Data Integration Engineer

Hybrid in Libertyville, IL, US • Posted 1 hour ago • Updated 1 hour ago
Contract W2
12 Months
75% Travel Required
Hybrid
$55 - $60/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Kafka
  • MDM
  • Data Integration

Summary

Job Title: Senior Apache Kafka DeveloperExperience: 7–10+ YearsLocation: Mettwa, IL, USA (4 days at work)Employment Type: Contract / Full-Time
Industry: Life science is preferred We are seeking a highly skilled Data Integration Engineer to design, build, andoptimize our next-generation data streaming pipelines and integration services. In thisrole, you will be responsible for building real-time and batch data pipelines that bridgeour operational systems, cloud data warehouse, and Master Data Management (MDM)platforms. You will leverage a modern data stack centered around Python, FastAPI,Apache Kafka, Snowflake, and Reltio to ensure our data is fluid, synchronized, andhighly reliable. Pipeline Development: Design and deploy scalable real-time streamingpipelines using Confluent Apache Kafka and robust batch ETL/ELT workflowsusing Python. API Ingestion & Microservices: Build and maintain high-performance,asynchronous REST APIs and data connectors using FastAPI to facilitateseamless app-to-app data integrations. Data Warehousing: Optimize data extraction from Snowflake using Snowpipe,streaming ingestion frameworks, and advanced SQL transformations into Kafkatopics Master Data Management (MDM): Integrate data sources with the Reltioplatform via the Reltio Integration Hub (RIH) and APIs to manage entityresolution, data cleansing, and consolidate golden customer/product profiles. System Monitoring: Implement automated monitoring, error handling, validationchecks, and data quality routing across all integration layers. Collaboration & DevOps: Work closely with Data Science, Analytics, andSoftware Engineering teams to understand data requirements and implementCI/CD deployment pipelines for data services.Required Skills:CoreProgramming

Strong Python proficiency with hands-on experience utilizingasynchronous frameworks like FastAPI.

Streaming &Messaging

Deep understanding of Apache Kafka architecture (topics,partitions, producers/consumers, schema registries).

DataWarehousing

Expert knowledge of Snowflake architecture, queryoptimization, and native ingestion tooling.

MDM Platforms Direct experience working with Reltio multidomain MDM,

workflow modelers, or Reltio data pipelines.

Database Skills Advanced SQL capability alongside knowledge of transactional

databases, NoSQL systems, and JSON parsing.

Experience required:5 years of industry experience implementing data integration projects.
 
Reltio or MDM or Kafka or Integration engineer
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91164964
  • Position Id: 9136047
  • Posted 1 hour ago

Company Info

About Virtualan Software

Virtualan Software is a prominent IT services and consulting firm that excels in various technological domains.

We specialize in delivering innovative IT solutions that empower businesses to achieve their goals. Our expertise spans a wide range of technologies, ensuring that we can provide the right solution for your unique needs.

Virtualan Software specializes in developing products using Low Code Technology that is designed to streamline and automate various testing and development processes. All products are designed to be cloud-ready, ensuring seamless integration and deployment in cloud environments.

Contact the job poster
RS

Reegana Sulthana

Recruiter @ Virtualan Software

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.