Job Title: Senior Apache Kafka Developer
Experience: 7–10+ Years
Location: Mettwa, IL, USA (4 days at work)
Employment Type: Contract / Full-Time
Industry: Life science is preferred We are seeking a highly skilled Data Integration Engineer to design, build, and
optimize our next-generation data streaming pipelines and integration services. In this
role, you will be responsible for building real-time and batch data pipelines that bridge
our operational systems, cloud data warehouse, and Master Data Management (MDM)
platforms. You will leverage a modern data stack centered around Python, FastAPI,
Apache Kafka, Snowflake, and Reltio to ensure our data is fluid, synchronized, and
highly reliable.
Pipeline Development: Design and deploy scalable real-time streaming
pipelines using Confluent Apache Kafka and robust batch ETL/ELT workflows
using Python.
API Ingestion & Microservices: Build and maintain high-performance,
asynchronous REST APIs and data connectors using FastAPI to facilitate
seamless app-to-app data integrations.
Data Warehousing: Optimize data extraction from Snowflake using Snowpipe,
streaming ingestion frameworks, and advanced SQL transformations into Kafka
topics
Master Data Management (MDM): Integrate data sources with the Reltio
platform via the Reltio Integration Hub (RIH) and APIs to manage entity
resolution, data cleansing, and consolidate golden customer/product profiles.
System Monitoring: Implement automated monitoring, error handling, validation
checks, and data quality routing across all integration layers.
Collaboration & DevOps: Work closely with Data Science, Analytics, and
Software Engineering teams to understand data requirements and implement
CI/CD deployment pipelines for data services.
Required Skills:
Core
Programming
Strong Python proficiency with hands-on experience utilizing
asynchronous frameworks like FastAPI.
Streaming &
Messaging
Deep understanding of Apache Kafka architecture (topics,
partitions, producers/consumers, schema registries).
Data
Warehousing
Expert knowledge of Snowflake architecture, query
optimization, and native ingestion tooling.
MDM Platforms Direct experience working with Reltio multidomain MDM,
workflow modelers, or Reltio data pipelines.
Database Skills Advanced SQL capability alongside knowledge of transactional
databases, NoSQL systems, and JSON parsing.
Experience required:
5 years of industry experience implementing data integration projects.
