Data Engineer with Flink and Kafka

Columbus, OH, US • Posted 9 hours ago • Updated 9 hours ago
Contract W2
12 Months
No Travel Required
On-site
$60 - $65/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Flink
  • Kafka

Summary

Job Title: Data Engineer with Flink and Kafka
Location: Columbus, OH
Type: W2
Job Summary
We are looking for an experienced Data Engineer with strong expertise in Apache Flink and Apache Kafka to design, develop, and maintain scalable, real-time data processing pipelines. The candidate will work on high-volume streaming data applications, ensuring low-latency processing, data quality, fault tolerance, and reliable integration with downstream systems.
Key Responsibilities
  • Design, develop, and maintain real-time data pipelines using Apache Flink and Apache Kafka.
  • Build stream-processing applications using Flink DataStream API, Table API, and Flink SQL.
  • Develop Kafka producers and consumers, manage topics and partitions, and optimize consumer groups.
  • Implement event-time processing, watermarks, windowing, stateful computations, and complex event processing.
  • Configure Flink checkpoints, savepoints, state backends, and recovery mechanisms.
  • Implement reliable streaming pipelines with appropriate delivery guarantees and idempotent processing.
  • Integrate Kafka and Flink with databases, data lakes, REST APIs, and downstream analytical platforms.
  • Perform performance tuning, troubleshoot latency, monitor backpressure, and resolve production issues.
  • Implement data validation, schema evolution, error handling, and dead-letter queue mechanisms.
  • Collaborate with architects, DevOps teams, business analysts, and other engineering teams.
  • Participate in code reviews, unit testing, integration testing, deployment, and production support.
  • Follow security, governance, coding standards, and CI/CD best practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90915265
  • Position Id: 9121957
  • Posted 9 hours ago
Contact the job poster
AS

Anusha Santhosh

Recruiter @ LiveMindz

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.