Overview
On Site
$50 - $55
Contract - Independent
Contract - W2
Skills
Apache Flink
Apache HTTP Server
Apache Kafka
Collaboration
Continuous Delivery
Continuous Integration
Data Engineering
Data Flow
Data Modeling
Data Processing
Elasticsearch
Electronic Commerce
Financial Services
High Availability
Incident Management
Java
Kubernetes
Management
Production Support
Python
Real-time
Scala
Splunk
Streaming
Terraform
Job Details
We are seeking a skilled Data Engineer with hands-on experience in real-time data processing for distributed transactional systems. The ideal candidate has strong knowledge of OpenSearch, Kafka, Apache Flink, and Kubernetes, and has worked in a production support environment, ensuring stability, monitoring, and on-call support for live data pipelines.
Key Responsibilities
- Design, build, and support real-time streaming data pipelines.
- Work with Kafka and Apache Flink to process large-scale data in real time.
- Manage and scale infrastructure using Kubernetes.
- Index and query log/event data using OpenSearch.
- Ensure high availability and reliability of data systems through effective monitoring and alerting using Splunk, Wavefront, PagerDuty, or similar tools.
- Participate in on-call rotations to support production systems and resolve incidents.
- Collaborate with engineering and product teams to optimize data flow across systems.
Requirements
- 4 6 years of experience as a Data Engineer, preferably in environments with distributed transactional systems.
- Strong experience with:
- Apache Kafka
- Apache Flink (or equivalent stream processing frameworks)
- OpenSearch (or Elasticsearch)
- Kubernetes (deployment, scaling, monitoring)
- Familiarity with monitoring and incident response tools like:
- Splunk, Wavefront, PagerDuty, etc.
- Experience with on-call production support and troubleshooting live systems.
- Solid understanding of data modeling, streaming architectures, and event-driven systems.
Preferred Qualifications
- Experience in financial services, e-commerce, or other high-volume transactional environments.
- Exposure to CI/CD pipelines and infrastructure as code (e.g., Terraform, Helm).
- Familiarity with Java, Scala, or Python in the context of data engineering.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.