Data Engineer

Overview

On Site
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

Kafka
Flink
Spark
Avro
CQRS
ETL
FIVETRAN
Data Dog
IAC
Terraform
CI/CD
AWS Kinesis

Job Details

NO C2C ONLY ON W2

We have an immediate requirement @TX

Job Description:

  • Extensive experience (5+ years) with event streaming platforms (Kafka preferred), stream processing frameworks (Flink, Spark Streaming), and data serialization formats (Avro, Protobuf, JSON).
  • Deep understanding of event-driven architectures, CQRS, and event sourcing.
  • Extensive experience with ETL/ELT tools, specifically Fivetran; demonstrated ability to design, implement, and optimize Fivetran-based data pipelines. This includes experience with connector configuration, data transformation, and schema management within Fivetran.
  • Proficiency in monitoring and observability tools (Datadog, Prometheus, Grafana, or similar).
  • Strong experience with Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation).
  • Proven ability to automate tasks and implement CI/CD pipelines.
  • Strong problem-solving and communication skills.

Nice-to-Have Skills:

  • Experience with cloud-based streaming services (AWS Kinesis, Azure Event Hubs, Google Cloud Platform Pub/Sub).
  • Experience with application development frameworks (Spring Boot, Node.js, etc.).
  • Familiarity with Kubernetes and container orchestration.
  • Experience with various database technologies (SQL and NoSQL).
  • Real-time analytics and dashboarding experience.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.