Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 6 Month(s)
No Travel Required
Skills
Apache Kafka
ELT
Informatica
Kubernetes
Terraform
Grafana
Prometheus
Datadog
SQL
NoSQL
Extract
Transform
Load
Real-time
Fivetran
Azure
AWS
Kafka
Redpanda
Google Cloud Platform
Job Details
Need:
Fivetran / Informatica IDMC/ Azure Data Factory/AWS Glue (or similar automation experience)
ETL/ELT
Requirements:
- Extensive Experience with Cloud and Data Platform Infrastructure Engineering.
- Extensive experience with event platforms on-prem or Cloud (Kafka, Redpanda, AWS Kinesis, Azure Event Hubs, Google Cloud Platform Pub/Sub), stream processing frameworks (Flink, Spark Streaming, Amazon Kinesis Data Streams, Google Cloud Dataflow ).
- Experience with ETL/ELT tools like Fivetran, and/or Informatica's cloud product, IDMC; demonstrated ability to design, implement, and optimize data pipelines. This includes experience with and automating connector configuration, data transformation, and schema management.
- Understanding of event-driven architectures, CQRS, and event sourcing.
- Proficiency in monitoring and observability tools (Datadog, Prometheus, Grafana, or similar).
- Strong experience with Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation).
- Proven ability to automate tasks and implement CI/CD pipelines.
- Strong problem-solving and communication skills.
- Experience with Kubernetes and container orchestration.
- Experience with various database technologies (SQL and NoSQL).
- Experience in supporting Real-time analytical need.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.