AWS Data Platform Engineer (Hybrid Cloud)
Location: Dallas, TX
We are seeking an experienced AWS Data Platform Engineer to design, build, and operate enterprise-grade data pipelines across both on-premises and AWS cloud environments. This role will be instrumental in building the foundation of our enterprise data platform, enabling secure, scalable, and governed data ingestion, processing, and analytics. The ideal candidate has hands-on experience developing distributed data pipelines, deploying cloud-native infrastructure, and integrating data from diverse enterprise systems while adhering to security, governance, and operational best practices.
Key Responsibilities
Design, develop, and maintain scalable data pipelines across hybrid (on-premises and AWS) environments.
Build and optimize streaming and batch data ingestion pipelines for structured and unstructured data.
Develop reusable data engineering frameworks that support enterprise-scale analytics and AI initiatives.
Integrate data from multiple enterprise sources, including:
IoT and sensor data
Finance and ERP systems
Procurement applications
Security and audit logs
Operational databases
APIs and event streams
Deploy and manage cloud-native data infrastructure using Infrastructure as Code (Terraform).
Build secure, governed data platforms following enterprise security and data governance standards.
Implement CI/CD pipelines and automate deployments for data platform components.
Collaborate with architecture, security, DevOps, and business teams to deliver reliable, scalable data solutions.
Required Technical Skills
Python
SQL
Terraform (Infrastructure as Code)
Apache Kafka
Apache Flink
Apache Beam
Apache Spark
Apache Airflow
Kubernetes (Amazon EKS)
Trino and/or Amazon Athena
Amazon S3
AWS Lambda
AWS IAM
AWS Lake Formation
GitHub
Harness
JFrog
Argo CD
Never miss an opportunity! Create an alert based on the job you applied for.