Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Job Details
Join our team as an AWS Data Engineer, where you'll innovate and develop scalable AWS-native platforms and data layers. This role offers the chance to work on advanced cloud engineering projects in a collaborative and dynamic environment.
Responsibilities
- Design and implement AWS Lakehouse architectures to enhance data storage and processing efficiency.
- Develop modular, testable Python code for data engineering and production-grade pipelines.
- Create and manage Bronze, Silver, and Gold data layers using Medallion Architecture.
- Utilize AWS services like S3, Glue, and Athena for efficient ETL processes.
- Work closely with cross-functional teams to ensure smooth integration of data solutions.
- Document processes and communicate effectively with stakeholders throughout project lifecycles.
Skills
- Strong proficiency in Python programming tailored for data engineering tasks.
- Proven experience with AWS services and cloud architecture design.
- Solid understanding of open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi.
- Experience with Slowly Changing Dimensions (SCD Type 2) in distributed data systems.
- Excellent communication and teamwork abilities.
Preferred Skills
- Familiarity with orchestration tools like EMR on EKS or Argo Workflows.
- Experience with data visualization tools such as AWS Quicksights, Tableau, or Cognos.
- Knowledge of best practices for data ingestion, transformation, and curation.
At Horizontal, we are committed to fostering a diverse and inclusive workplace where all individuals are valued and empowered to contribute to our collaborative culture.
Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.