AWS Data Engineer

Role: AWS Data Engineer

Location: Houston, TX (3 days/week onsite)

We are seeking a skilled AWS Data Engineer who has experience working with Python, SQL, Glue, and Airflow.

Responsibilities:

• Design, build, and optimize ETLs using Python, SQL, Glue, Airflow, and other AWS services.
• Develop and maintain ETL workflows using Python, SQL, and AWS-native tools.

• Create SQL queries to segment, manipulate, and formatdata.
• Provide Run/DevOps support for data services, ensuring high availability and performance.
• Implement batch job scheduling and manage data dependencies using tools like Airflow or Step Functions.
• Maintain documentation for data flows, incident resolution, and operational procedures.
• Participate in on-call rotations and incident response for production systems.

• Build automations to ingest, transfer, move, upload, and manipulatedata.

• Build or maintain data ingestion pipelines that move data from source systems into Data Lake.

• Create and manage data models to ensure data integrity and facilitate efficient data analysis.

• Implement and maintain data security and compliance measures, including access controls, encryption, and data masking.

• Ensure data quality, accuracy, and consistency through data validation, cleansing, and monitoring.

Requirements:

• 5+ years of experience in data engineering.
• Strong proficiency in AWS services: S3, Glue, DMS.
• Solid programming skills in Python and SQL.

• Must have experience with Airflow.
• Advanced SQL query development proficiency

• Understanding of data modelling principles and techniques.

• Knowledge of data security best practices and compliance requirements.