SENIOR AWS DATA ENGINEER

Overview

Hybrid
52 - 55
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship

Skills

AWS
S3
STEP FUNCTION
LAMBDA

Job Details

A Senior AWS Data Engineer designs, builds, and maintains scalable data pipelines (ETL/ELT) on AWS using services like S3, Glue, Redshift, Lambda, with Python/PySpark, SQL for complex transformations, orchestrating with tools like , ensuring data quality, security, governance, and performance optimization for analytics/BI, collaborating with stakeholders to translate needs into robust, cloud-native data solutions. 

Key Responsibilities:

  • Pipeline Development: Build, automate, and monitor scalable ETL/ELT data pipelines using Python, PySpark, Spark SQL, and AWS services (S3, Glue, Lambda, EMR, Redshift).
  • Data Modeling & Architecture: Design and implement data models, data lakes, data warehouses, and lakehouse architectures for analytics.
  • Orchestration: Develop and manage workflows using orchestrators like Airflow, EventBridge, or AWS Step Functions.
  • Performance Optimization: Tune and optimize data pipelines and queries for speed, cost-efficiency, and reliability.
  • Collaboration: Partner with data scientists, analysts, and business stakeholders to gather requirements and deliver data-driven solutions.
  • Quality & Governance: Implement data quality checks, security (encryption, access controls), and governance best practices.
  • Automation: Apply CI/CD, version control (Git), and testing to data workflows. 

Core Skills:

  • AWS: S3, Glue, EMR, Redshift, Lambda, Athena, Kinesis, SNS, SQS.
  • Programming: Advanced Python (data manipulation, APIs), SQL (expert level).
  • Big Data: Apache Spark, PySpark.
  • Tools: Airflow, , ,  (often).
  • Concepts: Data Warehousing, Data Lake, Data Modeling, Distributed Systems. 

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.