AWS Data Platform Engineer

  • New York, NY
  • Posted 1 hour ago | Updated 1 hour ago

Overview

On Site
Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 6 Month(s)

Skills

AWS Data Platform Engineer
ETL/ELT processes
AWS Lake Formation
control and governance.
Spark on EMR (EC2)
Redshift
Athena
and Glue
IAM
KMS
encryption
and governance frameworks
Data Lake & Governance:S3
Lake Formation
EMR on EC2
Spark
Glue
Kinesis
pache Hudi
Iceberg
Trino
Design Data Products
Data fabric

Job Details

Role- AWS Data Platform Engineer
Location- 3 days onsite in either Toronto or New York

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL/ELT processes using AWS-native and complementary tools.
  • Build and manage data lakes with AWS Lake Formation, including fine-grained access control and governance.
  • Develop and optimize large-scale data processing solutions using Spark on EMR (EC2).
  • Implement and manage data warehouse and analytics solutions using Redshift, Athena, and Glue.
  • Partner with client teams to integrate multiple data sources and downstream applications.
  • Ensure platform security and compliance using IAM, KMS, encryption, and governance frameworks.
  • Monitor, troubleshoot, and optimize data pipelines and query performance across Athena, Redshift, and EMR.
  • Contribute to engineering standards, code reviews, and best practices, while mentoring junior engineers.

Required Skills & Experience

  • 10+ years of professional experience in data engineering, with at least 5+ years on AWS data platforms.
  • Strong expertise with AWS services:
    • Data Lake & Governance: S3, Lake Formation
    • Data Processing & Analytics: EMR on EC2, Spark, Athena, Redshift, Glue, Kinesis
    • Orchestration & Monitoring: CloudWatch, Step Functions, Airflow (or similar)
  • Proficiency in SQL and at least one programming language (Python, Scala, or Java).
  • Solid understanding of data modeling, schema design, and query optimization.
  • Hands-on experience with infrastructure-as-code (Terraform, CloudFormation, or CDK).
  • Knowledge of DevOps practices and CI/CD for data engineering (GitHub Actions, CodePipeline, etc.).
  • Experience with structured, semi-structured (JSON, Parquet, Avro), and unstructured data.
  • Strong communication skills with the ability to work independently in client-facing teams.

Must have skills Strong hands on programming exp in python, experience in creating and managing data platforms on AWS with IaaC ( terraform ), Spark, EMR, Lake formation, Athena

Good to Have Skills Apache Hudi, Iceberg , Trino, Design Data Products, Data fabric

Regards

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.