Overview
Skills
Job Details
Role: ETL Developer
Location : Jersey City, NJ
Job Description:
Required Skills & Qualifications:
Design and develop scalable ETL pipelines using AWS services such as:
- AWS Glue for serverless data integration
- AWS Lambda for lightweight transformations
- Amazon S3 for data lake storage
- Amazon Redshift or RDS for data warehousing
Integrate data from diverse sources including APIs, databases, and flat files into AWS-based data platforms.
Implement data transformation logic using PySpark, Python, or SQL within AWS Glue or Lambda.
Monitor, schedule, and orchestrate ETL workflows using AWS Step Functions, Glue Workflows, or Apache Airflow on Amazon MWAA.
Ensure data quality, consistency, and lineage using AWS Glue Data Catalog and AWS Lake Formation.
Optimize ETL performance and cost-efficiency through partitioning, parallelism, and resource tuning.
Implement security best practices including encryption, IAM roles, and VPC configurations.
Collaborate with data engineers, analysts, and DevOps teams to support analytics and reporting needs.
Document ETL processes, data flows, and architecture using tools like AWS Architecture Diagrams or Confluence.
Equal opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.