Overview
Skills
Job Details
Avanciers are seeking an experienced ETL Developer with deep expertise in AWS Glue, PySpark, and Lambda, and proven hands-on experience in the banking or financial services domain. The ideal candidate will design, develop, and maintain scalable ETL pipelines within a secure AWS environment to ensure high-quality, performant, and cost-efficient data flows.
Key Responsibilities
Design and develop scalable ETL pipelines using AWS Glue and Lambda for data integration and transformation.
Integrate data from APIs, databases, and flat files into AWS-based platforms.
Implement complex transformation logic using PySpark, Python, or SQL within AWS Glue or Lambda.
Orchestrate and monitor workflows using AWS Step Functions, Glue Workflows, or Apache Airflow (Amazon MWAA).
Ensure data quality, consistency, and lineage via AWS Glue Data Catalog and Lake Formation.
Optimize performance and cost through partitioning, parallelism, and resource tuning.
Document data flows and ETL architecture using tools like Confluence or AWS Architecture Diagrams.
Required Skills
ETL Development – 5+ years
AWS Glue & AWS Lambda – Expert level
PySpark & Python – Strong proficiency
AWS Step Functions / Airflow (MWAA) – Workflow orchestration experience
Banking/Fintech Domain Knowledge – Mandatory
Good to Have
Experience with AWS Lake Formation, Glue Data Catalog, or Athena
Familiarity with data governance and metadata management
Strong communication and documentation skills