ETL Developer

ETL Developer
Location : Chicago, IL day one onsite

POSITION OVERVIEW
The technology team is seeking a Senior ETL Developer IV to lead the design, implementation, and optimization of massive-scale enterprise backend ETL and data analytics services within an AWS cloud ecosystem. The mission is to build robust, highly automated data pipelines that extract, transform, and load data from disparate systems to support enterprise reporting and analytics initiatives.

DAY-TO-DAY RESPONSIBILITIES

• Lead, design, implement, deploy, and optimize backend ETL services and data processing procedures.
• Support a massive-scale enterprise data solution using AWS data and analytics services.
• Analyze and interpret complex data and related systems, providing efficient technical solutions.
• Provide support to ETL schedules and maintain strict compliance with schedule execution.
• Develop and maintain standards for ETL code and maintain an effective project lifecycle across all ETL processes.
• Coordinate with cross-functional teams including architects, platform engineers, other developers, and product owners to build data processing workflows.
• Perform root cause analysis on production issues, conduct routine database monitoring, and provide operational support to ETL environments.
• Help create functional specifications and technical designs while partnering with business process area owners.
• Implement industry best practice code and configurations for production and non-production environments in a highly automated environment.
• Provide technical advice, effort estimates, and architectural impact analyses.
• Provide timely project status and incident/issue reporting to management.
• Support and troubleshoot critical production pipeline issues during odd hours in the event of major incidents.

REQUIRED SKILLS

• 6+ years of experience using ETL tools to perform data cleansing, data profiling, transforming, and scheduling diverse workflows.
• 6+ years of expert-level proficiency writing, debugging, and optimizing complex SQL queries.
• 3–4 years of programming experience writing complex code using Python or PySpark/Glue for large-scale data sets.
• 3–4 years of hands-on experience using core AWS services: AWS Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL, CloudWatch, SNS, SQS, and EventBridge.
• 3+ years of experience in Big Data processing, applying common design patterns, data models, and scalable architectures.
• Demonstrated capability troubleshooting database internals and common issues (e.g., AWS RDS MySQL).
• Hands-on experience with CI/CD and Infrastructure as Code (IaC), specifically Harness and developing/maintaining YAML and CloudFormation scripts.

ADDITIONAL DESIRED SKILLS

• Prior experience serving as a technical lead for a decent-sized ETL/data engineering team.
• Hands-on experience with Apache Iceberg table format for large analytic datasets.
• Familiarity with enterprise observability and application performance monitoring tools such as Dynatrace or DataDog.