ETL DAG architect - Atlanta, GA - Hybrid. Must be deep expertise in Apache Airflow and Astronomer. Must have skills DAGs, Operators, Sensors, XComs, TaskFlow API, AWS (EKS, ECS, S3, Lambda, Secrets Manager, CloudWatch), Snowflake, Databricks, SQL Server, REST APIs, and message queues (Kafka/SQS), CI/CD pipelines (GitHub Actions, Jenkins, or GitLab CI), Docker and Kubernetes

We need Strong Airflow /Astromaur
Design, develop, and maintain Apache Airflow DAGs for complex, multi-step workflows in the banking and financial domain.
Deploy and manage Airflow environments using Astronomer on AWS (EKS / ECS).
Develop custom Airflow operators, hooks, and sensors to integrate with external systems (Snowflake, Databricks, SQL Server, APIs, etc.).
Implement error handling, retries, SLAs, and alerting mechanisms for all DAGs.
Collaborate with DevOps teams to containerize and deploy workflows using CI/CD pipelines.
Optimize DAG performance and scalability for large-volume banking data operations.
Ensure compliance with data security and governance standards (e.g., masking, auditing, logging).
Participate in code reviews, architecture discussions, and design documentation.
Automate environment setup, configuration, and deployment of Astronomer/Airflow clusters.
Required Skills & Experience:
8+ years of hands-on Python development experience.
3+ years of production experience with Apache Airflow (2.x) preferably Astronomer Airflow.
Strong understanding of Airflow concepts: DAGs, Operators, Sensors, XComs, TaskFlow API, etc.
Experience deploying Airflow in AWS (EKS, ECS, S3, Lambda, Secrets Manager, CloudWatch).
Experience integrating with Snowflake, Databricks, SQL Server, REST APIs, and message queues (Kafka/SQS).
Good understanding of data orchestration patterns, dependency management, and parallel execution.
Proficiency in CI/CD pipelines (GitHub Actions, Jenkins, or GitLab CI).
Familiar with Docker and Kubernetes deployments.
Knowledge of banking data workflows (payments, transactions, reconciliation, reporting) is a plus.
Strong communication and documentation skills:
Experience with Astronomer Cloud or Astronomer Enterprise.
Exposure to data governance frameworks and financial compliance.
Familiarity with IaC tools (Terraform or CloudFormation).
Basic knowledge of ETL frameworks or data transformation tools