About the Role
We are seeking a skilled ETL Developer with strong expertise in Python and Apache Airflow to design, build, and optimize scalable data pipelines. In this role, you will develop production-ready workflows, ensure pipeline reliability, and collaborate with data teams to support business needs.
Responsibilities
· Develop, test, and deploy Python-based ETL pipelines using Apache Airflow.
· Write efficient, reusable Python scripts for transformations, validations, and data quality checks.
· Manage scheduling, orchestration, and monitoring of workflows in Airflow.
· Collaborate with data engineers and analysts to design pipelines aligned with business requirements.
· Troubleshoot, optimize, and scale existing ETL jobs.
· Implement best practices for code quality, testing, and CI/CD integration.
· Contribute to documentation, observability, and knowledge sharing.
Required Skills
· Strong experience with Python (pandas, SQLAlchemy, or similar libraries for ETL).
· Proficiency with Apache Airflow DAG design, task orchestration, and operators.
· Hands-on experience with dependency/environment management (pipenv, poetry, or conda).
· Solid knowledge of SQL and relational databases.
· Understanding of data modeling and transformation patterns (star schema, SCDs, etc.).
· Familiarity with Git workflows and CI/CD pipelines.
· Ability to work independently and collaboratively in a fast-paced environment.
Nice to Have
· Cloud platform experience (AWS, Google Cloud Platform, or Azure) for pipelines and storage.
· Familiarity with containerization tools (Docker, Kubernetes).
· Exposure to data warehouses (Snowflake, BigQuery, Redshift).
Never miss an opportunity! Create an alert based on the job you applied for.
