Title: ETL Developer -SQL, Apache Airflow
Location: Richfield, MN (Hybrid - 2 days/Week)
Duration: 12 months contract
Position Summary/Job Description:
Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.
Skills Overview:
What are the top five skills and number of years of experience required to perform this job?
- SQL (5+ years)
- Apache Airflow (Cloud Composer) (3+ years)
- Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
- Python (5+ years)
- Big Data (warehousing/processing concepts, performance)(5+ years)
- Postgres (3+)
Experience
- Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
- Build ELT/ETL on Google Cloud Platform services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
- Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
- Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
- Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
- Integrate Postgres sources/targets
- Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.
What are some preferred/nice to have skills the manager is looking for?
- Who has worked in ads domain.
- Should be able to talk to stakeholders and understand the problem and solve it efficiently
- Preventing data quality issues before they impact users.
- Prioritizing projects and handling multiple requests.
Never miss an opportunity! Create an alert based on the job you applied for.