Overview
On Site
Hybrid
BASED ON EXPERIENCE
Full Time
Contract - Independent
Contract - W2
Skills
GCP
GOOGLE CLOUD
DATASTAGE
DATA STAGE
BIGQUERY
AIRFLOW
Job Details
Job Title: Data Engineer
Location: Remote (Preferred: MN)
Duration: 6 Months Contract-to-Hire (CTH)
Job Description:
We are seeking a skilled Data Engineer to support critical data modernization initiatives, including the migration of data to Google Cloud Platform (Google Cloud Platform) and the buildout of a BigQuery data warehouse. This role is hands-on, involving ETL pipeline development, orchestration, and cloud data engineering.
Key Responsibilities:
Required Skills:
Nice to Have:
Location: Remote (Preferred: MN)
Duration: 6 Months Contract-to-Hire (CTH)
Job Description:
We are seeking a skilled Data Engineer to support critical data modernization initiatives, including the migration of data to Google Cloud Platform (Google Cloud Platform) and the buildout of a BigQuery data warehouse. This role is hands-on, involving ETL pipeline development, orchestration, and cloud data engineering.
Key Responsibilities:
- Migrate legacy ETL pipelines from IBM DataStage to modern cloud-based solutions.
- Design and develop new data pipelines using SnapLogic, Python, SQL, Dataflow, and Spark.
- Build and orchestrate DAGs using Airflow or Cloud Composer.
- Support data warehousing efforts in Google BigQuery, including data modeling and performance tuning.
- Collaborate with cross-functional teams to sunset legacy systems and ensure data quality and reliability.
Required Skills:
- IBM DataStage - strong understanding of legacy ETL workflows.
- Airflow or Cloud Composer - experience building DAGs from scratch.
- Python, SQL, Spark, Dataflow - for modern ETL/ELT development.
- Google BigQuery - strong data warehousing experience.
- SnapLogic - preferred (not mandatory), experience building integrations and pipelines.
Nice to Have:
- Experience with Redshift-to-BigQuery migrations.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.