Data Engineer with Google Cloud Platform BQ, Dataflow, Dataproc, and Composer (Airflow)

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 6 Month(s)

Skills

Data Architecture
BTEQ
Collaboration
Conflict Resolution
Continuous Delivery
Continuous Integration
Data Warehouse
Debugging
Extract
Transform
Load
Good Clinical Practice
Data Engineering
Data Flow
Google Cloud Platform
Management
Orchestration
Data Governance
Data Integration
Data Quality
ELT
Google Cloud
JavaScript
Performance Tuning
Problem Solving
Python
Real-time
SQL
Teradata
Workflow

Job Details

Title: Data Engineer with Google Cloud Platform BQ, Dataflow, Dataproc, and Composer (Airflow)
Location: Irving, TX (Onsite from Day 1)
Duration: 12+ Months
Rate: OPEN
Visa Status: TN, USA
Relevant Experience: 8+ years

Job Description:

  • Design, develop, and maintain scalable data pipelines and data architecture solutions in Google Cloud Platform.
  • Refactor and migrate legacy Teradata ETL logic into Google Cloud Platform Dataflow, Dataproc, or BigQuery workflows.
  • Build and optimize ETL/ELT data pipelines using Python/Java scripting and Google Cloud Platform native services.
  • Manage data integration from multiple sources into BigQuery with efficient transformations.
  • Implement data quality, performance tuning, and error handling mechanisms in pipelines.
  • Collaborate with cross-functional teams to define and implement best practices in data governance and CI/CD for Google Cloud Platform.
  • Leverage Pub/Sub for real-time data ingestion and Composer (Airflow) for workflow orchestration.

Minimum Qualifications:

  • 10+ years of overall IT experience.
  • 4 6 years of experience in Data Architecting.
  • 4 6 years of experience in Data Engineering.
  • At least 2 years of recent experience in Google Cloud Platform (Google Cloud Platform).
  • Strong hands-on experience with Teradata Data Warehousing, BTEQ, and complex SQL.
  • Familiarity with CI/CD processes and tools for data engineering workflows.
  • Excellent problem-solving and debugging skills.

Must-Have Skills:

  • Google Cloud Platform BigQuery
  • Cloud Storage
  • Dataflow
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.