Overview
Skills
Job Details
Senior Data Engineer / Lead - Google Cloud Platform Native Platform with 12+ yrs of exp - Dallas TX - Hybrid work
Senior Data Engineer - Google Cloud Platform Native Platform
Role Summary
Seeking an experienced Senior Data Engineer to design and build scalable data pipelines on Google Cloud Platform. You will implement data solutions using BigQuery, Dataow, Cloud Composer, and modern engineering practices while mentoring junior team members and driving technical excellence.
Key Responsibilities
Pipeline Development & Engineering
Build and optimize data pipelines using Dataow (Apache Beam) for batch and streaming workloads
Develop Airow DAGs in Cloud Composer for workow orchestration
Implement ELT processes using Dataform for SQL-based transformations
Design and maintain BigQuery datasets following medallion architecture patterns
Create reusable pipeline templates and frameworks for accelerated development
Data Platform Implementation
BigQuery: Develop optimized schemas, partitioning strategies, and materialized views
Dataow: Build Apache Beam pipelines in Python/Java for complex transformations
Cloud Composer: Create and maintain Airow workows with proper dependency management
Dataform: Write SQLX transformations, tests, and documentation
Pub/Sub: Implement event-driven data ingestion and CDC patterns
Cloud Storage: Manage data lake structures and lifecycle policies
Technical Delivery
Partner with architects to implement technical designs and standards
Conduct code reviews and ensure engineering best practices
Troubleshoot and optimize pipeline performance and costs
Implement data quality checks and monitoring solutions
Support production deployments and incident resolution
Collaboration & Mentorship
Mentor junior engineers on Google Cloud Platform technologies and best practices
Collaborate with cross-functional teams including analysts and data scientists
Document technical solutions and create knowledge base articles
Participate in agile ceremonies and sprint planning
Support onshore/offshore team coordination
Required Qualications
Experience
5+ years data engineering experience, 2+ years with Google Cloud Platform
Hands-on experience with BigQuery at enterprise scale
Strong background in building production data pipelines
Experience with Python and/or Java development
Proven track record of delivering complex data solutions
Technical Skills
Core Requirements:
BigQuery (SQL optimization, scripting, stored procedures)
Apache Beam/Dataow development
Airow/Cloud Composer DAG creation
SQL and Python programming prociency
Git version control and CI/CD pipelines
Additional Skills:
Dataform or dbt experience
Infrastructure-as-Code (Terraform basics)
Data modeling and schema design
API integration and REST services
Cloud Monitoring and logging
Data quality frameworks
Preferred Qualications
Google Cloud Platform Professional Data Engineer certication
Experience with:
Vertex AI for ML pipeline integration
Cloud Functions for serverless processing
Dataproc for Spark workloads
Real-time streaming architectures
Knowledge of data governance tools (Atlan, Collibra, Dataplex)
Experience with legacy system migrations
Familiarity with Power BI or Looker
Container technologies (Docker, Kubernetes)
Location
[Remote/Hybrid/On-site]
Equal Opportunity Employer
We are committed to building a diverse and inclusive team.