Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 6 Month(s)
Skills
Python
GCP
Google Cloud Platform
BigQuery
Dataflow
Composer
MLOps
Data Engineering
Machine Learning
Data Pipelines
Infrastructure
Monitoring
Logging
Alerting
Cost Optimization
Data Governance
Data Lineage
CI/CD
DevOps
Airflow
Terraform
Kubernetes
ML Platform
Feature Engineering
Batch Pipelines
Cloud Infrastructure
Rollout Strategy
Runbooks
Cloud Computing
Continuous Integration
Data Processing
Good Clinical Practice
Data Flow
IaaS
Machine Learning Operations (ML Ops)
Machine Learning (ML)
Continuous Delivery
Job Details
We are seeking a Senior Data Infrastructure Engineer with deep expertise in Python, Google Cloud Platform (Google Cloud Platform), and MLOps to join our growing data engineering team. You will be responsible for building scalable data pipelines, optimizing cost and performance, and supporting machine learning workflows across our organization.
Key Responsibilities
- Develop and enhance Python frameworks and libraries for:
- Cost tracking
- Data processing
- Data quality
- Lineage
- Governance
- MLOps
- Optimize data processing workflows to reduce costs for large-scale training data and feature pipelines.
- Build scalable batch pipelines using BigQuery, Dataflow, and Composer on Google Cloud Platform (Google Cloud Platform).
- Implement robust monitoring, logging, and alerting systems to ensure infrastructure reliability.
- Plan and execute infrastructure rollouts with phased deployments, validation, and rollback strategies.
- Serve as the primary liaison for Data Scientists, ML Engineers, and other stakeholders during rollout coordination and issue resolution.
- Collaborate with ML Platform Engineers to ensure seamless integration of updates.
- Document processes and changes, creating clear runbooks and handoff materials for ongoing support.
Required Skills & Qualifications
- Strong proficiency in Python and experience with building reusable libraries and frameworks.
- Hands-on experience with Google Cloud Platform (Google Cloud Platform) services: BigQuery, Dataflow, Composer, Cloud Monitoring, etc.
- Solid understanding of MLOps, data governance, and data lineage principles.
- Experience with CI/CD, infrastructure as code, and DevOps practices.
- Excellent communication and collaboration skills.
- Proven ability to manage infrastructure rollouts and support cross-functional teams.
Preferred Qualifications
- Experience with Terraform, Kubernetes, or Airflow.
- Familiarity with machine learning workflows and feature engineering pipelines.
- Background in data quality frameworks and cost optimization strategies.
Python, Google Cloud Platform, Google Cloud Platform, BigQuery, Dataflow, Composer, MLOps, Data Engineering, Machine Learning, Data Pipelines, Infrastructure, Monitoring, Logging, Alerting, Cost Optimization, Data Governance, Data Lineage, CI/CD, DevOps, Airflow, Terraform, Kubernetes, ML Platform, Feature Engineering, Batch Pipelines, Cloud Infrastructure, Rollout Strategy, Runbooks
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.