Overview
Remote
On Site
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
ML data infrastructure
GCP data & ML services
BigQuery
Dataflow
Cloud Storage
Vertex AI Feature Store
Cloud Composer
Dataproc
Spark
Beam
Flink
Kafka
Pub/Sub
Kinesis
Job Details
Senior ML Platform Engineer
We re looking for a seasoned engineer to help build and scale our ML data infrastructure platform. In this role, you ll design and develop the systems that power efficient data preparation, feature engineering, and dataset management laying the foundation for advanced machine learning capabilities.
What You ll Do
Design and implement scalable data processing pipelines for ML training and validation.
Build and maintain feature stores for batch and real-time features.
Develop frameworks for data quality monitoring, validation, and testing.
Implement dataset versioning, lineage tracking, and reproducibility systems.
Create automated data documentation and discovery tools.
Optimize storage and access patterns for ML workloads.
Collaborate with data scientists to streamline data prep workflows.
What You Bring
7+ years of software engineering experience, including 3+ years in data infrastructure.
Strong expertise with Google Cloud Platform data & ML services: BigQuery, Dataflow, Cloud Storage, Vertex AI Feature Store, Cloud Composer, Dataproc.
Deep knowledge of data processing frameworks (Spark, Beam, Flink).
Hands-on experience with feature stores (Feast, Tecton) and data versioning tools.
Proficiency in Python and SQL.
Experience with data quality/testing frameworks and pipeline orchestration (Airflow, Dagster).
Nice to Have
Experience with streaming systems (Kafka, Pub/Sub, Kinesis).
Knowledge of Google Cloud Platform security, IAM, logging, monitoring.
Familiarity with Cloud Build/Deploy for CI/CD.
Exposure to ML metadata management, data governance, or dbt.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.