Data Pipeline Engineer

A global leader in consumer technology is looking for a talented Data Engineer to join its Cloud Services innovation group, focused on developing cutting-edge, cloud-based mobile applications and services. In this role, you ll help design and build secure, scalable data infrastructure that powers AI-driven products used by millions worldwide. You ll collaborate with world-class engineers to productize research projects and support robust, cloud-based platforms for mobile ecosystems. This is an exciting opportunity to shape the next generation of intelligent cloud services at the forefront of mobile innovation.
Job Responsibilities:
Implement, maintain and evolve big data platform and infrastructure
Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
Perform extensive research and analysis to make optimal architecture and design decisions
Write large amounts of code, perform code reviews, write unit tests and documentation
Interface with other groups including Product Management, QA and Operations
Create quick proof-of-concept prototypes
Work in a scrum team with ML & Cloud Engineers
Candidate Requirements:
Hand-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & Kafka
Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
Hands-on experience in building REST API s
Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
Desire to learn fast and pick up latest and greatest technologies
MS in Computer Science or equivalent experience
Preferred:
Programming Language: Python
Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
Machine Learning: PyTorch, TensorFlow, Spark ML
REST API: Flask, FastAPI, or Django
Data Quality tools such as Monte Carlo, Great Expectations, or Databand
Experience with teams using MLflow

Type: Contract
Duration: 12 months (with possibility to extend)
Work Location: Mountain View, CA (on-site)
Pay rate: $70.00 - $95.00 (DOE)