Overview
Skills
Job Details
A globally leading technology company is seeking an experienced Data Engineer to support large-scale data operations for machine learning workflows. You will work closely with external data vendors and internal teams to ingest, validate, curate, and organize high-quality datasets, enabling downstream ML model development. This role requires a strong background in Python and experience working with AWS S3-based pipelines. All qualified candidates are welcome to apply!
Job Responsibilities:
Collaborate with external data collection vendors to track and ingest incoming datasets.
Design and execute robust data validation and curation pipelines to ensure data quality and consistency.
Implement logic to bin and categorize data according to project-specific criteria.
Run pseudo-labeling workflows on newly ingested data using pre-trained ML models.
Maintain clear status and versioning of datasets throughout their lifecycle.
Distribute and deliver validated data assets to various internal product and ML teams.
Maintain logs and reports to ensure traceability and accountability across data operations.
Candidate Requirements:
5+ years of industry experience in data engineering, data pipelines, or ML infrastructure.
Strong proficiency in Python, including data processing and scripting.
Experience working with AWS S3 for managing and organizing large-scale datasets.
Familiarity with data quality assurance and curation processes.
Comfortable operating in Unix/Linux environments, with familiarity in using command-line tools.
Strong communication and coordination skills, especially when collaborating with external vendors and distributed teams.
Self-driven, organized, and able to handle multiple data workflows in parallel.
Nice to Have:
Experience with ML pipelines, especially pseudo-labeling or active learning.
Familiarity with data versioning tools or frameworks (e.g., DVC, LakeFS).
Prior experience in managing vendor relationships or annotation workflows.
Speak multiple languages
Type: Contract (W2)
Duration: 12 months (with a possibility to extend)
Work Location: Seattle,WA (On site)
Pay Rate: $ 60.00 - $ 80.00/HR (DOE)