Apply Now

Data Engineer

• Posted 3 hours ago • Updated 46 minutes ago

Full Time

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

sql
Python
Spark

Summary

Data Engineer

The Difference You Will Make

We are looking for Data Engineers who are passionate about making a difference through their work. You will collaborate in a global, cross-functional environment and lead through influence and partnership to turn ideas into production-ready systems. In this role, you will help develop and evolve search and experimentation platforms, prototype solutions, and adopt advanced data technologies.

Required Experience

3 5 years of hands-on experience in a software engineering role, shipping high-quality code to production
Experience building or supporting high-scale, distributed systems, data pipelines, and/or analytical libraries

Technical Expertise

Programming & Data Engineering

Proficiency in Java, Scala, and Python (at least one required; others preferred)
Strong SQL expertise, with the ability to go deep when debugging or optimizing queries
Proficiency with SQL-based analytics and big data technologies, including:
- Hive
- Presto/Trino
- Spark
Deep, hands-on experience with at least one modern big data processing framework (e.g., Spark, Dataflow)

Nice to Have

Knowledge of cloud platforms, such as:
- AWS services (e.g., S3, EMR), or equivalent offerings from other cloud providers
Experience with scientific or statistical computation, especially related to online experimentation
Experience with feature stores, such as Chronon
Familiarity with AI coding assistants such as Claude Code and GitHub Copilot

Sample Projects & Areas of Impact

Data Pipelines & Evaluation Systems

Counterfactual evaluation:
- Support ad hoc metrics analysis
- Support pipeline debugging
- Support pipeline data migration
Offline counterfactual scoring support pipeline migration
Search simulator support pipeline migration
Offline interaction detection support pipeline migration

Monitoring, Quality & Reliability

Holdout:
- Implement comprehensive monitoring for traffic and models
Clean up old data pipelines and deprecated tables, with appropriate testing
Set up dashboards and monitoring for new and existing applications
Set up alerting for new and existing applications using Grafana and PagerDuty

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90969158
Position Id: 2026-4979/40824
Posted 3 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Irving, Texas

•

Today

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health , you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time. Position Summary Caremark LLC, a CVS Health Company, is

Full-time

USD 141,336.00 - 144,200.00 per year

Data Engineer

Chicago, Illinois

•

Today

We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets. Core Responsibilities Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)Collaborate with development teams on data modeling, data

Full-time

USD 175,000.00 - 225,000.00 per year

Data Engineer

San Francisco, California

•

Today

About Rad AI At Rad AI, we're on a mission to transform healthcare with artificial intelligence. Founded by a radiologist, our AI-driven solutions are revolutionizing radiology-saving time, reducing burnout, and improving patient care. With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports by nearly 50%. Rad AI has secured over $140M in funding, inclu

Full-time

USD 145,000.00 - 190,000.00 per year

Big Data Developer

Hybrid in McLean, Virginia

•

Yesterday

Responsibilities: Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.Stay current with industry trends and emerging Big Data technologies to continuously improve the data architectureCollaborate with cross-functional teams to understand business requirements and translate them into technical solut

Easy Apply

Contract

Depends on Experience

Search all similar jobs