Senior Machine Learning Engineer II, Search & Recommendations Ranking

• Posted 1 day ago • Updated 10 hours ago
Full Time
USD $207,000.00 - 253,500.00 per year
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Art
  • Semantics
  • Reasoning
  • Artificial Intelligence
  • Innovation
  • Publications
  • Research
  • Backbone.js
  • Merchandising
  • SAFE
  • ADS
  • Return On Investment
  • Mentorship
  • IT Management
  • Optimization
  • User Experience
  • Testing
  • Python
  • Fluency
  • SQL
  • Pandas
  • Machine Learning (ML)
  • XGBoost
  • Deep Learning
  • TensorFlow
  • PyTorch
  • Analytical Skill
  • Communication
  • Multitasking
  • Evaluation
  • Modeling
  • Caching
  • A/B Testing
  • Adapter
  • Clarity
  • Apache Flex
  • Mergers and Acquisitions

Summary

We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we're building the team to help push our shopping cart forward. If you're ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There's no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work-whether it's from home, an office, or your favorite coffee shop-while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.

Overview

The Search & Personalization ML team is Instacart's engine for state-of-the-art multi-task, multi-objective ranking-unifying search, discovery, recommendation, ads, and merchandising into a single value-aware platform. Partnering with world-class engineers, scientists, and PMs, we build the ranking backbone that powers every pixel of the shopping journey, optimizing not just for clicks, but for incremental GTV, basket lift, and retention over the long run.

What We're Building
  • Foundational Ranking Backbone Models: Multi-task/multi-objective models (shared encoders + task heads) that jointly learn relevance, conversion, margin contribution, churn risk, and ad quality, enabling consistent decisions across search and recommendations.
  • Value-Aware Optimization: Uplift and long-horizon value models that steer decisions toward incrementality and LTV, with calibrated constraints on quality, diversity, fairness, and spend pacing-plus guardrails for safe exploration.
  • LLM-Enhanced Retrieval & Features: Using LLMs to enrich query and item semantics for long-tail recall, generate features for cold-starts, and feed the ranker with reasoning-rich context, while remaining the source of truth for final ordering.

Our commitment to AI innovation is reflected in our recent publications and research contributions to the field.

About the Job
  • Architect the ranking backbone that unifies query understanding, personalization, multi-objective ranking, ads, and merchandising into a single adaptive platform.
  • Design and build a search autosuggest system optimized for personalization and value-based relevance.
  • Design long-horizon objective functions (e.g., incrementality, LTV, habit formation) and build uplift/causal value models that move beyond short-term engagement.
  • Develop production-grade Multi-Task Learning (e.g., shared encoders, MMOE/PLE task heads) to jointly learn relevance, propensity, margin, and churn risk-ensuring calibration, constraints, and explainability.
  • Own the inference layer: goal-aware re-rankers, diversity and quality constraints, safe exploration, and millisecond-class latency optimization.
  • Advance evaluation practices: online experiments, long-horizon cohort metrics, counterfactual evaluations, and attribution pipelines for tracking incremental GTV and retention.
  • Partner across ads, infrastructure, product, and design teams to translate business goals into ranking policies and measurable ROI.
  • Mentor ML engineers to build expertise in ranking, causal inference, and scalable serving systems.

About You
Minimum Qualifications
  • 5+ years applying ML at scale (3+ years in technical leadership), with a proven track record improving ranking or recommendation systems in production.
  • Demonstrated success in applying multi-objective or constrained optimization to balance relevance, revenue, margin, and user experience; experience with online testing and attribution beyond CTR.
  • Strong coding (Python) and data fluency (SQL/Pandas), with expertise in classic ML techniques (e.g., XGBoost) and deep learning frameworks (TensorFlow/PyTorch).
  • Excellent analytical skills and strong cross-functional communication abilities.

Preferred Qualifications
  • Expertise in multi-task learning architectures (e.g., MMOE/PLE, shared encoders), calibration, counterfactual evaluation, uplift/causal modeling, and/or contextual bandits for exploration.
  • Experience building low-latency ranking services, including feature stores, caching, vector + lexical retrieval, re-ranking, and A/B testing infrastructure, with expertise in constraint-aware inference.
  • Hands-on experience with LLMs as feature/recall enhancers (e.g., embeddings, adapter tuning) while maintaining clarity on when the ranker should arbitrate.

Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.

Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.

For US based candidates, the base pay ranges for a successful candidate are listed below.

CA, NY, CT, NJ

$207,000-$253,500 USD

WA

$198,000-$243,000 USD

OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI

$190,000-$233,000 USD

All other states

$173,000-$212,000 USD
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80183357
  • Position Id: 901b6838ffc9dca4d63c29e287daa9d2
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Palo Alto, California

Today

Full-time

USD 229,000.00 - 343,000.00 per year

San Jose, California

Today

Full-time

USD 361,300.00 - 510,000.00 per year

Remote

Today

Full-time

USD 313,000.00 - 330,500.00 per year

No location provided

Today

Full-time

USD 265,000.00 - 279,500.00 per year

Search all similar jobs