Overview
On Site
Depends on Experience
Full Time
Accepts corp to corp applications
Skills
Data Scientist / AI Engineer
ML techniques and Python and Data Science
LLM evaluation and consumer AI
Job Details
Role : Senior Data Scientist / AI Engineer
Location: San Francisco Bay Area ( onsite all 5 days )
Work Authorization: Any
Job Summary: We are looking for a Senior/Staff-level Data Scientist with deep technical expertise and product intuition to join our team, leading development of data-driven systems to power our evaluation engines, leaderboards, and recommendation layers, and build mechanisms to derive business insights from data. The ideal candidate has a strong foundation in statistical inference, experimentation, and machine learning, and is comfortable designing novel evaluation methods. You will work cross-functionally with engineers, researchers, and product managers to turn data into insights and insights into product direction.
Responsibilities:
1. Design and lead experiments to evaluate and rank models using human and behavioral feedback; develop novel methodologies for sampling, aggregation, and bias correction.
2. Collaborate with engineering to productionize data pipelines and evaluation logic at scale.
3. Perform deep dives into usage data to surface insights that shape product and research priorities. Track critical business metrics through data collection, visualization, and recommendations. Troubleshoot and debug data inconsistencies and irregularities.
4. Participate in product building through contributing production code, DB schema design, and more.
Qualifications:
1. 10+ years of experience in data science, applied ML, or related fields.
2. Strong knowledge of experimental design, causal inference, and statistical modeling.
3. Proficient in Python and data science libraries (e.g., NumPy, pandas, scikit-learn, statsmodels).
4. Experience with modern ML techniques for ranking, embeddings, and preference learning.
5. Familiarity with large-scale data processing tools (e.g. BigQuery) and SQL.
6. Strong communication skills and ability to frame abstract problems in product-relevant ways.
Preferred Qualifications:
1. Experience in consumer AI, recommender systems, or human-in-the-loop evaluation.
2. Prior work on LLM evaluation or reinforcement learning from human feedback (RLHF).
3. Familiarity with modern experiment platforms and A/B testing infrastructure.
If you are passionate about creating exceptional user experiences and thrive in a dynamic and collaborative environment, we would love to hear from you. Apply today and join our team of talented individuals!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.