Job Title: Data Scientist
AS A DATA SCIENTIST ON DIGITAL COACH, YOU WILL:
Monitor and evaluate AI chatbot accuracy, safety, and policy compliance at scale, ensuring responses are high-quality and customer-ready.
Design and implement data-driven evaluation frameworks, metrics, and guardrails to continuously improve AI behavior in production.
Develop scoring rubrics, test scenarios, and monitoring strategies for probabilistic and generative models.
Partner closely with engineering teams to build internal tools, dashboards, and automated QA pipelines that support reliable AI operations.
Detect model drift, regressions, and emerging risk patterns through ongoing analysis and alerting.
Translate regulatory, policy, and risk requirements into measurable, testable checks embedded into AI workflows.
Collaborate cross-functionally with product, UX, engineering, and compliance partners to convert model insights into concrete behavior improvements.
THE EXPERTISE AND SKILLS YOU BRING
Bachelor’s degree in a quantitative field such as Data Science, Computer Science, Engineering, or equivalent practical experience.
10+ years of experience as a data scientist working with production machine learning systems.
Strong background in model quality evaluation, including metrics such as accuracy, precision, recall, and drift.
Experience in trust & safety, risk, fraud, model validation, or similarly high-stakes domains is strongly preferred.
Hands-on experience with model monitoring, alerting, regression analysis, and post-deployment evaluation.
Strong SQL and Python skills, with experience contributing to internal analytics tooling or automated evaluation systems.
Comfort operating in regulated or high-risk environments and translating abstract policies into operational checks.
Strong communication and collaboration skills, with the ability to influence product and engineering decisions through data
