Job Description: A/B TestDataScientist(Website Experimentation)
Role Overview
As an A/B TestDataScientist, you will be the statistical engine behind our website’s optimization strategy. You will design, execute, and analyze controlled experiments to improve user experience, conversion rates, and business growth. You will work at the intersection of product, engineering, and marketing to ensure every website change is backed by rigorousdata.
Key Responsibilities
Develop clear experimentation hypotheses and define primary and secondary success metrics.
Determine appropriate sample sizes, statistical power, and experiment duration for reliable test outcomes.
Manage experiment execution, including user segmentation and randomization processes.
Collaborate with engineering teams to ensure accurate event tracking and data integrity.
Analyze experiment results using statistical methods such as p-values and confidence intervals to measure significance.
Conduct post-experiment analyses to uncover segment-level insights and business impact.
Translate complex analytical findings into actionable recommendations for stakeholders and leadership teams.
Maintain and manage an experimentation roadmap while documenting and archiving key learnings and outcomes.
Required Skills & Qualifications
Statistical Expertise: Mastery of hypothesis testing, experimental design, and probability. Knowledge of Bayesian vs. Frequentist approaches is a plus.
Programming:Proficiency in SQLfordataextraction and Python or Rfor advanced statistical analysis.
Tools:Experience with experimentation platforms (e.g.,Optimizely,VWO, orLaunchDarkly) and web analytics (e.g.,Google Analytics 4).
Visualization:Ability to build dashboards inTableau,Power BI, orLookerto monitor live tests.
Soft Skills:Strong critical thinking and the ability to explain "why" a result occurred to non-technical partners.
Experience & Education
Education:Bachelor’s degree in a quantitative field (Statistics, Math, CS, Economics); master’s or PhD preferred.
Experience:2–5 years in adatascience or product analytics role, specifically focused on digital experimentation
Never miss an opportunity! Create an alert based on the job you applied for.
