Data Scientist 5 - Infrastructure Experimentation

At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what's next.

Everything that we build to delight our members, and all of the work we do to figure out how to do that better, relies on our extensive infrastructure, which spans what we rent from AWS to what we build ourselves (we operate our own custom-built content delivery network, Open Connect). Because this infrastructure is so central to everything we do, we want to ensure we are using it in the most effective and efficient way. Doing that well starts with great visibility into how we are using our infrastructure, and actionable metrics and analytics to help us take action as needed.

As a Senior Data Scientist focused on Infrastructure Experimentation, you will join a data org of Analytics Engineers, Data Engineers, and Data Scientists who partner with our infrastructure engineering teams to measure, model, and surface the infrastructure impact of product experiments. You will work closely with partners in data science, platform engineering, and experimentation platform teams to build and maintain models and experimentation capabilities that predict the cost and performance implications of A/B tests, enabling experiment owners to make more holistic decisions that balance member impact with infrastructure performance.

The ideal candidate will excel in experimentation design and evaluation, causal inference, and applied machine learning, with a passion for applying these skills within the infrastructure domain.

To learn more about our team, read here. To learn more about the work in this role, see our recent presentation at AWS Re:invent.

In this role, you will:
Build and maintain machine learning models that predict the infrastructure cost impact of A/B experiments, translating experimentally observed signals (e.g., request volume changes) into business and system metrics (e.g. projected annualized costs)
Drive adoption of infrastructure metrics within the experimentation community through analysis, consultation with experiment owners, documentation, and training
Partner with platform teams (Observability, Experimentation Platform) to improve the quality and coverage of infrastructure usage data feeding our models
Extend our measurement framework to new metrics (e.g., latency) and new experiment types (e.g., infrastructure canary tests)
Champion an infrastructure lens within the broader experimentation community,
helping shift culture toward reasoning about the full ROI and infrastructure impact of experiments
Connect with the larger analytics and experimentation communities at Netflix to bring visibility to our work and learn from others

You are:
Experienced in experimentation methodology and causal inference, with a strong foundation in A/B testing, treatment effect estimation, and statistical significance
Experienced in building and maintaining machine learning models in production,
including the full lifecycle of training, evaluation, monitoring, and continuous
improvement
Fluent in Python and SQL, with experience engineering data pipelines and working with large-scale data systems
A strong collaborator who thrives in horizontal roles with broad stakeholder surfaces, comfortable influencing decisions through data and analysis rather than direct authority
An exceptional communicator who can flex between technical and non-technical
audiences, translating statistical concepts for software engineers and business leaders alike
Comfortable with messy, incomplete data environments and able to balance short term execution with a drive to improve data quality over time
A strong product thinker who views data science outputs as products, taking an
end-to-end ownership mindset from data quality through to user adoption
Comfortable with ambiguity, and thrive with minimal oversight and process
Curious about infrastructure systems; prior experience in the infrastructure domain is a strong plus but not required; the ability and motivation to learn is essential

Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $372,000.00 - $600,000.00. This compensation range will vary based on location.

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here.

Netflix is a unique culture and environment. Learn more here.

Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.