Senior Research Scientist, Validity Research & Services Team

Senior Research Scientist, Validity Research & Services (VRS)

College Board - Learning & Assessment (L&A) - Research Department

Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).

Type: This is a full-time position

About the Team

The Validity Research & Services (VRS) Team is a part of the Research department, housed within the larger Learning & Assessment division. We are responsible for much of the SAT Suite validity research, developing and utilizing a longitudinal database of college outcomes for rigorous test validity and college readiness and success research, and assisting educational institutions in conducting their own validity research on College Board assessments.

About the Opportunity

The Senior Research Scientist will lead and contribute to the design and implementation of research studies to support the use of College Board assessments in K-12 and Higher Education institutions, as well as advance our understanding of college and career readiness and success. This individual will have a high level of expertise in research methodology, educational measurement, statistical analysis, and report writing translating complex concepts into clear language for various stakeholders. This role is responsible for leading the core analytical work behind the digital SAT validity argument, which includes the first national digital SAT validity study, foundational research that will be cited across the field for the next decade. This is a career-defining opportunity for a measurement researcher passionate about high-impact validity work.

In this role, you will:

Design & Conduct Research Studies (70%):

• Lead the initiation, design, development, and completion of high-quality research studies and projects that enhance College Board's validity research and college and career readiness agenda.
• Lead the definition of projects of decisive importance to accomplish broader organizational goals.
• Author and contribute to publications including College Board Research Reports, Statistical Reports, Technical Memos/Manuals/Reports, peer reviewed journal articles, and other important documents.
• Develop the datasets for projects and the associated quality control (QC) of the dataset when developed by others.
• Determine the most effective methodologies to employ for studies and carry out rigorous analyses and interpretation of results.
• Remain up-to-date on advances in educational measurement, the college and career readiness and success literature, and validity research methods and approaches.
• Mentor junior staff members by reviewing analyses, providing methodological guidance, collaborating on impactful research ideas, and supporting high-quality research outputs.
• Serve as the primary analyst for many of the Digital SAT validity studies, including core placement, retention, completion, STEM outcomes, subgroup analyses, and institutional patterns.
• Conduct updated analysis and review of SAT Suite College & Career Readiness Benchmarks.

Provide Research Consultation to Internal & External Colleagues (30%):

• Contribute to research-informed requests and response(s) to College Board Communications, College Board Senior Leadership, RFPs, external inquiries from researchers, and College Board Programs - e.g., SAT, AP, etc.
• Synthesize research findings into clear information and deliverables for various stakeholders.
• When needed, support presentations translating complex concepts into clear language for the organization and public more broadly.
• Provide measurement research consultation to College Board programs to inform assessment operations and practices.
• Collaborate with educational institutions to conduct institution-specific validity studies and consult on related studies as needed.

About you, you have:

• Demonstrated ability to lead, design and conduct high quality educational research studies and statistical analyses; including a track record of published work
• Strong knowledge of educational measurement and psychometrics; well-versed in test validity; knowledgeable about college outcomes as well as career/workforce outcomes
• Excellent data coding, manipulation, and analysis skills; hands-on coding expertise in Python, R or SAS with a track record of producing analyses, rather than relying on others to execute core statistical work.
• Broad and deep methodological toolbox, including experience with multilevel modeling, experimental, and quasi-experimental methodologies, meta-analysis, and validity research methods
• Superior written communication skills
• Clear written communication and the ability to explain and present methods and results to technical and semi-technical audiences.
• Strong project management skills
• Demonstrated ability to assume responsibility
• Ability to work collaboratively with colleagues and creatively solve problems
• Ability to mentor research staff
• Familiarity with the history, debates, and public sensitivities surrounding standardized testing and SAT validity arguments.
• The ability to travel 3-5 times a year to College Board offices or on behalf of College Board business
• Authorization to work in the United States for any employer

All roles at College Board require:

• A passion for expanding educational and career opportunities and mission-driven work
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
• Clear and concise communication skills, written and verbal
• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.

About Our Process

• Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

What We Offer

At College Board, we offer more than just a paycheck, we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We're a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market.

A Thoughtful Approach to Compensation

• The hiring range for this role is $120,000-$175,000
• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
• We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
• We adjust salaries by location to ensure fairness, no matter where you live.

You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process. Check out our careers page for more.

#LI-Remote

#LI-TheAcorn