Research Statistician I., Psychometrics College Board - Learning and Assessment Location: Fully remote. Type: This is a full-time position About the Team The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board's mission of access and equity in education. We are a 35+ person core team of Psychometricians and Research Statisticians that collaborate deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology.
About the Opportunity You will play a key role in both sustaining and modernizing College Board's assessment research infrastructure by conducting complex statistical analyses, interpreting results, and preparing high-impact reports that inform critical program decisions across the SAT Suite, AP, CLEP, and ACCUPLACER. This full-time role extends beyond routine analysis - it is a forward-looking position focused on designing and deploying scalable analytical tools, integrating artificial intelligence into psychometric workflows, and future-proofing systems to ensure data integrity, reliability, and continuous innovation. You will collaborate closely with psychometricians, and research statisticians across Learning & Assessment and PsyTech to enhance analytical efficiency, strengthen data quality, and advance the organization's measurement capabilities.
In this role, you will:
Statistical Analysis, Data Management, and Engineering (55%)
- Conduct advanced statistical and psychometric analyses across high-stakes programs (SAT, CLEP, ACCUPLACER, AP) using internal and external datasets.
- Produce accurate, high-quality data visualizations, tables, and reports to inform key program and research decisions.
- Develop, optimize, and document end-to-end data pipelines using Python, SQL, and cloud-based tools (e.g., AWS, Redshift) to ensure efficiency and scalability.
- Design and implement automated workflows leveraging generative AI for data validation, code optimization, and visual reporting.
- Write and maintain robust, reusable analysis code and stored procedures to improve consistency, reduce turnaround time, and eliminate manual errors.
- Ensure data integrity and reproducibility through version control, CI/CD practices, and standardized documentation.
- Reformat, organize, and prepare data for use in specialized statistical software, supporting psychometricians and researchers with accurate and timely analytical outputs.
Systems Development and AI-Driven Modernization (35%)
- Design, develop, and maintain scalable software solutions for statistical and psychometric analyses, including item and test analyses, security analysis, standard setting, and reporting.
- Implement automation tools and analytical systems that leverage AI-assisted code generation, LLM-powered quality control, and predictive modeling to enhance accuracy and efficiency.
- Collaborate with PsyTech, Data Science, and cross-functional teams to create intelligent agents for data processing, anomaly detection, and dynamic documentation.
- Test, validate, and optimize programs to ensure high performance, reproducibility, and traceability across research workflows.
- Develop and promote visualization tools that communicate complex analysis results clearly and effectively.
- Lead modernization initiatives that cut turnaround time by 50% while maintaining 100% analytical accuracy.
- Advance AI literacy across the research group by establishing best practices, sharing prototypes, and mentoring colleagues in the adoption of emerging technologies.
Research, Strategy, and Innovation (10%)
- Lead and contribute to large-scale, high-impact psychometric research projects in collaboration with state education departments, academic partners, and internal College Board teams.
- Conduct exploratory research on AI applications in psychometrics, including adaptive testing, automated calibration, data synthesis, and model-based validation.
- Design and implement rigorous quality control (QC) procedures to ensure accuracy, reproducibility, and scientific integrity in all statistical analyses.
- Align and integrate external student data sources with internal assessment data to enhance research precision and program insights.
- Translate emerging research findings into actionable strategies that inform assessment design, technology integration, and future analytical capabilities.
- Co-author internal reports, white papers, and conference presentations showcasing innovations in methodology, data science, and AI-driven psychometric solutions.
- Partner with leadership to identify and develop new opportunities for data science, machine learning, and AI integration that strengthen College Board's measurement excellence1.
About You To qualify for this role you must have:
- M.S. in Statistics, Data Science, or other quantitative discipline
- Advanced programming proficiency in Python, R, and SAS, with strong experience in statistical modeling, algorithm development, and data engineering.
- Skilled in using Python libraries (e.g., SciPy, NumPy, Pandas, Matplotlib) for scientific computing, analysis, and visualization.
- Experienced with relational databases (e.g., Amazon Redshift, MySQL) and version control tools (e.g., GitHub).
- Proficient in cloud computing and storage platforms (e.g., AWS S3), as well as web-based and business intelligence tools (e.g., Shiny, Tableau).
- Demonstrated ability to integrate AI/ML tools into statistical workflows (e.g., GPT APIs, automated documentation, predictive modeling).
- Strong background in psychometric and statistical research, including the design, execution, and validation of complex analyses.
- Ability to interpret and translate research questions into analytical tasks and actionable insights.
- Exceptional attention to detail, critical thinking, and a commitment to quality and reproducibility.
- Effective collaborator and communicator, able to convey technical findings to diverse audiences.
- Future-oriented and self-driven, with a passion for leveraging technology and AI to advance measurement science.
- Skilled in managing and aligning cross-program data structures and ensuring analytical accuracy through quality control procedures.
All roles at College Board require:
- A passion for expanding educational and career opportunities and mission-driven work
- Authorization to work in the United States for any employer
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
- Clear and concise communication skills, written and verbal
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
About Our Process - Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
- While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.
What We Offer At College Board, we offer more than just a paycheck-we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We're a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
- The hiring range for this role is $56,000-$100,000
- Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
- We aim to make our best offer upfront-rooted in fairness, transparency, and market data.
- We adjust salaries by location to ensure fairness, no matter where you live.
You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process. Check out our careers page for more.
Never miss an opportunity! Create an alert based on the job you applied for.
