IT Data Scientist

company banner
ETS (Educational Testing Service)
Full Time

Job Description

Job Description:

Position Summary:

ETS seeks several candidates to join a data scientist on the newly formed AI Development team. The positions will play a critical role in building machine learning (ML) and deep learning models to advance ETS's mission to advance education equity through quality and fair assessments. Potential projects will include analyzing data from multiple contexts, including text, audio, and video. The work environment is highly collaborative and cross-functional, including work with developers, other data scientists, business leaders, and shareholders. Successful work will shape ETS's future direction and have tremendous potential for positive impact by broadening access to quality assessments and ensuring the integrity of services. The AI Development team will also take an active interest in growing members' personal and professional skills.

  • Lead and mentor staff and provide learning and development opportunities by sharing Subject Matter Expertise
  • Designs experiments, test hypotheses and build models for the assigned operational problems.
  • Conducts advanced data analysis and complex design algorithms to discover patterns.
  • Work with stakeholders to identify business requirements and expected outcomes.
  • Models and frames business scenarios that are meaningful and which impact critical business processes and/or decisions.
  • Collaborates with subject matter experts, both within IT and business areas, to select the relevant sources of information.
  • Works with IT teams to support data collection, integration and retention requirements based on input collected with the business.
  • Works in iterative processes, at times using experimental design approaches to validate findings.
  • Assesses, with the business, the expected qualification and assurance of the information in support of the use case(s).
  • Defines the validity of the information, how long the information is meaningful and other information it is related to.
  • Recommends ongoing improvements to methods and algorithms that lead to findings, including new information or data external to the organization that may be useful.
  • Identifies and analyzes patterns in the data, including the type of data and speed of sudden variations in the data collection.
  • Provides business metrics for assigned projects to show improvements.
  • Provides on-going tracking and monitoring of performance of decision systems and models.
  • Troubleshoots and implements enhancements and fixes to systems as needed.
  • Demonstrates data scientist qualities, including clarity, accuracy, precision, relevance, depth, breath, logic, significance and fairness.
  • Adhere to ethical standards and comply with the laws and regulations applicable to your job function

Experience and Skills

Education, Certifications, or Special Licenses:
  • Bachelor's degree in Data Science, Mathematics, Statistics, Computer Science or related field, or an equivalent combination of education and professional experience is required. Masters' degree is preferred.

Relevant Years of Experience:
  • Adherence to the highest ethical standards of data science, as well as observance ETS Values
  • Ability to translate business and technical requirements into their corresponding data science research questions and needs
  • Ability to communicate data science findings and methods to non-technical audiences
  • Selection and implementation of ML models for classification and regression, along with a demonstrable and concise ability to speak to the strengths and weaknesses of your selection
  • Proficiency in a variety of Python-based data science tools, including Jupyter and traditional Python development tools and best practices
  • Demonstrated experience in creating well-tested and maintainable codebases
  • Experience in developing and deploying production-quality predictive models
  • Participation in projects managed with Scrum sprints and other agile frameworks
  • Document projects in JIRA/Confluence and track development with git
  • Presentation skills progress reports and demos to a diverse audience of technical and non-technical personnel

Other Requirements:
  • Excitement to take deep learning models from concept to production-ready in months, if not weeks
  • Expertise in fairness and biases in machine learning models, privacy-preserving AI services, particularly as they apply to education and security applications
  • Experience in biometrics, fraud detection, or recommendation systems
  • Optimization of deployed models, especially deep learning architectures, using distillation, model compilation, sharding, quantization, caching, etc.
  • Experience with MLOps tools and practices in maintaining and monitoring production models
  • Visualization experience with complex data types and metrics
  • Familiarity with AWS services, or equivalent cloud infrastructure, used for data science product development. Some examples:
    • S3
    • EC2
    • SageMaker
    • RDS + DynamoDB
    • Lambda
    • EventBridge and other streaming data services
  • Publications in data science, machine learning, education/testing, or relevant social and psychological sciences
  • Demonstrated desire to improve test taker experience and create an equitable testing process



COVID-19 Requirements
ETS requires all new hires to either certify that they have been fully vaccinated or request and obtain an exemption due to medical or religious reasons by their start date.

ETS is an Equal Opportunity Employer comprised of people with different experiences, strengths, and backgrounds who share a passion for advancing quality and equity in education. We are dedicated to building teams that reflect the various backgrounds, experiences, and identities of those we serve. The Talent Acquisition team strives to ensure candidates enjoy a fair and equitable hiring process. We believe our differences empower us to be a better team, making better decisions and delivering better results.

Company Information

At ETS we believe that through learning, people have the opportunity to make a difference in their lives and in the world — and that research, assessment and measurement have valuable roles in helping everyone chart their unique paths to new possibilities. As an independent, nonprofit organization devoted to educational research and assessment we expand opportunities for learners of all income and social status levels through more informed, objective methods for evaluation. Our commitment to fairness lives on today through our mission to advance quality and equity in education worldwide. Our mission informs the core values of equity and opportunity, quality, integrity and social responsibility that are the basis of our decisions and behavior — and it is brought to life every day by the dedicated work of our employees. We have been on a journey with students, educators, partner organizations and others within the learning ecosystem to create a world where all people can discover what’s possible through education. Now more than ever, we are proud that our research, products and services provide measurement data and innovation that help individuals to see and take the next step forward in their education or career.

Dice Id : 10383379
Position Id : 346999
Originally Posted : 3 months ago

Similar Positions at ETS (Educational Testing Service)

IT Data Scientist Senior
  • Princeton,
  • 21 hours ago