IT Data Scientist Senior

company banner
ETS (Educational Testing Service)
Full Time

Job Description

Job Description:

Position Summary:

ETS seeks several candidates to join a data scientist on the newly formed AI Development team. The positions will play a critical role in building machine learning (ML) and deep learning models to advance ETS's mission to advance education equity through quality and fair assessments. Potential projects will include analyzing data from multiple contexts, including text, audio, and video. The work environment is highly collaborative and cross-functional, including work with developers, other data scientists, business leaders, and shareholders. Successful work will shape ETS's future direction and have tremendous potential for positive impact by broadening access to quality assessments and ensuring the integrity of services. The AI Development team will also take an active interest in growing members' personal and professional skills.

  • Develop robust and innovative machine learning (ML) models using advanced algorithms, mining and visualization techniques to solve complex data and business problems considering all components of data sources and product while adhering to guidelines of system development methodologies and technology stack
  • Independently conduct advanced data analysis and complex design algorithms to discover patterns. Assignments may include data architecture development, identification of value engagement, usage, progressions and performance data point, and automation of data collection processes
  • Evaluate new technologies and data that will help improve AI/ML and advanced analytics, product development processes, solution deployments and model development guidelines
  • Improve the enterprise's knowledge of emerging technologies, frameworks, and trends in AI (Artificial Intelligence) and ML
  • Investigate technical issues, interpretations and instruments through a systematic approach to the problem including exploring datasets to discover trends and patterns; build predictive models and ML/AI; develop new methods for uncovering trends
  • Develop strong partnerships with key stakeholders within Business, IT, Program/Product, Marketing, and Finance to identify business requirements and expected outcomes
  • Develop models and frames business scenarios that are meaningful and which impact critical business processes and/or decisions
  • Mentor and provide guidance, direction, and assistance to other IT Data Scientist, Data Analysts, and Data/ML Engineers
  • Create strong visualizations and engaging presentations that ensures continuous stakeholder collaboration and model comprehension for better outcomes and results
  • Design experiments, test hypotheses and build models for the assigned business operational problems
  • Collaborate with subject matter experts, both within IT and business areas, to select the relevant sources of information
  • Work with IT teams to support data collection, integration and retention requirements based on input collected with the business
  • Work in iterative processes, at times using experimental design approaches to validate findings
  • Assess, with the business, the expected qualification and assurance of the information in support of the use case(s)
  • Define the validity of the information, how long the information is meaningful and other information it is
  • Recommend ongoing improvements to methods and algorithms that lead to findings, including new information or data external to the organization that may be useful
  • Identify and analyze patterns in the data, including the type of data and speed of sudden variations in the data collection
  • Demonstrate data scientist qualities, including clarity, accuracy, precision, relevance, depth, breath, logic, significance and fairness
  • Adhere to ethical standards and comply with the laws and regulations applicable to your job functions

Experience and Skills

Education, Certifications, or Special Licenses:
  • Bachelor's degree in Data Science, Mathematics, Statistics, Computer Science or related field, or an equivalent combination of education and professional experience is required.
  • Advanced degree (Masters' or Ph.D.) is strongly preferred.

Relevant Years of Experience:
  • Adherence to the highest ethical standards of data science, as well as observance ETS Values
  • Ability to translate business and technical requirements into their corresponding data science research questions and needs
  • Ability to communicate data science findings and methods to non-technical audiences
  • Selection and implementation of ML models for classification and regression, along with a demonstrable and concise ability to speak to the strengths and weaknesses of your selection
  • Proficiency in a variety of Python-based data science tools, including Jupyter and traditional Python development tools and best practices
  • Demonstrated experience in creating well-tested and maintainable codebases
  • Experience in developing and deploying production-quality predictive models
  • Participation in projects managed with Scrum sprints and other agile frameworks
  • Document projects in JIRA/Confluence and track development with git
  • Presentation skills progress reports and demos to a diverse audience of technical and non-technical personnel

Senior-level requirements
  • Show extensive portfolio of completed industry-grade data science products or high-quality research publications
  • Expertise in applying deep learning to at least one domain, such as computer vision, natural language processing, or time series
  • Familiarity with deep learning frameworks and tools such as PyTorch, TensorFlow, FastAI, or Keras
  • Ability to conceptualize and lead complex data science projects, from proof-of-concept to production
  • Excellent ability to engage and communicate with executives and IT leaders on data science methods and findings, including providing consultation on data infrastructure design, analytic strategies, and fair and interpretable machine learning applications
  • Supervise and mentor data scientists and engineers, with at least 1 year of team management or mentoring experience

Additional Requirements:
  • Excitement to take deep learning models from concept to production-ready in months, if not weeks
  • Expertise in fairness and biases in machine learning models, privacy-preserving AI services, particularly as they apply to education and security applications
  • Experience in biometrics, fraud detection, or recommendation systems
  • Optimization of deployed models, especially deep learning architectures, using distillation, model compilation, sharding, quantization, caching, etc.
  • Experience with MLOps tools and practices in maintaining and monitoring production models
  • Visualization experience with complex data types and metrics
  • Familiarity with AWS services, or equivalent cloud infrastructure, used for data science product development. Some examples:
    • S3
    • EC2
    • SageMaker
    • RDS + DynamoDB
    • Lambda
    • EventBridge and other streaming data services
  • Publications in data science, machine learning, education/testing, or relevant social and psychological sciences
  • Demonstrated desire to improve test taker experience and create an equitable testing process




COVID-19 Requirements
ETS requires all new hires to either certify that they have been fully vaccinated or request and obtain an exemption due to medical or religious reasons by their start date.

ETS is an Equal Opportunity Employer comprised of people with different experiences, strengths, and backgrounds who share a passion for advancing quality and equity in education. We are dedicated to building teams that reflect the various backgrounds, experiences, and identities of those we serve. The Talent Acquisition team strives to ensure candidates enjoy a fair and equitable hiring process. We believe our differences empower us to be a better team, making better decisions and delivering better results.

Company Information

At ETS we believe that through learning, people have the opportunity to make a difference in their lives and in the world — and that research, assessment and measurement have valuable roles in helping everyone chart their unique paths to new possibilities. As an independent, nonprofit organization devoted to educational research and assessment we expand opportunities for learners of all income and social status levels through more informed, objective methods for evaluation. Our commitment to fairness lives on today through our mission to advance quality and equity in education worldwide. Our mission informs the core values of equity and opportunity, quality, integrity and social responsibility that are the basis of our decisions and behavior — and it is brought to life every day by the dedicated work of our employees. We have been on a journey with students, educators, partner organizations and others within the learning ecosystem to create a world where all people can discover what’s possible through education. Now more than ever, we are proud that our research, products and services provide measurement data and innovation that help individuals to see and take the next step forward in their education or career.

Dice Id : 10383379
Position Id : 346996
Originally Posted : 3 months ago

Similar Positions at ETS (Educational Testing Service)

IT Data Scientist
  • Princeton,
  • 1 day ago