AI Test lead

Position: AI Test lead role

Location: Indianapolis Day 1 onsite

Job Type: Contract

Job Duration: Long Term.

When we talk about Responsible AI Test Lead role, the candidate must be able to do following

1. Identify and test the common principles of responsible AI (e.g., fairness, safety and reliability, privacy and security, transparency and explainability, accountability and human-centricity).
2. Understand the main elements of the EU AI Act.
   1. Understand the risk classification framework for AI (i.e., prohibited AI, high-risk, limited-risk and minimal-risk) and what systems fall into each category.
   2. Understand the key requirements for high-risk, limited-risk and minimal-risk AI including risk management, data governance, technical documentation, conformity assessment, record keeping, human oversight, transparency and notification, quality management (as applicable).
   3. Understand the distinct requirements for general purpose AI models. Understand the enforcement framework and penalties for non-compliance.
   4. Understand the differences in requirements based on organizational context (e.g., providers, deployers, importers, and distributors).
3. Understand the main industry standards and tools that apply to AI.
   1. Understand the OECD principles, framework, policies and recommended practices for trustworthy AI.
   2. Understand the NIST AI Risk Management Framework and Playbook (e.g., the core functions, categories and subcategories).
   3. Understand the NIST ARIA program for methodologies, tools, metrics and measurements on AI safety.
   4. Understand the core ISO AI standards (i.e., 22989 and 42001).
4. Perform key activities to assess the AI model.
   1. Perform or review an impact assessment on the selected AI model.
   2. Identify laws that apply to the AI model.
   3. Identify and evaluate key terms and risks in the vendor or open source agreement.
   4. Identify and understand issues that are unique to a company deploying its own proprietary AI model (e.g., increased obligations and higher potential liability).