AI/ML Tester

• Design and execute test strategies for Machine Learning and AI based applications across development and production environments
• Validate ML models for accuracy precision recall robustness bias and overall performance against business requirements
• Develop and maintain automated test frameworks for data validation model testing and AI application workflows
• Create functional integration regression and performance test cases for ML and GenAI solutions
• Verify data quality feature engineering pipelines and training datasets to ensure model reliability
• Perform model validation and compare outputs against expected benchmarks and acceptance criteria
• Evaluate AIML models for fairness explainability compliance and Responsible AI standards
• Test RAG pipelines vector databases and LLMpowered applications for accuracy and consistency
• Collaborate with Data Scientists ML Engineers and Product Teams to identify and resolve defects
• Develop test datasets synthetic data and edgecase scenarios to improve model robustness
• Perform performance scalability and stress testing of AIML systems in cloud environments
• Implement test automation within CICD and MLOps pipelines to support continuous delivery
• Track defects prepare test reports and provide quality metrics to project stakeholders
• Ensure compliance with security privacy governance and regulatory requirements for AI systems

Required Skills

7 years in Software TestingQA experience in ML Model Validation Python SQL API Testing Test Automation MLOps AzureAWSGoogle Cloud Platform AIML concepts SeleniumPyTest and performance testing tools

Skills

Mandatory Skills : Generative AI Evaluation