Gen AI Tester (SDLC)

Job Role: Gen AI Tester (SDLC) in Montvale, NJ (Remote is an option)
Location: Detroit, MI

Key Skills: GEN AI, AI/ML, Software Testing, PyTest, JUnit, Selenium, Python/ Java

Job Summary:

We are seeking skilled and detail-oriented GEN AI Testers to join our team. The candidate will be responsible for testing and validating our Generative AI SDLC model to ensure they meet the highest standards of quality, performance, and reliability. This role involves creating and executing test plans, identifying and documenting bugs, and working closely with developers and data scientists to improve our AI systems. Strong understand of GenAI solution and how the solutions are used in Professional Services environment. Ability to think as a business user while testing and validating GenAI outcomes.

Preferred Qualifications:

Understanding of AI/ML concepts, algorithms, and workflows.

Proficiency in using tools and platforms for AI model development and testing

Strong analytical and problem-solving skills.

At least 7-8 years of Testing and Test management experience

Proven experience in software testing, preferably with AI or machine learning models.

Familiarity with testing frameworks and tools such as PyTest, JUnit, Selenium, etc.

Experience with scripting and programming languages like Python, Java, or similar.

Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree is a plus.

Roles and Responsibilities:

Test Planning and Design:

Develop comprehensive test plans and test cases based on requirements and specifications.

Validate software against business and technical requirement throughout the SDLC stages

Design and implement automated testing scripts and frameworks for GEN AI models

Develop test strategy to validate prompt engineering and RAG outputs

Participate in Design review, Code review to provide testing perspective

Execution and Reporting:

Execute tests on AI models to ensure accuracy, robustness, and performance

Identify, document, and track defects, and work with the development team to resolve them.

Report testing progress, issues, and risks to stakeholders in a clear and concise manner.

Quality Assurance:

Validate the functionality, performance, and reliability of AI models across various scenarios and datasets.

Ensure compliance with industry standards and best practices for AI development and testing

Collaboration:

Work closely with data scientists, machine learning engineers, and software developers to understand AI model requirements and constraints.

Provide feedback and suggestions for improvements in AI model development and deployment processes.

Continuous Improvement:

Stay updated with the latest advancements in AI testing methodologies and tools.

Contribute to the continuous improvement of testing processes and practices within the organization.

About Us WinningEdge:

Job Search can be a painful & frustrating process. We take time to understand candidate skillsets, and job search preferences and match them with our ideal clients. Our team has a combined experience of over 100 years and we have successfully placed hundreds of candidates.