QA Engineer with AI/ML experience
Contract Independent
Contract W2
Contract Corp To Corp
12 Months
No Travel Required
Able to Sponsor
On-site
$50 - $55/hr
Rivago infotech inc
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- API QA
- Databricks
- ETL QA
- ELT
- GitHub
- JIRA
- Machine Learning Operations (ML Ops)
- Microsoft Office
- Information Technology
- Generative Artificial Intelligence (AI)
- Health Care
- PySpark
- POSTMAN
- Python
- Prompt Engineering
- Snow Flake Schema
- Selenium
- Testing
- TestNG
- SQL
- Microsoft Azure
- Machine Learning (ML)
- Quality Assurance
Summary
Role: AI/ML QA Engineer
Location: McLean, VA 22102 (100% Onsite)
Primary Skills: AI/ML Testing, Python, SQL, ETL Testing, Snowflake, Databricks, Azure, Healthcare Domain, GenAI Testing.
Job Summary: We are seeking a skilled AI/ML QA Engineer to ensure the quality, reliability, performance, and governance of AI and Machine Learning solutions in the healthcare domain. The role involves validating AI models, testing data pipelines, evaluating model outputs, identifying bias and performance issues, and supporting the end-to-end quality assurance lifecycle for AI-driven applications.
The ideal candidate should have strong QA expertise combined with exposure to AI/ML technologies, data validation, automation testing, and healthcare data environments.
Key Responsibilities
- Develop and execute test strategies for AI/ML applications and data-driven systems.
- Validate AI model outputs for accuracy, consistency, bias, fairness, and reliability.
- Design and execute data quality testing for structured and unstructured datasets.
- Test ETL/ELT pipelines supporting AI model development and deployment.
- Validate training, testing, and inference datasets used in AI solutions.
- Perform functional, integration, regression, performance, and user acceptance testing.
- Work with Data Scientists, Data Engineers, Product Owners, and Business Stakeholders to define AI testing requirements.
- Create automated test frameworks for AI and analytics solutions.
- Monitor model performance and identify drift, degradation, and anomalies.
- Verify compliance with healthcare data quality and governance requirements.
- Support defect triage, root cause analysis, and resolution tracking.
- Prepare QA documentation, test cases, test reports, and validation evidence.
Required Technical Skills
- QA & Automation
- Manual Testing
- Test Planning & Execution
- Test Automation (Selenium, API Testing with Postman)
- JIRA, TestNG / PyTest
- Data Testing (SQL, ETL Testing, Data Validation)
- AI/ML Testing (AI Model Validation, LLM Testing, Bias & Fairness Testing)
- Programming (Python, PySpark preferred)
- Cloud & Data Platforms (Azure, Databricks, Snowflake)
Expertise You'll Bring:
- Experience testing Generative AI and LLM-based applications.
- Familiarity with GitHub Copilot, Microsoft 365 Copilot, and enterprise AI tools.
- Understanding of prompt engineering and prompt validation techniques.
- Experience evaluating AI output quality, hallucinations, and response consistency.
- Knowledge of Responsible AI principles, fairness, explainability, and governance.
Preferred Qualifications
- Experience validating AI/ML models in production environments.
- Exposure to MLOps processes and model deployment frameworks.
- Knowledge of healthcare compliance and data privacy requirements.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management capabilities.
Education
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or related field.
Nice to Have
- Healthcare domain experience
- Snowflake Certification
- Azure Certification
- Databricks Certification
- AI/ML Testing Certification
- Experience with GenAI and LLM evaluation frameworks
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91131106
- Position Id: 9082267
- Posted 2 days ago
Company Info
About Rivago infotech inc
Rivago Infotech Inc has been a leader in IT staffing and Software development for over 5 years and is one of the largest diversity and development firms in the industry. We are known for our high-touch, customer-eccentric approach, offering our clients unmatched quality, responsiveness and flexibility . We are appreciated by our clients for our streamlined execution, highly efficient service and exceptional talent management that go above and beyond traditional staffing services.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs