SDET – AI/ML Testing


Vision Square
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- AI
- LLM
Summary
Hiring: SDET – AI/ML Testing
Location: Alpharetta, GA (Hybrid) Local Candidates Only No Relocation Under 50 Miles only
Employment Type: W2 (NO C2C)
Pay Rate: $40–$42 per hour
Position Summary
We are seeking an experienced Software Development Engineer in Test (SDET) with strong software engineering, test automation, and AI/ML quality assurance expertise. The ideal candidate will design and maintain scalable automation frameworks and develop testing strategies for traditional software applications as well as AI-powered and generative AI systems.
You will collaborate with software engineers, data scientists, product managers, and DevOps teams to ensure the functionality, performance, reliability, security, and quality of applications throughout the software development lifecycle.
Key Responsibilities
Design, develop, and maintain scalable automation frameworks for web, mobile, API, and backend applications.
Develop comprehensive testing strategies for AI/ML-powered products and services.
Automate functional, regression, integration, API, and end-to-end testing.
Validate application performance, scalability, reliability, and security.
Test data quality, data pipelines, model accuracy, consistency, and edge cases.
Evaluate generative AI applications for response quality, hallucinations, factual accuracy, toxicity, bias, and harmful content.
Test prompt injection, jailbreak resistance, response consistency, and model or prompt regressions.
Validate Retrieval-Augmented Generation (RAG) workflows and AI-driven application behavior.
Develop tools for test data generation, model evaluation, monitoring, and reporting.
Integrate automated testing into CI/CD pipelines and establish quality gates.
Perform root-cause analysis, troubleshoot complex defects, and communicate risks and recommendations.
Establish quality metrics, dashboards, and reports for software and AI/ML systems.
Collaborate with engineering and data science teams to identify defects early and improve product quality.
Participate in test planning, code reviews, architecture discussions, and release readiness assessments.
Mentor team members and promote automation and quality engineering best practices.
Required Skills and Qualifications
Experience in SDET, software development, test automation, or quality engineering.
Strong programming skills in Python, Java, JavaScript, or TypeScript.
Proven experience designing and maintaining automation frameworks.
Strong understanding of software testing methodologies, test strategy, and defect management.
Experience testing RESTful APIs, microservices, databases, and distributed systems.
Hands-on experience with Selenium, Playwright, Cypress, Appium, REST Assured, PyTest, JUnit, or equivalent tools.
Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, Azure DevOps, or CircleCI.
Exposure to cloud platforms such as AWS, Azure, or Google Cloud.
Practical experience testing AI/ML systems, models, data pipelines, or AI-powered applications.
Understanding of machine learning concepts, model evaluation, data validation, and statistical testing.
Strong analytical, troubleshooting, communication, and problem-solving skills.
Preferred Qualifications
Experience testing generative AI and LLM-based applications.
Knowledge of hallucination detection, prompt evaluation, bias testing, and AI safety.
Experience validating RAG systems, model outputs, and prompt engineering workflows.
Familiarity with AI evaluation benchmarks, test datasets, and automated quality monitoring.
Interested Candidates
Please share your updated resume along with your current location, work authorization, availability, and expected rate.
Note: This is a hybrid position based in Alpharetta, GA, with compensation of $40–$42/hr on W2.
- Dice Id: RTX1d0567
- Position Id: 9126012
- Posted 1 day ago
Company Info
At Vision Square Inc, we believe that Great Workforce is the cause for phenomenal growth of the company. By combining the skill and experience of the founders and executives, Vision Square Inc follows a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements and delivering exceptional service, we achieve great results for all concerned.
Vision Square Inc is one of the fastest growing information technology consulting and services with superior value-priced consulting, contracting, permanent recruiting and placement services for both private and government sector clients.
Our vision is to provide complete quality services for all clients at all levels, while allowing the clients to remain focused on there core business. Our processes are robust and we invest heavily in our delivery models and ensure that our clients globally get uniformity of delivery and highest quality of service. Our clients rely on us to connect them with high caliber technology professionals and we ensure that they remain on top of the continually evolving technology landscape.
