SDET – AI/ML Testing

Hybrid in Alpharetta, GA, US • Posted 1 day ago • Updated 1 day ago
Contract W2
12 Months
No Travel Required
Hybrid
$40 - $42/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AI
  • LLM

Summary

Hiring: SDET – AI/ML Testing

Location: Alpharetta, GA (Hybrid) Local Candidates Only No Relocation Under 50 Miles only
Employment Type: W2 (NO  C2C)
Pay Rate: $40–$42 per hour

Position Summary

We are seeking an experienced Software Development Engineer in Test (SDET) with strong software engineering, test automation, and AI/ML quality assurance expertise. The ideal candidate will design and maintain scalable automation frameworks and develop testing strategies for traditional software applications as well as AI-powered and generative AI systems.

You will collaborate with software engineers, data scientists, product managers, and DevOps teams to ensure the functionality, performance, reliability, security, and quality of applications throughout the software development lifecycle.

Key Responsibilities

  • Design, develop, and maintain scalable automation frameworks for web, mobile, API, and backend applications.

  • Develop comprehensive testing strategies for AI/ML-powered products and services.

  • Automate functional, regression, integration, API, and end-to-end testing.

  • Validate application performance, scalability, reliability, and security.

  • Test data quality, data pipelines, model accuracy, consistency, and edge cases.

  • Evaluate generative AI applications for response quality, hallucinations, factual accuracy, toxicity, bias, and harmful content.

  • Test prompt injection, jailbreak resistance, response consistency, and model or prompt regressions.

  • Validate Retrieval-Augmented Generation (RAG) workflows and AI-driven application behavior.

  • Develop tools for test data generation, model evaluation, monitoring, and reporting.

  • Integrate automated testing into CI/CD pipelines and establish quality gates.

  • Perform root-cause analysis, troubleshoot complex defects, and communicate risks and recommendations.

  • Establish quality metrics, dashboards, and reports for software and AI/ML systems.

  • Collaborate with engineering and data science teams to identify defects early and improve product quality.

  • Participate in test planning, code reviews, architecture discussions, and release readiness assessments.

  • Mentor team members and promote automation and quality engineering best practices.

Required Skills and Qualifications

  • Experience in SDET, software development, test automation, or quality engineering.

  • Strong programming skills in Python, Java, JavaScript, or TypeScript.

  • Proven experience designing and maintaining automation frameworks.

  • Strong understanding of software testing methodologies, test strategy, and defect management.

  • Experience testing RESTful APIs, microservices, databases, and distributed systems.

  • Hands-on experience with Selenium, Playwright, Cypress, Appium, REST Assured, PyTest, JUnit, or equivalent tools.

  • Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, Azure DevOps, or CircleCI.

  • Exposure to cloud platforms such as AWS, Azure, or Google Cloud.

  • Practical experience testing AI/ML systems, models, data pipelines, or AI-powered applications.

  • Understanding of machine learning concepts, model evaluation, data validation, and statistical testing.

  • Strong analytical, troubleshooting, communication, and problem-solving skills.

Preferred Qualifications

  • Experience testing generative AI and LLM-based applications.

  • Knowledge of hallucination detection, prompt evaluation, bias testing, and AI safety.

  • Experience validating RAG systems, model outputs, and prompt engineering workflows.

  • Familiarity with AI evaluation benchmarks, test datasets, and automated quality monitoring.

Interested Candidates

Please share your updated resume along with your current location, work authorization, availability, and expected rate.

Note: This is a hybrid position based in Alpharetta, GA, with compensation of $40–$42/hr on W2.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX1d0567
  • Position Id: 9126012
  • Posted 1 day ago

Company Info

About Vision Square

At Vision Square Inc, we believe that Great Workforce is the cause for phenomenal growth of the company. By combining the skill and experience of the founders and executives, Vision Square Inc follows a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements and delivering exceptional service, we achieve great results for all concerned.

Vision Square Inc is one of the fastest growing information technology consulting and services with superior value-priced consulting, contracting, permanent recruiting and placement services for both private and government sector clients.

Our vision is to provide complete quality services for all clients at all levels, while allowing the clients to remain focused on there core business. Our processes are robust and we invest heavily in our delivery models and ensure that our clients globally get uniformity of delivery and highest quality of service. Our clients rely on us to connect them with high caliber technology professionals and we ensure that they remain on top of the continually evolving technology landscape.

Contact the job poster
AC

Allen Carter

Recruiter @ Vision Square

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.