Apply Now

Senior Quality Engineer – AI/LLM Test Automation

Birmingham, AL, US • Posted 1 hour ago • Updated 1 hour ago

Full Time

No Travel Required

On-site

120000/yr

Tek Inspirations LLC

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

API
Agile
Artificial Intelligence
Automated Testing
Continuous Delivery
Continuous Integration
Evaluation
Git
LangSmith
Python
Quality Assurance
Regression Analysis
Testing
TypeScript
Workflow

Summary

Position : Senior Quality Engineer – AI/LLM Test Automation

Location: Birmingham, AL
Type: Full-Time

Must Have

5+ years of QA / SDET / Test Automation experience.
1–2+ years of hands-on experience testing AI/LLM applications.
Hands-on experience with LLM evaluation / AI evaluation.
Experience creating or working with evaluation datasets and ground truth.
Understanding of LLM judges / AI-as-a-judge, evaluators, scoring, and quality thresholds.
Experience testing nondeterministic AI-generated outputs.
Hands-on LangSmith experience.
Hands-on LangGraph or agent workflow experience.
Strong Playwright experience, preferably with TypeScript.
Strong Python and/or TypeScript skills.
API, integration, regression, and end-to-end testing experience.
Experience integrating automated tests into CI/CD.
Strong understanding of Git and Agile development.

Ideal Background

Someone who has worked as an SDET / Senior QA Automation Engineer / AI Test Engineer / AI Quality Engineer and can explain, with real examples:

Production/User Behavior ? Evaluation Dataset ? Ground Truth ? Evaluator/LLM Judge ? Experiment ? Score/Threshold ? Regression ? CI/CD

The candidate should be able to explain how they tested AI outputs, not simply how they used AI tools to write traditional automation tests.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91099133
Position Id: 9109834
Posted 1 hour ago

Company Info

About Tek Inspirations LLC

TEK Inspirations LLC is a Texas based IT Staffing and consulting company that focuses on highly qualitative, timely delivered and cost-effective offshore software development and Staffing Services. We are committed to attracting, retaining and rewarding the best minds in the business. TEK Inspirations LLC is a place where people can grow and advance their career. We believe in an environment of integrity, trust, and sense of pride. We commit to attract & develop talent and retain a team of motivated & satisfied employees.

TEK Inspirations is committed to provide customer satisfaction through commitment & highest standards of qualitative services with minimum turnaround time. We have extensive experience in providing services to different domains like Healthcare, Pharmaceutical, Banking & Financial, and Telecom etc. We are highly focused to our customers in more ways than one. By improving reliability and agility, we enable our customers to achieve sustainable advantage over their competitors.

Go to company profile

Contact the job poster

Payal Shrivastava

Recruiter @ Tek Inspirations LLC

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Hybrid in Mesa, Arizona

•

7d ago

Job Description - Job Title: Sr. QA Lead (automation & manual testing) Work Model: Hybrid, with the first 6 8 months fully remoteLocation: Mesa, AZ Need a local candidateInterview Process: VirtualNeed a local candidate of AZcandidate with strong leadership abilities Overview The Senior QA Lead is responsible for owning end-to-end quality across applications, leading QA strategy, guiding automation and manual testing efforts, and mentoring a team of QA engineers. This role requires a seasone

Easy Apply

Contract

$40 - $60

Search all similar jobs

More jobs at Tek Inspirations LLC in Birmingham, AL