Search Jobs | Dice.com

451 results (31 new)

Group by company

Test Automation Engineer || QA || Generative AI

SolveIT Services Inc

Dallas, Texas • Today

Easy Apply

Contract, Third Party

$60 - $60

Senior AWS Full Stack Software Engineer

System One

Plano, Texas • 4d ago

Easy Apply

Full-time

$108500

Senior QA Automation Engineer

Stellent IT LLC

Irving, Texas • Today

Easy Apply

Contract, Third Party

Senior AWS Full Stack Engineer

System One

Plano, Texas • 4d ago

Easy Apply

Full-time

$108000

AI Quality Engineer

Software Guidance & Assistance

Irving, Texas • Today

Contract, Third Party

QA Automation Tester with Data Governance

Promantus, Inc

Plano, Texas • 2d ago

Easy Apply

Contract, Third Party

40 - 45

Solution Engineering

Qualizeal

Remote or Hybrid in Dallas, Texas • 24d ago

Easy Apply

Full-time

0 - 0

Telecom OSS Tester with AI/Agentic AI Experience

Cliff Services Inc

Dallas, Texas • Today

Easy Apply

Contract

Software Engineer in Test II

Forcepoint

Richardson, Texas • Today

Full-time

USD 98,900.00 - 129,200.00 per year

Tester

Pyramid Consulting, Inc.

Plano, Texas • Yesterday

Easy Apply

Contract

$50 - $55

Python QA Automation Engineer (AI Experience required)

AgreeYa Solutions

Plano, Texas • Today

Easy Apply

Contract

Depends on Experience

QA Automation

Prudent Technologies and Consulting

Coppell, Texas • 3d ago

Easy Apply

Contract

Depends on Experience

Sr. QA Automation Tester

Software Guidance & Assistance

Irving, Texas • Today

Contract, Third Party

AI Integration Sr. Analyst - Risk Analytics

Texas Capital Bank

Dallas, Texas • Today

Full-time

Technical Architect - Enterprise Data

Arastra, Inc.

Remote or Dallas, Texas • Today

Full-time

QA Automation Engineer (Exp-8 Years) -Full time-Hybrid

Visionary Innovative Technology Solutions

Hybrid in Dallas, Texas • 3d ago

Easy Apply

Full-time

Depends on Experience

Java AI Developer

Software Guidance & Assistance

Irving, Texas • Today

Contract, Third Party

Sr. Java Developer

Software Guidance & Assistance

Irving, Texas • Today

Contract, Third Party

AI Engineer Intern - USA

Black Box

Plano, Texas • Today

Part-time

AI Engineer

Digipulse Technologies, Inc

Remote • 2d ago

Easy Apply

Full-time, Third Party

Depends on Experience

Test Automation Engineer

GDH

Remote • 8d ago

Easy Apply

Third Party, Contract

Depends on Experience

Gen AI Developer || Hybrid -Irving, TX

Pioneer IT Systems LLC

Hybrid in Irving, Texas • 2d ago

Easy Apply

Full-time

$120,000 - $140,000

Project Manager

Tixy Services LLC

Dallas, Texas • Yesterday

Easy Apply

Full-time

55 - 60

Lead Software Engineer - Quality Assurance / Test Automation / Agentic Systems

JPMorgan Chase & Co.

Plano, Texas • Today

Full-time

Full Stack Java/React Technical Lead - Vice President

Citi

Irving, Texas • Today

Full-time

USD 125,760.00 - 188,640.00 per year

Lead Data Engineer

Tixy Services LLC

Dallas, Texas • 22d ago

Easy Apply

Contract

Depends on Experience

Senior AI Engineer

eClercx

Dallas, Texas • Today

Full-time

USD 105,000.00 - 150,000.00 per year

Forward Deployed AI Engineer

Everest Technologies

Dallas, Texas • 24d ago

Easy Apply

Full-time, Third Party

Depends on Experience

QA Lead- AI / Automation Testing ::: FTE ::: Remote

REDLEO SOFTWARE INC.

Remote • 8d ago

Easy Apply

Full-time

110,000 - 120,000

Lead Security Engineer - Python

JPMorgan Chase & Co.

Plano, Texas • Today

Full-time

USD 156,750.00 - 215,000.00 per year

Job Details

Skills

Agentic

Summary

Agentic QA Engineer Generative AI & Agentic Systems (Agent, MultiAgent Testing)

Location: Dallas, TX

Rate: $60/hr on Corp to Corp

Duration: Long term

Summary

We are seeking a hands-on AI Engineer to design and execute end-to-end testing strategies for agentic AI solutions, including multi-agent systems in production-grade environments. This role partners with the Agentic Operations Team to ensure resiliency, reliability, accuracy, latency, orchestration correctness, and scale. You will establish QA frameworks, build reusable test artifacts, drive macro-level validations across complex workflows, and lead the QA function for Agentic AI from Dev to Prod.

Key Responsibilities

Agentic & MultiAgent Testing
Reliability, Resiliency, and Latency
Accuracy & Macro-Level Validations
Scale & Orchestration
Dev Prod Readiness
Define and own the QA strategy for agentic/multi-agent AI systems across dev, staging, and prod.
Mentor a team of QA engineers; establish testing standards, coding guidelines for test harnesses, and review practices.
Partner with Agentic Operations, Data Science, MLOps, and Platform teams to embed QA in the SDLC and incident response.
Design tests for agent orchestration, tool calling, planner-executor loops, and inter-agent coordination (e.g., task decomposition, handoff integrity, and convergence to goals).
Validate state management, context windows, memory/knowledge stores, and prompt/graph correctness under varying conditions.
Implement scenario fuzzing (e.g., adversarial inputs, prompt perturbations, tool latency spikes, degraded APIs).
Create resilience testing suites: chaos experiments, failover, retries/backoff, circuit-breaking, and degraded mode behavior.
Establish latency SLOs and measure end-to-end response times across orchestration layers (LLM calls, tool invocations, queues).
Ensure reliability through soak tests, canary verifications, and automated rollbacks.
Define ground-truth and reference pipelines for task accuracy (exact match, semantic similarity, factuality checks).
Build macro validation frameworks that validate task outcomes across multi-step agent workflows (e.g., complex data pipelines, content generation + verification agent loops).
Instrument guardrail validations (toxicity, PII, hallucination, policy compliance).
Design load/stress tests for multi-agent graphs under scale (concurrency, throughput, queue depth, backpressure).
Validate orchestrator correctness (DAG execution, retries, branching, timeouts, compensation paths).
Engineer reusable test artifacts (scenario configs, synthetic datasets, prompt libraries, agent graph fixtures, simulators).
Integrate tests into CI/CD (pre-merge gates, nightly, canary) and production monitoring with alerting tied to KPIs.
Define release criteria and run operational readiness (performance, security, compliance, cost/latency budgets).

Required Qualifications

7+ years in Software QA/Testing, with 2+ years in AI/ML or LLM-based systems; hands-on experience testing agentic/multi-agent architectures.
Strong programming skills in Python experience building test harnesses, simulators, and fixtures.
Experience with LLM evaluation (exact/soft match, BLEU/ROUGE, BERTScore, semantic similarity via embeddings), guardrails, and prompt testing.
Expertise in distributed systems testing latency profiling, resiliency patterns (circuit breakers, retries), chaos engineering, and message queues.
Familiarity with orchestration frameworks (LangChain, LangGraph, LlamaIndex, DSPy, OpenAI Assistants/Actions, Azure OpenAI orchestration, or similar).
Proficiency with CI/CD (GitHub Actions/Azure DevOps), observability (OpenTelemetry, PrometheGrafana, Datadog), and feature flags/canaries.
Solid understanding of privacy/security/compliance in AI systems (PII handling, content policies, model safety).
Excellent communication and leadership skills; proven ability to work cross-functionally with Ops, Data, and Engineering.

Preferred Qualifications

Experience with multi-agent simulators, agent graph testing, and tooling latency emulation.
Knowledge of MLOps (model versioning, datasets, evaluation pipelines) and A/B experimentation for LLMs.
Background in cloud (AWS), serverless, containerization, and event-driven architectures.

Prior ownership of cost/latency/SLAs for AI workloads in production.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91132048
Position Id: 9077107
Posted 20 hours ago

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Contact the job poster

Akash Goyal

US IT Recruiter @ SolveIT Services Inc

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Dallas, Texas

•

Today

Hi All, Good Morning, Immediate and urgent need for the below requirement. Title: Senior SDET / QA Automation Engineer (Agentic AI & Full-Stack) Location: Dallas, TX In-person interview is mandatory Duration: Long Term Need strong Python and AWS Bedrock experience Summary: Were looking for a Senior SDET with strong fullstack engineering skills, deep experience in backend and servicelevel development, and the ability to build scalable test application in Python or Java. This role blends front

Easy Apply

Third Party, Contract

55 - 60

Senior SDET / QA Automation Engineer (Agentic AI & Full-Stack) - allas, TX In-person interview is mandatory. Need strong Python and AWS Bedrock experience.

Dallas, Texas

•

3d ago

Senior SDET / QA Automation Engineer (Agentic AI & Full-Stack) Dallas, TX In-person interview is mandatory Need strong Python and AWS Bedrock experience Summary We re looking for a Senior SDET with strong fullstack engineering skills, deep experience in backend and servicelevel development, and the ability to build scalable test application in Python or Java. This role blends frontend and backend development, cloudnative testing, and AI-augmented quality engineering with a heavy focus on buildi

Easy Apply

Third Party, Contract

Depends on Experience

AI Quality Engineer

Irving, Texas

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for an AI Quality Engineer for a contract assignment with one of our premier financial services clients in Irving, TX . Responsibilities : Design, develop, and implement comprehensive quality assurance strategies for our artificial intelligence applications and AI agents. Responsible for creating robust test plans and procedures to validate the performance, functionality, accuracy, and resilience of AI models and systems. Play a critical

Contract, Third Party

Gen AI Architect_Dallas,TX

Dallas, Texas

•

Today

AI Architect Need strong candidates local to Dallas . Day one onsite Inperson interview is must 10 Years of Experience As Sr Eng 2 Architect on the Agentic System Layer (ASL) team, you will define and drive the technical architecture for agentic AI platform. Day-to-day responsibilities include: designing and evolving the architecture for multi-agent orchestration systems, tool-use frameworks, and LLM integration pipelines; establishing patterns for agent reliability, observability, and guardr

Easy Apply

Contract, Third Party

Depends on Experience

Job Details

Skills

Agentic

Summary

Agentic QA Engineer Generative AI & Agentic Systems (Agent, MultiAgent Testing)

Location: Dallas, TX

Rate: $60/hr on Corp to Corp

Duration: Long term

Summary

Key Responsibilities

Agentic & MultiAgent Testing
Reliability, Resiliency, and Latency
Accuracy & Macro-Level Validations
Scale & Orchestration
Dev Prod Readiness
Define and own the QA strategy for agentic/multi-agent AI systems across dev, staging, and prod.
Mentor a team of QA engineers; establish testing standards, coding guidelines for test harnesses, and review practices.
Partner with Agentic Operations, Data Science, MLOps, and Platform teams to embed QA in the SDLC and incident response.
Design tests for agent orchestration, tool calling, planner-executor loops, and inter-agent coordination (e.g., task decomposition, handoff integrity, and convergence to goals).
Validate state management, context windows, memory/knowledge stores, and prompt/graph correctness under varying conditions.
Implement scenario fuzzing (e.g., adversarial inputs, prompt perturbations, tool latency spikes, degraded APIs).
Create resilience testing suites: chaos experiments, failover, retries/backoff, circuit-breaking, and degraded mode behavior.
Establish latency SLOs and measure end-to-end response times across orchestration layers (LLM calls, tool invocations, queues).
Ensure reliability through soak tests, canary verifications, and automated rollbacks.
Define ground-truth and reference pipelines for task accuracy (exact match, semantic similarity, factuality checks).
Build macro validation frameworks that validate task outcomes across multi-step agent workflows (e.g., complex data pipelines, content generation + verification agent loops).
Instrument guardrail validations (toxicity, PII, hallucination, policy compliance).
Design load/stress tests for multi-agent graphs under scale (concurrency, throughput, queue depth, backpressure).
Validate orchestrator correctness (DAG execution, retries, branching, timeouts, compensation paths).
Engineer reusable test artifacts (scenario configs, synthetic datasets, prompt libraries, agent graph fixtures, simulators).
Integrate tests into CI/CD (pre-merge gates, nightly, canary) and production monitoring with alerting tied to KPIs.
Define release criteria and run operational readiness (performance, security, compliance, cost/latency budgets).

Required Qualifications

7+ years in Software QA/Testing, with 2+ years in AI/ML or LLM-based systems; hands-on experience testing agentic/multi-agent architectures.
Strong programming skills in Python experience building test harnesses, simulators, and fixtures.
Experience with LLM evaluation (exact/soft match, BLEU/ROUGE, BERTScore, semantic similarity via embeddings), guardrails, and prompt testing.
Expertise in distributed systems testing latency profiling, resiliency patterns (circuit breakers, retries), chaos engineering, and message queues.
Familiarity with orchestration frameworks (LangChain, LangGraph, LlamaIndex, DSPy, OpenAI Assistants/Actions, Azure OpenAI orchestration, or similar).
Proficiency with CI/CD (GitHub Actions/Azure DevOps), observability (OpenTelemetry, PrometheGrafana, Datadog), and feature flags/canaries.
Solid understanding of privacy/security/compliance in AI systems (PII handling, content policies, model safety).
Excellent communication and leadership skills; proven ability to work cross-functionally with Ops, Data, and Engineering.

Preferred Qualifications

Experience with multi-agent simulators, agent graph testing, and tooling latency emulation.
Knowledge of MLOps (model versioning, datasets, evaluation pipelines) and A/B experimentation for LLMs.
Background in cloud (AWS), serverless, containerization, and event-driven architectures.

Prior ownership of cost/latency/SLAs for AI workloads in production.

Dice Id: 91132048
Position Id: 9077107
Posted 20 hours ago

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Contact the job poster

Akash Goyal

US IT Recruiter @ SolveIT Services Inc

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Dallas, Texas

•

Today

Easy Apply

Third Party, Contract

55 - 60

Senior SDET / QA Automation Engineer (Agentic AI & Full-Stack) - allas, TX In-person interview is mandatory. Need strong Python and AWS Bedrock experience.

Dallas, Texas

•

3d ago

Easy Apply

Third Party, Contract

Depends on Experience

AI Quality Engineer

Irving, Texas

•

Today

Contract, Third Party

Gen AI Architect_Dallas,TX

Dallas, Texas

•

Today

Easy Apply

Contract, Third Party

Depends on Experience

Test Automation Engineer || QA || Generative AI

Skills

Summary

Dice Job Match Score™

Akash Goyal

Similar Jobs

Test Automation Engineer || QA || Generative AI

Job Details

Skills

Summary

Dice Job Match Score™

Akash Goyal

Similar Jobs