AI QE Architect and Governance Leader - West Palm Beach, FL - Lorven Technologies, Inc. - West Palm Beach, FL, US | Dice.com

Lorven Technologies, Inc.

Apply Now

AI QE Architect and Governance Leader - West Palm Beach, FL

West Palm Beach, FL, US • Posted 6 days ago • Updated 3 hours ago

Full Time

On-site

$DOE

Apply Now

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

SDET
Typescript
Python
QE
LLM
Langgraph

Summary

Our client seeks an AI QE Architect for a Full time project in West Palm Beach, FL . Below is the detailed requirement

Job Title: AI QE Architect

Work location : West Palm Beach, FL

Duration: Full Time

Job Description:

Bachelor's degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12+ Minimum Experience

10 14 years as a Technology Architect, SDET, or QE Leader with strong coding skills in Python, TypeScript, or Java.
Proven experience designing automation frameworks or developer tools for large engineering organizations.
Hands-on expertise with Large Language Models (LLMs), prompt engineering, and safety evaluation techniques.
Exposure to Agentic AI systems and orchestration tools such as LangGraph, AutoGen, CrewAI, or similar agent frameworks.
Experience implementing Model Context Protocol (MCP) for real-time automation, autonomous workflows, or CI/CD integrations.
Experience working in highly regulated industries-Energy, Utilities, Nuclear, Healthcare, BFSI, or similar.

AI / ML Technologies

Practical experience with frameworks and ecosystems:
LangChain, Hugging Face, GPT models, vector databases
Working knowledge of ML/DL libraries:
Scikit-learn, TensorFlow, Keras, PyTorch, HuggingFace Transformers, OpenCV, NLTK and BART
Understanding of RAG architectures, embeddings, and semantic search (bonus).

GenAI & AI Agent Development

Expertise in designing, developing, validating, and deploying Generative AI solutions.
Experience building AI agents, multi-agent workflows, or autonomous decision systems.

Ability to define governance for:

LLM drift detection
Prompt quality standards
Agent monitoring & observability
Data lineage & model versioning

Automation & Quality Engineering

Strong experience building test automation frameworks using Python, PyTest, Selenium, Playwright, and Requests.
Ability to create automated tests covering:

Functional

API
Integration
Performance
Security
AI/ML validation (LLM testing, model accuracy, hallucination detection)

Proficiency in API testing and validation of RESTful services.
Plus: Experience with performance/load testing tools K6 or JMeter.

AI Governance & Compliance

Establish AI/ML quality standards, testing guidelines, and risk controls.

Define governance around:

Data security & privacy
Model evaluation KPIs (accuracy, bias, toxicity, hallucination rates)
Regulatory alignment for Energy/Utility operations
Continuous monitoring & drift alerts

Experience working with IRB, compliance, or audit teams.

Cloud, DevOps & CI/CD

Knowledge of deploying AI and automation solutions on AWS.
Experience implementing CI/CD pipelines for ML and LLM models:
Model versioning & lifecycle
Retraining workflows
Automated evaluation gates
Infrastructure-as-code (IAC) familiarity
Experience implementing observability frameworks for AI/ML systems.

SDLC & Collaboration

Strong understanding of end-to-end SDLC and QE methodologies.
Work closely with developers, product managers, data scientists, and business stakeholders.
Ability to provide clear communication around test strategy, risks, coverage, and governance readiness.
Skilled in defect triage, risk-based testing, and quality strategy leadership.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10120137
Position Id: 2025-66017
Posted 6 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

West Palm Beach, Florida

•

Today

NO Sponsorship, No C2C, Onsite from day one. Candidate doesnt need AI development experience. The AI experience is only from the user side Someone who has experience using LLM or AI tools in testing (for example: using AI for test case generation, validation, automation assistance, etc.) Job description: We are seeking an experienced AI Quality Engineering (QE) Architect & Governance Leader to drive end-to-end quality, automation, and governance for AI, ML, and GenAI solutions across mission-cri

Easy Apply

Full-time

Depends on Experience

AI QE Engineer

West Palm Beach, Florida

•

Yesterday

Job Role: AI QE Engineer Location : West Palm Beach, Florida (Onsite) 2 positions Visa Status US Job Description: Role Summary We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6 years as a Softw

Easy Apply

Full-time

Depends on Experience

AI QE Engineer (NO c2C)

West Palm Beach, Florida

•

6d ago

No Sponsorship. NO C2C. Onsite from day one. We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6 years as a Software Engineer, SDET, or Automation Engineer.Strong coding skills in Python, TypeScr

Easy Apply

Full-time

Depends on Experience

Senior Staff AI/ML Product Lead - Enterprise Data

Remote or West Palm Beach, Florida

•

Today

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500 . Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But thi

Full-time

AI QE Architect and Governance Leader - West Palm Beach, FL

Dice Job Match Score™

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs

Dice Job Match Score™