About Apexon:
Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients toughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents.
We enable #HumanFirstDIGITAL
AI QE Architect and Governance Leader - Job description:
We are seeking an experienced AI Quality Engineering (QE) Architect & Governance Leader to drive end-to-end quality, automation, and governance for AI, ML, and GenAI solutions across mission-critical and highly regulated environments. This role combines deep expertise in automation, AI/ML technologies, and agentic workflows with strong leadership in governance, risk, and complianceespecially for Energy/Utilities/Nuclear domains.
You will architect future-state AI QE frameworks, establish testing standards for LLMs and agents, automate validation pipelines, enforce model governance, and lead enterprise-wide assurance initiatives.
Visa Status US
Country USA, Canada
Location Onsite FPL West Palm Beach , Florida
Core Experience & Qualifications
- 1014 years as a Technology Architect, SDET, or QE Leader with strong coding skills in Python, TypeScript, or Java.
- Proven experience designing automation frameworks or developer tools for large engineering organizations.
- Hands-on expertise with Large Language Models (LLMs), prompt engineering, and safety evaluation techniques.
- Exposure to Agentic AI systems and orchestration tools such as LangGraph, AutoGen, CrewAI, or similar agent frameworks.
- Experience implementing Model Context Protocol (MCP) for real-time automation, autonomous workflows, or CI/CD integrations.
- Experience working in highly regulated industriesEnergy, Utilities, Nuclear, Healthcare, BFSI, or similar.
AI / ML Technologies
- Practical experience with frameworks and ecosystems:
LangChain, Hugging Face, GPT models, vector databases
- Working knowledge of ML/DL libraries:
Scikit-learn, TensorFlow, Keras, PyTorch, HuggingFace Transformers, OpenCV, NLTK and BART
- Understanding of RAG architectures, embeddings, and semantic search (bonus).
GenAI & AI Agent Development
- Expertise in designing, developing, validating, and deploying Generative AI solutions.
- Experience building AI agents, multi-agent workflows, or autonomous decision systems.
- Ability to define governance for:
oLLM drift detection
oPrompt quality standards
oAgent monitoring & observability
oData lineage & model versioning
Automation & Quality Engineering
- Strong experience building test automation frameworks using Python, PyTest, Selenium, Playwright, and Requests.
- Ability to create automated tests covering:
oFunctional
oAPI
oIntegration
oPerformance
oSecurity
oAI/ML validation (LLM testing, model accuracy, hallucination detection)
- Proficiency in API testing and validation of RESTful services.
- Plus: Experience with performance/load testing tools K6 or JMeter.
AI Governance & Compliance
- Establish AI/ML quality standards, testing guidelines, and risk controls.
- Define governance around:
oData security & privacy
oModel evaluation KPIs (accuracy, bias, toxicity, hallucination rates)
oRegulatory alignment for Energy/Utility operations
oContinuous monitoring & drift alerts
- Experience working with IRB, compliance, or audit teams.
Cloud, DevOps & CI/CD
- Knowledge of deploying AI and automation solutions on AWS.
- Experience implementing CI/CD pipelines for ML and LLM models:
oModel versioning & lifecycle
oRetraining workflows
oAutomated evaluation gates
oInfrastructure-as-code (IAC) familiarity
- Experience implementing observability frameworks for AI/ML systems.
SDLC & Collaboration
- Strong understanding of end-to-end SDLC and QE methodologies.
- Work closely with developers, product managers, data scientists, and business stakeholders.
- Ability to provide clear communication around test strategy, risks, coverage, and governance readiness.
- Skilled in defect triage, risk-based testing, and quality strategy leadership.
Our Commitment to Diversity & Inclusion:
Did you know that Apexon has been Certified by Great Place To Work, the global authority on workplace culture, in each of the three regions in which it operates: USA (for the fourth time in 2023), India (seven consecutive certifications as of 2023), and the UK.Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. You can read about our Job Applicant Privacy policy here Job Applicant Privacy Policy (apexon.com)
Our Commitment to Environment:
Actively contribute to Apexon's commitment to environmental responsibility by following sustainable practices and supporting ESG initiatives.
Our Perks and Benefits:
Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning/upskilling experience and provide care and support for you and your loved ones. As an Apexon Associate, you get continuous skill-based development, opportunities for career advancement, and access to comprehensive health and well-being benefits and assistance.
We also offer:
o Health Insurance with Dental & Vision
o 401K Plan
o Life Insurance, STD & LTD
o Paid Vacations & Holidays
o Paid Parental Leave
o FSA Dependent & Limited Purpose care
Never miss an opportunity! Create an alert based on the job you applied for.