AI QE Engineer

Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients toughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents.

We enable #HumanFirstDIGITAL

Job Description: AI QE Engineer

Location West Palm Beach, FL (or willing to travel onsite as needed)

Role Summary

We are looking for a AI Quality Engineering Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.

Core Experience

• 4 - 6 years as a Software Engineer, SDET, or Automation Engineer.
• Strong coding skills in Python, TypeScript, or Java.
• Hands-on experience developing automation scripts, tools, or frameworks.
• Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.
• Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.
• Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).

AI / ML Technologies

• Practical experience with AI/ML frameworks:

LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.

• Experience with ML/DL libraries such as:

Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.

• Ability to work with embeddings, similarity search, and content evaluation metrics.

GenAI & AI Agent Development

• Ability to integrate or build GenAI components, including RAG pipelines or agent-based workflows.
• Support model evaluation tasks such as:

oOutput quality checks

oHallucination detection

oPrompt validation

oRegression checks for model updates

Automation & Quality Engineering

• Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.
• Ability to design and execute automated tests for:

oFunctional

oIntegration

oAPI

oBasic performance & reliability testing

• Hands-on experience testing RESTful APIs and building automated API suites.

Cloud, DevOps & CI/CD

• Exposure to deploying AI or automation solutions on AWS.
• Working knowledge of CI/CD pipelines, including:

oAutomated testing

oModel validation steps

oVersioning & artifact management

SDLC & Collaboration

• Strong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.
• Ability to collaborate with Developers, Data Scientist, and QE teams, clearly communicating progress, risks, and results.
• Skilled in documenting and tracking defects and participating in defect triage.

Our Commitment to Diversity & Inclusion:

Did you know that Apexon has been Certified by Great Place To Work , the global authority on workplace culture, in each of the three regions in which it operates: USA (for the fourth time in 2023), India (seven consecutive certifications as of 2023), and the UK.Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. You can read about our Job Applicant Privacy policy here Job Applicant Privacy Policy (apexon.com)

Our Commitment to Environment:

Actively contribute to Apexon's commitment to environmental responsibility by following sustainable practices and supporting ESG initiatives.

Our Perks and Benefits:

Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning/upskilling experience and provide care and support for you and your loved ones. As an Apexon Associate, you get continuous skill-based development, opportunities for career advancement, and access to comprehensive health and well-being benefits and assistance.

We also offer:

o Health Insurance with Dental & Vision

o 401K Plan

o Life Insurance, STD & LTD

o Paid Vacations & Holidays

o Paid Parental Leave

o FSA Dependent & Limited Purpose care