AI QE Engineer - Cosmic-I LLC DBA Northern Base - West Palm Beach, FL, US | Dice.com

Cosmic-I LLC DBA Northern Base

Apply Now

AI QE Engineer

West Palm Beach, FL, US • Posted 1 day ago • Updated 1 day ago

Full Time

On-site

Depends on Experience

Apply Now

Cosmic-I LLC DBA Northern Base

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

AI QE Engineer
SDET
Typescript

Summary

Job Role: AI QE Engineer

Location : West Palm Beach, Florida (Onsite)

2 positions

Visa Status US

Job Description:

Role Summary

We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.

Core Experience

4-6 years as a Software Engineer, SDET, or Automation Engineer.
Strong coding skills in Python, TypeScript, or Java.
Hands-on experience developing automation scripts, tools, or frameworks.
Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.
Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.
Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).

AI / ML Technologies

Practical experience with AI/ML frameworks:
LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.
Experience with ML/DL libraries such as:
Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.
Ability to work with embeddings, similarity search, and content evaluation metrics.

GenAI & AI Agent Development

Ability to integrate or build GenAI components, including RAG pipelines or agent-based workflows.
Support model evaluation tasks such as:
Output quality checks
Hallucination detection
Prompt validation
Regression checks for model updates

Automation & Quality Engineering

Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.
Ability to design and execute automated tests for:
Functional
Integration
API
Basic performance & reliability testing
Hands-on experience testing RESTful APIs and building automated API suites.

Cloud, DevOps & CI/CD

Exposure to deploying AI or automation solutions on AWS.
Working knowledge of CI/CD pipelines, including:
Automated testing
Model validation steps
Versioning & artifact management

SDLC & Collaboration

Strong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.
Ability to collaborate with Developers, Data Scientist, and QE teams, clearly communicating progress, risks, and results.
Skilled in documenting and tracking defects and participating in defect triage.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91162152
Position Id: 8827193
Posted 1 day ago

Company Info

About Cosmic-I LLC DBA Northern Base

Enabling our clients to achieve their goals since 2016.

We stay at the forefront of technology trends and emerging innovations to bring our clients cutting-edge solutions that help them stay ahead of the competition. Our focus on innovation enables us to provide customized IT solutions that address our clients’ specific needs and drive business success.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AI QE Engineer (NO c2C)

West Palm Beach, Florida

•

6d ago

No Sponsorship. NO C2C. Onsite from day one. We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6 years as a Software Engineer, SDET, or Automation Engineer.Strong coding skills in Python, TypeScr

Easy Apply

Full-time

Depends on Experience

QE Architect and Governance Leader with experience in AI (NO C2C)

West Palm Beach, Florida

•

Today

NO Sponsorship, No C2C, Onsite from day one. Candidate doesnt need AI development experience. The AI experience is only from the user side Someone who has experience using LLM or AI tools in testing (for example: using AI for test case generation, validation, automation assistance, etc.) Job description: We are seeking an experienced AI Quality Engineering (QE) Architect & Governance Leader to drive end-to-end quality, automation, and governance for AI, ML, and GenAI solutions across mission-cri

Easy Apply

Full-time

Depends on Experience

AI QE Architect and Governance Leader - West Palm Beach, FL

West Palm Beach, Florida

•

Today

Our client seeks an AI QE Architect for a Full time project in West Palm Beach, FL . Below is the detailed requirement Job Title: AI QE Architect Work location : West Palm Beach, FL Duration: Full Time Job Description: Bachelor's degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12+ Minimum Experience 10 14 years as a Technology Architect, SDET, or QE Leader with strong coding skills in Python, TypeScript

Easy Apply

Full-time

$DOE

Senior Software Engineer (C#, .NET Core, Azure / AWS, AI Integration, T-SQL)

Hybrid in Boca Raton, Florida

•

4d ago

Our client is looking to augment their team with a Senior Software Engineer to assist in the implementation of their cloud-based systems. AI experience a plus but not required Requirements: 5+ years of experience in software development, preferably with exposure to large-scale, web-based applications.Extensive experience with .NET / C#, SQL Server, front-end technologies (HTML, CSS, JavaScript).Experience with unit testing, Continuous Integration, working within an Agile (SCRUM) development envi

Easy Apply

Full-time

Depends on Experience

AI QE Engineer

Cosmic-I LLC DBA Northern Base

Dice Job Match Score™

Dice Job Match Score™

Job Details

Skills

Summary

Company Info

About Cosmic-I LLC DBA Northern Base

Similar Jobs

Dice Job Match Score™

Ramya Lakshmi