Software Engineer AI/ML QA Engineer

Hybrid in Columbia, MD, US • Posted 20 hours ago • Updated 2 hours ago
Contract W2
12 Months
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AI QA ENGINEER
  • AI/ML QA ENGINEER
  • GENAI QA ENGINEER
  • AI TEST ENGINEER
  • ML QA ENGINEER
  • AI SDET
  • LLM
  • GENERATIVE AI
  • GENAI
  • MACHINE LEARNING
  • AI/ML
  • LLM TESTING
  • AI TESTING
  • MODEL VALIDATION
  • MODEL TESTING
  • PROMPT TESTING
  • RAG
  • AI EVALUATION
  • SELENIUM
  • BDD
  • CUCUMBER
  • SQL
  • ORACLE
  • AWS
  • GCP
  • AWS BEDROCK
  • SAGEMAKER

Summary

Company Description
Lumen SolutionsGroupInc. is a technology consulting Services company based inFlorida. Weprovidea wide array of experienced business and IT professionals supporting clients from solution design to implementation and support.We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and EnterpriseTransformation.

Role: Software Engineer AI/ML QA Engineer
Location: Columbia, MD / Washington, DC (Hybrid Required once in a Week)
Job Type: 6 Months Contract (Possible Extension)


Job Summary:
We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills.


Key Responsibilities:
  • Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.
  • Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
  • Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
  • Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
  • Test Salesforce Einstein and integrations with external LLM/AI platforms.
  • Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
  • Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety.
  • Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
  • Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
  • Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.

Required Qualifications
  • 3+ years of Software Engineering experience.
  • 12 years of hands-on AI/ML/Generative AI project experience.
  • 3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
  • Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
  • Strong hands-on experience with Selenium, BDD, and test automation.
  • Experience with API, UI, manual, and automation testing.
  • Strong SQL skills and experience with Oracle.
  • Understanding of relational and non-relational databases.
  • Understanding of data pipelines and ability to validate intermediate pipeline outputs.
  • Experience working with Jira and Confluence.
  • Bachelor's degree required; technical degree preferred.

Nice to Have
  • Experience with AWS Bedrock and/or SageMaker.
  • Experience with AI/ML testing frameworks.

Lumen SolutionsGroup Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10483685
  • Position Id: 26-00772
  • Posted 20 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Columbia, Maryland

Today

Easy Apply

Third Party, Contract

Depends on Experience

Hybrid in Columbia, Maryland

Today

Easy Apply

Contract

Depends on Experience

Hybrid in Baltimore, Maryland

Today

Easy Apply

Contract

Depends on Experience

Hybrid in Columbia, Maryland

Today

Easy Apply

Contract

$62.4

Search all similar jobs