AI Engineer

Hybrid in Atlanta, GA, US • Posted 1 day ago • Updated 1 day ago
Contract W2
24 Months
No Travel Required
Hybrid
$65 - $70/hr
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Artificial Intelligence
  • Analytical Skill
  • API
  • Generative Artificial Intelligence (AI)
  • JSON
  • Agile
  • Python
  • SQL
  • RAG
  • LLM
  • DevOps
  • Postman
  • Automated Testing
  • Quality Assurance

Summary

AI Engineer – GenAI Quality & Evaluation


Locations: Oakdale, MN | Atlanta, GA | Scottsdale, AZ | St. Petersburg, FL | Omaha, NE
Work Arrangement: Hybrid – 3 days onsite
Employment Type: Contract (C2C)
Requirement: Candidates must be local to one of the listed locations.

We are looking for an experienced AI Engineer with a background in software engineering, QA, automation testing, or business systems analysis. The ideal candidate should have at least one year of hands-on experience with Generative AI, LLMs, prompt engineering, conversational AI, or AI testing.

Key Skills

  • Generative AI and Large Language Models
  • Prompt engineering and prompt optimization
  • LLM testing and AI quality assurance
  • RAG, vector databases, semantic search, and embeddings
  • AI evaluation and observability
  • Python and SQL
  • REST APIs, JSON, and Postman
  • Test automation frameworks
  • Azure DevOps, Git, and Azure OpenAI
  • Arize AI or similar observability tools

Responsibilities

  • Design and execute test plans for GenAI and LLM applications
  • Test prompts, agents, APIs, conversational AI, and RAG workflows
  • Evaluate AI responses and identify hallucinations or quality issues
  • Perform functional, regression, integration, and API testing
  • Build or improve automated testing frameworks
  • Track defects, prompt versions, experiments, and test results
  • Prepare technical documentation and evaluation reports
  • Work closely with developers, QA teams, product teams, and business stakeholders

Qualifications

  • 5–10 years of relevant technical experience
  • 1+ year of hands-on GenAI or LLM experience
  • Strong experience with test planning, APIs, JSON, and Agile delivery
  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field
  • Strong analytical, troubleshooting, communication, and documentation skills
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10227485
  • Position Id: 9046282
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Atlanta, Georgia

Today

Easy Apply

Full-time, Third Party

Depends on Experience

Atlanta, Georgia

13d ago

Full-time

USD 134,500.00 - 265,100.00 per year

Alpharetta, Georgia

Today

Contract

Hybrid in Alpharetta, Georgia

2d ago

Easy Apply

Full-time

140,000 - 160,000

Search all similar jobs