Overview
On Site
DOE
Accepts corp to corp applications
Contract - W2
Skills
Quality Assurance
Large Language Models (LLMs)
Technical Writing
Collaboration
Testing
Machine Learning (ML)
Generative Artificial Intelligence (AI)
FOCUS
Prompt Engineering
Evaluation
LangSmith
ServiceNow
Orchestration
Microsoft Azure
Analytical Skill
Problem Solving
Conflict Resolution
Communication
Documentation
Reporting
Computer Science
Data Science
Automated Testing
Scripting
Regulatory Compliance
Data Governance
Artificial Intelligence
Job Details
; Job Summary We are seeking a Gen AI Engineer with a strong focus on testing and prompt engineering to support the development and quality assurance of generative AI solutions.This role will play a critical part in validating integrations between CoPilot Studio and external systems such as ServiceNow, ensuring compliance, and enhancing personalized experiences through Azure AI Search and other tools.The ideal candidate will also contribute to model tuning, orchestration, and documentation.
;
; Key Responsibilities Conduct comprehensive testing of Gen AI features and integrations, especially between CoPilot Studio and external systems.Perform prompt engineering and model evaluation using tools such as LangSmith.Support the design and tuning of large language models (LLMs) and multi-system orchestration.Ensure compliance and personalization through integrations with Azure AI Search and other platforms.Create and maintain technical documentation including integration guides and user manuals.Collaborate with development teams to implement and validate new features and functionalities.Identify and troubleshoot issues during testing and integration phases.
;
; Required Qualifications Experience in testing AI/ML or Gen AI solutions, with a focus on integration validation.Hands-on experience with prompt engineering and model evaluation tools (e.g., LangSmith).Familiarity with CoPilot Studio and external system integrations (e.g., ServiceNow).Understanding of LLM design, tuning, and orchestration.Experience with Azure AI Search or similar platforms.Strong analytical and problem-solving skills.Excellent written communication skills for documentation and reporting.
;
; Preferred Qualifications Bachelors degree in Computer Science, Data Science, or a related field.Experience in QA automation and scripting for AI systems.Familiarity with compliance frameworks and data governance in AI applications.
; Education: Bachelors Degree
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.