Search Jobs | Dice.com

1 results (0 new)

Group by company

Applied AI Engineer (Agent Skills)

Advanced Tech Placement

Hybrid in Johns Creek, Georgia • Yesterday

Easy Apply

Contract

Depends on Experience

Job Details

Skills

DESIGN SYSTEM
WEB COMPONENT
WEB COMPONENTS
REUSABLE COMPONENT
REUSABLE COMPONENTS
COMPONENT LIBRARY
COMPONENT LIBRARIES
SHADOW DOM
FIGMA
STORYBOOK
AGENT
AGENTS
AGENTIC
MULTI-AGENT
SUBAGENT
SUBAGENTS
MCP
MODEL CONTEXT PROTOCOL
MODEL-CONTEXT-PROTOCOL

Summary

We are looking for a AI Evaluation Engineer (Agent Skills)

This role focuses on building reusable AI skills that support the component factory and improve how teams implement applications with our design system. The position centers on shared capabilities such as requirements gathering, planning, accessibility review, spec generation, and implementation support using design system components and utilities.

Responsibilities:

Build reusable core skills that support the factory workflow, including requirements gathering, planning, accessibility review, and spec generation.
Create AI-assisted implementation skills that help teams use design system components and utilities correctly in application code.
Improve how shared design system guidance gets translated into practical implementation workflows.
Partner with engineering and design to identify repetitive implementation problems that can be improved through reusable skills.
Help define skills that increase consistency, reduce rework, and make application delivery faster within design system boundaries.
Contribute to a shared AI capability model that supports both upstream definition work and downstream implementation work.

Requirements:

Strong software engineering fundamentals.
Hands-on experience building applied AI capabilities, workflow tools, or agent-like systems.
Ability to create reusable skills that support both factory workflows and application implementation.
Experience working with component libraries, shared utilities, or design system-based application development.
Strong understanding of how engineering teams move from requirements and specs into implementation.
Strong judgment about how to balance standardization, usability, and product-team flexibility.
Ability to work across ambiguity and turn broad ideas into practical, usable internal capabilities.

Required Skills:

An engineering foundation; it's an engineer who evaluates, not a pure QA person.
Deep understanding of web standards and how the web fundamentally works to judge whether generated component code is actually right.
Experience writing and evaluating agent skills and prompts, including knowing which prompt patterns work better than others.
Experience testing and evaluating AI and LLM output, including eval frameworks, rubrics, LLM-as-judge approaches, regression suites for prompts, and similar work.
Proficiency in JS/TS, with the same maintainability consideration as Role 1.

Preferred Skills:

Write agent skills and evaluate their quality so the instructions and prompts inside skills reliably get the best results from AI agents.
Build evaluation mechanisms for output that is non-deterministic, where you can't just check for an exact match.
Handle a second source of change: skills draw on the team's own documentation and component APIs, which keep evolving. The system must catch regressions when either the skills or the docs change.
Expand what they've started with "golden prompts." These are prompts re-run after every change to confirm output is still correct. The open problem is how to define and measure "correct" when output is never identical twice.
Ensure what product teams receive keeps getting better, not worse, as changes ship.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91132164
Position Id: 26-00318
Posted 1 day ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior AI Engineer – Agentic Systems

Hybrid in Johns Creek, Georgia

•

Yesterday

We are looking for a Senior AI Engineer Agentic SystemsThis role involves building reusable AI skills that enhance the component factory and improve application implementation using our design system. Responsibilities: Build reusable core skills to support factory workflow, including requirements gathering, planning, accessibility review, and spec generation. Create AI-assisted implementation skills to aid teams in using design system components and utilities correctly in application code. I

Easy Apply

Contract

Depends on Experience

APPLIED AI ENGINEER

Hybrid in Alpharetta, Georgia

•

7d ago

Hi, Greetings from Iflowsoft Solutions Inc Position - AI Engineer Location - Alpharetta, GA Position Overview We are seeking experienced Applied AI Engineers to join an enterprise design systems and engineering team focused on building AI-powered developer tools, agentic workflows and advanced software solutions. Key Responsibilities Design, develop and maintain AI-powered applications, agent skills and automated development workflows. Build pipelines that transform design documentation int

Easy Apply

Full-time

Depends on Experience

Job opportunity AI Engineer (Applied AI)/ Capital Management Client/ Alpharetta GA - Hybrid 3 days

Hybrid in Alpharetta, Georgia

•

7d ago

Client: Capital Management Client Job Title: AI Engineer (Applied AI) Location: Alpharetta GA ( Hybrid 3 Days Onsite / Week) Duration: 12+ Months Contract Position Overview We are seeking experienced Applied AI Engineers to join an enterprise design systems and engineering team focused on building AI-powered developer tools, agentic workflows and advanced software solutions. Key Responsibilities Design, develop and maintain AI-powered applications, agent skills and automated development workfl

Easy Apply

Contract

Depends on Experience

AI Analytic Developer- Federal Projects

No location provided

•

Today

Job Description *Due to the client contract, you will be assigned, this position requires you to * Oracle Health is seeking a Senior AI Agent Engineer to build production AI agents and workflow automation capabilities that accelerate analytics delivery, improve insight generation, and reduce manual engineering work across our analytics and reporting ecosystem. This engineer will design and implement AI-driven workflows that integrate with enterprise systems and support use cases such as SQL g

Full-time

USD 97,800.00 - 209,500.00 per year

Job Details

Skills

DESIGN SYSTEM
WEB COMPONENT
WEB COMPONENTS
REUSABLE COMPONENT
REUSABLE COMPONENTS
COMPONENT LIBRARY
COMPONENT LIBRARIES
SHADOW DOM
FIGMA
STORYBOOK
AGENT
AGENTS
AGENTIC
MULTI-AGENT
SUBAGENT
SUBAGENTS
MCP
MODEL CONTEXT PROTOCOL
MODEL-CONTEXT-PROTOCOL

Summary

We are looking for a AI Evaluation Engineer (Agent Skills)

Responsibilities:

Build reusable core skills that support the factory workflow, including requirements gathering, planning, accessibility review, and spec generation.
Create AI-assisted implementation skills that help teams use design system components and utilities correctly in application code.
Improve how shared design system guidance gets translated into practical implementation workflows.
Partner with engineering and design to identify repetitive implementation problems that can be improved through reusable skills.
Help define skills that increase consistency, reduce rework, and make application delivery faster within design system boundaries.
Contribute to a shared AI capability model that supports both upstream definition work and downstream implementation work.

Requirements:

Strong software engineering fundamentals.
Hands-on experience building applied AI capabilities, workflow tools, or agent-like systems.
Ability to create reusable skills that support both factory workflows and application implementation.
Experience working with component libraries, shared utilities, or design system-based application development.
Strong understanding of how engineering teams move from requirements and specs into implementation.
Strong judgment about how to balance standardization, usability, and product-team flexibility.
Ability to work across ambiguity and turn broad ideas into practical, usable internal capabilities.

Required Skills:

An engineering foundation; it's an engineer who evaluates, not a pure QA person.
Deep understanding of web standards and how the web fundamentally works to judge whether generated component code is actually right.
Experience writing and evaluating agent skills and prompts, including knowing which prompt patterns work better than others.
Experience testing and evaluating AI and LLM output, including eval frameworks, rubrics, LLM-as-judge approaches, regression suites for prompts, and similar work.
Proficiency in JS/TS, with the same maintainability consideration as Role 1.

Preferred Skills:

Write agent skills and evaluate their quality so the instructions and prompts inside skills reliably get the best results from AI agents.
Build evaluation mechanisms for output that is non-deterministic, where you can't just check for an exact match.
Handle a second source of change: skills draw on the team's own documentation and component APIs, which keep evolving. The system must catch regressions when either the skills or the docs change.
Expand what they've started with "golden prompts." These are prompts re-run after every change to confirm output is still correct. The open problem is how to define and measure "correct" when output is never identical twice.
Ensure what product teams receive keeps getting better, not worse, as changes ship.

Dice Id: 91132164
Position Id: 26-00318
Posted 1 day ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior AI Engineer – Agentic Systems

Hybrid in Johns Creek, Georgia

•

Yesterday

Easy Apply

Contract

Depends on Experience

APPLIED AI ENGINEER

Hybrid in Alpharetta, Georgia

•

7d ago

Easy Apply

Full-time

Depends on Experience

Job opportunity AI Engineer (Applied AI)/ Capital Management Client/ Alpharetta GA - Hybrid 3 days

Hybrid in Alpharetta, Georgia

•

7d ago

Easy Apply

Contract

Depends on Experience

AI Analytic Developer- Federal Projects

No location provided

•

Today

Full-time

USD 97,800.00 - 209,500.00 per year