AI Prompt Engineer

Remote in Pittsburgh, PA, US • Posted 1 day ago • Updated 47 minutes ago
Full Time
Part Time
On-site
Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

  • Prompt
  • Prompt Engineering
  • Artificial intelligence workflows

Summary

Prompt Engineer & AI Workflow Specialist

Remote role - long term contract on w2

  • Owns output quality and reliability across AI components.
  • Designs prompt architectures, builds Copilot Studio agents, creates evaluation frameworks, and tunes AI workflows grounded on enterprise data inside the client security boundary.

What you'll do

Day-to-day

  • Design and iterate on prompt architectures for classification, summarization, extraction, drafting, and routing tasks.
  • Build Copilot Studio conversational agents grounded on SharePoint knowledge bases, SOPs, and enterprise data.
  • Design prompts for Azure AI Document Intelligence workflows: invoice parsing, JHA digitization, field document extraction.
  • Build evaluation frameworks: test suites, scoring rubrics, and regression checks for prompt performance.
  • Develop and maintain prompt templates and libraries across client engagements.
  • Test edge cases, adversarial inputs, and failure modes before they reach production.
  • Tune AI workflows: select models, configure routing logic, optimize for cost/quality/latency tradeoffs within Azure OpenAI Service.
  • Define and enforce guardrails: output validation, content filtering, confidence thresholds, human-in-the-loop triggers, and tenant-boundary data controls.
  • Prototype rapid AI experiments: build minimum-viable AI workflows to validate use cases before full engineering investment.
  • Document prompt design decisions and maintain version-controlled prompt repositories.


What we're looking for

You should

  • Deep, practical experience designing prompts for production systems, not just chat experiments.
  • Understand model behavior across providers (Azure OpenAI, Claude, GPT, open-source) and can make informed model selection recommendations.
  • Experience or strong interest in Copilot Studio agent design and RAG architectures over enterprise knowledge bases.
  • Think in systems. You see prompts as components inside larger workflows, not standalone instructions.
  • Rigorous about evaluation. You build tests, measure outputs, and make data-driven decisions about what is working.
  • Can prototype quickly. Comfortable with Python, API calls, and lightweight tooling to stand up test workflows fast.
  • Understand enterprise data boundaries: AI features must be grounded on verified sources with no data leakage outside the tenant.
  • Communicate clearly in writing. You document your reasoning, your test results, and your recommendations.


Nice to have

Bonus points

  • Experience building RAG systems, agentic workflows, or tool-use architectures
  • Hands-on experience with Copilot Studio or Azure OpenAI Service in production
  • Background in NLP, computational linguistics, or ML evaluation methodology
  • Familiarity with Azure AI Document Intelligence for document processing prompts
  • Exposure to compliance or safety-critical contexts where output reliability is non-negotiable


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90884655
  • Position Id: OOJ - 8337-7362-1773416075
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

No location provided

Today

Full-time

USD 60,000.00 - 80,000.00 per year

Pittsburgh, Pennsylvania

Today

Full-time

USD 150,000.00 - 175,000.00 per year

Pittsburgh, Pennsylvania

10d ago

Easy Apply

Full-time

Depends on Experience

Pittsburgh, Pennsylvania

Today

Full-time

Search all similar jobs