Product Owner (AI & Prompt Strategy)

Carrollton, TX, US • Posted 9 days ago • Updated 5 hours ago
Full Time
On-site
USD $90,000.00 - 150,000.00 per year
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Financial Services
  • Investments
  • System Integration Testing
  • Personas
  • Brand
  • Orchestration
  • Routing
  • Analytics
  • Optimization
  • Sales
  • Testing
  • Quality Assurance
  • Test Scenarios
  • Evaluation
  • A/B Testing
  • Data Analysis
  • Product Strategy
  • Return On Investment
  • KPI
  • Customer Satisfaction
  • Collaboration
  • Management
  • Real-time
  • Product Management
  • Product Ownership
  • Customer Service
  • Machine Learning (ML)
  • Large Language Models (LLMs)
  • Prompt Engineering
  • Amazon Web Services
  • Analytical Skill
  • Dashboard
  • Artificial Intelligence
  • Natural Language
  • Leadership
  • Stakeholder Management
  • Mortgage
  • Accountability
  • Life Insurance
  • Market Analysis

Summary

PENNYMAC

Pennymac (NYSE: PFSI) is a specialty financial services firm with a comprehensive mortgage platform and integrated business focused on the production and servicing of U.S. mortgage loans and the management of investments related to the U.S. mortgage market.

At Pennymac, our people are the foundation of our success and at the heart of our dynamic work culture. Together, we work towards a unified goal of helping millions of Americans achieve aspirations of homeownership through the complete mortgage journey.

A Typical Day

We are seeking a Product Owner (AI & Prompt Strategy) to serve as a prompt-development focused leader for PennyMac's conversational AI initiatives. Operating within a Federated Hub-and-Spoke model, you will sit at the orchestration level across work teams to own the company-wide prompt and persona strategy. Partnering closely with the core engineering team (the "Hub") and leading a team of Product Analysts, you will drive the parallel development and deployment of voice AI agents across CDL/Sales, Servicing, and Fulfillment.

Key Responsibilities:
  • Strategy & Orchestration: Lead the overall product vision for conversational AI agents, owning the company-wide persona, brand voice, and overarching prompt strategy.
  • Agent & Sub-Agent Architecture Design: Architect the multi-agent orchestration layer, defining how primary routing agents interpret user intent and seamlessly hand off tasks to specialized, domain-specific sub-agents (e.g., specific agents for Sales vs. Servicing vs. Fulfillment). Establish the logic boundaries, tool access, and context parameters for each sub-agent.
  • Iterative Prompt Refinement: Continuously develop, test, and tune complex system prompts, system instructions, and few-shot examples. Optimize these prompts across the AWS tech stack to balance conversational quality, token efficiency, and response latency.
  • Prompt Effectiveness Tracking & Analytics: Establish robust tracking frameworks to measure prompt and agent efficacy at a granular level. Monitor specialized metrics such as hallucination rates, contextual accuracy, task completion/containment rates, and user drop-off to drive continuous prompt optimization cycles.
  • Stakeholder Alignment: Serve as the central orchestrator across CDL/Sales, Servicing, and Fulfillment teams to negotiate and refine business requirements, ensuring parallel development without technical bottlenecks.
  • Testing & Quality Assurance: Define the "Golden Dataset" of test scenarios to feed into engineering's automated LLM-as-a-judge evaluation pipelines. Oversee structured A/B testing initiatives and data analysis to iteratively optimize agent responses against baseline configurations.
  • Performance & ROI: Define product strategy and track ROI by aligning AI agent performance to key business KPIs, including Customer Satisfaction (CSAT) and Average Handle Time (AHT).
  • Cross-Functional Collaboration: Partner with the engineering team to integrate prompt designs with the core infrastructure, latency management pipelines, and real-time safety guardrails.

What You'll Bring

  • 5-7 years of Product Management or Product Ownership experience, ideally within mortgage, fintech, or complex customer servicing environments.
  • Demonstrated experience with AI/ML products, specifically conversational AI, Large Language Models (LLMs), and deep prompt engineering strategies within an enterprise AWS environment.
  • Proven ability to design multi-agent or complex state-machine conversational architectures.
  • Strong analytical background with a track record of building effectiveness dashboards, running A/B tests, and utilizing AI-specific metrics (e.g., hallucination tracking, prompt latency) to drive improvements.
  • Ability to translate complex business logic into precise technical configurations and natural language flows.
  • Exceptional leadership and stakeholder management skills.

Why You Should Join

As one of the top mortgage lenders in the country, Pennymac has helped over 4 million lifetime homeowners achieve and sustain their aspirations of home. Our vision is to be the most trusted partner for home. Together, 4,000 Pennymac team members across the country are guided by our core values: to be Accountable, Reliable and Ethical in all that we do. Pennymac is committed to conducting a business that makes positive contributions and promotes long-term sustainable growth and to fostering an equitable and inclusive environment, where all employees and customers feel valued, respected and supported.

Benefits That Bring It Home: Whether you're looking for flexible benefits for today, setting up short-term goals for tomorrow, or planning for long-term success and retirement, Pennymac's benefits have you covered. Some key benefits include:
  • Comprehensive Medical, Dental, and Vision
  • Paid Time Off Programs including vacation, holidays, illness, and parental leave
  • Wellness Programs, Employee Recognition Programs, and onsite gyms and cafe style dining (select locations)
  • Retirement benefits, life insurance, 401k match, and tuition reimbursement
  • Philanthropy Programs including matching gifts, volunteer grants, charitable grants and corporate sponsorships

To learn more about our benefits visit: ;br>
For residents with state required benefit information, additional information can be found at: ;br>
Compensation: Individual salary may vary based on multiple factors including specific role, geographic location / market data, and skills and experience as defined below:
  • Lower in range - Building skills and experience in the role
  • Mid-range - Experience and skills align with proficiency in the role
  • Higher in range - Experience and skills add value above typical requirements of the role

Some roles may be eligible for performance-based compensation and/or stock-based incentives awarded to employees based on company and individual performance.

Salary

$90,000 - $150,000
Work Model

OFFICE
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80183372
  • Position Id: 312382ac8000dc0d01df3d706efefe
  • Posted 9 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Carrollton, Texas

Today

Full-time

USD 75,000.00 - 130,000.00 per year

Irving, Texas

Today

Easy Apply

Full-time

USD 50.00 - 57.00 per hour

Richardson, Texas

Today

Full-time

USD 122,600.00 - 208,800.00 per year

Richardson, Texas

Today

Full-time

Search all similar jobs