Product Analyst III (AI Context Designer)

Product Analyst III (AI Context Designer)

W2 Contract

Pay Rate: $38.07 - $48.07 per hour

Location: Carrollton, TX - Onsite Role

Job Summary:

We are seeking a highly analytical and detail-oriented Product Analyst to act as a "Context Designer" for the voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD.

Duties and Responsibilities:

• Act as a "Context Designer" to write, refine, and configure natural language prompts and conversational flows based on defined business logic.


• Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions.


• Review and curate operational PDFs and documentation to provide a verified "Source of Truth" for the RAG Vector Database.


• Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates.


• Assist the Product Owner in defining and documenting the "Golden Dataset" of test scenarios to support automated AI evaluations.


• Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality.

Requirements and Qualifications:

• 3-5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level).


• A non-engineer with a strong "technical bent" and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning).

Bayside Solutions, Inc. is not able to sponsor any candidates at this time. Additionally, candidates for this position must qualify as a W2 candidate.

Bayside Solutions, Inc. may collect your personal information during the position application process. Please reference Bayside Solutions, Inc.'s CCPA Privacy Policy at ;/span>