Sr. Technical Analyst, Agentic AI

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function:
Technology Product & Platform Management

Job Sub Function:
Technical Product Management

Job Category:
Scientific/Technology

All Job Posting Locations:
Raritan, New Jersey, United States of America

Job Description:

We are searching for the best talent for a Sr. Technical Analyst, Agentic AI to be located in Raritan, NJ

MedTech R&D IT - Data and AI, Lead Analyst - Agentic AI (Document Generation & Cognitive Search)

Position Summary

We are seeking a Product Lead Analyst with deep expertise in agentic AI systems to drive the design, delivery, and continuous improvement of autonomous document-generation and cognitive-search platforms. This role operates at the intersection of product analysis, AI/ML solution delivery, and enterprise content workflows. The ideal candidate is an agentic AI expert who understands how to orchestrate large language models, retrieval-augmented generation pipelines, and multi-step reasoning agents to produce consistent, traceable, review-ready outputs at scale.

Agentic Document Generation

Own the product backlog and roadmap for agentic document-generation solutions that autonomously draft technical, regulatory, and compliance documents from source evidence

Design and refine reusable prompt templates, agent workflows, and orchestration logic that drive source-document ingestion, multi-step reasoning, and output composition with full section-level traceability

Define acceptance criteria ensuring generated drafts are consistent, citation-accurate, and traceable to source documents for human expert review and approval

Collaborate with domain stakeholders to onboard new document-generation use cases, validate output quality, and expand platform coverage

Agentic Cognitive Search

Own the product backlog for agentic cognitive-search platforms that go beyond keyword lookup - interpreting intent, reasoning across documents, and synthesizing cited answers

Define and validate natural-language query experiences where every statement in the synthesized answer is cited to its source document

Manage requirements for modular search capabilities including evidence retrieval, lifecycle intelligence, and domain-specific search agents

Ensure role-based access governance so synthesized answers respect the permissions held on underlying source documents
Product Analysis & Delivery Execution

Drive end-to-end delivery of agentic AI features including sprint planning, release readiness, and go/no-go criteria

Translate business requirements into user stories, detailed specifications, and acceptance criteria for engineering teams building agent pipelines

Coordinate cross-team dependencies, conduct change-impact analysis, and manage risk/milestone tracking across multiple agentic workstreams

AI/ML Platform Operations & Quality

Monitor output quality of AI-generated content and search answers; define feedback loops, guardrails, and continuous-improvement metrics

Support incident and problem management for agent orchestration, LLM performance, retrieval accuracy, and hallucination detection

Contribute to observability improvements including citation-accuracy scoring, traceability audits, prompt-performance benchmarking, and agent-step telemetry

Compliance & Governance

Ensure agentic AI outputs adhere to applicable quality-system, validation, and regulatory requirements

Maintain audit-ready traceability artifacts demonstrating every generated section is linked to its source evidence

Support responsible-AI practices including bias monitoring, content safety, and ethical use of generative models

Stakeholder Engagement & Expansion

Collaborate with business, regulatory, clinical, quality, and engineering teams to expand agentic platform adoption

Drive onboarding of new document-generation and cognitive-search use cases across business units

Technical Skills & Domain Knowledge

Agentic AI & Orchestration: Multi-agent frameworks (LangGraph, CrewAI, AutoGen, or equivalent), tool-use patterns, chain-of-thought reasoning, planning/reflection loops, agent memory and state management

LLM & NLP: Large Language Models (GPT, Claude, open-source), prompt engineering, fine-tuning, Retrieval-Augmented Generation (RAG), semantic chunking, embedding models

Search & Retrieval: Vector databases (Pinecone, Weaviate, OpenSearch), semantic search, hybrid search (BM25 + vector), re-ranking, knowledge graphs

Cloud & Infrastructure: AWS (Bedrock, S3, Lambda, Step Functions, SageMaker), or equivalent cloud AI services; API design and integration patterns

Document & Content Platforms: PLM systems (e.g., Windchill), document management, content extraction/parsing, regulatory submission workflows

Evaluation & Observability: LLM evaluation frameworks (RAGAS, DeepEval, or equivalent), tracing (LangSmith, Arize), hallucination detection, citation validation

Qualifications

Required:

5-8+ years in product/business analysis within technology, Life Sciences, or regulated environments

Demonstrable expertise in agentic AI systems - designing, deploying, or managing multi-step autonomous AI workflows

Hands-on experience with LLMs, RAG pipelines, prompt engineering, and at least one agentic framework (LangGraph, CrewAI, AutoGen, or equivalent)

Strong understanding of semantic search, vector databases, and retrieval strategies

Proven ability to translate complex AI/ML capabilities into clear business requirements, user stories, and acceptance criteria

Experience with AI evaluation and quality metrics (hallucination rate, citation accuracy, retrieval precision/recall)

Preferred:

Experience with document-generation or intelligent document processing (IDP) solutions

Familiarity with PLM systems, enterprise content management, or regulated document workflows

Background in AWS cloud services (Bedrock, SageMaker, Step Functions, Agentcore) or similar cloud AI platforms

Knowledge of responsible AI practices, model governance, and AI safety frameworks

Certification or training in AI/ML (AWS ML Specialty, Stanford AI courses, or equivalent)
Success Metrics (First 6-12 Months)

Successful onboarding of at least one new agentic document-generation use case with full traceability validation

On-time delivery of agentic AI features aligned to sprint cadence with zero critical-severity escapes

Measurable improvement in citation accuracy, retrieval precision, and document-quality scores for generated outputs

Positive stakeholder feedback on cognitive-search relevance and synthesized answer quality

Contribution to platform adoption growth and measurable reduction in manual document-authoring effort

#LI-Hybrid

#JNJTECH

Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.

Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants' needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via , internal employees contact AskGS to be directed to your accommodation resource.

Required Skills:

Preferred Skills:
Agile Product Development, Analytical Reasoning, Coaching, Collaboration, Competitive Landscape Analysis, Critical Thinking, Customer Alignment, Demand Forecasting, Human-Computer Interaction (HCI), Organizing, Product Development, Product Improvements, Product Strategies, Requirements Analysis, Research and Development, Software Development Life Cycle (SDLC), Software Development Management, Stakeholder Management, Technical Credibility, Technical Writing, Technologically Savvy

The anticipated base pay range for this position is :
$94,000 - $151,800

Additional Description for Pay Transparency:
Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs: medical, dental, vision, life insurance, short- and long-term disability, business accident insurance, and group legal insurance. Subject to the terms of their respective plans, employees are eligible to participate in the Company's consolidated retirement plan (pension) and savings plan (401(k)). Subject to the terms of their respective policies and date of hire, Employees are eligible for the following time off benefits: Vacation -120 hours per calendar year Sick time - 40 hours per calendar year; for employees who reside in the State of Washington -56 hours per calendar year Holiday pay, including Floating Holidays -13 days per calendar year Work, Personal and Family Time - up to 40 hours per calendar year Parental Leave - 480 hours within one year of the birth/adoption/foster care of a child Condolence Leave - 30 days for an immediate family member: 5 days for an extended family member Caregiver Leave - 10 days Volunteer Leave - 4 days Military Spouse Time-Off - 80 hours Additional information can be found through the link below.