Senior AI Architect / Solution Engineer (Direct Client)

Role: Senior AI Architect / Solution Engineer

Location: Cambridge, MA

Duration: Long Term

This is a handson architectural leadership role requiring deep expertise in Generative AI, large language models (LLMs),

Core Technical Skills (Must Have)

Generative AI & LLM Engineering

• Handson experience with LLMs, prompt engineering, and embeddings
• Experience designing and implementing agentbased workflows and tool orchestration frameworks
• Proven implementation of guardrails, validation layers, and hallucination mitigation techniques
• Experience with automated evaluation, testing, and benchmarking of GenAI systems

Architecture & Engineering

• 10+ years of enterprise software or data platform engineering experience
• Strong background in microservices architectures and API design using REST and GraphQL
• Proven ability to design and deploy cloudnative solutions on Azure or AWS

LLMOps / MLOps & Platform Operations

• Experience operationalizing AI systems in production environments
• Experience implementing monitoring, logging, alerting, rollback, and resilience strategies
• Strong understanding of LLM cost management, including token controls, caching, routing, and model selection

Data & Integration

• Strong data engineering skills with enterprise data platforms such as lakehouses or data warehouses
• Handson experience with vector databases and semantic search technologies
• Experience building document ingestion pipelines for unstructured content including policies, PDFs, and audit evidence

Security, Privacy & Auditability

• Securebydesign engineering experience including IAM, RBAC, secrets management, and encryption
• Experience designing auditready AI systems with traceability and explainability
• Ability to implement comprehensive evidence logging to support audit and compliance requirements

Communication & Stakeholder Management

• Proven ability to partner effectively with Internal Audit, Risk, Compliance, Security, and Technology teams
• Strong communication skills to explain complex technical concepts to both technical and nontechnical audiences

Education & Experience

• Bachelor s or Master s degree in Computer Science, Engineering, Data Science, or a related field
• 3+ years delivering AI, ML, or Generative AI solutions in production environments
• Strong handson experience with Azure or AWS