Overview Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world's leading financial centers - New York, London, San Francisco, Los Angeles, Chicago and Boston. Baker Tilly Advisory Group, LP and Baker Tilly US, LLP (Baker Tilly) provide professional services through an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable laws, regulations and professional standards. Baker Tilly US, LLP is a licensed independent CPA firm that provides attest services to its clients. Baker Tilly Advisory Group, LP and its subsidiary entities provide tax and business advisory services to their clients. Baker Tilly Advisory Group, LP and its subsidiary entities are not licensed CPA firms.
Baker Tilly Advisory Group, LP and Baker Tilly US, LLP, trading as Baker Tilly, are independent members of Baker Tilly International, a worldwide network of independent accounting and business advisory firms in 141 territories, with 43,000 professionals and a combined worldwide revenue of $5.2 billion. Visit bakertilly.com or join the conversation on LinkedIn, Facebook and Instagram.
Please discuss the work location status with your Baker Tilly talent acquisition professional to understand the requirements for an opportunity you are exploring.
Baker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, gender identity, sexual orientation, or any other legally protected basis, in accordance with applicable federal, state or local law.
Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group, LP, employee e-mail accounts are considered property of Baker Tilly Advisory Group, LP, and are not subject to payment of agency fees. In order to be an authorized recruitment agency ("search firm") for Baker Tilly Advisory Group, LP, there must be a formal written agreement in place and the agency must be invited, by Baker Tilly's Talent Attraction team, to submit candidates for review via our applicant tracking system.
Job Description: The
Managing Director, AI Platform Architect is the founding architect of Baker Tilly's AI Product Group (APG) - the senior-most individual contributor in the organization and the single design authority for the product, agentic, and data architecture of everything APG builds. The architect designs the agent platform the firm's AI products run on (agent harness, orchestration, tool and MCP integration, retrieval, memory and context management, and the evaluation infrastructure that decides what ships), co-designs the intelligence substrate (ontology, knowledge graph, judgment layer) with the substrate lead, chairs APG's technical design authority, and serves as the CAITO's senior technical counsel.
This is a hands-on, build-first role: the architect prototypes the patterns product teams then harden, sets the technical bar for the founding engineers, and leads the deliberate absorption of architecture from the firm's expert engineering partners so Baker Tilly owns its platform rather than renting it.
Responsibilities - Architecture design and standards.
- Own the target-state architecture for the AI product portfolio and the architecture decision records that make significant decisions transparent, durable, and teachable.
- Design the agent platform: harness and orchestration patterns, tool and MCP integration, retrieval architecture spanning vector and graph, memory and context management, and the shared services every product consumes.
- Co-design the intelligence substrate (ontology, knowledge graph, judgment layer) with the substrate lead.
- Set and steward a model-agnostic model strategy - selection, routing, fallback, fine-tuning versus context strategies, and cost-per-outcome economics - and keep the platform portable and vendor-neutral.
- Hands-on technical leadership.
- Design by building: prototype the patterns product teams then harden.
- Review and shape each product's architecture with the engineering teams - hands-on, in the code.
- Chair APG's technical design authority.
- Lead architecture absorption from the firm's expert engineering partners on a shadow-pair-lead-own ramp, converting partner-built patterns into firm-owned standards, decision records, and runbooks, with defined gates at which each architecture layer becomes firm-owned.
- Evaluation standards and production readiness.
- Establish evaluation-first engineering as an architectural standard: no capability is production-ready until its evaluation suite says so.
- Define the non-functional architecture (scalability, deployment, security, observability) with enterprise technology partners so products transition cleanly into enterprise operation.
- Co-own the production handoff standard and exercise it on the first products through the gate.
- Operate the architectural seam with Enterprise Architecture - full design authority inside APG products, built to enterprise standards, data contracts, and production gates.
- Technical counsel and talent.
- Advise the CAITO on build, buy, and integrate decisions across the portfolio, including vendor AI architecture boundaries where the firm must own the data and knowledge layer.
- Help hire and mentor the founding engineers; raise the bar on design quality, code quality, and written technical decision-making.
- Represent APG architecture in the firm's architecture forums and, with the CAITO, to executive leadership.
- Engage and participate in special projects or complete other duties as assigned.
Qualifications - Bachelor's degree in computer science, engineering, or a related field, or equivalent practical experience; advanced degree a plus.
- No certifications or licenses required.
- 15+ years in software and platform architecture or engineering, including senior engineering leadership (director level or above) or principal/consulting-architect scope across multiple teams.
- Recent, hands-on depth in LLM-based and agentic systems carried to production - including agentic infrastructure itself: control planes, agent runtimes, gateways, SDKs, and the developer experience around them. Founder or zero-to-one platform experience is highly valued.
- Has personally designed and shipped an AI platform, agent framework, or ML platform at meaningful scale - and can walk through the decisions, trade-offs, and failures.
- Experience operating as a principal or consulting architect across multiple teams - setting direction through standards, prototypes, and persuasion rather than authority alone.
- Experience partnering with enterprise architecture, security, and governance functions in a large organization without losing product velocity.
- Deep fluency in the modern agentic stack: orchestration frameworks, tool/function calling and MCP, retrieval (vector and graph), context and memory management, and evaluation methodology.
- Strong data architecture background: lakehouse platforms, semantic and graph modeling, data contracts, and pipeline architecture for structured and unstructured data.
- Knowledge representation: ontologies, knowledge graphs, GraphRAG, judgment/decision modeling.
- LLM platform engineering: gateways, routing, evaluation harnesses, observability, token economics; model strategy across frontier and open models.
- Enterprise integration: APIs, event-driven patterns, data contracts, identity and entitlements.
- Writes production-quality code and prototypes; recent hands-on work in Python and/or TypeScript.
- Demonstrates personal AI leverage: designs and prototypes with agentic tools as a force multiplier - the working standard for this team.
- Builder-first temperament with strong architectural judgment; pragmatic about which decisions must be made once and well versus delegated; raises the technical bar of everyone in range; writes things down; makes complex systems explainable to executives and practitioners; treats the firm's platform, substrate, and runbooks as owned assets.
The pay rate range for the position is $350,000-$550,000. Actual compensation is influenced by a variety of relevant factors including but not limited to applicant's skills, prior experience, qualifications, degrees, professional certifications, work arrangements and geographic location. Baker Tilly offers a comprehensive compensation and benefits package to eligible employees.
All qualified internal candidates will be considered for this position, irrespective of their current geographic location.
Never miss an opportunity! Create an alert based on the job you applied for.
