LLM Platform Architect

Job ID: 2506494

Location: REMOTE WORK, VA, US

Date Posted: 2025-06-09

Category: Information Technology

Subcategory: Platform Engr

Schedule: Full-time

Shift: Day Job

Travel: No

Minimum Clearance Required: None

Clearance Level Must Be Able to Obtain: Public Trust

Potential for Remote Work: Yes

Description

We are seeking a highly experienced Platform Architect with expertise in LLM (Large Language Model) integration and AI/ML platform engineering to lead enterprise-level platform strategy and architecture. This role is centered on designing a scalable, modular, and secure AI/ML ecosystem that integrates seamlessly across enterprise teams-including infrastructure, governance, and security organizations.

You will guide the end-to-end architecture of a multi-cloud AI/ML platform that supports mission-critical workloads across federal, state, and commercial programs. The platform integrates services like Databricks, JupyterHub, AWS SageMaker, Bedrock, and emerging tools, while adhering to stringent security, compliance, and operational oversight frameworks. The role requires deep systems-level thinking with the ability to align technical direction with enterprise stakeholder needs.

Key Responsibilities:

• Architect secure, scalable environments for enterprise-grade model development and GenAI integration, including foundational components such as Databricks, JupyterHub, SageMaker, Bedrock, and future LLM-as-a-service frameworks.
• Establish enterprise-ready CI/CD and infrastructure-as-code pipelines using Terraform, Bitbucket, Bamboo, supporting platform repeatability, compliance, and modular growth.
• Collaborate closely with enterprise infrastructure, cybersecurity, governance, and data architecture teams to ensure alignment with boundary controls, policy enforcement, and integration patterns.
• Lead the development of platform-wide architecture artifact system blueprints, integration diagrams, standards repositories, onboarding workflows, and internal guidance consumed by implementation teams.
• Design future-ready cross-cloud integration architectures across AWS (T-Cloud), Azure, Google Cloud Platform, and OCI to support federated model workloads and portability of GenAI services.
• Represent architectural direction in executive and stakeholder reviews while partnering with internal product, security, and compliance teams to ensure platform continuity.
• Evaluate and define mechanisms to onboard additional tooling or frameworks (e.g., Immuta, Trustworthy AI audit services) to extend core platform capabilities while preserving auditability and operational control.
• Guide engineering teams with design best practices and influence long-term platform evolution strategies to maintain velocity, reusability, and governance.

Qualifications

Required Qualifications:

• Bachelor's or master's degree in computer science, Engineering, or a related technical field.
• 10+ years of experience designing platform architecture, including hands-on experience with AI/ML infrastructure.
• Demonstrated experience building enterprise-scale, modular platforms across hybrid or multi-cloud ecosystems.
• Deep understanding of AWS services (S3, Lambda, RDS, SageMaker, Bedrock), Databricks, and infrastructure automation (Terraform).
• Experience working with enterprise governance, compliance, and security stakeholders to align platform design with organizational and regulatory requirements.
• Strong ability to define patterns for API integration, model deployment, lifecycle orchestration, and cloud-native operations.

Desired Skills:

• Knowledge of GenAI patterns, LLM evaluation pipelines, and Responsible AI enforcement mechanisms.
• Experience working within government enterprise environments with boundary protection, audit, and compliance constraints.
• Familiarity with platform compliance standards (FedRAMP, NIST 800-53, SOC2) and model ATO strategies.
• Excellent communication and leadership skills to work across enterprise architecture forums and executive planning sessions.

Target salary range: $160,001 - $200,000. The estimate displayed represents the typical salary range for this position based on experience and other factors.