Sr AI Engineer

******** Please note that the consultants / Contractors need to be on our W2 for this job**********

·         Client: Mayo Clinic

·         Job Title: Sr Software Engineer

·         Job ID: 37345307

·         Number of Positions: 2

·         Remote

Education:

·         Minimum Education and/or Experience Required: (Education Requirements and Experience):

·         Required qualifications for this position include Bachelor’s degree in computer science /engineering or related field with 5 years of experience as noted below; OR an associate’s degree in computer / science/ engineering or related field with 7 years of experience.

Notes:  As a Senior Software Engineer for AI Platform Engineering, you will bridge the gap between high-scale system architecture and frontier AI. You will be one of builders of our Model & Agent Runtimes—the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint. This isn''t just about deployment; it’s about a platform-first mindset. You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices.

What You’ll Do Architect the Future of Runtimes: Design and implement high-performance hosting environments for both specialized models and autonomous agents.

Scale Hybrid-Cloud Infrastructure: Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments.

Drive Operational Excellence: Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.

Operational Stewardship: Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services.

Collaborate & Advocate: Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value.

What You’ll Bring Deep Systems Expertise:

·         Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (4+ years of in-depth Kubernetes is a must).

·         AI/ML Fluency: Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.

·         Operational Rigor: A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments.

Problem-Solving Mindset: The ability to turn abstract AI research into production-grade, hardened platform features.

Other requirements

·         Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields.

·         Demonstrated problem solving and time management skills.

·         Possesses strong technical aptitude for designing and implementing software solutions.

·         Experience with modern application development frameworks Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.

·         Deep hands-on technical expertise, excellent verbal and written communication skills.

·         Experience with Agile software development techniques.

·         Preferred qualifications for this position include:

o   Ability to use a wide variety of open-source technologies and cloud-based services. Experience writing software for hybrid cloud (Google Cloud Platform, AWS, Azure).

o   Experience building high-performance, highly available and scalable distributed systems.

o   Experience developing software for healthcare related industries.