Cayuse Holdings, LLC
Cayuse Holdings, LLC

Staff Software Engineer, Applied AI

Burlingame, CA, US • Posted 19 hours ago • Updated 7 hours ago
Full Time
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Use Cases
  • Revenue Management
  • Optimization
  • Caching
  • Load Balancing
  • Regulatory Compliance
  • Data Governance
  • Collaboration
  • Workflow
  • IT Management
  • Mentorship
  • Software Engineering
  • Python
  • Java
  • TypeScript
  • LangChain
  • LlamaIndex
  • SOA
  • Cloud Computing
  • Amazon Web Services
  • Google Cloud Platform
  • Google Cloud
  • Microsoft Azure
  • Kubernetes
  • Docker
  • Terraform
  • Machine Learning Operations (ML Ops)
  • Continuous Integration
  • Continuous Delivery
  • Evaluation
  • Systems Design
  • IT Architecture
  • Health Care
  • HL7
  • HIPAA
  • Vector Databases
  • Orchestration
  • SaaS
  • Artificial Intelligence
  • Privacy
  • Machine Learning (ML)

Summary

Overview

Role: Staff Software Engineer, Applied AI

Salary: $200,000.00 - $275,000.00 per year

Location: Burlingame, CA (Hybrid)

We are seeking a Staff Software Engineer, Applied AI to build and scale the backend systems that power LLM applications in healthcare. This role is ideal for an engineer who thrives at the intersection of backend architecture and applied AI, designing APIs, pipelines, and infrastructure that make LLMs reliable, secure, and cost-efficient in production. If you want to push LLMs beyond demos into mission-critical healthcare workflows, we'd love to hear from you.

Responsibilities

  • Backend for LLMs - Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases.
  • Data & Retrieval Pipelines - Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data.
  • LLMOps & Observability - Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use.
  • Performance & Optimization - Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
  • Security & Compliance - Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.
  • Cross-Functional Collaboration - Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems.
  • Technical Leadership - Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.


Qualifications

Required Qualifications:
  • 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.
  • Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).
  • Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).
  • Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.
  • Cloud-native expertise: AWS/Google Cloud Platform/Azure, Kubernetes, Docker, Terraform, etc.
  • Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.
  • Excellent system design skills and the ability to align technical architecture with product goals.

Preferred Qualifications:
  • Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA).
  • Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration.
  • Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter.
  • Knowledge of responsible AI, safety, and privacy-preserving ML techniques.


Pay Range

USD $200,000.00 - USD $275,000.00 /Yr.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099930
  • Position Id: 2026-3598
  • Posted 19 hours ago

Company Info

About Cayuse Holdings, LLC

Founded initially in 2006, Cayuse Holdings is today comprised of a family companies headquartered near Pendleton, Oregon, with offices in the Washington D.C. metro area, and Honolulu, HI. Tribally owned by the Confederated Tribes of the Umatilla Indian Reservation (CTUIR), Cayuse Holdings is a 100% Indian Owned Economic Enterprise and a foremost provider of responsible sourcing/certified diversity solutions for commercial, government, and tribal clients.

Our Mission

To become the #1 American Indian-owned commercial, government, and tribal contractor, providing trusted value for our clients, reliable and rewarding careers for our employees and contributing to the growth of the CTUIR.

 

Our Vision

Grow the Company, Grow the People!

Šapásttawaxt kutkutpama,́ Šapásttawaxt natítayt

Go to company profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sr Forward Deployed Engineer

No location provided

•

Today

Full-time

Depends on Experience

Forward Deployed Engineer

No location provided

•

Today

Full-time

Depends on Experience

AI Engineer

New Delhi, Delhi

•

Today

Full-time

Depends on Experience

Search all similar jobs