Overview
On Site
$145,000 - $250,000
Full Time
No Travel Required
Skills
Python
Machine Learnin
Software Engineer
Large Language Model
Artificial Intelligence
HIPAA
Health Care
Job Details
Crossing Hurdles is a global recruitment consultancy firm that assists our clients to hire the best talent.
About the Client:
AI-driven solution automates outbound calls for healthcare organizations, handling benefits verifications, claim follow-ups, prior auto, credentialing, and provider data inquiries.
- Role - Staff Software Engineer
- Location - Burlingame, CA
- Required Tech Stack - Python, Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, AWS, Google Cloud Platform, Azure, Kubernetes, Docker, Terraform, FHIR, HL7, HIPAA, Vector Databases
- Compensation - $145K - $250K + Equity (Competitive)
- Benefits - Medical, Dental, Vision, 401(k), Unlimited PTO
- YOE - 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.
Roles & Responsibilities:
- Backend for LLMs: Build scalable, low-latency APIs and services for healthcare LLMs.
- Data & Pipelines: Develop ingestion, preprocessing, and RAG pipelines for clinical and revenue-cycle data.
- LLMOps & Observability: Design systems for model monitoring, evaluation, cost tracking, and reliability.
- Optimization: Engineer solutions for caching, batching, load balancing, and scaling LLM workloads.
- Security & Compliance: Ensure HIPAA-ready infrastructure and data governance.
- Collaboration: Work with product, ML engineers, and healthcare experts to optimize backend systems.
- Leadership: Lead LLM backend projects, establish best practices, and mentor peers.
Requirements:
- Experience: 5+ years backend/full-stack engineering, 3+ years with ML/LLM-enabled applications.
- Skills: Strong Python, and ideally Go/Java/TypeScript. LLM integration (Hugging Face, LangChain, OpenAI APIs, etc.). Expertise in distributed systems, service-oriented architecture, and scalable APIs.
- Tech Stack: AWS/Google Cloud Platform/Azure, Kubernetes, Docker, Terraform. Familiar with MLOps/LLMOps (CI/CD, model evaluation, monitoring).
- System Design: Excellent ability to align technical architecture with product goals.
- Preferred: Experience in healthcare or regulated industries (FHIR, HIPAA). RAG pipelines, vector DBs, responsible AI.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.