Senior Software Engineer, Compute Platform

Palo Alto, CA, US • Posted 11 hours ago • Updated 3 hours ago
Full Time
On-site
$300000 - $400000 per annum
Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

  • Senior Software Engineer
  • Compute Platform

Summary



About the Company


A fast-growing, venture-backed startup is building a next-generation AI compute platform focused on decentralized, high-performance infrastructure. The company is rethinking how organizations access and scale compute by integrating global data centers into a unified, serverless platform.


Their mission is to democratize access to AI compute and provide an end-to-end lifecycle solution-from raw data to deployed models-through a combination of platform infrastructure and forward-deployed engineering.


With a global footprint and early traction, the team is tackling challenges across multi-cloud orchestration, GPU scheduling, and enterprise-grade infrastructure, with a strong focus on security and compliance.




The Role


This is a high-impact infrastructure role focused on designing and scaling distributed systems that power AI/ML workloads at scale.


You'll work across:



  • Core platform architecture

  • Multi-cloud compute orchestration

  • Managed services development

  • Customer-facing deployments


This role requires a strong mix of systems engineering + product thinking, with exposure to both backend infrastructure and end-user experience.




What You'll Work On


< data-start="1448" data-end="1500">Compute Platform & Multi-Cloud Architecture

  • Design abstraction layers across cloud providers (AWS, Google Cloud Platform, Azure, bare-metal)

  • Build systems that unify compute, storage, and networking across environments

  • Expand global compute capacity by integrating with cloud and data center providers

  • Architect reusable, composable infrastructure components


< data-start="1807" data-end="1855">Managed Services & Platform Development

  • Own services end-to-end (design deployment monitoring)

  • Build orchestration systems for GPU workloads and container scheduling

  • Develop APIs and control planes for provisioning, scaling, and lifecycle management

  • Drive improvements in performance, reliability, and cost efficiency


< data-start="2147" data-end="2190">Infrastructure & Platform Services

  • Build systems for billing, usage tracking, and cost attribution

  • Develop observability tooling (metrics, logging, tracing)

  • Establish engineering standards and best practices

  • Mentor engineers and contribute to system design decisions




What They're Looking For


< data-start="2471" data-end="2497">Core Requirements

  • 4+ years building distributed systems, backend infrastructure, or cloud platforms

  • Strong experience with AWS, Google Cloud Platform, or Azure

  • Deep understanding of:

    • Compute (VMs, instances)

    • Storage (object, block, file systems)

    • Networking (VPCs, load balancers, security groups)



  • Experience with Kubernetes and container orchestration

  • Strong programming skills (Golang preferred; Python/Rust a plus)

  • Experience building APIs, control planes, or platform services

  • Familiarity with databases (Postgres, Redis, etc.) and messaging systems (Kafka, RabbitMQ)




Nice to Have



  • GPU orchestration or AI/ML infrastructure experience

  • HPC or cluster management (Kubernetes, Slurm)

  • Data engineering or large-scale ETL systems

  • Systems-level programming (low-level infra, operators, daemons)

  • ML platform engineering (training/inference pipelines)

  • Experience deploying into enterprise or on-prem environments



Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10525742
  • Position Id: 004444-740
  • Posted 11 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Palo Alto, California

Today

Full-time

USD 204,250.00 - 285,000.00 per year

Mountain View, California

Today

Full-time

Menlo Park, California

Today

Full-time

USD 236,000.00 - 339,200.00 per year

Mountain View, California

Today

Full-time

Search all similar jobs