Software Engineer - Core Infrastructure

About the Role

We are seeking a Software Engineer specializing in Core Infrastructure to architect and scale distributed systems that power autonomous AI agent orchestration at scale. This role requires a builder who thrives on complex technical challenges in a high-trust, confidential environment.

What You'll Build

Distributed Systems Architecture

• Design and implement scalable infrastructure to orchestrate thousands of autonomous agents across production environments


• Build fault-tolerant systems with comprehensive monitoring, distributed tracing, and automated recovery capabilities


• Develop multi-tenant data isolation architectures ensuring privacy and security compliance

Performance & Scale Engineering

• Drive horizontal scaling initiatives from pilot to production-scale deployments


• Optimize resource allocation and API rate limiting across multiple AI model providers


• Architect local GPU infrastructure to reduce costs and increase processing throughput


• Design real-time observability platforms for system health monitoring and performance analytics

Security-First Development

• Engineer systems with privacy, security, and data protection as foundational requirements


• Implement secure authentication, authorization, and data isolation patterns


• Maintain operational confidentiality while collaborating across technical teams

Technology Stack

• Backend: Python, FastAPI, PostgreSQL, Redis


• Infrastructure: Cloud-native deployment with multi-region scaling capabilities


• AI/ML Integration: OpenAI, Anthropic Claude, DeepSeek, embedding systems, vector databases


• Security: Supabase with Row-Level Security, enterprise authentication


• Tooling: Stripe, API integrations, analytics platforms

What We're Looking For

Required Qualifications

• 3+ years of software engineering experience with strong Python expertise


• Proven track record building and scaling distributed systems in production


• Deep knowledge of system design principles: scalability, fault tolerance, data consistency


• Hands-on experience with PostgreSQL, Redis, and asynchronous task processing


• Strong understanding of security best practices and data privacy regulations


• Ability to make pragmatic engineering decisions balancing performance, cost, and reliability

Preferred Experience

• GPU infrastructure deployment or ML infrastructure optimization


• Multi-tenant SaaS architecture or agent-based system design


• Observability tooling (tracing, metrics, logging) in distributed environments


• Experience working in stealth or confidential product development settings

Why Join Us

• Work on cutting-edge AI infrastructure at unprecedented scale


• High autonomy and technical ownership


• Collaborative, world-class engineering team


• Competitive compensation and equity

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.