Senior / Staff Software Engineer - Gen AI

Job Title: Senior / Staff Software Engineer - Gen AI

• We are looking for a Senior / Staff Software Engineer to design, build, and scale enterprise-grade AI platforms and APIs that enable the adoption of large language models and generative AI capabilities across the organization. This role is focused on platform engineering at scale not just model experimentation. You will be responsible for building robust, secure, and highly scalable systems that integrate with leading cloud-based AI services.
• As a senior individual contributor, you will bring deep technical expertise, drive high-quality engineering practices, and serve as a mentor for junior and mid-level engineers. You will work closely with software engineers, data scientists, and product teams to deliver reusable AI infrastructure, developer-friendly APIs, and production-ready solutions.

• Design and build scalable Generative AI platforms, services, and APIs for internal and external consumers
• Develop and maintain high-performance backend services using Python and one or more of C++, C#, or Java
• Integrate and operationalize LLM and foundation model APIs, including Azure OpenAI, Google Vertex AI, and AWS Bedrock
• Build abstraction layers and orchestration logic to support multiple model providers and deployments
• Design RESTful and/or gRPC APIs with a strong focus on reliability, security, and performance
• Implement platform capabilities such as prompt management and versioning, model routing and fallback strategies, observability/logging/monitoring, and cost and usage tracking
• Deploy and operate services on Google Cloud Platform (Google Cloud Platform), leveraging managed services where appropriate
• Support CI/CD, infrastructure-as-code, and production operations
• Contribute to platform architecture decisions and engineering best practices

• Mentor and coach junior and mid-level engineers through code reviews, architecture discussions, and pair programming
• Foster a culture of engineering excellence, knowledge sharing, and continuous improvement
• Participate in technical design reviews and contribute to the professional growth of team members
• Help establish onboarding practices and learning paths for engineers new to AI platform development

• 10 15 years of professional software engineering experience
• Bachelor s degree in Computer Science or a related field (Master s degree preferred)
• Strong proficiency in Python
• Strong experience in at least one of the following: C++, C#, or Java
• Proven track record of designing and building platforms, frameworks, and APIs at scale (not just applications)
• Hands-on experience with Google Cloud Platform (Google Cloud Platform)
• Practical experience with cloud-hosted AI/LLM APIs, including Azure OpenAI, Vertex AI, and/or AWS Bedrock
• Deep understanding of API design, distributed systems, and cloud-native architectures
• Experience taking complex systems from design through production deployment and operation
• Demonstrated experience mentoring engineers and elevating team capabilities
• Experience designing multi-tenant or enterprise AI platforms
• Experience with containerization and orchestration (Docker, Kubernetes)

• Familiarity with MLOps or LLMOps concepts (model lifecycle, monitoring, evaluation)
• Experience with authentication, authorization, and secure API design
• Experience supporting developer platforms or internal tooling
• Experience writing design documents or helping define engineering standards

• A platform-first mindset you enjoy building reusable systems that enable other teams to move faster
• Strong engineering fundamentals with a high bar for production quality and operational excellence
• Comfort working across cloud services, APIs, and distributed systems at enterprise scale
• Ability to collaborate with both technical and non-technical stakeholders
• Deep hands-on expertise paired with the ability to think strategically about platform direction