Senior Principal Software Engineer- OCI AI Services

Job Description

At Oracle Cloud Infrastructure (OCI), we are redefining the future of computing for enterprises-building cloud-native systems from the ground up, powered by a global team of visionary engineers, scientists, and creators. We combine the agility of a startup with the scale, security, and reach of Oracle's enterprise-grade platforms.

Our Generative AI Service team is pioneering the development of infrastructure and services that harness the transformative power of Large Language Models (LLMs) and Agentic AI systems. Our mission is to build world-class, scalable platforms that enable customers to deploy intelligent agents and applications, deeply integrated with OCI's robust cloud ecosystem.

Role Summary

As a Consulting Member of Technical Staff (IC5), you will play a pivotal role in designing, building, and optimizing LLM infrastructure, agent execution runtimes, and next-generation developer platforms. You'll collaborate closely with applied scientists and ML engineers to bring agentic workflows into real-world deployments-at scale. This is a hands-on technical leadership role, ideal for someone deeply rooted in distributed systems and low-level computer science.

Minimum Qualifications

- BS in Computer Science or equivalent experience.

- 10+ years of experience in production-grade distributed systems and cloud-native software engineering.

- Proficiency in Go, Java, Python, or C++.

- Expertise in high-performance computing and ML model serving infrastructure.

- Deep understanding of container orchestration and CI/CD pipelines.

- Strong communication skills and experience mentoring across teams.

Preferred Qualifications

- MS or PhD in Computer Science, particularly in Systems, ML Infrastructure, or Compilers.

- Experience with LLM serving frameworks like vLLM, FasterTransformer, DeepSpeed, or Triton.

- Familiarity with agent-based systems.

- Contributions to LLM-native developer tools and compiler IRs.

- Experience with vector databases, tool APIs, and event-driven workflows.

- Foundation in OS internals, compiler pipelines, and systems programming.

- Proven ability to lead large-scale architecture efforts.

Why Join Us

- Be at the frontier of generative AI and agent-based software interaction.

- Work on mission-critical projects impacting Oracle's AI strategy.

- Collaborate with a globally distributed team of leading engineers and researchers.

- Enjoy the agility of a fast-moving team with enterprise-level resources.

Responsibilities

Responsibilities

- Architect and build high-throughput, low-latency serving systems for LLM inference and agent orchestration.

- Design agent-native runtime environments that support dynamic planning, tool calling, memory, and long-running context.

- Integrate foundational AI components with OCI's compute and networking layers.

- Partner with ML research to optimize model training, fine-tuning, and inference performance on GPU clusters.

- Own critical paths of software delivery from architectural review through implementation and post-deployment resilience.

- Contribute to OCI's developer-facing agent framework.

- Tackle deep systems-level challenges, drawing on knowledge in operating systems, compiler design, and cloud primitives.

Qualifications

Disclaimer:

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $96,800 to $251,600 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
Career Level - IC5

About Us

As a world leader in cloud solutions, Oracle uses tomorrow's technology to tackle today's challenges. We've partnered with industry-leaders in almost every sector-and continue to thrive after 40+ years of change by operating with integrity.

We know that true innovation starts when everyone is empowered to contribute. That's why we're committed to growing an inclusive workforce that promotes opportunities for all.

Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing or by calling +1 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.