Principal Architect Engineer

Overview

In the era of artificial intelligence (AI), efficiency across every layer of the compute stack-from software to hardware to physical infrastructure-is essential. As AI workloads grow rapidly, Microsoft continues to invest in systems that remain reliable, cost-effective, and sustainable. This role is an opportunity for individuals who are motivated by complex systems challenges and interested in shaping the future of AI and cloud computing.

As a Principal Architect in the One Fleet Efficiency (OFE) organization, you will partner across engineering teams and organizational boundaries to deliver architectural improvements that strengthen the efficiency of AI and cloud software, hardware, and infrastructure. Your work will span optimizing inference and training workloads, influencing the design of next-generation datacenters, and contributing to advancements in cloud platforms. This role provides the opportunity to lead high-impact technical initiatives, develop insight across the entire AI stack-from model to silicon to datacenter-and influence Microsoft's long-term infrastructure strategy.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Partner with engineering and infrastructure teams to define and execute strategies that improve efficiency across the AI stack.
• Lead architectural reviews and pathfinding efforts for high-impact systems, including inference platforms, training clusters, and datacenter designs.
• Write proof-of-concept code and conduct deep technical investigations to validate architectural decisions.
• Make impactful decisions that influence product deployment, cost, and sustainability outcomes.
• Ensure robust telemetry and incident response processes for critical AI services and infrastructure.
• Serve as a mentor and role model in technical leadership for earlier in career engineers.

Qualifications

Required Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications

• Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 5+ years of experience collaborating across teams and organizations.
• 5+ years of experience with cloud platforms or distributed systems.
• Exposure or familiarity with datacenter infrastructure or server hardware.

#azurecorejobs

Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
;br>
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.