Principal Machine Learning Engineering Manager - CoreAI

Overview

We are seeking a Principal Machine Learning Engineering Manager - CoreAI to lead the Multimodal Intelligence (MMI) custom modeling and memory team within Microsoft's CoreAI organization. This team is pivotal in advancing Azure AI services by delivering cutting-edge multimodal capabilities across Content Understanding (CU), Document Intelligence (DI), and Memory API in Foundry. You will drive innovation in custom modeling for documents, images, video, and audio, enabling enterprise customers to unlock the full potential of Generative AI.

This role offers significant growth through working experience with advanced AI technologies and leadership development. You will gain and refine skills in multimodal AI, large-scale model deployment, MLOps, and strategic product planning-building on your Knowledge, Skills, and Abilities (KSAs) to stay at the forefront of AI innovation!

This position is in-office, with a minimum of 3 days/week in office.

Microsoft's mission is to empower every person and every organization on the planet to achieve more, and we're dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.

Responsibilities

• Lead and Inspire: Manage a team of 15 engineers and applied scientists, fostering technical excellence and a culture of collaboration.
• Custom Analyzer Development: Oversee design and deployment of customizable analyzers for multimodal content via GenAI, ensuring scalability, reliability, and compliance.
• Memory API Ownership: Drive architecture and implementation of Memory API for agent personalization scenarios.
• Customer Impact: Deliver high-value solutions for marquee Azure customers, optimizing onboarding and performance for GenAI workloads.
• Cross-Functional Collaboration: Partner with product, research, and service engineering teams to align on architecture, performance, and security goals.
• Strategic Innovation: Shape the roadmap for multimodal AI capabilities, aligning with Microsoft's mission to empower every person and organization.

Qualifications

Required/Minimum Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to C# or Python
  • OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications:

• 10+ years of experience in machine learning engineering or applied AI.
• Proven leadership experience managing high-performing technical teams.
• Expertise in multimodal AI (text, vision, audio, video understanding) with GenAI models.
• Knowledge of cloud platforms (Azure preferred) and MLOps practices.
• Excellent communication and stakeholder management skills.
• Advanced degree in Computer Science, Machine Learning, or related field.
• Experience with prompt engineering, retrieval-augmented generation (RAG) and memory/agent frameworks.
• Familiarity with compliance and security standards in enterprise AI solutions.

Software Engineering M6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
;br>
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.