Senior Data Engineer - Critical Environment Systems Intelligence

Are you passionate about cloud computing? Would taking a hands-on approach to transforming Microsoft's most critical business through investigation, data analysis, and automation be exciting to you? If so, come and help us build the most reliable & efficient datacenter infrastructure on the planet. The Cloud Operations + Innovation (CO+I) Critical Environment Systems Intelligence (CESI) team is responsible for designing and delivering solutions to support global datacenter operations and to improve availability. CESI is helping to drive CO+I's transition to a customer centric, data driven, live service culture. As our newest Senior Data Engineer, you will be a key player in this transition.

You will be responsible for aggregating live and historical telemetry that are used to create and maintain critical environments to enable scenarios like Customer Impact Radius and Anomaly detections. You will partner with CO+I teams to build off and leverage each other to ensure that we are driving continuous improvements across the fleet for critical environment anomaly detections and detection onboarding. You will work with massive amounts of data with low latency requirements across cutting edge technologies, with the potential for significant potential impact to both internal partners and external customers. We are a customer first, outcome focused, and data driven team in alignment with Microsoft values. We are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft's core cloud platforms and services that millions of people use every day. With more than 95% of Fortune 500 business on Azure, 180 million using Office 365, and millions using other services - all running on Microsoft's cloud infrastructure - CO+I builds and operates the foundation upon which Microsoft's mission to empower every person and organization comes to life.

Microsoft is on a mission to empower every person and every organization on the planet to achieve more. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. You can help us achieve our mission.

Responsibilities:

• Create innovative data driven solutions to complex and unconventional problems related to our DC Critical Environments.
• Drive to the development and design of data services and pipelines that are highly available, scalable, and reliable to meet the needs of the business. (i.e. Typically working with Billions of records per day)
• Leads discussions and creates proposals for the data architecture of products/solutions by testing design hypotheses and helping to refine code plans
• Leads by example within the team by producing extensible and maintainable code
• Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and return on investment (ROI)
• Applies metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices
• Design and implement monitoring and alerting solutions to ensure the health of our critical production data environments
• Collaborate with software development and data engineering teams to ensure that software systems are designed with security, privacy, and reliability in mind
• Participate in incident response to identify and address root causes of issues (DRI)

Qualifications:

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience.
• 4+ years of experience as a Database Engineer or similar role
• 4+ years hands-on experience with Azure Synapse Analytics, Azure Log Analytics, and/or any analytical and visualization tools (PowerBI, Grafana, Dynamics 365, etc).

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Experience with Python/PySpark, Kusto, or other query language in production systems.
• experience with Modern DevOps practices (ex: Git, CI/CD , Azure DevOps/VSTS), including build and deployment pipelines, yaml development, and unit/integration testing.
• Experience working in a fast-paced/competitive environment, and have a deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes.
• Ability to effectively work independently to derive actionable solutions.
• Ability to collaborate across the globe with diverse teams and be able to travel as necessary to learn and support operations in the US.
• Experienced communicator with both words and data exhibiting an understanding of what it takes to go from raw data to something various skillsets understand.

Data Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: ;br>
Microsoft will accept applications for the role until November 5th, 2025.

#COICareers | #EPCCareers | #DCDCareers

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form .

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.