Senior Data Engineer

Overview

Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft's core cloud platforms and services that millions of people use every day. With more than 95% of Fortune 500 business on Azure, 180 million using Office 365, and millions using other services - all running on Microsoft's cloud infrastructure - CO+I builds and operates the foundation upon which Microsoft's mission to empower every person and organization comes to life.

Are you passionate about cloud computing? Do you get excited about taking a hands-on approach to transforming Microsoft's most critical business through investigation, data analysis, and automation? If so, come and help us build the most reliable & efficient datacenter infrastructure on the planet. The CO+I Critical Environment Systems Intelligence (CESI) team is responsible for designing and delivering solutions to support global datacenter operations and to improve availability. CESI is helping to drive CO+I's transition to a customer centric, data driven, live service culture. As a Senior Data Engineer, you will be a key player in this transition.

As a Senior Data Engineer on the CO+I Critical Environment Service Intelligence (CESI) team, you will be responsible for designing and delivering automated solutions for the onboarding of new and existing data center critical environment anomaly detections. You will partner with CO+I teams to build off and leverage each other to ensure that we are driving continuous improvements across the fleet for critical environment anomaly detections and detection onboarding. You will work with massive amounts of data with low latency requirements across cutting edge technologies, with the potential for significant potential impact to both internal partners and external customers.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

As a Senior Data Engineer, you will:

• Own and drive data reliability and engineering planning from requirements to deployment, including assessing end-user and business needs, driving engagement, and keeping processes running smoothly.

• Research and identify data related problems or potential problems and drive to resolution.

• Research and identify data that can be use in the creation of global datacenter anomalies and drive to resolution

• Drive improvements into our dependent data pipelines and sources.

• Work closely with key stakeholders and SMEs to define business rules that determine governance and data quality.

• Assist in writing tests and creating monitoring systems that validate business rules.

• Perform thorough data analysis and testing to identify data gaps and ensure data quality.

• Work closely with application, data platform, and data engineering teams to reconfigure data ingestion pipelines to be more reliable and continuously monitored.

• Manage data incidents and drive blameless postmortems.

• Help drive the creation of monitoring, alerting, and reporting on the reliability of data pipelines and other big data processing systems.

Qualifications

Required/Minimum Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• 6+ years of strong hands-on experience with Data Analytics applications. (SQL, Kusto, Hadoop, or equivalent large data system).

• 2+ years of hands-on experience creating and leveraging data visualization platforms (Power BI, Tableau, etc).

• Experience working with large data sets using SQL/Azure Data Lake/Spark, etc., to derive actionable insights is highly desirable.

• Familiarity with one or more general purpose programming languages including but not limited to: Java, C/C++, C#, Python, JavaScript, PowerShell.

• Experience with reporting and data analysis systems & platforms (e.g., Power BI, SAP, CRM, Dynamics 365, etc.).

• Demonstrated experience producing executable and measurable results; focused on delivering impact and identifying, managing, and mitigating risks.

• Demonstrated technical problem solving and excellent analytical, verbal, written, interpersonal communication skills with attention to detail.

• Ability to communicate with a broad range of audiences with varying technical abilities and to use data as a story-telling device.

• Ability to effectively deal with ambiguity and work independently to derive actionable solutions.

• Ability to successfully influence without authority and manage efforts through relationships.

• Ability to promote a collaborative environment and bring a positive attitude to difficult situations.

Data Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.