Data Architect - Partner Engineering Platform (PEP) Reporting

Overview

The Partner Engineering Platform (PEP) Reporting team within WECE powers high scale telemetry insights that help Microsoft's OEM and silicon partners improve device reliability and elevate the Windows customer experience worldwide.

As a Data Architect, you will lead the design and evolution of largescale distributed data platforms that ingest and processes Windows OEM telemetry at a multibillion record scale. You define architecture patterns, shape end-to-end data flows, and ensure the platform meets strict availability, latency, governance, and performance requirements.

You will partner with TPMs, engineering leads, and data science teams to set technical directions and deliver next generation reporting and AI powered experiences that support mission critical insights across the Windows ecosystem.

This role is built for architects who excel at driving clarity, establishing scalable platform patterns, and guiding teams toward long term, resilient data architecture solutions.

Responsibilities

• Architect, design, and maintain distributed data platforms supporting OEM telemetry, reliability analytics, compliance signals, and AI-driven data products.

• Establish end-to-end data architecture patterns for ingestion, curation, enrichment, aggregation, and publication across Microsoft Kusto clusters, Azure Cosmos DB, Azure Data Lake/Lakehouse, and COSMOS streaming and parquet-based pipelines.

• Own schema modeling, partitioning strategy, indexing, caching, and performance tuning for largescale structured, semi structured, and timeseries datasets.

• Develop architectural blueprints enabling real-time or near real-time slicing, filtering, and aggregation across billions of records to support AI Agents, partner facing dashboards, and internal engineering workflows.

• Drive availability, resiliency, cost optimization, and governance across high-scale data workloads, ensuring SLAs and SLOs for mission critical reporting pipelines.

• Partner with engineering teams to establish best practices for data quality, observability, lineage, security, and access patterns, including RBAC and compliant handling of sensitive telemetry.

• Guide engineers in building scalable data ingestion and transformation pipelines using Microsoft data plane technologies, including KQL-based ETL, parquet transformations, and high throughput telemetry streams.

• Collaborate closely with PEP TPMs on roadmap definition, platform migrations, and data driven initiative planning.

Qualifications

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience.

Preferred Qualifications:

• 5+ years of experience designing and architecting distributed data systems or analytics platforms.
• Deep experience with Microsoft data technologies-including:
  • Microsoft Kusto (ADX) clusters and advanced KQL (query optimization, partitioning, ingestion mapping, materialized views, update policies).
  • Azure Data Lake / Lakehouse / Data Stores (Delta/Parquet, hierarchical partitioning, metadata and schema management).
• Demonstrated success tuning and optimizing large-scale analytical systems for performance, reliability, and availability.
• Strong expertise in designing data models, distributed query patterns, and ingestion strategies for datasets larger than 5 billion records.
• Experience architecting real-time analytics solutions, including latency-aware data structures enabling sub-second slicing/aggregation for dashboards or AI Agents.
• Proficiency with data security, privacy, governance, and compliance best practices for enterprise data systems.
• Ability to drive architectural decisions across organizations and influence engineering teams toward scalable, long-term data strategies.
• Experience with Azure Cosmos DB (Core/SQL, API design, partitioning, RU optimization, change feed).
• Experience with COSMOS-to-Kusto patterns, parquet compaction strategies, or high-fidelity telemetry pipelines supporting reliability and health signals.
• Familiarity with AI/ML operationalization, vectorized data flows, or embedding augmented analytics pipelines.
• Experience leading large data architecture initiatives in cloud-scale environments.
• Excellent communication, executive facing storytelling, and cross functional collaboration skills especially in data-driven engineering organizations like WECE, Data Sciences, DSQ, WATSON, and Windows Fundamentals Reliability.

Success Criteria

High performing, cost efficient data architecture supporting mission critical OEM Health telemetry and reporting workloads.

Demonstrated improvements in ingestion throughput, query performance, end-to-end latency, and system reliability.

Architecture patterns adopted broadly by PEP Engineering, reducing operational friction and enabling faster delivery of insights.

Ability to support next-generation AI-powered reporting experiences built on PEP's data.

Data Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
;br>
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.