Job Responsibilities:
Provide SME advice on building and scaling an enterprise grade Data Analytics Platform on Azure
Work with Data Providers and Consumers to design end-to-end data flows, data servicing designs, and SLAs
Development of datasets to support self-service data discovery and activation
Creation and maintenance of data models (conceptual, logical and physical) using a variety of data modelling techniques
Incorporate data pipelines into a modern DevOps deployment and testing framework
Work with Data Scientists to stand-up initial Advanced Analytics and Machine Learning capabilities on top of the data platform
Support data stewardship from a technical perspective and support data stewardship processes, including data quality
Help guide the work for a Data Engineer II role
Skills:
Expert level knowledge of Azure, specifically as related to Data and Analytics Platforms
Experience building and scaling DevOps built, test, and release capabilities
Experience integrating data platforms with data catalog and data lineage technologies (preferably Purview)
Experience with design, implementation and sustainment of data lakes or lake houses
Advanced level knowledge of data modelling techniques and usage with data lakes and knowledge graphs
In-depth experience with at least three of the following: Azure Synapse Pipelines, Spark, Python, Scala, C#, SQL, KQL or R
Familiarity with telemetry-based data analytic paradigms, data enrichment practices and the establishment of reference and master data
Knowledge of Advanced Analytics patterns and techniques