Lead Data Architect

Lead Data Architect
Summary
We are seeking a Lead Data Architect with deep expertise in end-to-end data lake design and implementation. This role will require hands-on experience in data engineering and data pipelines to ensure best practices are followed across the team. While direct pipeline development is not always required, you will lead strategic design, governance, and execution efforts across data architecture.
Responsibilities

• Architect and design scalable data lakes with end-to-end implementation.
• Oversee and ensure best practices are followed across Data Engineering teams.
• Drive execution and strategy, balancing design and development responsibilities.
• Work collaboratively to develop data governance frameworks using Microsoft Purview and ideally, the Profisee Master Data Management Platform.
• Support and lead the development of three core frameworks in collaboration with other data engineers.
• Guide Data Engineering and BI Engineering teams in evolving towards architecture-level responsibilities including data governance oversight.
• Stay ahead of industry trends and integrate new features and technologies as they emerge.

Requirements

• Extensive experience in data architecture, data engineering, and pipeline development.
• Strong expertise in Microsoft Purview and data governance principles.
• Proficiency in using Python for data analysis, automation, and application development.
• Experience using PySpark for scalable data processing and distributed computing.
• Ability to design and implement scalable data solutions within complex enterprise environments.
• Proven ability to lead and mentor data engineers, guiding them towards architecture-level expertise.
• Strong problem-solving skills with the ability to execute, innovate, and drive strategy effectively.

Preferred

• Experience with Profisee Data Platform and Master Data Management (MDM).