Senior Data Platform Architect & Governance Specialist
Remote
Ohio residents onlyDescription:
Diversified Systems is searching for a Senior Data Platform Architect & Governance Specialist to design, implement, and support enterprise data warehouse, data lake, and Lakehouse solutions. The selected consultant will develop automated ELT pipelines, implement Medallion Architecture, design advanced data models, support data migrations and business intelligence, and maintain enterprise data governance, metadata management, lineage, and data quality frameworks.
Responsibilities:
- Design and maintain programmatic, automated ELT pipelines using SQL, Python, and modern cloud data tools to process data incrementally through Medallion Architecture stages.
- Conduct query and cluster tuning for modern cloud data platforms to optimize compute usage during data transformations and processing.
- Develop code to migrate legacy databases and files into automated Lakehouse ingestion pipelines.
- Work with IT Architecture staff to design and implement a scalable, secure Medallion Data Architecture across cloud environments.
- Establish standards, schemas, and file formats including Iceberg and Parquet for ingestion and data lake processing.
- Design physical and logical data structures within the Gold layer, including dimensions, facts, and business entity schemas.
- Build resilient data models capable of supporting structured and semi-structured data, including JSON and API payloads.
- Transform business reporting requirements into semantic layers supporting self-service business intelligence.
- Create documentation for pipelines, architecture, modeling, and migration efforts.
- Design standards for data exchange between systems, including data security models.
- Define data warehouse and business intelligence design.
- Implement data warehouses and data marts.
- Implement business intelligence tools and user interfaces.
- Implement enterprise reporting, management dashboards, scorecards, and analytic applications.
- Replicate and transform data for business intelligence.
- Manage and curate the Alation Data Catalog, including indexing, classification, and tagging of tables, schemas, and views across Bronze, Silver, and Gold layers.
- Map and monitor end-to-end data lineage from source applications through Gold-layer reporting assets within Alation.
- Design programmatic data validation and testing protocols between Bronze and Silver layers.
- Plan and conduct formal mentorship activities for peers and lower-level staff through verbal instruction or technical documentation.
Requirements:
- 5+ years of hands-on experience designing and implementing enterprise data warehouse, data lake, or Lakehouse solutions required.
- Expert-level SQL skills, including query optimization, performance tuning, and development of complex analytical datasets required.
- Experience developing automated ELT pipelines using Python, SQL, and modern cloud data platform technologies required.
- Hands-on experience implementing and supporting Snowflake-based data engineering, data warehousing, and analytics solutions required.
- Experience designing and managing Medallion Architecture, including Bronze, Silver, and Gold data platforms and associated processing standards required.
- Advanced experience with dimensional data modeling, including fact tables, dimensions, star schemas, and semantic layer design required.
- Experience integrating structured and semi-structured data sources, including APIs, JSON, and file-based ingestion frameworks required.
- Hands-on experience administering enterprise data catalog and governance platforms such as Alation required.
- Experience implementing data governance, metadata management, data lineage, and data quality frameworks required.
- Experience executing data migration and modernization initiatives required.
- Excellent communication skills and ability to collaborate with technical teams, business stakeholders, and executive leadership required.
Desired Skills:- Ability to define technical standards, best practices, and architecture documentation for enterprise data platforms highly desired.
- Ability to work independently and lead complex, cross-functional data architecture and engineering initiatives highly desired.
- Experience with Snowflake cloud-native architecture, including Snowflake Warehouses, Snowpark, Streams, Tasks, and secure data sharing highly desired.
- Familiarity with data modeling tools such as ER/Studio and modern modeling methodologies highly desired.
- Bachelor's Degree in Data Analytics, Computer Science, Information Technology, Computer Engineering, or a closely related field highly desired.
- Experience with enterprise data cataloging, metadata management, and data lineage tools such as Alation desired.
- Experience with dbt desired.
- Experience working in Agile, iterative, or rapidly evolving solution environments desired.
- Strong work ethic and time and attendance punctuality desired.
- Candidates located in Ohio required.
About Diversified Systems
Founded in 1990, Diversified Systems is an award-winning Technology Services corporation providing all levels of IT project consulting services nationwide. DSI is headquartered in Columbus, Ohio with regional offices in the American Midwest and East Coast. We offer our consultants a number of flexible and competitive compensation benefit packages.
Diversified Systems is committed to the principles of equal employment. We are committed to complying with all federal, state, and local laws providing equal employment opportunities, and all other employment laws and regulations.
Diversity, Equity and Inclusion
DSI values authenticity and is committed to making sure our employees and partners are valued and respected. At DSI, we believe building a diverse culture is important because we know when people work together, we can achieve better results as a team. DSI realizes that everyone comes from various backgrounds. We celebrate these differences because our employees are our greatest asset as we strive to best meet the needs of those we serve. As part of our ongoing efforts, DSI is focused on advancing equality, diversity, and inclusion by setting high standards to continually evolve our culture. This includes but is not limited to recruiting, community involvement, client delivery, and career development.