Enterprise Data Architect ? Databricks & Platinum Layer

  • Austin, TX
  • Posted 5 hours ago | Updated moments ago

Overview

On Site
BASED ON EXPERIENCE
Full Time
Contract - Independent
Contract - W2
Contract - 2+ mo(s)

Skills

AZURE DATA FACTORY
ADF
AZURE DEVOPS
DATABRICKS
DATA BRICKS
DELTA LAKE
UNITY CATALOG
SERVICENOW
SERVICE NOW
SNOW
ITSM/SLM
ITSM
SLM
APPTIOONE
ITFM
APPTIO ONE
APPTIO
SEMANTIC
PLATINUM
GOVERNANCE

Job Details

Enterprise Data Architect - Databricks & Platinum Layer
Location: Remote- Austin, TX

Role Summary


The EDM Architect will lead the design and implementation of the Platinum Layer within the Databricks Lakehouse architecture for the clients MSI Transition Project. This role requires deep expertise in Databricks, Delta Lake, Unity Catalog, and semantic modeling, with hands-on experience integrating ServiceNow (ITSM/SLM) and ApptioOne (ITFM). The architect must also be able to articulate high-level technology benefits and the most efficient way to operate Databricks in its standard build configuration.
Key Responsibilities
* - Architect and implement the Platinum Layer for semantic modeling, SLA analytics, and AI readiness.
* - Design and deliver low-level technical solutions for ingestion, transformation, and reporting pipelines.
* - Integrate ServiceNow SLA data and ApptioOne financial models into the Lakehouse.
* - Define and enforce governance policies using Unity Catalog.
* - Collaborate with DIR and SCPs to align architecture with business goals.
* - Build reusable frameworks for real-time SLA breach prediction, cost analysis, and executive dashboards.
* - Support CI/CD pipeline development and DevOps automation for data workflows.
* - Explain high-level technology benefits of Databricks to leadership and stakeholders.
* - Recommend and implement the most efficient operational practices for Databricks in standard build configuration.
Required Skills & Experience
* - 8+ years in Data Architecture, with 3+ years in Databricks and Delta Lake.
* - Proven experience designing and implementing Platinum or Semantic Layers.
* - Strong understanding of Medallion Architecture and Unity Catalog.
* - Hands-on integration experience with ServiceNow (SLA, CMDB, incident data).
* - Hands-on integration experience with ApptioOne (cost modeling, allocations).
* - Proficiency in Python, Spark, SQL, and Power BI.
* - Experience with MLflow, Feature Store, and AI/ML pipelines.
* - Familiarity with Azure Data Factory, Azure DevOps, and GitHub Actions.
* - Excellent communication and stakeholder engagement skills.
Preferred Qualifications
* - Experience in public sector or clien's DIR environments.
* - ITIL v4 Certification.
* - ApptioOne and ServiceNow scripting experience.
* - Experience with SLA breach forecasting and cost optimization models.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Apolis