Apply Now

Data Platform Architect – Supply Chain (Databricks)

Remote • Posted 1 hour ago • Updated 1 hour ago

Contract Independent

Contract W2

No Travel Required

Remote

Depends on Experience

Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

Artificial Intelligence
Databricks
Data Warehouse
Machine Learning (ML)
Logistics
Access Control
Apache Spark
Continuous Delivery
Continuous Integration
Data Governance
Data Quality
Generative Artificial Intelligence (AI)
PySpark
Procurement
Terraform
Test Cases
Unity
WMS
Workflow
Supply Chain Management
Software Development Methodology
Software Development

Summary

Job Title: Data Platform Architect – Supply Chain (Databricks)

Location: Open / Remote

Role Summary

We are seeking a senior Data Platform Architect to design and build an Enterprise Data Warehouse / Lakehouse platform for the supply chain domain from the ground up. This role requires deep expertise in Databricks Lakehouse, strong AI/ML capabilities, and a proven ability to leverage AI as an accelerator across the Software Development Life Cycle (SDLC).

The ideal candidate will drive architecture, design, and implementation while embedding AI, GenAI, and automation into every phase—from discovery to operations.

Key Responsibilities

Define the end-to-end vision, architecture, and roadmap for the enterprise data platform.
Design and implement a greenfield EDW / Lakehouse architecture (Bronze, Silver, Gold layers).
Build scalable data ingestion frameworks integrating ERP, WMS, TMS, MES, procurement, and logistics systems.
Develop pipelines using PySpark, Spark SQL, Delta Live Tables (DLT), and orchestrate with Databricks Workflows.
Implement data governance, lineage, and security using Unity Catalog.
Embed AI/ML and GenAI capabilities such as:
- LLM-driven schema mapping
- Vector search & RAG
- Forecasting models
- Natural-language BI solutions
Drive AI-accelerated SDLC delivery using copilots, agents, and automation tools.
Establish standards for data quality, monitoring, and reliability.
Lead and mentor cross-functional teams and collaborate with business stakeholders.

AI-Accelerated SDLC Approach

Phase	AI Acceleration Approach
Discovery & Design	AI-based source profiling, schema inference, auto data dictionaries
Data Modeling	LLM-generated dimensions, facts, and lineage
Pipeline Build	AI-assisted PySpark/SQL/DLT code generation
Testing & QA	Auto-generated test cases, synthetic data creation
Deploy & Operate	CI/CD automation, job optimization, anomaly detection
Consumption	Natural-language BI, GenAI assistants, predictive insights

Must-Have Skills & Experience

10+ years in Data Engineering / Architecture
Strong Supply Chain domain knowledge (Plan, Source, Make, Deliver, Return)
Hands-on experience with Databricks Lakehouse Platform
Expertise in:
- PySpark, Spark SQL
- Delta Lake & Delta Live Tables
- Databricks Workflows
Experience with Unity Catalog (governance, lineage, access control)
Strong knowledge of:
- Dimensional Modeling & Data Vault
- Medallion Architecture
- Data Product Design
Experience with CI/CD & IaC (Terraform / Databricks Asset Bundles)
Solid exposure to AI/ML technologies:
- GenAI, LLMs, RAG, Vector Search
- MLOps & Feature Stores
Proven experience using AI tools (Copilots/Agents) to accelerate SDLC
Strong leadership and stakeholder management skills

Nice to Have

Experience building a greenfield enterprise data platform
Exposure to ERP systems like SAP or Oracle EBS
Experience deploying AI assistants or agents on data platforms

Expected Outcome

A unified, AI-native supply chain data platform
Faster delivery enabled by AI-accelerated SDLC practices
A secure, governed, and scalable architecture built from scratch

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91099596
Position Id: 8956661
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Databricks Lead/Architect

Remote

•

9d ago

Required Qualifications Architecture & Design Define and design end-to-end data lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native services. Create reference architectures for batch, real-time, and streaming data pipelines. Architect data ingestion, curation, storage, and governance frameworks. Ensure the platform is scalable, secure, and optimized for performance and cost. Establish standards for data lineage, metadata management, and compliance. Work with enterprise ar

Easy Apply

Contract

Depends on Experience

Databricks Tech Lead

Remote

•

Yesterday

Hello; Role: Databricks Tech Lead Location: Remote Duration: Long Term We are looking for an experienced Databricks Tech Lead/Architect to serve as a trusted technical partner for our customers. This is a hands-on leadership role. Strong communication and relationship-building skills are just as important as deep Databricks expertise. What You Bring 12 14+ years of hands-on experience in data engineering, data architecture, or a closely related field. Deep expertise in Databricks Delta Lake,

Easy Apply

Full-time, Contract

Enterprise Data Architect

Remote

•

Yesterday

We are seeking an experienced Enterprise Data Architect to lead the design and implementation of scalable, enterprise-grade data platforms. This role will focus on defining data architecture strategy, governance, and modern data solutions leveraging Azure Databricks and Lakehouse architecture, with a strong emphasis on AI/ML integration. The ideal candidate will have a strong background in enterprise data architecture, cloud data platforms, and AI/ML-driven data solutions, with the ability to w

Easy Apply

Contract, Third Party

Depends on Experience

Databricks Data Engineer (AWS)

Remote

•

Today

We are looking for a hands-on Databricks Data Engineer with strong AWS experience to design, build, and optimize scalable data pipelines and lakehouse solutions. The role focuses on implementing robust batch and streaming data solutions using Databricks, Delta Lake, and AWS cloud-native services, ensuring high performance, scalability, and security. Key Responsibilities (Data Engineering & Pipeline Development) Build and maintain end-to-end data pipelines using Databricks, Delta Lake, and AWS se

Easy Apply

Contract

Depends on Experience

Search all similar jobs