Associate Director - Data & Databricks Delivery (Fully Remote!!)


Palni Inc
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Databricks
- Azure Databricks
- AWS Databricks
- Data Engineering
- Data Architecture
- Lakehouse
- Delta Lake
- ETL
- ELT
- Data Pipelines
- Data Modeling
- Cloud Data Platform
- Azure Data Factory
- ADLS
- Synapse
- AWS Glue
- Redshift
- Data Migration
- Data Modernization
- Analytics
- Data Governance
- Data Quality
- SQL
- Program Delivery
- Delivery Management
- Technical Leadership
- Stakeholder Management
- Enterprise Data
Summary
Role: Data & Databricks Delivery Lead – Associate Director
Duration: 3months to FTE
Location: Remote (USA)
Key Responsibilities
· Lead multiple enterprise data initiatives from discovery and planning through architecture, engineering, migration, testing, and production rollout.
· Own overall delivery across scope, schedule, dependencies, risks, quality, and client expectations.
· Provide technical leadership to Data Architects, Data Engineers, Analytics teams, and related workstreams.
· Review and guide data architecture, lakehouse design, ETL/ELT pipelines, integration patterns, migration approaches, and platform decisions.
· Lead client discussions on data modernization, architecture, delivery strategy, technical risks, and roadmap priorities.
· Coordinate onshore and offshore teams and establish effective delivery governance across multiple workstreams.
· Support estimation, staffing, resource planning, and technical delivery reviews.
· Identify opportunities to expand data, analytics, AI, and cloud work within the account.
· Serve as the senior delivery point of contact for data-related programs and build trusted relationships with client stakeholders.
Required Experience & Skills
· 12–15+ years of overall experience in Data Engineering, Data Architecture, Analytics, or enterprise data platform delivery.
· Strong, recent experience with Databricks and modern Lakehouse architectures.
· Strong understanding of core data concepts including data engineering, ETL/ELT, data pipelines, data modeling, data lakes/lakehouse, data integration, migration/modernization, governance, data quality, and SQL.
· Experience leading large or complex enterprise data programs with multiple technical workstreams.
· Ability to review and challenge technical designs rather than only manage project schedules and status.
· Strong client-facing communication, stakeholder management, and executive presentation skills.
· Experience leading senior architects, engineering leads, and distributed technical teams.
Cloud & Databricks Experience
· The candidate should have strong experience in at least one cloud Databricks ecosystem and working knowledge of the other:
o Azure Databricks and the Azure data ecosystem, or
o AWS Databricks and the AWS data ecosystem.
· The role does not require expertise in every Azure or AWS service. The expectation is strong Databricks depth, solid understanding of cloud data architecture, and the ability to work effectively across both Azure- and AWS-based client environments.
Preferred Experience
· Experience with cloud data modernization, migration, or enterprise information platform programs.
· Working knowledge of Azure Data Factory, ADLS, Synapse, or comparable AWS data services.
· Healthcare, Medicaid, payer, or public-sector data experience.
· Exposure to AI/ML workloads or analytics solutions running on Databricks.
· Experience supporting and growing a strategic client account from a delivery perspective.
- Dice Id: 10202573
- Position Id: 9107357
- Posted 4 hours ago
Company Info
About Palni Inc
At Palni, our ambition is matched only by our authenticity. We rely on teamwork to achieve our goals, with a laser focus on surpassing our customers’ expectations. Through collaborative efforts, we ignite innovation and drive growth, crafting solutions that elevate experiences and streamline efficiencies.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs