Sr. Databricks Lead/Architect

Boston, MA, US • Posted 19 days ago • Updated 6 days ago
Full Time
On-site
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Power BI
  • Azure DevOps
  • Business Intelligence
  • Apache Spark
  • Delta Lake
  • stakeholder management
  • data governance
  • data warehousing
  • Azure Synapse Analytics
  • Azure Databricks
  • Azure Data Factory (ADF)
  • Architecture Reviews
  • Apache Kafka
  • Machine Learning Workflows
  • Customer Engagement
  • PySpark
  • Dimensional modeling
  • Lakehouse Architecture
  • Program Leadership
  • Unity Catalog
  • Data Security & Compliance
  • Azure cloud architecture
  • Cloud Data Architect
  • Data Platform Architect
  • Structured Streaming
  • Solution Design Workshops
  • Senior Databricks Architect
  • Azure Databricks Lead
  • Data Engineering Architect
  • Lakehouse Architect
  • Technical Lead Data
  • Spark Optimization
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Event Hub
  • Medallion Architecture (Bronze/Silver/Gold)
  • Data Marts
  • ML Integration with Databricks
  • Offshore Team Management
  • Technical Governance
  • Batch & Streaming Pipelines

Summary

Solution IT Inc. is looking for Sr. Databricks Lead/Architect one of its clients - Boston, MA

Job Title: Sr. Databricks Lead/Architect

Responsibilities:

Customer & Stakeholder Engagement

Act as the primary technical point of contact for customer stakeholders (Business, Product Owners, Architects, and IT Leadership).

Lead requirements discovery workshops, solution discussions, and architecture reviews.

Translate business requirements into scalable Azure Databricks based data architectures.

Present architecture options, trade offs, and roadmaps to senior stakeholders and decision makers.

Provide technical leadership during program inception, design sign off, and critical milestones.

Solution & Data Architecture

Design end to end data platforms using Azure Databricks, Azure Data Lake (ADLS), Delta Lake, and surrounding Azure services.

Define lake house architectures supporting batch, streaming, and near real time use cases.

Establish data modeling standards (bronze/silver/gold layers, dimensional models, curated data marts).

Ensure solutions align with security, governance, performance, and cost optimization best practices.

Define integration patterns with upstream and downstream systems (APIs, Kafka/Event Hub, Power BI, Azure Synapse, ML workloads).

Support cloud migration, modernization, and legacy platform replacement initiatives.

Review and validate offshore team deliverables for architecture adherence, quality, and performance.

Resolve technical blockers and guide te ams on complex implementations.

Enforce coding standards, CI/CD practices, and reusable frameworks.

Ensure ontime, high quality delivery aligned with customer expectations.

Drive DevOps enablement (Azure DevOps, Git, CI/CD pipelines).

Establish monitoring, logging, and cost optimization strategies.

Required Skills:

Strong hands-on expertise with Azure Databricks (Spark, Delta Lake, Unity Catalog).

Deep experience with:

O Azure Data Lake Storage (ADLS Gen2)

O Azure Data Factory / Synapse Pipelines

O Streaming (Kafka / Event Hub / Structured Streaming)

O Python, SQL, Spark optimization

Solid understanding of data warehousing, lakehouse, and analytics architectures.

Experience with Power BI or other BI/analytics tools.

Familiarity with ML/AI integration with Databricks is a plus.

Leadership & Soft Skills

Proven experience working directly with customers in an onshore role.

Strong communication, presentation, and stakeholder management skills.

Experience managing distributed / offshore delivery teams.

Ability to balance hands on architecture work with leadership responsibilities.

Strong ownership mindset and decision-making ability.

Experience & Qualifications

10+ years in data engineering / data architecture roles.

5+ years designing solutions on Azure data platforms.

3+ years in a technical lead or solution architect role.

Azure or Databricks certifications preferred.

Work Site: Boston, MA

Duration: 12 Months

Expected Start Date: Immediate - 2 weeks

Number of Positions: 01

Please send your responses back to

Thanks

Recruiting Team

SOLUTION IT INC

Work: / Extn 120 /121 /125/126/142/143/145/146

URL:

Confidentiality Notice: The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient(s), be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. If you have received this e-mail in error, please immediately contact the sender by reply email and destroy all copies of the original message. Thank you.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10290916
  • Position Id: 2026-12489
  • Posted 19 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Boston, Massachusetts

6d ago

Easy Apply

Third Party, Contract

Boston, Massachusetts

Today

Easy Apply

Full-time

$160000 - $180000

Hybrid in Quincy, Massachusetts

Today

Easy Apply

Contract

$70 - $90

Boston, Massachusetts

Today

Full-time

USD 140,000.00 - 170,000.00 per year

Search all similar jobs