Databricks Architect

Remote β€’ Posted 6 hours ago β€’ Updated 6 hours ago
Contract W2
12 Months
No Travel Required
Remote
Depends on Experience
Fitment

Dice Job Match Scoreβ„’

πŸ”’ Crunching numbers...

Job Details

Skills

  • Data Engineering
  • Solution Architecture
  • Databricks
  • Data Architecture

Summary

Databricks Solution Architect


Location: San Francisco, CA (Remote)
Work Schedule: Must be available to work in Pacific Standard Time (PST)
Employment Type: Contract

Job Overview

We are seeking an experienced Databricks Resident Solution Architect with a strong background in enterprise data architecture, modern data engineering, and cloud-based data platforms. The ideal candidate will combine strategic solution architecture capabilities with extensive hands-on technical expertise.

This role requires a proven technical leader who can architect, design, develop, and implement scalable Databricks solutions while working closely with clients and engineering teams. Candidates should have successfully delivered multiple end-to-end Databricks implementations and possess deep expertise in the Databricks Lakehouse Platform.

Candidates holding the Databricks Solutions Architect Champion certification will receive strong preference.

Key Responsibilities

  • Lead the architecture, design, and implementation of enterprise-scale Databricks solutions.

  • Drive end-to-end Databricks implementations, from architecture planning and technical design through development, deployment, and production support.

  • Provide hands-on technical leadership in developing scalable ETL/ELT pipelines and data engineering solutions.

  • Design and optimize cloud-native data platforms using AWS, Microsoft Azure, and/or Google Cloud Platform (Google Cloud Platform).

  • Develop and implement solutions leveraging Apache Spark, Delta Lake, Structured Streaming, and modern data engineering frameworks.

  • Establish and implement best practices for data architecture, performance optimization, scalability, security, and cost efficiency.

  • Design and implement CI/CD and DevOps processes for production-grade data engineering solutions.

  • Leverage Databricks platform capabilities, including Unity Catalog, Workflows, MLflow, Delta Live Tables, and other Lakehouse technologies.

  • Provide technical guidance, troubleshoot complex data platform challenges, and recommend appropriate architectural solutions.

  • Collaborate with business stakeholders, clients, data engineers, and technical teams to translate business requirements into effective technical solutions.

  • Support MLOps practices, including machine learning lifecycle management, model deployment, and monitoring.

Required Technical Skills & Qualifications

  • 12–15+ years of experience in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions.

  • 10+ years of consulting experience, including client-facing technical delivery and solution architecture.

  • Proven track record of delivering 6–8+ end-to-end Databricks implementations as a hands-on developer, technical lead, or solution architect.

  • Databricks Data Engineering Professional certification or an equivalent advanced Databricks certification.

  • Strong expertise in cloud-native data platform architecture across AWS, Azure, and/or Google Cloud Platform, with deep hands-on proficiency in at least one cloud platform.

  • Advanced knowledge of Apache Spark, including performance tuning, partitioning strategies, execution plans, memory management, and Spark internals.

  • Extensive hands-on experience building scalable ETL/ELT pipelines using Databricks, Delta Lake, and Structured Streaming.

  • Strong understanding of the Databricks Lakehouse Platform, including:

    • Delta Lake

    • Unity Catalog

    • Databricks Workflows

    • MLflow

    • Delta Live Tables (DLT)

  • Experience implementing DevOps and CI/CD pipelines using Azure DevOps, GitHub Actions, GitLab CI/CD, or Jenkins.

  • Working knowledge of MLOps principles, machine learning lifecycle management, model deployment, and monitoring.

  • Strong experience optimizing large-scale distributed workloads for performance, scalability, and cost efficiency.

  • Excellent problem-solving, communication, client engagement, and technical leadership skills.

Employers have access to artificial intelligence language tools (β€œAI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10398358
  • Position Id: 9146674
  • Posted 6 hours ago
Contact the job poster
SW

Sam Wilson

Recruiter @ Georgia IT

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.