Databricks Architect

Overview

Remote
$70 - $90
Contract - Independent
No Travel Required

Skills

Databricks

Job Details

Databricks Architect Location: Remote US
Job Type: Contract 6+ Months
Experience Level:10+ Years

About the Role

We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure architectural integrity for enterprise-scale data platforms.

Key Responsibilities

  • Architect and lead the implementation of scalable big data solutions using Databricks and Apache Spark.
  • Design and optimize ETL/ELT pipelines for processing large-scale structured and unstructured data.
  • Define data architecture standards, best practices, and governance protocols.
  • Collaborate with cross-functional teams including Data Engineers, Data Scientists, and Business Analysts.
  • Provide technical leadership in Delta Lake, MLflow, and notebook-based development.
  • Ensure data reliability, scalability, and performance optimization across cloud platforms.
  • Lead code reviews, architecture discussions, and DevOps integration for continuous delivery.
  • Troubleshoot production issues and manage monitoring strategies for robust data infrastructure.
  • Mentor junior engineers and provide architectural guidance.

Required Skills & Qualifications

  • Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
  • 7+ years of experience in big data engineering, including 3+ years in Databricks architecture.
  • Expert-level proficiency in Apache Spark, Delta Lake, Python, and SQL.
  • Deep understanding of data warehousing, performance tuning, and cloud data platforms (Azure preferred, AWS acceptable).
  • Strong experience with CI/CD tools, DevOps practices, and infrastructure as code (e.g., Terraform).
  • Knowledge of data security, compliance, and governance frameworks.
  • Proven ability to lead technical teams and influence enterprise data strategy.

Preferred Qualifications

  • Databricks Certification: Data Engineer Professional, Solutions Architect, or equivalent.
  • Experience with Azure Data Lake, Azure Synapse, AWS Redshift, or Google Cloud Platform BigQuery.
  • Hands-on with MLflow, Unity Catalog, or data lineage and cataloging tools.
  • Familiarity with orchestration tools like Airflow, Azure Data Factory, or dbt.
  • Strong written and verbal communication skills; ability to present to technical and business stakeholders.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Showman Staffing