DataBricks Engineer

Overview

Remote
$120,000 - $140,000
Full Time

Skills

DataBrick
unity Catalog
SQL

Job Details

Sr Databrick Engineer

Cleveland, OH or Alpharetta, GA

Remote /Travel

Skilled Sr. Data Engineer /with expertise in Databricks and Unity Catalog to design, implement, and manage scalable data solutions.

Key Responsibilities:

  • Design and implement scalable data pipelines and ETL workflows using Databricks.
  • Implement Unity Catalog for data governance, access control, and metadata management across multiple workspaces.
  • Develop Delta Lake architectures for optimized data storage and retrieval.
  • Establish best practices for data security, compliance, and lineage tracking in Unity Catalog.
  • Optimize data lakehouse architecture for performance and cost efficiency.

Required Skills & Qualifications:

  • 8-19 years of experience in data engineering, data architecture, or cloud data solutions.
  • Strong hands-on experience with Databricks and Unity Catalog.
  • Expertise in PySpark, Scala, or SQL for data processing.
  • Deep understanding of Delta Lake, Lakehouse architecture, and data partitioning strategies.
  • Experience with RBAC, ABAC, and access control mechanisms within Unity Catalog.

Knowledge of data governance, compliance standards (GDPR, HIPAA, etc.), and audit logging.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.