Databricks Architect (Financial Exp)

Atlanta, GA, US • Posted 17 hours ago • Updated 15 hours ago
Contract Corp To Corp
Contract Independent
Contract W2
On-site
Depends on Experience
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • PySpark
  • Spark SQL
  • Delta Lake

Summary

We have an opening for Databricks Architect (Financial Exp) at Atlanta, GA. Kindly apply with your updated resume if you are interested. Please find the job details below:

Position: Databricks Architect (Financial Exp)

Location: Atlanta, GA

Duration: 12 Months contract position

 

Responsibilities

  • Architecture & Strategy: Designing scalable Medallion architectures (Bronze, Silver, Gold layers) and defining enterprise data strategies.
  • Pipeline Engineering: Leading the development of robust, end-to-end ETL/ELT pipelines for both batch and real-time streaming data.
  • Performance Optimization: Tuning Spark workloads, optimizing Delta Lake storage (e.g., Z-Ordering, partitioning), and managing DBU (Databricks Unit) costs.
  • Governance & Security: Implementing Unity Catalog for centralized access control, data lineage, and auditability.
  • DevOps & Automation: Establishing CI/CD practices using tools like Terraform, Azure DevOps, or GitHub Actions for automated deployments.
  • Leadership & Mentorship: Guiding cross-functional teams, performing code reviews, and mentoring junior engineers.

 

Key Technical Skills

  • Databricks Ecosystem: Deep expertise in PySpark, Spark SQL, Delta Lake, and Delta Live Tables (DLT).
  • Programming: Mastery of Python or Scala, and advanced proficiency in SQL.
  • Cloud Platforms: Strong hands-on experience with at least one major provider Azure (ADF, ADLS), AWS (S3, Glue, Lambda), or Google Cloud Platform.
  • Orchestration: Experience with workflow tools like Apache Airflow or Databricks Workflows
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10315040
  • Position Id: 8934584
  • Posted 17 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Atlanta, Georgia

Today

Easy Apply

Contract, Third Party

Depends on Experience

Atlanta, Georgia

10d ago

Easy Apply

Third Party, Contract

Depends on Experience

Hybrid in Atlanta, Georgia

6d ago

Easy Apply

Contract, Third Party

$50 - $57

Atlanta, Georgia

19d ago

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs