Databricks Architect

Hybrid in Dallas, TX, US • Posted 3 days ago • Updated 1 day ago
Full Time
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

  • Databricks
  • Azure

Summary

We are looking for an experienced Databricks Architect to lead the design, development, and implementation of scalable data platforms on Databricks. The ideal candidate will have strong expertise in Spark, Delta Lake, data engineering, and cloud platforms (Azure/AWS/Google Cloud Platform), along with proven experience in architecting modern data solutions.

Key Responsibilities

  • Design and implement end-to-end data architecture using Databricks Lakehouse platform
  • Define data engineering best practices and build scalable ETL/ELT pipelines
  • Architect solutions leveraging Apache Spark (PySpark/Scala) and Databricks workflows
  • Implement Delta Lake for data reliability, performance, and governance
  • Collaborate with stakeholders to understand business requirements and translate them into technical solutions
  • Optimize performance, cost, and scalability of data pipelines
  • Provide technical leadership, mentoring data engineers and developers
  • Ensure data security, governance, and compliance standards are met
  • Integrate Databricks with cloud services (Azure, AWS, or Google Cloud Platform) and other enterprise systems
  • Support real-time and batch data processing use cases

Required Skills & Qualifications

Technical Skills

  • Strong hands-on experience with Databricks Platform
  • Expertise in Apache Spark (PySpark / Scala / SQL)
  • Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
  • Proficiency in data pipelines, ETL/ELT frameworks
  • Strong experience in SQL and data modeling
  • Hands-on experience with cloud platforms:
    • Azure (ADF, ADLS, Synapse) OR
    • AWS (S3, Glue, EMR) OR

Data Engineering Concepts

  • Data warehousing and data lake solutions
  • Batch & real-time data processing
  • Data governance and security frameworks
  • Performance tuning and optimization

Tools & Technologies

  • Databricks Workflows / Jobs
  • Airflow / ADF / Prefect (any orchestration tool)
  • CI/CD pipelines (Azure DevOps, GitHub Actions)
  • Streaming tools like Kafka (preferred)

Preferred Qualifications

  • Databricks Certifications (e.g., Databricks Certified Professional / Associate)
  • Experience in data migration to Databricks
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10126072
  • Position Id: 9003563
  • Posted 3 days ago
Contact the job poster
Fayaz Shaik

Fayaz Shaik

Recruiter @ Anblicks
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Dallas, Texas

3d ago

Easy Apply

Full-time

Depends on Experience

Dallas, Texas

4d ago

Easy Apply

Full-time

Depends on Experience

Irving, Texas

6d ago

Full-time

USD 125,760.00 - 188,640.00 per year

Irving, Texas

6d ago

Full-time

USD 107,120.00 - 160,680.00 per year

Search all similar jobs