TechVirtue LLC
TechVirtue LLC

Lead Databricks Engineer

Atlanta, GA, US • Posted 23 hours ago • Updated 23 hours ago
Contract W2
12 Months
No Travel Required
On-site
$65 - $70/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Microsoft Azure / Azure Data Lake Storage (ADLS) Azure Data Factory Unity Catalog Databricks SQL Delta Live Tables / Lakeflow Terraform Kafka / Event Streaming Python Power BI or other BI tools Data governance and lineage Experience with GenAI/ML workloads on Databricks is a

Summary

We are seeking a Lead Databricks Engineer with strong hands-on experience in Databricks, Apache Spark, PySpark, SQL, and modern cloud data engineering. The ideal candidate will lead the design and development of scalable data platforms, mentor engineers, and work closely with architects and business stakeholders to deliver high-performance data solutions.

Key Responsibilities

  • Lead the design, development, and implementation of Databricks-based data platforms and pipelines.
  • Develop scalable ETL/ELT pipelines using Databricks, Apache Spark, PySpark, and SQL.
  • Design and implement Delta Lake / Lakehouse architectures.
  • Build batch and near-real-time data processing solutions.
  • Optimize Spark jobs, SQL queries, clusters, and data pipelines for performance and cost.
  • Develop reusable data engineering frameworks and standards.
  • Work with cloud storage, data warehouses, APIs, and enterprise data sources.
  • Implement data quality, validation, monitoring, and error-handling frameworks.
  • Use Databricks Workflows, notebooks, Delta Live Tables/Lakeflow, and CI/CD practices.
  • Implement security, access control, governance, and data lineage.
  • Collaborate with Data Architects, Data Scientists, Analysts, and application teams.
  • Provide technical leadership, code reviews, mentoring, and troubleshooting support.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91170837
  • Position Id: 9084578
  • Posted 23 hours ago

Company Info

About TechVirtue LLC

TechVirtue is involved in developing a wide range of solutions in finding the perfect candidate who has a strong knowledge in his/her work and suits the company's work culture. We even provide one-stop solutions ranging from software development and maintenance to expert support and advisory. Our team consists of experts who have several years of experience in staffing, recruitment, and web development. Our dedicated and motivated team makes sure to fulfill all our customers requirements.

About_Company_OneAbout_Company_Two
Go to company profile
Contact the job poster
VG

Vinuth Guntakala

Recruiter @ TechVirtue LLC
View Profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior / Lead Databricks Engineer - Atlanta - GA - Long term Contract

Atlanta, Georgia

•

Today

Easy Apply

Contract

55 - 70

Lead Databricks Engineer

Atlanta, Georgia

•

Today

Easy Apply

Contract

Depends on Experience

Azure Data Engineer

Atlanta, Georgia

•

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs
More jobs at TechVirtue LLC in Atlanta, GA