Lead Data Engineer (Databricks)

Los Angeles, CA, US • Posted 2 hours ago • Updated 4 minutes ago
Full Time
50% Travel Required
On-site
$140000/yr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • SQL
  • Python
  • PySpark
  • AWS Cloud
  • databricks
  • airflow
  • ETL / ELT Pipeline Development
  • Data Modeling & Data Warehousing
  • Lakehouse Architecture
  • Performance Optimization & Monitoring

Summary

Location: Los Angeles, CA (Hybrid 3 Days Onsite)
Type: Full-Time
Experience: 9 14 Years

Job Summary

We are seeking a Lead Data Engineer with strong expertise in Databricks, PySpark, and scalable data engineering to support large-scale media and streaming data environments. The role involves building high-performance ETL/ELT pipelines, optimizing data infrastructure, and supporting analytics and reporting initiatives.

Must-Have Skills
  • 9+ years of experience in Data Engineering
  • Strong hands-on experience with Databricks
  • Expertise in SQL, Python, and PySpark
  • Strong experience in ETL / ELT pipeline development
  • Experience with Data Modeling & Data Warehousing
  • Experience building Lakehouse architectures
  • Hands-on experience with Airflow or workflow orchestration tools
  • Strong understanding of performance optimization and monitoring
  • Experience with AWS cloud platforms
  • Excellent communication and stakeholder management skills
Key Responsibilities
  • Design, build, and maintain scalable ETL/ELT pipelines
  • Develop and optimize data models, lakehouse, and warehouse solutions
  • Build high-volume batch and near real-time data pipelines
  • Monitor, troubleshoot, and optimize production workloads
  • Implement orchestration and workflow automation solutions
  • Collaborate with analytics, reporting, and engineering teams
  • Lead technical discussions and mentor engineering teams
  • Support scalable solutions for streaming and subscription datasets
Nice to Have
  • Experience in Media / Streaming / Subscription platforms
  • Experience handling high-volume consumer datasets
  • Exposure to real-time data processing environments
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91026517
  • Position Id: 2026-1787
  • Posted 2 hours ago

Company Info

About Acunor Infotech

Acunor stands for Accurate North. Similar to North Star, we strive to provide accurate guidance and help our clients in every step of their journey towards a sustainable digital organization. Here at Acunor, we’ve been on a journey to upskill IT practitioners and we are ready to help IT organisations and individuals accelerate their upskilling journey and create the workforce of tomorrow, today.

Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or New Jersey

Today

Easy Apply

Full-time

$120k

Remote or New Jersey

Today

Easy Apply

Full-time

$140000

Remote or New Jersey

Today

Easy Apply

Full-time

$$125k

No location provided

Today

Easy Apply

Full-time

Search all similar jobs