Sr. Databricks Engineer

Charlotte, NC, US • Posted 2 hours ago • Updated 2 hours ago
Full Time
On-site
$120,000 - $140,000/yr
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Databricks
  • PySpark
  • Spark
  • Data Quality
  • Data Modeling
  • Data Analysis
  • Data Engineering
  • ELT
  • Extract
  • Transform
  • Load
  • SQL
  • Python
  • Microsoft Azure
  • Microsoft Power BI
  • Conflict Resolution
  • Continuous Delivery
  • Continuous Integration
  • Insurance
  • Analytics
  • Apache Spark
  • Cloud Computing
  • Collaboration
  • Communication
  • Orchestration
  • Performance Tuning
  • Problem Solving
  • Production Support
  • Scala
  • Workflow

Summary

Job Role: Sr. Databricks Engineer

Location: Charlotte, NC/Raleigh, NC

Job Description:

Must Have Technical/Functional Skills

  • 12+ years overall experience in data engineering or related fields.
  • 3 5 years hands-on experience with Databricks and Spark.
  • Strong proficiency in SQL and data analysis techniques.
  • Experience with ETL processes, data modeling, and performance tuning.
  • Familiarity with Python or Scala for data engineering tasks.
  • Excellent problem-solving and communication skills.

Roles & Responsibilities

We are seeking a hands-on Sr. Databricks Data Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong experience in data engineering, ETL development, and production support, ensuring reliable, scalable, and high-performing data operations within Azure environment and can work in a fast-paced environment. Knowledge of insurance domain and Power BI is a plus but not mandatory.

Development

  • Design, develop, and deploy scalable ETL/ELT data pipelines using Apache Spark, PySpark, and Databricks.
  • Develop and optimize SQL queries for data transformation and analysis.
  • Collaborate with product owners, data architects and analysts to build data models, delta lake structures, and data workflows.
  • Collaborate with data analysts and business teams to deliver actionable insights.
  • Build job orchestration and monitoring solutions
  • Ensure data quality, performance, and reliability across workflows.
  • Develop and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.
  • Work with cloud-based data platforms (Azure preferred).

Required Skills & Experience:

  • 10+ years overall experience in data engineering or related fields.
  • 3 5 years hands-on experience with Databricks and Spark.
  • Strong proficiency in SQL and data analysis techniques.
  • Experience with ETL processes, data modeling, and performance tuning.
  • Familiarity with Python or Scala for data engineering tasks.
  • Excellent problem-solving and communication skills.

Nice-to-Have:

  • Knowledge of insurance industry data.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10217521
  • Position Id: 8960193
  • Posted 2 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

4d ago

Easy Apply

Full-time

Depends on Experience

Charlotte, North Carolina

Today

Easy Apply

Full-time, Contract

$75 - $80.98 per hour

Charlotte, North Carolina

2d ago

Easy Apply

Full-time

USD 60.00 - 65.06 per hour

Charlotte, North Carolina

2d ago

Easy Apply

Full-time

USD 69.00 - 72.00 per hour

Search all similar jobs