Senior Data Engineer (Databricks)

Remote in Chicago, IL, US • Posted 2 hours ago • Updated 14 minutes ago
Full Time
Part Time
On-site
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • SQL
  • Extract
  • Transform
  • Load
  • Software Engineering
  • Problem Solving
  • Conflict Resolution
  • Performance Tuning
  • Cost Management
  • Data Engineering
  • Databricks
  • Apache Spark
  • Data Processing
  • Scalability
  • Root Cause Analysis
  • Continuous Integration
  • Continuous Delivery
  • Automated Testing
  • Cloud Computing
  • Mentorship
  • Microsoft Azure
  • Amazon Web Services
  • Google Cloud Platform
  • Google Cloud
  • Agile
  • Scrum

Summary

Job Title: Senior Data Engineer (Databricks)

Location: Chicago, IL / Remote

Job Type: Full-Time



Job Summary

We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, Apache Spark, SQL, and cloud-based ETL pipelines. The ideal candidate should possess strong software engineering fundamentals and experience building scalable, high-performance data engineering solutions in cloud environments.



Required Skills

  • Hands-on expertise in:
    • Databricks
    • Apache Spark
    • SQL
    • Cloud-based ETL pipelines
    • CI/CD implementation
  • Strong experience building scalable and distributed data engineering solutions
  • Strong software engineering and problem-solving skills
  • Experience with cloud platforms and modern data architectures
  • Knowledge of performance optimization, monitoring, and cost management



Key Responsibilities

  • Design, develop, test, and deliver high-quality data engineering solutions aligned with business needs
  • Build, optimize, and maintain scalable data pipelines using Databricks and Apache Spark
  • Architect distributed data processing frameworks ensuring reliability, scalability, and performance
  • Troubleshoot and resolve complex application and data issues through root cause analysis
  • Implement code reviews, engineering standards, and best practices to ensure maintainability and quality
  • Develop and support CI/CD pipelines, automated testing, and monitoring solutions for cloud data platforms
  • Optimize cloud data platform performance and operational costs
  • Mentor junior and mid-level engineers and contribute to continuous engineering improvements



Preferred Skills

  • Experience with Azure, AWS, or Google Cloud Platform data platforms
  • Exposure to Delta Lake, Data Lakes, or Lakehouse architectures
  • Familiarity with Agile/Scrum development methodologies

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91018020
  • Position Id: PDT - 11038-12173-1778593141
  • Posted 2 hours ago

Company Info

About Purple Drive Technologies LLC

Founded in 2007, Purple Drive started as a tech solutions firm and has grown into a full-service consulting and talent partner. We help businesses navigate complex technology challenges while connecting top professionals with career-defining opportunities.

We believe in transforming businesses through smart IT solutions and empowering technologists to grow their expertise through challenging projects and meaningful partnerships. Built on over 20 years of trusted relationships, we create success stories for both our clients and the talented professionals who drive innovation forward.

Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Chicago, Illinois

Today

Easy Apply

Full-time, Part-time, Contract, Third Party

Belews Creek, North Carolina

Today

Easy Apply

Full-time, Part-time, Contract, Third Party

Remote or Philadelphia, Pennsylvania

Today

Easy Apply

Full-time, Part-time, Third Party, Contract

New York, New York

Today

Easy Apply

Full-time, Part-time, Contract, Third Party

Search all similar jobs