Principal Data Engineer (Databricks & Azure)

Hybrid in Atlanta, GA, US • Posted 5 hours ago • Updated 5 hours ago
Full Time
No Travel Required
Hybrid
$160,000 - 165000/yr
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • Databricks
  • Continuous Delivery
  • Data Quality
  • Recruiting
  • Microsoft SQL Server
  • Migration
  • ELT
  • Data Governance
  • Data Lake
  • Apache Spark
  • Transact-SQL
  • Meta-data Management
  • Testing
  • Microsoft SSIS
  • PySpark
  • SQL
  • Retail

Summary

Principle Data Engineer

📍 Atlanta, GA (Hybrid)
💼 Full-Time (FTE)
🏢 Floor & Decor

About the Role

We are seeking a highly skilled Senior Data Engineer to join our growing Data Engineering team. This is a hands-on engineering role focused on building and delivering scalable data products within a modern cloud-based data platform using Databricks on Azure. The ideal candidate will have strong expertise in PySpark, Python, SQL, Delta Lake, and Azure Data Services, with experience developing production-grade data pipelines and supporting enterprise analytics initiatives.

This role offers the opportunity to work on cloud-first data engineering initiatives while supporting a strategic migration from legacy SQL Server data warehouse environments to a modern lakehouse architecture.


Responsibilities

✅ Design, build, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake

✅ Develop and support data products following Medallion Architecture (Bronze/Silver/Gold)

✅ Build and maintain SCD Type 1 & Type 2 data models and dimensional data warehouse solutions

✅ Create and optimize ETL/ELT workflows using Azure Data Factory and Databricks Jobs

✅ Implement data quality checks, monitoring, alerting, and operational support processes

✅ Collaborate with business stakeholders across Finance, Supply Chain, Merchandising, Marketing, and Operations

✅ Support legacy SQL Server and SSIS workloads during migration initiatives

✅ Participate in code reviews, CI/CD deployments, testing, documentation, and production support

✅ Contribute to engineering best practices, reusable frameworks, and technical mentoring


Required Skills & Experience

✔ 5+ years of Data Engineering experience

✔ 2+ years working with cloud-based data platforms (Databricks preferred)

✔ Strong experience with:

  • Databricks
  • PySpark
  • Spark SQL
  • Python
  • Delta Lake
  • Azure Data Factory
  • Azure Data Lake Storage Gen2
  • Azure DevOps
  • SQL Server / T-SQL

✔ Expertise in:

  • Data Modeling
  • Star Schema Design
  • SCD Type 1 & Type 2
  • ETL/ELT Development
  • Data Warehousing
  • CI/CD Practices
  • Git Version Control

✔ Experience building and supporting production-grade data pipelines

✔ Strong problem-solving, communication, and stakeholder management skills


Preferred Qualifications

⭐ Databricks Data Engineer Certification

⭐ Experience with dbt

⭐ Familiarity with Apache Airflow

⭐ Retail, Supply Chain, Merchandising, or ERP domain experience

⭐ Experience with Data Governance, Metadata Management, and Data Lineage

⭐ Bachelor''s Degree in Computer Science, Information Systems, or related field


What We''re Looking For

  • Ownership mentality and strong delivery focus
  • Ability to independently take requirements from design to production
  • Passion for cloud technologies and modern data platforms
  • Strong collaboration and communication skills
  • Experience working in compliance-sensitive environments (SOX, PCI, etc.)

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91124830
  • Position Id: 8992416
  • Posted 5 hours ago
Contact the job poster
SJ

Shivam Joga

Recruiter @ SyrenCloud LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Atlanta, Georgia

Today

Full-time

Alpharetta, Georgia

4d ago

Easy Apply

Full-time

Up to $140,000

Remote

26d ago

Easy Apply

Contract

45 - 50

Remote

Today

Easy Apply

Contract, Third Party

$61.67

Search all similar jobs