Apply Now

Databricks Data Engineer

• Posted 20 hours ago • Updated 8 hours ago

Full Time

Part Time

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

Databricks
Delta Lake
Python
SQL
ETL/ELT
cloud platforms
andSales Incentive Compensation (SIC)

Summary

Databricks Data Engineer

Location: New York , Onsite

Need Locals or nearby who can relocate

We are seeking an experienced Databricks Data Engineer to design, develop, and optimize enterprise-scale data pipelines on the Databricks platform. The ideal candidate will have strong expertise in Databricks, Delta Lake, Python, SQL, ETL/ELT, cloud platforms, and Sales Incentive Compensation (SIC) data processing.

<>Key Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks, Delta Lake, and Delta Live Tables.
Build and optimize data models, notebooks, workflows, and enterprise data pipelines.
Develop data solutions supporting Sales Incentive Compensation (SIC) including quota management, commission calculations, attainment tracking, and payout reporting.
Collaborate with Sales Operations, Finance, BI, and business stakeholders to translate business requirements into scalable data solutions.
Manage and enhance Databricks architecture, Unity Catalog, and workflow automation.
Optimize pipeline performance, troubleshoot issues, and ensure high data quality.
Integrate Databricks with cloud services (Azure, AWS, or Google Cloud Platform) and data sources such as Azure Data Factory, Kafka, Event Hubs, or similar.
Document data models, pipeline architecture, and technical specifications.

<>Required Skills

Strong expertise in:
- Databricks
- Delta Lake
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks Workflows
- Python and/or Scala
- Advanced SQL
- ETL/ELT development and data modeling
Experience with Sales Incentive Compensation (SIC) processes including commissions, quotas, payouts, and attainment calculations.
Experience integrating with Anaplan, Oracle ICM, Varicent (preferred).
Experience with Azure, AWS, or Google Cloud Platform cloud platforms.
Excellent analytical, communication, and stakeholder management skills.
Databricks Data Engineer Certification is a plus.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10236892
Position Id: OOJ - 5461-4462-1784543745
Posted 20 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Databricks Data Engineer

New York, New York

•

Today

Databricks Data EngineerLocation: New york We are seeking an experienced Databricks Data Engineer to design, develop, and optimize enterprise-scale data pipelines on the Databricks platform. The ideal candidate will have strong expertise in Databricks, Delta Lake, Python, SQL, ETL/ELT, cloud platforms, and Sales Incentive Compensation (SIC) data processing. < data-start=434 data-end=463>Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Databricks, Delta Lake, and De

Easy Apply

Contract

Depends on Experience

DataBricks Data Engineer

New York, New York

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a DataBricks Data Engineer for a CONTRACT assignment with one of our premier Insurance Services clients in New York, NY. We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, performance reporting, analytics,

Contract

USD 70.00 - 75.00 per hour

DataBricks Data Engineer

New York, New York

•

Today

Hello Job Description DataBricks Data Engineer Experience required: 10 Years Local candidate Only ( Hybrid ) Databricks Data Engineer We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, performance reporting, analytics, sales incentive compensation processing, and e

Easy Apply

Full-time, Part-time, Third Party, Contract

Databricks Data Engineer

Hybrid in New York, New York

•

Today

Data Engineer, Databricks Location: New York NY (4 days onsite), w2 only, local candidates only Duration: 6 Months Must have Data Modelling, Data Lake, Building Dashboard, and Databricks Databricks Data Engineer We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, perf

Easy Apply

Contract

$70 - $75

Search all similar jobs