Role: Sr. Databricks Engineer (Hybrid) - Location: NYC, NY (In-Person) - 100% Only locals (NY) with valid DL copy & Healthcare Background (Mandatory).

Hybrid in NYC, NY, US • Posted 4 hours ago • Updated 3 hours ago

Contract Independent

Contract W2

Hybrid

Up to $70/hr

HSK Technologies, Inc.

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

Databricks Engineer
Data Engineer
ETL development
data transformation
data analytics
Databricks notebooks
Azure Databricks
Azure Data Factory
Microsoft Azure
distributed computing
data engineering best practices
data pipelines
data lake architecture
Delta Lake
data quality automation
monitoring and logging
Azure Blob Storage
Azure Data Lake Storage
SQL databases
NoSQL databases
data modeling
schema design
CI/CD pipelines
DevOps practices
Databricks workspace administration
cluster management
job scheduling
workflow orchestration
cloud data integration

Summary

Job Title: Databricks Engineer (Hybrid)

Location: New York City, NY (In-Person)

Job Type: Contract

Job Overview

We are seeking a skilled Databricks Engineer to design, build, and optimize scalable data solutions that support enterprise analytics and data-driven decision-making. This role focuses on developing robust ETL pipelines, managing Databricks environments, and integrating cloud-based data sources within an Azure ecosystem.

The ideal candidate has strong hands-on experience with Databricks, distributed data processing, and modern data engineering best practices.

Key Responsibilities

Develop, optimize, and maintain Databricks notebooks for ETL, data transformation, and analytics workflows
Design and implement scalable data pipelines using Databricks and Azure Data Factory
Apply distributed computing concepts to process large-scale datasets efficiently
Work with data lake architectures, including Delta Lake, to ensure reliable and high-performance data storage
Automate data quality checks, monitoring, alerting, and logging processes
Integrate data from multiple cloud sources such as Azure Blob Storage, Azure Data Lake Storage, and SQL/NoSQL databases
Perform data modeling and schema design to support analytical and reporting workloads
Implement and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows
Manage Databricks workspace administration, cluster configuration, job scheduling, and orchestration
Collaborate with cross-functional teams including data analysts, architects, and stakeholders

Required Qualifications

Proven hands-on experience with Databricks for large-scale data processing and analytics
Strong understanding of data engineering best practices, ETL design, and distributed systems
Experience with cloud-based data platforms, preferably Microsoft Azure
Familiarity with data pipeline orchestration and automation tools
Experience working with structured and semi-structured data sources

Preferred Qualifications

Experience with Azure Data Factory, Delta Lake, and cloud-native data architectures
Knowledge of CI/CD tools and DevOps practices for data engineering
Experience working in regulated industries is a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91086948
Position Id: 8874235
Posted 4 hours ago

Company Info

About HSK Technologies, Inc.

We empower businesses to achieve their business innovation goals by offering world-class software development services
HSK Technologies was founded in 2009 to help businesses extract as much value as possible from their existing technology investments. From one-off projects, new implementations, HSK helps companies around the world achieve their business objectives.

With offices in North America and India, our expertise extends across most business segments including technology, financial services, insurance, healthcare, telecom, manufacturing, public sector, retail, and consumer packaged goods.

HSK is a true and seamless backend technology partner, helping your business accelerate the development of desktop, mobile & web-based apps with on-demand developers that focus on moving your business forward. Hundreds of large customers around the world, spanning Media and Entertainment, Banking and Financial services, Insurance, HealthCare, Retail, and Government entities, chose HSK as a preferred partner for IT support. With the support of industry experts and a huge pool of professionally qualified workers operating around the world, HSK Technologies offers world-class services.

We’ve earned our reputation one relationship at a time, delivering successful outcomes to over 100 customers (and counting).

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.