Apply Now

Databricks Data Engineer- azure databricks, Scala is Must

Deerfield, IL, US • Posted 1 hour ago • Updated 1 hour ago

Full Time

On-site

$100,000 - $140,000/yr

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

Databricks Data Engineer-
Scala

Summary

Databricks Data Engineer- azure databricks, Scala is Must
Location : Deerfield, IL (Onsite)
Full Time Only

Job Description

Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
Additional Skills: 3 6 years of experience in data engineering on cloud data platforms. Handson experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, aggregations, and data quality checks. Understanding of core Azure data services (Event Hubs/Kafka, Data Factory/Databricks Workflows, Key Vault). Experience working with Gitbased workflows and CI/CD in Azure DevOps or GitHub.
Good to have skills: Exposure to Spark Structured Streaming for near realtime use cases. Experience with data quality tools or frameworks and writing unit/integration tests for data pipelines. Familiarity with data modeling and performance considerations in Lakehouse environments.

Roles & Responsibilities:

Responsible for building data products in Databricks using Scala/Spark
Responsible for Ops work managing production for the data products developed and deployed to production
Responsible for testing data products based on product specification and end to end validation
Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools
Coordinate with offshore team in India

Salman Shaikh

Quadrant Technologies +1- (Cell)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91085293
Position Id: Deerfield
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Scala Data Engineer

Deerfield, Illinois

•

Yesterday

Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQubeAdditional Skills: 36 years of experience in data engineering on cloud data platforms. Handson experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, ag

Easy Apply

Full-time

90000 - 100000

Data Engineer III - 328284

Lake Forest, Illinois

•

23d ago

Work Location Type: Remote About Grainger: W.W. Grainger, Inc., is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. At Grainger, We Keep the World Working by serving more than 4.5 million customers worldwide with products and solutions delivered through innovative technology and deep customer relationships. Known for its commitment to service and award-winning culture, the Company had 2024 revenue of $17.2 billion across its two busines

Full-time

USD 130,707.00 - 156,400.00 per year

Sr Mgr Data & Analytics

Hybrid in Northbrook, Illinois

•

Today

Job Summary We are looking for a strategic, business-focused, and solution-driven Senior Manager to join our Information Technology - Data & Analytics team. This is a high-impact role focused on leading the development of data products that unlock insights and empower decision-making across various functions such as Supply Chain, Manufacturing, Finance, Sales, Quality and Procurement and lead the Data & Analytics- Centre of Excellence. We're seeking a techno-functional leader who is passionate

Full-time

USD 134,000.00 - 201,000.00 per year

Machine Learning Engineer - 328057

Lake Forest, Illinois

•

23d ago

Work Location Type: Hybrid About Grainger: W.W. Grainger, Inc., is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. At Grainger, We Keep the World Working by serving more than 4.5 million customers worldwide with products and solutions delivered through innovative technology and deep customer relationships. Known for its commitment to service and award-winning culture, the Company had 2024 revenue of $17.2 billion across its two busines

Full-time

USD 110,500.00 - 184,100.00 per year

Search all similar jobs