Apply Now

Databricks DevOps Lead

Deerfield, IL, US • Posted 3 hours ago • Updated 3 hours ago

Full Time

No Travel Required

On-site

Depends on Experience

citecht

Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

Databricks
DevOps
Azure
IAAS
Kubernetes
SonarQube
CI/CD

Summary

Greetings,

Hope you are doing well

Please find the JD and let me know your thoughts

Databricks DevOps Lead

Deerfield, IL

Fulltime

Onsite

Job Description

Mandatory skills: Databricks, Spark, IAAS, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
Additional Skills: 5+ years of DevOps/SRE experience supporting data platforms or distributed systems.
Strong experience with CI/CD pipelines (Azure DevOps/GitHub Actions) for Databricks, Spark jobs, and Azure data components. Hands‑on experience with infrastructure as code (Terraform/Bicep/ARM) for provisioning Azure resources (Databricks, ADLS Gen2, Event Hubs, Key Vault). Solid understanding of build and release strategies for notebooks, JARs, wheels, and configuration artifacts. Experience setting up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools.
Strong scripting skills (Python, PowerShell, or Bash) for automation and tooling.
Good to have skills: Experience with containerization and orchestration (Docker, Kubernetes, AKS) for supporting ancillary services. Knowledge of security best practices (managed identities, secrets management, RBAC) for Azure data services. Exposure to reliability engineering concepts (error budgets, SLOs, SLI dashboards) for data workloads.

Roles & Responsibilities:

Ability to create/maintain CI/CD pipelines (Azure DevOps/GitHub Actions) for Databricks, Spark jobs, and Azure data components.
Develop infrastructure as code (Terraform/Bicep/ARM) for provisioning Azure resources (Databricks, ADLS Gen2, Event Hubs, Key Vault).
Create scripts to manage release strategies for notebooks, JARs, wheels, and configuration artifacts.
Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools
Coordinate with offshore team in India

Regards

Shivam | Technical Recruiter

🌐

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: PTPI6rD4E3tvKm9
Position Id: 8954496
Posted 3 hours ago

Company Info

About citecht

Our Mission

Our mission is to help businesses succeed through reliable technology and skilled execution. We work closely with organizations to design and deliver IT solutions that support real business goals, encourage innovation, and enable long term growth.

Our Vision

Our vision is a future where technology consistently supports business operations and decision making. We aim to be the trusted partner organizations rely on to turn complex technical challenges into lasting value.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Azure Cloud Architect

Chicago, Illinois

•

Today

Roles & Responsibilities Design end-to-end cloud architecture, including app, data, integration and security layers Recommend and implement cloud migration strategies for applications in legacy tech stack ensuring cloud security principles and aligned to NTs enterprise architectural standards Define CI/CD templates using GitHub Actions Build cloud native apps using Java, Sprintboot, Microservices Prepare high-level and low-level solution design documents as applicable and secure approvals f

Easy Apply

Full-time

140,000

Search all similar jobs