Azure Databricks Administrator -W2 only

  • Posted 1 day ago | Updated moments ago

Overview

BASED ON EXPERIENCE
Full Time
Contract - W2
Contract - Independent

Skills

Data Analysis
Performance Tuning
Data Engineering
Data Governance
Operational Efficiency
Productivity
Virtual Machines
RBAC
Access Control
Analytics
Continuous Integration
Continuous Delivery
DevOps
GitHub
Collaboration
Documentation
Production Support
Cloud Computing
Management
Unity
Apache Spark
Orchestration
Storage
Computer Networking
Terraform
ARM
Linux
Problem Solving
Conflict Resolution
Communication
Microsoft Azure
Databricks
Scripting
Python
Windows PowerShell
Bash
Regulatory Compliance
Data Security

Job Details

Job Title: Azure Databricks Administrator (W2 Only)
Location: Rocky Hill, CT - Onsite
# of Positions: 2

Job Overview:
We are looking for a skilled Azure Databricks Administrator to support and manage enterprise-scale data analytics platforms. This role requires strong hands-on experience with Azure cloud services and Azure Databricks, focusing on platform administration, performance optimization, security, and operational stability. The ideal candidate will work closely with data engineering, analytics, and DevOps teams to ensure a reliable and scalable data environment.

Key Responsibilities:

  • Administer and support Azure Databricks workspaces, clusters, pools, jobs, and notebooks.

  • Configure, monitor, and optimize Databricks cluster and pool performance, availability, and cost.

  • Implement and manage Databricks Unity Catalog for centralized data governance, access control, and lineage tracking.

  • Utilize Databricks Assistant to improve operational efficiency, troubleshoot issues, and support user productivity.

  • Manage Azure infrastructure supporting Databricks including ADLS Gen2, Azure VMs, VNETs, NSGs, Key Vault, and Azure AD.

  • Implement and maintain security best practices including RBAC, workspace access controls, secrets management, and data permissions.

  • Monitor platform health using Azure Monitor, Log Analytics, and Databricks metrics.

  • Troubleshoot Databricks, Spark, and Azure-related issues across environments.

  • Support CI/CD pipelines for Databricks using Azure DevOps or GitHub.

  • Collaborate with data engineers and architects on platform improvements and scaling.

  • Maintain documentation, operational procedures, and support runbooks.

  • Participate in production support and incident resolution as needed.

Required Qualifications:

  • Hands-on experience in Azure cloud administration.

  • Hands-on experience administering Azure Databricks, including cluster and pool setup/management.

  • Working knowledge of Databricks Unity Catalog and Databricks Assistant.

  • Strong understanding of Apache Spark architecture and Databricks job orchestration.

  • Experience with Azure storage services (ADLS Gen2, Blob Storage).

  • Knowledge of Azure networking and security concepts.

  • Experience with Infrastructure as Code (Terraform, ARM templates).

  • Proficiency with Linux environments.

  • Strong problem-solving and communication skills.

Preferred Qualifications:

  • Azure certifications (AZ-104, AZ-305) or Databricks certification.

  • Experience supporting enterprise or large-scale data platforms.

  • Scripting experience with Python, PowerShell, or Bash.

  • Familiarity with governance, compliance, and data security standards.

    Infowave Systems is an equal opportunity employer that is committed to diversity and inclusion in the workplace.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Hexplora