Azure DevOps Engineer with Databricks & Terraform

Role: Azure DevOps Engineer with Databricks & Terraform

Location: Alpharetta GA or Berkley Heights NJ

Must Have Skills –

Skill 1 – Yrs of Exp – Azure DevOps

Skill 2 – Yrs of Exp – Terraform

Skill 3 – Yrs of Exp – CI/CD pipeline

Skill 4 – Yrs of Exp - Databricks

Good To have Skills –

Skill 1 – Yrs of Exp – Operations

Skill 2 – Yrs of Exp – Support

Skill 3 – Yrs of Exp – FinOps

Design, automate, and operate enterprise-scale Azure and Databricks platforms using Terraform Infrastructure-as-Code. Responsible for workspace provisioning, environment isolation, CI/CD automation, cloud governance, security and access management, FinOps optimization, disaster recovery, observability, and onboarding of data products and analytics platforms. Enable scalable, secure, and compliant data engineering and analytics solutions while driving infrastructure standardization and operational excellence across multiple business tribes and cloud environments.

Exp: 10+ years

Key Responsibilities

•         Build and maintain reusable Terraform modules and infrastructure automation.

•         Provision and manage Azure and Databricks workspaces, Unity Catalog, networking, storage, and access controls.

•         Implement workspace isolation, multi-subscription architectures, and governance controls.

•         Develop and support CI/CD pipelines, security compliance, and vulnerability remediation.

•         Support application teams to deploy configs and features to Production environment using Change Requests.

•         Support Linux patching team for patching the on-prem servers.

•         On-call support (L2) for infrastructure owned by the Devops team.

•         Drive FinOps initiatives, cost optimization, resource tagging, and cloud spend visibility.

•         Support disaster recovery, observability, platform reliability, and data product onboarding.

•         Enable integrations such as Delta Sharing, external data connectivity, and analytics platforms.

Key Skills Required

Cloud & Infrastructure

•         Azure Cloud Architecture and Services

•         Infrastructure as Code (Terraform/Terraform Enterprise)

•         Multi-Subscription & Multi-Environment Management

•         Networking (VNet Peering, Private Endpoints, NSGs, RBAC)

•         Disaster Recovery and High Availability Design

Databricks Platform Engineering

•         Databricks Workspace Provisioning & Administration

•         Unity Catalog Governance and Access Management

•         Workspace Isolation & Multi-Workspace Architecture

•         External Locations and Storage Credentials

•         Delta Sharing & External Data Connectivity

•         Databricks Security, Cluster Policies, and Resource Management

•         Databricks Integrations with external systems

DevOps & Automation

•         CI/CD Pipelines (GitLab, Harness)

•         Infrastructure Automation & Reusable Module Development

•         Platform Standardization and Governance Automation

•         Environment Provisioning and Configuration Management

•         Git-based Development Workflows

Security & Compliance

•         Cloud Security Best Practices

•         IAM, Service Principals, Managed Identities

•         Vulnerability Remediation & Certificate Management

•         Policy Enforcement and Governance Controls

•         Regulatory and Compliance Alignment

Data Platform & Operations

•         Data Lake and Storage Management (ADLS)

•         Data Platform Onboarding and Support

•         Production Support, Incident Management, and On-Call Operations

•         Change Management and Release Implementation

•         Platform Reliability Engineering

FinOps & Observability

•         Cloud Cost Optimization and Spend Analysis

•         Resource Tagging and Cost Attribution

•         Monitoring & Observability (Dynatrace, Splunk)

•         Capacity Planning and Performance Optimization

Soft Skills

•         Individual contributor for the features owned

•         Cross-functional Collaboration

•         Technical Leadership and Architecture Reviews

•         Problem Solving & Troubleshooting

•         Stakeholder Communication

•         Agile/Scrum familiarity