AZURE DATABRICKS INFRASTRUCTURE ENGINEER

King of Prussia, PA, US • Posted 1 day ago • Updated 1 day ago
Contract Corp To Corp
Contract Independent
12 Months
No Travel Required
On-site
$68/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AZURE DATABRICKS

Summary

 
 
Position Summary 
  • We are seeking an experienced Azure Databricks Infrastructure Engineer to execute migrations of Azure Databricks environments between Azure tenants. The successful candidate will have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization. 
  • This role is responsible for executing a migration strategy that minimizes risk, downtime, and business disruption. 
  • The ideal candidate will combine strong technical capabilities with consulting skills and be comfortable interacting with architects, platform teams, security organizations, and business stakeholders. 
 
Key Responsibilities 
Migration Planning 
  • Analyze tenant-specific dependencies, networking requirements, DNS, Private Endpoints, and identity integrations. 
  • Define migration waves and cutover strategies. 
  • Databricks Migration Execution 
  • Migrate Databricks workspaces between Azure tenants. 
Rebuild or migrate: 
  • Workspaces 
  • Compute policies 
  • Job schedules 
  • Repositories 
  • Workflows 
  • Secret scopes 
  • Access controls 
  • Migrate notebooks, libraries, packages, and configuration artifacts. 
  • Validate Unity Catalog and data governance configurations. 
  • Implement infrastructure-as-code and automation where applicable. 
  • Security and Identity 
Migrate and validate: 
  • Microsoft Entra ID integrations 
  • Managed identities 
  • Service principals 
  • RBAC assignments 
  • Databricks groups and permissions 
  • Coordinate Key Vault migration and secret rotation activities. 
  • Ensure compliance with Principle of Least Privilege (PLP). 
  • Support security reviews and governance approvals. 
  • Data Migration 
  • Assess and migrate associated datasets and storage integrations. 
  • Validate Delta Lake tables, metadata, and schemas. 
  • Develop rollback and recovery procedures. 
  • Automation and DevOps 
  • Develop Infrastructure-as-Code solutions using: 
  • Terraform 
  • Bicep 
  • ARM Templates 
  • Automate migration and validation activities wherever possible. 
 
Required Technical Skills 
  • Azure 
  • Azure Databricks 
  • Microsoft Entra ID 
  • Azure Virtual Networks 
  • Private Endpoints 
  • Azure Key Vault 
  • Azure Storage Accounts 
  • Azure Data Lake Storage Gen2 
  • Azure Monitor 
  • Log Analytics 
  • Azure Policy 
  • Azure RBAC 
  • Databricks 
  • Workspace administration 
  • Unity Catalog 
  • Delta Lake 
  • Databricks Repos 
  • MLflow 
  • Cluster management 
  • Cluster policies 
  • Secret scopes 
  • Databricks REST APIs 
  • Automation 
  • Terraform 
  • Azure DevOps 
  • GitHub Actions 
  • PowerShell 
  • Azure CLI 
  • Databricks CLI 
 
Required Experience 
  • 10+ years of Azure cloud experience. 
  • 7+ years of Azure Databricks administration and engineering experience. 
  • Demonstrated experience migrating Azure resources across tenants. 
  • Experience with large-scale data platform migrations. 
  • Experience designing secure cloud landing zones. 
  • Experience implementing Infrastructure as Code. 
  • Experience working in regulated enterprise environments. 
 
Preferred Qualifications 
  • Azure Solutions Architect Expert 
  • Databricks Administrator Certification 
  • Databricks Solution Architect Certification 
  • Experience with Unity Catalog migrations 
  • Experience with mergers, acquisitions, divestitures, or tenant-to-tenant transformations 
 
Deliverables 
  • The resource should be capable of independently producing: 
  • Migration strategy and wave plan 
  • Detailed migration runbooks 
  • Cutover and rollback plans 
  • Operational handover documentation 
 
Ideal Candidate Profile 
A senior-level architect or lead engineer who has previously executed Azure Databricks tenant-to-tenant migrations, understands both platform and data engineering concerns, can engage with executive stakeholders, and can lead migration activities from assessment through production cutover with minimal supervision. 
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172418
  • Position Id: 9081563
  • Posted 1 day ago

Company Info

About Empresent Global, LLC

At Empresent Global, we take pride in being a premier Total Manpower Solutions Company, operating under the Indian Companies Act 1956. Our journey is a testament to our commitment to excellence. Nestled in the bustling heart of Mumbai, our computerized, state-of-the-art office serves as the nerve center of our operations. At Empresent Global, we transcend borders to redefine the paradigm of overseas manpower recruitment.

Navigating Vast Avenues, Connecting Talents

Distinguished as a leading global manpower recruitment service provider, Empresent Global specializes in sourcing talent across Information Technology, IT enabled services, Civil/Mechanical Construction, Oil & Gas, Petrochemical, Hospitality, Medical, Paramedical, Facility Management, BMS, and Allied Industries. Our global footprint spans United states, key GCC countries, including Qatar, Bahrain, Saudi Arabia, and the UAE, reaffirming our commitment to connect talents with opportunities on an international scale.

Contact the job poster
AS

Ashok Shetty

Recruiter @ Empresent Global, LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs