Role: Azure Data Engineer
Location: Pittsburgh, PA 15219 _ Remote
Duration: Long term _ On W2
Please share the resume at
Must Have Skills: Azure databricks, ADF admin
Nice to have skills: Power Apps Admin
Detailed Job Description:
10+ years of experience in IT, data or digital roles, with 5+ years focused on Databricks and Azure administration
Hands-on experience administering Azure Databricks or Azure ADF, including workspace provisioning, cluster configuration, job management, and access control.
Experience with Identity and Access Management (IAM), Unity Catalog, secret scopes, audit logging, and network/security configuration within Databricks.
Experience managing large-scale data processing environments, optimizing compute usage, and supporting mission-critical data pipelines.
Preferred:
Strong understanding of Spark, Delta Lake, and Databricks workspace architecture.
Experience with CI/CD for Databricks, including tools such as Azure DevOps, GitHub Actions, or Jenkins.
Working knowledge of cloud platforms (Azure/AWS/Google Cloud Platform), including networking concepts like VNETs, private endpoints, and firewalls.
Ability to troubleshoot performance, cluster stability, and job execution issues within Databricks.