Databricks Platform Engineer- Unity Catalog and DevOps

Hybrid in Philadelphia, PA, US • Posted 2 hours ago • Updated 2 hours ago
Contract W2
Contract Independent
12 Months
No Travel Required
Hybrid
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Databricks
  • Unity Catalog
  • CI/CD on Azure DevOps or GitHub Actions

Summary

Databricks Platform Engineer- Unity Catalog and DevOps

Job Type: Contract (6-12 Months) possible extension

Location: Philadelphia, PA  - (Hybrid – Flexible Work Model)

Job description:

Job summary:

  • Program: Consolidation of five legacy data and BI platforms onto Azure Databricks and Power BI
  • We are seeking a platform engineer to build and automate an Azure Databricks environment governed by Unity Catalog.
  • Working under the platform lead, you will configure catalogs and permissions as code, build deployment pipelines, and support data engineering teams as they migrate workloads onto the platform.

Key responsibilities:

  • Configure Unity Catalog objects as code: catalogs, schemas, external locations, storage credentials and grants.
  • Implement access controls, including row filters and column masks, to the lead's design.
  • Build and maintain CI/CD pipelines for platform configuration, pipelines and jobs.
  • Manage repositories, branching and release promotion across environments.
  • Automate workspace, cluster policy and job configuration.
  • Monitor usage, cost and access using Databricks system tables.
  • Troubleshoot access, deployment and integration issues for engineering teams.
  • Write runbooks and support testing and production deployments.

Required qualifications:

  • 5+ years in data platform, DevOps or data engineering roles, including 2+ years on Databricks.
  • 1+ year of hands-on Unity Catalog configuration in a production environment.
  • Terraform, or Databricks Asset Bundles, for deploying Databricks resources.
  • CI/CD on Azure DevOps or GitHub Actions, with Git branching and pull-request workflows.
  • Working Python and SQL.
  • Azure fundamentals: Entra ID, ADLS Gen2, Key Vault.

Preferred qualifications:

  • Experience in financial services or another regulated industry.
  • PySpark, Delta Lake and Lakeflow.
  • Databricks Data Engineer Associate certification.
  • Experience working in an Agile team.
  • AI coding and analysis tools may be used only on endpoints the client has approved.
  • Experience in financial services, wealth management or another regulated industry is strongly preferred.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10367586
  • Position Id: 9143791
  • Posted 2 hours ago

Company Info

About eSolutionsFirst, LLC

eSolutionsFirst is a premier technology and talent solutions partner providing best-in-class IT solutions and staffing services that empower our clients to be market leaders.

We Believe in Consistent, Quality & Transparent Hiring Process.

As a pioneer in talent management since we are proud of bridging the gap between diverse aspiring talent and various visionary organizations. Our people-centric Workforce portfolio spans across to help businesses overcome any talent management challenge. Our experience in serving industry leaders and Fortune500 companies gear us to empower enterprises of any size and industry with our dynamic staffing solutions.

 We Deliver the Promise of Modern Technology.

Our leading-edge capabilities in Cloud, Data, and Security have been fortifying businesses with accelerated digital transformation over years. Our proven methodologies and pragmatic approaches revolutionize IT environments across diverse industries. Through our advisory and end-to-end digital transformation solutions, we encourage companies to establish a “Cloud-First Data-Driven” culture.

 • Over 1,000 man-years of services in IT services.

• Over 100+ software development and management engagements.

• Over 17+ years of advisory services and multiple commercial-grade software products developed.

About_Company_OneAbout_Company_Two
Contact the job poster
GR

Gajendra Ravuru

Recruiter @ eSolutionsFirst, LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.