Databricks Senior Manager

Overview

Remote
$175000 - $180000 per annum
Full Time

Skills

Databricks
Azure
AWS
GCP

Job Details



Senior Manager, Databricks


Location


Remote


Overview


Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities.


Key Responsibilities




  • Lead and develop a team of data engineers, platform specialists, or solution architects, setting goals, reviewing progress, and enabling professional growth.




  • Manage escalations and support operations for Databricks usage, maintaining high availability and strong customer satisfaction.




  • Define a strategic roadmap for Databricks deployment and usage, aligned with business priorities across Azure, AWS, and Google Cloud Platform.




  • Architect and maintain cloud data pipelines (batch and streaming) using Spark, SQL, Delta Lake, Kafka, and similar technologies.




  • Oversee the configuration and tuning of Databricks workspaces, clusters, job workflows, and Unity Catalog for performance and cost efficiency.




  • Drive automation through infrastructure-as-code (e.g., Terraform, ARM, Cloud Deployment Manager) and CI/CD pipelines (e.g., Azure DevOps, GitHub Actions).




  • Collaborate cross-functionally with engineering, product, sales, and customer success teams to ensure platform adoption and optimal architecture.




  • Establish, measure, and improve team and platform KPIs, continuously refining processes and tools.




Required Qualifications




  • Bachelor's degree in Computer Science, Engineering, or equivalent experience.




  • At least 3 years in a leadership or managerial role, building and scaling teams.




  • Deep technical expertise in Databricks, Apache Spark (PySpark/Spark SQL), Delta Lake, Unity Catalog, and data pipeline engineering.




  • Hands-on experience with multiple public cloud platforms-Azure, AWS, and Google Cloud Platform-covering data services such as ADLS, S3, GCS, EMR, Dataproc, Data Factory, and BigQuery.




  • Proficient in infrastructure-as-code and CI/CD for data workloads using Terraform, ARM, Azure DevOps, GitHub, or similar tools.




  • Strong communication, stakeholder engagement, and cross-functional leadership skills.




Preferred Qualifications




  • Certifications in Databricks (e.g., Data Engineer), AWS, Azure, or Google Cloud Platform.




  • Experience with data governance, security frameworks, and cost-management tools in cloud environments.




What You'll Achieve




  • Build and scale a robust, unified data platform across three major public clouds.




  • Mentor and grow a high-achieving team aligned with enterprise data strategy.




  • Deliver high-impact outcomes through automation, governance, and cloud optimization.




  • Shape best-in-class practices for Databricks adoption and platform excellence.





Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.