Overview
Skills
Job Details
Senior Manager, Databricks
Location
Remote
Overview
Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities.
Key Responsibilities
Lead and develop a team of data engineers, platform specialists, or solution architects, setting goals, reviewing progress, and enabling professional growth.
Manage escalations and support operations for Databricks usage, maintaining high availability and strong customer satisfaction.
Define a strategic roadmap for Databricks deployment and usage, aligned with business priorities across Azure, AWS, and Google Cloud Platform.
Architect and maintain cloud data pipelines (batch and streaming) using Spark, SQL, Delta Lake, Kafka, and similar technologies.
Oversee the configuration and tuning of Databricks workspaces, clusters, job workflows, and Unity Catalog for performance and cost efficiency.
Drive automation through infrastructure-as-code (e.g., Terraform, ARM, Cloud Deployment Manager) and CI/CD pipelines (e.g., Azure DevOps, GitHub Actions).
Collaborate cross-functionally with engineering, product, sales, and customer success teams to ensure platform adoption and optimal architecture.
Establish, measure, and improve team and platform KPIs, continuously refining processes and tools.
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or equivalent experience.
At least 3 years in a leadership or managerial role, building and scaling teams.
Deep technical expertise in Databricks, Apache Spark (PySpark/Spark SQL), Delta Lake, Unity Catalog, and data pipeline engineering.
Hands-on experience with multiple public cloud platforms-Azure, AWS, and Google Cloud Platform-covering data services such as ADLS, S3, GCS, EMR, Dataproc, Data Factory, and BigQuery.
Proficient in infrastructure-as-code and CI/CD for data workloads using Terraform, ARM, Azure DevOps, GitHub, or similar tools.
Strong communication, stakeholder engagement, and cross-functional leadership skills.
Preferred Qualifications
Certifications in Databricks (e.g., Data Engineer), AWS, Azure, or Google Cloud Platform.
Experience with data governance, security frameworks, and cost-management tools in cloud environments.
What You'll Achieve
Build and scale a robust, unified data platform across three major public clouds.
Mentor and grow a high-achieving team aligned with enterprise data strategy.
Deliver high-impact outcomes through automation, governance, and cloud optimization.
Shape best-in-class practices for Databricks adoption and platform excellence.
Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.