Databricks Platform Manager/Engineer
Full Time
No Travel Required
Hybrid
$50 - $55/hr
Prama Innovations India Pvt. Ltd.
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- databricks
- Unity Catalog
- AWS
- Terraform
Summary
Job Title: Databricks Platform Manager/Engineer
Location: NY (Hybrid Onsite)
Type: Contract
Job Summary
We are looking for a Databricks Platform Manager/Engineer with strong hands-on experience administering enterprise Databricks environments on AWS. The role focuses on platform administration, workspace and cluster management, Unity Catalog, AWS IAM, security/governance, Terraform/IaC, CI/CD, monitoring, and cost optimization. Ideal candidates will have 3–5+ years of production Databricks platform administration experience and a strong AWS/cloud infrastructure background.
Key Responsibilities
- Administer and support Databricks workspaces across Dev, Test, UAT, and Production.
- Manage clusters, cluster policies, instance pools, job clusters, and Databricks Runtime upgrades.
- Administer Unity Catalog, catalogs, schemas, permissions, and RBAC.
- Manage AWS IAM integration, SSO, service principals, secrets, and access controls.
- Implement and support Terraform/IaC and CI/CD for Databricks platform deployments.
- Manage Git/Databricks Repos and automated deployment processes.
- Monitor platform health, performance, jobs, clusters, and production environments.
- Troubleshoot platform issues, incidents, and performance problems.
- Support audit logging, security, governance, and compliance requirements.
- Identify opportunities for Databricks and AWS cost optimization.
- Partner with Data Engineering, DevOps, Cloud, Security, and Infrastructure teams.
Required Skills
- Strong hands-on Databricks Platform Administration
- Databricks Workspace Management
- Cluster Management & Cluster Policies
- Unity Catalog
- Databricks Runtime
- Service Principals, Secrets & PATs
- AWS IAM
- AWS S3, VPC, EC2, KMS, Security Groups
- Terraform / Infrastructure as Code
- Git and CI/CD
- Azure DevOps, GitHub Actions, or Jenkins
- Platform Monitoring & Troubleshooting
- Production Support
- Cost Optimization
Preferred
- Experience supporting enterprise Databricks environments with 100+ users
- Experience with AWS PrivateLink / VPC Endpoints
- AWS Organizations / Control Tower
- CloudWatch, Datadog, or Splunk
- Delta Lake / Lakehouse architecture
- Exposure to Spark internals
- Experience supporting Databricks AI/ML workloads
- Databricks or AWS certifications
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91175551
- Position Id: 9063589
- Posted 12 hours ago
Company Info
Prama is a technology company that builds AI, Data, Cloud, and Platform solutions for organizations that want to transform how they operate, decide, and serve their customers.
We engineer secure, scalable, and intelligent systems that move enterprises from reactive processes to predictive, automated decision-making.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs