Databricks Platform Engineer

Hybrid in Newark, NJ, US • Posted 6 days ago • Updated 3 hours ago

Contract W2

Contract Independent

On-site

$60 - $75 hr

Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

DATABRICKS PLATFORM ENGINEER
DATABRICKS ADMINISTRATION
CLOUD DATA PLATFORM
DATABRICKS
SPARK
PYTHON
SQL
AWS
AZURE
GCP
CI/CD
TERRAFORM
IAC
DATA SECURITY
IDENTITY MANAGEMENT
NETWORKING

Summary

Job Title: Databricks Platform Engineer

Databricks Platform Engineer Position Summary
We are seeking a skilled Databricks Platform Engineer to design, implement, and maintain our enterprise Databricks environment. This role will focus on enabling scalable data processing, optimizing performance, and ensuring security and compliance across the platform. The ideal candidate will have strong experience with cloud technologies, data engineering principles, and automation practices.

Databricks Platform Engineer Key Responsibilities

Platform Administration & Optimization
1. Deploy, configure, and manage Databricks workspaces, clusters, and jobs.
2. Monitor platform performance and optimize resource utilization.
3. Implement best practices for cost management and scalability.
4. Knowledge of Unity Catalog Implementation
Security & Compliance
1. Configure identity and access management (IAM) for Databricks.
2. Ensure compliance with organizational security standards and data governance policies.
3. Manage secrets, tokens, and secure data access.
Integration & Automation
1. Integrate Databricks with cloud storage, data lakes, and enterprise systems.
2. Automate cluster provisioning, job scheduling, and CI/CD pipelines.
3. Develop reusable scripts and templates for infrastructure as code (IaC).
Collaboration & Support
1. Partner with Data Architecture, Enterprise Architecture, and Enterprise Infrastructure
2. Partner with data engineers, analysts, and data scientists to enable efficient workflows.
3. Provide technical support and troubleshooting for Databricks-related issues.
4. Document platform architecture, processes, and operational guidelines.

Databricks Platform Engineer Required Qualifications

Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience).
3+ years of experience in cloud-based data platforms (AWS, Azure, or Google Cloud Platform).
Hands-on experience with Databricks administration and development.
Strong knowledge of Spark, Python, and SQL.
Familiarity with CI/CD, Terraform, or other IaC tools.
Understanding of data security, networking, and identity management in cloud environments.

Databricks Platform Engineer Preferred Qualifications

Experience with AWS Databricks.
Knowledge of Delta Lake, MLflow, GitHub, and advanced Databricks features.
Exposure to data governance frameworks and compliance standards.
Certifications in Databricks, AWS.

Databricks Platform Engineer Soft Skills

Strong problem-solving and analytical skills.
Excellent communication and collaboration abilities.
Ability to work in a fast-paced, agile environment.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10107170
Position Id: 25-00131
Posted 6 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Databricks Platform Engineer

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs