Overview
On Site
USD 65.00 - 75.00 per hour
Full Time
Skills
Access control
Technical Support
Issue resolution
Disaster recovery
Data integrity
Data warehouse
Computer science
Data engineering
Apache Spark
Databricks
System integration testing
Terraform
ProVision
Amazon Web Services
Management
Policies
Data
Training
Encryption
Regulatory Compliance
Backup
Collaboration
Documentation
HCL
SQL
Python
gitlab
Continuous integration
Continuous delivery
Machine Learning Operations (ML Ops)
Cloud computing
Energy
Job Details
Location: Denver, CO
Salary: $65.00 USD Hourly - $75.00 USD Hourly
Description: Our client is currently seeking a Databricks Platform Engineer
This role is hybrid and can sit in Denver, CO or Minneapolis, MN
Responsibilities:
Qualifications:
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Salary: $65.00 USD Hourly - $75.00 USD Hourly
Description: Our client is currently seeking a Databricks Platform Engineer
This role is hybrid and can sit in Denver, CO or Minneapolis, MN
Responsibilities:
- Configure, deploy and maintain Databricks clusters and workspaces.
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
- Ensure consistency and repeatability by treating infrastructure as code, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Manage platform feature and software releases and updates.
- Provide technical support to Databricks users, including troubleshooting and issue resolution.
- Conduct training sessions to educate users on platform best practices and capabilities.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Monitor and manage platform costs, including optimizing resource utilization to control expenses.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions.
Qualifications:
- Bachelor's degree in a relevant field (computer science, data engineering, etc.)
- 7+ years of related professional experience.
- 3 years' experience with Databricks Lakehouse Platform Architecture on AWS
- Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps Proficiency in AWS cloud platforms
- Experience in Utility and Energy related business is a plus.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!