Databricks Admin with AWS

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)

Skills

ELT
Apache Spark
SQL
Amazon Web Services
Terraform

Job Details

Responsibilities:

  • Databricks Platform Infrastructure: Design, build, and maintain data infrastructure on the Databricks Platform, including Spark and Databricks SQL.
  • Data Team Enablement: Provide technical expertise and support to Data Scientists, Data Engineers, and Analysts, enabling them to effectively utilize the Databricks platform.
  • Performance Optimization: Optimize Databricks workloads for performance, scalability, and cost efficiency.
  • Infrastructure as Code (IaC): Implement and manage infrastructure using IaC tools such as Terraform or CloudFormation.
  • Security and Governance: Implement and maintain security and governance best practices for the Databricks platform.
  • Monitoring and Troubleshooting: Monitor the health and performance of the Databricks infrastructure and troubleshoot and resolve technical issues.
  • Best Practices: Develop and document best practices for Databricks platform management.

Minimum Qualifications:

  • Extensive hands-on experience with the Databricks Platform, including Delta Lake, Spark, and Databricks SQL.
  • Proven experience in building and maintaining cloud-based data infrastructure, preferably on AWS.
  • Strong understanding of data warehousing, data lake, and data engineering concepts.
  • Demonstrated experience supporting Data Scientists, Data Engineers, and Analysts.
  • Proficiency in Infrastructure as Code (IaC) tools. Preferably Terraform.
  • Experience with data pipelines, ETL/ELT processes, and data modeling.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.