DATABRICKS CONSULTANT

Overview

On Site
USD 65.00 - 75.00 per hour
Contract - Independent

Skills

Palo Alto
Management
Data Lake
Innovation
Research
Provisioning
Epic
Workday
HL7
Data Integration
Modeling
Master Data Management
Cloud Security
Auditing
Collaboration
Documentation
Training
Databricks
SQL Azure
Storage
Terraform
ARM
Extract
Transform
Load
Cloud Computing
Database
Microsoft Azure
DevOps
Git
Continuous Integration
Continuous Delivery
Workflow
Data Security
Regulatory Compliance
Communication
Presentations
Stakeholder Engagement
Python
PySpark
SQL
R
Scala
Job Boards
LinkedIn
Privacy
Marketing

Job Details

Location: Palo Alto, CA
Salary: $65.00 USD Hourly - $75.00 USD Hourly
Description: Our client is currently seeking a DATABRICKS CONSULTANT

Job Title: Azure/Databricks Engineer
Location: Hybrid - Onsite in Stanford, CA (2-3 days/week initially), with flexibility for remote work over time
Contract Type: Contract-to-Hire (6 months)

Position Overview

We're seeking a mid-level Azure/Databricks Engineer with 3-5 years of enterprise experience to support the design, implementation, and management of a secure, scalable cloud data platform. This role is ideal for someone with a strong foundation in Azure, Databricks, and DevOps practices, who thrives in collaborative environments and is passionate about automation and data operations.

The position will begin with a hybrid schedule (onsite in Stanford, CA a few days per week) and transition to more remote flexibility over time. Local candidates are strongly preferred.

Key Responsibilities
  • Cloud Data Platform Development:
    Design and manage enterprise data lake environments on Azure using Databricks and other cloud technologies.
  • Sandbox Environment Creation:
    Build secure sandbox/enclave environments for innovation and research without impacting production systems.
  • Infrastructure-as-Code (IaC):
    Automate cloud resource provisioning using Terraform, ARM templates, or Bicep.
  • Data Pipeline & ETL Development:
    Build scalable data pipelines and optimize ETL processes for high-quality data ingestion from diverse sources (e.g., Epic, Workday, HL7, FHIR, RTLS).
  • Data Integration & Modeling:
    Collaborate with teams to integrate data into conformed models (OMOP, Master Data, custom models).
  • Security & Compliance:
    Implement best practices for cloud security and ensure compliance with audit and FinOps requirements.
  • Cross-Functional Collaboration:
    Work closely with data scientists, developers, and product managers to deliver tailored solutions. Lead meetings on platform enhancements and compliance.
  • Documentation & Training:
    Create clear documentation and conduct training sessions on platform usage and security protocols.


Required Skills & Experience
  • 3-5 years of enterprise experience in cloud engineering or data operations
  • Strong hands-on experience with Azure services: Databricks, Data Factory, Azure SQL, Azure Storage
  • Proficiency in infrastructure-as-code tools: Terraform, ARM templates, Bicep
  • Experience with ETL processes, data pipeline development, and cloud database services
  • Familiarity with DevOps tools: Azure DevOps, Git
  • Solid understanding of CI/CD pipelines and production deployment workflows
  • Knowledge of data security best practices and compliance standards
  • Strong communication skills for technical presentations and stakeholder engagement
  • Programming proficiency in Python, PySpark, SQL, R, or Scala


Let me know if you'd like a version tailored for a job board, internal HR system, or formatted for LinkedIn!

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Judge Group, Inc.