Databricks Data Engineer || 14+ years experience || LinkedIn Must || Remote in Texas(Locals only)

Overview

Remote
Up to $65
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Apache Spark
DataBricks
ETL/ELT
Spark
Azure
CI/CD
Agile
Spark SQL
MLflow
Scikit-learn

Job Details

Role: Databricks Data Engineer
Duration: Long-term contract
Location: Remote
Experience: 14+ years required
Local to Texas Only

Responsibilities:

  • Design & develop scalable data pipelines using Apache Spark on Databricks

  • Implement ETL/ELT workflows for structured & unstructured data

  • Optimize Spark jobs for performance and cost

  • Integrate with Azure Data Factory and other Azure services

  • Automate deployments via CI/CD pipelines

  • Ensure data quality, governance (Unity Catalog, Delta Lake), and security

  • Collaborate with data scientists, analysts, and stakeholders

  • Work in Agile, multicultural teams

Technical Stack:

  • Languages: Python, R, SQL

  • Tools: Databricks, Azure Data Lake, Azure DevOps, Git

  • Cloud: Azure

  • Other: Spark SQL, MLflow (preferred), Scikit-learn (preferred)

Certifications (Preferred):

  • Databricks Certified Associate Developer for Apache Spark

  • Azure Data Engineer Associate


    Thanks
    Bhupesh

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.