Databricks & Python Developer

Overview

Remote
Depends on Experience
Full Time

Skills

Python
Databricks

Job Details

Hi,

Job Summary

We are seeking a skilled Databricks & Python Developer to design, develop, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong experience with Databricks, Python programming, and big data technologies to support data engineering and analytics initiatives.

Key Responsibilities

  • Design and develop data pipelines using Databricks and Python

  • Build and optimize ETL/ELT workflows for large-scale data processing

  • Work with Apache Spark (PySpark) for data transformation and analytics

  • Integrate data from multiple sources including databases, APIs, and cloud storage

  • Optimize performance, scalability, and reliability of data solutions

  • Collaborate with data analysts, data scientists, and business teams

  • Ensure data quality, governance, and security best practices

  • Troubleshoot and resolve data pipeline and performance issues

Required Skills & Qualifications

  • Strong proficiency in Python

  • Hands-on experience with Databricks platform

  • Solid understanding of Apache Spark / PySpark

  • Experience with SQL and data modeling

  • Knowledge of cloud platforms (AWS, Azure, or Google Cloud Platform)

  • Experience with version control tools like Git

  • Familiarity with data warehousing and big data concepts

Preferred Qualifications

  • Experience with Delta Lake, Unity Catalog, or MLflow

  • Knowledge of CI/CD pipelines for data engineering

  • Exposure to data visualization or BI tools

  • Experience in Agile/Scrum environments

Education

  • Bachelor s degree in Computer Science, Engineering, or related field (or equivalent experience)

Location & Employment Type

  • Location: [Onsite / Hybrid / Remote]

  • Employment Type: Full-time / Contract


If you want, I can also:

  • Shorten this to 5 6 bullet points

  • Make it client-ready for submission

  • Customize it for Azure Databricks, AWS, or Data Engineer vs Analytics Engineer

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.