Databricks & Python Developer

Databricks & Python Developer

Job Summary

We are seeking a skilled Databricks & Python Developer to design, develop, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong experience with Databricks, Python programming, and big data technologies to support data engineering and analytics initiatives.

Key Responsibilities

• Design and develop data pipelines using Databricks and Python

• Build and optimize ETL/ELT workflows for large-scale data processing

• Work with Apache Spark (PySpark) for data transformation and analytics

• Integrate data from multiple sources including databases, APIs, and cloud storage

• Optimize performance, scalability, and reliability of data solutions

• Collaborate with data analysts, data scientists, and business teams

• Ensure data quality, governance, and security best practices

• Troubleshoot and resolve data pipeline and performance issues

Required Skills & Qualifications

• Strong proficiency in Python

• Hands-on experience with Databricks platform

• Solid understanding of Apache Spark / PySpark

• Experience with SQL and data modeling

• Knowledge of cloud platforms (AWS, Azure, or Google Cloud Platform)

• Experience with version control tools like Git

• Familiarity with data warehousing and big data concepts

Preferred Qualifications

• Experience with Delta Lake, Unity Catalog, or MLflow

• Knowledge of CI/CD pipelines for data engineering

• Exposure to data visualization or BI tools

• Experience in Agile/Scrum environments

Education

• Bachelor s degree in Computer Science, Engineering, or related field (or equivalent experience)

Location & Employment Type

• Location: [Onsite / Hybrid / Remote]

• Employment Type: Full-time / Contract