We are seeking an experienced Mid–Senior Databricks Developer with 8–10+ years of industry experience to design, develop, and optimize large-scale data solutions. The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services.
A minimum of a Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field is required.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
Build and optimize Delta Lake architectures and data models.
Develop high-quality, reusable Python code for data processing and automation.
Write and optimize complex SQL queries for large datasets.
Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.
Ensure data quality, reliability, and performance across all data pipelines.
Troubleshoot production issues and perform root-cause analysis.
Follow best practices for version control, CI/CD, and cloud security.
Required Qualifications
Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
8–10+ years of experience in data engineering or software development.
Strong hands-on experience with Databricks, including notebooks, jobs, clusters, and Delta Lake.
Advanced proficiency in Python for data engineering.
Strong expertise in SQL, including performance tuning.
Solid experience with Microsoft Azure cloud services.
Experience working with large-scale distributed data systems.
Strong problem-solving skills and ability to work independently.
Preferred Skills
Experience with CI/CD tools such as Azure DevOps and GitHub Actions.
Knowledge of Spark performance optimization.
Experience with data governance and security frameworks.
Familiarity with Agile methodologies.
Never miss an opportunity! Create an alert based on the job you applied for.
