Sr Databricks Developer

Role: Senior Databrick Developer/Support Engineer

Experience: 7 10 years

Work Mode: Hybrid (with 5-hour overlap with US EST)

Core Technical Skills:

Databricks Skill Level - Expert

• Solid experience in PySpark for data ingestion, transformation, and cleansing.
• Expertise in Delta Lake, job scheduling, and optimizing Spark jobs.
• Implement New Enhancements and new plant onboarding.
• Experience integrating Databricks with ADF pipelines and Azure Data Lake.
• Knowledge of data validation, logging, and exception handling frameworks.

• ADF Expert Level:
• End-to-end pipeline development, data movement, and orchestration experience.

• ADLS Expert Level:
• Deep knowledge of file structures, partitioning strategies, and access control.

• Azure Medium Level:
• Working experience with Azure Monitor, Key Vault, and automation scripts.

• Power BI Medium Level:
• Experience in data model validation and troubleshooting refresh failures.

Responsibilities

• Design, develop, and maintain ETL/ELT workflows across Databricks and ADF.
• Handle production support issues, ensuring minimal downtime and quick turnaround.
• Work closely with onshore leads for change requests, enhancements, and deployments.
• Automate recurring support activities through scripting and alerts.

Mandatory Skills

PySpark, Delta Lake, ADF, ADLS, Azure DevOps, Data Modeling Concepts, SQL.