Job Location: Mississauga, ON, Canada
Job Title: Technical Lead - Databricks Engineer
Duration: 12 Months / Fulltime
Target Start Date: ASAP
About the Role
We re looking for a Technical Lead Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You ll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.
Key Skills & Expertise
- Strong hands-on experience with Databricks, including:
- Databricks Notebooks (Python, SQL)
- Unity Catalog for governance & security
- Advanced Databricks performance optimization techniques
- Best practices for cost and compute efficiency
- Proficient in Azure Data Factory (ADF) for orchestrating ETL workflows.
- Excellent programming in Python, with advanced PySpark skills.
- Solid understanding of Apache Spark internals & tuning.
- Expertise in SQL writing complex queries, optimizing joins, working with large datasets.
- Familiar with data warehousing principles & modeling techniques (e.g., star/snowflake schemas).
- Knowledge of Azure data services: Data Lake Storage, Synapse Analytics, SQL Database.
- Experience implementing data governance, access control, and data lineage.
What You ll Do
Strong capability in architecting Databricks environments,and define data modeling strategy, including schema design, data structuring, and pipeline organization.
Design and implement robust, scalable, and efficient data pipelines using Databricks and ADF.
Leverage Unity Catalog to secure and govern sensitive data.
Optimize Databricks jobs & queries for speed, cost, and scalability.
Build and maintain Delta Lake tables and data models suitable for analytics and BI.
Collaborate with stakeholders to define data needs, provide solutions, and deliver business value.
Automate manual workflows, improve reliability, and ensure data quality.
Troubleshoot and monitor pipelines to guarantee uptime and data accuracy.
Mentor junior engineers and foster best practices in Databricks & Azure data engineering.
Preferred Background
- 8 - 10 years in data engineering with a focus on Azure.
- Demonstrated ability to work with large-scale distributed systems.
- Strong communication and teamwork skills.
- Certifications in Databricks and/or Azure Data Engineering are a plus.
Never miss an opportunity! Create an alert based on the job you applied for.
