Overview
Skills
Job Details
Seeking an Azure Data Engineer with strong Databricks expertise to build scalable data pipelines.
Design, develop, and implement high-performance, fault-tolerant data pipelines.
Utilize Azure Data Factory, Databricks (PySpark, SQL), and other Azure data services.
Architect and implement solutions within the Databricks Lakehouse platform (Delta Lake, Databricks SQL).
Develop and optimize ETL/ELT workflows from diverse data sources.
Design efficient data models for data warehousing and analytics.
Implement data quality checks and governance policies.
Performance tune data pipelines and Databricks workloads.
Ensure solutions adhere to Azure cloud architecture and security best practices.
Collaborate with data scientists, analysts, and business stakeholders.
Implement CI/CD pipelines using Azure DevOps for automated deployment.
Requires a Bachelor's degree and 5+ years of data engineering experience with Azure.