Overview
On Site
Hybrid
$100,000 - $120,000
Full Time
50% Travel
Skills
Business Intelligence
Azure Cloud
Data Lake
ETL
Python
Developing
Databricks
Job Details
Azure BI Developer
Role Purpose:
We are seeking a highly skilled Azure BI Developer to join our team. The ideal candidate will bring deep expertise in Azure Synapse Analytics, Databricks, Python, PySpark, Azure Data Factory (ADF), and Azure cloud services. In this role, you will be responsible for designing, developing, and maintaining scalable data solutions while ensuring optimal ETL/ELT processing, data governance, and performance optimization.
Job Description
- Design, build, and maintain data pipelines and solutions using Azure technologies.
- Develop and optimize scalable data solutions using Azure Synapse Analytics, Databricks, Python, PySpark, and Azure Data Factory (ADF).
- Design, develop, and maintain ETL/ELT pipelines for efficient data processing and transformation.
- Implement Data Lake architecture and Delta Lake best practices for managing structured and unstructured data.
- Enforce and manage data security, governance, and compliance measures within Azure cloud environments.
- Collaborate with cross-functional teams to integrate data insights and deliver impactful solutions that support business goals.
- Implement Azure DevOps processes for automating CI/CD pipelines to streamline development workflows.
- Leverage expertise in Synapse Analytics for data integration and analytics.
- Work hands-on with Databricks for big data processing, analytics, and machine learning workflows.
- Provide guidance on best practices for performance optimization, monitoring, and troubleshooting.
Skills Required
- Proficiency in Python for data processing, automation, and transformation.
- Extensive experience with PySpark for distributed data processing.
- Strong knowledge of SparkSQL for querying and managing big data.
- Proven hands-on expertise with Azure Synapse Analytics, Databricks, and Azure Data Factory (ADF) for developing ETL/ELT pipelines.
- Strong understanding of Data Lake architecture and Delta Lake principles for managing large-scale data.
- Knowledge of data security, governance, and compliance standards in cloud environments.
- Expertise in Azure DevOps for setting up CI/CD pipelines and automating workflows.
- Experience implementing automated data engineering processes with Azure DevOps.
- 6+ years of experience in Data Engineering, with a strong focus on Azure technologies and cloud-based data solutions.
- Azure certifications (e.g., Azure Data Engineer or Azure AI Engineer Associate) are a plus.
- Ability to work onsite
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.