Overview
Full Time
Contract - W2
Contract - 6+ month(s)
Skills
Azure
Databricks
Job Details
Job Description:
We are looking for a skilled and experienced Azure Databricks Engineer to join our team and contribute to the design, development, and deployment of scalable big data pipelines and analytics solutions using Azure Databricks. The ideal candidate will have strong experience in cloud data engineering and hands-on expertise with Azure Data Services.
Key Responsibilities:
- Design and develop scalable data pipelines using Azure Databricks, Apache Spark, and Delta Lake.
- Collaborate with data scientists, analysts, and business stakeholders to implement efficient data processing workflows.
- Optimize performance of ETL/ELT jobs and ensure data quality and consistency.
- Integrate Databricks with other Azure services including Data Factory, Data Lake Storage, Synapse Analytics, and Key Vault.
- Develop reusable code components, libraries, and frameworks for consistent data pipeline development.
- Troubleshoot and resolve performance issues, system errors, and data-related concerns.
- Ensure security and compliance requirements are met throughout the data lifecycle.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.