Databricks Developer - Mid Level / Lead

Role Description

​A Data bricks developer to design, develop, and maintain Data bricks pipelines

Required Skills

• ​5+ years of managing and administering the Databricks environment, including clusters, workspaces, and notebooks, to ensure optimal performance, reliability, and scalability.
• Write clean, modular Python code for data processing, orchestration, automation, and integration with internal and external systems.
• Implement and tune Spark jobs for performance, reliability, and cost-efficiency, including partitioning, caching, and cluster configuration.
• Admin capabilities to setup infrastructure in cost effective way.
• Configure and optimize Databricks clusters and resources based on workload requirements and best practices.
• Monitor system performance, resource utilization, and availability using Databricks monitoring and logging tools. Preferably Dynatrace.
• Troubleshoot and resolve issues related to Databricks infrastructure, security, and integration with other systems.
• Implement and enforce security best practices to protect data and resources in the Databricks environment, including authentication, authorization, encryption, and data governance.

Nice-to-have Skills

• 2+ plus years of experience in designing, developing, and maintaining business intelligence solutions in Power BI
• Study, analyze and understand business requirements in context to business intelligence.
• Convert business requirements into technical specificities
• Design, develop, and deploy BI solutions such as reporting tools
• Build analysis services reporting models
• Establish row-level data security while comprehending Power BI’s application security layer models.
• Integrate and alter the data while connecting and updating it from different sources.
• Develop dynamic and attracting dashboards and reports using Power BI
• Experience in Retail is desired, not mandatory