Job Role: (Data Engineer) Data bricks developer
Location: Remote
Role Description
A Data bricks developer to design, develop, and maintain Data bricks pipelines
Required Skills
5+ years of managing and administering the Databricks environment, including clusters, workspaces, and notebooks, to ensure optimal performance, reliability, and scalability.
Write clean, modular Python code for data processing, orchestration, automation, and integration with internal and external systems.
Implement and tune Spark jobs for performance, reliability, and cost-efficiency, including partitioning, caching, and cluster configuration.
Admin capabilities to setup infrastructure in cost effective way.
Configure and optimize Databricks clusters and resources based on workload requirements and best practices.
Monitor system performance, resource utilization, and availability using Databricks monitoring and logging tools. Preferably Dynatrace.
Troubleshoot and resolve issues related to Databricks infrastructure, security, and integration with other systems.
Implement and enforce security best practices to protect data and resources in the Databricks environment, including authentication, authorization, encryption, and data governance.
Thanks & Regards,
Shilpa
US IT Recruiter
TekLeaders Inc
5151 Headquarters Dr. Suite 105
Plano TX 75024
Mob:
Email:
tekleaders.com
Never miss an opportunity! Create an alert based on the job you applied for.
