Databricks Tech Lead / Architect with Azure ADLS, ADF, Python and PySpark Expertise (Only G.C / U.S.C)
6+Months
Hybrid
Overview:
Seeking a dynamic Databricks Technical Leader prepared to interface with key business and IT stakeholders, comprehend detailed requirements, and lead the development of robust solutions while managing a technical team.
Key Competencies:
- Demonstrable expertise in Azure Databricks, adept at creating and refining intricate data pipelines, and developing solutions utilizing Delta Lake.
- Solid understanding of Azure Data Lake Storage (ADLS), including its structure, handling of extensive and varied data, and best practices.
- Experienced in crafting and implementing data models and frameworks that integrate data from various primary data stores and systems.
- Proven prowess in delivering high-performance solutions tailored for batch and real-time data processing in Azure.
- Proven success in transforming processes to enhance workflow automation in a cloud setting.
- Proficiency with Azure ecosystem technologies, including ADLS, Azure Data Factory, and Azure Synapse Analytics.
- Dedication to the principles of data governance, ensuring data quality, and optimizing cloud costs.
- Proficient in advanced Python, SQL, and PySpark programming within a Databricks environment.
- Desirable: Knowledge in developing continuous integration/continuous deployment (CI/CD) pipelines and using Databricks Asset Bundles for streamlined deployment.
- Capability to document and curate reusable, well-structured solutions, prioritizing knowledge sharing among team members.
- Openness to working with additional cloud platforms (e.g., AWS, Google Cloud Platform), with a focus on Azure specialization.
Duties:
- Guide and support a development team, conducting validation and maintenance of various applications.
- Engage collaboratively with stakeholders and subject matter experts to synthesize business needs into effective technical solutions compliant with defined criteria.
- Utilize analytical abilities to deconstruct existing systems, outlining the current operational methodologies.
- Act as an innovator, offering technical insights during design discussions to guide solutions and implementation tactics.
- Proficient in the use of project management tools and methodologies.
- Display exceptional problem-solving skills to address complex technical challenges.
Never miss an opportunity! Create an alert based on the job you applied for.
