Sr. Azure Databricks Data Engineer / Lead / Manager (Only G.C / U.S.C)
6+Months
Hybrid
Core Responsibilities:
- In-depth, practical knowledge of Azure Databricks, including the construction, enhancement, and fine-tuning of intricate data processing architectures and Delta Lake infrastructures.
- Solid foundational understanding of Azure Data Lake Storage (ADLS), encompassing its structure, established methodologies, and the effective treatment of extensive and varied data stores.
- Prior involvement in the design and deployment of data architectures and convergence hubs, enabling seamless data amalgamation from multiple Operational Data Stores (ODS) and assorted origin systems.
- Proven ability to deliver robust, high-performance solutions for both queued and real-time data processing demands on the Azure platform.
- Demonstrated history of elevating procedural efficiencies—focusing on notable enhancements of automation procedures within cloud-based frameworks.
- Proficiency with various Azure services, including but not limited to ADLS, Azure Data Factory, and Azure Synapse Analytics.
- Dedication to the principles of data stewardship, integrity management, and the frugal consumption of cloud-resources.
- Expert-level programming abilities in Python, SQL, and PySpark, specifically within the Databricks setting.
Desirable Skills:
- Background in developing Continuous Integration/Continuous Delivery (CI/CD) frameworks and the application of Databricks Asset Bundles for streamlined deployment and change management.
- Aptitude for crafting thoroughly elucidated, repeatable solutions and promoting the dispersion of knowledge across the team.
- Exposure to other cloud service platforms such as AWS and Google Cloud Platform is beneficial; however, extensive mastery of Azure is crucial.
Never miss an opportunity! Create an alert based on the job you applied for.
