Title: Enterprise Data Architect with Databricks
Location: Remote
Duration: 12+ Months
The client is seeking a strong Data Architect to be part of their data product development team. It consists of data engineers who can assist to translate business requirements into data products. create efficient data pipelines with reusability, work with product owners and stakeholders to design, develop, and implement data supply chains in enterprise data warehouse environments using Microsoft Azure, ADF, Python, Pyspark, Spark SQL and Databricks environment.
Responsibilities::
Ensure data quality, reliability of data, orchestration of data pipelines, CI/CD implementation, performance and optimization of data pipelines to ensure efficiency, while collaborating with cross-functional teams to integrate data sources and optimize data pipelines.
Also, this engineer must provide technical expertise and support for Azure Databricks-related projects.
Follow technical best practices and coding standards, job orchestration & monitoring, and produce mandatory artifacts.
Requirements:
Bachelor''s degree in computer science, information technology, or a related field.
Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must.
Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines, data management methods.
Advanced Pyspark, Python, Spark SQL, Dimensional models, optimization in Azure, data bricks skills required.
Ability to service various business stakeholders, internal and external partners to support data demands.
Health care experience is desired with a data-centric motive is a plus.
8+ years of experience in data engineering with Azure data bricks ecosystem.
Strong knowledge of Azure data services, including ADF, Databricks, Delta Lake, delta live tables, Power BI, and Azure SQL Server
Experience with data processing languages such as SQL, Python, Pyspark and Spark SQL
Experience with agile methodologies on Azure DevOps and continuous integration/continuous delivery (CI/CD)
Strong problem-solving and analytical skills; excellent communication and collaboration skills
Self-motivated and a self-starter with strong ability to multitask projects/tasks effectively.
Ability to work independently and collaborate effectively in a team environment.
Never miss an opportunity! Create an alert based on the job you applied for.
