Lead Azure Databrick Engineer

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Cloud Computing
Microsoft Azure
PySpark
Python
Data Mining
Databricks
Data Modeling

Job Details

****************Individual Contractors (W2/1099) are encouraged to apply. Visa sponsorship is not available for this role at this time************

Role Summary

An Azure Data Engineer is responsible for designing, implementing, and maintaining the data infrastructure within an organization. They collaborate with both business and IT teams to understand stakeholders needs and unlock the full potential of data. They create conceptual and logical data models, analyze structural requirements, and ensure efficient database solutions.

Must Have Skills:

  • Experience of Migrating from other platform to Databricks
  • Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles, Hoslistic vision on the Data Strategy.
  • Proficiency in Data Streaming and Data Modeling
  • Experience in architecting at least two large-scale big data projects
  • Strong understanding of data scaling and its complexities
  • Data Archiving and Purging mechanisms.

Job Requirements

Degree in computer science or equivalent preferred

Demonstrable experience in architecture, design, implementation, and/or support of highly distributed applications with Azure cloud and Databricks.

10+ Years of Hands-on experience with data modelling, database design, data mining, and segmentation techniques.

Working knowledge and experience with "Cloud Architectures" (e.g., SaaS, PaaS, IaaS) and the ability to address the unique security considerations of secure Cloud computing

Should have architected solutions for Cloud environments such as Microsoft Azure and/or Google Cloud Platform

Experience with debugging and performance tuning in distributed environments

Strong analytical skills with the ability to collect, organize, analyse, and broadcast significant amounts of information with attention to detail and accuracy

Experience dealing with structured, unstructured data.

Must have Python, PySpark experience.

Experience in ML or/and graph analysis is a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.