Lead Azure Data Engineer

Overview

Remote
Up to $160,000
Full Time

Skills

azure databricks
databricks
data factories
delta lake
sql
etl
power bi
Azure
Azure SQL
Data Lakes
data warehouse
database design
python
version control
MS SQL

Job Details

Are you ready to be a part of a game-changing transformation in the logistics industry? Our client is revolutionizing the way things are done in multiple marketplaces with their strategic and process-driven logistics solutions. They are on the lookout for a Lead Azure Data Engineer to quarterback their team and help propel their business to new heights through data-driven insights. This is a fully remote position.

As the Lead Azure Data Engineer, you will have the opportunity to work with a complex and robust database migrating to Azure Cloud and wear multiple hats in the process. The client is looking for someone who is detail-oriented, can voice their opinions and needs, and is a self-starter with problem-solving skills. Not only will you act as a senior engineer, but you will be expected to take ownership of complex projects, design mature technical solutions, and provide mentorship to junior staff as the team continues to grow.

The ideal candidate will have the following qualifications:

  • 5+ years of architecture and development within Azure Databricks
  • 7+ years of expertise in Azure enviornments (Data Lakes, Databricks, anddata factories)
  • 7+ years of experience with hands-on ETL/ELT development
  • Experience in designing, developing, and architecting MS SQL Database and Azure SQL Database
  • Strong validation and version control skills
  • Expertise in writing complex SQL scripts from scratch
  • Development experience with PowerBI
  • Proven project experience with data warehouse build-out projects
  • Experience automating CI/CD pipelines
  • Project experience building a data warehouse using Databricks
  • Hands on experience with Notebooks (python/pyspark)
  • Proven experience working with stake-holders to understand business needs
  • Experience in designing and developing, table designs, and custom data models based off of business needs.
  • Experience in engineering, developing, and building out database features and solutions
  • Understanding of database indexes and implementation of database structures
  • Familiarity with database design best practices
  • Experience with backups, restores, and recovery models
  • Participation in the full project life cycle, including requirement gathering, development/build, and go-live
  • Ability to problem solve while managing a multitude of tasks
  • Willingness to mentor junior engineers

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.