Overview
Skills
Job Details
Title: Senior Data Warehouse Engineer - Hybrid
Mandatory skills:
Data Engineering,
Azure data ecosystem, Azure Data Lake Storage, Azure Databricks, Azure Data Explorer,
Databricks Data Warehouse, data warehousing principles,
ETL, ELT processes, tools,
Python, SQL, Scala, Java,
data modeling, data access, data storage techniques,
Power BI, Azure ecosystem,
robust data pipelines, transform data, data processes, Databricks Unity Catalog Data Warehouse, data integrity, data governance, data flow, data architecture, data processing
Description:
The client s Server Automation team are currently seeking a highly skilled Data Warehouse Engineer to join our dynamic team. The ideal candidate will be instrumental in designing and implementing robust data pipelines, ensuring the integrity and accessibility of data across our organization.
RESPONSIBILITIES:
Design, build, and maintain efficient and reliable data pipelines to move and transform data (both large and small amounts) within our Azure ecosystem.
Work closely with Azure Data Lake Storage, Azure Databricks, and Azure Data Explorer to manage and optimize data processes.
Develop and maintain scalable ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
Ensure the seamless integration and compatibility of data solutions with Databricks Unity Catalog Data Warehouse and adhere to general data warehousing principles.
Collaborate with data scientists, analysts, and other stakeholders to support data-centric needs.
Implement data governance and quality processes, ensuring data integrity and compliance.
Optimize data flow and collection for cross-functional teams.
Provide technical leadership and mentorship to junior team members.
Stay current with industry trends and developments in data architecture and processing.
REQUIREMENTS:
Bachelor s or master s degree in computer science, Engineering, or a related field.
Minimum of 5 years of experience in a Data Engineering role.
Strong expertise in the Azure data ecosystem, including Azure Data Lake Storage, Azure Databricks, and Azure Data Explorer.
Proficient in Databricks Data Warehouse and a solid understanding of data warehousing principles.
Experience with ETL and ELT processes and tools.
Strong programming skills in languages such as Python, SQL, Scala, or Java.
Experience with data modeling, data access, and data storage techniques.
Ability to work in a fast-paced environment and manage multiple projects simultaneously.
Excellent problem-solving skills and attention to detail.
Strong communication and teamwork skills.
Top 3 skills:
Databricks Data Warehouse and a solid understanding of data warehousing principles
Develop and maintain scalable ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes
Programming skills in languages such as Python, SQL, Scala, or Java - Python and SQL are the most important
Power BI knowledge would be beneficial, but is not a requirement
VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.
Contact Details :
VIVA USA INC.
3601 Algonquin Road, Suite 425
Rolling Meadows, IL 60008