Azure Data Engineer

Overview

On Site
Full Time

Skills

Emerging technologies
Data collection
Software design
Microsoft Azure
Unit testing
Continuous integration
Data warehouse
Real-time
Cosmos-Db
Microsoft SSAS
Big data
Data
HTC
Collaboration
Insurance
Database
Storage
Reporting
Analytics
Python
SQL
NoSQL
Scala
Apache Spark
Databricks
ARM
Analytical skill
Design
Presentations
Communication

Job Details

HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies.

At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.

Job Description:

In your role as an Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.

Responsibilities

  • 10+ Years of Data Experinece with Data Bricks experience is required.
  • Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
  • Develop and maintain innovative Azure solutions
  • Solution design using Microsoft Azure services and other tools
  • The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
  • Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
  • Build data pipelines to collectively bring together data
  • Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse

Tech Stack

  • Python
  • SQL and NoSQL databases
  • Scala
  • Spark-SQL
  • Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates

Qualifications

  • Previous experience as an Azure Data Engineer or similar role
  • Experience building and optimising big data data pipelines, architectures, and data sets
  • Strong analytic skills related to working with unstructured datasets
  • The ability to design and implement well written code
  • Ability to work to tight deadlines
  • Ability to test the data from source to the presentation layer
  • Ability to support/troubleshoot data pipelines
  • Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency

About HTC Global Services