Azure Data Engineer with Big Data

  • Posted 14 hours ago | Updated 11 hours ago

Overview

Remote
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Analytics
Apache Hadoop
Apache Hive
Apache Spark
Big Data
Cloud Computing
Cloudera
Data Lake
Data Processing
Databricks
Extract
Transform
Load
Finance
Informatica
Java
Microsoft Azure
NoSQL
Python
Scala

Job Details

Title: Azure Data Engineer with Big Data

Location: Remote

Duration: 6+ Months Contract

Job Description:

  • Senior Azure Data Engineer Investment Banking
  • Design and implement scalable data solutions using ADLS, Azure Synapse Analytics, and Azure Databricks to support high-volume financial data processing and analytics
  • Excellent hands on / programming skills on big data analytics azure cloud & on-prem technologies - spark, python, azure synapse, data factory , azure data bricks.
  • The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
  • Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
  • 10+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Cloudera.
  • 4+ years working experience in Databricks (essential) and Python.
  • Experience with Big Data tech stack, including Hadoop, Java, Spark, Scala, and Hive, NoSQL data stores.
  • Experience building data pipelines and infrastructure.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.