Data Engineer (Azure, Python)

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Contract - 6 Month(s)
Unable to Provide Sponsorship

Skills

Python
PySpark
Azure cloud
data factory
API Gateway
SQL
databricks
DevOps

Job Details

Role Description

We are seeking experienced software Data engineers spread across Charlotte (N.C) and Jersey City (N.J), with 10+ years of relevant experience to support the design and development of a strategic data platform for investment bank.

Role Objectives

These roles will be part of the Data Strategy team spanning across the Capital Markets and securities teams, broker-dealer and swap-dealer entities.

These roles will be involved in the active development of the data platform in close coordination with the client team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.

The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.

The implementation of this strategic platform on Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

10+ years of experience in software development using Python, PySpark and its frameworks.

Proven experience as a Data Engineer with experience in Azure cloud.

Experience implementing solutions using -

Azure cloud services

Azure Data Factory

Azure Lake Gen 2

Azure Databases

Azure Data Fabric

API Gateway management

Azure Functions

Well versed with Azure Databricks

Strong SQL skills with RDMS or noSQL databases

Experience with developing API s using FastAPI or similar frameworks in Python

Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes

Good understanding of ETL/ELT processes

Experience in financial services industry, financial instruments, asset classes and market data are a plus.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.