Overview
On Site
Depends on Experience
Contract - W2
Skills
Data engineer
Azure
Devops
Data Factory
Data Fabric
ETL
spark
Job Details
Job Title: Azure Data Engineer
Location: Weehawken, NJ Hybrid
Contract - W2 only
Job Description:
We are looking for a candidate who will be responsible for designing, implementing, and managing data solutions on the Azure platform.
Responsibilities:
- Help us implement our data strategy, design, develop and maintain efficient data pipelines in Azure
- Automate data workflows for both real-time and batch processing
- Integrate data from various sources and sync data to various systems
- Implement data quality checks and ensure data integrity, consistency and reliability
- Help build the required infrastructure and DevOps pipelines
Requirements:
Cloud experience
- Fluent with Azure/ Power platform Data technologies like Data Factory, Data Fabric, Data Lake Storage. SQL Database, Data Explorer, Synapse Analytics, Purview
- Azure Identity management such as AKV, UAMI.
ETL experience
- Fluent with Big Data technologies like Spark, Kafka and Hive,
- Demonstratable knowledge of applying data engineering processes and principles in an Agile environment.
Programming skills/ DevOps
- Experience of setting up CI/CD pipeline like GitLab/Teamcity/Jenkins.
- Other
- Ability to work with analysts and other subject matter experts, in a globally distributed team, to test changes to our trading application suite.
- Prior experience of working in a fast-paced global organization with teams in various geographical locations.
Soft skills
- Ability to work with analysts and other subject matter experts, in a globally distributed team, to test changes to our trading application suite.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.