Azure Data Engineer

Overview

On Site
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

Python
Azure Databricks
Apache Spark
Azure Data Factory
Azure SQL Microsoft
Azure Synapse Analytics
ETL/ELT Solutions

Job Details

Greetings from WB Solutions....!


We have the Urgent requirement for Azure Data Engineer at Weehawken, NJ - Long-Term Contract.

Role: Azure Data Engineer
Location:
Weehawken, NJ

NOTE: LINKEDIN IS MUST

Main skill: Data Software Engineering

SkillSpec: DSE Python Azure Databricks

Must have skills :

Apache Spark

Azure Data Factory

Azure SQL Microsoft

Azure Synapse Analytics

ETL/ELT Solutions

Nice to have skills :

Apache Kafka

CI/CD

Python

Description: Your Team

Are you an enthusiastic technology professional? Are you excited about seeking an enriching career, working for one of the finest financial institutions in the world? If so, you are the right person for this role. We are seeking technology and domain experts to join our CRM platform development team.
Your Role:
Do you want to design and build next generation business applications using the latest technologies? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you like to
be challenged and encouraged to learn and grow professionally?
Your Expertise:

  • Expert level skills writing and optimizing complex SQL
  • Experience with complex data modeling, ETL design, and using large databases in a business environment
  • Experience with building data pipelines and applications to stream and process datasets at low latencies
  • Fluent with Big Data technologies like Spark, Kafka and Hive
  • Expert level understanding of Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service
  • Designing and building data pipelines using API ingestion and Streaming ingestion methods
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code
  • Experience in developing NoSQL solutions using Azure Cosmos DB
  • Thorough understanding of Azure and AWS Cloud Infrastructure offerings
  • Working knowledge of Python is desirable
  • Key Responsibilities
  • Design and implement scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
  • Manage and optimize data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB
  • Monitor and troubleshoot data-related issues within the Azure environment to maintain high availability and performance
  • Implement data security measures, including encryption, access controls, and auditing, to protect sensitive information
  • Automate data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
  • Utilize Azure analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making Document data procedures, systems, and architectures to maintain clarity and ensure compliance withregulatory standards
  • Provide guidance and support for data governance, including metadata management, data lineage, and data cataloging

Location:

  • Office presence: 5 days a week from Weehawken, NJ

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.