Data Engineer

Depends on Experience

Contract: Corp-To-Corp, W2, 1 Year(s)

    Skills

    • Apache Spark
    • SQL Azure
    • Snow flake schema
    • Microsoft Windows Azure
    • Big data
    • Python
    • Data warehouse
    • Apache Kafka

    Job Description

    Atyeti Recognition:

     

    Inc. 500 & 5000 Honoree Company for 2012,2013,2014,2015, 2016 and 2017

    Atyeti Ranks No. 270 on the 2012 Inc. 500 List

    2012, 2016 and 2017 NJ 50 Fastest Growing Companies

    Global Investment Bank is looking to hire a Data Engineer for its team in Newyork, NY location. This is a long term contract role.

    Email:

    Please contact:

     

    REQUIRED SKILLS

    •                   Demonstrable experience designing and developing big data applications using Apache Spark and Airflow

    •                   Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service

    •                   Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.

    •                   Experience designing and developing Airflow DAGs, Operators etc…

    •                   Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services

    •                   Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..

    •                   Experience using Cloud data warehouse technologies such as Snowflake is highly desired

    •                   Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc..