Data Engineer

  • Atyeti,
  • New York, NY
  • 1 week ago
Apache Spark, SQL Azure, Snow flake schema, Microsoft Windows Azure, Big data, Python, Data warehouse, Apache Kafka
Contract W2, Contract Corp-To-Corp, 1 Years
Depends on Experience

Job Description

Atyeti Recognition:

 

Inc. 500 & 5000 Honoree Company for 2012,2013,2014,2015, 2016 and 2017

Atyeti Ranks No. 270 on the 2012 Inc. 500 List

2012, 2016 and 2017 NJ 50 Fastest Growing Companies

Global Investment Bank is looking to hire a Data Engineer for its team in Newyork, NY location. This is a long term contract role.

Email:

Please contact:

 

REQUIRED SKILLS

•                   Demonstrable experience designing and developing big data applications using Apache Spark and Airflow

•                   Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service

•                   Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.

•                   Experience designing and developing Airflow DAGs, Operators etc…

•                   Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services

•                   Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..

•                   Experience using Cloud data warehouse technologies such as Snowflake is highly desired

•                   Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc..

Dice Id : 10378739
Position Id : 6893355
Originally Posted : 3 months ago
Have a Job? Post it