Inc. 500 & 5000 Honoree Company for 2012,2013,2014,2015, 2016 and 2017
Atyeti Ranks No. 270 on the 2012 Inc. 500 List
2012, 2016 and 2017 NJ 50 Fastest Growing Companies
Global Investment Bank is looking to hire a Data Engineer for its team in Newyork, NY location. This is a long term contract role.
• Demonstrable experience designing and developing big data applications using Apache Spark and Airflow
• Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service
• Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.
• Experience designing and developing Airflow DAGs, Operators etc…
• Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services
• Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..
• Experience using Cloud data warehouse technologies such as Snowflake is highly desired
• Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc..