Big Data Engineer / SPARK - NYC, NY

Big data, Hadoop, Hive, Spark, Scala, Python, AWS, Redshift, Oracle, PLSQL, TSQL, SQL SERVER, HTML and CSS
Contract W2, Contract Independent, Contract Corp-To-Corp, 6 Months
Depends on Experience
Travel not required

Job Description

Hi,       

 

Greetings from Sight Spectrum,

 

This is regarding an Immediate Job opportunity for Big Data Engineer / SPARK - NYC, NY and should have strong skills in the following areas. If you are interested, please revert along with below details and recommend your friends also.

 

Role: Big Data Engineer / SPARK 

Location: NYC, NY

Job Type: Contract

Duration: 6+ months

 

 

Job Summary :

  1. Spark,Scala, Python AWS Redshift Oracle PLSQL TSQL SQL SERVER HTML and CSS 1) Work with stakeholders including the Executive, Product, Data / Solution Architect and Design teams to assist with data-related technical issues and support validating data infrastructure needs
    2) Experience 8 Plus years with skill set expanding from extensive usage of Spark Python AWS Redshift Oracle PLSQL TSQL SQL SERVER HTML and CSS
    3) Strong expertise in Oracle Database SQL PLSQL and TSQL Hive MongoDB Hadoop AWS stack and Dockers
    4) Assemble large, complex data sets that meet functional / non-functional business requirements. 5) Build the data pipeline required or use existing one for optimal extraction, transformation, and loading of data from multiple sources (SQL/Python) to target (Hadoop / Hive) 6) Have the ability to leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver solutions using PySpark, Dataframes, Python, Hive and other tools/frameworks available in and around the Hadoop ecosystem
    7) Build the infrastructure required for optimal extraction transformation and loading of data from multiple sources to target Hadoop Hive
    8) Experience implementing complex data analytics and transformations with PySpark/Spark(Scala/Java). 9) Demonstrate notion of software design principles and the protocols involved in the software delivery lifecycle.
    10) Experience working on scrum methodologies like Agile and/or Kanban

Thanks & Regards,

Saravanan P

Dice Id : 91094181
Position Id : SHA210912
Originally Posted : 1 month ago
Have a Job? Post it

Similar Positions

Sr. Bigdata developer
  • Caprus IT Inc.
  • New York, NY, USA
Big data engineer - NYC, NY
  • Syeta Inc
  • New York, NY, USA
Data Engineer
  • Princeton IT Services
  • New York, NY, USA
Big Data Engineer
  • CV Project LLC
  • New York, NY, USA
Big Data Engineer
  • P2PSoftTek Inc
  • New York, NY, USA
Big Data Engineer - NYC (Remote intially) 10+yrs
  • Pioneer Consulting Services LLC
  • New York, NY, USA
Big Data Lead - 6 months RTH
  • Contech Systems Online
  • Newark, NJ, USA
BigData engineer
  • Cyma Systems Inc
  • New York, NY, USA
Java Scala Developer
  • Acclive Inc.
  • New York, NY, USA