Greetings from Sight Spectrum,
This is regarding an Immediate Job opportunity for Big Data Engineer / SPARK - NYC, NY and should have strong skills in the following areas. If you are interested, please revert along with below details and recommend your friends also.
Role: Big Data Engineer / SPARK
Location: NYC, NY
Job Type: Contract
Duration: 6+ months
Job Summary :
Spark,Scala, Python AWS Redshift Oracle PLSQL TSQL SQL SERVER HTML and CSS 1) Work with stakeholders including the Executive, Product, Data / Solution Architect and Design teams to assist with data-related technical issues and support validating data infrastructure needs
2) Experience 8 Plus years with skill set expanding from extensive usage of Spark Python AWS Redshift Oracle PLSQL TSQL SQL SERVER HTML and CSS
3) Strong expertise in Oracle Database SQL PLSQL and TSQL Hive MongoDB Hadoop AWS stack and Dockers
4) Assemble large, complex data sets that meet functional / non-functional business requirements. 5) Build the data pipeline required or use existing one for optimal extraction, transformation, and loading of data from multiple sources (SQL/Python) to target (Hadoop / Hive) 6) Have the ability to leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver solutions using PySpark, Dataframes, Python, Hive and other tools/frameworks available in and around the Hadoop ecosystem
7) Build the infrastructure required for optimal extraction transformation and loading of data from multiple sources to target Hadoop Hive
8) Experience implementing complex data analytics and transformations with PySpark/Spark(Scala/Java). 9) Demonstrate notion of software design principles and the protocols involved in the software delivery lifecycle.
10) Experience working on scrum methodologies like Agile and/or Kanban
Thanks & Regards,