Big Data with Python

  • Jersey City, NJ
  • Posted 4 days ago | Updated 4 days ago

Overview

Hybrid
$60 - $70
Contract - W2
Contract - 18 Month(s)

Skills

Hadoop
Python
PySpark
HDFS

Job Details

Job Description:

Senior developer that will be responsible for building an Analytics platform for the CFO Group within Global Markets Business on the Hadoop infrastructure.
Role Specific Responsibilities:
Responsible for creating a Finance Data Lake on HDFS
Responsible for developing data transfer tools to replicate data from no-sql datastore to the DataLake
Responsible for creating ETL jobs using PySpark
Responsible for building REST web services and APIs that can be used by internal Quantitative team
Participating fully in the development process through the entire software lifecycle.
Participating fully in Agile software development process

6-10 years designing and tuning SQL database tables/queries is required.
Experience with grid computing and high data volume a plus.
Experience with object-oriented database a plus.
Experience doing test-driven development, functional testing and continuous integration is desirable.
Strong written and verbal communications

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Purple Hires