Big Data Developer(9)

big data, cluster, spark, Python
Contract W2, 6 Months
Depends on Experience
Work from home not available Travel not required

Job Description

Immediate need for a talented Senior Big Data Developer for a position in the Mortgage Industry.

This is a 12+ Months contract opportunity with long-term potential and is located in McLean, VA Please review the job description below and contact me ASAP if you are interested.

Job ID: 19-18299

Role: Senior Big Data Developer

Location: McLean, VA

Position: 12+ Months Contract


  • Cleanse, manipulate and analyze large datasets (Structured and Unstructured data XMLs, JSONs, PDFs) using Hadoop platform. o Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
  • Manage and implement data processes (Data Quality reports).
  • Develop data profiling, deduping logic, matching logic for analysis.
  • Programming Languages experience in Python, PySpark and Spark for data ingestion
  • Programming experience in BigData platform using Hadoop platform
  • Present ideas and recommendations on Hadoop and other technologies best use to management

Basic Requirements:

  • 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)

  • 3+ years of programming experience in Python, Spark for data processing and analysis.
  • Strong SQL experience is a must
  • 3+ years of experience using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
  • Detail oriented. Excellent communication skills (verbal and written)

  • Must be able to manage multiple priorities and meet deadlines
  • Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field

Our client is a leading Mortgage organization and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Dice Id : pyrmid
Position Id : 5964656
Have a Job? Post it