Big Data Developer (Python PySpark Big Data Developer) - Whippany, NJ

Overview

On Site
$50 - $55
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

Python
PySpark
Big Data Developer

Job Details

This is very high priority, need your support

Python PySpark Big Data Developer

Whippany, NJ

Must - Enterprise Financial Services experience required

We are seeking a Python PySpark Big Data Developer with strong expertise in building scalable data processing solutions using PySpark and Python.

You will design, develop, and optimize high performance ETL pipelines to process large datasets in distributed environments, ensuring data quality, integration, and fault tolerance.

This role involves collaborating with data scientists, data engineers, and stakeholders to translate business requirements into robust data workflows

and implement complex data transformations using Spark, Hadoop, Kafka, or cloud platforms like AWS EMR or Databricks Strong problem solving skills,

hands on experience in performance tuning of PySpark jobs, and writing clean,

maintainable Python code for both batch and streaming scenarios are essential.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.