Big Data Developer

Overview

On Site
Depends on Experience
Contract - W2

Skills

PySpark
Python
Big Data
Apache Spark
Apache Kafka
Apache Hadoop
Bigdata
Hadoop
Hive
Kafka
Databricks
Python code
ETL
Apache Hive
Apache Cassandra
Data Analytics
Data visualization
Data mining
Data storage
Storm
MongoDB
Python API
Big Data Developer
Big Data Engineer
Finance
Financial
Investment
Banking

Job Details

Greeting From Vilwaa

About Us Innovative Solutions for the Digital Age : Powering Business Transformation In the dynamic landscape of the digital age, innovation is the key to unlocking new possibilities and driving transformative change.

Big Data Developer

Whippany NJ

We are seeking a Python PySpark Big Data Developer with strong expertise in building scalable data processing solutions using PySpark and Python.

You will design, develop, and optimize high performance ETL pipelines to process large datasets in distributed environments, ensuring data quality, integration, and fault tolerance.

This role involves collaborating with data scientists, data engineers, and stakeholders to translate business requirements into robust data workflows

and implement complex data transformations using Spark, Hadoop, Kafka, or cloud platforms like AWS EMR or Databricks Strong problem-solving skills,

hands on experience in performance tuning of PySpark jobs, and writing clean,

maintainable Python code for both batch and streaming scenarios are essential.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.