Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Skills
Big Data
Python
Pyspark
SQL
Spark
Hadoop
Kafka
AWS
EMR
Databricks
ETL pipelines
Development
streaming scenarios
Cloud Platform
Data quality
Integration
Fault tolerance
Job Details
Job Title: Big Data Developer (Python &Pyspark)
Job Type: Contact
Location: Whippany, NJ(Onsite)
Duration: Contract
Start Date: Immediate
About US At Vilwaa (, we are focused towards delivering IT services and solutions in Data Engineering, Cloud Infrastructure solutions , Digital Application Development, (IoT) - Internet of Things.
Title: Big Data Developer (Python &Pyspark)
Location: Whippany, NJ(Onsite)
Must - Enterprise Financial Services experience required
- We are seeking a Python PySpark Big Data Developer with strong expertise in building scalable data processing solutions using PySpark and Python.
- You will design, develop, and optimize high performance ETL pipelines to process large datasets in distributed environments, ensuring data quality, integration, and fault tolerance.
- This role involves collaborating with data scientists, data engineers, and stakeholders to translate business requirements into robust data workflows
- And implement complex data transformations using Spark, Hadoop, Kafka, or cloud platforms like AWS EMR or Databricks Strong problem solving skills,
- Hands on experience in performance tuning of PySpark jobs, and writing clean, Maintainable Python code for both batch and streaming scenarios are essential.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.