Big Data PySpark Developer

New York City, NY, US • Posted 1 day ago • Updated 16 minutes ago
Contract W2
Contract Independent
50% Travel Required
On-site
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Python
  • Hadoop
  • PYSPARK

Summary

Job Title: Big Data PySpark Developer

Location: New York - NY

Duration: Long term

Tax Term: W2

Job description

Experience Required

  • 10+ years of experience in Big Data development
  • Strong Python and PySpark expertise
  • Experience with Hadoop ecosystem
  • Spark SQL, Hive, HiveQL
  • Kafka and data pipeline development
  • Strong SQL skills
  • Unix/Linux environment
  • Software Development Life Cycle (SDLC)
  • Design, coding, unit testing, debugging, and deployment
  • Ability to work independently and within Agile teams

Responsibilities

  • Design, build, and deploy Big Data solutions
  • Develop scalable data processing applications using PySpark
  • Create and optimize Spark/Hive jobs
  • Work with large-scale datasets
  • Follow architecture, testing, and coding standards
  • Troubleshoot production issues
  • Collaborate with business and technical stakeholders. Deliver high-quality code with minimal defects
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90696805
  • Position Id: 2026-5726
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

New York, New York

16d ago

Easy Apply

Full-time

Depends on Experience

Jersey City, New Jersey

6d ago

Easy Apply

Full-time

$120,000 - $130,000

New York, New York

Yesterday

Easy Apply

Contract

$60 - $70

New York, New York

Yesterday

Full-time

USD 120,000.00 - 135,000.00 per year

Search all similar jobs