Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
big data
scala
pyspark
Job Details
Big data engineer/developer
12+ months contract
NJ/hybrid
- experience in Big Data Engineering.
- Strong hands-on experience with PySpark or Scala.
- Deep expertise in on-prem Hadoop distributions (Cloudera, Hortonworks, MapR) or cloud-based big data platforms.
- Proficiency in Kafka batch processing, Hive, and Dremio.
- Solid understanding of REST API development using Python frameworks.
- Familiarity with cloud platforms (Google Cloud Platform, AWS, or Azure).
- Experience or exposure to AI and RAG architectures is a plus.
- Excellent problem-solving, communication, and collaboration skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.