Scala Developer in NYC, NY (Hybrid role)

Hybrid in New York, NY, US • Posted 1 day ago • Updated 7 hours ago
Contract Corp To Corp
Contract Independent
Contract W2
12 Months
No Travel Required
Hybrid
0+
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • Scala
  • Spark SQL
  • DataFrames
  • RDDs
  • Spark
  • Hadoop
  • Hive
  • Kafka
  • HBase
  • Apache
  • AWS
  • Azure
  • GCP
  • Spark Streaming

Summary

Key Responsibilities

  • Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
  • Implement data transformation and ETL workflows to handle structured and unstructured data.
  • Utilize Python for data processing, scripting, and integrating Spark workflows.
  • Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
  • Participate in code reviews, design discussions, and ensure adherence to best practices.
  • Document workflows, architecture, and solutions for internal knowledge sharing.

Required Qualifications

  • Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
  • Proficiency in Python for data manipulation, scripting, and automation.
  • Proven experience with distributed computing concepts and large-scale data processing.
  • Knowledge of ETL development, data warehousing, and data modeling techniques.
  • Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase is a plus.
  • Excellent communication and collaboration skills.

Preferred Qualifications

  • Experience with cloud platforms such as AWS, Google Cloud Platform, or Azure (particularly with Spark services).
  • Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
  • Knowledge of data governance, security, and compliance practices.
  • Basic understanding of machine learning workflows is advantageous.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10518135a
  • Position Id: 9001735
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in New York, New York

Today

Easy Apply

Contract, Third Party

0+

Hybrid in Montreal, Quebec

Today

Easy Apply

Contract, Third Party

0+

Hybrid in Irvine, California

Today

Easy Apply

Full-time

180 - 240

Search all similar jobs