Overview
On Site
$50 - $55
Accepts corp to corp applications
Contract - W2
No Travel Required
Skills
SQL
ETL
HDFS
Hive
Parquet
Apache spark
Scala
Job Details
Job Title: Spark/Scala Developer
Location: NJ / DE / FL
Job Description:
We are seeking a skilled Scala and Spark Developer to join our data engineering team. The ideal candidate will be responsible for developing, optimizing, and maintaining big data pipelines using Apache Spark and Scala. You will work closely with data scientists, analysts, and other engineers to ensure high-quality data processing solutions that support business intelligence and analytics initiatives.
Key Responsibilities:
Design, develop, and maintain scalable data processing pipelines using Spark and Scala.
Optimize Spark jobs for performance and efficiency.
Integrate data from various sources including structured, semi-structured, and unstructured data.
Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
Ensure data quality and implement robust monitoring and logging.
Requirements:
Strong programming experience in Scala.
Hands-on experience with Apache Spark (batch and streaming).
Familiarity with data storage solutions like HDFS, Hive, or Parquet.
Experience with ETL processes and distributed computing.
Knowledge of SQL and data modeling concepts
We are seeking a skilled Scala and Spark Developer to join our data engineering team. The ideal candidate will be responsible for developing, optimizing, and maintaining big data pipelines using Apache Spark and Scala. You will work closely with data scientists, analysts, and other engineers to ensure high-quality data processing solutions that support business intelligence and analytics initiatives.
Key Responsibilities:
Design, develop, and maintain scalable data processing pipelines using Spark and Scala.
Optimize Spark jobs for performance and efficiency.
Integrate data from various sources including structured, semi-structured, and unstructured data.
Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
Ensure data quality and implement robust monitoring and logging.
Requirements:
Strong programming experience in Scala.
Hands-on experience with Apache Spark (batch and streaming).
Familiarity with data storage solutions like HDFS, Hive, or Parquet.
Experience with ETL processes and distributed computing.
Knowledge of SQL and data modeling concepts
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.