Big Data Engineer (Spark/Scala)

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 6 Month(s)

Skills

Big Data
Spark
Scala
SQL
Kafka
Python
AWS

Job Details

Job Title: Big Data Engineer (Spark/Scala)
Location: Sunnyvale, CA or Austin, TX
Duration: 6 Months

Responsibilities

Technical:

  • Develop and implement scalable solutions using Spark, Scala, and Big Data Hadoop.
  • Manage system integrations, optimize data pipelines, and provide technical support.

Functional:

  • Gather and analyze business requirements, and design functional specifications.
  • Streamline business processes, conduct system testing, and deliver user training.
  • Collaborate with both business stakeholders and technical teams to align solutions with business goals.

Skills & Qualifications

Technical:

  • Strong hands-on experience in Spark, Scala, SQL (basic & advanced), Kafka, Cassandra, and Spark Streaming.
  • Knowledge of Python and Unix Shell Scripting.
  • AWS experience is a plus.

Functional:

  • Expertise in business process mapping, requirements gathering, and functional specification creation.
  • Strong communication and problem-solving skills.
  • Familiarity with Agile development methodologies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Black Rock Group