Data Engineer (Scala & Spark)

Overview

Hybrid
$60 - $70
Contract - W2
Contract - 12 Month(s)
50% Travel

Skills

Apache Spark
Scala
HDFS
Hive
Kafka
HBase

Job Details

Job Title: Sr. Data Engineer

Location: Atlanta, GA (Hybrid Onsite)

Client: Financial Services (Direct)

W2/Fulltime

Key Responsibilities:

  • Design and implement high-performance data pipelines using Apache Spark and Scala.
  • Optimize Spark jobs for efficiency, scalability, and reliability.
  • Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.
  • Monitor, troubleshoot, and maintain production data pipelines to ensure seamless operations.
  • Create and maintain comprehensive documentation for all data systems and processes.

Required Skills & Qualifications:

  • 5+ years of hands-on experience with Apache Spark and Scala.
  • Strong understanding of distributed computing concepts and Spark internals.
  • Experience with Big Data ecosystems including HDFS, Hive, Kafka, and HBase.
  • Proven ability to write optimized, maintainable Spark jobs using Scala.
  • Strong problem-solving and analytical skills, with a focus on data-driven solutions.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Xoriant Corporation