Spark/Scala Engineer

Hybrid in Sunnyvale, CA, US • Posted 23 hours ago • Updated 23 hours ago
Contract W2
6 Months
No Travel Required
Hybrid
$50/hr
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Scala
  • Open Source
  • Apache Spark
  • Big Data
  • Software Engineering
  • Scalability

Summary

Description

Responsible for developing and operating big data platform using open source or other solutions to aid critical applications, such as analytics, reporting, and AI/ML apps. This includes working to optimize performance and cost, automate operations, and identifying and resolving production errors and issues to ensure the best data platform experience.

Minimum Qualifications:

  • 5+ years of professional software engineering experience with large-scale big data platforms, including strong programming skills in Java, Scala, Python, or Go.
  • Proven expertise in designing, building, and operating large-scale distributed data processing systems with a strong focus on Apache Spark.
  • Experience with contribution to Open-Source projects is a plus.
  • Hands-on experience with table formats and data lake technologies such as Apache Iceberg, ensuring scalability, reliability, and optimized query performance.
  • Skilled at coding for distributed systems and developing resilient data pipelines.
  • Strong background in incident management, including troubleshooting, root cause analysis, and performance optimization in complex production environments.
  • Proficient with Unix/Linux systems and command-line tools for debugging and operational support.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099677
  • Position Id: 8991709
  • Posted 23 hours ago
Contact the job poster
SD

Srinath Deekonda

Delivery Manager - Recruitment @ Talent Groups
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sunnyvale, California

Today

Easy Apply

Contract

50

Cupertino, California

Today

Full-time

San Jose, California

Today

Full-time

USD 323,000.00 - 428,000.00 per year

Sunnyvale, California

3d ago

Easy Apply

Full-time

Depends on Experience

Search all similar jobs