Hadoop Scala Data Engineer

Hadoop, Scala, Spark, Kafka, Big Data, Analytics, Streaming, Data Pipeline, Algorithms
Full Time
$120,000 - $180,000
Work from home not available Travel not required

Job Description

Title: Big Data Engineer

Location: Cupertino, CA

Type of hire: Full time




Participate in design and development of Big Data analytical applications

Design, support and continuously enhance the project code base, continuous integration pipeline, etc.

Write complex ETL processes and frameworks for analytics and data management

Implement large-scale near real-time streaming data processing pipelines

Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale


Strong knowledge of Scala

In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)

Understanding of the best practices in data quality and quality engineering

Experience with version control systems, Git in particular

Desire and ability for quick learning of new tools and technologies.

What will be a plus:

Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)

Experience with Github-based development processes

Experience with JVM build systems (SBT, Maven, Gradle).

Posted By

Abhi Singh

Dice Id : 91074902
Position Id : 5922184
Originally Posted : 6 months ago
Have a Job? Post it

Similar Positions

Big Data Engineer
  • Grid Dynamics International, Inc.
  • Milpitas, CA
Data Engineer
  • Flexton Inc
  • Sunnyvale, CA
Big data Developer
  • Nityo Infotech Corporation
  • Pleasanton, CA
Data Engineer
  • Droisys
  • Santa Clara, CA
Data Engineer
  • DRS IT Solutions
  • Sunnyvale, CA
Big Data Engineers
  • BayOne Solutions
  • Sunnyvale, CA
Data Engineer
  • TriOptus
  • Sunnyvale, CA
Scala Big Data Engineer
  • Staffing Headquarters LLC.
  • Sunnyvale, CA
Senior Software Data Engineer
  • Humana
  • Campbell, CA
Data Engineer AWS or Big Data
  • InterSources Inc.
  • Mountain View, CA
Big Data Engineer
  • Red Oak Technologies, Inc.
  • Cupertino, CA
Big Data (Kafka/Spark) Developer
  • Quantiphi Inc.
  • Santa Clara, CA