Hadoop Scala Data Engineer

Hadoop, Scala, Spark, Kafka, Big Data, Analytics, Streaming, Data Pipeline, Algorithms
Full Time
$120,000 - $180,000
Work from home not available Travel not required

Job Description






Title: Big Data Engineer


Location: Cupertino, CA


Type of hire: Full time


 


DESCRIPTION:




Responsibilities:


Participate in design and development of Big Data analytical applications


Design, support and continuously enhance the project code base, continuous integration pipeline, etc.


Write complex ETL processes and frameworks for analytics and data management


Implement large-scale near real-time streaming data processing pipelines


Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale




Requirements:


Strong knowledge of Scala


In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)


Understanding of the best practices in data quality and quality engineering


Experience with version control systems, Git in particular


Desire and ability for quick learning of new tools and technologies.




What will be a plus:


Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)


Experience with Github-based development processes


Experience with JVM build systems (SBT, Maven, Gradle).



Posted By

Abhi Singh

Dice Id : 91074902
Position Id : 5922184
Have a Job? Post it

Similar Positions

Spark Scala Developer
  • Wipro Ltd.
  • Sunnyvale, CA
Big Data Developer
  • Simplion Technologies Inc
  • Sunnyvale, CA
Hadoop / Big Data Developer / Architect - Java / Spark
  • Reliable Software Resources
  • Pleasanton, CA
Senior Data Engineer (Hadoop, Big Data)
  • CyberCoders
  • Los Angeles County, CA
Staff Big Data/Database Engineer
  • Capital Markets Placement
  • Mountain View, CA
Hadoop Developer
  • Softpath System, LLC.
  • San Jose, California
Data Engineer III
  • SPECTRAFORCE TECHNOLOGIES Inc.
  • Menlo Park, CA
Scala/Spark Developers
  • DRS IT Solutions
  • San Jose, CA
Data Engineer
  • Virtusa
  • Mountain View, CA
Big Data Architect/Researcher for Autonomous Car Data Cente
  • OSI Engineering, Inc.
  • Mountain View, CA
Data Engineer (Full Time)
  • Adroit Resources
  • Pleasanton, CA
Data Engineer
  • Mumba Technologies
  • Los Gatos, CA
Sr. Scala Engineer
  • Transamerican Information Systems
  • Sunnyvale, CA