Streaming Data Engineer Spark streaming, Flink and Kafka *** Urgent requirement ***

Apache Cassandra, Apache Flink, Apache HBase, Apache Hadoop, Apache Hive, Apache Kafka, Apache Spark, Apache Storm, Architecture, Big data, ETL, HDFS, MapReduce, Software development, Streaming, streaming data engineer
Contract W2, Contract Independent, 12 Months
Depends on Experience

Job Description

Immediate need, must be hands on, role requires coding as well as architecture experience

Required Skills and responsibilities

  1.  Expertise in architecture and building bacth and streaming big data plarforms. Be able to design and code streaming data pipelines. Configuring and administering streaming data pipelines for large-scale ingestion (on the order of at least terabytes of data/day, if not petabytes of data/day)
  2. Experience with streaming technologies; designing streaming data pipelines
  3. Experience building enterprise, large-scale streaming data pipelines using Flink and Kafka
  4. Evaluate streaming technologies, evaluate open source libraries and conduct POCs 
  5. Experience with Spark streaming and Storm
  6. Experience with Bigdata technologies, Spark, Hive, HDFS, MapReduce, Hadoop, batch streaming/processing, HBase, Cassandra

 

 

Posted By

Santa Clara, CA, 95050

Dice Id : 10126850
Position Id : STREAM-DE
Originally Posted : 3 months ago
Have a Job? Post it