Data engineer position @ Sunnyvale, CA

("DATA ENGINEER") AND (SCALA) AND (SPARK OR HIVE) AND (KAFKA) AND ("BIG DATA")
Contract Corp-To-Corp, Contract Independent, Contract W2, C2H Corp-To-Corp, C2H Independent, C2H W2
Work from home not available Travel not required

Job Description

Job Title: Data Engineer/Hadoop Engineer

Primary Skills: data pipelines,spark,scala/kafka

Location: Sunnyvale, CA

Duration : 18+ months

Job Description:

Role and responsibilities : Build big data event driven applications Kafka consumer Build / Scale / Debug - Realtime stream processing framework with Apache Flink / Spark Build new / debug DAG operators in APEX / Airflow Apache Druid - event driven stacks with Kafka and data lakes (hdfs) : Build new/ debug existing Experience in programming in Scala / Python / Java In depth understanding of the Hadoop infrastructure setup/ configuration Spark / Hive SQL Oozie workflow (Or knowledge and experience of other scheduler) - written/ maintained and managed Strong ETL experience

- Not just extraction from data lakes and loading into HDFS.

- Experience with transformations in spark. (DAG) Additional criteria : Engineer / dev-ops experience with Kafka consumer or similar technology Experience with relational databases

- data model / SQL Coding - Algorithms / Pseudo and actual coding concepts (OOP / hash etc.)

Thanks & Regards

Shaik Sadeq (Sam)
Infobahn Soft world Inc.

Email: Sadeq@infobahnsw.com

Posted By

Sadeq Shaik

Dice Id : infobahn
Position Id : 2019-38177
Have a Job? Post it

Similar Positions

Senior Data Engineer
  • DRISHTICON
  • Santa Clara, CA
Senior Data Engineer
  • Alpha Net Consulting LLC
  • Menlo Park, CA
Data Engineer
  • Flexton Inc
  • Sunnyvale, CA
Data Engineer - Risk Assurance
  • The Judge Group, Inc.
  • Santa Clara, CA
Data Engineer
  • Infostride
  • San Jose, CA
Data Engineer
  • Shimento, Inc.
  • Mountain View, CA
Data Engineer AWS or Big Data
  • InterSources Inc.
  • Mountain View, California
Data Engineer
  • Openmind Technologies
  • San Jose, CA
Data Engineer
  • Redolent, Inc
  • Sunnyvale, CA
Python Data engineer 150-180K - Direct client (70-120/hr)
  • Projas Technologies, LLC
  • South San Francisco, CA
Data Engineer
  • Spire Systems Inc
  • Pleasanton, CA
Java Big Data Analytics Engineer
  • Numeric Technologies, Inc.
  • Sunnyvale, CA
Sr. ETL / Data Engineer (Locals Only)
  • ParSoft LLC
  • San Jose, CA
Data Engineer - AI Labs
  • BlackRock
  • Palo Alto, CA
Data Engineer with Spark and Scala
  • AIEnterprise Inc
  • Milpitas, CA