Data Er

Data Engineer, Python, ETL, Spark, Kafka, Hadoop, or similar, Hive, Oozie OR Airflow
Contract W2, 12 Months
Depends on Experience
Work from home available

Job Description

Data Engineer (Sunnyvale, CA)

  • A background in computer science, engineering, mathematics, or similar quantitative field
  • Minimum of Data Engineer 2 years professional experience.
  • Experience in implementing data pipelines using python.
  • Experience working with large volumes of data and challenges associated in transforming and enriching such datasets.
  • Extract Transform Load (ETL) experience using Spark, Kafka, Hadoop, or similar technologies.
  • Experience with relational and distributed systems such as Hive/Teradata/SQL.
  • Experience with workflow scheduling / orchestration such as Oozie or Airflow.
  • Experience with Unix-based command line interface and Bash scripts.

 

Responsibilities:

  • Automate end-to-end ETL/ML pipelines with structural understanding of data products.

. Automate, deploy and maintain ML pipelines into existing Hadoop ecosystems.

  • Work with team members to assist with data-related technical issues and support their data product needs.

 

Nice to have:

  • Experience with python-Pandas a plus.
  • Data visualization or web development skills a plus.

You are required to perform ALL work within a commutable distance of your assigned Worksite Location.

Dice Id : redoak
Position Id : DATAer
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

Data Engineer
  • TEKHiring
  • Sunnyvale, CA, USA
Java developer with kafka and Cassendra
  • Tekforce Corporation
  • Sunnyvale, CA, USA
Bigdata Java Engineer
  • BayOne Solutions
  • Sunnyvale, CA, USA
Data Infrastructure Engineer - JD
  • Advent Global Solutions, Inc.
  • Cupertino, CA, USA
Senior BIG Data Engineer
  • E-Solutions, Inc.
  • San Jose, CA, USA
Data Engineer
  • Ab Ovo Inc
  • Sunnyvale, CA, USA
Java Developer only on w2
  • Mindsource Inc
  • Cupertino, CA, USA
Sr Data Solutions Engineer
  • Staffing Headquarters LLC.
  • Sunnyvale, CA, USA
Data Engineer
  • Stefanini
  • Palo Alto, CA, USA
Data Test Engineer with Hadoop experience
  • Aspire Systems, Inc.
  • Cupertino, CA, USA