Lead Hadoop BigData Developer with Google Cloud Platform

  • Irving, TX
  • Posted 21 days ago | Updated 19 hours ago

Overview

On Site
Hybrid
Up to $60
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

DataFlow
BigQuery
Cloud Storage
DataProc
Airflow
BigData migration with GCP
Lead exp required
Hadoop Big data ecosystem

Job Details

Job Title: Lead Bigdata Hadoop Engineer (with Google Cloud Platform exp)

Location: Irving, TX (Hybrid – Weekly 2-3 days has to go to office)

Duration: 12+ Months

Ingestion and Curation skills needed

Required Skills:

Must Have:

· Must have hands on Lead experience.

· Big data expert with 6+ years experience in Hadoop Big data ecosystem

· Spark - Batch & Streaming (Python, Scala )

· Apache Kafka hands on experience

· Experience in cloud environment, specially Google Cloud Platform

· Experience in developing both batch and real-time streaming data pipelines

· Python/Shell scripting

· Expertise in SQL

· Experience in Hive, Impala, Ozone, Iceberg

· Oozie and Airflow scheduler hands on experience

Good to have:

· Hadoop fundamental concepts

· CICD

· Cloudera ecosystem experience