Overview
Skills
Job Details
Job Title: Lead Bigdata Hadoop Engineer (with Google Cloud Platform exp)
Location: Irving, TX (Hybrid – Weekly 2-3 days has to go to office)
Duration: 12+ Months
Ingestion and Curation skills needed
Required Skills:
Must Have:
· Must have hands on Lead experience.
· Big data expert with 6+ years experience in Hadoop Big data ecosystem
· Spark - Batch & Streaming (Python, Scala )
· Apache Kafka hands on experience
· Experience in cloud environment, specially Google Cloud Platform
· Experience in developing both batch and real-time streaming data pipelines
· Python/Shell scripting
· Expertise in SQL
· Experience in Hive, Impala, Ozone, Iceberg
· Oozie and Airflow scheduler hands on experience
Good to have:
· Hadoop fundamental concepts
· CICD
· Cloudera ecosystem experience