Big Data Engineer

Overview

On Site
Contract - W2

Skills

spark
Hadoop
GCP

Job Details

Role: 1 Big data developer

Irving Dallas TX (8 days a month is mandate. Tuesday and Wednesday or Thursday onsite is mandate)

Must Have

Big data expert with 6+ years' experience in Hadoop Big data ecosystem

Spark - Batch & Streaming (Python, Scala )

Apache Kafka hands on experience

Experience in cloud environment, specially Google Cloud Platform

Experience in developing both batch and real-time streaming data pipelines

Python/Shell scripting

Expertise in SQL

Experience in Hive, Impala, Ozone, Iceberg

Oozie and Airflow scheduler hands on experience

Good to have Hadoop fundamental concepts

CICD

Cloudera ecosystem experience

CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower businesses around the world to make better, faster operational decisions.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.