Senior Data Engineer (Hadoop/PySpark)

  • Cleveland, OH
  • Posted 60+ days ago | Updated 2 days ago

Overview

Hybrid
$60 - $70
Contract - W2
Contract - 12 Month(s)

Skills

Big Data
Hadoop
Confluent
Python
Kafka
PySpark

Job Details

Join our dynamic team as a Senior Data Engineer on a contract basis, with potential for full-time employment. This role offers a hybrid work model, with three days in the office and two days remote.

Job Responsibilities:

  • Participate in daily standups, sprint planning, and sprint retrospective sessions.
  • Engage in coding development and unit testing.
  • Modify existing databases and database management systems.
  • Coordinate database development within a project team.
  • Estimate time and cost for project requests.
  • Perform other duties as assigned.

Skills Required:

  • Proficiency in Hadoop Big Data Engineering with PySpark, HQL, Python skills.
  • Familiarity with Hadoop Platform utilities - Hive, Oozie, Yarn, Impala, HDFS, Hbase- Hue, Beeline.
  • Experience in Python and Shell Programming (PySpark) - Python 2.7, 3.0.
  • Knowledge of DSP (Data Streaming Platform) - Kafka Confluent.
  • Experience in Model Implementation - PySpark.
  • Familiarity with CA7 Mainframe.

Preferred Skills:

  • Bachelor's degree in a relevant field.
  • Strong attention to detail, team player, and self-starter.

 

W2 only

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.