Lead Data Engineer

Overview

On Site
$120,000 - $130,000
Full Time

Skills

Data Engineer
AWS
Hadoop
ETL
PySpark
HBase
Hive
Pig
Sqoop
Scala
HDFS
Python
Kafka
Data Modeling
Data Analytics
Erwin
Machine Learning Models
Artificial Intelligence
Data Components
SDLC

Job Details

Lead Data Engineer

Cleveland, OH, Pittsburgh, PA

Full Time Opportunity

Job Duties :

  • 8+ Years experience working in Data Engineering and Data Analysis.
  • Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,PySpark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce).
  • Hands on experience with Python & Kafka .
  • Good understanding of Database concepts , Data Design , Data Modeling and ETL.
  • Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing , Data Extraction , Data Ingestion , Data Quality ,Data Normalization & Data Loading.
  • Working experience in delivering projects in Agile Methodology and hands on in Jira.
  • Experience in Client Facing Roles with good communication & thought leadership skills to co-ordinate deliverables across the SDLC .
  • Good understanding of Machine Learning Models and Artificial Intelligence preferred.
  • Good understanding of Data Components , Data Processing & Data Analytics on AWS is good to have .
  • Experience with data modeling tools like Erwin is good to have
  • Master's/bachelor s in computer science or equivalent fields
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About American IT Systems