Sr Data Engineer

AWS, Athena, EMR, Python
Contract W2, 12 Months
Depends on Experience
Travel not required

Job Description

Sr .Data Engineer (BigData/AWS)

Duration: 6+ Months C2H

 

Job Description

Responsibilities:

  • Design, implement and support an analytical data infrastructure providing access to large datasets and computing power.
  • Creation and support of real-time data pipelines built on AWS technologies including EMR, Glue, Kinesis, Redshift/Spectrum and Athena
  • Responsible for building and automating an end-to-end data pipeline from data collection to data lake (Snowflake).
  • Writing and validating scripts for data munching / data wrangling using Python/SQL or equivalent.
  • Assisting in Data Analytics and Visualizations using SQL, Python (Numpy, Pandas, Scipy, etc.) as needed.

Qualifications:

  • 10+ years of industry experience
  • 5+ years of experience in data engineering/preparation
  • Solid understanding of the core principles of Data engineering and Data warehousing
  • End-to-End experience with Data Collection, Integration, Analysis of Website logs (hit level data) , Google Analytics Data set, Machine data in factories and structured dataset out of IT applications.
  • In-depth understanding and hands-on implementation and use of  AWS services related to data engineering world – S3, Kinesis, Glue, EMR,  Spark, Redshift, Sagemaker
  • Ability to work with MPP databases like Netezza or Redshift or Teradata

 

Regards,

Rahul Bobbili

9254759970/

 

Posted By

Rahul Bobbili

Dice Id : 10494547
Position Id : 6511956
Originally Posted : 5 months ago
Have a Job? Post it

Similar Positions

Cloud Data Engineer
  • Openmind Technologies
  • San Jose, CA
Azure Data Engineer
  • InterSources Inc.
  • San Jose, CA
Sr. Data Engineer
  • Kaltechsoft
  • San Mateo, CA
Data Engineering Project Manager
  • GSPANN Technologies
  • San Ramon, CA
IOT Data Engineer ** Direct end client *** $80-$115/hr ***
  • Projas Technologies, LLC
  • Mountain View, CA
Data Engineer
  • New York Technology Partners
  • San Jose, CA
Senior Data Engineer
  • VDart, Inc.
  • Santa Clara, CA
Data Engineer
  • Info Way Solutions
  • San Jose, CA
AWS Big Data Architect - Sunnyvale CA
  • Flexon Technologies Inc.
  • Sunnyvale, CA
Bigdata operations engineer (SRE)
  • Vertogic
  • San Jose, CA
Data Engineer
  • Applicantz, Inc.
  • Menlo Park, CA
Data Engineer
  • Best High Technologies
  • Mountain View, CA
Data Engineer
  • Intuites
  • Sunnyvale, Ca, CA
GCP Data Engineer - Remote / Telecommute
  • Cynet Systems
  • San Jose, CA