Big Data Engineer

  • Tampa, FL
  • Posted 33 days ago | Updated 6 hours ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

Big Data
KAFKA
Spark
SQOOP
Hive
Python
Eclipse
SQL

Job Details

Title:- Big Data Pyspark Engineer

Location:- Tampa FL / Irving, TX

Experience -4-6 Years

Role Description:

1 Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns

2 Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework

3 Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like IMPALA.

Essential Skills:

  • Should be comfortable with Unix File system as well as HDFS commands
  • Should be flexible
  • Should have good communication and customer management skills
  • Experience with Pyspark ,Python and Spark

Desirable Skills:

  • Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.
  • Should be aware of the components in Big Data ecosystem.
  • Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.