Data Engineer

Overview

On Site
Depends on Experience
Contract - W2
Contract - 6 Month(s)
No Travel Required
Unable to Provide Sponsorship

Skills

Scala
Spark
hive SQL
Hadoop
Kafka
SQL optimization
Hive
Spark Streaming
Kafka Streams
Apache Hadoop
Apache Hive
Apache Kafka
Apache Spark
Big Data
Cloudera
Data Governance
Extract, Transform, Load
Java
Data Warehouse
Real-time
SQL
SQL Tuning
Data Quality
Streaming
Orchestration

Job Details

Role : Data Engineer
Location : Scottsdale AZ  (100% Onsite)

Independent Visa | No Fake GCs | BGV is a must


 
Must have :
10-12 years of experience
Strong Experience in Scala, Spark, hive SQL, Hadoop and Kafka
Proficiency in Hive and SQL optimization.
Understanding of distributed systems and big data architecture.
Knowledge of streaming frameworks (Spark Streaming, Kafka Streams).
Good to have – Aerospike experience
 
 
Skills required:
Experience : 10+ Years
Must have Primary skills required Cloudera (Hadoop), Spark + Scala or Spark + Java and SQL
The resources should also have good understanding of Hive, Aerospike.
The resources should have strong analytical skills.
Should have worked on large scale ETL and DW projects and pipelines.
Real time data streaming experience and batch orchestration, data quality and reconciliation, understanding of concepts like Data Governance is a must.
Strong communication skills and ability to independently work and troubleshoot problems and come up with solutions

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.