Big Data Engineer

3-5 years of experience with Big Data and with 2+ years of Java Coding Experience
Full Time, Full Time + Bonus
open DOE
Telecommuting not available Travel not required

Job Description

Skills and Qualifications

∙             Java(required) – Must have 2+ years of experience coding in Java

∙             Python and Bash (as a plus).

∙             PostgreSQL as a plus

∙             Proficient understanding of distributed computing principles

∙             Management of Hadoop cluster (Cloudera preferred), with all included services

∙             Ability to solve any ongoing issues with operating the cluster

∙             Proficiency with Hadoop v2, MapReduce, HDFS, Sqoop

∙             Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

∙             Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

∙             Experience with Spark 

∙             Experience with integration of data from multiple data sources such as MsSQL Server, Oracle,

∙             Good understanding of SQL queries, joins, stored procedures, relational schemas

∙             Experience with NoSQL databases, such as HBase, Cassandra, MongoDB (preferred)

∙             Knowledge of various ETL techniques and frameworks, such as Flume

∙             Experience with various messaging systems, such as Kafka or RabbitMQ

∙             Experience with Cloudera

∙             Oozie workflow (in Hadoop skill list)

Posted By

41 University Drive, Suite 202 Newtown, PA, 18940

Dice Id : 10330481
Position Id : BDEMC01
Have a Job? Post it