Overview
Hybrid
$120,000 - $140,000
Full Time
No Travel Required
Skills
Apache HBase
Apache Hadoop
Apache Hive
Apache Kafka
Apache Oozie
Apache Spark
Apache Sqoop
Batch Processing
Big Data
CA Workload Automation AE
Cloudera
Cloudera Impala
Computer Science
Continuous Delivery
Continuous Integration
Data Engineering
Data Management
Data Processing
Database
Elasticsearch
Extract
Transform
Load
Git
HDFS
Internet
J2EE
Java
Jenkins
Job Scheduling
NoSQL
Oracle Linux
Performance Analysis
Performance Tuning
Programming Languages
Python
SQL
Scala
Software Development
Software Engineering
Streaming
Job Details
Job Title: Big Data Engineer
Location: New jersey (Hybrid)
Type: Fulltime
Big Data concepts: Good
Scala Programming: Good
Java / Python: Beginner
Autosys: Implemented in one project earlier
CI/CD: Jenkins knowledge
Sqoop / Spark / Hive / HDFS / Oozie: Good on concepts
Cloudera Cluster configuration: Never worked
Databricks working knowledge: Good
Kafka: Learning knowledge (haven t got a chance to work on it practically)
Batch / Streaming: Only Batch driven data he has worked till date
Optimization performance tuning: Average
Bachelor s Degree or Master s in Computer Science, Engineering, Software Engineering or a relevant field. Around 10 years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs) Work with Cloudera on open issues that would result in cluster configuration changes and then implement as needed Strong experience with databases such as SQL,Hive, Elasticsearch, HBase, etc Knowledge of Hadoop Security, Data Management and Governance
Primary Skills: Java/Scala, ETL, Spark, Hadoop, Hive, Impala, Sqoop, HBase, Confluent Kafka, Oracle, Linux, Git, Jenkins CI/CD, etc.
Location: New jersey (Hybrid)
Type: Fulltime
Big Data concepts: Good
Scala Programming: Good
Java / Python: Beginner
Autosys: Implemented in one project earlier
CI/CD: Jenkins knowledge
Sqoop / Spark / Hive / HDFS / Oozie: Good on concepts
Cloudera Cluster configuration: Never worked
Databricks working knowledge: Good
Kafka: Learning knowledge (haven t got a chance to work on it practically)
Batch / Streaming: Only Batch driven data he has worked till date
Optimization performance tuning: Average
Bachelor s Degree or Master s in Computer Science, Engineering, Software Engineering or a relevant field. Around 10 years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs) Work with Cloudera on open issues that would result in cluster configuration changes and then implement as needed Strong experience with databases such as SQL,Hive, Elasticsearch, HBase, etc Knowledge of Hadoop Security, Data Management and Governance
Primary Skills: Java/Scala, ETL, Spark, Hadoop, Hive, Impala, Sqoop, HBase, Confluent Kafka, Oracle, Linux, Git, Jenkins CI/CD, etc.
Thanks and Regards
Sanket Parate
Talent Acquisition Specialist, KTEK Resourcing
Email -
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.