Our client is looking Big Data Developer for a long term project in Quincy, MA below is the detailed requirement.
Job Title: Big Data Developer
Location: Quincy, MA
Duration: Long Term
- Bachelor s degree in Computer Science or equivalent. with minimum of 8+ years of experience.
- Big Data and Spark Developer Total 8 years of experience and 3 years of minimum experience in Big data and Spark
- Work experience in Java and J2EE technologies Work experience in ingestion storage querying processing and analysis of Big data with hands on experience in Big data Eco system related technologies like Map Reduce Spark Hive Impala Sqoop HBase Kafka
- Good understanding of Spark Algorithms such as Classification Clustering and Regression
- Experience working with Spark tools like RDD transformations spark SQL and spark MLlib
- Experience in addressing performance issues Must have experience in Hive Impala and Sqoop 3 years Spark 2 years Kafka 1 year
- Core java experience dealing with data transformation with Spark and Hadoop 2. Experience in Spark, Hive.
- Experience of working in Agile team preferable
- Minimum 4+ years of development experience on Hadoop Environment.
- In depth knowledge and work experience of writing code on HIVE, PIG, SCOOP and Unix Script.
- Strong coding Skills writing on SQL 7. In depth experience on SPARK on in-memory solution environment
- Designing, building, installing, configuring and supporting Hadoop.
- Maintain security and data privacy.
- Create scalable and high-performance web services for data tracking.
- High-speed querying.
- Managing and deploying HBase.
- Should have good communication and should work in a team.
- Has worked in client facing environment in previous projects.
- Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customers.
- Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail.
- Strong work ethic with good time management with ability to work with diverse teams and lead meetings