Hadoop Developer

company banner
SkillStorm Commercial Services LLC
Hadoop, Big data, Apache Hadoop, SQL, ETL, Software development
Contract W2
Depends on Experience
Travel not required

Job Description

SkillStorm is seeking a Hadoop Developer for our client in Newark, Delaware. Candidates must be able to work on SkillStorm's W2; not a C2C position. EOE, including disability/vets.


  • Hadoop Developer to work in one or more than one projects in the hadoop data lake, including technical deliverables as per business needs. Work closely with project managers, Tech managers to Develop integrated technical applications in data lake platform, from conceptualization and project planning to the post-implementation support level. Responsible for developing complete life cycle of a Hadoop project implementation. Responsible to develop new re-usable utilities, understand and enhance existing utilities

Required Skills:

  • Following is a summary of the essential functions for this job. Other duties may be performed, both major and minor, which are not mentioned below. Specific activities may change from time to time.
  • Sound understanding and experience with Hadoop ecosystem (Cloudera). Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
  • Experience in working with a Big Data implementation in production environment
  • Experience in Spark, Map Reduce, Hive, impala, Scala, Kafka, flume, Linux/Unix technologies is mandatory
  • Experience in Unix shell scripting is mandatory
  • Experience in python/perl is mandatory, able to analyze and debug the existing code
  • Experience in Banking domain is mandatory
  • Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
  • Strong IT consulting experience in various data warehousing engagement, handling large data volumes, architecting big data environments.
  • Deep understanding of algorithms, data structures, performance optimization techniques and software development in a team environment.
  • Benchmark and debug critical issues with algorithms and software as they arise.
  • Lead and assist with the technical design/architecture and implementation of the big data cluster in various environments.
  • Able to guide/mentor development team for example to create custom common utilities/libraries that can be reused in multiple big data development efforts.
  • Exposure to ETL tools e.g. data stage, NoSQL (HBase, Cassandra, MongoDB)
  • Work with line of business (LOB) personnel, external vendors, and internal Data Services team to develop system specifications in compliance with corporate standards for architecture adherence and performance guidelines.
  • Provide technical resources to assist in the design, testing and implementation of software code and infrastructure to support data infrastructure and governance activities.
  • Support multiple projects with competing deadlines

Desired Skills:

  • Previous experience in the financial services industry
  • Broad Client technical experience and good understanding of existing testing/operational processes and an open mind on how to enhance those
  • Understanding of industry trends and relevant application technologies
  • Experience in designing and implementing analytical environments and business intelligence solutions

Company Information

Founded in 2002, SkillStorm was built on the mission of accelerating careers in high-demand technologies. We hire, train, and deploy Stormers from all backgrounds and experience levels in today’s in-demand technologies such as AWS, Salesforce, PEGA, ServiceNow, and Appian.

We are committed to hiring and training college graduates and veterans for high-growth technology careers with our fortune 100 clients. Through these dedicated efforts, we are able to build a reliable, exclusive pipeline of high-quality, U.S.-based tech talent with the skills and clearance levels required to support our client’s critical technology initiatives.

As a flexible technology workforce partner, we provide fully formed tech teams at any level of experience, skillsets, and clearance. Stormers are deployed either at client’s sites or at our U.S.-based delivery centers.

Dice Id : 10270185
Position Id : 34315
Originally Posted : 2 months ago