Senior Hadoop Engineer

company banner
Computer Merchant, Ltd., The
Hadoop, Java, Big Data
Full Time, Perm
Telecommuting not available Travel not required

Job Description

Senior Hadoop Engineer
Waltham, MA

We have a definitive vision of how electronic payment systems will look in the future and we have the knowledge, scale and resources to deliver it. We've developed a suite of world class Analytics and Fraud Prevention products and services based on very modern technologies such as containerization and Hadoop. As a Hadoop/Big Data Engineer, you too can help us drive payments at the speed of change.

Essentially this role will have two phases, namely:

  • The immediate need is to have a strong Hadoop presence to help us to operationalize the clusters both for the dev and prod environments
  • Longer term, the job will evolve into an engineering role with the data science organization and basically liaise between the Architects, Data Science team and the ops team as we define and deploy models and services for fraud and related analytics.

Essential Duties and Responsibilities:

  • Manages and participates in the day to day operational work across the Hadoop clusters
  • Works closely with the hosted ops colleagues to define operational best practice for the UAT and Prod Hadoop clusters.
  • Participates in project planning and review as they pertain to Hadoop and Hadoop clusters.
  • Development of software applications utilizing Hadoop and other big data technologies.

Minimum Requirements:

  • Bachelor's degree in Computer Science or a related field and/or equivalent experience.
  • Previous experience administering Hadoop clusters.
  • 2 years Java development experience.
  • 5 years of related work experience to include experience with systems testing and system requirements processes (planning, elicitation, analysis and management.)
  • 2 or more years of experience working with Hadoop in a big data environment

Highly Desired Skills:

  • Experience with the Hortonworks Hadoop Distribution (HDP).
  • Experience with SPARK, HBase, Hive, NIFI, and Phoenix.
  • Experience with Cassandra, SOLR and Kafka.
  • Experience with agile software development methodologies (e.g. Scrum)
  • Familiar with containerization technology (e.g. Docker, Kubernetes)
  • Experience with machine learning using Hadoop or other frameworks.
  • Experience working with Kerberized Hadoop clusters.


TCM is an EEO/Vets/Disabled Employer.

Posted By

95 Longwater Circle Norwell, MA, 02061

Company Information

The Computer Merchant Ltd. (TCM) is a veteran-owned, national provider of technology staffing services and workforce solutions that meet the unique needs and demanding expectations of Fortune 1000, SMB commercial and public sector clients across the U.S. Over the last five years, we’ve successfully deployed over 12,500 consultants on long term, mission critical assignments at a long list of prestigious and demanding companies, including 12 of the Fortune 100, 34 of the Fortune 500 and over 150 industry-leading large and SMB clients.
Dice Id : cxtcml
Position Id : 17-03090

Similar Positions at Computer Merchant, Ltd., The

Senior Front End Engineer
  • Boston, MA
  • 1 week ago
Sr Systems Engineer
  • Marlborough, MA
  • 1 week ago
Senior Applications Developer / Blackbaud CRM
  • Chestnut Hill, MA
  • 3 weeks ago
Business / Data Analyst
  • Boston, MA
  • 2 weeks ago
Sr Systems Engineer
  • Aurora, CO
  • 3 days ago