Big Data/Java Developer

Big Data, Java, Python, Logstash, Elastic Search, Spark
Contract W2, Contract Independent, Contract Corp-To-Corp
Depends on Experience

Job Description

Big Data / Java Developer,

Manassas, VA

Requirements

Working with application development teams who write applications which generate logs, and with Operations teams who operate those applications, and through development of an understanding of the business of SWIFT customers, the successful candidate will drive and oversee the following:

  • Understanding of content and value of logs generated by messaging or service management tools
  • Creation of syslog-ng or Filebeat configuration to transport logs from generating system into pipeline
  • Development of parser(s) for the logs, using logstash GROK or custom parser developed in Java
  • Development of configuration for a generic metrics engine defining fields to be used for calculating metrics of interest e.g. transit times
  • Development of dashboards for useful visualization of insights found in those logs – Kibana mostly
  • Working with development & operations staff, conduct end-to-end tests of the entire pipeline from generating system to dashboard
  • Use predictive analytics classification algorithm (like linear, logistic, random forest, SVM, TF-IDF etc) to predict

 

Desire Languages/Technologies – Java, Python, Ansible, Logstash, Flume, Fluentd, Elastic Search, Kibana, Syslog-NG, Filebeat, Metricbeat, Data Science (Some knowledge)

 

Skills/Requirements:

Python

Java

Logstash

Elastic Search

Apache Spark

Data Analysis

Software Engineering

Big Data Infrastructure

Dice Id : 10432128
Position Id : 6630125
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

JAVA AWS with Spark Developer
  • Tekfortune Inc.
  • Mclean, VA
Sr. Big Data Developer with Strong AWS (Exp 10+)
  • Youth Power Technosoft LLC.
  • Reston, VA
Bigdata Developer (2 Positions)
  • Technology Ventures
  • Mclean, VA
Requirement : Bigdata Spark AWS- Reston VA
  • Vbeyond Corporation
  • Reston Va, VA
Sr Big Data Engineer
  • Marlabs, Inc
  • Rockville, MD
Java Scala Developer with Data Structures--Washington, DC--contract
  • Silverlink Technologies LLC
  • Washington D.c., DC
Lead Big Data Developer
  • Vega Consulting Solutions
  • Reston, VA
Lead Big Data Engineer
  • InfoVision, Inc.
  • Vienna, VA
Big Data developer with Java background
  • Lumen Solutions Inc
  • Reston, VA
Big Data Engineer
  • Zenith Services Inc.
  • Mc Lean, VA
Big Data Architect
  • GMCA Technologies LLC
  • Washington, DC