Spark Core expert with Java Development

  • New York, NY
  • Posted 1 day ago | Updated 1 day ago

Overview

Hybrid
$90 - $101
Full Time
No Travel Required

Skills

Spark Core
Spark SQL
Java
Linux

Job Details

Corp to corp accepted
Must be 3+ years of Spark Core and Spark SQL as a Java programmer
Please only candidates local to New York City or New Jersey as there is in-perosn interview

SPARK CORE SPARK CORE SPARK CORE experts only processing HUGE AMOUNT of data.

Market Risk Technology is seeking a strong senior application developer with experience in developing distributed systems, capable of processing very high volumes of data. The ideal candidate will have extensive experience in Java development, a strong understanding of software engineering principles, and the ability to work collaboratively in a fast-paced environment.
Market Risk Technology support the Market Risk Department in monitoring, measuring and reporting risk generated by Brokerage's global business lines, and in implementing calculation models required for regulatory compliance. The Market Risk platform interfaces with various systems and obtains valuations and risk sensitivities, along with trade and product attributes across all asset classes. The middle tier has many roles to play namely data ingestion framework, subscription managers, data driven event workflow, and streaming dynamic datasets over the wire.
Responsibilities:

  • Design, develop, and maintain high-quality Java SPARK applications.
  • Collaborate with cross-functional teams to define, design, and ship new features.
  • Write clean, maintainable, and efficient code.
  • Conduct code reviews and provide constructive feedback to team members.
  • Troubleshoot and debug applications to ensure optimal performance.
  • Stay up-to-date with the latest industry trends and technologies.

Requirements:

  • 10+ Years hands-on experience with Core Java and related technologies.--> 10-15 years Core Backend java developer, multi-threading, RDBMS
  • 5+ Year of experience working with SQL and database design.--> Must have Stored procedure Data modelling and SQL writing
  • 3+ Year of hands-on experience with SPARK( using JAVA) based processing . ---. SPARK Exp in last 3 year is must, SPARK Core and SPARK SQL
  • Strong object oriented design and development skills using core Java and Spring, Data Structures and algorithms and design patterns.
  • Experience with development of event based system orchestration.
  • Experience with development of rule based system.
  • A good understanding of how to build multi-threaded applications utilizing a service oriented architecture.
  • A culture of incorporating unit test cases when designing systems using Junit/BDD.
  • Strength in querying large relational databases in an optimized manner
  • Ability to write scripts in Shell/Python- Excellent analytical ability
  • Strong collaboration, communication & dev team leadership skills.
  • Experience with Agile methodologies and DEVOPS automation.


Preferred Qualifications:

  • Risk/Financial Systems development experience
  • Understanding of massive parallel processing (MPP) architecture to support high volume data processing.
  • Knowledge of Python syntax and experience with relevant libraries such as NumPy, Pandas etc.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.