Big Data Engineer with Scala, Spark and Hadoop (Mississauga, ON)

  • Mississauga, ON
  • Posted 1 day ago | Updated 1 day ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

Spark
Scala
Hive
SQL
Hadoop
HDFS
HQL
Big Data
Real-Time Data Processing
Spark Streaming
Linux
Hadoop Ecosystem
Impala
HBase
Banking Domain
Capital Markets
Financial Services

Job Details

Job Title: Big Data Engineer with Scala, Spark and Hadoop.
Location: Mississauga, ON (Hybrid)
Duration/Term: Long Term Contract


Job Description:

We are looking for a Big Data Engineer with expertise in Spark, Scala, Hive, SQL, and Hadoop within the Banking and Capital Markets domain. The ideal candidate will have experience working with Linux-based Hadoop ecosystems, handling real-time data processing with Spark Streaming, and demonstrating strong problem-solving and decision-making skills.


Key Responsibilities:

  • Develop, optimize, and maintain Big Data solutions using Spark, Scala, Hive, HDFS, and HQL.
  • Work within a Linux-based Hadoop ecosystem, including HDFS, Impala, Hive, HBase, etc.
  • Design and implement real-time data processing platforms (Spark Streaming experience is a plus).
  • Ensure data integrity, efficiency, and security across Big Data frameworks.
  • Maintain clear and concise written and verbal communication for technical documentation and stakeholder interactions.
  • Drive projects with a strong ability to multi-task, work under pressure, and meet agreed objectives.
  • Demonstrate problem-solving and decision-making skills for complex data challenges.


Qualifications:

Must Have:

  • Expertise in Spark, Scala, Hive, SQL, and Hadoop.
  • Experience in Banking & Capital Markets domain.
  • Strong communication skills (written and verbal).

Nice to Have:

  • Experience with real-time data processing using Spark Streaming.
  • Knowledge of Big Data architectures and industry best practices.


Key Skills:

Spark, Scala, Hive, SQL, Hadoop, HDFS, HQL, Linux, Impala, HBase, Banking & Capital Markets, Big Data Processing, Problem-Solving, Decision-Making, Communication


VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies

Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact

Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many

Fortune 500 companies Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.