Spark/Scala Developer

  • Mississauga, ON
  • Posted 18 hours ago | Updated 18 hours ago

Overview

Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)

Skills

Apache Spark
Scala
Structured Streaming
Apache Kafka
ETL
Data Pipelines
Hadoop
Hive
Parquet
CI/CD
Docker
Kubernetes
AWS EMR
AWS MSK
Azure
GCP

Job Details

Job Title: Spark/Scala Developer
Location: Mississauga, ON (Hybrid)
Duration: Long-Term Contract

Job Description:

We are seeking an experienced Spark/Scala Developer with 5+ years of hands-on experience in Apache Spark (including Structured Streaming) and strong Scala programming skills. The ideal candidate will design and optimize data pipelines, implement real-time streaming solutions, and work with big data technologies in a cloud environment.

Key Responsibilities:

  • Develop and optimize Apache Spark applications (batch & streaming) using Scala
  • Build real-time data pipelines with Apache Kafka
  • Design efficient ETL processes and data models
  • Work with Hadoop ecosystem (Hive, Parquet, etc.)
  • Implement CI/CD pipelines (Docker, Kubernetes)
  • Deploy and manage solutions on cloud platforms (AWS EMR/MSK, Azure, Google Cloud Platform)
  • Troubleshoot performance issues and ensure scalability

Required Skills & Experience:

  • 5+ years of Apache Spark (including Structured Streaming)
  • 3+ years of Apache Kafka for real-time data processing
  • Strong Scala programming skills (functional & OOP)
  • Hands-on experience with Hadoop, Hive, Parquet
  • Knowledge of CI/CD, Docker, Kubernetes
  • Familiarity with cloud platforms (AWS, Azure, Google Cloud Platform)

Key Skills:

Apache Spark, Scala, Structured Streaming, Apache Kafka, ETL, Data Pipelines, Hadoop, Hive, Parquet, CI/CD, Docker, Kubernetes, AWS EMR, AWS MSK, Azure, Google Cloud Platform

VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies

Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact

Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many

Fortune 500 companies Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.