Overview
Skills
Job Details
Job Title: Spark/Scala Developer
Location: Mississauga, ON (Hybrid)
Duration: Long-Term Contract
Job Description:
We are seeking an experienced Spark/Scala Developer with 5+ years of hands-on experience in Apache Spark (including Structured Streaming) and strong Scala programming skills. The ideal candidate will design and optimize data pipelines, implement real-time streaming solutions, and work with big data technologies in a cloud environment.
Key Responsibilities:
- Develop and optimize Apache Spark applications (batch & streaming) using Scala
- Build real-time data pipelines with Apache Kafka
- Design efficient ETL processes and data models
- Work with Hadoop ecosystem (Hive, Parquet, etc.)
- Implement CI/CD pipelines (Docker, Kubernetes)
- Deploy and manage solutions on cloud platforms (AWS EMR/MSK, Azure, Google Cloud Platform)
- Troubleshoot performance issues and ensure scalability
Required Skills & Experience:
- 5+ years of Apache Spark (including Structured Streaming)
- 3+ years of Apache Kafka for real-time data processing
- Strong Scala programming skills (functional & OOP)
- Hands-on experience with Hadoop, Hive, Parquet
- Knowledge of CI/CD, Docker, Kubernetes
- Familiarity with cloud platforms (AWS, Azure, Google Cloud Platform)
Key Skills:
Apache Spark, Scala, Structured Streaming, Apache Kafka, ETL, Data Pipelines, Hadoop, Hive, Parquet, CI/CD, Docker, Kubernetes, AWS EMR, AWS MSK, Azure, Google Cloud Platform
VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies
Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact
Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many
Fortune 500 companies Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele