Job Title: Big Data Developer
Location: Toronto, ON, Canada
Duration: 12 Months
Job Overview
Optimize enterprise data platforms with Spark + Hadoop.
Build and performance-tune distributed data processing applications, consolidating multi-source data into unified Hadoop data lakes while ensuring production-grade reliability.
Data Processing Development
- Build/deploy Spark/Scala applications for distributed data processing.
- Consolidate source systems into Hadoop-based data lakes.
Performance & Reliability
- Optimize Spark jobs and troubleshoot Hadoop cluster issues.
- Monitor production workflows and resolve pipeline failures.
Engineering Excellence
- Implement data modeling and ETL best practices.
- Leverage Git + CI/CD for version-controlled deployments.
Must-Have Technical Skills
- Hadoop ecosystem mastery (HDFS, YARN, Hive).
- Spark + Scala proficiency for large-scale processing.
- Git/CI-CD pipeline experience.
- ETL principles and data modeling.
Keywords: Big Data Developer, Spark Developer, Scala Developer, Hadoop Developer, Spark processing, Scala programming, Hadoop ecosystem, HDFS, YARN, Hive, data lake, ETL pipeline, data integration, data consolidation, Spark optimization, Hadoop cluster, production monitoring, pipeline troubleshooting, Git, CI/CD pipeline, data modeling, distributed processing
About VDart Group
VDart Group is a global leader in technology, product, and talent solutions, serving Fortune 500 clients in 13 countries. With over 4,000 professionals worldwide, we deliver innovation, operational excellence, and measurable outcomes across industries. Guided by our commitment to People, Purpose, and Planet, VDart is recognized with an EcoVadis Bronze Medal and as a UN Global Compact member, reflecting our dedication to sustainable practices.