Job Title: Cloud Big Data Engineer (Senior/Specialist)
Location: Toronto, ON, Canada
Duration: 12 Months
Job Overview
Scale enterprise data with Spark/Scala on AWS or Azure.
Design and optimize large-scale data pipelines using Spark (Core, Streaming, SQL) and cloud-native services. Transform raw data into analytics-ready datasets for data scientists and business stakeholders.
Pipeline Architecture
- Build scalable ingestion/processing pipelines with Spark + Scala.
- Optimize Hadoop ecosystems and cloud storage/compute (S3/EMR or ADF/Databricks).
Software Engineering
- Write production-grade Java/Scala code for data services.
- Implement SQL/NoSQL data models and warehousing solutions.
Cloud Mastery
- Architect high-availability, cost-efficient solutions on AWS or Azure.
- Performance tuning for petabyte-scale data processing.
Technical Requirements
- Expert Spark (Core, Streaming, SQL) + Scala proficiency.
- Strong Java + Hadoop ecosystem experience.
- Hands-on AWS (S3, EMR) OR Azure (Data Factory, Databricks).
- SQL/NoSQL + data warehousing expertise.
Keywords: Cloud Big Data Engineer, Senior Data Engineer, Spark, Scala, Spark Streaming, Spark SQL, Java, Hadoop, AWS S3, AWS EMR, Azure Data Factory, Azure Databricks, data pipeline, ETL pipeline, data ingestion, data processing, SQL, NoSQL, data warehouse, data modeling, cloud architecture, Hadoop ecosystem, distributed computing, Toronto data engineer, Spark optimization, Scala programming
About VDart Group
VDart Group is a global leader in technology, product, and talent solutions, serving Fortune 500 clients in 13 countries. With over 4,000 professionals worldwide, we deliver innovation, operational excellence, and measurable outcomes across industries. Guided by our commitment to People, Purpose, and Planet, VDart is recognized with an EcoVadis Bronze Medal and as a UN Global Compact member, reflecting our dedication to sustainable practices.