PySpark Developer

  • Toronto, ON
  • Posted 4 days ago | Updated 23 hours ago

Overview

On Site
Accepts corp to corp applications
Contract - W2
Contract - 6+ month(s)

Skills

ARCHITECT
SAS
pyspark

Job Details

Role Overview
We are seeking a skilled and motivated SAS to PySpark Developer to lead the migration of legacy SAS-based analytics workflows to scalable PySpark solutions. This role is critical to modernizing our data infrastructure and enabling advanced analytics capabilities across cloud platforms.
________________________________________
Key Responsibilities
Analyze and reverse engineer existing SAS programs, macros, and data flows.
Design and implement equivalent PySpark modules optimized for performance and scalability.
Develop and maintain ETL pipelines using PySpark integrated with AWS, Snowflake/DataBricks
Validate migrated outputs against SAS baselines to ensure accuracy and consistency.
Collaborate with cross-functional teams including data scientists, business analysts, and cloud engineers.
Document technical specifications, migration strategies, and validation protocols.
Participate in sprint planning, estimation, and delivery of migration milestones.
________________________________________
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or related field.
3+ years of experience in SAS programming and data engineering.
2+ years of hands-on experience with PySpark and big data technologies.
Strong understanding of data structures, algorithms, and performance tuning.
Experience with cloud platforms (AWS, Azure, Snowflake) and distributed computing.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.