Senior Big Data Developer/Engineer

Job Title: NAM-CA-Big Data-Senior (CAD)

Location: Mississauga

Duration: Contract - 6 months

Job ID: 408133

About TSR

TSR is a trusted staffing and workforce solutions partner with more than 50 years of experience delivery highly qualified talent to support clients' most critical business and technology initiatives. Through a disciplined approach to sourcing, candidate vetting, and delivery, TSR helps organizations scale teams quickly while maintaining quality and reliability. TSR operates with a global delivery model, leveraging specialized teams to support enterprise clients across North America and beyond.

In June 2024, TSR was acquired by Justin Christian, founder and CEO of BCforward, a global provider of professional services and workforce solutions. This partnership expands TSR's ability to deliver broader capabilities, global delivery resources, and enhanced opportunities for both clients and consultants.

Job Description

We are seeking a Senior Big Data Developer/Engineer to join our dynamic team. The ideal candidate will have strong experience in PySpark, Hadoop ecosystem tools, and streaming data platforms and a proven ability to design, build, and optimize large-scale data pipelines and distributed data systems.

Responsibilities:

• Build and maintain scalable data pipelines using PySpark to process structured and unstructured data.


• Design and develop solutions across the Hadoop ecosystem, including Hive, HDFS, Sqoop, Spark, Impala, and Scala.


• Develop and manage real-time and batch data workflows using streaming platforms for high availability and low latency.


• Write complex SQL queries to extract, validate, and analyze data across distributed systems.


• Design and implement data models and architecture patterns aligned with data warehouse principles.


• Automate scheduling and orchestration using shell scripting and Autosys to improve reliability.


• Identify, assess, and resolve technical risks and data issues to maintain platform integrity.


• Leverage DataBricks for development and collaboration.

Required Skills & Qualifications:

• Hands-on expertise in PySpark and Big Data processing for distributed data workflows at scale.


• Practical experience with Hive, HDFS, Sqoop, Spark, Impala, and Scala in production.


• Proficiency in complex SQL for analysis, transformation, and validation across large datasets.


• Understanding of distributed systems and data flow across processing layers.


• Knowledge of data modeling, data design, and dimensional modeling aligned to data warehouse concepts.


• Competence with shell scripting and job scheduling using Autosys or similar tools.


• Strong analytical and problem-solving ability with independent execution.


• Clear communication skills for technical and non-technical stakeholders.


• Experience level: 6-8 years of professional developer experience.

Preferred Skills:

• Experience with DataBricks.


• Experience with BI platforms, preferably Tableau.

Why TSR?

At TSR, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits.


• Opportunities for growth with global clients.


• A supportive, inclusive culture that values innovation and people.


• Exposure to cutting-edge technologies and projects.

About Our Commitment

TSR is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.