Cloud Data Platform Engineer

Hybrid in Toronto, ON, CA • Posted 7 hours ago • Updated 7 hours ago
Full Time
No Travel Required
Hybrid
$40 - $45/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • AWS
  • Apache Airflow
  • Python
  • Apache Iceberg
  • Snowflake
  • Apache Spark
  • Kubernetes
  • Docker
  • CI/CD
  • Git
  • API Ingestion
  • SFTP
  • Streaming Data
  • AWS SQS
  • Webhooks
  • Data Modeling
  • Event-Driven Architecture
  • ETL/ELT
  • Workflow Orchestration
  • Containerization
  • Data Science Support

Summary

***Candidates must be currently authorized to work in Canada on a full-time, permanent basis. StaffRight Associates and our clients do not provide visa sponsorship for this position. This role will be a T4 employee of our client.

 This is an exceptional company seeking exceptional talent!

Preference: 1-2 days on-site in Toronto, ON

Pay Rate: $40.00 – $45.00 CAD / hour

Employment Type: 12-Month Contract (T4) | Potential for extension

StaffRight Associates is looking for a Cloud Data Platform Engineer to join a sophisticated AWS data ecosystem. This role is a technical linchpin, sitting between infrastructure and advanced analytics. You will be responsible for the "plumbing" of the data world—ensuring Data Scientists and ML Engineers have the high-quality, structured pipelines necessary for model development and experimentation.


Core Responsibilities

  • Pipeline Orchestration: Architect and maintain complex data workflows using Apache Airflow, writing production-grade Python code to ensure scalability and reliability.

  • Hybrid Ingestion Strategies: Design ingestion patterns for diverse data sources, utilizing APIs, SFTP, and real-time streaming (AWS Webhooks, SQS, or event-driven approaches).

  • Modern Data Stack Management: Build and manage data movement into Apache Iceberg (AWS-hosted) and facilitate seamless integration into Snowflake.

  • DevOps for Data: Manage pipeline code via Git (branching, PRs, version control) and support CI/CD processes using Kubernetes and Docker containers.

  • ML & Data Science Partnership: Collaborate closely with ML Engineers to provide reliable data environments for large-scale experiments and model training.

  • System Evolution: Participate in architectural discussions to shift the platform toward real-time processing capabilities using Spark and containerized workflows.


Candidate Requirements

  • AWS Expertise: Proven experience engineering within an AWS-based data environment.

  • Orchestration Mastery: Deep, hands-on experience with Apache Airflow for complex workflow management.

  • Advanced Programming: Strong Python skills, specifically for workflow orchestration and automated data processing.

  • Infrastructure Familiarity: Comfort with Docker, Kubernetes, and Spark within a containerized data pipeline architecture.

  • Data Lake/Warehouse Knowledge: Practical experience with Snowflake and modern table formats like Apache Iceberg.

  • Version Control: Proficiency in Git best practices, including managing code reviews and merges in a collaborative environment.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90939179
  • Position Id: 8911382
  • Posted 7 hours ago

Company Info

About StaffRight Associates, LLC

StaffRight Associates is a premier recruitment and staffing partner that provides talent to a broad and diverse range of corporate disciplines. StaffRight was crafted out of an industry need to better manage the processes and complexities of today’s recruitment and staffing demands. With company beginnings formulated in the industry over 30 years ago, our founder realized that there was a definitive need to utilize recruitment and staffing more efficiently and effectively than what has been the typical industry standard model. StaffRight is dedicated to servicing our clients with a comprehensive, scientific approach of refining the process throughout our clients' engagements.  

Understanding and committing to our employees is critical to the growth and sustainability of StaffRight. We are of the opinion that regardless of their expertise, a successful company needs great people. The success of an employee is realized in a variety of different ways, but for us, we go well beyond one's credentials and interview. Finding the best employees who possess the needed skills, experience, and education are certainly key in a hire, but to truly find great employees who feel they are an integral part of the company, it takes tremendous insight in understanding what makes someone successful. Passion for one’s work, commitment to excellence, and having a ‘get it done’ attitude are essential for a great employee. Having these qualities also goes a long way in ensuring that an employee always has the client's best interests in mind. Great employees are passionate about their work and the company where they hang their jacket. Additionally, we believe that having refined and solid communication skills is also paramount in enabling all employees to work together towards the common goals and successes of the company. This collaboration is very much based on our employees' ability to listen to others and respond effectively, both internally with each other, and externally to our clients. 

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in New York, New York

Today

Easy Apply

Full-time

150000 - 200000

Remote or Hybrid in Orlando, Florida

Today

Easy Apply

Full-time

160000 - 180000

Search all similar jobs