Senior Platform Engineer - Data and Cloud

We are looking for Senior Platform Engineer - Data and Cloud for our client in Toronto, ON.

Job Title: Senior Platform Engineer - Data and Cloud

Job Location: Toronto, ON

Job Type: Contract

Job Overview:

Requirement/Must Have:

• 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
• Hands-on experience in AWS and Hadoop ecosystems.
• Experience in data migration projects (e.g., Hadoop to AWS, DB migrations).
• Strong understanding of data warehousing concepts and ETL design patterns.
• Expertise in query optimization and performance tuning.
• Experience supporting production data platforms.
• Bachelor s degree in Computer Science, Engineering, or related field.

Responsibilities:

• Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies.
• Lead and support data platform migration initiatives (On-Prem to AWS Cloud).
• Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar.
• Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow.
• Build and optimize data workflows and orchestration pipelines using Airflow.
• Work with real-time streaming technologies such as Kafka and Spark Streaming.
• Perform data ingestion, transformation, and validation from multiple data sources.
• Optimize SQL queries for performance and scalability.
• Monitor system performance, troubleshoot issues, and ensure system reliability.
• Collaborate with cross-functional teams including developers, architects, and infrastructure teams.

Nice to Have:

• Experience in Banking / Financial Services domain.
• Experience with data lake architecture and governance.
• Knowledge of DevOps tools and CI/CD pipelines.
• Experience in platform engineering and framework development.

Skills:

• Strong experience in AWS Cloud services: EMR, EC2, S3, VPC, RDS, Redshift.
• AWS Glue, IAM, CloudWatch, CloudFormation.
• Airflow (or AWS Managed Workflows).
• Experience working with SQL-based systems: SQL Server and PostgreSQL.
• Data warehouses: Teradata, Redshift, Netezza.
• Hands-on experience with ETL Tools like SSIS.
• Strong proficiency in SQL and Shell scripting.
• Good to have: Python.
• Strong experience in Unix/Linux environments.

Qualification And Education:

• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to work independently and lead initiatives.
• Experience mentoring team members.