Data Engineer with REST API

Job Title: Data Engineer with REST API
Location: Mississauga, ON (Hybrid)

Overview:

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data modeling, SQL, ETL processes, and expertise working within Azure cloud environment, particularly with Databricks. You will play a pivotal role in designing, developing, and maintaining scalable data pipelines and supporting our data strategy initiatives.

Key Responsibilities:

• Design, develop, and optimize data models and schemas to support business needs.
• Develop, implement, and maintain efficient ETL pipelines using Spark, Databricks, and other tools.
• Write complex SQL queries, stored procedures, and functions to extract, transform, and load data from various sources.
• Collaborate with data analytics and business teams to understand data requirements and deliver solutions accordingly.
• Leverage Azure Data Services, including Azure Data Lake, Azure Data Factory, and Azure Databricks, to build scalable data solutions.
• Ensure data quality, governance, and security standards are maintained throughout all data processes.
• Monitor, optimize, and troubleshoot data pipelines to ensure high performance and availability.
• Document data architecture, workflows, and procedures, and participate in code reviews and best practice development.

Qualifications:

• 6 to 8 years of experience in data engineering, with strong expertise in data modelling and SQL.
• Must have experience in REST API, GraphQL.
• Proven experience with ETL development and data pipeline orchestration.
• Hands-on experience working with Azure cloud platform, specifically Azure Data Factory, Data Lake, and Databricks.
• Strong knowledge of Spark, Python, or Scala for data processing.
• Familiarity with data governance, security, and compliance best practices.
• Excellent problem-solving skills and attention to detail.
• Ability to work independently and as part of a collaborative team.
• Bachelor's degree in Computer Science, Information Technology, or related field.

• Certifications in Azure Data services or Databricks.
• Experience with BI tools and reporting.
• Knowledge of other cloud platforms is a plus.