Sr Azure Data Engineer(Databricks/Pyspark)

Hybrid in Mississauga, ON, CA • Posted 2 hours ago • Updated 2 hours ago
Full Time
No Travel Required
Hybrid
$140,000 - $160,000/yr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • ADF
  • Databricks
  • Data Warehouse
  • Data Lake
  • Microsoft Azure
  • PySpark
  • Scala
  • SQL
  • Data Modeling
  • Meta-data Management
  • DevOps
  • Apache Spark
  • ADLS
  • Data Migration
  • Azure Data factory
  • CDC
  • Azure Synapse
  • SparkSQL
  • Medallion Architecture
  • Data Validation
  • Unity Catalog
  • Data Extraction
  • Data Ingestion
  • BFSI
  • Financial
  • Microsoft Power BI
  • Performance Tuning
  • Dashboard
  • ETL Pipelines

Summary

Hello Azure Data Professional!

We are looking for an "Azure Data Engineer in Toronto, ON for a (Hybrid Role)."
Below is the JD for review.
Job Title-: Sr Azure Data Engineer
Location-: Mississauga, ON, Canada (Hybrid)
Role- Full Time
Exp- 8-12 years
Skills:
  • Azure Data Lake Storage,
  • Azure Data Factory,
  • Azure Data Bricks,
  • Azure Synapse,
  • Azure Analysis Server,
  • Azure Devops,
  • Spark SQL,
  • SQL,
  • Data Modelling,
  • Data Warehousing,
  • Pyspark, Scala
Description:
  • Implemented end-to-end solution for migrating on-premises system to Azure Cloud.
  • Analysis of the requirements provided by the client and transforming them into functional and technical specifications.
  • Built the metadata driven Data Ingestion and Data Transformation pipelines using Azure Data factory
  • Have done the performance optimization using delta lake house in databricks
  • Built the complex business logic in Databricks using SparkSQL, SCALA and PySpark
  • Built the Spark applications for data extraction, transformation and aggregation from multiple file formats for analyzing and
  • transforming the data uncover insight into the customer usage patterns.
  • Creation of cubes on Visual Studio on top of Azure Synapse and ADLS which works as a consumption source for visualization on Power BI dashboards.
  • Created multiple complex and dynamic stored procedures using Azure Synapse and scheduled them Using ADF.
  • Have done the performance optimization for Databricks and Stored procedures and reduced the execution time to some extent.
  • Deployed all the Components from one environment to another environment Using Azure Dev ops.
  • Managed the team and responsible for requirement gathering, data modelling, capacity planning, sprint planning, developing and on time delivery of the project.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91162538
  • Position Id: 8931567
  • Posted 2 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Toronto, Ontario

Today

Easy Apply

Full-time

$112000 - $130000

Toronto, Ontario

Today

Easy Apply

Full-time

$110000 - $135000

Mississauga, Ontario

Today

Full-time

USD 74,100.00 - 123,500.00 per year

Mississauga, Ontario

28d ago

Full-time

$87,896 - $93,824

Search all similar jobs