Skills
- Azure
- ETL
- Azure Synapse
- Azure Data Factory
- Azure Cloud
- CI/CD
- Power BI
- Azure Blob storage
- Azure Data Lake Storage gen2
- Azure SQL Database
Job Description
Must Live in TORONTO- Canada
Role And Responsibilities
- Experience in designing and architecting end to end Analytics solution in Azure Cloud.
- Design and build data processing components and systems utilizing cloud compute technologies including Azure Cloud.
- Design requirement driven data models such as dimensional ,relational and data vault.
- Build ELT/ETL pipelines using workflow management applications such as Azure Synapse, Azure Data Factory and distributed computing such as Synapse , Databricks Spark .
- Acquire, analyze, combine, synthesize, and store data from a wide range of internal and external sources as it pertains to system development.
- Builds and tests CI/CD deployment pipelines for data system components.
- Develops and supports monitoring solutions for data systems and components.
- Partner with business and technical leaders to prioritize data needs to expand analytics solution capabilities.
Qualifications And Education Requirements
- 15 years of Industry experience
- 7+ years in data engineering , data warehousing or related field.
- Deep understanding relational database systems , modern Datawarehouse platforms like Azure SQL Synapse.
- Understanding of data lake design, implementation is required.
- Mastery of SQL, Data warehouse design and implementation experience in cross-functional area like Sales & Distribution, Supply Chain , Finance , Marketing etc.
- Experience building and automating data system components that enable:
- Data acquisition, cleansing, and persistence engineering
- Experience with Azure technologies such as Storage solutions Azure Blob storage , Azure Data Lake Storage gen2 , Azure SQL Database etc.
- Experience with Visualization tools like Power BI will be preferred.
- Monitoring the performance of data analysis and system components
- Versioning of data snapshots, data lineage, schemas, and overall database systems
- Deployment through a CI/CD pipeline with Azure DevOps preferred
- Strong PowerShell and cloud compute skills.
- Experience with analytics tools such as Databricks Spark, PySpark etc.
- Experience with modern CI/CD pipeline technologies involving git repositories, static code analysis, test-driven development etc.
- Experience in the full data engineering life-cycle, from business understanding to building operational systems.
- Understanding and experience navigating all types of database models and DBMS's.
- Must have excellent data problem solving skills, communication skills and can execute alone but is an awesome team player.
- Big picture approach a plus - able to incorporate business understanding into design and approach to achieve current value and prepare for future benefit.
- Consulting experience a plus - role includes client-facing meetings and communication.
- Excellent teamwork, coordination, influencing and communication skills.
- Ability to develop timely and effective solutions for challenging design problems.
- B.S. degree in Computer Science related fields