Overview
Skills
Job Details
JOB: Python Data Platform Engineer
EXPERIENCE : 10 Years
LOCATION: Montreal Canada
SKILLS: At least 10 years of experience in data development and solutions in highly complex data environments with large data volumes.
At least 7 years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
At least 7 years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
At least 3 years of experience developing solutions in a hybrid data environment (on-Prem and A At least 3 years of experience developing Airflow DAGs to orchestrate data pipelines that utilize branching, dynamic DAG / task generation, and error handling.
Hands on experience with Snowflake, Apache Spark, Airflow, DBT a must.
Experience with performance tuning SQL queries, Spark job, and stored procedures.
An understanding of E-R data models (conceptual, logical, and physical).
Understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal \ Bi-Temporal models, etc.)