Data Engineer

Title: Data Engineer

Location: Montreal, Quebec (Onsite)

Type: Contract

Description:

• This is a data engineer role in the team responsible for developing the firm's data messaging platforms and data stores that holds both transactional, reference data and aggregated risk measures for real time and archive processing and getting it into the operational data stores (ODS), archives and DataMart. The global team consists of highly technical team members who are adaptable and hands on in software development and life cycle management and proficient in devops. We deliver multiple projects for multiple business areas in parallel. The business owners and subject matter experts are globally distributed making communication to be important.
• The candidate is expected to collaborate closely with our users and support partners. The development is to be performed using an agile methodology which is based on scrum (time boxing, daily scrum meetings, retrospectives, etc.) and XP (continuous integration, refactoring, unit testing, etc.) best practices. Candidates must therefore be able to work collaboratively, demonstrate good ownership and be a team player.

Primary Responsibilities:

• Translate business requirement into queries against a set of relational tables and produce reporting based on the requirements.
• Design and build scalable and performant databases.
• Database and ETL development, including stored procedures, queries, performance tuning, archiving, etc.; using python, SQL and ETL tools.
• Build efficient automation scripts (using Python etc.). The current global team members are all very skilled in domain modeling, database design (both relational and noSQL), big data, kafka, and messaging so this is an excellent opportunity to play a key role in the growing team.

Technical Skills:

• Strong relational database skills especially with DB2/Postgres/Greenplum/Snowflake.
• Knowledge of Spark, Snowflake, and Databricks is desirable.
• Create high quality and optimized stored procedures and queries.
• Experience with Power Designer or some similar modeling tool.
• Python and Unix / K-Shell.
• Strong knowledge base of relational database performance and tuning such as: proper use of indices, database statistics/reorgs, denormalization concepts.
• Familiar with lifecycle of a trade and flows of data in an investment banking operation.
• Experienced in Agile development process.
• Effective communication skills.