Data Engineer

Our client, a leading financial services company is hiring a Data Engineer on a long-term contract basis.
Job ID 83467

Work Location:
Mississauga, Ontario
Summary:
The Applications Development Tech Lead Analyst is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems analysis, development and maintenance activities. This role requires hands-on development and participation in entire software/application development lifecycle.
Responsibilities:

• Manage one or more Applications Development teams in an effort to accomplish established goals
• Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
• Review/analyze/develop proposed technical solutions for projects
• Contribute to formulation of strategies for applications development and other functional areas
• Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
• Provide evaluative judgment based on analysis of factual data in complicated and unique situations
• Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
• Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding the business, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards.

Required Skills:

• The Data Engineering lead will be working very closely with and managing the work of a team of data engineers working on our Big DataPlatform. The lead will need the below core skills -
• Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
• Hands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
• Strong proficiency in Spark for development work related to curation/conformance. Strong Scala development (with previous Java background) preferred.
• Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
• Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
• Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
• Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
• Communication Skills: Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
• DevOps Practices: Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
• Software Engineering Principles: Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
• Data Visualization: Experience with data visualization tools and techniques for presenting data insights effectively.
• Agile Methodologies: Familiarity with agile development methodologies and experience working in agile and scaled agile teams.
• 8-12+ years of relevant experience in the Big Data Application Development
• Experience as Applications Development Manager
• Experience as senior level in an Applications Development role
• Stakeholder and people management experience
• Demonstrated leadership skills
• Proven project management skills
• Basic knowledge of industry practices and standards

Preferred Skills:

• Cloudera/Hortonworks/AWS EMR, S3 experience a plus
• Experience with Cloud Integration on AWS, Snowflake or Google Cloud Platform tech stack components.
• Experience with API development and use of JSON/XML/Hypermedia data formats.
• Analysis and development across Lines of business product/function including Payments, Digital Channels, Liquidities, Trade, Sales, Pricing, Client Experience having Cross train, functional and/or technical knowledge

Education:

• Bachelor's degree/University degree or equivalent experience
• Master's degree preferred

Pay: $58-$72 per hour.

The post appeared first on .