Data Engineer

**NO 3^rd Parties or Sponsorship!

Role Title: Data Engineer

Duration: 6 months but extension up to 3 years

Preferred Location: remote

Role Description:
Secondary project: Lift and shift migration from Azure environment to AWS Snowflake platform for standardization.
Involves machine learning model migration and complex ETL processes requiring external consultant support.
Resource allocation depends on post-audit internal availability assessment.

Requirements:

• Quantity needed: 4-6 data engineers across solution engineering teams.
• Data engineers will be responsible for building and maintaining ETL pipelines to ensure efficient data flow between systems.
• Candidates should have a strong understanding of Snowflake and be familiar with accessing and managing data within the platform.
• Experience with Python and YAML configuration files is preferred, as these skills will aid in data processing and integration tasks.
• Technical skills: Python coding, YAML configuration files, AWS Glue (preferred), database access tools like dBeaver.
• Proficiency in Python coding is essential for data manipulation, automation, and developing data pipelines, enabling efficient data processing and analysis.
• Experience with YAML configuration files is important for defining data workflows and settings in various data engineering tools, facilitating better organization and readability of configurations.
• Familiarity with AWS Glue and database access tools like dBeaver enhances the ability to manage ETL processes, perform data transformations, and interact with databases effectively.
• Platform requirements: Snowflake view creation and access, data analysis capabilities.
• Understanding Snowflake's view creation and access is essential for effective data management and analysis.
• Snowflake allows users to create views that serve as virtual tables, enabling simplified data access and enhanced security by controlling user permissions.
• Data analysis capabilities in Snowflake are robust, supporting SQL queries, integration with BI tools, and advanced analytics features like machine learning and data sharing.