Sr. Data Engineer (Independent & local Consultants Only)

Overview

Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - 12 Month(s)

Skills

Python
Azure Data Factory
credit risk management
data warehouse
SSIS
ETL

Job Details

Role: Senior Data Engineer (Python, SQL, DWH)

Location: NYC(3 Days Hybrid)

Experience: 8+ Years

 

NOTE: Local candidates only

 

 

Job Description :

Must have hands-on:

  • Experience in SQL Server as it involves replicating functionality in Snowflake.
  • SSIS strongly preferred
  • Python
  • DBT, Mulesoft, and Alation – good to have

Primary Responsibilities:

  • Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
  • Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Need to have a working knowledge of MS Azure configuration items concerning Snowflake.
  • Developing EL pipelines in and out of the data warehouse using a combination of Data bricks, Python and Snow SQL.
  • Developing scripts UNIX, Python, etc. to Extract, Load and Transform data, as well as other utility functions.
  • Provide production support for Data Warehouse issues such as data load problems, transformation translation problems
  • Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Understanding data pipelines and modern ways of automating data pipelines using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Basic Qualifications:

  • Minimum 5 years of designing and implementing an operational production-grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
  • Hands-on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL.
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.

Good to Have:

  • Experience in Finance / Banking industry – some understanding of Securities and Banking products