Overview
Hybrid3-4 Days every week
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - 12 Month(s)
Skills
Python
Azure Data Factory
credit risk management
data warehouse
SSIS
ETL
Job Details
Role: Senior Data Engineer (Python, SQL, DWH)
Location: NYC(3 Days Hybrid)
Experience: 8+ Years
NOTE: Local candidates only
Job Description :
Must have hands-on:
- Experience in SQL Server as it involves replicating functionality in Snowflake.
- SSIS strongly preferred
- Python
- DBT, Mulesoft, and Alation – good to have
Primary Responsibilities:
- Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
- Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
- Need to have a working knowledge of MS Azure configuration items concerning Snowflake.
- Developing EL pipelines in and out of the data warehouse using a combination of Data bricks, Python and Snow SQL.
- Developing scripts UNIX, Python, etc. to Extract, Load and Transform data, as well as other utility functions.
- Provide production support for Data Warehouse issues such as data load problems, transformation translation problems
- Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
- Understanding data pipelines and modern ways of automating data pipelines using cloud-based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
- Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Basic Qualifications:
- Minimum 5 years of designing and implementing an operational production-grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
- Hands-on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL.
- Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.
Good to Have:
- Experience in Finance / Banking industry – some understanding of Securities and Banking products