Data Engineer Lead

  • New York, NY
  • Posted 13 hours ago | Updated 13 hours ago

Overview

On Site
Up to $65
Contract - W2
Contract - 12 Month(s)

Skills

Data Lead
ETL
SQL
Python
Scala
Bigdata
snowflake

Job Details

W2 Role. No C2C Accepcted.

Required Qualifications:

8+ years experience with ETL/ELT process and frameworks is a must

8+ years expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL

5+ years proficient in Python and Scala programming for data engineering tasks, automations

8+ years strong in GIT repo and CI/CD deployment process

5+ years experience with Big Data Hadoop, Spark

5-8 years experience in the following domains:

Asset Management

Financial Services

Investment Management

Hedge Fund

Create integration and application technical design documentation.

Conduct peer-reviews of functional design documentation.

Complete development, configuration, test cases and unit testing

Perform code reviews and ensure standards are applied to each solution component.

Resolve complex defects during testing phases and identify root causes.

Drive performance testing.

Production Support: Assist in troubleshooting production environment and tuning environments.

Ensure best practices are followed from a technical perspective during all phases of the project.

Strong Application development experience in Python.

Experience in designing & developing a big data solution using Spark, AWS Glue, Lambda, SNS/SQS, Cloudwatch

Strong Database SQL experience, preferably Redshift.

Experience in Snowflake

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.