Data Engineer

Overview

On Site
Full Time
Part Time
Accepts corp to corp applications
Contract - W2
Contract - Independent

Skills

INFORMATICA
SHELL SCRIPTING
PYTHON
GIT
CI/CD
SPARK
SQL

Job Details

Role: Sr. Data Engineer (Only W2-CRI)





Location: NJ, (Need Locals)






Job Description





Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems

Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance

Work in tandem with our engineering team to identify and implement the most optimal solutions

Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design

Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures

Able to manage deliverables in fast paced environments





Areas of Expertise





At least 5-8 years of experience designing and development of data solutions in enterprise environment

At least 2+ years' experience on Snowflake Platform

Strong hands on SQL and Python development

Experience with designing and development data warehouses in Snowflake

A minimum of three years experience in developing production-ready data ingestion and processing pipelines using Spark, Scala

Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic

Good understanding on Metadata and data lineage

Hands on knowledge on SQL Analytical functions

Strong knowledge and hands-on experience in Shell scripting, Java Scripting

Able to demonstrate experience with software engineering practices including CI/CD, Automated testing and Performance Engineering.

Good understanding and exposure to Git, Confluence and Jira

Good problem solving and troubleshooting skills.

Team player, collaborative approach and excellent communication skills




Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Comprehensive Resources Inc.