Data Quality Engineer

  • Jersey City, NJ
  • Posted 32 days ago | Updated moments ago

Overview

Remote
On Site
Hybrid
BASED ON EXPERIENCE
Contract - Independent
Contract - W2
Contract - 9+ mo(s)

Skills

QA
QA ENGINEER
ETL
SQL
HADOOP
PYTHON

Job Details

Data Quality Engineer

100% Remote.

Be an expert in writing and executing test cases, managing and analyzing large sets of data, creating automation scripts, and communicating relevant insights to the team

Love to collaborate with other data professionals, engineers, and business operation experts to understand and address reporting needs

Experience with both traditional and big data streaming

Create and maintain complex SQL queries such as; type 2 triggers, various joins, aggregations, groupings, and more

Execute ETL jobs using orchestration tools (airflow/scheduler/SQL agent)

Have a working knowledge and testing experience of ETL

Be proactive with leadership abilities with a strong "can do attitude

Possesses heavy experience with automation testing for ETL

Highly detailed oriented

Strong willingness & comfort in taking on and challenging development approaches

Conduct and facilitate UAT

Previously worked in Agile and Scrum

What You Will Need:

Solid understanding of test Automation architecture, framework, and Automation script creation using programming language Python, Bash Scripts, etc. and Orchestration tools like Apache Airflow, Luigi

Strong knowledge of creating SQL queries for source to target database validation and Data warehouse testing

Hands-on experience interpreting and understanding data models and ER diagrams

Experienced in traditional SQL DB (MySQL, Postgres, SQL server) and cloud-native data warehouses Snowflake or Redshift

Experienced in ETL tools Informatica, ab initio, Talend, and reporting tools - Tableau and PowerBI

Create and execute strategies and test cases for applications that use ETL components

CI/CD implementation through Jenkins/GitLab/Maven

Experienced with Client ALM, Jira, rally any agile test management tools

Implement the orchestration of business flows on given problem statements for the automation of complex scenarios

Review technical requirements with data warehouse and business intelligence terminology to produce test strategies, test scenarios, and test cases for the data warehouse team

Create the test plan for the software release, defining resources, and test suites required for each test cycle, dependencies, risks, and the overall strategy for testing complex systems and applications

Experienced in using frontend (UI) to generate test scenarios and validate data in the backend

Write Python test using unit test framework

Experience with Kafka messaging is desired

Rest APIs

Docker and Kubernetes experience is a nice to have

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.