ETL QA Test Engineer

Overview

On Site
$60,000+
Full Time

Skills

ETL
QA
SQL
IBM Data Stage & Microsoft SSIS
Data Warehousing
Data Analysis
Python & Perl
Oracle
PostgreSQL
Test Automation
Big Data & Hadoop
Spark
CI/CD
Agile

Job Details

Technical Skills:
  • SQL:
    Strong SQL skills are essential for querying and manipulating data in relational databases, which are central to the ETL process. This includes understanding joins, aggregations, subqueries, and data manipulation techniques.
  • ETL Tools:
    Familiarity with ETL tools like Informatica, Talend, IBM DataStage, or Microsoft SSIS is important for understanding how data is extracted, transformed, and loaded.
  • Data Warehousing:
    A solid understanding of data warehousing concepts, including schemas (star, snowflake), OLAP, OLTP, and data marts, is necessary.
  • Data Analysis:
    The ability to analyze data, identify patterns, and understand data quality issues is crucial for effective ETL testing.
  • Scripting Languages:
    Proficiency in scripting languages like Python, Shell, or Perl is helpful for automating tasks, developing custom transformations, and integrating with other systems.
  • Database Knowledge:
    Understanding different database management systems (DBMS) like Oracle, SQL Server, MySQL, and PostgreSQL is beneficial.
  • Data Mapping and Transformation:
    The ability to understand and verify data mapping and transformation rules is essential for ensuring data accuracy and consistency.
  • Test Automation:
    Experience with test automation frameworks and tools is highly desirable for building automated tests for data ingestion and transformation jobs.
  • Big Data Technologies:
    Knowledge of big data technologies like Hadoop, Spark, and Hive can be advantageous, especially in organizations dealing with large datasets.
  • Version Control and CI/CD:
    Familiarity with version control systems like Git and Continuous Integration/Continuous Deployment (CI/CD) pipelines is important for managing code changes and automating deployments.
  • Data Quality Management:
    Understanding data quality principles and implementing data quality checks throughout the ETL process is critical.
Soft Skills:
  • Analytical and Problem-Solving Skills:
    ETL testers need strong analytical skills to identify issues, understand data patterns, and develop effective solutions.
  • Attention to Detail:
    A keen eye for detail is necessary to identify even subtle errors in data and ensure data accuracy.
  • Communication Skills:
    The ability to communicate technical findings and recommendations clearly and concisely to both technical and non-technical stakeholders is essential.
  • Teamwork:
    ETL testers often work in teams, so the ability to collaborate effectively and work well with others is important.
  • Time Management:
    The ability to manage multiple tasks, prioritize work, and meet deadlines is crucial in a fast-paced development environment.
  • Agile Methodologies:
    Experience working in Agile/Scrum environments is often required.
  • Adaptability:
    The ability to adapt to new technologies, tools, and processes is important in the ever-evolving field of ETL development.
Key Responsibilities:
  • Designing and executing test cases for ETL processes.
  • Validating data accuracy, completeness, and consistency.
  • Identifying and reporting data quality issues.
  • Automating ETL testing processes.
  • Collaborating with developers and other stakeholders to resolve issues.
  • Participating in Agile ceremonies and contributing to sprint planning.
  • Ensuring data quality throughout the ETL pipeline. Et
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.