Overview
Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Skills
Agile
Amazon Web Services
Apache Kafka
Apache NiFi
Automated Testing
Cloud Computing
Collaboration
Continuous Delivery
Continuous Integration
Data Lake
Data Manipulation
Data Quality
Data Warehouse
ETL QA
Extract
Transform
Load
Good Clinical Practice
Google Cloud Platform
Informatica
Integration Testing
JIRA
Microsoft Azure
Python
Quality Assurance
Real-time
Regression Analysis
Root Cause Analysis
SQL
Scripting
Scrum
Streaming
Test Cases
Test Plans
Test Scripts
Testing
Workflow
Job Details
Job Title: ETL Tester with Kafka & Python Experience
Location: Chicago or New York City Hybrid
Required Qualifications:
7+ years of experience in ETL testing, including both batch and streaming environments.
Strong hands-on expertise in Apache Kafka, including experience with data ingestion and validation in streaming systems.
Proficient in Python for test scripting, data manipulation, and automation.
Solid experience with SQL for querying and validating datasets.
Familiarity with data warehousing concepts and cloud-based data platforms (AWS, Google Cloud Platform, or Azure is a plus).
Working knowledge of Agile/Scrum methodologies and collaboration tools like Jira.
Job Overview:
We are looking for a highly skilled ETL Tester with strong experience in Apache Kafka and Python to join our Quality Assurance team. In this role, you will be responsible for validating complex data pipelines, ensuring data accuracy, and automating test processes in both batch and streaming data environments.
Key Responsibilities:
Design and execute comprehensive test plans and test cases for ETL workflows.
Validate data ingestion, transformation, and loading using Kafka and Python.
Perform end-to-end testing of batch and real-time data pipelines.
Conduct root cause analysis of data issues and work closely with developers to implement fixes.
Develop and maintain automated test scripts for regression and integration testing.
Ensure data quality, consistency, and completeness across various systems.
Preferred Skills:
Experience with tools such as Apache NiFi, Airflow, or Informatica.
Understanding of data lake and data mesh architectures.
Exposure to CI/CD pipelines and test automation frameworks.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.