Overview
On Site
Depends on Experience
Full Time
Skills
Agile
Apache Kafka
Automated Testing
Cloud Computing
Collaboration
Root Cause Analysis
Testing
Workflow
SQL
Scalability
Debugging
Extract
Transform
Load
Test Cases
Test Scripts
Python
Issue Resolution
Data Validation
Job Details
Job Description
Skill: Kafka Tester
Must Have Technical/Functional Skills:
- Apache Kafka: Deep understanding of Kafka's architecture, components, and functionality.
- SQL: Experience with SQL for data validation and debugging.
- ETL: Experience with ETL processes and data warehousing concepts.
- Test Automation: Experience in developing and maintaining automated tests for data pipelines.
- Data Analysis: Ability to analyze data, identify issues, and propose solutions.
- Communication: Strong communication and collaboration skills are essential for working with development teams.
Roles & Responsibilities:
- Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.
- Data Validation: Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
- Kafka Expertise: Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.
- Scripting and Automation: Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
- Issue Resolution: Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions.
- Performance Testing: Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.
- Agile/Scrum: Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
- Data Warehousing: Familiarity with data warehousing concepts and cloud data platforms is often a plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.