Overview
Skills
Job Details
DATA Engineer/Big DATA Engineer/Developer who is comfortable to work in QA space.
Work with the Big Data Engineering team to develop automated testing frameworks.
Develop testing applications that will generate and validate data for big data systems.
Design and implement automated testing systems using Python.
Develop and update scripts in Bash and Python/Pyspark.
Have working knowledge of Google Cloud Platform with BigQuery(preferred), Dataproc.
Develop SQL/Analytical SQL queries to extract data from various database tables and perform data validation and verification;
Run data analytics in Spark using Spark SQL;
Perform bug tracking and defect management using JIRA.
Create test plans and test cases for assigned components.
Work with product managers and development leads for creating testing strategies.
Help create and implement quality processes and requirements, identify and communicate risks about releases.
Contribute in building a flexible and scalable data testing automation solution.