ETL SDET with Pyspark (W2 Resource)

Overview

Remote
Full Time
Part Time
Accepts corp to corp applications
Contract - W2
Contract - Independent

Job Details

This is Sai Vikas from Tek Leaders. One of our client is looking for ETL SDET with (Pyspark Coding Experience) @ NYC, NY (Remote). you can reach me at

Role: ETL SDET with (Pyspark Coding Experience) (W2 Resource)

Location: NYC, NY (Remote)



We have an urgent ETL SDET requirement. Please share profiles with 10+ years of experience

Must-Have Skills:

  • PySpark Coding Experience
  • Python
  • AWS S3, Redshift
  • Complex SQL
  • ETL Testing



Good to Have:

  • Kafka, Shell scripting, Healthcare domain

Note: Only ETL SDET profiles will be considered.

Important:

  • All the skills mentioned in the skill matrix must be clearly highlighted in the candidate s resume.
  • Resumes without the required skills and experience explicitly mentioned will be treated as invalid and will not be considered.

Skill Matrix


Skills

Years of Exp

Year lastly Used

Rating Out of 10

SDET

ETL

Python

Pyspark Coding (Must)

AWS S3

Strong SQL

Position Summary

The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification:

  • At least 10 years of IT experience with minimum 5 years of experience in below skills
  • Tech Skills
  • Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language
  • Experience in Pypark is Mandatory
  • Strong SQL skill with experience in handling big data using ETL tools eg Informatica
  • Testing experience in cloud environment AWS s3
  • Experience with Test Automation and DevOps practices in ETL and Cloud
  • Experience providing testing oversight in Agile team
  • Should have excellent business communication to interact with Business teams and crossfunctional teams

Responsibilities:

  • Review requirements specifications and technical design documents to understand and feedback
  • Experience in developing and implementing test strategies for complex initiatives
  • Estimate prioritize plan and coordinate testing activities
  • Create automation test framework
  • Design develop and execute automation scripts
  • Identify record document thoroughly and track bugs
  • Strong problem solving skills troubleshooting and root cause analysis skills
  • Perform thorough regression testing when bugs are resolved
  • Develop and apply testing processes for new and existing features to meet client needs
  • Liaise with cross functional teams to identify system requirements
  • Track quality assurance metrics like defect densities and open defect counts
  • Stay up to date with new testing tools and test strategies requirements

Support and guide junior team members

Thanks & Regards

Sai vikas Vemula

Sr IT recruiter

Email ID:

5151 Headquarters Dr.Suite: 105, Plano, TX 75024.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.