ETL SDET with Pyspark Coding Experience

Sensiple Inc is a New Jersey corporation with over two decades of expertise in technology-driven solutions specialising in Customer Experience, Contact Center Solutions, Digital Transformation, Cloud Computing & Independent Testing.

With an expert team that has enriched experience in executing & developing sustainable IT strategies in Healthcare, Technology, Retail, Logistics, Education, Telecommunications, Government and Media, we help our diverse customers to envision the future.

By developing highly scalable and consistent solutions, our primary goal is to deliver excellence at all levels and delight our customers and drive them to a better future.

We are looking for a ETL SDET with Pyspark Coding Experience opportunity with one of our clients.

Job Description

ETL SDET with Pyspark Coding Experience

NYC, NY (Remote)

Long term Contract

Position Summary

The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification

• At least 10 years of IT experience with minimum 5 years of experience in below skills

Tech Skills

• Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language

Experience in Pyspark is Mandatory

• Strong SQL skill with experience in handling big data using ETL tools eg Informatica
• Testing experience in cloud environment AWS s3
• Experience with Test Automation and DevOps practices in ETL and Cloud
• Experience providing testing oversight in Agile team
• Should have excellent business communication to interact with Business teams and cross functional teams

Responsibilities

• Review requirements specifications and technical design documents to understand and feedback
• Experience in developing and implementing test strategies for complex initiatives
• Estimate prioritize plan and coordinate testing activities
• Create automation test framework
• Design develop and execute automation scripts
• Identify record document thoroughly and track bugs
• Strong problem solving skills troubleshooting and root cause analysis skills
• Perform thorough regression testing when bugs are resolved
• Develop and apply testing processes for new and existing features to meet client needs
• Liaise with cross functional teams to identify system requirements
• Track quality assurance metrics like defect densities and open defect counts
• Stay up to date with new testing tools and test strategies requirements
• Support and guide junior team members

Must-Have Skills:

• PySpark Coding Experience
• Python
• AWS S3, Redshift
• Complex SQL
• ETL Testing

Good to Have:

• Kafka, Shell scripting, Healthcare domain

If you find yourself suitable for this position, kindly send your updated resume and expected hourly rate to ranjitnair at sensiple dot com

Regards

Ranjit Nair | Sensiple Inc.,

7 3 2 2 8 3 0 4 9 9 x 234

ranjitnair at sensiple dot com

555 US Highway 1 S, Ste 330 Iselin, NJ 08830

Sensiple, Inc. is an Equal Opportunity Employer, and all qualified applicants will receive consideration for employment without regard to gender, race, colour, religion, sex, national origin, veteran or disability status.