EIS QA Engineer II

Hybrid in Mississauga, ON, CA • Posted 5 days ago • Updated 5 days ago
Contract W2
20 Weeks
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

  • JIRA
  • Python

Summary

EIS QA Engineer II (Hybrid)
Primary Location: Mississauga, Ontario

V-Soft Consulting is currently hiring for an EIS QA Engineer II for our premier client in Mississauga, Ontario.

Education and Experience »
  • Proven experience in a quality assurance, testing, or data analysis role, preferably within the AI/ML domain.
  • A deep understanding of the machine learning lifecycle and the common failure modes of AI models.
  • Hands-on experience with data annotation, data validation, and managing large datasets.
  • Meticulous attention to detail and a methodical approach to problem-solving.
  • Strong analytical skills with the ability to identify patterns in data and draw meaningful conclusions.
  • Expertise with industry-standard test automation tools and libraries (e.g., Selenium, Playwright, Cypress, REST-assured).
  • Experience in testing across different platforms (e.g. comprehensive testing of mobile Android/iOS and web applications).
  • Experience with bug tracking systems (e.g., Jira) and test case management tools.
  • Scripting skills (e.g., Python) for test automation and data manipulation.
  • (Preferred) experience in testing AI systems, including evaluating agentic responses, model performance metrics, and data integrity.
  • Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.
  • Familiarity with computer vision or other specific AI domains relevant to our work.

WHAT YOU’LL DO:
Job Responsibilities:
  • Evaluation Strategy & Benchmark Development: Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks. Proactively identify potential model failure points, including edge cases, adversarial inputs, and sources of bias.
  • Error Analysis & Failure Triage: Conduct systematic error analysis to categorize model failures and identify underlying patterns. Triage defects, prioritize them based on severity and impact, and work with the development team to ensure resolution.
  • Data Sourcing & Curation: Source, curate, and manage high-quality datasets for model evaluation and testing. This includes performing data annotation and validation to ensure the integrity of our ground-truth data.
  • Exploratory & Adversarial Testing (Red Teaming): Perform unscripted, exploratory testing to discover unexpected model behaviors. Participate in red teaming exercises to intentionally challenge our models and identify potential safety and security vulnerabilities.
  • Test Environment Management: Set up, maintain, and troubleshoot testing and demonstration environments to ensure a stable and reliable evaluation pipeline.
  • Reporting & Insights: Analyze and synthesize test results into clear, actionable reports for both technical and non-technical stakeholders. Translate complex findings into concrete recommendations for model improvement.
  • Process Improvement: Actively participate in post-hoc evaluation reviews and contribute to the continuous improvement of our testing methodologies, tools, and overall quality assurance processes.

Interested?
Qualified candidates should send their resumes to

V-Soft Consulting Group is recognized among the top 100 fastest growing staffing companies in North America, V-Soft Consulting Group is headquartered in Louisville, KY with strategic locations in India, Canada and the U.S. V-Soft is known as an agile, innovative technology services company holding several awards and distinctions and has a wide variety of partnerships across diverse technology stacks.

As a valued V-Soft Consultant, you’re eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more. V-Soft is partnered with numerous Fortune 500 companies, exceptionally positioned to advance your career growth.

V-Soft Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

For more information or to view all our open jobs, please visit or call .

#LI-SK10
#INDSP
#MonsterPost
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: vsky001
  • Position Id: 110309
  • Posted 5 days ago
Contact the job poster
RG

Ramesh Geda

Recruiter @ V-Soft Consulting Group, Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Full-time

Depends on Experience

Buffalo, New York

Today

Full-time

USD 116,400.00 - 194,000.00 per year

Remote

Today

Easy Apply

Third Party, Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs