AI Software Development Engineer in Test

AI Software Development Engineer in Test

Responsibilities:

• Help create a culture that motivates teams to ensure zero defects leak into production.
• Work across teams to understand enterprise quality requirements and ensure adoption of core processes and standards.
• Implement the shift-left test strategy for each line of business
• Leverage open-source automation frameworks and tools across all levels of testing that integrate in the automated CI/CD pipeline.
• Participate in the Agile (Scrum) team process, perform required standard testing activities keeping the customer experience top of mind during the testing process.
• Work with internal teams to document test environment and test data management container strategies and provisioning for the different types of testing activities.
• Comprehend and decompose user stories/requirements to identify what tests need to be created and automated across all levels of testing.

Qualifications:

• 5+ years of experience in testing automation engineering with both functional & API based testing
• Preferred BS/MS in Computer Science, Engineering, or related subject

Required Skills & Experience

• Proficiency writing code in Python
• Experience writing end to end test scripts utilizing multiple services and reporting results
• Experience using SQL to join and query data across multiple tables and schemas
• Experience with AWS services including
  • S3, Lambda, Dynamo DB, Cloudwatch, etc
• Experience with CI/CD supporting technologies
  • GIT, GitLab, Docker
• Experience with up-to-date AI paradigms
  • Large language models
  • Classification models
  • MCP
  • RAG
  • Dynamic prompting for LLMs

Preferred Skills & Experience

• Experience automating API tests and extensive knowledge of creating and leveraging mocks, stubs, and virtual services to fulfill test automation requirement
• Automating tests for the full solution stack (unit, business logic, contract, usability, functional, performance)
• Experience testing AI implementations and an understanding of the risks models pose to systems and the business at large

Major plus with direct experience in the following

• Experience leaving feedback on Merge/Pull Requests to ensure teams follow best practices
• Financial services technology / consumer banking testing experience
• Experience with Genesys IVR and Salesforce is a plus

Extensive knowledge of:

• White Box Testing practices
• Software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control, build and release processes, continuous integration and continuous deployment concepts (CI & CD), and test suite development and maintenance

Working knowledge of:

• Commonly used ML/AI Python libraries/packages
  • Spacy, nltk, etc
• Experience in troubleshooting issues and root cause analysis
• Possesses a deep understanding of shift-left test practices and techniques along with the frameworks, and tools that support it.
• Strong written and verbal communication skills.
• Enthusiastic and energetic with an inherent curiosity to break code.