AI Software Development Engineer in Test

Responsibilities

Help create a culture that motivates teams to ensure zero defects leak into production.
Work across teams to understand enterprise quality requirements and ensure adoption of core processes and standards.
Implement the shift-left test strategy for each line of business
Leverage open-source automation frameworks and tools across all levels of testing that integrate in the automated CI/CD pipeline.

Participate in the Agile (Scrum) team process, perform required standard testing activities keeping the customer experience top of mind during the testing process.

Work with internal teams to document test environment and test data management container strategies and provisioning for the different types of testing activities.
Comprehend and decompose user stories/requirements to identify what tests need to be created and automated across all levels of testing.

Qualifications

5+ years of experience in testing automation engineering with both functional & API based testing
Preferred BS/MS in Computer Science, Engineering, or related subject
Required Skills & Experience
- Proficiency writing code in Python
- Experience writing end to end test scripts utilizing multiple services and reporting results
- Experience using SQL to join and query data across multiple tables and schemas
- Experience with AWS services including
  - S3, Lambda, Dynamo DB, Cloudwatch, etc
- Experience with CI/CD supporting technologies
  - GIT, GitLab, Docker
- Experience with up-to-date AI paradigms
  - Large language models
  - Classification models
  - MCP
  - RAG
  - Dynamic prompting for LLMs
- Preferred Skills & Experience
  - Experience automating API tests and extensive knowledge of creating and leveraging mocks, stubs, and virtual services to fulfill test automation requirement
  - Automating tests for the full solution stack (unit, business logic, contract, usability, functional, performance)
  - Experience testing AI implementations and an understanding of the risks models pose to systems and the business at large
- Major plus with direct experience in the following
  - Experience leaving feedback on Merge/Pull Requests to ensure teams follow best practices
  - Financial services technology / consumer banking testing experience
  - Experience with Genesys IVR and Salesforce is a plus
- Extensive knowledge of:
  - White Box Testing practices
  - Software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control, build and release processes, continuous integration and continuous deployment concepts (CI & CD), and test suite development and maintenance
- Working knowledge of:
  - Commonly used ML/AI Python libraries/packages
    - Spacy, nltk, etc
  - Experience in troubleshooting issues and root cause analysis
  - Possesses a deep understanding of shift-left test practices and techniques along with the frameworks, and tools that support it.
  - Strong written and verbal communication skills.
  - Enthusiastic and energetic with an inherent curiosity to break code.

AI Software Development Engineer

Similar Jobs