AI Automation Test Engineer - Charlotte, NC

DTS is looking for AI Automation Test Engineer for our direct client Position in Charlotte, NC.

Job Responsibilities

• Help create a culture that motivates teams to ensure zero defects leak into production.
• Work across teams to understand enterprise quality requirements and ensure adoption of core processes and standards.
• Implement the shift-left test strategy for each line of business
• Leverage open-source automation frameworks and tools across all levels of testing that integrate in the automated CI/CD pipeline.
• Participate in the Agile (Scrum) team process, perform required standard testing activities keeping the customer experience top of mind during the testing process.
• Work with internal teams to document test environment and test data management container strategies and provisioning for the different types of testing activities.
• Comprehend and decompose user stories/requirements to identify what tests need to be created and automated across all levels of testing.

Qualifications

• 5+ years of experience in testing automation engineering with both functional & API based testing
• Preferred BS/MS in Computer Science, Engineering, or related subject

Required Skills/Experience

• Proficiency writing code in Python
• Experience writing end to end test scripts utilizing multiple services and reporting results
• Experience using SQL to join and query data across multiple tables and schemas

Experience with AWS services including:

• S3, Lambda, Dynamo DB, Cloudwatch, etc

Experience with CI/CD supporting technologies:

• GIT, GitLab, Docker

Experience with up-to-date AI paradigms

• Large language models
• Classification models
• MCP for agentic workflows
• Dynamic prompting for LLMs

Preferred Skills/Experience

• Experience automating API tests and extensive knowledge of creating and leveraging mocks, stubs, and virtual services to fulfill test automation requirement
• Automating tests for the full solution stack (unit, business logic, contract, usability, functional, performance)
• Experience testing AI implementations and an understanding of the risks models pose to systems and the business at large

MAJOR PLUS Direct experience in the following:

• Experience leaving feedback on Merge/Pull Requests to ensure teams follow best practices
• Financial services technology / consumer banking testing experience
• Experience with Genesys IVR and Salesforce is a plus

Extensive knowledge of:

• White Box Testing practices
• Software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control, build and release processes, continuous integration and continuous deployment concepts (CI & CD), and test suite development and maintenance

Working knowledge of:

• Commonly used ML/AI Python libraries/packages: Spacy, nltk, etc
  • Experience in troubleshooting issues and root cause analysis
  • Possesses a deep understanding of shift-left test practices and techniques along with the frameworks, and tools that support it.
  • Strong written and verbal communication skills.
  • Enthusiastic and energetic with an inherent curiosity to break code.

Soft Skills:

• High communication and clarity skills
• Self-starter, figures out things independently, but works collaboratively
• Not afraid to not know something, but to ask when you don't know

Hard Skills:

• Python OOP and scripting, largely in the context of integration testing
• Understanding of how APIs work and how to test them
• Understanding of AI concepts such as LLM, classification model, MCP, RAG

DTS offers excellent compensation package.

Contact :

Ajay Bharbutta
Team Lead
Digital Technology Solutions (DTS)