QA Agentic Automation Engineer

Overview

Hybrid
Depends on Experience
Part Time
No Travel Required
Unable to Provide Sponsorship

Skills

A/B Testing
API
Adapter
Amazon DynamoDB
Amazon RDS
Amazon S3
Amazon Web Services
Artificial Intelligence
Evaluation
LangChain
Machine Learning (ML)
Orchestration
Python
Quality Assurance
Remote Desktop Services
Software Engineering
Semantics
Policy Administration
Step-Functions
Agentic
Automation
Kernel
AWS
Lambda

Job Details

 HYBRID MODEL

Skills Mandatory: AI/ML, Agentic AI - (AI Projects with Agentic Automation)

Experience:  5+ years of software engineering experience building production-grade platforms or distributed systems

Expert-level Python skills, including building services, SDKs, and integrations

Key Responsibilities

Design and build a modular platform that integrates Python-based agent frameworks (e.g., LangChain, Semantic Kernel, custom orchestration) and no-code/low-code tools (e.g., MS Copilot Studio).

Implement core services: agent orchestration, prompt/policy management, connector/tool registry, configuration store, and secure secrets handling.

Develop APIs/SDKs/adapters to support multiple model providers and runtimes; enable multi-tenant use by various teams.

Strong AWS experience container orchestration (EKS/Fargate), serverless (Lambda), API Gateway, Step Functions, S3, DynamoDB/RDS, Secrets Manager/KMS, CloudWatch/CloudTrail, IAM

Hds-on with LLM/agent frameworks and providers (e.g., LangChain, Semantic Kernel, OpenAI/AWS Bedrock/Anthropic SDKs) and prompt/agent lifecycle management

Proven LLMOps experience: experiment tracking, offline/online evaluation, telemetry, cost/safety monitoring, and A/B testing

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.