Evaluation jobs in alabaster, al

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Senior DevSecOps Engineer

Hybrid in Birmingham, Alabama

•

27d ago

Senior DevSecOps Engineer Permanent Full-Time Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia SC Position Description This role focuses on improving software supply chain security, artifact management, open-source governance, CI/CD security, SBOM generation, artifact signing, and software provenance across enterprise environments. Key Responsibilities Enhance artifact management, policy governance, and open-source lifecycle processes using tools such as Sonatype Lifecycle (IQ Server)

Easy Apply

Full-time

$104000

Senior DevSecOps Engineer - Birmingham, AL

Hybrid in Birmingham, Alabama

•

23d ago

Job Title: Senior DevSecOps Engineer Locations: Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Type: Direct Hire Work Model: Hybrid Hours: 40.0 Responsibilities Enhance artifact management, policy governance, and open source lifecycle processes using tools like Sonatype and Nexus Repository.Build and automate software approval workflows, quarantine/waiver processes, and repository proxy strategies across supported ecosystems.Drive dependency upgrades and vulnerability remediation

Easy Apply

Full-time

$139300

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Senior Quality Engineer – AI/LLM Test Automation

Birmingham, Alabama

•

14d ago

Position : Senior Quality Engineer AI/LLM Test Automation Location: Birmingham, AL Type: Full-Time Must Have 5+ years of QA / SDET / Test Automation experience.12+ years of hands-on experience testing AI/LLM applications.Hands-on experience with LLM evaluation / AI evaluation.Experience creating or working with evaluation datasets and ground truth.Understanding of LLM judges / AI-as-a-judge, evaluators, scoring, and quality thresholds.Experience testing nondeterministic AI-generated outputs.Han

Easy Apply

Full-time

120000

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Engineering Intern - Space & Propulsion Systems

Birmingham, Alabama

•

Today

GENERAL JOB SUMMARY: Job Description: Kratos Defense & Rocket Support Services/SRE (KSRE) is a market leader in testing, characterization, and understanding of advanced materials in extreme environments. From advanced carbon-carbon composites to complex refractory metals, KSRE brings world-class expertise and test facilities to the problems facing government and commercial customers in the aerospace, defense, and industrial sectors. The Engineering Intern will gain hands-on experience working

Full-time

Principal Forward Deployed Data Scientist

Alabama

•

Today

Job Description Principal Forward Deployed Data Scientist This is a very senior, hands-on technical leadership role for a data scientist who has built real, production AI applications for internal teams and for customers and knows what it takes to take an idea all the way from prototype to production within a regulated environment. You'll sit at the intersection of our business, our users, and the bleeding edge of AI. You won't be handed a spec you'll work directly with stakeholders to u

Full-time

USD 235,000.00 - 285,000.00 per year

Substation Control Design - Engineer/Designer (Birmingham, AL)

Birmingham, Alabama

•

Today

Job Description Substation Control Design - Engineer/Designer Southern Company Services Technical Shared Services - Substation Engineering This position will be located at The Energy Center in Birmingham, AL TRAVEL & WORK LOCATION This position requires approximately 25% of travel to the surrounding areas Alabama, Mississippi, and Georgia.The role is based out of The Energy Center (HWY 280), Birmingham, AL. Relocation assistance may be provided for candidates not currently living within a reas

Full-time

Mechanical Engineer

Birmingham, Alabama

•

Today

General Summary This position is for a Mechanical Engineer responsible for executing the mechanical design of devices incorporating complex moving components such as levers, gears, springs, and bearings. The engineer is responsible for full-lifecycle mechanism design, including conceptualization, 3D CAD modeling, and hardware validation. The engineer is also responsible for preparing project proposals, creating mechanical drawings, interacting with fabricators, and completing those projects on-

Full-time

TEMPORARY TALENT WORKFORCE: Specialist Lead, Analytics & Insights (Data Visualization)

Birmingham, Alabama

•

Today

TEMPORARY TALENT WORKFORCE: Specialist Lead, Analytics & Insights This is a temporary salaried opportunity to join Deloitte Services LP for a short-term assignment. We are currently seeking a candidate to fill our Specialist Lead, Analytics & Insights role between October 2026 - May 2027 for our People Analytics team. Recruiting for this role ends on November 6, 2026. This role is remote. Work you'll do Translate requirements and user stories into wireframes and prototypes in Figma, applyin

Full-time

Principal Engineer

Birmingham, Alabama

•

Today

Impact As a Principal Agentic Engineer in Gig Operations, you will architect and deploy Shipt's foundational Agentic AI platform to optimize real time routing, pay, and coverage across our national fulfillment network. You will spend your days collaborating with cross functional data science, engineering, and product teams to integrate autonomous reasoning loops, tool binding frameworks, and multi agent orchestration directly into high throughput microservices. Your work directly drives the core

Full-time

USD 140,000.00 - 235,000.00 per year

Lead AI Agent Engineer

Hybrid in Birmingham, Alabama

•

20d ago

Job Title: Lead AI Agent Engineer Location: Birmingham, AL, Knoxville, TN or Lafayette, LA Type: Permanent Full Time Responsibilities Implement, administer, secure, and support enterprise AI coding agent and developer productivity platforms within a large-scale financial services environment.Take AI coding agent capabilities beyond proofs of concept into secure, production enterprise environments.Work independently on complex integrations, establish technical standards and controls, develop vali

Easy Apply

Full-time

Depends on Experience

IT Manager - Software Engineering

Birmingham, Alabama

•

Today

Responsibilities Own the full employee lifecycle for the software development team, including recruiting, hiring, onboarding, development, performance evaluation, and retention, in partnership with the IT Director.Manage, mentor, and develop software engineers at all levels, building a team culture of trust, accountability, shared ownership, and continuous learning.Own the management of in-house software development, including scope, quality, and timelines, and coordinate outside consulting res

Full-time

Evaluation jobs in Alabaster, AL, USA