Evaluation jobs in Alpharetta, GA

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Planning Evaluator

Atlanta, Georgia

•

Today

Overview DecisionPoint is seeking a Planning Evaluator to join our team in Atlanta, GA, to provide advanced planning, coordination, and implementation of the agency's standard response evaluation approach, including analytic support for public health programs and preparedness exercises. The contractor will support evaluation aspects of agency-wide responses and functional exercises to inform decision-making, improve response capabilities, and strengthen public health outcomes. This is a 100% in

Full-time

Google Cloud Platform AI Architect / Diamond Layer Tech Lead NJ/Atlanta, GA (Hybrid) Advanced Python, Agentic AI/LLM Agents, Multi-Agent Orchestration, RAG, Knowledge Graphs, RDF, SPARQL, SHACL, Ontology Modeling, Stardog, Google Cloud Platform/GKE, BigQuery, Advanced SQL, Langfuse, Grafana, LLM Evaluation, AI Security & Governance.

Atlanta, Georgia

•

24d ago

Google Cloud Platform AI Architect (Diamond Layer Tech Lead)* Location - NJ/ATL (Hybrid) Role Overview We are seeking a Diamond Layer Tech Lead to lead the architecture and implementation of enterprise AI orchestration, domain agents, semantic retrieval, knowledge graphs, and supporting data foundations. This role will own the technical architecture connecting the Master Coordinator, domain agents, tools, RAG systems, semantic platforms, and enterprise data sources, with a strong emphasis on gro

Easy Apply

Contract, Third Party

Depends on Experience

Agentic / AI Architect

Hybrid in Alpharetta, Georgia

•

15d ago

Job DescriptionResponsible for overall architecture of the application (including design and analysis of software projects) to create new applications or improve existing applications. Provide expertise into system, language and platform choices for teams to enable teams to run software tests, develop product prototypes, create technical documents and manuals relating to software application development. Skill/Experience/Education Mandatory Skills 8 years relevant client experience in similar te

Easy Apply

Contract, Third Party

80 - 90

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Engineer 2 - P&C

Marietta, Georgia

•

Today

Job Description Position Overview: This is the second level of the Engineering classification. Provide engineering/technical expertise to solve more complex problems in a specific area of expertise, with some supervision. Incumbents are expected to develop advanced skills and the ability to work with greater independence. Duties & Responsibilities Under some direct supervision, in the area of expertise will provide: engineering/technical expertise and guidance in the identification, analysis,

Full-time

Semantic Data Eng

Atlanta, Georgia

•

Today

Job Summary Location: United States Experience: 5+ years in Semantic Data Engineering Job Type: Permanent Thinking Minds' client is looking for an experienced Senior Semantic Data Engineer to enhance their data solutions team. The role is crucial for creating a shared enterprise understanding of business concepts, relationships, rules, and measures. This helps people, applications, processes, and AI interpret and use data consistently. The position involves carrying solutions from discovery thr

Full-time

Engineer 1 - P&C

Marietta, Georgia

•

Today

Job Description Position Overview: Provide substation protection and control design, engineering, technical support, and oversight to a transmission substation engineering and design team for the purpose of delivering safe, cost-effective, and quality engineering and design services. Provide technical competency and direction on complex engineering and technical problems for projects including a wide range of utility substation projects, battery energy storage systems and solar collector substa

Full-time

Engineer I - Physical

Marietta, Georgia

•

Today

Job Description Position Overview: Provide substation physical engineering and technical support to a Transmission Substation engineering and design team for the purpose of delivering safe, cost-effective, and quality engineering and design services. Provide technical competency and direction on complex engineering and technical problems for projects including a wide range of utility substation projects, battery energy storage systems and solar collector substations. Duties & Responsibilities

Full-time

Applied Gen AI Engineer

Hybrid in Alpharetta, Georgia

•

Yesterday

ONLY 6+ YEARS EXPERIENCEFULL-TIMECore Focus: Applied Gen AI and PythonSkills and experience requiredCore skills 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.Strong Python and SQL skills.Hands-on experience with Generative AI and Large Language Models (LLMs).Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.Experience building and deploying production-ready ML solutions.Strong understanding of data pip

Easy Apply

Full-time

$100,000 - $120,000

2027 Summer Intern - System Engineer

Alpharetta, Georgia

•

Today

Overview As a System Engineer Intern, you would be engaging in several parts of the V-Cycle at once. Propose customer-tailored solutions using Stryten's Lithium building blocks, evaluating feedback from customers, and understanding failure modes. Also, you will evaluate needs, elicit requirements, create and execute verification and validation plans of Stryten's new generation of lithium packs. Join us for a paid internship from May to August 2027! We are looking for students who are ready to

Full-time

Structural Engineer (Construction Engineering Focus)

Atlanta, Georgia

•

Today

Responsibilities This position requires performing the engineering of entire projects, systems, or components of varying degrees of complexity under the direction of a Senior Engineer. This includes directing the efforts of other engineers to perform and deliver specific engineering deliverables and reviewing their work to confirm adequacy. Typical Responsibilities and Duties include the following (other duties may be assigned): Perform structural engineering design of temporary structures use

Full-time

Engineer 3 - P&C

Marietta, Georgia

•

Today

Full-time

Evaluation jobs in Alpharetta, GA, USA