Evaluation jobs in Beachwood, OH

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

Principal Practice Enterprise Architect AI

Cleveland, Ohio

•

Today

Job Description The Principal Practice Architect, AI is the architecture decision maker for artificial intelligence across the enterprise. The role owns the standards, reference architecture, guardrails, technology selections and roadmap that every portfolio conforms to when it builds with AI. When this role sets the enterprise standard for an agent framework, a model gateway or an evaluation approach, that is the standard: Portfolio Architects design within it, Solution & Domain Architects con

Full-time

USD 153,842.00 - 200,728.05 per year

Engineering Intern PT

Twinsburg, Ohio

•

Today

Business Unit and Position Summary: Reuter-Stokes, the Crane Nuclear site in Twinsburg, OH, manufactures harsh environment sensors for precise neutron radiation measurement, nuclear reactor power monitoring, UV flame detection, and downhole radiation detection for oil & gas exploration. The Engineering Intern on the manufacturing team will support daily operations as well as perform independent projects to develop and recommend improvements in the manufacturing process to make it safer, more e

Part-time

Clinical Engineer I - Neuro Expansion

Cleveland, Ohio

•

Today

At Cleveland Clinic Health System, we believe in a better future for healthcare. And each of us is responsible for honoring our commitment to excellence, pushing the boundaries and transforming the patient experience, every day. We all have the power to help, heal and change lives - beginning with our own. That's the power of the Cleveland Clinic Health System team, and The Power of Every One. Job Title Clinical Engineer I - Neuro Expansion Location Cleveland Facility Cleveland Clinic Main Cam

Full-time

Director- Technology It

Cleveland, Ohio

•

Today

Location: MetroHealth Old Brooklyn Campus Biweekly Hours: 80.00 Shift: 8a - 5p The MetroHealth System is redefining health care by going beyond medical treatment to improve the foundations of community health and well-being: affordable housing, a cleaner environment, economic opportunity and access to fresh food, convenient transportation, legal help and other services. The system strives to become as good at preventing disease as it is at treating it. Founded in 1837, Cuyahoga County's safet

Full-time

Engineering Intern, Quality

Cleveland, Ohio

•

Today

20600 Emerald Parkway, Cleveland, Ohio 44135 United States of America Why Oatey? Since 1916, Oatey has provided reliable, high-quality products for the residential and commercial plumbing industries, with a commitment to delivering quality, building trust and improving lives. Today, Oatey operates a comprehensive manufacturing and distribution network comprised of industry leading family of companies: Oatey, Cherne, Keeney, Quick Drain, Hercules, Dearborn, Oatey Canada, William H. Harvey, Mast

Full-time

USD 20.00 per hour

Mechanical Engineer - Perry

Hybrid in Perry, Ohio

•

Today

If you have what it takes to become part of the Vistra family and would like to start a promising career with a global leader, take a look at the exciting employment opportunities that are currently available and apply online. Job Summary The Mechanical Engineer provides technical expertise and operational support across a broad range of plant systems and components. This includes valves (motor-operated and air-operated), rotating equipment (pumps and turbines), HVAC systems, chillers, compress

Full-time

Depends on Experience

Field Service Engineer, Cleveland, Ohio

Cleveland, Ohio

•

Today

We are the people who give possibilities purpose BD is one of the largest global medical technology companies in the world. Advancing the world of health is our Purpose, and it's no small feat. It takes the imagination and passion of all of us-from design and engineering to the manufacturing and marketing of our billions of MedTech products per year-to look at the impossible and find transformative solutions that turn dreams into possibilities. Job Description Summary: The BD Pyxis Field Ser

Full-time

USD 28.20 - 45.10 per hour

Health Physicist

Cleveland, Ohio

•

Today

One Physics has been certified as a "Great Place to Work" 3 years in a row as well as "Best Workplaces in Healthcare" in 2022, 2023, 2024 by Fortune. One Physics employees enjoy the support and flexibility of their roles while exhibiting a passion for excellence in all areas of their work. We create a culture where employees feel valued and ensure our communities are receiving the best-in-class treatment they deserve. At One Physics, our mission is to transform the health and safety of our comm

Full-time

USD 100,000.00 - 150,000.00 per year

Senior Engineer - Forging and Metallurgy

Cleveland, Ohio

•

Today

Job Description Summary We are seeking a highly experienced engineer with deep expertise in forging processes, metallurgy, heat treatment, materials characterization, and failure analysis to serve as the technical leader for forging process development and product characterization within our powder metallurgy manufacturing operation. This individual will be the site's primary subject matter expert for forging and metallurgical evaluation, leading initiatives to optimize material properties, imp

Full-time

Electrical/I&C Engineer - Perry Plant Support Engineering

Hybrid in Perry, Ohio

•

Today

If you have what it takes to become part of the Vistra family and would like to start a promising career with a global leader, take a look at the exciting employment opportunities that are currently available and apply online. Job Summary The Electrical/I&C Engineer provides technical expertise and operational support across a broad range of nuclear power plant systems and components. This includes transmitters (pressure, level, temperature), analog PID control circuit boards, electromechanical

Full-time

Depends on Experience

Electrical Engineer - Perry Plant Support Engineering

Hybrid in Perry, Ohio

•

Today

If you have what it takes to become part of the Vistra family and would like to start a promising career with a global leader, take a look at the exciting employment opportunities that are currently available and apply online. Job Summary The Electrical Engineer provides technical expertise and operational support across a broad range of nuclear power plant systems and components. This includes circuit breakers, transformers, motors, electromechanical relays, transmitters, cathodic protection,

Full-time

Depends on Experience

Evaluation jobs in Beachwood, OH 44122, USA