AI Evaluation & Benchmarking Engineer
GlobalLogic Inc.
Dice Job Match Score™
🔗 Matching skills to job...
Job Details
Skills
- Reinforcement Learning
- Langchain
- Python
- LLM
- Benchmarking
- Artificial Intelligence
- Machine Learning (ML)
- Evaluation
Summary
- Hands-on reinforcement learning experience.
- Experience using LLMs for agents, evaluation, reasoning, automation, or benchmark workflows.
- Strong Python experience for ML, data workflows, experimentation, and analysis.
- Experience designing and running experiments with statistical and analytical rigor.
- Strong understanding of evaluation metrics, scoring frameworks, performance comparison, and benchmark design.
- Experience analyzing structured logs, run outputs, model/agent performance, and experiment results.
- Ability to work across APIs, logs, CLI/tools, data structures, and platform workflows.
- Strong communication skills to translate experiment findings into platform improvement requirements.
- Ability to work inside client-owned repositories, infrastructure, workflows, and security controls.
- The ability to develop text-based and multimodal agents using Python and LLMs
- The ability to use frameworks (e.g., LangChain) to build agents that can manage reasoning flows
- Dice Id: RTL65472
- Position Id: IRC299413
- Posted 7 hours ago
Company Info
The leader in software R&D services, GlobalLogic has created a network of global innovation hubs throughout the US, India, Ukraine, China and Argentina that connects clients with 3,000 of the brightest and most innovative software minds through an award-winning platform (GlobalLogic Velocity ) for distributed Agile R&D.
GlobalLogic leverages its proven Agile tools and processes, as well as a decade of experience building thousands of market-leading products, to provide clients with a full range of lifecycle services, including advisory, ideation, customer research, engineering, QA/IVT, maintenance & support, and product line management. The company has ongoing partnerships with more than 150 clients in markets such as Digital Media, Electronics, Finance, Healthcare, Infrastructure Software, Retail and Telecom.
If you are a California resident, more details on how we process your personal information can be found in the CCPA Recruitment Privacy Notice (https://www.globallogic.com/privacy/ccpa-recruitment-privacy-notice/)
Top Rank
Ranked an Inc. 500 company Recognized as a top global employer since 2005 Has global innovation hubs in U.S., India, Ukraine, China and Argentina
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs