Evaluation jobs in Albany, NY

Remote

•

Today

Join the Enterprise Agent Development Platform project at EPAM. We are building a cloud-native platform that enables engineering teams to develop, deploy, and operate AI agents in production. The platform combines modern agent frameworks, AWS infrastructure, CI/CD, observability, and governance to make AI development faster and more reliable. As a Python AI Evaluation Engineer , you will own a key part of this platform: building the capabilities that measure and validate the quality of AI soluti

Full-time

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Remote

•

Today

Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firms products and agents will do various business functions which must be auditable. The standard is correct results every time, not good enough for a personal assistant. Because large language models are probabilistic, this takes re

Easy Apply

Contract

Depends on Experience

Mainframe Architect (z/VM)

Albany, New York

•

3d ago

Our goal is to solve problems and deliver results for our clients. At Cloud and Things, you can be a part of transforming the public sectors IT environment. Our team is on the forefront of helping to solve the government's most complex IT challenges. If you are seeking a role that offers the opportunity to work on rewarding projects, consider a career with Cloud and Things. *This is an exempt position. Salary commensurate with experience* Job Title: Mainframe Architect (z/VM) Location: Al

Easy Apply

Full-time

Depends on Experience

DB2 Migration Specialist

Albany, New York

•

6d ago

Our goal is to solve problems and deliver results for our clients. At Cloud and Things, you can be a part of transforming the public sectors IT environment. Our team is on the forefront of helping to solve the government's most complex IT challenges. If you are seeking a role that offers the opportunity to work on rewarding projects, consider a career with Cloud and Things. This is an exempt position. Salary commensurate with experience Job Title: DB2 Migration Specialist / DB2 Architect Locat

Easy Apply

Full-time

Depends on Experience

AWS Solutions Architect

Hybrid in Schenectady, New York

•

3d ago

Our goal is to solve problems and deliver results for our clients. At Cloud and Things, you can be a part of transforming the public sectors IT environment. Our team is on the forefront of helping to solve the government's most complex IT challenges. If you are seeking a role that offers the opportunity to work on rewarding projects, consider a career with Cloud and Things. This is an exempt position. Salary commensurate with experience Job Title: AWS Solutions Architect Location: Schenectady,

Easy Apply

Full-time

Depends on Experience

Quality Assurance/Tester

Hybrid in Albany, New York

•

6d ago

Our goal is to solve problems and deliver results for our clients. At Cloud and Things, you can be a part of transforming the public sectors IT environment. Our team is on the forefront of helping to solve the government's most complex IT challenges. If you are seeking a role that offers the opportunity to work on rewarding projects, consider a career with Cloud and Things. *This is an exempt position. Salarycommensuratewith experience* Job Title: Quality Assurance/Tester Location:Albany, NY (

Easy Apply

Full-time

Depends on Experience

AI voice Evaluation Specialist

Remote

•

7d ago

Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavyaccent will not work. Previous experience is Speech Annotation or Audio engineering, or Podcasting. Job Description Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact

Easy Apply

Third Party, Contract

Depends on Experience

Software Engineer AI Evaluation & Automation

Remote

•

2d ago

Software Engineer AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities Build and integ

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer, Evaluation Engine

Remote

•

Today

At Vanta, our mission is to help businesses earn and prove trust.We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our Senior Software Engineers independently drive complex technical work, shape the systems and technical decisions within their teams, and enable other eng

Full-time

USD 195,000.00 - 229,000.00 per year

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Remote or San Francisco, California

•

Today

Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products. Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire peo

Full-time

USD 206,100.00 - 269,075.00 per year

Staff Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road, and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle exp

Full-time

Senior Software Engineer, Autonomy Evaluation

Remote

•

Today

Job Description General Motors is a global leader in advanced driver assistance. With Super Cruise hands-free technology in more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven, GM is proving that automation can be trusted, intuitive, and helpful. GM has the global reach to bring cutting-edge advances to everyday drivers at unprecedented scale. Join us to help deliver the next generation of safe and delightful personal autonomous vehicle expe

Full-time

Sr. Software Engineer I, Evaluation Services (Scala)

Remote or Chicago, Illinois

•

Today

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles-including job descriptions, compensation, and benefits-can only be guaranteed on our official job board. For the latest listings and details, please visit: ;br> JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their finan

Full-time

USD 125,000.00 - 175,000.00 per year

IBM Cognos Developer or BI Expert

Rensselaer, New York

•

2d ago

Request ID / Job ID: HBITS-08-15044Position Title: Systems Developer (Expert Skill Level)Project / Program Name: OREPA Data Warehouse/System Developer ExpertAgency: New York State Office of Children and Family Services (OCFS) - Office of Research, Evaluation and Performance Analytics (OREPA)Work Location: 52 Washington St., Room 323 North, Rensselaer, NY 12144Telecommuting: Allowed (50% after the first three months, pending satisfactory job performance/evaluation; negotiable)Interview Format: We

Easy Apply

Full-time, Third Party

55 - 65

EMR Engineer II

Albany, New York

•

Today

Join Us: Turn Asset Data into Operational Confidence as an EMR Engineer II - Strengthen Reliability, Improve Performance, and Support Smarter Facility Decisions Are you ready to build on your engineering experience while helping clients improve the reliability and lifecycle value of critical facility assets? Do you enjoy translating technical information into practical maintenance strategies, accurate documentation, and long-term operational improvements? CHA Consulting, Inc. is seeking an EM

Full-time

USD 80,000.00 - 90,000.00 per year

Early Career Mechanical Engineer Opportunities

Albany, New York

•

Today

Join Us: Build Your Career with Purpose as an Early Career Mechanical Engineer - Learn, Collaborate, and Make Real Impact Are you ready to bring your mechanical engineering skills to projects that improve communities and support a more sustainable future? Do you excel in team settings where collaboration, curiosity, and thoughtful execution are central to delivering great work? CHA Consulting, Inc. is seeking Early Career Mechanical Engineers to join our growing Mechanical Engineering teams.

Full-time

USD 65,000.00 - 80,000.00 per year

Manager Information Technology Services 2, (SG-M3) Item# 00600

Troy, New York

•

Today

Duties Description Provide operational leadership and oversee day to day operations of the Scheduling Services, Mail Center, and Facilities Management teams to ensure consistent, high quality service delivery. Minimum Qualifications To be appointed to this position, you must: Be reachable for appointment on the Manager Information Technology Services 2 eligible list. OR Be eligible for 52.6 transfer with one year of qualifying service in a title approved for transfer. Transfer For 52.6 transfe

Full-time

USD 120,471.00 - 152,238.00 per year

Assistant Engineer (Electrical) (NY HELPS) - VID 222011

Albany, New York

•

Today

Duties Description Duties include, but are not limited to: Perform engineering duties related to a group of electrical systems projects. Advise on electrical systems design or management of ongoing rehabilitation of existing electrical equipment. Assist a higher-level professional engineer overseeing subcontractors or development of electrical specifications writing and estimates of work. Evaluation operations problems in existing electrical systems. May supervise consultant work. Perform other

Full-time

USD 74,193.00 - 94,121.00 per year

Electrical Machine Design Engineer - Generator

Schenectady, New York

•

Today

Job Description Summary The Engineer in Generator Electrical Design is an individual contributor. The major thrust of this position is leading the electrical design activities within projects to support R&D, Tendering and Requisition Engineering. Job Description Essential Responsibilities Perform requisition electrical design activities for Turbogenerators, meeting schedules and cost objectives.Adaptation of electrical standard documentation to project specific requirementsPerform Design Analy

Full-time

USD 80,000.00 - 120,000.00 per year

Data Analyst 3

Albany, New York

•

Today

Duties Description The New York State Department of Financial Services seeks to build an equitable, transparent, and resilient financial system that benefits individuals and supports business. Through engagement, data-driven regulation and policy, and operational excellence, the Department and its employees are responsible for empowering consumers and protecting them from financial harm; ensuring the health of the entities we regulate; driving economic growth in New York through responsible inno

Full-time

USD 111,708.00 per year

Evaluation jobs in Albany, NY, USA