Software Engineering Evaluator (AI /ML) with LLM

Remote • Posted 4 hours ago • Updated 4 hours ago
Contract Independent
Contract W2
Contract Corp To Corp
Able to Sponsor
Remote
$60 - $100/hr
Company Branding Image
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • LLM
  • AI
  • ML
  • AI/ML

Summary

Job Description:

Role Overview

As a Software Engineering Evaluator, you will contribute to training and improving large language models (LLMs) by creating, evaluating, and refining high-quality code datasets. You ll collaborate with AI researchers and engineers to enhance model performance across software engineering tasks.

Key Responsibilities

  • Curate and create high-quality code datasets for AI model training
  • Write, review, and correct code in:
    • Python
    • JavaScript (including ReactJS)
    • C/C++
    • Java
    • Rust
    • Go
  • Evaluate AI-generated code for:
    • Efficiency
    • Scalability
    • Reliability
  • Collaborate with cross-functional teams to improve AI-driven coding solutions
  • Build agents/tools to:
    • Verify code correctness
    • Detect error patterns
  • Analyze and evaluate AI capabilities across the software development lifecycle:
    • Prototyping
    • Architecture design
    • API design
    • Production deployment
    • Monitoring & maintenance
  • Design automated verification systems for software engineering tasks

Required Qualifications

  • 5+ years of software engineering experience
  • Strong full-stack development experience
  • Expertise in building scalable, production-grade systems
  • Deep understanding of:
    • Software architecture
    • System design
    • Debugging and code quality
  • Strong communication skills (written & verbal)

Preferred Skills

  • Experience working with AI/ML or LLM-based systems
  • Familiarity with benchmarking and evaluating AI models
  • Experience building developer tools or code analysis systems
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91142017
  • Position Id: 8944231
  • Posted 4 hours ago

Company Info

About JC CORPORATIONS

JC Corp is a team of experts aiming to get your business sail smoothly on the rough tide of huge competitors by its seamless IT solutions. As all business domains are skyrocketing in the current era, it is mandatory to rely on services like banking, staff augmentation and cloud services and we are here to support all your needs to make you grow.

Helping you reach your goals by unlocking new possibilities through IT solutions is JC Corp’s major focus. Time well managed is an opportunity well captured. And we are confident that our expertise will be a great opportunity for our clients to excel.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract, Third Party

$60 - $100

Remote

Today

Easy Apply

Contract, Third Party

$60 - $90

Remote

Today

Easy Apply

Contract, Third Party

$60 - $70

Remote

26d ago

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs