Overview
On Site
$52 - $57 hourly
Contract - W2
Contract - Temp
Skills
Data Quality
Language Models
Demonstrations
Collaboration
Research
Software Engineering
Software Development
Programming Languages
Analytical Skill
Decision-making
Communication
Technical Writing
Git
Docker
Cloud Computing
Software Development Methodology
Machine Learning (ML)
Natural Language Processing
Data Analysis
Writing
Microsoft Excel
Artificial Intelligence
Messaging
Job Details
RESPONSIBILITIES:
Kforce has an enterprise client seeking a Software Development Engineer 2 in Bellevue, WA.
Job Description:
As a Data Quality SDE, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Responsibilities:
* Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
* Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
* Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
* Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
* Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
* Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
* Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
REQUIREMENTS:
* Advanced degree in Computer Science, Software Engineering, or a related field
* Extensive experience (3+ years) in software development across multiple programming languages and paradigms
* Demonstrated ability to critically evaluate code quality, efficiency, and adherence to best practices
* Strong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstances
* Excellent written and verbal communication skills, with the ability to explain technical concepts clearly
* Experience in technical writing, particularly in creating coding examples or tutorials
* Experience in creating or contributing to coding standards or style guides
* Software skills good to have: Git, Docker, Cloud services, Backend or Front end, AI infra
Preferred Qualifications:
* Previous experience working with or evaluating AI systems, particularly in the context of code generation
* Familiarity with a wide range of software development methodologies and architectural patterns
* Understanding of machine learning concepts, particularly as they apply to natural language processing and code generation
* Data analysis skills, writing script to analyze model performance against human ground truth
* Intermediate Excel skills (VLOOKUPS, PIVOTS, formulas)
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce has an enterprise client seeking a Software Development Engineer 2 in Bellevue, WA.
Job Description:
As a Data Quality SDE, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Responsibilities:
* Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
* Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
* Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
* Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
* Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
* Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
* Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
REQUIREMENTS:
* Advanced degree in Computer Science, Software Engineering, or a related field
* Extensive experience (3+ years) in software development across multiple programming languages and paradigms
* Demonstrated ability to critically evaluate code quality, efficiency, and adherence to best practices
* Strong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstances
* Excellent written and verbal communication skills, with the ability to explain technical concepts clearly
* Experience in technical writing, particularly in creating coding examples or tutorials
* Experience in creating or contributing to coding standards or style guides
* Software skills good to have: Git, Docker, Cloud services, Backend or Front end, AI infra
Preferred Qualifications:
* Previous experience working with or evaluating AI systems, particularly in the context of code generation
* Familiarity with a wide range of software development methodologies and architectural patterns
* Understanding of machine learning concepts, particularly as they apply to natural language processing and code generation
* Data analysis skills, writing script to analyze model performance against human ground truth
* Intermediate Excel skills (VLOOKUPS, PIVOTS, formulas)
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.