Linguist III (AI/LLM)

Job Title: Linguist III (AI/LLM)

Location: Remote - PST preferred

Duration: Contract - 6 months

Pay Range: $41/hr $43/hr (W2)

Job ID: 399758

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Linguistic Engineer to join our dynamic team. The ideal candidate will have strong experience in LLM data pipeline workflows, data quality assessment, and dataset curation and a proven ability to build, maintain, and analyze datasets that drive accurate and reliable LLM-powered features for smart glasses applications.

Responsibilities:

• Aggregate cross-functional requests and translate them into actionable, high-quality datasets using synthetic data collections and live user traffic.


• Deliver analytics, statistics, and model performance results on curated datasets.


• Design and conduct experiments to evaluate rater quality and inter-rater reliability, write summary reports, and present findings.


• Develop manual and automated processes across concurrent projects to ensure high-quality labeled data.


• Create and refine LLM quality grading queues and error attribution queues for LLM components.


• Build datasets and write clear guidelines rapidly for emergent LLM data rating, creation, and annotation needs.


• Analyze system metrics such as factuality, brevity, coherence, and subcomponent performance, summarize insights, and communicate results.

Required Skills & Qualifications:

• Basic to intermediate Python and SQL with a demonstrated desire to grow.


• Foundational knowledge of linguistics, such as phonetics, syntax, semantics, or dialectology.


• Ability to analyze numerical rating results and derive data-driven conclusions.


• Working knowledge of basic statistics and mathematics for data analysis.


• Clear written and oral communication skills for reporting findings and milestone updates.

Preferred Skills:

• Experience with LLM evaluation frameworks, rater tooling, or annotation platforms.


• Background in experiment design for human-in-the-loop evaluation and inter-rater reliability.

Education/Experience:

• Bachelor's degree in Linguistics, Computational Linguistics, Speech Science, or a related field, or a graduate degree in Linguistics, or similar industry experience.


• Master's degree or beyond preferred, or equivalent industry experience.


• Additional learning via Coursera, Udemy, or similar platforms is valued.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits.


• Opportunities for growth with global clients.


• A supportive, inclusive culture that values innovation and people.


• Exposure to cutting-edge technologies and projects.

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.