Staff Engineer (AI and LLM)

New York, NY, US • Posted 13 hours ago • Updated 6 hours ago
Full Time
No Travel Required
On-site
$190,000 - 250000/yr
Company Branding Image
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • AI
  • LLM
  • Shipping
  • Production
  • Founding Engineer
  • Artificial Intelligence
  • Prompt Engineering
  • Team Building

Summary

Job Title:            Staff Engineer – AI and LLM
Job Type:            Full-Time
Experience:        8–15+ Years

 

Mandatory Requirement:

·       Candidates must have a proven track record of building, deploying, and supporting LLM-powered applications in production environments. Experience limited to experimentation, proof-of-concepts, or prompt engineering alone will not be considered.

 

About the Role

·       We are seeking an experienced Staff Engineer to join a high-performing engineering team building AI-native products. This is a hands-on engineering role focused on designing, developing, and deploying production-grade LLM-powered applications. You will work closely with product, engineering, and leadership to build scalable AI systems that solve real-world business problems.

·       This role is ideal for someone who has successfully shipped LLM-based applications to production and has deep expertise in modern AI architectures, agentic workflows, and distributed systems.

 

Responsibilities

·       Design, develop, and deploy production-ready LLM-powered applications.

·       Build scalable AI services using modern LLM frameworks and orchestration tools.

·       Develop autonomous AI agents, RAG pipelines, and intelligent workflow automation.

·       Implement prompt engineering, evaluation frameworks, guardrails, caching, and monitoring.

·       Optimize inference performance, latency, reliability, and cost.

·       Collaborate with cross-functional teams to translate business requirements into AI-powered solutions.

·       Mentor engineers and establish engineering best practices for AI application development.

·       Drive architecture decisions and contribute to the technical roadmap.

 

Required Qualifications

·       8+ years of software engineering experience with strong backend development expertise.

·       Hands-on experience building and shipping LLM-based applications to production is mandatory.

·       Strong experience with Python and modern backend frameworks.

·       Experience integrating commercial and open-source LLMs (OpenAI, Anthropic, Gemini, Llama, Mistral, etc.).

·       Experience with AI orchestration frameworks such as LangGraph, LangChain, LlamaIndex, CrewAI, or similar.

Excellent problem-solving and communication skill.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: PZP91081408zzzz
  • Position Id: 9011435
  • Posted 13 hours ago

Company Info

About Avacend, Inc.

Our mission is customer centric, we are successful when our customers are successful.

Our Vision is to connect great companies with good employees and create opportunities for all by providing the best quality of human resource services. We measure our success by the satisfaction of our customers by empowering them to focus on what they do best.

Contact the job poster
SS

Shibu Singha

Recruiter @ Avacend, Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs