Remote :: Job Title :- Gen AI Architect (Eval) :: Contract - Amaze Systems Inc - Remote | Dice.com

Amaze Systems Inc

Apply Now

Remote :: Job Title :- Gen AI Architect (Eval) :: Contract

Remote • Posted 8 hours ago • Updated 1 hour ago

Full Time

Part Time

Remote

Apply Now

Amaze Systems Inc

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

Python
GenAI
Langfuse

Summary

Hello,

Hope you are doing great !!

Please go through the Job description if interested kindly response with your resume along with contact details

Job Title :- Gen AI Architect

Work Location :- Remote

Contract only

Mandatory skills :-

Evaluation SDK.
Langfuse (including v3 features)
Azure AI services
LLMOps, prompt engineering, and GenAI lifecycle management.
Python

Skills:

Hands-on experience with Langfuse (including v3 features) and integrations.
Experience with other GenAI observability tools (e.g., TruLens, W&B, Helicone).
Knowledge of Retrieval-Augmented Generation (RAG), fine-tuning, and multi-agent orchestration.
Strong understanding of Azure AI services, especially the Evaluation SDK.
Deep expertise in LLMOps, prompt engineering, and GenAI lifecycle management.
Proficiency in Python, TypeScript, or similar languages used in GenAI frameworks.
Experience with cloud-native architectures (Azure preferred).
Familiarity with Tracing tools, observability platforms, and evaluation metrics.
Excellent communication and documentation skills.

Key Responsibilities:

Set-up and deploy Langfuse v3 in production environment.
Architect and implement the upgrade of Langfuse v2 to v3 within the LamBots framework, ensuring backward compatibility and performance optimization
Design modular components for prompt management, tracing, metrics, evaluation, and playground features using Langfuse v3.

Leverage Langfuse's full feature set:

Prompt Management versioning, templating, and optimization
Tracing end-to-end visibility into GenAI workflows
Metrics performance, latency, and usage analytics
Evaluation automated and manual scoring of model outputs
Playground interactive testing and debugging of prompts

Integrate Azure AI Evaluation SDK into LamBots to enable scalable enterprise-grade evaluation pipelines/workflows, including:
Build reusable components and templates for evaluation across diverse GenAI use cases.
Collaborate with cross-functional teams to integrate evaluation capabilities into production pipelines/ systems.
Ensure scalability and reliability of evaluation tools in both offline and online environments.
Define and enforce evaluation standards and best practices for GenAI agents, RAG pipelines, and multi-agent orchestration.
Collaborate with product, engineering, and data science teams to align evaluation metrics with business KPIs.
Drive observability, debugging, and traceability features for GenAI workflows.
Stay current with emerging GenAI evaluation tools, frameworks, and methodologies.

Thanks & Regards

Namit Raj Singh

Amaze Systems Inc

Contact Details :- +1

Email :-

USA: 8951 Cypress Waters Blvd, Suite 160, Dallas, TX 75019

Amaze Systems is an Equal Opportunity Employer (EOE), and does not discriminate based on age, gender, religion, disability, marital status, race and also adheres to laws relating to non-discrimination on the basis of national origin and citizenship status.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91132378
Position Id: 2025-9065
Posted 8 hours ago

Company Info

About Amaze Systems Inc

We strive to be the very best in our industry. We're the Best IT Specialists.
We value our clients and their trust in us and hence, Our IT & Web Consultants don't hesitate to move mountains to give them high quality & innovative digital strategies, without resting, till they get the brand of their dreams.

Our impeccable digital executions has helped several businesses multiply and increase their business enquiries substantially over years making us one of the most preferred online partners.

Our Core Values Confine

image
Customer Experience
Best quality service value to maintain the long-lasting customer relationships
Support and reliability
Efficiency and time adherence
image
Delivery Excellence
Maintain high-standards in every delivery within the timelines
Enhance end-user acceptability
Maintain a healthy operating margin for the project
image
Integrity
Enabling economic growth through support and development services
Respect for individuals and maintaining the honor code
Ethical work practices
image
Practical Innovation
Value for innovation
Respect for new ideas
Innovative approach

Https://amaze-systems.com/

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Gen AI Architect

Remote or Humboldt, Michigan

•

Today

The Senior GenAI Architect is responsible for leading the development of the GenAI architecture across the Lineage enterprise. This will be accomplished through collaboration with key stakeholders in data science, data solutions, infrastructure, and business teams. This includes scaling our GenAI capabilities by designing RAG systems, integrating LLMs, building Agentic workflows, and enabling secure, responsible AI deployments that align with Lineage's data and digital strategy, and build reusab

Full-time

Azure AI Architect

Remote

•

3d ago

Job Description: AI Architect (Azure) No of Openings- 1 opening. Mode of employment- FTE preferred but C2C can work Location: REMOTE USA/CANADA Tentative Start date: 3rd week of October. Domain- Preferred Insurance. Role Overview We are seeking a highly skilled AI Architect (Azure) to lead the architecture and technical strategy for AI programs across insurance and other regulated industries. The AI Architect will own and define reference architectures for Retrieval-Augmented Generation (RAG), C

Easy Apply

Full-time

Depends on Experience

Senior AI / ML Engineer / Remote / LLMs / RAG / AI Platform

Remote or Los Angeles, California

•

Today

Job Description An early-stage startup is hiring a remote full-time AI/ML Engineer to help build a next-generation communication platform from the ground up. The product is designed to make team collaboration faster, smarter, and more focused by deeply integrating AI into the core user experience. This is a rare chance to join a well-funded founding team with a strong track record in scaling products used by millions. You'll be part of a small, fast-moving engineering group focused on rapid iter

Easy Apply

Full-time

180k - 220k

AI Architect - (NPW)

Remote

•

Today

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The comp

Full-time