Overview
On Site
Depends on Experience
Full Time
Skills
A/B Testing
Artificial Intelligence
Cloud Computing
Continuous Improvement
Evaluation
Information Retrieval
LangChain
Leadership
Legal
Machine Learning (ML)
Mentorship
Prompt Engineering
Python
Software Engineering
Workflow
Job Details
Role: Senior ML Engineer
Location: New York City, NY / San Francisco, CA
Job Type: Full Time
Summary:
ML Engineer Senior
Node, React, Google Cloud Platform, Postgres
Role Overview:
As our first ML hire, you ll build and productionize our AI capabilities crafting agentic legal-AI workflows, defining evaluation frameworks, and mentoring future ML team members. You ll grow into Head of AI, CTO, or similar leadership as we scale.
Key Responsibilities:
- Architect and deploy LLM-based pipelines using OpenAI, Anthropic, Gemini, etc.
- Develop agentic solutions (LangChain or equivalent) for document redlining, Q&A, and drafting
- Collaborate with legal SMEs to refine prompt strategies, evaluation metrics, and feedback loops
- Optimize inference performance, cost, and reliability on Google Cloud Platform
- Establish data annotation, model monitoring, and continuous-improvement processes
Must-Have Qualifications:
- 4 5 years ML/AI engineering experience, including production LLM work
- Concrete examples of agentic solutions you have shipped into production, including with advanced multi-agent systems, tool-enabled agents, etc.
- Hands-on expertise with prompt engineering, chain-of-thought, and few-shot techniques
- Strong software engineering skills in Python and cloud deployments
- Proven ability to engage non-technical stakeholders and translate requirements
- Ownership mentality and excitement for building from the ground floor
Nice-to-Have:
- Prior legal-tech or regulated-industry experience
- Familiarity with evaluation platforms and A/B testing for LLMs
- NLP fine-tuning or information-retrieval background
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.