Senior ML Engineer

  • New York City, NY
  • Posted 1 day ago | Updated 9 hours ago

Overview

On Site
Depends on Experience
Full Time

Skills

A/B Testing
Artificial Intelligence
Cloud Computing
Continuous Improvement
Evaluation
Information Retrieval
LangChain
Leadership
Legal
Machine Learning (ML)
Mentorship
Prompt Engineering
Python
Software Engineering
Workflow

Job Details

Role: Senior ML Engineer

Location: New York City, NY / San Francisco, CA

Job Type: Full Time

Summary:

ML Engineer Senior

Node, React, Google Cloud Platform, Postgres

Role Overview:

As our first ML hire, you ll build and productionize our AI capabilities crafting agentic legal-AI workflows, defining evaluation frameworks, and mentoring future ML team members. You ll grow into Head of AI, CTO, or similar leadership as we scale.

Key Responsibilities:

  • Architect and deploy LLM-based pipelines using OpenAI, Anthropic, Gemini, etc.
  • Develop agentic solutions (LangChain or equivalent) for document redlining, Q&A, and drafting
  • Collaborate with legal SMEs to refine prompt strategies, evaluation metrics, and feedback loops
  • Optimize inference performance, cost, and reliability on Google Cloud Platform
  • Establish data annotation, model monitoring, and continuous-improvement processes

Must-Have Qualifications:

  • 4 5 years ML/AI engineering experience, including production LLM work
  • Concrete examples of agentic solutions you have shipped into production, including with advanced multi-agent systems, tool-enabled agents, etc.
  • Hands-on expertise with prompt engineering, chain-of-thought, and few-shot techniques
  • Strong software engineering skills in Python and cloud deployments
  • Proven ability to engage non-technical stakeholders and translate requirements
  • Ownership mentality and excitement for building from the ground floor

Nice-to-Have:

  • Prior legal-tech or regulated-industry experience
  • Familiarity with evaluation platforms and A/B testing for LLMs
  • NLP fine-tuning or information-retrieval background
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.