Machine Learning Engineer in New York

Introduction

This position is for a Machine Learning Engineer based in New York. The candidate will be responsible for designing and maintaining integrations using OpenAI APIs within AWS environments, building Python-based services, implementing workflows, and deploying AI/ML systems in production environments.

Responsibilities

• Design and maintain LLM integrations using OpenAI APIs within AWS environments.
• Build Python-based LLM services deployed on AWS compute platforms (ECS, EKS, Lambda, or EC2).
• Implement RAG workflows and semantic search using AWS data and storage services.
• Develop LangChain or agentic workflows supporting reasoning and tool use.
• Integrate LLM pipelines with ETL/ELT workflows and enterprise data systems.
• Deploy and integrate MCP servers and emerging orchestration tools.
• Apply AWS security best practices using IAM, KMS, and Secrets Manager.
• Implement monitoring and observability using CloudWatch and related tools.
• Migrate custom GPT solutions into production-grade AWS-hosted assistants.

Requirements

Required Skills:

• Strong proficiency in Python, with experience building modular, production-grade services.
• Experience deploying and managing systems within AWS environments, including services such as S3, Lambda, ECS/EKS, and IAM.
• Experience building scalable, secure, and observable AI/ML systems in production.

Preferred Skills:

• Experience implementing Retrieval-Augmented Generation (RAG) and semantic search architectures.
• Hands-on experience integrating and operationalizing OpenAI LLM APIs in production environments.
• Experience with ETL/ELT data pipelines in cloud environments.
• Knowledge of AWS Glue, Amazon Athena, Amazon OpenSearch Service, and Amazon Aurora.
• Knowledge of Code (IaC) using AWS CDK, CloudFormation, or Terraform.