Apply Now

Principal AI Engineer

New York, NY, US • Posted 2 days ago • Updated 4 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

System Integration Testing
Management
Legal
ISO 9000
Testing
Leadership
Mentorship
Software Engineering
Data Science
Computer Science
Python
IaaS
Microservices
Continuous Integration
Continuous Delivery
Docker
Terraform
DevOps
Supply Chain Management
Threat Modeling
Problem Solving
Conflict Resolution
Evaluation
Communication
English
Agile
Collaboration
Management Consulting
Professional Services
Design Patterns
Open Source
Publications
Deep Learning
Cloud Architecture
Amazon Web Services
Google Cloud
Google Cloud Platform
Microsoft Azure
Machine Learning (ML)
CISSP
Artificial Intelligence
Regulatory Compliance
System On A Chip
ISO/IEC 27001:2005
Writing
TypeScript
Elasticsearch

System Integration Testing
Management
Legal
ISO 9000
Testing
Leadership
Mentorship
Software Engineering
Data Science
Computer Science
Python
IaaS
Microservices
Continuous Integration
Continuous Delivery
Docker
Terraform
DevOps
Supply Chain Management
Threat Modeling
Problem Solving
Conflict Resolution
Evaluation
Communication
English
Agile
Collaboration
Management Consulting
Professional Services
Design Patterns
Open Source
Publications
Deep Learning
Cloud Architecture
Amazon Web Services
Google Cloud
Google Cloud Platform
Microsoft Azure
Machine Learning (ML)
CISSP
Artificial Intelligence
Regulatory Compliance
System On A Chip
ISO/IEC 27001:2005
Writing
TypeScript
Elasticsearch

Summary

About the Role
As a Principal AI Engineer, you will sit at the intersection of software engineering, data science, platform architecture, and AI governance. You will serve as the technical owner for how AI/ML engineering is designed, built, governed, and shipped across our client's entire product portfolio. This is a hands-on leadership position where you will fluidly transition between writing production code, architecting multi-tenant AI services, building developer tooling, and leading security design. Your success is measured by creating scalable patterns that outlast your direct involvement.

What You'll Do

AI Productization & Platform Engineering: Design and own our AI productization and governance playbook, covering service patterns, compliance standards, and production-readiness criteria. You will build reusable internal tooling, such as AI service scaffolding and monitoring tools, to enable team adoption without ongoing hand-holding.

Governance & Security: Establish AI agent governance policies, including permissions and human-in-the-loop enforcement. You will partner with Security, Legal, and Compliance to define SOC2/ISO-aligned AI controls and prompt data classification policies.

Engineering Excellence: Champion AI-assisted development practices and codify modern software standards (CI/CD, DevOps, testing) that serve as a baseline for all products.

Leadership & Mentorship: Serve as the go-to technical authority on AI/ML and platform architecture for senior stakeholders. You will mentor engineers and tech leads to improve delivery consistency and design quality.

Required

15+ years in software engineering, data science, or a closely related technical field.
Bachelor's degree or higher in Computer Science, Engineering, or a related field.
Deep expertise in AI/ML frameworks and the Python ecosystem, with hands-on experience deploying models to public cloud infrastructure.
Demonstrated experience designing and operating multi-tenant AI services and LLM integrations in production.
Proven track record leading microservices architecture - decomposing monoliths, defining service contracts, and operationalizing CI/CD for distributed systems.
Strong hands-on command of containerization (Docker), infrastructure-as-code (Terraform), and modern DevOps practices.
Substantive experience with AI/LLM security - including prompt injection, data boundary enforcement, model supply chain risk, and AI-specific threat modeling.
Strong problem-solving skills, especially in building governance frameworks, evaluation rubrics, and reusable platform patterns at scale.
Excellent written and verbal communication skills in English; ability to translate complex technical topics to diverse audiences, including executive stakeholders.
Experience with Agile methodologies and cross-functional product team collaboration.

Preferred / Additional Qualifications

Experience applying AI/ML in business consulting, advisory, or professional services contexts.
Familiarity with AI service interface and gateway design patterns, including emerging AI integration protocols.
Contributions to open-source AI/ML projects, publications, or active involvement in technical communities.
Advanced certifications in AI, deep learning, cloud architecture, or security (e.g., AWS/Google Cloud Platform/Azure ML, CISSP).
Experience defining AI compliance controls for SOC2, ISO 27001, or TISAX frameworks.
Demonstrated enthusiasm for developer education - writing internal guides, running workshops, or building internal tooling communities.
Proficiency in additional languages is a plus (Go, Typescript)

#LI-ES2

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10488758
Position Id: b591e2496a26794f8282ee1b8cbb3480
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Principal AI Engineer

New York, New York

•

8d ago

Job Description: Serve as the most senior individual-contributor engineer and principal technical authority within the Commercial AI Center of Excellence (CAI CoE), owning the technical vision for AI-as-a-Service (AIaaS) enablement at enterprise scale. Operate as a full-spectrum AI engineer fluent across the entire lifecycle - data, model training and fine-tuning, retrieval, orchestration, evaluation, and production operations - able to go as deep as any specialist and to compose the pieces into

Full-time

USD 229,800.00 - 298,700.00 per year

Principal Software Engineer - AI Foundations

Hoboken, New Jersey

•

10d ago

Job Description If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorganChase within the Chief Data and Analytics Office (CDAO), you provide expertise and engineering excellence as an integral part of an agile team to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your advanced technical capabilit

Full-time

Principal Software Engineer - AI Foundations

Jersey City, New Jersey

•

Today

Full-time

USD 204,250.00 - 285,000.00 per year

Senior Lead AI Engineer (LLM Gateway, FM Hosting)

New York, New York

•

Today

Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent ? along with our deep experience in machine learning ? position us to be at the forefront of enterprises leveraging AI. From informing custom

Full-time

Search all similar jobs

More jobs at IntePros in New York, NY