NTT DATA Americas, Inc
NTT DATA Americas, Inc

Real-Time Inference Engineering Lead

Hybrid in Charlotte, NC, US • Posted 22 hours ago • Updated 22 hours ago
Contract W2
1 Year
Hybrid
$88.85/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • ML PLATFORM ENGINEER
  • MACHINE LEARNING PLATFORM ENGINEER
  • AI PLATFORM ENGINEER
  • AI INFRASTRUCTURE ENGINEER
  • ML INFRASTRUCTURE ENGINEER
  • MACHINE LEARNING SYSTEMS ENGINEER
  • LEAD MLOPS ENGINEER
  • MLOPS ENGINEER
  • PRINCIPAL PLATFORM ENGINEER
  • STAFF PLATFORM ENGINEER
  • SITE RELIABILITY ENGINEER
  • SRE
  • PRINCIPAL DEVOPS ENGINEER
  • KUBERNETES ARCHITECT
  • KUBERNETES
  • K8S
  • MODEL SERVING
  • INFERENCE
  • INFERENCING
  • MLOPS
  • KUBEFLOW
  • MLFLOW
  • KSERVE
  • TRITON
  • SELDON

Summary

Company Overview:
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Inference Lead to join our team in Charlotte, North Carolina (US-NC), United States (US).

Job Description:
Real-Time Services – Real-Time Inference Engineering Lead

Role Summary
The Real-Time Inference Engineering Lead will design and industrialize low-latency, resilient model-serving services for predictive AI use cases. The role will define deployment patterns, capacity controls, monitoring, performance standards, and operational practices across cloud and on-premises environments.

Key Responsibilities
  • Architect low-latency online inference and real-time model-serving solutions.
  • Develop scalable APIs, microservices, and deployment patterns for predictive models.
  • Implement Kubernetes-based deployment, autoscaling, load balancing, and traffic-management strategies.
  • Conduct benchmarking, performance tuning, capacity planning, and load testing.
  • Optimize latency, throughput, resource consumption, availability, and cost.
  • Define monitoring, alerting, SLOs, runbooks, and incident-response practices.
  • Build CI/CD pipelines for repeatable model and service releases.
  • Design resilience, failover, rollback, disaster recovery, and graceful-degradation patterns.
  • Lead technical reviews and mentor inference and platform engineers.
Required Skills
  • 8 + years of experience in online inference and real-time model-serving architecture.
  • REST/gRPC APIs and distributed microservices.
  • Kubernetes, containers, autoscaling, and traffic management.
  • Performance engineering, latency optimization, and load testing.
  • Monitoring, SLOs, capacity planning, and production operations.
  • CI/CD and progressive-deployment approaches.
  • Resilience and high-availability engineering.
  • Cloud and on-premises deployment experience.
  • Preferred Qualifications
  • Degree in computer science, engineering, or a related discipline.
  • Experience with enterprise model-serving platforms and inference runtimes.
  • Cloud, Kubernetes, SRE, or ML engineering certification.
NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $80-$88.85. Actual compensation will depend on a number of factors, including the candidate's relevant experience, technical skills, and other qualifications.
This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits

About NTT DATA:

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com


NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: CUEDATA
  • Position Id: 26-02055
  • Posted 22 hours ago

Company Info

About NTT DATA Americas, Inc

At NTT DATA, you have endless opportunities to think big, act bold, and take ownership.

As a $30+ billion business and technology services, AI and digital infrastructure leader, we co-innovate solutions with clients and partners globally for business and societal impact. Serving 75% of the Fortune Global 100, with experts in over 70 countries, we encourage experimentation and recognize great work.

Proudly a Global Top Employer, NTT DATA is part of NTT group, which invests over $3 billion annually in R&D. Make this the place where you belong, learn and build your network. Make this the place where you grow.

Go to company profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Real-Time Inference Engineering Lead

Hybrid in Charlotte, North Carolina

•

7d ago

Easy Apply

Contract, Third Party

$80

AWS Data & AI Platform Engineer

Hybrid in Charlotte, North Carolina

•

4d ago

Easy Apply

Third Party, Contract

Depends on Experience

Guardrails Engineer

Hybrid in Charlotte, North Carolina

•

16d ago

Easy Apply

Contract, Third Party

Depends on Experience

Business Consultant - AI/ML Engineer

Hybrid in Sandy Springs, Georgia

•

10d ago

Easy Apply

Contract, Third Party

$60 - $70

Search all similar jobs
More jobs at NTT DATA Americas, Inc in Charlotte, NC