NMK Global Inc. is a global IT Services & Solutions company specializing in IT Staffing, Technology Consulting, Workforce Solutions, and Application Development Services. We help organizations build high-performing technology teams by connecting them with exceptional talent across a wide range of industries. Our expertise, industry knowledge, and consultative approach enable clients to achieve successful business outcomes while helping professionals advance their careers.
Software Engineer – AI/ML Engineer
Location: Santa Clara, CA
Job Description:
We are seeking a highly skilled Software Engineer specializing in AI/ML applications to independently drive the development, evaluation, deployment, and lifecycle management of AI-powered systems.
The ideal candidate will combine advanced AI application development, Python software engineering, distributed model deployment, automated testing, and DevSecOps expertise. This role involves working with AI agents, GPU infrastructure, Kubernetes/Ray/Slurm, LLM evaluation, prompt engineering, and secure CI/CD automation.
Key Responsibilities
- Architect, deploy, and scale open-source AI models using Kubernetes, Ray, or Slurm.
- Design and deploy production-grade AI models and AI agents.
- Develop prompt-engineering strategies and evaluate model performance.
- Build model benchmarking frameworks and perform detailed error and gap analysis.
- Create analytics dashboards to communicate AI system performance.
- Develop automated testing frameworks for traditional software and stochastic AI outputs.
- Build and maintain secure GitLab CI/CD pipelines.
- Automate vulnerability scanning and remediation within GitLab Merge Requests.
- Optimize GPU utilization, memory management, throughput, and inference latency.
- Own features end-to-end, from architecture and development through production deployment.
- Manage advanced Git workflows and public/private repository synchronization.
Required Skills
- 4+ years of professional production-grade Python development, including asynchronous Python.
- Strong software architecture, design patterns, and systems engineering experience.
- Hands-on experience deploying and scaling AI/ML models in production.
- Strong experience with Kubernetes, Ray, or Slurm and multi-node clusters.
- Strong understanding of GPU memory management and AI inference optimization.
- Experience with LangChain, Hugging Face, vLLM, and SGLang.
- Strong knowledge of prompt engineering and LLM evaluation.
- Experience with automated model benchmarking and performance analysis.
- Proficiency with Python, pandas, and NumPy for data analysis.
- Advanced GitLab CI/CD experience, including automated testing and security scanning.
- Strong experience with PyTest, mocking libraries, and automated test generation.
- Advanced Git skills, including rebasing, cryptographic commit signing, and repository mirroring.
Preferred / Standout Qualifications
- Contributions to open-source AI projects such as LangChain, Hugging Face, vLLM, or SGLang.
- Public GitHub/GitLab repositories demonstrating AI/ML engineering expertise.
- Experience building AI agents or multi-agent systems.
- Demonstrated experience with LLM benchmarking, evaluation, and gap analysis.
- Experience designing custom CI/CD pipelines for testing, automation, and security.
- Ability to provide links to accepted PRs, resolved issues, technical documentation, or other open-source contributions.
NMK Global Inc. is an Equal Opportunity Employer. We are committed to creating an inclusive workplace and consider all qualified applicants without regard to age, race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender identity, or any other characteristic protected by applicable law.
Never miss an opportunity! Create an alert based on the job you applied for.
