Description We are looking for a Cloud Engineer II to join our team in Philadelphia, Pennsylvania to support a six-week proof of concept project focused on deploying and evaluating open-weight AI coding models in AWS. This role will help validate the feasibility, performance, scalability, and developer experience of an enterprise AI coding assistant solution.
Responsibilities
- Deploy and configure open-weight LLM endpoints in AWS.
- Configure model-serving infrastructure, GPU resources, APIs, routing, monitoring, and logging.
- Integrate AI model endpoints with coding-assistant platforms and developer workflows.
- Build observability dashboards and track latency, throughput, utilization, and reliability metrics.
- Create reusable deployment artifacts, runbooks, and technical documentation.
- Conduct testing, performance analysis, and knowledge-transfer sessions.
- Deliver recommendations and a go/no-go assessment for future enterprise-scale deployment.
Requirements Required Qualifications
- 3-5+ years of Cloud Engineering experience.
- Hands-on AWS, Kubernetes, Docker, and API integration experience.
- Experience with infrastructure automation (Terraform, Helm, Kubernetes manifests, or similar).
- Strong experience with monitoring and observability tools such as Grafana and CloudWatch.
- Ability to troubleshoot distributed cloud environments and performance issues.
Preferred Qualifications
- Experience with Generative AI, LLMs, or AI infrastructure.
- Familiarity with model-serving platforms such as vLLM, Triton, TGI, or similar.
- Experience supporting GPU-based workloads in AWS.
- Knowledge of OpenAI-compatible APIs and AI-powered developer tools.
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Never miss an opportunity! Create an alert based on the job you applied for.