Linux programmer - AI and GPU programming

Overview

On Site
Accepts corp to corp applications
Contract - Contract

Skills

linux
aws
EC2
AI
GPU

Job Details

Job Title: Linux programmer - AI and GPU programming
Location: Bronx, NY
Key Responsibilities:
  • Set up and manage Linux-based environments (Ubuntu preferred), including shell scripting and package management.
  • Deploy and configure LLMs such as LLaMA using PyTorch and Hugging Face Transformers.
  • Run inference jobs using GPU resources (NVIDIA CUDA).
  • Manage cloud-based GPU instances on platforms like AWS EC2, Google Cloud Platform (Google Cloud Platform), or Hugging Face Spaces.
  • Create and maintain isolated development environments using Conda and pip.
  • Collaborate with the team to ensure smooth model integration and deployment in production-ready pipelines.
Operating Systems & Tools:
  • Proficient in Linux (Ubuntu preferred)
  • Strong experience with shell scripting and package manager
Cloud Platforms:
  • Familiarity with GPU-based instances (AWS EC2, Google Cloud Platform, Hugging Face Spaces)
Programming & Frameworks:
  • Python (must-have)
  • Experience with PyTorch and Hugging Face Transformers
Model Deployment & Inference:
  • Hands-on experience installing and configuring LLMs (e.g., LLaMA)
  • Running GPU-based inference workloads (CUDA)
  • Experience setting up virtual environments and managing Python dependencies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.