Overview
Skills
Job Details
Title: Software Engineer
Location- Remote
Any Visa will work
Job Overview
We are seeking a skilled Software Engineer with expertise in GPU Infrastructure, Ubuntu operating systems, and automation to design, build, maintain, and optimize machine images across a variety of cloud platforms. In this role, you will play a key part in delivering standardized, secure, and high-performant images, including those deployed on GPU Bare Metal and GPU droplet (VM) images
You will focus on automating the image creation lifecycle, ensuring image integrity, and optimizing for performance and security. The ideal candidate brings deep experience in GPU infrastructure, automation, and test systems, along with a strong passion for building secure, scalable, and efficient machine images that power modern cloud-native applications and services.
Key Responsibilities
- Work with key stakeholders in packaging and continuously testing our GPU images across multiple platform services. This includes coordination with hardware engineering
teams on packaging firmware versions and maintaining an active compatibility matrix of
- GPU drivers across Nvidia and AMD GPU platforms (H100/H200/MI300x/MI325x).
- Automation and Scripting: Develop and maintain tooling and scripts (e.g., using
- HashiCorp Packer, Ansible, Terraform, Python, Shell scripting) to automate the creation, testing, and deployment of machine images.
- Security and Compliance: Ensure machine images adhere to security best practices, including hardening, patch management, and compliance with organizational and industry standards (e.g., CIS benchmarks, GDPR, HIPAA).
- Optimization: Optimize machine images for performance, size, and boot time to enhance scalability and reduce operational costs.
- CI/CD Integration: Integrate machine image creation into CI/CD pipelines using tools like Jenkins, GitHub Actions, or GitLab CI for automated builds and deployments.
- Versioning and Documentation: Maintain version control for machine images and document configurations, processes, and best practices.
- Monitoring and Troubleshooting: Implement monitoring for image performance and troubleshoot issues related to image deployment and runtime in cloud environments.
- Stay Updated: Keep abreast of advancements in cloud technologies, containerization, and image management tools to propose and implement improvements.
Qualifications Required:
- Strong experience with building Linux operating system images.
- Solid understanding of GPU related infrastructure including NCCL, RCCL testing frameworks particularly in a fabric connected environment.
- Hands-on experience building and managing machine images using tools like Packer, cloud-init, Ansible, Python, and scripting.
- Familiarity with CI/CD tools (e.g., GitHub Actions, Jenkins, GitLab CI) for automating image pipelines.
- Strong understanding of security practices in image building (e.g., CVE scanning, secrets management, system hardening).
Preferred:
- Experience in developer experience environments that cater towards Ai/ML.
- Knowledge of Immutable Infrastructure and Golden Image pipelines.
- Experience with configuration management tools like Chef or Puppet.