Requisition Id 17343
Overview: We are hiring an Advanced Computing Engineer to design, operate and maintain HPC clusters and AI systems supporting services where science happens at ORNL! This position resides in the Emerging Technologies & AI and Computing team in the Research Computing group in the Information Technology Services Directorate at Oak Ridge National Laboratory (ORNL).
The Emerging Technology Computational Group facilitates ORNL goals through HPC and AI systems engineering, integration, and support for the research community at ORNL. By providing design, deployment, optimization, monitoring, and tooling support across multiple clustered infrastructures, we facilitate Lab-wide R&D projects. Our HPC clusters range in scope from just a handful of nodes to over fifty-thousand cores.
We partner with ORNL research organizations to enable research excellence and delivery. We work with other clustered computing and HPC groups to help research programs identify the best solutions for their needs. When we build our customer's environments, our team collaborates to design, implement, and maintain the systems from inception to retirement.
Major Duties/Responsibilities:- Advocate and promote HPC and AI clustered computing services to researchers who process large data sets and/or develop code as a part of their project.
- Design and define the end-to-end architecture for AI/ML solutions, ensuring scalability, performance, and alignment with ORNL's strategic goals and architectural principles and guidelines.
- Define and implement AI/ML solutions that align with a robust master data management strategy to ensure data integrity, security, and accessibility.
- Ensure the availability, performance, scalability, and security of production systems.
- Leverage automation and monitoring solutions that minimize our day-to-day maintenance and scout opportunities to optimize system management practices or system performance.
- Collaborate with technical POCs for the programs that we support to install and help tune the performance of various scientific toolsets.
- Deliver ORNL's mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote equal opportunity by fostering a respectful workplace - in how we treat one another, work together, and measure success.
Basic Qualifications:- A BS degree in computer science, computer engineering, information technology, information systems, science, engineering, business, or a related discipline and a minimum of 8 years of aligned professional experience is required for consideration. An overall combination of equivalent education and experience may be considered.
- Four (4) or more years with managing UNIX/Linux Systems.
- Two (2) or years of proven experience with configuration management and automation tools such as Git, Ansible, or Puppet.
- Moderate proficiency in at least one scripting language such as Bash, Python, or others.
- Experience performing advanced troubleshooting and system administration with Linux Servers.
Preferred Qualifications:- Active DOE Q, active DOD Top Secret, or active DOD TS/SCI clearance is heavily preferred for consideration.
- A strong desire to innovate and identify new technologies and opportunities and be able to communicate the potential benefits of those choices to others within the team and our research partners.
- A collaborative and upbeat approach to thrive on the opportunity to build trust and credibility and ultimately become a trusted advisor to our research teams.
- Solid understanding of multiple operating systems and cluster technologies.
- Experience with Rocky/Centos/RHEL, Ubuntu, VMware.
- Understanding of HPC platforms to support users with SLURM job submissions and troubleshooting.
- Understanding of vLLM or TensorRT
- Experience deploying and operating AI workloads on GPU systems.
- Knowledge of inference optimization, quantization, batching, context management, and model serving.
- Experience building and running containerized applications in an HPC environment.
- Experience building and running containerized applications in an AI environment.
- Experience with multiple deployment mechanisms like Diskless, Warewulf, and traditional deployment (cobbler, PXEboot, and/or Bright).
- Experience managing systems utilizing GPU (NVIDIA and AMD) clusters for AI/ML and/or image processing.
- Knowledge of networking fundamentals including TCP/IP, traffic analysis, common protocols, and network diagnostics.
- Experience with Infiniband networks and diagnostics.
- Experience with performance and diagnostic tools for benchmarking, analysis and tuning of systems, networking, and storage.
- Experience with Grafana, CheckMK, Nagios, Zabbix, SolarWinds, Ganglia, or other network and device monitoring systems.
- Previous experience working in a government, scientific or other highly technical environment.
- Good documentation skills, including ability to prepare simple documentation web pages.
Special Requirements:- Visa sponsorship is not available for this position.
About ORNL:As a U.S. Department of Energy (DOE) Office of Science national laboratory, ORNL has an impressive 80-year legacy of addressing the nation's most pressing challenges. Our team is made up of over 7,000 dedicated and innovative individuals! Our goal is to create an environment where a variety of perspectives and backgrounds are valued, ensuring ORNL is known as a top choice for employment. These principles are essential for supporting our broader mission to drive scientific breakthroughs and translate them into solutions for energy, environmental, and security challenges facing the nation.
ORNL offers competitive pay and benefits programs to attract and retain individuals who demonstrate exceptional work behaviors. The laboratory provides a range of employee benefits, including medical and retirement plans and flexible work hours, to support the well-being of you and your family. Employee amenities such as on-site fitness, banking, and cafeteria facilities are also available for added convenience.
Other benefits include the following: Prescription Drug Plan, Dental Plan, Vision Plan, 401(k) Retirement Plan, Contributory Pension Plan, Life Insurance, Disability Benefits, Generous Vacation and Holidays, Parental Leave, Legal Insurance with Identity Theft Protection, Employee Assistance Plan, Flexible Spending Accounts, Health Savings Accounts, Wellness Programs, Educational Assistance, Relocation Assistance, and Employee Discounts.
This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.
We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.
If you have trouble applying for a position, please email
ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply. UT-Battelle is an E-Verify employer.
