Senior AI Infrastructure Engineer - DGX Cloud
NVIDIA · Posted Nov 5
Graphics processing units, artificial intelligence platforms, accelerated computing, and data center solutions
Get a personal compatibility score
Add a resume for personal matches
About the role
NVIDIA's DGX Cloud group builds and operates GPU cloud services for AI training and inferencing workloads. The team combines software and systems engineering practices to run large scale production infrastructure with high efficiency and availability. This role designs, builds and maintains internal tooling and platforms, performs performance analysis on multi-GPU and multi-node clusters, and supports production services through automation, monitoring and incident response.
What you will do
- Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
- Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
- Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement.
- Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews.
- Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
- Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
- Practice sustainable incident response and blameless postmortems
- Be part of an on call rotation to support production systems
Skills used in this role
What the employer is looking for
- BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
- 5+ years of experience.
- A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others.
- Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production.
- Experience in one or more of the following: Python, Go, C/C++, Java
- In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
- Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
- Distributed system experience
Preferred qualifications
- Interest in crafting, analyzing and fixing large-scale distributed systems.
- Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
- Ability to debug and optimize code and automate routine tasks.
- Experience in using or running large private and public cloud systems based on Kubernetes or Slurm.
Benefits and support
- Compensation and benefits are detailed in the job posting
About NVIDIA
NVIDIA Corporation is a multinational technology company that designs graphics processing units (GPUs) for the gaming and professional markets, as well as system on a chip units (SoCs) for the mobile computing and automotive market. Pioneering accelerated computing, the company has become a driving engine of modern artificial intelligence, deep learning, and data center infrastructure.
- Industry
- Semiconductors
- Company size
- 42000+ employees
- Founded
- April 5, 1993
- Location
- Santa Clara, California, USA
- Funding stage
- Public Company
Funding
Public Company · $5M raised
Leadership
Founder, President and Chief Executive Officer
Executive Vice President and Chief Financial Officer
Founder and NVIDIA Fellow
Executive Vice President, Worldwide Field Operations
Recent coverage
NVIDIA Newsroom
NVIDIA Sets Conference Call for Third-Quarter Financial Results2026-10-28
NVIDIA Newsroom
NVIDIA and Oracle Expand NVIDIA Vera Rubin to Multi-Gigawatt Scale2026-10-27
The Elec
Nvidia to Showcase Latest AI Infrastructure at AI Day Seoul 2026 Starting Nov. 92026-11-02