Tools for Managing Clusters of NVIDIA Gpus

More documents

Recommendations

Info

Programmatic Interfaces § Ship a new library with the driver, NVML § Provide API that encapsulates nvidia-smi functionality, plus additional goodness § Future nvidia-smi built on top of NVML § Building block for 3rd party tools
Out-of-band Monitoring § Move GPU monitoring off CPU § Thermals, utilization, ECC errors, etc § Crash dumps § Get some useful data even if GPU/driver is hung § OEM engagement to build this in to real products
Page 1 and 2: Tools for Managing Clusters of NVID
Page 3 and 4: Topics § Historical challenges for
Page 5 and 6: Historical challenges for GPUs § B
Page 7 and 8: Key Problem Spaces § Job isolation
Page 9 and 10: Where We Stand Today § Nvidia-smi
Page 11 and 12: nvidia-smi Features -- Queries § G
Page 13 and 14: Nvidia-smi Features -- Operations
Page 15 and 16: Nvidia-smi - Example Output Timesta
Page 17 and 18: Nvidia Healthmon § Simple tool for
Page 19 and 20: 3rd Party Tools - Bright Computing
Page 21: Future Directions § Based on feedb
Page 25 and 26: GPUDirect San Jose, CA| September 2
Page 27 and 28: GPUDirect v1 Motivation � Remove
Page 29: We’d Love to Hear From You § Fee

Tools for Managing Clusters of NVIDIA Gpus

Create successful ePaper yourself

Delete template?

Save as template?