Advanced_GPU_talk

Recommendations

Info

cudaIpc • Sharing GPU pointers between MPI processes • cudaIpcGetMemHandle(handle, ptr) • send handle over MPI • cudaIpcOpenMemHandle(handle, ptr, flags) • Same works for Events • cudaIpcGetEventHandle, cudaIpcOpenEventHandle • Will fail if Peer-to-Peer is not possible! • Just use GPU Direct… (export MV2_USE_CUDA=1)
CUDA 6.0 • Unified Memory • Pointers accessible from both the CPU and the GPU • cudaMallocManaged • Will automatically copy data up and down • Synchronisation! + Improved Dynamic Parallelism
Page 1 and 2: Advanced GPU programming techniques
Page 3 and 4: “Usual way” cudaMemcpy(…) ker
Page 5 and 6: Why streams? • Concurrent CUDA op
Page 7 and 8: So what is a stream? • A sequence
Page 9 and 10: Default (NULL) stream • This is t
Page 11 and 12: Overlap Example cudaStream_t stream
Page 13 and 14: Synchronisation CPU GPU stream 1 st
Page 15 and 16: Priority streams • cudaStreamCrea
Page 17: Multi-GPU • You can control multi
Page 21 and 22: Tip #2 - multi GPU • Always try a
Page 23: Thank you! istvan.reguly@oerc.ox.ac

Advanced_GPU_talk

Create successful ePaper yourself

Delete template?

Save as template?