Advanced_GPU_talk

Recommendations

Info

Overview Some of the lesser-known techniques and features • Streams • Synchronisation, Events, Callbacks • Scheduling, Concurrency & false dependencies • Hyper-Q & CUDA Proxy • Peer-to-peer access (single proc, cudaIpc, <strong>GPU</strong> Direct) • CUDA 6.0
“Usual way” cudaMemcpy(…) kernel_1(…) cudaDeviceSynchronize() timing() kernel_2(…) cudaDeviceSynchronize() timing() … Kernel launch overhead ~10-50us launch copy launch kernel synchronize launch kernel H2D Kernel 1 Kernel 2
Page 1: Advanced GPU programming techniques
Page 5 and 6: Why streams? • Concurrent CUDA op
Page 7 and 8: So what is a stream? • A sequence
Page 9 and 10: Default (NULL) stream • This is t
Page 11 and 12: Overlap Example cudaStream_t stream
Page 13 and 14: Synchronisation CPU GPU stream 1 st
Page 15 and 16: Priority streams • cudaStreamCrea
Page 17 and 18: Multi-GPU • You can control multi
Page 19 and 20: CUDA 6.0 • Unified Memory • Poi
Page 21 and 22: Tip #2 - multi GPU • Always try a
Page 23: Thank you! istvan.reguly@oerc.ox.ac

Advanced_GPU_talk

Create successful ePaper yourself

Delete template?

Save as template?