Advanced_GPU_talk

Recommendations

Info

Why streams? • Concurrent CUDA operations • Kernels • Memcpy • CPU execution H2D Kernel 1 D2H Can have: • up to 16 kernels H2D Kernel 2 D2H • 2 async copies H2D Kernel 3 D2H
So what is a stream? • A sequence of operations that execute strictly in-order • But obviously there are limited resources -> concurrency • The theoretical model: • Operations in a stream are serialised • Operations in different streams can run concurrently Stream 1 H2D Kernel 1 D2H Stream 2 H2D Kernel 2 D2H
Page 1 and 2: Advanced GPU programming techniques
Page 3 and 4: “Usual way” cudaMemcpy(…) ker
Page 5: Why streams? • Concurrent CUDA op
Page 9 and 10: Default (NULL) stream • This is t
Page 11 and 12: Overlap Example cudaStream_t stream
Page 13 and 14: Synchronisation CPU GPU stream 1 st
Page 15 and 16: Priority streams • cudaStreamCrea
Page 17 and 18: Multi-GPU • You can control multi
Page 19 and 20: CUDA 6.0 • Unified Memory • Poi
Page 21 and 22: Tip #2 - multi GPU • Always try a
Page 23: Thank you! istvan.reguly@oerc.ox.ac

Advanced_GPU_talk

Create successful ePaper yourself

Delete template?

Save as template?