Advanced_GPU_talk

ePAPER READ

DOWNLOAD ePAPER

blueisviolet

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

START NOW

Why streams?

• Concurrent CUDA operations

• Kernels

• Memcpy

• CPU execution

H2D Kernel 1 D2H H2D Kernel 2 D2H H2D Kernel 3 D2H

Recommendations
Info

“Improved way” cudaMemcpyAsync(…) kernel_1(…) ! ! kernel_2(…) Kernel launch overhead ~10-50us ! ! … launch copy launch kernel launch kernel H2D Kernel 1 Kernel 2

Why streams? • Concurrent CUDA operations • Kernels • Memcpy • CPU execution H2D Kernel 1 D2H H2D Kernel 2 D2H H2D Kernel 3 D2H

Page 1 and 2: Advanced GPU programming techniques
Page 3: “Usual way” cudaMemcpy(…) ker
Page 7 and 8: So what is a stream? • A sequence
Page 9 and 10: Default (NULL) stream • This is t
Page 11 and 12: Overlap Example cudaStream_t stream
Page 13 and 14: Synchronisation CPU GPU stream 1 st
Page 15 and 16: Priority streams • cudaStreamCrea
Page 17 and 18: Multi-GPU • You can control multi
Page 19 and 20: CUDA 6.0 • Unified Memory • Poi
Page 21 and 22: Tip #2 - multi GPU • Always try a
Page 23: Thank you! istvan.reguly@oerc.ox.ac

Advanced_GPU_talk

Create successful ePaper yourself

Delete template?

Save as template?