Advanced_GPU_talk

Recommendations

Info

Tip #2 - multi <strong>GPU</strong> • Always try avoiding: • Small memcopies (good advice for MPI too!) • cudaMalloc, cudaMallocHost calls • Overlap (or at least Async) what you can: • Halo copies • Halo unpack Gather 1 D2H H2D Scatter 1 Gather 2 Kernel interior Scatter 2
Thank you! istvan.reguly@oerc.ox.ac.uk
Page 1 and 2: Advanced GPU programming techniques
Page 3 and 4: “Usual way” cudaMemcpy(…) ker
Page 5 and 6: Why streams? • Concurrent CUDA op
Page 7 and 8: So what is a stream? • A sequence
Page 9 and 10: Default (NULL) stream • This is t
Page 11 and 12: Overlap Example cudaStream_t stream
Page 13 and 14: Synchronisation CPU GPU stream 1 st
Page 15 and 16: Priority streams • cudaStreamCrea
Page 17 and 18: Multi-GPU • You can control multi
Page 19 and 20: CUDA 6.0 • Unified Memory • Poi
Page 21: Tip #2 - multi GPU • Always try a

Advanced_GPU_talk

Create successful ePaper yourself

Delete template?

Save as template?