Slides - Par Lab

More documents

Recommendations

Info

What is a CUDA Thread? ¡ Independent thread of execution § has its own program counter, variables (registers), processor state, etc. § no implication about how threads are scheduled ¡ CUDA threads might be physical threads § as mapped onto NVIDIA GPUs ¡ CUDA threads might be virtual threads § might pick 1 block = 1 physical thread on multicore CPU 12/73
What is a CUDA Thread Block? ¡ Thread block = a (data) parallel task § all blocks in kernel have the same entry point § but may execute any code they want ¡ Thread blocks of kernel must be independent tasks § program valid for any interleaving of block executions 13/73
Page 1: An Introduction to CUDA/OpenCL a
Page 15 and 16: Synchronization ¡ Threads within
Page 17 and 18: Scalability ¡ Manycore chips exi
Page 19 and 20: Memory model Thread Per-‐threa
Page 24 and 25: Using per-‐block shared memo
Page 26 and 27: CUDA: Runtime support ¡Explicit
Page 28 and 29: CUDA and OpenCL correspondence
Page 30 and 31: Imperatives for Efficient CUDA
Page 32 and 33: Mapping CUDA to a GPU, continu
Page 34 and 35: Profiling NVIDIA Visual Profiler©
Page 36 and 37: Memory, Memory, Memory ! Chapter
Page 38 and 39: Coalescing ¡ GPUs and CPUs both
Page 40 and 41: SoA, AoS ¡ Different data acces
Page 42 and 43: Efficiency and Productivity" Parall
Page 44 and 45: Abstraction, cont." Reduction is on
Page 46 and 47: Diving In#include #include #include
Page 48 and 49: Containers" Concise and readable co
Page 50 and 51: Iterators" Iterators act like point
Page 52 and 53:
Algorithms" Elementwise operations"
Page 54 and 55:
Algorithms" Standard data types// a
Page 56 and 57:
Custom Types & Operators// compare
Page 58 and 59:
Recap" Containers manage memory" He
Page 60 and 61:
Explicit versus implicit parallelis
Page 62 and 63:
Explicit versus implicit parallelis
Page 64 and 65:
Productivity Implications" Consider
Page 66 and 67:
Productivity Implications" Consider
Page 68 and 69:
Leveraging Parallel Primitives" Use
Page 70 and 71:
Leveraging Parallel Primitives" Com
Page 72 and 73:
Summary ¡ Throughput optimized p
show all

Slides - Par Lab

Create successful ePaper yourself

Delete template?

Save as template?