Tutorial CUDA

More on Memory Spaces
Each thread can:
Read/write per-thread registers
Read/write per-block shared memory
Read/write per-grid global memory
Most important, commonly used
Each thread can also:
Read/write per-thread local memory
Read only per-grid constant memory
Read only per-grid texture memory
Used for convenience/performance
More details later
The host can read/write global,
constant, and texture memory
(stored in DRAM)
© NVIDIA Corporation 2008
Host
Grid
Block (0, 0)
Shared Memory
Registers
Thread (0, 0)
Local
Memory
Global
Memory
Constant
Memory
Texture
Memory
Registers
Thread (1, 0)
Local
Memory
Block (1, 0)
Local
Memory
Shared Memory
Registers
Thread (0, 0)
Registers
Thread (1, 0)
Local
Memory