Tutorial CUDA

Hardware Implementation:
Memory Architecture
The global, constant, and texture
spaces are regions of device
memory
Each multiprocessor has:
A set of 32-bit registers per
processor (8192 on G80)
On-chip shared memory (16 K on
G80)
© NVIDIA Corporation 2008
Where the shared memory
space resides
A read-only constant cache
To speed up access to the
constant memory space
A read-only texture cache
To speed up access to the
texture memory space
Device
Multiprocessor N
Multiprocessor 2
Multiprocessor 1
Registers
Processor 1
Device memory
Shared Memory
Registers
Processor 2
…
Registers
Processor M
Instruction
Unit
Constant
Cache
Texture
Cache