Tutorial: Introduction to CUDA Fortran | GTC 2013

Thread-Level Parallelism
• Execution configuration dictates number of threads per block
– Limit on number of threads per block for each architecture
• Number of concurrent blocks on a multiprocessor limited by
– Register use per thread
– Shared memory use per thread block
– Limit on number of threads per multiprocessor
• Occupancy
– Ratio of actual to maximum number of concurrent threads per
multiprocessor