GPU Performance Analysis and Optimization - GPU Technology ...

Occupancy and Performance• Note that 100% occupancy isn’t needed to reach maximumperformace– Once the “needed” occupancy is reached, further increases won’timprove performance• Needed occupancy depends on the code– More independent work per thread -> less occupancy is needed– Memory-bound codes tend to need more occupancy• Higher latency than for arithmetic, need more work to hide it– We’ll discuss occupancy for memory- and math-bound codes laterin the presentation© 2012, NVIDIA13