slides - Spring School in Advanced Computing TACC @ UP

More documents

Recommendations

Info

NUMA Operations • Process Affinity and Memory Policy can be controlled at socket and core level with numactl. CPU  2  CPU  CPU  3  CPU  2  CPU  CPU  CPU  CPU  3  8,9,10,11  CPU  CPU  12,13,14,15  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  CPU  1  CPU  CPU  0  CPU  1  CPU  CPU  CPU  CPU  0  CPU  CPU  4,5,6,7  CPU  CPU  0,1,2,3  Process: Socket References  Memory: Socket References  process assignment  memory allocaFon  ‐N  –l  –i  ‐‐peferred –m  (local, interleaved, pref., mandatory)  Process: Core References  core assignment  –C  8
Modes of MPI/Thread Operation • SMP Nodes • Single MPI task launched per node • Parallel Threads share all node memory, e.g 16 threads/ node on Ranger. • SMP Sockets • Single MPI task launched on each socket • Parallel Thread set shares socket memory, e.g. 4 threads/socket on Ranger • MPI Cores • Each core on a node is assigned an MPI task. • (not really hybrid, but in master/slave paradigm master could use threads) 9
Page 1 and 2: Hybrid Computing Lars Koesterke Uni
Page 3 and 4: Why Hybrid? (cont 1) • Only profi
Page 5 and 6: Node Views CPU OpenMP CPU CPU CPU C
Page 7: NUMA Operations • Ways Process Af
Page 11 and 12: SMP Nodes Hybrid Batch Script 16 th
Page 13 and 14: SMP Sockets Hybrid Batch Script 4 t
Page 15 and 16: MPI with OpenMP -- Messaging Single
Page 17 and 18: Syntax: MPI2 MPI_Init_thread call M
Page 19 and 20: MPI Call through Master • MPI_THR
Page 21 and 22: MPI Call within Single • MPI_THRE
Page 23 and 24: Overlapping Communication and Work
Page 25 and 26: Thread-rank Communication • Can u
Page 27 and 28: NUMA in Code • Scheduling Affinit
Page 29 and 30: Conclusion • Placement and bindin

slides - Spring School in Advanced Computing TACC @ UP

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?