slides - Spring School in Advanced Computing TACC @ UP

More documents

Recommendations

Info

Hybrid – Program Model • Start with MPI initialization • Create OMP parallel regions within MPI task (process). • Serial regions are the master thread or MPI task. • MPI rank is known to all threads • Call MPI library in serial and parallel regions. • Finalize MPI 14 Program
MPI with OpenMP -- Messaging Single-threaded messaging Node Node rank to rank MPI from serial region or a single thread within parallel region Multi-threaded messaging Node Node rank-thread ID to any rank-thread ID MPI from multiple threads within parallel region Requires thread-safe implementation 15
Page 1 and 2: Hybrid Computing Lars Koesterke Uni
Page 3 and 4: Why Hybrid? (cont 1) • Only profi
Page 5 and 6: Node Views CPU OpenMP CPU CPU CPU C
Page 7 and 8: NUMA Operations • Ways Process Af
Page 9 and 10: Modes of MPI/Thread Operation • S
Page 11 and 12: SMP Nodes Hybrid Batch Script 16 th
Page 13: SMP Sockets Hybrid Batch Script 4 t
Page 17 and 18: Syntax: MPI2 MPI_Init_thread call M
Page 19 and 20: MPI Call through Master • MPI_THR
Page 21 and 22: MPI Call within Single • MPI_THRE
Page 23 and 24: Overlapping Communication and Work
Page 25 and 26: Thread-rank Communication • Can u
Page 27 and 28: NUMA in Code • Scheduling Affinit
Page 29 and 30: Conclusion • Placement and bindin

slides - Spring School in Advanced Computing TACC @ UP

Create successful ePaper yourself

Delete template?

Save as template?