One-sided vs. Two-sided Communication Paradigms on Relaxed ...

More documents

Recommendations

Info

MPI OrderingF U T U R E T E C H N O L O G I E S G R O U P Non-overtake rule (determinism) If a sender sends two messages (Message 1 and Message 2) in successionto the same destination, and both match the same receive, the receiveoperation will receive Message 1 before Message 2. If a receiver posts two receives (Receive 1 and Receive 2), in succession,and both are looking for the same message, Receive 1 will receive themessage before Receive 2.Send: S order source rankdest rankS 2 0 S 1 0 S 0 0P 0P 1HT3GeminiNICReceive: R order source rankGeminiNIC3D torusHT3R 0 ANY S 1 2 R 2 ANYGemini P 2HT3NICP 3R 0 ANY R 1 ANYP 4P 6LAWRENCE BERKELEY NATIONAL LABORATORY
Cray MPI Method to ExploitGemini Relaxed OrderingF U T U R E T E C H N O L O G I E S G R O U PTypical eager <strong>vs</strong>. rendezvousCray’s<strong>Two</strong> eager modes<strong>Two</strong> rendezvous modeSwitching is controlled based on Message sizeRegistration cache is used(may not be able to tell which memory will be used for communication)E0 E1 R0 R10 512 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1MB 4MBMPICH_GNI_MAX_VSHORT_MSG_SIZEMPICH_GNI_MAX_EAGER_MSG_SIZEMPICH_GNI_NDREG_MAXSIZELAWRENCE BERKELEY NATIONAL LABORATORY
Page 1 and 2: F U T U R E T E C H N O L O G I E S
Page 3 and 4: MotivationF U T U R E T E C H N O L
Page 5 and 6: Hopper HardwareF U T U R E T E C H
Page 7 and 8: MicrobenchmarkF U T U R E T E C H N
Page 9 and 10: DMAPP vs. uGNI (FM
Page 11 and 12: Relaxed Ordering and ConcurrencyF U
Page 13 and 14: Communication <str
Page 15 and 16: Communication Para
Page 17 and 18: Relaxed Ordering andCommuni
Page 19: UPC Shared Memory Ordering Challeng
Page 23 and 24: MPI Eager 1F U T U R E T E C H N O
Page 25 and 26: MPI Rendezvous 1F U T U R E T E C H
Page 27 and 28: 1648Bwindow size1648BF U T U R E T
Page 29 and 30: window sizwindowwindow sizewindow s
Page 31: ConclusionF U T U R E T E C H N O L

One-sided vs. Two-sided Communication Paradigms on Relaxed ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?