Accelerating High Performance Computing with GPUDirect RDMA

More documents

Recommendations

Info

MVAPICH2/MVAPICH2-X Software• High Performance open-source MPI Library for InfiniBand, 10Gig/iWARP, andRDMA over Converged Enhanced Ethernet (RoCE)– MVAPICH (MPI-1) ,MVAPICH2 (MPI-2.2 and MPI-3.0), Available since 2002– MVAPICH2-X (MPI + PGAS), Available since 2012– Used by more than 2,055 organizations (HPC Centers, Industry and Universities) in70 countries– More than 180,000 downloads from OSU site directly– Empowering many TOP500 clusters• 7 th ranked 204,900-core cluster (Stampede) at TACC• 14 th ranked 125,980-core cluster (Pleiades) at NASA• 17 th ranked 73,278-core cluster (Tsubame 2.0) at Tokyo Institute of Technology• 75 th ranked 16,896-core cluster (Keenland) at GaTech• and many others– Available with software stacks of many IB, HSE, and server vendorsincluding Linux Distros (RedHat and SuSE)– http://mvapich.cse.ohio-state.eduMVAPICH2 with GPUDirect RDMA3
MVAPICH2 1.9 and MVAPICH2-X 1.9• Released on 05/06/13• Major Features and Enhancements– Based on MPICH-3.0.3• Support for all MPI-3 features – Non-blocking collectives, Neighborhood Collectives, etc.– Support for single copy intra-node communication using Linux supported CMA (Cross Memory Attach)• Provides flexibility for intra-node communication: shared memory, LiMIC2, and CMA– Checkpoint/Restart using LLNL's Scalable Checkpoint/Restart Library (SCR)• Support for application-level checkpointing• Support for hierarchical system-level checkpointing– Scalable UD-multicast-based designs and tuned algorithm selection for collectives– Improved job startup time• Provided a new runtime variable MV2_HOMOGENEOUS_CLUSTER for optimized startup onhomogeneous clusters– Revamped Build system with support for parallel builds– Many enhancements related to GPU• MVAPICH2-X 1.9 supports hybrid MPI + PGAS (UPC and OpenSHMEM) programming models.– Based on MVAPICH2 1.9 including MPI-3 features; Compliant with UPC 2.16.2 and OpenSHMEM v1.0dMVAPICH2 with GPUDirect RDMA4
Page 1 and 2: Accelerating High Performance Compu
Page 3 and 4: User SpaceSystem SpaceUser SpaceSys
Page 5 and 6: GPUDirect History• The GPUDirect
Page 7 and 8: 1 21GPUDirect 1.0ReceiveTransmitSys
Page 9 and 10: 11GPUDirect RDMAReceiveTransmitSyst
Page 11 and 12: How to get started evaluating GPUDi
Page 13 and 14: Thank You© 2013 Mellanox Technolog
Page 15: Large-scale InfiniBand Cluster Inst
Page 19 and 20: What is GPU-Aware MPI Library?MVAPI
Page 21 and 22: MPI + CUDA - Advanced• Pipelining
Page 23 and 24: MPI Micro-benchmark PerformanceTime
Page 25 and 26: GPU-Direct RDMA with CUDA 5.0• Fa
Page 27 and 28: Performance of MVAPICH2 with GPU-Di
Page 29 and 30: Performance of MVAPICH2 with GPU-Di
Page 31 and 32: How can I get Started with GDR Expe
Page 33 and 34: Additional Information and Contact
Page 35 and 36: Outline! GPUDirect technology famil
Page 37 and 38: NVIDIA Software and Hardware Requir
Page 39 and 40: IB verbs extensions for GPUDirect R
Page 41 and 42: Example:d_buf=cudaMalloc();mr=ibv_r
Page 43 and 44: GPUDirect RDMA: Common use cases! I
Page 45 and 46: So what happens at CUDA 6?! No chan
Page 47 and 48: The EndQuestion Time
Page 49: GTC 2014 Call for SubmissionsLookin

Accelerating High Performance Computing with GPUDirect RDMA

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?