Accelerating High Performance Computing with GPUDirect RDMA
Accelerating High Performance Computing with GPUDirect RDMA
Accelerating High Performance Computing with GPUDirect RDMA
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Performance</strong> of MVAPICH2 <strong>with</strong> GPU-Direct-<strong>RDMA</strong>800700GPU-GPU Internode MPI Uni-Directional BandwidthSmall Message BandwidthMVAPICH2-1.9MVAPICH2-1.9-GDR70006000Large Message BandwidthMVAPICH2-1.9MVAPICH2-1.9-GDRBandwidth (MB/s)6005004003002002.8xBetterBandwidth (MB/s)500040003000200033%Better100100001 4 16 64 256 1K 4K08K 32K 128K 512K 2MMessage Size (bytes)MVAPICH2 <strong>with</strong> <strong>GPUDirect</strong> <strong>RDMA</strong>Based on MVAPICH2-1.9Intel Sandy Bridge (E5-2670) node <strong>with</strong> 16 coresNVIDIA Telsa K20c GPU, Mellanox ConnectX-3 FDR HCACUDA 5.5, OFED 1.5.4.1 <strong>with</strong> GPU-Direct-<strong>RDMA</strong> PatchMessage Size (bytes)15