CUDA Libraries and MPI+OpenMP+CUDA - Prace Training Portal

More documents

Recommendations

Info

Performance Measurement and Metrics__global__ base(float *a, float *b) {int i;i = (blockIdx.x-1)*blockDim.x + threadIdx.x;a[i] = sin(b[i]);}__global__ memory(float *a, float *b) {int i;i = (blockIdx.-1)*blockDim.x + threadIdx.x;a[i] = b[i];}__global__ math(float *a, float b, int flag) {float v;int i;i = (blockIdx.-1)*blockDim.x + threadIdx.xv = sin(b);if (v*flag == 1) a[i] = v;}Smart trick to avoid compilerinterference at assembly levelCourtesy of M. FaticaFebruary 10, 2012 PRACE Winter School 201232
Performance Measurement and MetricsOutput of the command-line profiler (export CUDA_PROFILE=1)method=[ base ] gputime=[ 871.680 ] cputime=[ 5.000 ] occupancy=[ 1.000 ]method=[ memory ] gputime=[ 620.064 ] cputime=[ 5.000 ] occupancy=[ 1.000 ]method=[ math ] gputime=[ 661.792 ] cputime=[ 5.000 ] occupancy=[ 1.000 ]! Kernel balanced, latency under controlCan we do better? Yes! sin() ! __sin()method=[ base ] gputime=[ 626.944 ] cputime=[ 5.000 ] occupancy=[ 1.000 ]method=[ memory ] gputime=[ 619.328 ] cputime=[ 4.000 ] occupancy=[ 1.000 ]method=[ math ] gputime=[ 163.136 ] cputime=[ 5.000 ] occupancy=[ 1.000 ]! Kernel memory-boundCourtesy of M. FaticaFebruary 10, 2012 PRACE Winter School 201233
Page 1 and 2: PRACE Winter School 2012Hybrid Prog
Page 3 and 4: Acknowledgments first!• ICHEC, Ir
Page 5 and 6: CUDA library ecosystemNVIDIA CUDATo
Page 7 and 8: CUFFT - Code Sample (C)#define NX 2
Page 9 and 10: CUBLAS - Thunking versus non-Thunki
Page 11 and 12: CUBLAS - Code Sample (FORTRAN)PROGR
Page 13 and 14: use-case: compute 3D-FFT on multi-G
Page 15 and 16: fft3Dtest.cu - Code Snippet (C++)lo
Page 17 and 18: fft3Dtest.cu - Profiling12101 GPU2
Page 19 and 20: Pinned allocation - Code Sample (FO
Page 21 and 22: Pinned allocation - Code Sample (FO
Page 23 and 24: Consideration over PINNED memory4m3
Page 25: PHIGEMM - Code Snippet (C)for (iDev
Page 28 and 29: cuBLAS API: new versus Legacy• th
Page 30 and 31: Performance Measurement and Metrics
Page 34 and 35: MPI + CUDA, short summary1MPI commu
Page 36 and 37: Know what you have…Let’s forget
Page 38 and 39: Example: PLASMA, DPLASMA & MAGMAMAG
Page 40 and 41: Time-consuming steps in PWSCF• Ca
Page 42 and 43: GPU Developments• MPI-GPU binding
Page 44 and 45: MPI-GPU binding - Code Snippet (C)/
Page 46 and 47: GPU memory management - Code Snippe
Page 48 and 49: ADDUSDENS - Code Snippet (FORTRAN)D
Page 50 and 51: QVAN2 - Code Snippet (FORTRAN)DO lm
Page 52 and 53: CUDA ADDUSDENS, Considerations• C
Page 54 and 55: “new” CUDA ADDUSDENS - Code Sni
Page 56 and 57: CUDA NEWD - Code Snippet (C)for( ih
Page 58 and 59: CUDA NEWD - Code Snippet (C)...#if
Page 60 and 61: CUDA VLOC_PSI_K serial - Computatio
Page 62 and 63: KERNEL_INIT_PSIC_K - Code Snippet (
Page 64 and 65: CUDA VLOC_PSI_K - parallelPSIPSICFF
Page 66 and 67: PWSCF GPU, results & benchmarks(ser
Page 68 and 69: WHEN and WHY more MPI processesper
Page 70: Thank you for your attention!No CPU

CUDA Libraries and MPI+OpenMP+CUDA - Prace Training Portal

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?