CUDA Libraries and MPI+OpenMP+CUDA - Prace Training Portal

More documents

Recommendations

Info

Mixing CUDA and FORTRANQ: Can I call CUDA library routines directly in a FORTRAN program?A: Yes but keep in mind the data order convention!Q: Can I wrote a CUDA kernel in FORTRAN?A: No… but CUDA Fortran exists (PGI)Q: Can I call CUDA runtime APIs in FORTRAN?A: Yes and No… but CUDA Fortran exists (PGI)Q: So, how I can perform a simple pinned allocation of in FORTRAN?A: …February 10, 2012 PRACE Winter School 201218
Pinned allocation - Code Sample (FORTRAN)MODULE cuda_mem_allocINTERFACE! cudaMallocHostINTEGER (C_INT) function cudaHostAlloc(buffer, size, flag) &bind(C,name="cudaHostAlloc")MODULE iso_c_bindingIMPLITICT NONETYPE(C_PTR) :: bufferINTEGER(C_SIZE_T), VALUE :: sizeINTEGER(C_SIZE_T), VALUE :: flagEND FUNCTION cudaHostAlloc! cudaFreeHostINTEGER (C_INT) function cudaFreeHost(buffer) bind(C,name="cudaFreeHost")MODULE iso_c_bindingIMPLITICT NONETYPE(C_PTR), VALUE :: bufferEND FUNCTION cudaFreeHostEND INTERFACEEND MODULE cuda_mem_allocFebruary 10, 2012 PRACE Winter School 201219
Page 1 and 2: PRACE Winter School 2012Hybrid Prog
Page 3 and 4: Acknowledgments first!• ICHEC, Ir
Page 5 and 6: CUDA library ecosystemNVIDIA CUDATo
Page 7 and 8: CUFFT - Code Sample (C)#define NX 2
Page 9 and 10: CUBLAS - Thunking versus non-Thunki
Page 11 and 12: CUBLAS - Code Sample (FORTRAN)PROGR
Page 13 and 14: use-case: compute 3D-FFT on multi-G
Page 15 and 16: fft3Dtest.cu - Code Snippet (C++)lo
Page 17: fft3Dtest.cu - Profiling12101 GPU2
Page 21 and 22: Pinned allocation - Code Sample (FO
Page 23 and 24: Consideration over PINNED memory4m3
Page 25: PHIGEMM - Code Snippet (C)for (iDev
Page 28 and 29: cuBLAS API: new versus Legacy• th
Page 30 and 31: Performance Measurement and Metrics
Page 32 and 33: Performance Measurement and Metrics
Page 34 and 35: MPI + CUDA, short summary1MPI commu
Page 36 and 37: Know what you have…Let’s forget
Page 38 and 39: Example: PLASMA, DPLASMA & MAGMAMAG
Page 40 and 41: Time-consuming steps in PWSCF• Ca
Page 42 and 43: GPU Developments• MPI-GPU binding
Page 44 and 45: MPI-GPU binding - Code Snippet (C)/
Page 46 and 47: GPU memory management - Code Snippe
Page 48 and 49: ADDUSDENS - Code Snippet (FORTRAN)D
Page 50 and 51: QVAN2 - Code Snippet (FORTRAN)DO lm
Page 52 and 53: CUDA ADDUSDENS, Considerations• C
Page 54 and 55: “new” CUDA ADDUSDENS - Code Sni
Page 56 and 57: CUDA NEWD - Code Snippet (C)for( ih
Page 58 and 59: CUDA NEWD - Code Snippet (C)...#if
Page 60 and 61: CUDA VLOC_PSI_K serial - Computatio
Page 62 and 63: KERNEL_INIT_PSIC_K - Code Snippet (
Page 64 and 65: CUDA VLOC_PSI_K - parallelPSIPSICFF
Page 66 and 67: PWSCF GPU, results & benchmarks(ser
Page 68 and 69:
WHEN and WHY more MPI processesper
Page 70:
Thank you for your attention!No CPU
show all

CUDA Libraries and MPI+OpenMP+CUDA - Prace Training Portal

Create successful ePaper yourself

Delete template?

Save as template?