slides - Spring School in Advanced Computing TACC @ UP

More documents

Recommendations

Info

include ‘mpif.h’  program hybsing  Serialize through Single call mpi_init_thread(MPI_THREAD_SERIALIZED,                                                        iprovided,ierr)  !$OMP parallel     !$OMP barrier     !$OMP single       call MPI_(…,ierr)     !$OMP end single  Fortran  C  #include   int main(int argc, char **argv){  int rank, size, ierr, i;  mpi_init_thread(MPI_THREAD_SERIALIZED,                                 iprovided)  #pragma omp parallel  {     #pragma omp barrier     #pragma omp single     {       ierr=MPI_(…)     }     !!OMP barrier  !$OMP end parallel  end     //pragma omp barrier  }  }  22
Overlapping Communication and Work • One core can saturate the PCI-e network bus. Why use all to communicate? • Communicate with one or several cores. • Work with others during communication. • Need at least MPI_THREAD_FUNNELED support. • Can be difficult to manage and load balance! 23
Page 1 and 2: Hybrid Computing Lars Koesterke Uni
Page 3 and 4: Why Hybrid? (cont 1) • Only profi
Page 5 and 6: Node Views CPU OpenMP CPU CPU CPU C
Page 7 and 8: NUMA Operations • Ways Process Af
Page 9 and 10: Modes of MPI/Thread Operation • S
Page 11 and 12: SMP Nodes Hybrid Batch Script 16 th
Page 13 and 14: SMP Sockets Hybrid Batch Script 4 t
Page 15 and 16: MPI with OpenMP -- Messaging Single
Page 17 and 18: Syntax: MPI2 MPI_Init_thread call M
Page 19 and 20: MPI Call through Master • MPI_THR
Page 21: MPI Call within Single • MPI_THRE
Page 25 and 26: Thread-rank Communication • Can u
Page 27 and 28: NUMA in Code • Scheduling Affinit
Page 29 and 30: Conclusion • Placement and bindin

slides - Spring School in Advanced Computing TACC @ UP

Create successful ePaper yourself

Delete template?

Save as template?