slides - Spring School in Advanced Computing TACC @ UP

More documents

Recommendations

Info

Funneling through Master include ‘mpif.h’  program hybmas  !$OMP parallel     !$OMP barrier     !$OMP master       call MPI_(…,ierr)     !$OMP end master     !$OMP barrier  !$OMP end parallel  end  Fortran  C  #include   int main(int argc, char **argv){   int rank, size, ierr, i;  #pragma omp parallel  {     #pragma omp barrier     #pragma omp master     {       ierr=MPI_(…)     }     #pragma omp barrier  }  }  20
MPI Call within Single • MPI_THREAD_SERIALIZED • Only OMP_BARRIER at beginning, since there is an implicit barrier in SINGLE workshare construct (OMP_SINGLE). • All other threads will be sleeping. • (The simplest case is for any thread to execute a single mpi call, e.g. with the “single” omp construct. See next slide.) 21
Page 1 and 2: Hybrid Computing Lars Koesterke Uni
Page 3 and 4: Why Hybrid? (cont 1) • Only profi
Page 5 and 6: Node Views CPU OpenMP CPU CPU CPU C
Page 7 and 8: NUMA Operations • Ways Process Af
Page 9 and 10: Modes of MPI/Thread Operation • S
Page 11 and 12: SMP Nodes Hybrid Batch Script 16 th
Page 13 and 14: SMP Sockets Hybrid Batch Script 4 t
Page 15 and 16: MPI with OpenMP -- Messaging Single
Page 17 and 18: Syntax: MPI2 MPI_Init_thread call M
Page 19: MPI Call through Master • MPI_THR
Page 23 and 24: Overlapping Communication and Work
Page 25 and 26: Thread-rank Communication • Can u
Page 27 and 28: NUMA in Code • Scheduling Affinit
Page 29 and 30: Conclusion • Placement and bindin

slides - Spring School in Advanced Computing TACC @ UP

Create successful ePaper yourself

Delete template?

Save as template?