QLogic OFED+ Host Software User Guide, Rev. B

F–Troubleshooting
QLogic MPI Troubleshooting
This is equally applicable if the module mpi provides only a lower-rank interface
and you want to add a higher-rank interface, for example, when the module
explicitly provides for 1-D and 2-D integer arrays, but you need to pass a 3-D
integer array. Add a higher-rank interface only under the following conditions:
• The module mpi provides an explicit Fortran 90 style interface for
mpi_bcast. If the module mpi does not have this interface, the program
uses an implicit Fortran 77 style interface, which does not perform any type
checking. Adding an interface will cause type-checking error messages
where there previously were none.
• The underlying function accepts any data type. It is appropriate for the first
argument of mpi_bcast because the function operates on the underlying
bits, without attempting to interpret them as integer or character data.
Lock Enough Memory on Nodes When Using a Batch
Queuing System
QLogic MPI requires the ability to lock (pin) memory during data transfers on each
compute node. This is normally done via /etc/initscript, which is created or
modified during the installation of the infinipath RPM (setting a limit of
128 MB, with the command ulimit -l 131072).
Some batch systems, such as SLURM, propagate the user’s environment from
the node where you start the job to all the other nodes. For these batch systems,
you may need to make the same change on the node from which you start your
batch jobs.
If this file is not present or the node has not been rebooted after the infinipath
RPM has been installed, a failure message similar to one of the following will be
generated.
The following message displays during installation:
$ mpirun -np 2 -m ~/tmp/sm mpi_latency 1000 1000000
iqa-19:0.ipath_userinit: mmap of pio buffers at 100000 failed:
Resource temporarily unavailable
iqa-19:0.Driver initialization failure on /dev/ipath
iqa-20:1.ipath_userinit: mmap of pio buffers at 100000 failed:
Resource temporarily unavailable
iqa-20:1.Driver initialization failure on /dev/ipath
F-22 D000046-005 B