27.12.2014 Views

QLogic OFED+ Host Software User Guide, Rev. B

QLogic OFED+ Host Software User Guide, Rev. B

QLogic OFED+ Host Software User Guide, Rev. B

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

E–Integration with a Batch Queuing System<br />

Lock Enough Memory on Nodes when Using SLURM<br />

The following message displays after installation:<br />

$ mpirun -m ~/tmp/sm -np 2 -mpi_latency 1000 1000000<br />

node-00:1.ipath_update_tid_err: failed: Cannot allocate memory<br />

mpi_latency:<br />

/fs2/scratch/infinipath-build-1.3/mpi-1.3/mpich/psm/src<br />

mq_ips.c:691:<br />

mq_ipath_sendcts: Assertion ‘rc == 0’ failed. MPIRUN: Node program<br />

unexpectedly quit. Exiting.<br />

You can check the ulimit -l on all the nodes by running ipath_checkout. A<br />

warning similar to this displays if ulimit -l is less than 4096:<br />

!!!ERROR!!! Lockable memory less than 4096KB on x nodes<br />

To fix this error, install the infinipath RPM on the node, and reboot it to ensure<br />

that /etc/initscript is run.<br />

Alternately, you can create your own /etc/initscript and set the ulimit<br />

there.<br />

E-6 D000046-005 B

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!