QLogic OFED+ Host Software User Guide, Rev. B
QLogic OFED+ Host Software User Guide, Rev. B
QLogic OFED+ Host Software User Guide, Rev. B
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>QLogic</strong> <strong>OFED+</strong> <strong>Host</strong> <strong>Software</strong> <strong>User</strong> <strong>Guide</strong><br />
<strong>QLogic</strong> <strong>OFED+</strong> Version 1.5<br />
Configuring Fibre Channel Load Balancing. . . . . . . . . . . . . . . . . . . . . D-18<br />
1 Adapter Port and 2 Ports on a Single VIO. . . . . . . . . . . . . . . . D-18<br />
2 Adapter Ports and 2 Ports on a Single VIO Module . . . . . . . . D-19<br />
Using the roundrobinmode Parameter . . . . . . . . . . . . . . . . . . . . D-20<br />
Configuring SRP for Native InfiniBand Storage. . . . . . . . . . . . . . . . . . D-21<br />
Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-23<br />
Additional Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-23<br />
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-23<br />
OFED SRP Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D-24<br />
E<br />
F<br />
Integration with a Batch Queuing System<br />
Using mpiexec with PBS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-1<br />
Using SLURM for Batch Queuing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-2<br />
Allocating Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-3<br />
Generating the mpihosts File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-3<br />
Simple Process Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-4<br />
Clean Termination of MPI Processes . . . . . . . . . . . . . . . . . . . . . . . . . E-4<br />
Lock Enough Memory on Nodes when Using SLURM. . . . . . . . . . . . . . . . . E-5<br />
Troubleshooting<br />
Using LEDs to Check the State of the Adapter . . . . . . . . . . . . . . . . . . . . . . F-1<br />
BIOS Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-2<br />
Kernel and Initialization Issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-2<br />
Driver Load Fails Due to Unsupported Kernel. . . . . . . . . . . . . . . . . . . F-3<br />
Rebuild or Reinstall Drivers if Different Kernel Installed . . . . . . . . . . . F-3<br />
InfiniPath Interrupts Not Working. . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-3<br />
OpenFabrics Load Errors if ib_qib Driver Load Fails . . . . . . . . . . . . F-4<br />
InfiniPath ib_qib Initialization Failure. . . . . . . . . . . . . . . . . . . . . . . . F-5<br />
MPI Job Failures Due to Initialization Problems . . . . . . . . . . . . . . . . . F-6<br />
OpenFabrics and InfiniPath Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-6<br />
Stop Infinipath Services Before Stopping/Restarting InfiniPath . . . . . . F-6<br />
Manual Shutdown or Restart May Hang if NFS in Use . . . . . . . . . . . . F-7<br />
Load and Configure IPoIB Before Loading SDP . . . . . . . . . . . . . . . . . F-7<br />
Set $IBPATH for OpenFabrics Scripts . . . . . . . . . . . . . . . . . . . . . . . . F-7<br />
SDP Module Not Loading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-7<br />
ibsrpdm Command Hangs when Two <strong>Host</strong> Channel<br />
Adapters are Installed but Only Unit 1 is Connected<br />
to the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-8<br />
Outdated ipath_ether Configuration Setup Generates Error . . . . . . . . F-8<br />
System Administration Troubleshooting. . . . . . . . . . . . . . . . . . . . . . . . . . . . F-8<br />
D000046-005 ix
Change language