QLogic OFED+ Host Software User Guide, Rev. B

6–Performance Scaled Messaging
Virtual Fabric Support
Virtual Fabric Support
Virtual Fabric (vFabric) in PSM is supported with the QLogic Fabric Manager. The
latest version of the QLogic Fabric Manager contains a sample qlogic_fm.xml
file with pre-configured vFabrics for PSM. Sixteen unique Service IDs have been
allocated for PSM enabled MPI vFabrics to ease their testing however any
Service ID can be used. Refer to the QLogic Fabric Manager User Guide on how
to configure vFabrics.
There are two ways to use vFabric with PSM. The “legacy” method requires the
user to specify the appropriate SL and Pkey for the vFabric in question. For
complete integration with vFabrics, users can now specify a Service ID (SID) that
identifies the vFabric to be used. PSM will automatically obtain the SL and Pkey to
use for the vFabric from the QLogic Fabric Manager via path record queries.
Using SL and PKeys
SL and Pkeys can be specified natively for OpenMPI and QLogic MPI. For other
MPIs use the following list of environment variables to specify the SL and Pkey.
The environment variables need to be propagated across all processes for correct
operation.
NOTE:
This is available with OpenMPI v1.3.4rc4 and above only!
• OpenMPI: Use mca parameters (mtl_psm_ib_service_level and
mtl_psm_ib_pkey) to specify the pkey on the mpirun command line.
Example:
mpirun –np 2 –machinefile machinefile -mca
mtl_psm_ib_service_level SL -mca mtl_psm_ib_pkey Pkey prog
prog_args.
• QLogic MPI: Requires use of IPATH_SL environment variable to specify
the SL and the –p switch to mpirun for the Pkey.
Example:
IPATH_SL=SL mpirun –np 2 –m machinefile -p Pkey prog prog_args
• Other MPIs can use the following environment variables that are propagated
across all processes. This process is MPI library specific but samples on
how to do this for OpenMPI and MVAPICH2 are listed in the “Introduction”
on page 6-1.
IPATH_SL=SL # Service Level to Use 0-15
PSM_PKEY=Pkey # Pkey to use
6-2 D000046-005 B