QLogic OFED+ Host Software User Guide, Rev. B

3–TrueScale Cluster Setup and Administration
QLogic Distributed Subnet Administration
Virtual Fabric “Default”
Pkey: 0xffff
SID Range: 0 x0-0 xffffffffffffffff
Virtual Fabric “Default”
Pkey: 0xffff
SID Range: 0x1-0xf
SID Range: 0x 1000117500000000-0x 100011750000000f
Infiniband Fabric
Distributed SA
Figure 3-2. Distributed SA Default Configuration
If you are using the QLogic FM in its default configuration, and you are using the
standard QLogic PSM Service IDs, this arrangement will work fine and you will not
need to modify the Distributed SA's configuration file - but notice that the
Distributed SA has restricted the range of Service IDs it cares about to those that
were defined in its configuration file. Attempts to get path records using other SIDs
will not work, even if those other SIDs are valid for the fabric.
Multiple Virtual Fabrics Example
A person configuring the physical InfiniBand fabric may want to limit how much
InfiniBand bandwidth MPI applications are permitted to consume. In that case,
they may re-configure the QLogic Fabric Manager, turning off the "Default" Virtual
Fabric and replacing it with several other Virtual Fabrics.
In Figure 3-3, the administrator has divided the physical fabric into four virtual
fabrics: "Admin" (used to communicate with the Fabric Manager), "Storage" (used
by SRP), "PSM_MPI" (used by regular MPI jobs) and a special "Reserved" fabric
for special high-priority jobs.
D000046-005 B 3-15