QLogic OFED+ Host Software User Guide, Rev. B

More documents

Recommendations

Info

QLogic OFED+ Host Software User Guide QLogic OFED+ Version 1.5 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-3 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-3 Compiling Open MPI Applications. . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-3 Running Open MPI Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-4 Further Information on Open MPI . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 MVAPICH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 Compiling MVAPICH Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 Running MVAPICH Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6 Further Information on MVAPICH . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6 Managing Open MPI, MVAPICH, and QLogic MPI with the mpi-selector Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6 HP-MPI and Platform MPI 7 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8 Compiling Platform MPI 7 Applications . . . . . . . . . . . . . . . . . . . . . . . . 5-8 Running Platform MPI 7 Applications . . . . . . . . . . . . . . . . . . . . . . . . . 5-9 More Information on Platform MPI 7 . . . . . . . . . . . . . . . . . . . . . . . . . . 5-9 Platform (Scali) MPI 5.6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-9 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-9 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-9 Compiling Platform MPI 5.6 Applications . . . . . . . . . . . . . . . . . . . . . . 5-9 Running Platform MPI 5.6 Applications . . . . . . . . . . . . . . . . . . . . . . . . 5-10 Further Information on Platform MPI 5.6 . . . . . . . . . . . . . . . . . . . . . . . 5-10 Intel MPI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-11 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-11 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-11 Compiling Intel MPI Applications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-13 Running Intel MPI Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-13 Further Information on Intel MPI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-14 Improving Performance of Other MPIs Over InfiniBand Verbs. . . . . . . . . . . 5-14 6 Performance Scaled Messaging Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-1 Virtual Fabric Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-2 Using SL and PKeys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-2 Using Service ID. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-3 SL2VL mapping from the Fabric Manager . . . . . . . . . . . . . . . . . . . . . . . . . . 6-3 Verifying SL2VL tables on QLogic 7300 Series Adapters . . . . . . . . . . . . . . 6-4 vi D000046-005
QLogic OFED+ Host Software User Guide QLogic OFED+ Version 1.5 7 Dispersive Routing 8 gPXE gPXE Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-1 Required Steps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-2 Preparing the DHCP Server in Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-2 Installing DHCP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-2 Configuring DHCP. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-3 Netbooting Over InfiniBand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-4 Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-5 Boot Server Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-5 Steps on the gPXE Client . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-14 HTTP Boot Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-14 A B C mpirun Options Summary Job Start Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1 Essential Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1 Spawn Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-2 Quiescence Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-3 Verbosity Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-3 Startup Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-3 Stats Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-4 Tuning Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-5 Shell Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-6 Debug Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-6 Format Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-7 Other Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-7 Benchmark Programs Benchmark 1: Measuring MPI Latency Between Two Nodes . . . . . . . . . . . B-1 Benchmark 2: Measuring MPI Bandwidth Between Two Nodes . . . . . . . . . B-3 Benchmark 3: Messaging Rate Microbenchmarks. . . . . . . . . . . . . . . . . . . . B-4 Benchmark 4: Measuring MPI Latency in Host Rings . . . . . . . . . . . . . . . . . B-5 VirtualNIC Interface Configuration and Administration VirtualNIC Interface Configuration and Administration. . . . . . . . . . . . . . . . . C-1 Getting Information about Ethernet IOCs on the Fabric . . . . . . . . . . . C-1 Editing the VirtualNIC Configuration file . . . . . . . . . . . . . . . . . . . . . . . C-4 Format 1: Defining an IOC using the IOCGUID . . . . . . . . . . . . . C-5 Format 2: Defining an IOC using the IOCSTRING . . . . . . . . . . . C-6 Format 3: Starting VNIC using DGID . . . . . . . . . . . . . . . . . . . . . C-6 D000046-005 vii
Page 1 and 2: QLogic OFED+ Host Software User Gui
Page 3 and 4: Table of Contents 1 Introduction Ho
Page 5: QLogic OFED+ Host Software User Gui
Page 15 and 16: Preface The QLogic OFED+ Host Softw
Page 17 and 18: Preface Technical Support Technical
Page 19 and 20: 1 Introduction How this Guide is Or
Page 21 and 22: 1-Introduction Interoperability QLo
Page 23 and 24: 2 Step-by-Step Cluster Setup and MP
Page 25 and 26: 3 TrueScale Cluster Setup and Admin
Page 27 and 28: 3-TrueScale Cluster Setup and Admin
Page 57 and 58:
3-TrueScale Cluster Setup and Admin
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
4 Running QLogic MPI on QLogic Adap
Page 65 and 66:
4-Running QLogic MPI on QLogic Adap
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
5 Using Other MPIs Introduction Thi
Page 93 and 94:
5-Using Other MPIs Open MPI Open MP
Page 95 and 96:
5-Using Other MPIs MVAPICH Further
Page 97 and 98:
5-Using Other MPIs Managing Open MP
Page 99 and 100:
5-Using Other MPIs Platform (Scali)
Page 101 and 102:
5-Using Other MPIs Intel MPI Intel
Page 103 and 104:
5-Using Other MPIs Intel MPI When u
Page 105 and 106:
5-Using Other MPIs Improving Perfor
Page 107 and 108:
6 Performance Scaled Messaging Intr
Page 109 and 110:
6-Performance Scaled Messaging Usin
Page 111 and 112:
7 Dispersive Routing Infiniband use
Page 113 and 114:
7-Dispersive Routing • Static_Des
Page 115 and 116:
8 gPXE gPXE Setup gPXE is an open s
Page 117 and 118:
8-gPXE Preparing the DHCP Server in
Page 119 and 120:
8-gPXE Netbooting Over InfiniBand P
Page 121 and 122:
8-gPXE Netbooting Over InfiniBand W
Page 123 and 124:
8-gPXE Netbooting Over InfiniBand #
Page 125 and 126:
8-gPXE Netbooting Over InfiniBand #
Page 127 and 128:
8-gPXE Netbooting Over InfiniBand T
Page 129 and 130:
8-gPXE HTTP Boot Setup 5. Create an
Page 131 and 132:
A mpirun Options Summary This secti
Page 133 and 134:
A-mpirun Options Summary Quiescence
Page 135 and 136:
A-mpirun Options Summary Tuning Opt
Page 137 and 138:
A-mpirun Options Summary Format Opt
Page 139 and 140:
B Benchmark Programs Several MPI pe
Page 141 and 142:
B-Benchmark Programs Benchmark 2: M
Page 143 and 144:
B-Benchmark Programs Benchmark 4: M
Page 145 and 146:
C VirtualNIC Interface Configuratio
Page 147 and 148:
C-VirtualNIC Interface Configuratio
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
D SRP Configuration SRP Configurati
Page 163 and 164:
D-SRP Configuration QLogic SRP Conf
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
Page 179 and 180:
Page 181 and 182:
Page 183 and 184:
Page 185 and 186:
D-SRP Configuration OFED SRP Config
Page 187 and 188:
E Integration with a Batch Queuing
Page 189 and 190:
E-Integration with a Batch Queuing
Page 191 and 192:
E-Integration with a Batch Queuing
Page 193 and 194:
F Troubleshooting This appendix des
Page 195 and 196:
F-Troubleshooting Kernel and Initia
Page 197 and 198:
F-Troubleshooting Kernel and Initia
Page 199 and 200:
F-Troubleshooting OpenFabrics and I
Page 201 and 202:
F-Troubleshooting Performance Issue
Page 203 and 204:
F-Troubleshooting QLogic MPI Troubl
Page 205 and 206:
Page 207 and 208:
Page 209 and 210:
Page 211 and 212:
Page 213 and 214:
Page 215 and 216:
Page 217 and 218:
Page 219 and 220:
Page 221 and 222:
Page 223 and 224:
Page 225 and 226:
G ULP Troubleshooting Troubleshooti
Page 227 and 228:
G-ULP Troubleshooting Troubleshooti
Page 229 and 230:
Page 231 and 232:
Page 233 and 234:
Page 235 and 236:
Page 237 and 238:
Page 239 and 240:
Page 241 and 242:
H Write Combining Introduction Writ
Page 243 and 244:
H-Write Combining MTRR Mapping and
Page 245 and 246:
I Useful Programs and Files The mos
Page 247 and 248:
I-Useful Programs and Files Summary
Page 249 and 250:
Page 251 and 252:
Page 253 and 254:
Page 255 and 256:
Page 257 and 258:
Page 259 and 260:
Page 261 and 262:
I-Useful Programs and Files Common
Page 263 and 264:
Page 265 and 266:
Page 267 and 268:
Page 269 and 270:
J Recommended Reading Reference mat
Page 272:
Corporate Headquarters QLogic Corpo
show all

QLogic OFED+ Host Software User Guide, Rev. B

Create successful ePaper yourself

Delete template?

Save as template?