QLogic OFED+ Host Software User Guide, Rev. B

More documents

Recommendations

Info

QLogic OFED+ Host Software User Guide QLogic OFED+ Version 1.5 ipath_control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-12 ipath_mtrr. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-13 ipath_pkt_test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-14 ipathstats. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-15 lsmod . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-15 modprobe . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-15 mpirun . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-15 mpi_stress. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-16 rpm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-16 strings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-17 Common Tasks and Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-17 Summary and Descriptions of Useful Files . . . . . . . . . . . . . . . . . . . . . . . . . I-18 boardversion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-19 status_str. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-19 version . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-21 Summary of Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-21 J Recommended Reading References for MPI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-1 Books for Learning MPI Programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-1 Reference and Source for SLURM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-1 InfiniBand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-1 OpenFabrics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-1 Clusters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-2 Networking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-2 Rocks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-2 Other Software Packages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . J-2 List of Figures Figure Page 3-1 QLogic OFED+ Software Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 3-2 Distributed SA Default Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16 3-3 Distributed SA Multiple Virtual Fabrics Example . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-17 3-4 Distributed SA Multiple Virtual Fabrics Configured Example . . . . . . . . . . . . . . . . . . 3-17 3-5 Virtual Fabrics with Overlapping Definitions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-18 3-6 Virtual Fabrics with PSM_MPI Virtual Fabric Enabled . . . . . . . . . . . . . . . . . . . . . . . 3-18 3-7 Virtual Fabrics with all SIDs assigned to PSM_MPI Virtual Fabric. . . . . . . . . . . . . . 3-19 3-8 Virtual Fabrics with Unique Numeric Indexes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-19 C-1 Without IB_Multicast . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . C-10 C-2 With IB_Multicast . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . C-11 xii D000046-005
QLogic OFED+ Host Software User Guide QLogic OFED+ Version 1.5 List of Tables Table Page 4-1 QLogic MPI Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-7 4-2 Command Line Options for Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-7 4-3 Intel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9 4-4 Portland Group (PGI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9 4-5 PathScale Compiler Suite . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-10 4-6 Available Hardware and Software Contexts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-11 4-7 Environment Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-20 5-1 Other Supported MPI Implementations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-1 5-2 Open MPI Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-3 5-3 MVAPICH Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5 5-4 Platform MPI 7 Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8 5-5 Platform MPI Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-10 5-6 Intel MPI Wrapper Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-13 F-1 LED Link and Data Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . F-1 I-1 Useful Programs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-2 I-2 ipath_checkout Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-11 I-3 Common Tasks and Commands Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-17 I-4 Useful Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-19 I-5 status_str File Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-19 I-6 Status—Other Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-20 I-7 Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-21 D000046-005 xiii
Page 1 and 2: QLogic OFED+ Host Software User Gui
Page 3 and 4: Table of Contents 1 Introduction Ho
Page 11: QLogic OFED+ Host Software User Gui
Page 15 and 16: Preface The QLogic OFED+ Host Softw
Page 17 and 18: Preface Technical Support Technical
Page 19 and 20: 1 Introduction How this Guide is Or
Page 21 and 22: 1-Introduction Interoperability QLo
Page 23 and 24: 2 Step-by-Step Cluster Setup and MP
Page 25 and 26: 3 TrueScale Cluster Setup and Admin
Page 27 and 28: 3-TrueScale Cluster Setup and Admin
Page 63 and 64:
4 Running QLogic MPI on QLogic Adap
Page 65 and 66:
4-Running QLogic MPI on QLogic Adap
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
5 Using Other MPIs Introduction Thi
Page 93 and 94:
5-Using Other MPIs Open MPI Open MP
Page 95 and 96:
5-Using Other MPIs MVAPICH Further
Page 97 and 98:
5-Using Other MPIs Managing Open MP
Page 99 and 100:
5-Using Other MPIs Platform (Scali)
Page 101 and 102:
5-Using Other MPIs Intel MPI Intel
Page 103 and 104:
5-Using Other MPIs Intel MPI When u
Page 105 and 106:
5-Using Other MPIs Improving Perfor
Page 107 and 108:
6 Performance Scaled Messaging Intr
Page 109 and 110:
6-Performance Scaled Messaging Usin
Page 111 and 112:
7 Dispersive Routing Infiniband use
Page 113 and 114:
7-Dispersive Routing • Static_Des
Page 115 and 116:
8 gPXE gPXE Setup gPXE is an open s
Page 117 and 118:
8-gPXE Preparing the DHCP Server in
Page 119 and 120:
8-gPXE Netbooting Over InfiniBand P
Page 121 and 122:
8-gPXE Netbooting Over InfiniBand W
Page 123 and 124:
8-gPXE Netbooting Over InfiniBand #
Page 125 and 126:
8-gPXE Netbooting Over InfiniBand #
Page 127 and 128:
8-gPXE Netbooting Over InfiniBand T
Page 129 and 130:
8-gPXE HTTP Boot Setup 5. Create an
Page 131 and 132:
A mpirun Options Summary This secti
Page 133 and 134:
A-mpirun Options Summary Quiescence
Page 135 and 136:
A-mpirun Options Summary Tuning Opt
Page 137 and 138:
A-mpirun Options Summary Format Opt
Page 139 and 140:
B Benchmark Programs Several MPI pe
Page 141 and 142:
B-Benchmark Programs Benchmark 2: M
Page 143 and 144:
B-Benchmark Programs Benchmark 4: M
Page 145 and 146:
C VirtualNIC Interface Configuratio
Page 147 and 148:
C-VirtualNIC Interface Configuratio
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
D SRP Configuration SRP Configurati
Page 163 and 164:
D-SRP Configuration QLogic SRP Conf
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
Page 179 and 180:
Page 181 and 182:
Page 183 and 184:
Page 185 and 186:
D-SRP Configuration OFED SRP Config
Page 187 and 188:
E Integration with a Batch Queuing
Page 189 and 190:
E-Integration with a Batch Queuing
Page 191 and 192:
E-Integration with a Batch Queuing
Page 193 and 194:
F Troubleshooting This appendix des
Page 195 and 196:
F-Troubleshooting Kernel and Initia
Page 197 and 198:
F-Troubleshooting Kernel and Initia
Page 199 and 200:
F-Troubleshooting OpenFabrics and I
Page 201 and 202:
F-Troubleshooting Performance Issue
Page 203 and 204:
F-Troubleshooting QLogic MPI Troubl
Page 205 and 206:
Page 207 and 208:
Page 209 and 210:
Page 211 and 212:
Page 213 and 214:
Page 215 and 216:
Page 217 and 218:
Page 219 and 220:
Page 221 and 222:
Page 223 and 224:
Page 225 and 226:
G ULP Troubleshooting Troubleshooti
Page 227 and 228:
G-ULP Troubleshooting Troubleshooti
Page 229 and 230:
Page 231 and 232:
Page 233 and 234:
Page 235 and 236:
Page 237 and 238:
Page 239 and 240:
Page 241 and 242:
H Write Combining Introduction Writ
Page 243 and 244:
H-Write Combining MTRR Mapping and
Page 245 and 246:
I Useful Programs and Files The mos
Page 247 and 248:
I-Useful Programs and Files Summary
Page 249 and 250:
Page 251 and 252:
Page 253 and 254:
Page 255 and 256:
Page 257 and 258:
Page 259 and 260:
Page 261 and 262:
I-Useful Programs and Files Common
Page 263 and 264:
Page 265 and 266:
Page 267 and 268:
Page 269 and 270:
J Recommended Reading Reference mat
Page 272:
Corporate Headquarters QLogic Corpo
show all

QLogic OFED+ Host Software User Guide, Rev. B

Create successful ePaper yourself

Delete template?

Save as template?