VSAN-Troubleshooting-Reference-Manual

Recommendations

Info

Diagnostics and Troubleshooting Reference Manual – Virtual SAN WHAT HAPPENS WHEN THE ENTIRE CLUSTER NETWORK FAILS? ................................................................. 71 WHAT HAPPENS WHEN A STORAGE I/O CONTROLLER FAILS? ...................................................................... 71 HANDLING MULTIPLE FAILURES ......................................................................................................................... 72 8. GETTING STARTED WITH RVC .................................................................................................... 73 INTRODUCTION TO RVC AND VSAN OBSERVER .............................................................................................. 73 RVC DEPLOYMENT SUGGESTION/RECOMMENDATION ................................................................................... 73 LAUNCHING RVC FROM THE VCENTER SERVER APPLIANCE ......................................................................... 73 LAUNCHING RVC FROM WINDOWS VCENTER SERVER .................................................................................. 77 9. NAVIGATING RVC ............................................................................................................................. 79 NAVIGATING RVC EXAMPLES .............................................................................................................................. 79 USING RVC TO DISPLAY ADAPTER INFORMATION ........................................................................................... 81 vsan.disks_info –show-adapters .................................................................................................................... 81 USING RVC TO VERIFY VIRTUAL SAN FUNCTIONALITY ................................................................................. 81 vsan.cluster_info .................................................................................................................................................... 82 A note of fault domains ...................................................................................................................................... 83 vsan.check_state .................................................................................................................................................... 84 vsan.check_limits .................................................................................................................................................. 86 Brief explanation on RDT Assocs/Sockets/Client/Owners ............................................................... 88 Brief explanation of disk components revisited ..................................................................................... 88 Understanding components and component count ............................................................................. 90 Examining components via the vSphere web client ............................................................................. 90 vsan.vm_object_info ............................................................................................................................................. 92 vsan.object_info ..................................................................................................................................................... 93 vsan.whatif_host_failures .................................................................................................................................. 94 10. TROUBLESHOOTING THE VIRTUAL SAN NETWORK ......................................................... 95 INTRODUCTION TO VIRTUAL SAN NETWORKING ........................................................................................... 96 VIRTUAL SAN NETWORK REQUIREMENTS ........................................................................................................ 97 Physical Network Interface Card (NIC) requirements ........................................................................ 97 Virtual SAN traffic – vmknic requirement ................................................................................................ 97 Virtual switch requirement ............................................................................................................................. 97 MTU & jumbo frames .......................................................................................................................................... 98 Multicast traffic requirement ......................................................................................................................... 98 IGMP snooping and IGMP querier for multicast traffic ...................................................................... 99 Using NIOC and VDS to set Quality of Service on Virtual SAN traffic ........................................ 100 VIRTUAL SAN AND VSPHERE HA NETWORK DEPENDENCY ....................................................................... 101 Changing the vSphere HA network ........................................................................................................... 101 CHECKING THE VIRTUAL SAN NETWORK IS OPERATIONAL ....................................................................... 102 esxcli vsan network list ................................................................................................................................... 102 esxcli network ip interface list ..................................................................................................................... 103 esxcli network ip interface ipv4 get –i vmk2 ........................................................................................ 103 vmkping ................................................................................................................................................................. 104 vsan.cluster_info ................................................................................................................................................. 104 esxcli network ip neighbor list .................................................................................................................... 105 esxcli network diag ping ................................................................................................................................ 105 CHECKING MULTICAST SETTINGS..................................................................................................................... 106 tcpdump-uw –i vmk2 udp port 23451 –v ............................................................................................... 106 tcpdump-uw –i vmk2 igmp ........................................................................................................................... 107 CHANGING MULTICAST SETTINGS WHEN MULTIPLE VIRTUAL SAN CLUSTERS ARE PRESENT .............. 108 V M W A R E S T O R A G E B U D O C U M E N T A T I O N / 4
Diagnostics and Troubleshooting Reference Manual – Virtual SAN esxcli vsan network list ................................................................................................................................... 108 esxcli vsan network ipv4 set ......................................................................................................................... 108 NETWORK PORTS AND ESXI FIREWALL ......................................................................................................... 109 CHECKING PERFORMANCE OF VIRTUAL SAN NETWORK ............................................................................. 110 iperf for Virtual SAN 5.5 ................................................................................................................................. 110 iperf for Virtual SAN 6.0 ................................................................................................................................. 110 CHECKING VIRTUAL SAN NETWORK LIMITS ................................................................................................. 111 vsan.check_limits ............................................................................................................................................... 111 NETWORK STATUS: MISCONFIGURATION DETECTED .................................................................................. 113 IDENTIFYING A PARTITIONED CLUSTER ......................................................................................................... 113 esxcli vsan cluster get ...................................................................................................................................... 114 vsan.cluster_info ................................................................................................................................................. 115 TROUBLESHOOTING A MULTICAST CONFIGURATION ISSUE ......................................................................... 116 Symptoms of a multicast misconfiguration issue ............................................................................... 116 TROUBLESHOOTING A MTU/JUMBO FRAMES MISMATCH ........................................................................... 117 esxcli network ip interface list ..................................................................................................................... 117 esxcli network vswitch standard list ........................................................................................................ 117 Symptoms of MTU misconfiguration: Cannot complete file creation ....................................... 119 VERIFYING SUBNETS/VLAN SETTINGS .......................................................................................................... 120 esxcli network ip interface ipv4 get –i vmk2 ........................................................................................ 120 REFRESHING NETWORK CONFIGURATION ...................................................................................................... 121 vsan.reapply_vsan_vmknic_config ............................................................................................................. 121 CONSIDERATIONS WHEN USING LACP FOR VSAN NETWORK ................................................................... 121 ROUTING THE VIRTUAL SAN TRAFFIC OVER LAYER 3 NETWORKS............................................................ 121 PHYSICAL NETWORK SWITCH CONFIGURATIONS AND FLOW CONTROL .................................................... 122 ethtool ..................................................................................................................................................................... 122 PHYSICAL NETWORK SWITCH FEATURE INTEROPERABILITY ...................................................................... 122 CHECKLIST SUMMARY FOR VIRTUAL SAN NETWORKING ........................................................................... 123 11. TROUBLESHOOTING VIRTUAL SAN STORAGE .................................................................. 124 VIRTUAL SAN OBJECTS AND COMPONENTS REVISITED ............................................................................... 124 Object layout and RAID trees ....................................................................................................................... 125 VIRTUAL SAN STORAGE REQUIREMENTS ....................................................................................................... 127 Pass-thru mode versus RAID-0 mode ....................................................................................................... 127 Checking your storage I/O controller queue depth ........................................................................... 128 Esxtop for controller queue depth ............................................................................................................. 128 esxcfg-info –s | grep “==+SCSI Interface” –A 18 .................................................................................. 129 CONFIGURING VIRTUAL SAN STORAGE .......................................................................................................... 131 Storage I/O controller cache ....................................................................................................................... 131 A note about HP SSD Smart Path observations ................................................................................... 131 A note about the all-flash capacity layer ................................................................................................ 132 IDENTIFY AN SSD WHICH IS A RAID-0 VOLUME .......................................................................................... 133 VIRTUAL SAN STORAGE LIMITS ....................................................................................................................... 134 vsan.check_limits ............................................................................................................................................... 134 VERIFYING VIRTUAL SAN STORAGE OPERATION – ESX CLI ...................................................................... 136 esxcli core storage device list ....................................................................................................................... 136 Is SSD and Is Local ............................................................................................................................................ 137 esxcli vsan storage list ..................................................................................................................................... 138 vdq ............................................................................................................................................................................ 138 vdq - IsCapacityFlash ....................................................................................................................................... 139 V M W A R E S T O R A G E B U D O C U M E N T A T I O N / 5
Page 1 and 2: Diagnostics and Troubleshooting Gui
Page 3: Diagnostics and Troubleshooting Ref
Page 7 and 8: Diagnostics and Troubleshooting Ref
Page 55 and 56:
Diagnostics and Troubleshooting Ref
Page 57 and 58:
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
Page 135 and 136:
Page 137 and 138:
Page 139 and 140:
Page 141 and 142:
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
Page 163 and 164:
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
Page 179 and 180:
Page 181 and 182:
Page 183 and 184:
Page 185 and 186:
Page 187 and 188:
Page 189 and 190:
Page 191 and 192:
Page 193 and 194:
Page 195 and 196:
Page 197 and 198:
Page 199 and 200:
Page 201 and 202:
Page 203 and 204:
Page 205 and 206:
Page 207 and 208:
Page 209 and 210:
Page 211 and 212:
Page 213 and 214:
Page 215 and 216:
Page 217 and 218:
Page 219 and 220:
Page 221 and 222:
Page 223 and 224:
Page 225 and 226:
Page 227 and 228:
Page 229 and 230:
Page 231 and 232:
Page 233 and 234:
Page 235 and 236:
Page 237 and 238:
Page 239 and 240:
Page 241 and 242:
Page 243 and 244:
Page 245 and 246:
Page 247 and 248:
Page 249 and 250:
Page 251 and 252:
Page 253 and 254:
Page 255 and 256:
Page 257 and 258:
Page 259 and 260:
Page 261 and 262:
Page 263 and 264:
Page 265 and 266:
Page 267 and 268:
Page 269 and 270:
Page 271 and 272:
Page 273 and 274:
Page 275 and 276:
Page 277 and 278:
Page 279 and 280:
Page 281 and 282:
Page 283 and 284:
Page 285 and 286:
Page 287 and 288:
Page 289 and 290:
Page 291 and 292:
Page 293 and 294:
Page 295:
show all

VSAN-Troubleshooting-Reference-Manual

Create successful ePaper yourself

Delete template?

Save as template?