InfiniBand Architecture Overview - HPC Advisory Council

More documents

Recommendations

Info

Link Layer: Payload Size Maximum Transfer Unit (MTU) • MTU allowed from 256 Bytes to 4K Bytes (Message sizes much larger). • Only packets smaller than or equal to the MTU are transmitted • Large MTU is more efficient (less overhead) • Small MTU gives less jitter • Small MTU preferable since segmentation/reassembly performed by hardware in the HCA. • Routing between end nodes utilizes the smallest MTU of any link in the path (Path MTU) © 2009 MELLANOX TECHNOLOGIES - CONFIDENTIAL - 12
Link Layer: Virtual Lanes (Quality of Service) 16 Service Levels (SLs) • A field in the Local Routing Header (LRH) of an <strong>InfiniBand</strong> packet • Defines the requested QoS Virtual Lanes (VLs) • A mechanism for creating multiple channels within a single physical link. • Each VL: – Is associated with a set of Tx/Rx buffers in a port – Has separate flow-control • A configurable Arbiter control the Tx priority of each VL • Each SL is mapped to a VL • IB Spec allows a total of 16 VLs (15 for Data & 1 for Management) – Minimum of 1 Data and 1 Management required on all links – Switch ports and HCAs may each support a different number of VLs • VL 15 is a management VL and is not a subject for flow control © 2009 MELLANOX TECHNOLOGIES - CONFIDENTIAL - 13
Page 1 and 2: InfiniBand Architecture Overview Ba
Page 3 and 4: Infiniband Feature Highlights Seri
Page 5 and 6: IB Architecture Layers • Physical
Page 7 and 8: Physical Layer - Responsibilities
Page 9 and 10: Physical Layer Cont’ Media types
Page 11: Link Layer: Packets Packets are ro
Page 15 and 16: Link Layer: Example Transaction Tra
Page 17 and 18: Link Layer: Example Virtual Lane In
Page 19 and 20: Layer 2 Forwarding Switches use FD
Page 21 and 22: Transport Layer - Responsibilities
Page 23 and 24: Transport Layer: Work Request Eleme
Page 25 and 26: Transport Services Non-connected Co
Page 27 and 28: Transport Layer: RDMA Write Example
Page 29 and 30: Verbs Verbs are the SW interface t
Page 31 and 32: Management Model SNMP Tunneling Age
Page 33 and 34: Subnet Management Topology Discover
Page 35 and 36: Topologies There are several commo
Page 37 and 38: InfiniBand Link Speed Roadmap © 20

InfiniBand Architecture Overview - HPC Advisory Council

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?