IBM System x at-a-glance guide - QLogic
IBM System x at-a-glance guide - QLogic
IBM System x at-a-glance guide - QLogic
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
®<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches forthe <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex<strong>IBM</strong> <strong>System</strong> x <strong>at</strong>-a-<strong>glance</strong> <strong>guide</strong>Over the past 10 years, InfiniBand networks have become the preferred means for interconnecting highperformance computing (HPC) resources. The <strong>QLogic</strong> 12200 and 12300 are 36-port Quad D<strong>at</strong>a R<strong>at</strong>e(QDR, 40 Gbps) InfiniBand switches designed to cost-effectively link workgroup resources into a clusteror provide an edge switch option for a larger fabric. The 12200 is a fixed configur<strong>at</strong>ion, externallymanaged InfiniBand switch; the 12300 is a modular, internally or externally managed InfiniBand switch.Both switches are part of the 12000 Series of products th<strong>at</strong> delivers an unm<strong>at</strong>ched set of high speednetworking fe<strong>at</strong>ures and functions.Figure 1 shows the rear of the 12200 switch. The 12300 is very similar in port layout.Figure 1. <strong>QLogic</strong> 12200 QDR InfiniBand switchDid you know?<strong>QLogic</strong> 12200 and 12300 InfiniBand switch series are part of <strong>IBM</strong> <strong>System</strong>s Cluster 1350 solution. TheCluster 1350 is your key to a fully integr<strong>at</strong>ed HPC solution. <strong>IBM</strong> clustering solutions include servers,storage, and industry-leading OEM interconnects th<strong>at</strong> are factory-integr<strong>at</strong>ed, fully tested, and delivered toyour door, ready to plug into your d<strong>at</strong>a center, all with a single point of contact for support.<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 1
Part number inform<strong>at</strong>ionTable 1 shows the part numbers to order these switches.Table 1. <strong>IBM</strong> part numbers for orderingDescription<strong>IBM</strong> part number<strong>QLogic</strong> 12200 36-port QDR InfiniBand Switch Bundle 0449-019<strong>QLogic</strong> 12200 (iDPx) 36-port QDR InfiniBand Switch Bundle 0449-020<strong>QLogic</strong> 12300 36-port QDR InfiniBand Switch Bundle 0449-021The <strong>QLogic</strong> 12200 and 12300 QDR InfiniBand edge switches are based on <strong>QLogic</strong> TrueScale ASICtechnology and deliver the next evolution in switching for high performance computing (HPC). Theavailable models are tailored for the requirements of the solution:• The <strong>QLogic</strong> 12200 Fixed Configur<strong>at</strong>ion switch for the Cluster 1350 (0449-019) provides 36 QDR portsin a compact 1U 14.5-inch deep fixed form factor, making it the ideal edge switch for large HPC fabricdeployments.• The <strong>QLogic</strong> 12200 Fixed Configur<strong>at</strong>ion switch for iD<strong>at</strong>aPlex (0449-020) provides 36 QDR ports in acompact 1U 14.5-inch deep fixed form factor. It includes AC power entry, air flow, and mountinghardware tailored for <strong>IBM</strong> iD<strong>at</strong>aPlex, making it the ideal embedded or edge switch for iD<strong>at</strong>aPlexsolutions deploying InfiniBand.• The <strong>QLogic</strong> 12300 Configurable switch for Cluster 1350 (0449-021) is an ideal edge switch forenterprise clustering. It provides 36 QDR ports in a standard 1U 26-inch deep form factor andincludes a management processor supporting chassis management and an embedded InfiniBandSubnet Manager. The highly available 12300 design is built around st<strong>at</strong>e-of-the-art fault detection andrecovery capabilities. It ships with redundant hot-swap power and cooling modules.BenefitsThe <strong>QLogic</strong> 12200 and 12300 InfiniBand switches offer the following benefits:• Low l<strong>at</strong>ency: The <strong>QLogic</strong> 12200 and 12300 provide scalable, predictable low l<strong>at</strong>ency, even <strong>at</strong> 90%traffic use. Predictable l<strong>at</strong>ency means HPC applic<strong>at</strong>ions can be scaled easily without worrying aboutdiminished cluster performance or costly system tuning efforts.• Flexible partitioning: The <strong>QLogic</strong> 12200 and 12300 advanced design is based on an architecture th<strong>at</strong>provides comprehensive virtual fabric partitioning capabilities th<strong>at</strong> enable the InfiniBand fabric tosupport the evolving requirements of an organiz<strong>at</strong>ion. The TrueScale architecture, together with IFS,allows the fabric to be shared by mission-critical applic<strong>at</strong>ions while delivering maximum bandwidthutiliz<strong>at</strong>ion.• Investment protection: The 12000 series of switch products adhere to the IBTA version 1.2specific<strong>at</strong>ion, ensuring the ability to interoper<strong>at</strong>e with all other IBTA compliant devices.• Highly reliable: The highly available 12200 and 12300 design is built around st<strong>at</strong>e of the art faultdetection and recovery capabilities. In addition, 12300 ships with hot swappable, redundant powerand cooling modules.• Easy to manage: The 12200 takes advantage of <strong>QLogic</strong>’s advanced InfinBand Fabric Suite Softwareto facilit<strong>at</strong>e quicker install<strong>at</strong>ion and configur<strong>at</strong>ion. IFS has advanced tools to verify fabric configur<strong>at</strong>ion,topology and performance. Faults are autom<strong>at</strong>ically isol<strong>at</strong>ed to the component level and reported. Inaddition, an optional embedded capability of 12300 can be used for switch management.<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 2
• Power optimized: Maximum performance is delivered with minimal power and cooling requirementsas part of <strong>QLogic</strong>’s Star Power commitment to developing green solutions for the d<strong>at</strong>a center.Fe<strong>at</strong>ures and specific<strong>at</strong>ionsThe <strong>QLogic</strong> 12200 and 12300 InfiniBand switches include the following fe<strong>at</strong>ures and functions:• 36 ports of InfiniBand QDR (40Gbps) performance with support for DDR and SDR• 40/20/10-Gbps auto-negoti<strong>at</strong>ion links• Supports Quad Small Form Factor Pluggable (QSFP) optical and copper cable specific<strong>at</strong>ions• TrueScale architecture, with scalable, predictable low l<strong>at</strong>ency• 2.88-Tbps aggreg<strong>at</strong>e bandwidth• Switching l<strong>at</strong>ency: < 140 ns• Multiple Virtual Lanes (VLs) per physical port• Virtual lanes: 8 plus 1 management• Maximum MTU size: 4096 bytes• Maximum multicast table size: 1024 entries• Supports virtual fabric partitioning• External chassis management via optional InfiniBand Fabric Suite (IFS) management solution, whichprovides an expanded set of fabric views and fabric tools.• Complies with InfiniBand Trade Associ<strong>at</strong>ion (IBTA) version 1.2 standardThe <strong>QLogic</strong> 12200 InfiniBand switch supports the following management methods:• Optional external server-based InfiniBand compliant subnet manager• IBTA compliant SMA and PMAThe <strong>QLogic</strong> 12300 InfiniBand switch supports the following management methods:• Command line interface• Optional external server-based InfiniBand compliant subnet manager• Optional embedded fabric management• IBTA compliant SMA,PMA, and BMA• Chassis management GUI• SNMP support• Access methods:• 10/100 Ethernet Base-T• Serial port (RS-232 with DB9)The following LEDs are loc<strong>at</strong>ed on <strong>QLogic</strong> 12200 InfiniBand switches:• One per InfiniBand port• Two for InfiniBand switch st<strong>at</strong>us<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 3
The following LEDs are loc<strong>at</strong>ed on <strong>QLogic</strong> 12300 InfiniBand switches:• One per InfiniBand port• One for 10/100 Ethernet interface• Two for InfiniBand switch st<strong>at</strong>usSupported <strong>System</strong> x and BladeCenter servers , adapters, and cablesThe <strong>QLogic</strong> 12200 and 12300 InfiniBand switches support <strong>IBM</strong> <strong>System</strong> Cluster 1350 nodes withInfiniBand adapters installed in the <strong>System</strong> x or BladeCenter servers. The tables below show coresolution components from the <strong>IBM</strong> <strong>System</strong> Cluster 1350 Service Component Guide Release 9A Version1.0.QDR InfiniBand solution with <strong>System</strong> x servers and <strong>QLogic</strong> 12200 or 12300 series switchesTable 2 shows core components to cre<strong>at</strong>e a full-speed QDR (40 Gbps) InfiniBand solution using <strong>QLogic</strong>12200 or 12300 InfiniBand switches and <strong>System</strong> x servers.Table 2. QDR InfiniBand solution core components for <strong>System</strong> xDescription<strong>IBM</strong> part number ormachine typeInfiniBand Host Channel AdaptersMellanox ConnectX Single-Port 4X QDR InfiniBand x8 PCI-E 2.0 HCAMellanox ConnectX Dual-Port 4X QDR InfiniBand x8 PCI-E 2.0 HCA46M220346M2199Compute Nodes<strong>IBM</strong> <strong>System</strong> x3450 7948<strong>IBM</strong> <strong>System</strong> x3550 M2 7946<strong>IBM</strong> <strong>System</strong> x3650 M2 7947<strong>IBM</strong> <strong>System</strong> x3655 7943<strong>IBM</strong> <strong>System</strong> x3455 7940, 7941<strong>IBM</strong> <strong>System</strong> x3755 7163<strong>IBM</strong> <strong>System</strong> x iD<strong>at</strong>aPlex dx360 M2 7321, 7323Cables3m <strong>QLogic</strong> Optical QDR InfiniBand QSFP Cable10m <strong>QLogic</strong> Optical QDR InfiniBand QSFP Cable30m <strong>QLogic</strong> Optical QDR InfiniBand QSFP Cable59Y192059Y192459Y1928<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 4
DDR InfiniBand (20 Gbps) solution with <strong>System</strong> x servers and <strong>QLogic</strong> 12200 or 12300 switchesTable 3 shows core components to cre<strong>at</strong>e a full-speed DDR (20 Gbps) InfiniBand solution using <strong>QLogic</strong>12200 or 12300 InfiniBand switches and <strong>System</strong> x servers.Table 3. DDR InfiniBand solution core components for <strong>System</strong> xDescription<strong>IBM</strong> part number ormachine typeInfiniBand Host Channel AdaptersMellanox Single-Port 4X DDR InfiniBand x8PCI-E x8 HCAMellanox ConnectX Dual-Port 4X DDR InfiniBand x8 PCI-E 2.0 HCA44R997644R8728Compute Nodes<strong>IBM</strong> <strong>System</strong> x3450 7948<strong>IBM</strong> <strong>System</strong> x3550 M2 7946<strong>IBM</strong> <strong>System</strong> x3650 M2 7947<strong>IBM</strong> <strong>System</strong> x3655 7943<strong>IBM</strong> <strong>System</strong> x3455 7940, 7941<strong>IBM</strong> <strong>System</strong> x3755 7163<strong>IBM</strong> <strong>System</strong> x iD<strong>at</strong>aPlex dx360 M2 7321, 7323Cables3m <strong>QLogic</strong> Optical DDR InfiniBand QSFP-to-CX4 Cable10m <strong>QLogic</strong> Optical DDR InfiniBand QSFP-to-CX4 Cable30m <strong>QLogic</strong> Optical DDR InfiniBand QSFP-to-CX4 Cable59Y190859Y191259Y1916<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 5
NoticesThis inform<strong>at</strong>ion was developed for products and services offered in the U.S.A.<strong>IBM</strong> may not offer the products, services, or fe<strong>at</strong>ures discussed in this document in other countries. Consult your local<strong>IBM</strong> represent<strong>at</strong>ive for inform<strong>at</strong>ion on the products and services currently available in your area. Any reference to an<strong>IBM</strong> product, program, or service is not intended to st<strong>at</strong>e or imply th<strong>at</strong> only th<strong>at</strong> <strong>IBM</strong> product, program, or service maybe used. Any functionally equivalent product, program, or service th<strong>at</strong> does not infringe any <strong>IBM</strong> intellectual propertyright may be used instead. However, it is the user's responsibility to evalu<strong>at</strong>e and verify the oper<strong>at</strong>ion of any non-<strong>IBM</strong>product, program, or service. <strong>IBM</strong> may have p<strong>at</strong>ents or pending p<strong>at</strong>ent applic<strong>at</strong>ions covering subject m<strong>at</strong>ter describedin this document. The furnishing of this document does not give you any license to these p<strong>at</strong>ents. You can sendlicense inquiries, in writing, to:<strong>IBM</strong> Director of Licensing, <strong>IBM</strong> Corpor<strong>at</strong>ion, North Castle Drive, Armonk, NY 10504-1785 U.S.A.The following paragraph does not apply to the United Kingdom or any other country where such provisionsare inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THISPUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUTNOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESSFOR A PARTICULAR PURPOSE. Some st<strong>at</strong>es do not allow disclaimer of express or implied warranties in certaintransactions, therefore, this st<strong>at</strong>ement may not apply to you. This inform<strong>at</strong>ion could include technical inaccuracies ortypographical errors. Changes are periodically made to the inform<strong>at</strong>ion herein; these changes will be incorpor<strong>at</strong>ed innew editions of the public<strong>at</strong>ion. <strong>IBM</strong> may make improvements and/or changes in the product(s) and/or the program(s)described in this public<strong>at</strong>ion <strong>at</strong> any time without notice.Any references in this inform<strong>at</strong>ion to non-<strong>IBM</strong> Web sites are provided for convenience only and do not in any mannerserve as an endorsement of those Web sites. The m<strong>at</strong>erials <strong>at</strong> those Web sites are not part of the m<strong>at</strong>erials for this<strong>IBM</strong> product and use of those Web sites is <strong>at</strong> your own risk.<strong>IBM</strong> may use or distribute any of the inform<strong>at</strong>ion yousupply in any way it believes appropri<strong>at</strong>e without incurring any oblig<strong>at</strong>ion to you. Inform<strong>at</strong>ion concerning non-<strong>IBM</strong>products was obtained from the suppliers of those products, their published announcements or other publiclyavailable sources. <strong>IBM</strong> has not tested those products and cannot confirm the accuracy of performance, comp<strong>at</strong>ibilityor any other claims rel<strong>at</strong>ed to non-<strong>IBM</strong> products. Questions on the capabilities of non-<strong>IBM</strong> products should beaddressed to the suppliers of those products. This inform<strong>at</strong>ion contains examples of d<strong>at</strong>a and reports used in dailybusiness oper<strong>at</strong>ions. To illustr<strong>at</strong>e them as completely as possible, the examples include the names of individuals,companies, brands, and products. All of these names are fictitious and any similarity to the names and addressesused by an actual business enterprise is entirely coincidental.Any performance d<strong>at</strong>a contained herein was determined in a controlled environment. Therefore, the results obtainedin other oper<strong>at</strong>ing environments may vary significantly. Some measurements may have been made ondevelopment-level systems and there is no guarantee th<strong>at</strong> these measurements will be the same on generallyavailable systems. Furthermore, some measurement may have been estim<strong>at</strong>ed through extrapol<strong>at</strong>ion. Actual resultsmay vary. Users of this document should verify the applicable d<strong>at</strong>a for their specific environment.COPYRIGHT LICENSE:This inform<strong>at</strong>ion contains sample applic<strong>at</strong>ion programs in source language, which illustr<strong>at</strong>e programming techniqueson various oper<strong>at</strong>ing pl<strong>at</strong>forms. You may copy, modify, and distribute these sample programs in any form withoutpayment to <strong>IBM</strong>, for the purposes of developing, using, marketing or distributing applic<strong>at</strong>ion programs conforming tothe applic<strong>at</strong>ion programming interface for the oper<strong>at</strong>ing pl<strong>at</strong>form for which the sample programs are written. Theseexamples have not been thoroughly tested under all conditions. <strong>IBM</strong>, therefore, cannot guarantee or imply reliability,serviceability, or function of these programs.© Copyright Intern<strong>at</strong>ional Business Machines Corpor<strong>at</strong>ion 2009. All rights reserved.Note to U.S. Government Users Restricted Rights -- Use, duplic<strong>at</strong>ion or disclosure restricted byGSA ADP Schedule Contract with <strong>IBM</strong> Corp.<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 7
This document was cre<strong>at</strong>ed or upd<strong>at</strong>ed on September 3, 2009.Send us your comments in one of the following ways:• Use the online Contact us review form found <strong>at</strong>:ibm.com/redbooks• Send your comments in an e-mail to:redbook@us.ibm.com• Mail your comments to:<strong>IBM</strong> Corpor<strong>at</strong>ion, Intern<strong>at</strong>ional Technical Support Organiz<strong>at</strong>ionDept. HYTD Mail St<strong>at</strong>ion P0992455 South RoadPoughkeepsie, NY 12601-5400 U.S.A.This document is available online <strong>at</strong> http://www.ibm.com/redbooks/abstracts/tips0723.html .Trademarks<strong>IBM</strong>, the <strong>IBM</strong> logo, and ibm.com are trademarks or registered trademarks of Intern<strong>at</strong>ional BusinessMachines Corpor<strong>at</strong>ion in the United St<strong>at</strong>es, other countries, or both. These and other <strong>IBM</strong> trademarkedterms may also be registered or common law trademarks in other countries. A current list of <strong>IBM</strong>trademarks is available on the Web <strong>at</strong> http://www.ibm.com/legal/copytrade.shtmlThe following terms are trademarks of the Intern<strong>at</strong>ional Business Machines Corpor<strong>at</strong>ion in the UnitedSt<strong>at</strong>es, other countries, or both:1350BladeCenter®<strong>IBM</strong>®Redbooks (logo)®<strong>System</strong> x®The following terms are trademarks of other companies:InfiniBand Trade Associ<strong>at</strong>ion, InfiniBand, and the InfiniBand design marks are trademarks and/or servicemarks of the InfiniBand Trade Associ<strong>at</strong>ion.<strong>QLogic</strong>, and the <strong>QLogic</strong> logo are registered trademarks of <strong>QLogic</strong> Corpor<strong>at</strong>ion. SANblade is a registeredtrademark in the United St<strong>at</strong>es.Other company, product, or service names may be trademarks or service marks of others.<strong>QLogic</strong> 12200 and 12300 InfiniBand Edge Switches for the <strong>IBM</strong> <strong>System</strong>s Cluster 1350 and <strong>IBM</strong> iD<strong>at</strong>aPlex 8
Change language