PCI Express Overview - PLX Technology
PCI Express Overview - PLX Technology
PCI Express Overview - PLX Technology
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>PLX</strong> <strong>Technology</strong><br />
<strong>PCI</strong> <strong>Express</strong> <strong>Overview</strong><br />
Q1CY07<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST<br />
1
Corporate <strong>Overview</strong><br />
‣ Public U.S. Company<br />
• Founded in 1986<br />
• IPO in 1999<br />
• NASDAQ: <strong>PLX</strong>T<br />
‣ Headquarters in Sunnyvale, CA<br />
• 150 Employees<br />
• Sales & Technical Support Worldwide<br />
• Fabless Semiconductor Business Model<br />
‣ Over 1000 customers worldwide<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 2
<strong>PLX</strong> Interconnect Products<br />
‣ <strong>PLX</strong> is a Leader in I/O Interconnect Products<br />
‣ Our broad product line of devices can bridge popular I/O<br />
standards including <strong>PCI</strong> <strong>Express</strong><br />
Local<br />
Bus<br />
Bridges<br />
Conceptual Drawing, not every possible option available currently from <strong>PLX</strong><br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 3
<strong>PCI</strong> <strong>Express</strong> Focus = Leadership<br />
‣ <strong>PLX</strong> started investing in <strong>PCI</strong> <strong>Express</strong> in 2001<br />
• 100% of all Current Development is <strong>PCI</strong> <strong>Express</strong><br />
‣ Broad Offering of<br />
<strong>PCI</strong> <strong>Express</strong> Bridges & Switches<br />
‣ Objective:<br />
• #1 Supplier of<br />
<strong>PCI</strong> <strong>Express</strong><br />
Switches and Bridges<br />
in the Industry<br />
Switches<br />
Bridges<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 4
<strong>PCI</strong> <strong>Express</strong> in Servers<br />
Bridge<br />
GE<br />
CPU<br />
GE<br />
Switch<br />
Chip Set<br />
Memory<br />
Adapter & Riser Cards<br />
Switch<br />
Stand-alone<br />
alone<br />
Switch<br />
I/O<br />
I/O<br />
Rack-<br />
mount<br />
Blade<br />
I/O<br />
Bridge<br />
I/O<br />
Server<br />
Motherboard<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 5
<strong>PCI</strong> <strong>Express</strong> in Storage Systems<br />
CPU<br />
CPU<br />
SAN<br />
NAS<br />
Chip Set<br />
Memory<br />
Chip Set<br />
Memory<br />
Storage<br />
FC<br />
FC<br />
Switch<br />
Switch<br />
NT<br />
I/O<br />
NT<br />
Switch<br />
I/O<br />
I/O<br />
I/O<br />
SAS<br />
SAS<br />
Switch<br />
Bridge<br />
I/O<br />
Bridge<br />
I/O<br />
High Availability Storage System<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 6
<strong>PCI</strong> <strong>Express</strong> in Peripherals & Consumer<br />
GPU<br />
GPU<br />
Bridge<br />
GPU<br />
Switch<br />
Graphics - Reverse Bridge<br />
Graphics – More Monitors<br />
or Higher Resolution<br />
TV<br />
Tuner<br />
Bridge<br />
TV<br />
Mobile<br />
<strong>PCI</strong> <strong>Express</strong> TV Tuner<br />
Computer Peripheral<br />
and Consumer Electronics<br />
Printer<br />
Wireless LAN<br />
Graphics/<br />
Video<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 7
<strong>PCI</strong> <strong>Express</strong> in Communications<br />
DSLAM<br />
Base Station<br />
Controller<br />
Wireless<br />
LAN Gateway<br />
Enterprise Storage<br />
Co-Processor-<br />
Security/DSP<br />
Switch<br />
NT<br />
NPU/ASIC<br />
VoIP<br />
Gateway<br />
Remote Access<br />
Concentrator<br />
Router/Switch<br />
Local<br />
Processor<br />
Framer<br />
PHY<br />
Line Card 1<br />
Communications<br />
Line Card n<br />
Switch<br />
Control<br />
Processor<br />
Memory<br />
Supervisory or Controller Card<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 8
<strong>PCI</strong> <strong>Express</strong> in Embedded<br />
FPGA<br />
FPGA<br />
Bridge<br />
Bridge<br />
Memory<br />
CPU<br />
Imaging/Graphics<br />
Printer<br />
Medical<br />
Industrial<br />
Embedded<br />
Switch<br />
FPGA<br />
Bridge<br />
Industrial Control &<br />
Instrumentation<br />
I/O<br />
I/O<br />
Host<br />
CPU<br />
Bridge<br />
<strong>PCI</strong>e<br />
ASIC<br />
Embedded Host System<br />
PCe<br />
TAM<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 9
<strong>Express</strong>Lane <strong>PCI</strong> <strong>Express</strong> Switches<br />
‣ 8, 16, 24, 32, & 48 <strong>PCI</strong> <strong>Express</strong> Lanes<br />
• Others in Development/Planned<br />
‣ 4 to 9 Flexible Ports<br />
• x1 to x16 Port Configurations<br />
PEX 8500<br />
Series<br />
‣ Additional Features<br />
• Lowest Latency ~110ns<br />
• Non-Transparent Port<br />
for Dual Hosts<br />
• True Peer-to-Peer<br />
& Fan-Out Capabilities<br />
• Up to 2 Virtual Channels<br />
• Low Power<br />
‣ Available Now<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 10
<strong>PLX</strong> <strong>PCI</strong>e Gen 1 Switch Road Map<br />
48 Lanes<br />
32 Lanes<br />
1 st Generation<br />
Vega Architecture<br />
PEX 8532<br />
32 Lanes, 8 Ports, NT<br />
8 HPC, 2VC, Peer-Peer<br />
Pin Compatible Migration*<br />
PEX 8548<br />
48 Lanes, 9 Ports, 1KB<br />
3 HPC, 110ns Cut-Thru<br />
PEX 8547<br />
48 Lanes, 3 x16 Ports,<br />
for Graphics Apps<br />
PEX 8533<br />
32 Lanes, 6 Ports, 1KB<br />
3 HPC, 115ns Cut-Thru<br />
3rd Generation<br />
Altair Architecture<br />
Shipping Now<br />
In Development<br />
Planned/Concept<br />
* Pin compatible with some feature<br />
changes. Discuss with <strong>PLX</strong><br />
24 Lanes<br />
16 Lanes<br />
12 Lanes<br />
8 Lanes<br />
PEX 8524<br />
24 Lanes, 6 Ports, NT<br />
6 HPC, 2VC, Peer-Peer<br />
PEX 8516<br />
16 Lanes, 4 Ports, NT<br />
4 HPC, 2VC, Peer-Peer<br />
Pin Compatible<br />
Migration*<br />
2nd Generation<br />
Vega Lite<br />
Architecture<br />
Pin Compatible Migration*<br />
PEX 8517<br />
16 Lanes, 4 Ports, NT<br />
4 HPC, 150ns Cut-Thru<br />
PEX 8518<br />
16 Lanes, 5 Ports, NT<br />
5 HPC, 150ns Cut-Thru<br />
PEX 8508<br />
8 Lanes, 5 Ports, NT<br />
5 HPC, 150ns Cut-Thru<br />
PEX 8525<br />
24 Lanes, 5 Ports, 1KB<br />
3 HPC, 115ns Cut-Thru<br />
Future Products:<br />
More Gen 1<br />
Gen 2 (5GTps)<br />
Specialty Switches<br />
Additional Product Details<br />
can be shared<br />
under NDA<br />
5 Lanes<br />
2004/2005 2006 2007<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 11
<strong>PLX</strong>: Switch Market Leading Supplier<br />
‣ First devices in Late 2004<br />
• Three Generations of Architecture have been introduced<br />
• Constantly improving based on internal learning curve<br />
and customer input<br />
• Shipping Production….<br />
…..while other sample/power point<br />
‣ Broadest Switch Portfolio<br />
• 10 Devices Available today<br />
• 8 to 48 Lanes<br />
• 3 to 9 Ports<br />
• Many More Planned and in Development<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 12
Optimized for Different Applications<br />
‣ Fan-out for Servers & HBAs<br />
• Cost Optimized<br />
• Industry best performance & latency<br />
• 110ns Latency<br />
‣ Peer-to-Peer for Backplanes<br />
• No CPU intervention required<br />
‣ Non-Transparency for Address Isolation<br />
• Dual Host and Failover<br />
‣ High Port Count<br />
• For Control Planes needing lots of connectivity<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 13
‣ Flexible<br />
Port Flexibility<br />
• Ports configurable as x1, x2, x4, x8, x16<br />
• Customize to meet your design’s needs<br />
• Auto-negotiation of port width supported<br />
• Will negotiate down to x8, x4, x2, or x1<br />
‣ Versatile<br />
• Any port can be upstream<br />
• Movable upstream port<br />
• Cross-link capability<br />
• Dual-host support<br />
4 x2 ports<br />
2 x4 ports<br />
1 x8 port<br />
<strong>PCI</strong>e<br />
Switch<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 14
Dual-Host & Failover Options<br />
‣ Two methods of implementing Failover Systems<br />
• Non-Transparent Port<br />
• Crosslink & Moveable Upstream Port Primary<br />
Host<br />
Secondary<br />
Host<br />
‣ Crosslink & Moveable Upstream Port<br />
• Utilized when user has full control of<br />
system software (OS)<br />
and enumeration process<br />
Switch<br />
‣ Non-Transparent Port<br />
• Utilized when user has no or limited control of system<br />
software (OS) and/or enumeration process<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 15
Crosslink or Non-Transparency<br />
CPU 1<br />
Chip Set<br />
Memory<br />
CPU 2<br />
Chip Set<br />
Memory<br />
Intelligent I/O Adaptor<br />
I/O<br />
I/O<br />
CPU<br />
NT<br />
Non-Transparent<br />
Port<br />
Primary<br />
Host<br />
CPU<br />
Blade<br />
Secondary<br />
Host<br />
CPU<br />
Blade<br />
End<br />
Point<br />
End<br />
Point<br />
Switch<br />
Upstream<br />
Downstream<br />
Crosslink<br />
Switch<br />
End<br />
Point<br />
End<br />
Point<br />
I/O<br />
I/O<br />
Switch<br />
Switch<br />
NT<br />
I/O<br />
Non-Transparent<br />
Port<br />
Crosslink is useful when user has<br />
full control of system software<br />
(OS) and enumeration process<br />
NT is needed when user has no or<br />
limited control of system software<br />
(OS) and/or enumeration process<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 16
<strong>PLX</strong> Switches with Hot-Plug<br />
<strong>PLX</strong> <strong>PCI</strong>e<br />
Switch<br />
<strong>PCI</strong>e hot-plug<br />
control registers<br />
<strong>PCI</strong>e Switch<br />
w/o Hot Plug<br />
Controller<br />
No <strong>PCI</strong>e hot-plug<br />
control registers<br />
Voltage<br />
Cont.<br />
Clk<br />
Voltage<br />
Cont.<br />
CPLD<br />
$5<br />
Clk<br />
Power<br />
HPPE<br />
RST<br />
Clock<br />
Power<br />
HPPE<br />
RST<br />
Clock<br />
‣ <strong>PLX</strong> <strong>PCI</strong>e Switches<br />
‣ Other <strong>PCI</strong>e Switches<br />
• Internal Hot-Plug Controllers • Require External CPLD $!<br />
• Provide <strong>PCI</strong>e Hot-Plug Registers<br />
• May not provide <strong>PCI</strong>e Hot-Plug<br />
and 9 Hot-Plug signals<br />
Registers Software burden!<br />
• Minimal External Circuitry Needed<br />
• Additional External Circuitry Needed<br />
• Available on 2 to 8 ports<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 17
Cut-Thru<br />
‣ Cut-Thru Architecture – reduced latency<br />
• Moves packet to Egress port after reading packet header<br />
• Increased performance with bursty traffic<br />
‣ Store & Forward Architecture<br />
• Moves packet to Egress port after reading entire packet<br />
1001011000110110<br />
Ingress<br />
Port<br />
Cut-Thru Path<br />
Egress<br />
Port<br />
1001011000110110<br />
Payload<br />
Header<br />
<strong>PCI</strong>e Switch<br />
Payload<br />
Header<br />
1001011000110110<br />
Ingress<br />
Port<br />
Egress<br />
Port<br />
100101100011<br />
0110<br />
Payload<br />
Header<br />
Store & Forward Path<br />
Payload<br />
Header<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 18
True Peer-to-Peer Support<br />
Root<br />
Complex<br />
Root<br />
Complex<br />
End<br />
Point<br />
Switch<br />
End<br />
Point<br />
End<br />
Point<br />
Other <strong>PCI</strong>e<br />
Switches<br />
End<br />
Point<br />
End<br />
Point<br />
End<br />
Point<br />
End<br />
Point<br />
End<br />
Point<br />
‣ <strong>PLX</strong> <strong>PCI</strong>e Switches<br />
• No host involvement<br />
• Reduced latency<br />
• Enhanced CPU Performance<br />
• Optimized Peer-to-Peer<br />
Bandwidth/Performance<br />
‣ Other <strong>PCI</strong>e Switches<br />
• Claim Peer-to-Peer…but…<br />
• May require host-support<br />
• Added latency<br />
• Reduced CPU Performance<br />
• Bandwidth/Performance impact<br />
for Peer-to-Peer traffic<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 19
Port Arbitration<br />
‣ Allows priority assignment to specific ports<br />
• Round Robin or Weighted Round Robin schemes can be used<br />
Egress Port<br />
Switch<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
010101000011110101011<br />
Packet<br />
Queue<br />
User assigns priority or weight for<br />
ports<br />
Example:<br />
Green port weight = 2<br />
Yellow and Gray weight = 1<br />
Port arbiter serves green port twice<br />
the rate of other ports<br />
Ingress Ports<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 20
Device Configuration<br />
‣ Register Configuration via:<br />
• I 2 C – Two wire protocol<br />
defined by Philips<br />
• Out of band device<br />
configuration<br />
• EEPROM – Serial Load<br />
• Configures device prior to<br />
BIOS access<br />
• In Band – Memory<br />
mapped via <strong>PCI</strong>e link<br />
• In band device<br />
configuration by host<br />
‣ Hardware Strapping<br />
• Using Pull-up/Pull-down<br />
resistors<br />
Signal Strapping<br />
Switch<br />
I 2 C<br />
CSRs<br />
EEPROM<br />
<strong>PCI</strong>e<br />
Upstream Link<br />
Multiple Ways to Configure <strong>PLX</strong> Switches<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 21
Non-Blocking Internal Architecture<br />
‣ Allows traffic between ports at full line rates<br />
‣ Flexible buffer allocation<br />
• Prevents head of line blocking<br />
Switch<br />
Non-Blocking<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 22
Spread Spectrum Clock Support<br />
‣ SSC Systems Supports Single Clock Domain<br />
• Reduces EMI<br />
‣ Supports Two clock domains<br />
• SSC Domain<br />
• Modulated clock input<br />
• Constant clock domain<br />
• Constant clock input<br />
‣ Advantages for having Two clock domains<br />
• Removes requirement for single source clock<br />
• Important for Modular Systems<br />
Host 1<br />
SSC Domain 1<br />
Host 2<br />
SSC Domain 2<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 23
T<br />
Spread Spectrum Clock Support<br />
Host 1<br />
SSC Domain 1<br />
CPU<br />
Constant Clock<br />
Domain (Non-SSC)<br />
CPU<br />
Host 2<br />
SSC Domain 2<br />
Bridge<br />
Bridge<br />
I/O<br />
I/O<br />
I/O<br />
T<br />
NT<br />
Switch NT Switch<br />
I/O<br />
I/O<br />
I/O<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 24
Power Management<br />
‣ Supports all required <strong>PCI</strong>e Link & Device Power Management States<br />
‣ Additional Power Management Support<br />
• WAKE#<br />
• Out of band mechanism used by endpoints to inform host of power<br />
state change<br />
• Beacon<br />
• In-band mechanism used by <strong>PCI</strong>e devices to<br />
inform host of power state change<br />
• VAUX<br />
• Auxiliary voltage supply for Beacon internal circuit<br />
‣ VAUX/WAKE#/Beacon support<br />
• WAKE# - Input Signal to Switch<br />
• Switch generates in-band Beacon sequence<br />
to host when WAKE# is active<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 25
VAUX/WAKE#/Beacon<br />
WAKE#/Beacon Support<br />
present in Switch<br />
WAKE#/Beacon Support<br />
not present in Switch<br />
CPU<br />
CPU<br />
Chipset<br />
Chipset<br />
WAKE#<br />
I/O<br />
Beacon<br />
I/O<br />
I/O<br />
Switch<br />
Switch<br />
VAUX<br />
Switch<br />
I/O<br />
I/O<br />
I/O<br />
WAKE#<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 26
Reliability & Serviceability<br />
‣ Performance Monitoring<br />
• Allows users to monitor device and system performance on<br />
a per port basis:<br />
• TLP throughput & Queue depths<br />
• Blocking, stalling, over-subscription detection<br />
‣ Internal Testability Features<br />
• JTAG support<br />
• BIST for internal memories<br />
• Lane/Port status indicators<br />
‣ Debug Features<br />
• PRBS generator for bit error rate characterization<br />
• SerDes loopback mode (four levels)<br />
• Error Injection<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 27
Additional Key Features<br />
‣ Quality of Service<br />
• Up to Two Virtual Channels<br />
‣ Lane and polarity reversal supported on all ports<br />
‣ Up to 32 General Purpose Output Pins<br />
‣ FATAL_ERR# and INTA# support<br />
‣ Error Handler<br />
• <strong>PCI</strong> <strong>Express</strong> Advanced error reporting<br />
• Poison-bit & end-to-end CRC<br />
‣ Industrial Temp Support<br />
‣ SerDes power control<br />
• Off, low, typical and high<br />
• Turn off unused SerDes blocks<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 28
<strong>PCI</strong> <strong>Express</strong> Switches<br />
Device Information<br />
Gen 1 (2.5GT/s)<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST<br />
29
‣ PEX 8548<br />
48 Lane Switch<br />
• Industry’s first 48 lanes and 9 ports <strong>PCI</strong>e switch<br />
• Servers, ATCA Blades, Fan-out, Peer-to-Peer Communication,<br />
Graphics<br />
Feature<br />
Lanes<br />
Ports<br />
Latency<br />
Non-Transparency<br />
Hot Plug Ports<br />
Maximum Payload Size<br />
Availability<br />
Package<br />
Typical Power<br />
PEX 8548<br />
48<br />
9<br />
110ns (in x16 to x16 configuration)<br />
No<br />
3<br />
1 KB<br />
Samples Now / Production in Q1 07<br />
37.5 x 37.5 mm 2<br />
4.9 W<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 30
48 Lane Port Configurations<br />
PEX 8548<br />
x8<br />
x8<br />
PEX 8548<br />
x8<br />
x8<br />
x16<br />
PEX 8548<br />
x8<br />
x4<br />
x8<br />
PEX 8548<br />
x8<br />
x4<br />
x8<br />
x16<br />
PEX 8548<br />
x16<br />
x4 x4 x4 x4<br />
x16<br />
x16<br />
x4 x4 x4 x4<br />
x4<br />
x4<br />
x8<br />
x8<br />
PEX 8548<br />
x8<br />
x8<br />
x8<br />
PEX 8548<br />
x8<br />
x8<br />
x8<br />
x16<br />
PEX 8548<br />
x8<br />
x8<br />
x16<br />
PEX 8548<br />
x8<br />
x8<br />
x8<br />
x8<br />
x4<br />
x4 x8<br />
x4 x4 x4 x4<br />
x4<br />
x8<br />
x4<br />
‣ Many other configurations possible<br />
‣ Higher lane-width port will auto-negotiation down<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 31
Storage Servers<br />
CPU<br />
Chip Set<br />
Memory<br />
x16<br />
End<br />
Point<br />
x8 PEX 8548<br />
Bridge<br />
x8<br />
x16<br />
Bridge<br />
Switch<br />
x8 or x4 ports<br />
PEX<br />
Switch<br />
8524<br />
x8 or x4 ports<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 32
32 Lane Switches<br />
‣ PEX 8532<br />
• Non-Transparent switch<br />
• Redundant Systems, Dual-Host, Fail-over Systems<br />
‣ PEX 8533<br />
• Performance optimized switch with industry’s lowest latency - 115ns<br />
• Servers, Storage, Graphics, Fan-Out, Peer-to-Peer Communication<br />
Feature<br />
Lanes<br />
Ports<br />
Latency<br />
Non-Transparency<br />
Hot Plug Ports<br />
Maximum Payload Size<br />
Availability<br />
Package<br />
Typical Power<br />
PEX 8532<br />
32<br />
8<br />
> 200ns<br />
Yes<br />
8<br />
256 B<br />
In Production<br />
35 x 35 mm 2<br />
5.7 W<br />
PEX 8533<br />
32<br />
6<br />
115ns (in x8 to x8 configuration)<br />
No<br />
3<br />
1 KB<br />
Samples Now / Production in Q1 07<br />
35 x 35 mm 2<br />
3.3 W<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 33
32 Lane Port Configurations<br />
PEX 8532<br />
PEX 8533<br />
x4<br />
x16<br />
x8<br />
x16<br />
x4<br />
PEX 8532<br />
x4 x4 x4 x4<br />
x4<br />
x4<br />
x8<br />
PEX 8532<br />
x8<br />
x8<br />
PEX 8533<br />
x4x4x4x4<br />
x8<br />
PEX 8533<br />
x8<br />
x8<br />
x8<br />
x8<br />
x8<br />
x8<br />
PEX 8532<br />
x8<br />
x8<br />
PEX 8532<br />
PEX 8533<br />
PEX 8533<br />
x4<br />
x4<br />
x4 x4 x4 x4<br />
x8<br />
x8<br />
x8<br />
x4x4x8x8<br />
‣ Many other configurations possible<br />
‣ Higher lane-width port will auto-negotiation down<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 34
24 Lane Switches<br />
‣ PEX 8524<br />
• Non-Transparent switch<br />
• Redundant Systems, Dual-Host, Fail-over Systems<br />
‣ PEX 8525<br />
• Performance optimized switch with industry’s lowest latency - 115ns<br />
• Servers, Storage, Graphics, Peer-to-Peer Communication<br />
Feature<br />
Lanes<br />
Ports<br />
Latency<br />
Non-Transparency<br />
Hot Plug Ports<br />
Maximum Payload Size<br />
Availability<br />
Package<br />
Typical Power<br />
PEX 8524<br />
24<br />
6<br />
> 200ns<br />
Yes<br />
6<br />
256 B<br />
In Production<br />
31 x 31 mm 2<br />
3.9 W<br />
PEX 8525<br />
24<br />
5<br />
115ns (in x8 to x8 configuration)<br />
No<br />
3<br />
1 KB<br />
Samples Now / Production in Q1 07<br />
31 x 31 mm 2<br />
2.6 W<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 35
24 Lane Port Configurations<br />
PEX 8524<br />
PEX 8525<br />
x4<br />
x8<br />
x8<br />
x8<br />
x4<br />
PEX 8524<br />
PEX 8524<br />
PEX 8525<br />
PEX 8525<br />
x4 x4 x4 x4<br />
x8<br />
x8<br />
x4x4x4x4<br />
x8<br />
x8<br />
x8<br />
x8<br />
x8<br />
x4<br />
PEX 8524<br />
x2<br />
PEX 8524<br />
PEX 8525<br />
PEX 8525<br />
x4 x4 x4 x4<br />
x4 x4 x4x2<br />
x8<br />
x4<br />
x4<br />
x4x4x4x4<br />
‣ Many other configurations possible<br />
‣ Higher lane-width port will auto-negotiation down<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 36
16 Lane Switches<br />
‣ PEX 8518<br />
• Non-Transparent switch with SSC and Vaux/WAKE#/Beacon<br />
• Redundant Systems, Fan-Out, Servers, HBAs, NICs, Mezzanine cards<br />
‣ PEX 8517<br />
• Pin compatible migration from 1 st generation 16-lane PEX 8516 switch<br />
Feature<br />
Lanes<br />
Ports<br />
Latency<br />
Non-Transparency<br />
Hot Plug Ports<br />
Maximum Payload Size<br />
Availability<br />
Package<br />
Typical Power<br />
PEX 8518*<br />
16<br />
5<br />
150ns<br />
Yes<br />
5<br />
256 B<br />
In Production<br />
23 x 23 mm 2<br />
2.6 W<br />
PEX 8517<br />
16<br />
5<br />
150ns<br />
Yes<br />
4<br />
256 B<br />
In Production<br />
27 x 27 mm 2<br />
2.6 W<br />
* PEX 8518 recommended for all new 16 lane designs<br />
PEX 8516<br />
16<br />
4<br />
> 200ns<br />
Yes<br />
4<br />
256 B<br />
In Production<br />
27 x 27 mm 2<br />
3.2 W<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 37
16 Lane Port Configurations<br />
PEX 8518<br />
x4<br />
x8<br />
PEX 8518<br />
PEX 8518<br />
x4<br />
x4 x4<br />
x4<br />
x2<br />
x2<br />
x4<br />
x8<br />
PEX 8518<br />
PEX 8518<br />
x4 x4 x2 x2<br />
x2 x2 x2 x2<br />
‣ Many other configurations possible<br />
‣ Higher lane-width port will auto-negotiation down<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 38
8 Lane Switches<br />
‣ PEX 8508<br />
• Non-Transparent switch with SSC and Vaux/WAKE#/Beacon<br />
• Redundant Systems, Host Isolation, AMC/XMC plug-in cards<br />
‣ PEX 8509<br />
• Industry’s only 8 lanes & 8 ports <strong>PCI</strong>e switch<br />
• Control Planes, Docking Stations, NICs, High-end Printers<br />
Feature<br />
Lanes<br />
Ports<br />
Latency<br />
Non-Transparency<br />
Hot Plug Ports<br />
Maximum Payload Size<br />
Availability<br />
Package<br />
Typical Power<br />
PEX 8508<br />
8<br />
5<br />
150ns<br />
Yes<br />
5<br />
256 B<br />
In Production<br />
19 x 19 mm 2<br />
1.6 W<br />
PEX 8509<br />
8<br />
8<br />
140ns (in x4 to x1 configuration)<br />
No<br />
3<br />
1 KB<br />
Q2 07<br />
15 x 15 mm 2<br />
1.5 W<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 39
8 Lane Port Configurations<br />
PEX 8508<br />
PEX 8509<br />
x4<br />
x4<br />
x4<br />
x2<br />
PEX 8508<br />
PEX 8508<br />
PEX 8509<br />
x2<br />
PEX 8509<br />
x1 x1 x1 x1<br />
x2<br />
x2<br />
x1x1x1x1<br />
x1x1x1x1<br />
x4<br />
x2<br />
x2<br />
x1<br />
PEX 8508<br />
PEX 8508<br />
x1<br />
PEX 8509<br />
x1<br />
x1<br />
PEX 8509<br />
x1<br />
x1<br />
x2<br />
x1<br />
x1<br />
x2 x2 x2<br />
x1x1x1x1<br />
x1x1x1x1<br />
‣ Many other configurations possible<br />
‣ Higher lane-width port will auto-negotiation down<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 40
Notebook Docking Station<br />
Mother Board<br />
CPU<br />
Graphics<br />
North<br />
Bridge<br />
Memory<br />
USB/SATA/GE<br />
South<br />
Bridge<br />
• Low Cost and Power<br />
• <strong>PCI</strong> <strong>Express</strong><br />
aggregator<br />
• Single lane <strong>PCI</strong> <strong>Express</strong><br />
slots/cards<br />
Network<br />
End Point<br />
Docking Station<br />
1<br />
1<br />
1<br />
4<br />
PEX 8509<br />
1<br />
End<br />
Point<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 41
Control Planes For Large Systems<br />
To Line Cards<br />
7 ports<br />
6 ports<br />
PEX 8509<br />
PEX 8509<br />
Control<br />
Processor<br />
Memory<br />
Controller Card<br />
‣ Controller Processor has dual <strong>PCI</strong>e ports<br />
‣ Now there is no bottleneck between the 2 PEX 8509 devices<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 42
PEX Rapid Development Kits (RDK)<br />
‣ Configurable in up to 7 <strong>PCI</strong> <strong>Express</strong> Ports<br />
• One male edge connector<br />
• Up to 4 on-board female connectors<br />
• Breakout Boards used for further port expansion<br />
‣ Plugs in a standard <strong>PCI</strong> <strong>Express</strong> slot<br />
‣ Usable on bench-top while powered<br />
by an external power supply<br />
‣ On-board clock buffer, Hot Plug<br />
controller, EEPROM, etc.<br />
‣ RDKs available for all <strong>PLX</strong> switches!<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 43
<strong>PLX</strong> <strong>PCI</strong>e Switch Summary<br />
‣ Broadest Portfolio of Switches in the Industry<br />
‣ Industry-wide Acceptance<br />
• All production products on <strong>PCI</strong>-SIG<br />
Integrators List<br />
• Shipping in Production<br />
‣ Active Participation in Multiple Standards Bodies<br />
• <strong>PCI</strong>-SIG, IOV, Gen 2 Specification, Geneseo<br />
‣ Undisputed Leader in <strong>PCI</strong>e Switches<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 44
<strong>Express</strong>Lane <strong>PCI</strong> <strong>Express</strong> Bridges<br />
‣ <strong>PCI</strong> to <strong>PCI</strong> <strong>Express</strong><br />
• 32-Bit <strong>PCI</strong> (66MHz)<br />
• x1 <strong>PCI</strong>e<br />
‣ <strong>PCI</strong>-X to <strong>PCI</strong> <strong>Express</strong><br />
• 64-Bit <strong>PCI</strong>-X (133MHz)<br />
• x4 <strong>PCI</strong>e<br />
‣ Additional Features<br />
• Forward & Reverse<br />
• Low Power<br />
• Small Packages<br />
<strong>PCI</strong> or <strong>PCI</strong>-X<br />
PEX 8100<br />
Series<br />
‣ Available TODAY!<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 45
Forward and Reverse Bridging<br />
Primary<br />
Primary Bus<br />
Bridge<br />
Bridge<br />
Secondary Bus<br />
Secondary<br />
Forward Bridge<br />
Reverse Bridge<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 46
Bridge Road Map - <strong>PCI</strong>, <strong>PCI</strong>-X, <strong>PCI</strong>e<br />
<strong>PCI</strong>/<strong>PCI</strong>-X<br />
Bus Speeds<br />
64 Bits<br />
133 MHz<br />
64 Bits<br />
66 MHz<br />
<strong>PCI</strong> 6254<br />
Non-Transparent<br />
Asynchronous<br />
<strong>PCI</strong> 6154<br />
Asynchronous<br />
31x31 mm 2 304 PBGA<br />
<strong>PCI</strong> 6466<br />
Non-Transparent<br />
Asynchronous<br />
<strong>PCI</strong> 6540<br />
<strong>PCI</strong>-X Non-Transparent<br />
Asynchronous<br />
<strong>PCI</strong> 6520<br />
<strong>PCI</strong>-X Asynchronous<br />
27x27 mm 2 380 PBGA<br />
PEX 8114<br />
64-Bit 133MHz <strong>PCI</strong>-X<br />
to x4 <strong>PCI</strong>e<br />
• Forward & Reverse Mode<br />
• Small 17x17mm Package<br />
• No Heat Sink Required<br />
32 Bits<br />
66MHz<br />
<strong>PCI</strong> 6150<br />
High Performance<br />
Asynchronous<br />
<strong>PCI</strong> 6152<br />
Smallest Footprint<br />
15x15 mm 2 160 TBGA<br />
Shipping Now<br />
PEX 8111<br />
32-Bit 66MHz <strong>PCI</strong><br />
to x1 <strong>PCI</strong>e<br />
• Forward & Reverse Mode<br />
32 Bits<br />
33MHz<br />
<strong>PCI</strong> 6140<br />
Lowest Power<br />
(200mW)<br />
In Development<br />
Planned/Concept<br />
• Small 10x10 & 13x13mm Package<br />
• No Heat Sink Required<br />
2003 & Before<br />
2004<br />
2005 2007<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 47
PEX 8111 <strong>Overview</strong><br />
‣ Forward or Reverse Bridging<br />
‣ <strong>PCI</strong> <strong>Express</strong> to <strong>PCI</strong> Transparent Reversible<br />
Bridge<br />
‣ <strong>PCI</strong> <strong>Express</strong> – 1 lane, 1 virtual channel, with<br />
integrated 2.5 GHz SerDes<br />
‣ <strong>PCI</strong> Bus – 66 MHz, 32-Bit, CardBus Compatible<br />
‣ 8K of shared memory accessible from both<br />
sides<br />
‣ Four GPIO pins<br />
‣ Packaging<br />
• 13mm x 13mm 144 ball BGA package<br />
• 10mm x 10mm 161 ball Fine-pitch BGA<br />
package (Smallest in Industry)<br />
‣ In Production!<br />
PEX 8111<br />
<strong>PCI</strong> 32-bit, 66MHz<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 48
Example in Add-in Cards<br />
Forward Mode<br />
Reverse Mode<br />
<strong>PCI</strong><br />
Device<br />
PEX 8111<br />
<strong>PCI</strong>e<br />
Endpoint<br />
PEX 8111<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 49
Example on Motherboard<br />
<strong>PCI</strong> Slots<br />
<strong>PCI</strong><br />
Chipset<br />
<strong>PCI</strong> Bus<br />
Host<br />
CPU<br />
PEX 8111<br />
<strong>PCI</strong>-to-<strong>PCI</strong> <strong>Express</strong><br />
Bridge<br />
<strong>PCI</strong> <strong>Express</strong><br />
Add-On Slot<br />
PEX 8111<br />
Creating <strong>PCI</strong> Slots<br />
<strong>PCI</strong> Slots<br />
Providing <strong>PCI</strong> <strong>Express</strong><br />
Host<br />
CPU<br />
Root<br />
Complex<br />
PEX 8111<br />
<strong>PCI</strong><br />
Device<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 50
<strong>PCI</strong> <strong>Express</strong> Features<br />
‣ Compliant with <strong>PCI</strong>e 1.0a specification<br />
• Listed on <strong>PCI</strong>-SIG integrators list<br />
‣ Maximum payload size 128 Bytes<br />
‣ Interrupts transferred between ports<br />
‣ Message signal interrupts (MSI) propagates to<br />
<strong>PCI</strong><br />
‣ <strong>PCI</strong> interrupt propagates to MSI<br />
‣ Power management<br />
‣ Supports in-band power management<br />
‣ Link power states: L0, L0s, L1, L2/3, L2, L3<br />
‣ Device power management states: D0, D3 (hot)<br />
‣ Hot Plug<br />
PEX 8111<br />
<strong>PCI</strong> 32-bit, 66MHz<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 51
<strong>PCI</strong> Features<br />
‣ <strong>PCI</strong> r3.0 compliant<br />
‣ 32-bit <strong>PCI</strong> operation up to 66 MHz<br />
‣ 64-bit addressing as master and slave<br />
‣ Memory and I/O data transfers<br />
‣ <strong>PCI</strong> power management support<br />
‣ Supports D0, D3 (hot)<br />
PEX 8111<br />
‣ Arbiter supports 4 external masters<br />
‣ Arbiter can be disabled to allow external arbiter<br />
<strong>PCI</strong> 32-bit, 66MHz<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 52
<strong>PCI</strong> <strong>Express</strong> to <strong>PCI</strong>-X Bridge<br />
‣ <strong>PCI</strong> <strong>Express</strong> to <strong>PCI</strong>-X Bridge<br />
• 4 lane <strong>PCI</strong> <strong>Express</strong> port (x1, x2, or x4 config.)<br />
• Supports Forward & Reverse modes<br />
‣ 17 x 17 mm PBGA package<br />
• No heat sink, no air flow required<br />
‣ Low power (2 watts max)<br />
‣ <strong>PCI</strong>-X<br />
• 64-/32-bit, 133/100/66 MHz <strong>PCI</strong>-X<br />
• 64-/32-bit, 66/50/33/25 MHz <strong>PCI</strong><br />
• Arbiter supports up to 4 masters<br />
‣ <strong>PCI</strong> <strong>Express</strong><br />
• Maximum payload size = 256B<br />
• RAS features<br />
• Polarity Reversal<br />
• Hot Plug<br />
PEX 8114<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 53
<strong>PCI</strong>e to <strong>PCI</strong>-X Bridge Example<br />
4<br />
4<br />
PEX<br />
8114<br />
PEX 8114<br />
4<br />
Host<br />
CPU<br />
Root<br />
Complex<br />
Root<br />
Complex<br />
8<br />
PEX8532<br />
PEX 8532<br />
2<br />
Native<br />
4<br />
Native<br />
1<br />
Native<br />
‣ PEX 8114 can create legacy <strong>PCI</strong>-X slots in a <strong>PCI</strong> <strong>Express</strong> System<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 54
<strong>PCI</strong> <strong>Express</strong> Features<br />
‣ Maximum payload size 256B<br />
‣ Support for polarity reversal<br />
‣ EEPROM support<br />
‣ Interrupts transferred between ports<br />
• Message signal interrupt propagates to <strong>PCI</strong>-X interrupt<br />
• <strong>PCI</strong>-X interrupt propagates to message signal interrupt<br />
‣ Power management:<br />
• Link power management states:<br />
L0, L0s, L1, L2/L3 Ready, L2, L3<br />
• Device power management states:<br />
D0, D3 HOT<br />
‣ RAS features<br />
• Hot Plug master & slave<br />
• TLP Digest support:<br />
• Poison bit and End to end CRC<br />
PEX 8114<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 55
<strong>PCI</strong>-X/<strong>PCI</strong> Bus Features<br />
‣ <strong>PCI</strong>-X r1.0b and <strong>PCI</strong> r 3.0 compliant<br />
• <strong>PCI</strong>-X operation up to 133 MHz<br />
• 64-bit/32-bit <strong>PCI</strong> operation up to 66 MHz<br />
• 64-bit addressing as master and slave<br />
• Memory and I/O data transfers<br />
• Up to 8 outstanding split <strong>PCI</strong>-X<br />
transactions<br />
‣ <strong>PCI</strong> Power Management r1.1 compliant<br />
PEX 8114<br />
• Supports D0, D3 HOT<br />
‣ Arbiter supports 4 external masters<br />
• Arbiter can be disabled to allow external<br />
arbiter<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 56
Bridge on Add-in Card<br />
Forward Mode<br />
<strong>PCI</strong>-X<br />
Device<br />
<strong>PCI</strong>-X Bus<br />
PEX 8114<br />
<strong>PCI</strong> <strong>Express</strong><br />
Reverse Mode<br />
<strong>PCI</strong>e<br />
Endpoint<br />
<strong>PCI</strong> <strong>Express</strong><br />
PEX 8114<br />
<strong>PCI</strong>-X Bus<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 57
AdvancedTCA with AMC<br />
<strong>PCI</strong> - X<br />
<strong>PCI</strong>-X<br />
Device<br />
Device<br />
<strong>PCI</strong>-X<br />
- X<br />
Device<br />
PEX 8114<br />
PEX P-<br />
Bridge 8114<br />
‣ 8U Form Factor<br />
‣ 2.4 times board real estate as 6U<br />
‣ Up to eight (8) mezzanine slots<br />
‣ Robust power budget exists on<br />
ATCA board<br />
<strong>PCI</strong>-X<br />
<strong>PCI</strong>- X<br />
Device<br />
Device<br />
PEX P-<br />
Bridge 8114<br />
uProc CPU<br />
<strong>PCI</strong> <strong>PCI</strong><br />
Device Device<br />
PEX P-<br />
Bridge 8114<br />
Switch<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 58
Local Bus to <strong>PCI</strong> <strong>Express</strong> Bridge<br />
‣ Generic Local to <strong>PCI</strong> <strong>Express</strong><br />
• 32-Bit Local (up to 66MHz)<br />
• x1 <strong>PCI</strong>e<br />
‣ Local Bus Modes<br />
• Non-Multiplexed 32-Bit address/data<br />
(C Mode)<br />
• Multiplexed 32-Bit address/data<br />
(J-Mode)<br />
32-Bit Generic Local<br />
PEX 8300<br />
Series<br />
‣ Root Complex & End Point Modes<br />
‣ 2 DMA Channels<br />
‣ Available in volume production<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 59
Local Bus Bridge Road Map<br />
Local/<strong>PCI</strong><br />
Bus Speeds<br />
64 Bits<br />
133 MHz<br />
Target (Slave)<br />
Devices<br />
Bus Master<br />
Devices<br />
64 Bits<br />
66 MHz<br />
<strong>PCI</strong> 9656<br />
66MHz Local Bus<br />
Dual DMA<br />
• Easy way to Bridge Local Bus to <strong>PCI</strong> <strong>Express</strong><br />
• Compatible with <strong>PCI</strong> 9056<br />
• Works well with FPGAs<br />
32 Bits<br />
66MHz<br />
32 Bits<br />
33MHz<br />
<strong>PCI</strong> 9030<br />
32-Bit, 60MHz LB to<br />
32-Bit 33MHZ <strong>PCI</strong><br />
32-Bit 33MHZ <strong>PCI</strong> <strong>PCI</strong> 9054<br />
<strong>PCI</strong> 9052<br />
40MHz Local Bus<br />
ISA Compatible<br />
<strong>PCI</strong> 9056<br />
66MHz Local Bus<br />
Dual DMA<br />
32-Bit, 50MHz LB to<br />
32-Bit, 33MHz <strong>PCI</strong><br />
PEX 8311<br />
32-Bit, 66MHz Local<br />
Bus to x1 <strong>PCI</strong>e<br />
Shipping Now<br />
In Development<br />
Planned/Concept<br />
2005 & Before 2006<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 60
PEX 8311 <strong>Overview</strong><br />
‣ Generic Local bus to <strong>PCI</strong> <strong>Express</strong> Bridge<br />
• Available in volume production<br />
‣ Generic Local Bus<br />
• 32-Bit, Up to 66MHz<br />
• Multiplexed (C-Mode) & Non-Multiplex (J-Mode)<br />
• 2 DMA Channels<br />
• Register Backward compatible with<br />
<strong>PLX</strong> <strong>PCI</strong> 9056, 9656 & 9054<br />
• Local Bus protocol backward compatible with<br />
<strong>PLX</strong> <strong>PCI</strong> 9056 & 9656 up to 66MHz<br />
PEX 8311<br />
32-bit / 66MHz<br />
Local Bus<br />
‣ <strong>PCI</strong> <strong>Express</strong><br />
• x1 Lane <strong>PCI</strong>e<br />
• Integrated SerDes<br />
• Rev 1.0a compliant<br />
• Maximum payload size: 128B<br />
• 1 Virtual Channel<br />
• Hot plug support in EndPoint mode<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 61
System Controller Card<br />
EEPROM<br />
SRAM<br />
FPGA<br />
DSP<br />
Proprietary<br />
ASIC<br />
Local<br />
CPU<br />
PEX 8311<br />
Generic Local Bus<br />
‣ Root Complex mode<br />
‣ Control Path implementation: x1 lane<br />
‣ Interface to Switching Fabric cards & I/O<br />
Cards<br />
‣ Generic interface to local bus devices<br />
‣ Backward compatible to <strong>PCI</strong> 9xxx family<br />
‣ 2 Gbps generic local bus/<strong>PCI</strong>e link<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 62
Industrial Control Video Monitor<br />
FPGA<br />
PEX 8311<br />
CPU<br />
SDRAM<br />
FPGA<br />
PEX 8311<br />
PEX 8532<br />
Host<br />
FPGA<br />
FPGA<br />
PEX 8311<br />
PEX 8311<br />
‣ x1 links<br />
‣ 2Gbps local bus<br />
throughput<br />
‣ More sources per board<br />
driving bandwidth<br />
‣ Unidirectional traffic<br />
‣ 1 DMA sufficient<br />
‣ Scatter/gather manages<br />
multiple flows<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST 63
End of Presentation<br />
Thank You<br />
<strong>PLX</strong> <strong>PCI</strong>e Jan 2007 CUST<br />
64
Change language