10 Gb Ethernet Mark Wagner - Red Hat

More documents

Recommendations

Info

A Quick Example Internet search for “linux tcp_window_scaling performance” will show some sites say to set it to 0 others say set it to 1 [root@perf12 np2.4]# sysctl w net.ipv4.tcp_window_scaling=0 [root@perf12 np2.4]# ./netperf P1 l 30 H 192.168.10.100 Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 87380 16384 16384 30.00 2106.40 [root@perf12 np2.4]# sysctl w net.ipv4.tcp_window_scaling=1 [root@perf12 np2.4]# ./netperf P1 l 30 H 192.168.10.100 Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 87380 16384 16384 30.01 5054.68
Platform Features Multiple processors Fast memory All my testing has been done on PCIe ● PCI-X not really fast enough for full-duplex ● Look for width of 8 lanes (8x) ●PCIe is typically 250 Gb/sec per lane Look for support of MSI-X interrupts ● Server ● OS (RHEL does this :) ● Driver
Page 1 and 2: 10 Gb Ethernet Mark Wagner Senior S
Page 3 and 4: Some Quick Disclaimers Test result
Page 5: Take Aways - continued Read the ve
Page 9 and 10: Tools (cont) Tuning tools ● etht
Page 11 and 12: ethtool c interrupt coalesce [
Page 13 and 14: ethtool k HW Offload Settings
Page 15 and 16: sysctl sysctl is a mechanism to vi
Page 17 and 18: Some Important settings for sysctl
Page 19 and 20: netperf http://netperf.org Featur
Page 21 and 22: Control your network route : Check
Page 23 and 24: lspci - validate your slot setting
Page 25 and 26: Performance Tuning Outline IRQ Aff
Page 27 and 28: New Boards, first Run # ./netperf
Page 29 and 30: Tuning - Identify the Bottlenecks
Page 31 and 32: Know Your CPU core layout # cat /pr
Page 33 and 34: Tuning - Run2, IRA Affinity # ./net
Page 35 and 36: Run 2 - review data - next steps W
Page 37 and 38: Run3 Bottlenecks Transmit CPU %s
Page 39 and 40: Run 4 - Change send() to sendfile()
Page 41 and 42: Tuning - Identifying the Bottleneck
Page 43 and 44: Run 5 - Kick up MTU = 9000 TX CPU %
Page 45 and 46: Single RX Queue - Multiple netperf
Page 47 and 48: Interrupt distribution w/ MultiQueu
Page 49 and 50: New Tuning Tools w/ RH MRG MRG Tuni
Page 51 and 52: Tuning Network Apps Messages/sec 10
Page 53 and 54: Lower RX Latency with ethtool C #
Page 55 and 56: 10 GbE Scaling w/Xen on RHEL5.2
Page 57 and 58:
Wrap up There are lots of knobs to
show all

10 Gb Ethernet Mark Wagner - Red Hat

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?