From owner-freebsd-performance@FreeBSD.ORG Thu Dec 10 14:32:20 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 48ABE10656A3 for ; Thu, 10 Dec 2009 14:32:20 +0000 (UTC) (envelope-from noisex@apollo.lv) Received: from smtp5.apollo.lv (smtp5.apollo.lv [80.232.168.197]) by mx1.freebsd.org (Postfix) with ESMTP id C21D68FC19 for ; Thu, 10 Dec 2009 14:32:19 +0000 (UTC) Received: from VECTOR (unknown [195.122.14.116]) by smtp5.apollo.lv (Postfix) with ESMTP id 79F1F3402BE for ; Thu, 10 Dec 2009 16:28:43 +0200 (EET) From: "Noisex" To: References: <4B108A18.207@truschinski.de> <584ec6bb0911291330o11fba282y400e0abf121f5e7f@mail.gmail.com> <056c01ca773a$a88f69e0$f9ae3da0$@lv> <4ADA4DF6401E47F6A0FE26890B50FBB1@multiplay.co.uk> In-Reply-To: <4ADA4DF6401E47F6A0FE26890B50FBB1@multiplay.co.uk> Date: Thu, 10 Dec 2009 16:28:10 +0200 Message-ID: <066b01ca79a5$04ab9980$0e02cc80$@lv> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: Acp5nRrNv2c6plx0ScuxdjY6VvZ3GgABhO8w Content-Language: lv X-Lattelecom-MailScanner-Information: Please contact the ISP for more information X-Lattelecom-MailScanner-ID: 79F1F3402BE.48745 X-Lattelecom-MailScanner: Found to be clean X-Lattelecom-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-1.148, required 5, BAYES_00 -2.60, RDNS_NONE 0.10, TVD_RCVD_SINGLE 1.35) X-Lattelecom-MailScanner-From: noisex@apollo.lv X-Spam-Status: No Subject: RE: FreeBSD TCP tuning and performance X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Dec 2009 14:32:20 -0000 This server is basically used for bandwidth testing (Our company is = internet service provider) and we need and our clients something to = measure a internet speed. Actually on that server is hosted MyConnection SpeedServer = (http://www.visualware.com/) for bandwidth tests. Some month ago we = started to clients offer GPON with speed 500Mbit/500mbit. While we offer DSL technology and speeds was up to 100Mbit it was pretty = good results...but now we can't measure a speed on 1Gbps link...the = results is very pure (almost half from real on FreeBSD). This results aren't only with MyConnection..also with nuttcp and = iperf...i have feeling, that FreBSD can't handle window size = send/receive buffer p.s maybe I should enable Network Pooling/disable interrupts on network = card etc things? What could be a recommendations to set up for maximum = performance TCP settings on 1/10Gbps interface with sysctl parameters? Noisex -----Original Message----- From: owner-freebsd-performance@freebsd.org = [mailto:owner-freebsd-performance@freebsd.org] On Behalf Of Steven = Hartland Sent: ceturtdiena, 2009. gada 10. decembr=C4=AB 15:20 To: Noisex; freebsd-performance@freebsd.org Subject: Re: FreeBSD TCP tuning and performance What app are you using there and is it setting the send / receive = buffers correctly? ----- Original Message -----=20 From: "Noisex" To: Sent: Monday, December 07, 2009 12:41 PM Subject: FreeBSD TCP tuning and performance Hi! I have a problem with TCP performance on FBSD boxes with 1Gbps net = i-faces (Broadcom NetXtreme II BCM5708 1000Base-T (B2)).=20 Currently i use FBSD 7.1 AMD64. The test lab: 2 x (server-client) HP Proliant G5 DL360 (quad-core/8gb = ram, raid 5 SAS). For net benchmark i used nuttcp and iperf. The servers (client-server) are in 1 VLAN. The results on 1Gbps (down & up): 63.4375 MB / 1.00 sec =3D 532.1332 Mbps 64.3750 MB / 1.00 sec =3D 540.0426 Mbps 62.8125 MB / 1.00 sec =3D 526.8963 Mbps 64.5625 MB / 1.00 sec =3D 541.6318 Mbps 63.9375 MB / 1.00 sec =3D 536.3595 Mbps 63.7500 MB / 1.00 sec =3D 534.7566 Mbps 63.0000 MB / 1.00 sec =3D 528.5003 Mbps 63.5000 MB / 1.00 sec =3D 532.7150 Mbps 64.0000 MB / 1.00 sec =3D 536.8586 Mbps 63.5625 MB / 1.00 sec =3D 533.2452 Mbps 637.6688 MB / 10.02 sec =3D 533.9108 Mbps 9 %TX 9 %RX 9 = host-retrans 0.67 msRTT 25.5625 MB / 1.00 sec =3D 214.3916 Mbps 30.8750 MB / 1.00 sec =3D 259.0001 Mbps 29.9375 MB / 1.00 sec =3D 251.1347 Mbps 27.1875 MB / 1.00 sec =3D 228.0669 Mbps 30.5000 MB / 1.00 sec =3D 255.8533 Mbps 30.2500 MB / 1.00 sec =3D 253.7551 Mbps 26.8125 MB / 1.00 sec =3D 224.9211 Mbps 30.3750 MB / 1.00 sec =3D 254.8047 Mbps 30.3750 MB / 1.00 sec =3D 254.8050 Mbps 30.0625 MB / 1.00 sec =3D 252.1835 Mbps 292.2155 MB / 10.02 sec =3D 244.6825 Mbps 10 %TX 12 %RX 0 = host-retrans 0.71 msRTT As you can see down is littlebit more than half of full link speed. And = upload is only 20-25% of full link. I tried to change a lot sysctl params but without a big results. = Currenlty my entries in /etc/sysctl.conf which regarding to TCP: #kernel tuning, tcp kern.ipc.somaxconn=3D2048 kern.ipc.nmbclusters=3D32768 kern.ipc.maxsockbuf=3D8388608 net.inet.tcp.sendbuf_max=3D16777216 net.inet.tcp.recvbuf_max=3D16777216 net.inet.tcp.inflight.enable=3D0 net.inet.tcp.sendspace=3D65536 net.inet.tcp.recvspace=3D65536 net.inet.udp.recvspace=3D65536 net.inet.tcp.inflight.enable=3D0 net.inet.tcp.rfc1323=3D1 net.inet.tcp.sack.enable=3D1 net.inet.tcp.path_mtu_discovery=3D1 net.inet.tcp.sendbuf_auto=3D1 net.inet.tcp.sendbuf_inc=3D16384 net.inet.tcp.recvbuf_auto=3D1 net.inet.tcp.recvbuf_inc=3D524288 Do you have some kind suggestion what i could to change to increase the = performance of TCP? Besides when i make the benchamrks i run the sniffer to see whats = happening with network..sometimes i saw that window size is=20 0...does it mean that server can't handle something or recieve buffer = size is to small? p.s sory for my bad english :) Noisex _______________________________________________ freebsd-performance@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-performance To unsubscribe, send any mail to = "freebsd-performance-unsubscribe@freebsd.org" =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D This e.mail is private and confidential between Multiplay (UK) Ltd. and = the person or entity to whom it is addressed. In the event of = misdirection, the recipient is prohibited from using, copying, printing = or otherwise disseminating it or any information contained in it.=20 In the event of misdirection, illegible or incomplete transmission = please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. _______________________________________________ freebsd-performance@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-performance To unsubscribe, send any mail to = "freebsd-performance-unsubscribe@freebsd.org"