From owner-freebsd-stable@FreeBSD.ORG Tue Sep 5 16:21:15 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 66A0D16A4DE for ; Tue, 5 Sep 2006 16:21:15 +0000 (UTC) (envelope-from junics-fbsdstable@atlantis.maniacs.se) Received: from mammoth.unixsh.net (mammoth.unixsh.net [195.35.83.67]) by mx1.FreeBSD.org (Postfix) with SMTP id 07CED43D64 for ; Tue, 5 Sep 2006 16:21:09 +0000 (GMT) (envelope-from junics-fbsdstable@atlantis.maniacs.se) Received: (qmail 4951 invoked from network); 5 Sep 2006 16:21:08 -0000 Received: from localhost.maniacs.se (HELO ?192.168.0.34?) (127.0.0.1) by localhost.maniacs.se with SMTP; 5 Sep 2006 16:21:08 -0000 Message-ID: <44FDA3F3.6090003@atlantis.maniacs.se> Date: Tue, 05 Sep 2006 18:21:07 +0200 From: Thomas Herrlin User-Agent: Thunderbird 1.5.0.5 (Windows/20060719) MIME-Version: 1.0 To: Danny Braniss References: <2a41acea0608301145j7bbed961j33ce903a27d8963d@mail.gmail.com> In-Reply-To: <2a41acea0608301145j7bbed961j33ce903a27d8963d@mail.gmail.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: tcp/udp performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Sep 2006 16:21:15 -0000 Jack Vogel wrote: > On 8/30/06, Danny Braniss wrote: >> >> ever since 6.1 I've seen fluctuations in the performance of >> the em (Intel(R) PRO/1000 Gigabit Ethernet). >> >> motherboard OBN (On Board NIC) >> ---------------- ------------------ >> 1- Intel SE7501WV2S Intel 82546EB::2.1 >> 2- Intel SE7320VP2D2 INTEL 82541 >> 3- Sun Fire X4100 Server Intel(R) PRO/1000 >> >> test 1: writing to a NetApp filer via NFS/UDP >> FreeBSD Linux >> MegaBytes/sec >> 1- Average: 18.48 32.61 >> 2- Average: 15.69 35.72 >> 3- Average: 16.61 29.69 >> (interstingly, doing NFS/TCP instead of NFS/UDP shows an increase in >> speed of >> around 60% on FreeBSD but none on Linux) >> >> test2: iperf using 1 as server: >> FreeBSD(*) Linux >> Mbits/sec >> 1- 926 905 (this machine was busy) >> 2- 545 798 >> 3- 910 912 >> *: did a 'sysctl net.inet.tcp.sendspace=65536' >> >> >> So, it seems to me something is not that good in the UDP department, but >> I can't find what to tweek. >> >> Any help? >> >> danny > > Have discussed this some internally, the best idea I've heard is that > UDP is not giving us the interrupt rate that TCP would, so we end up > not cleaning up as often, and thus descriptors might not be as quickly > available.. Its just speculation at this point. If a high interrupt rate is a problem and your NIC+driver supports it, then try enabling polling(4) aswell. This has helped me for bulk transfers on slower boxes but i have noticed problems with ALTQ/dummynet and other highly realtime dependent networking code. YMMV. More info in the man 4 polling. I think recent linux kernels/drivers have this implemented so it will enable it dynamically on high load. However i only skimmed the documents and i'm not a linux expert so i may be wrong on that. /Junics > > Try this: the default is only to have 256 descriptors, try going for > the MAX > which is 4K. > > Cheers, > > Jack > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >