From owner-freebsd-stable@FreeBSD.ORG Wed Aug 30 18:45:03 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D0B2116A4E2 for ; Wed, 30 Aug 2006 18:45:03 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.176]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5E2AE43D79 for ; Wed, 30 Aug 2006 18:45:02 +0000 (GMT) (envelope-from jfvogel@gmail.com) Received: by py-out-1112.google.com with SMTP id o67so379764pye for ; Wed, 30 Aug 2006 11:45:01 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=qRVaPVzZTX8V15P9R1IKf4PWxyCtEJ4kreBX2xoJzxwUAxo/gF7ow8v83upwWuB/vFTauuElJzN9gsYtzYXtkK8yuimjg4/sZUfjkkDAk41B4Dh90A1DTRwiR2dDl7ozlrbdV4S6MO0XtUfoHSPOKnukazzyKRKogKwFHapmapo= Received: by 10.35.72.6 with SMTP id z6mr1575491pyk; Wed, 30 Aug 2006 11:45:01 -0700 (PDT) Received: by 10.35.119.1 with HTTP; Wed, 30 Aug 2006 11:45:01 -0700 (PDT) Message-ID: <2a41acea0608301145j7bbed961j33ce903a27d8963d@mail.gmail.com> Date: Wed, 30 Aug 2006 11:45:01 -0700 From: "Jack Vogel" To: "Danny Braniss" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: tcp/udp performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Aug 2006 18:45:03 -0000 On 8/30/06, Danny Braniss wrote: > > ever since 6.1 I've seen fluctuations in the performance of > the em (Intel(R) PRO/1000 Gigabit Ethernet). > > motherboard OBN (On Board NIC) > ---------------- ------------------ > 1- Intel SE7501WV2S Intel 82546EB::2.1 > 2- Intel SE7320VP2D2 INTEL 82541 > 3- Sun Fire X4100 Server Intel(R) PRO/1000 > > test 1: writing to a NetApp filer via NFS/UDP > FreeBSD Linux > MegaBytes/sec > 1- Average: 18.48 32.61 > 2- Average: 15.69 35.72 > 3- Average: 16.61 29.69 > (interstingly, doing NFS/TCP instead of NFS/UDP shows an increase in speed of > around 60% on FreeBSD but none on Linux) > > test2: iperf using 1 as server: > FreeBSD(*) Linux > Mbits/sec > 1- 926 905 (this machine was busy) > 2- 545 798 > 3- 910 912 > *: did a 'sysctl net.inet.tcp.sendspace=65536' > > > So, it seems to me something is not that good in the UDP department, but > I can't find what to tweek. > > Any help? > > danny Have discussed this some internally, the best idea I've heard is that UDP is not giving us the interrupt rate that TCP would, so we end up not cleaning up as often, and thus descriptors might not be as quickly available.. Its just speculation at this point. Try this: the default is only to have 256 descriptors, try going for the MAX which is 4K. Cheers, Jack