From owner-freebsd-net@FreeBSD.ORG Wed Dec 26 19:50:56 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C3B8B16A421 for ; Wed, 26 Dec 2007 19:50:56 +0000 (UTC) (envelope-from netslists@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.244]) by mx1.freebsd.org (Postfix) with ESMTP id 840B313C44B for ; Wed, 26 Dec 2007 19:50:56 +0000 (UTC) (envelope-from netslists@gmail.com) Received: by an-out-0708.google.com with SMTP id c14so531958anc.13 for ; Wed, 26 Dec 2007 11:50:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; bh=wSuie2gWE8WpbKCkvIWWJxklWfv+MIevEV0YUTyLceE=; b=w5BSizMm7b9heSWMHD49ojencmMvKmrgFgpI72A+pZsEj8h+G+L5jg7MFb8uESJpmhHuLqZAUwnL0G09kvn6GyttxW0ArRxre3FZMc6E+r4M/xdrj8RSHm9kSN7F4x710YiB1qVd+dlf9SXE8qc6xnRk3GTlHHXpIhBLjRo9yQU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; b=aKtKby+FDlXQh9dMas5D50q1tHtlBIBU1H8v/lHgBNTO1w+WqlyIsX6QUsdXZm4d6g/TqenFfjMTl1gfOO+B51B6Ktffvs1FHeWP2K+ammsKw8m3sdECbbE4o3pgKSj3Y48G9H8eSlgpzvUllMDxG2zNSSkzBnDxW+jmSOA0oNo= Received: by 10.100.110.15 with SMTP id i15mr14674910anc.76.1198697087677; Wed, 26 Dec 2007 11:24:47 -0800 (PST) Received: from ?192.168.12.8? ( [97.101.40.241]) by mx.google.com with ESMTPS id c40sm7839142anc.16.2007.12.26.11.24.46 (version=SSLv3 cipher=RC4-MD5); Wed, 26 Dec 2007 11:24:46 -0800 (PST) Message-ID: <4772AA7C.1020206@gmail.com> Date: Wed, 26 Dec 2007 14:24:44 -0500 From: Sten Daniel Soersdal User-Agent: Thunderbird 2.0.0.9 (Windows/20071031) MIME-Version: 1.0 To: Jean-Claude MICHOT References: <20071226180327.GA39735@flash.usenet-fr.net> In-Reply-To: <20071226180327.GA39735@flash.usenet-fr.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, freebsd-performance@freebsd.org Subject: Re: DELL PowerEdge 860 and Broadcom Gigabit Ethernet poor performance. X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2007 19:50:56 -0000 Jean-Claude MICHOT wrote: > The server is a DELL PowerEdge 860 freshly installed with > FreeBSD 7.0-BETA4 (GENERIC Kernel). > > pciconf and part of boot information: > > bge0@pci0:4:0:0: class=0x020000 card=0x01e61028 chip=0x165914e4 rev=0x11 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'BCM5721 NetXtreme Gigabit Ethernet PCI Express' > class = network > subclass = ethernet > bge1@pci0:5:0:0: class=0x020000 card=0x01e61028 chip=0x165914e4 rev=0x11 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'BCM5721 NetXtreme Gigabit Ethernet PCI Express' > class = network > subclass = ethernet > > bge0: mem 0xfe5f0000-0xfe5fffff irq 16 at device 0.0 on pci4 > miibus0: on bge0 > brgphy0: PHY 1 on miibus0 > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto > bge0: Ethernet address: 00:1c:23:e1:78:7e > bge0: [ITHREAD] > bge1: mem 0xfe3f0000-0xfe3fffff irq 17 at device 0.0 on pci5 > miibus1: on bge1 > brgphy1: PHY 1 on miibus1 > brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto > bge1: Ethernet address: 00:1c:23:e1:78:7f > bge1: [ITHREAD] > > There's no problem with input throughput (upto 980 Mbits) but output > throughput never go upper to 540 Mbits :( > > Just for test, i have add to this server an Intel Gigabit Ethernet board > (em) and there's no problem to output data up to around 980 Mbits with > this addon board. > > If i boot the server with Linux Ubuntu, there's no output throughput > problem with Broadcom, so it seem to be FreeBSD bge driver problem. > > I'm not the only one to have poor output performance with bge on > DELL PowerEdge 860 > http://lists.freebsd.org/pipermail/freebsd-net/2007-June/014373.html > > I have also try various patch or setup driver default values > http://lists.freebsd.org/pipermail/freebsd-net/2007-November/015951.html > http://lists.freebsd.org/pipermail/freebsd-net/2007-November/015956.html > > But all theses attempts to get better ouput performance was unsuccessful :( > > Any idea are welcome. > > PS: If it's usefull to debug and try to fix the problem, i can provide > root access to a DELL PE860 test server with bge. > Have you tried setting the tcp send and receive windows? The defaults are: net.inet.tcp.sendspace: 32768 net.inet.tcp.recvspace: 65536 Also you might want to try to lower: net.inet.tcp.delacktime: 100 -- Sten Daniel Soersdal