From owner-freebsd-net@FreeBSD.ORG Fri Oct 8 14:10:00 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 69B44106566C for ; Fri, 8 Oct 2010 14:10:00 +0000 (UTC) (envelope-from tom@tomjudge.com) Received: from eu1sys200aog115.obsmtp.com (eu1sys200aog115.obsmtp.com [207.126.144.139]) by mx1.freebsd.org (Postfix) with SMTP id 002CD8FC13 for ; Fri, 8 Oct 2010 14:09:58 +0000 (UTC) Received: from source ([63.174.175.251]) by eu1sys200aob115.postini.com ([207.126.147.11]) with SMTP ID DSNKTK8mNUkP3ukFxaBnNo8iGn4u06hvHgbQ@postini.com; Fri, 08 Oct 2010 14:09:59 UTC Received: from [172.17.10.53] (unknown [172.17.10.53]) by bbbx3.usdmm.com (Postfix) with ESMTP id 42ECAFD019; Fri, 8 Oct 2010 14:09:57 +0000 (UTC) Message-ID: <4CAF261F.4090509@tomjudge.com> Date: Fri, 08 Oct 2010 09:09:35 -0500 From: Tom Judge User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.9) Gecko/20100922 Lightning/1.0b2 Thunderbird/3.1.4 MIME-Version: 1.0 To: a.smith@ukgrid.net References: <20100924021115.GI15014@michelle.cdnetworks.com> <20100924123938.80702gxrzyfpury0@webmail2.ukgrid.net> <20100924165452.GA19036@michelle.cdnetworks.com> <20100927122713.12822br1odth4sro@webmail2.ukgrid.net> <20100927165129.GA1435@michelle.cdnetworks.com> <20100928132445.72052m5iw9f41ns4@webmail2.ukgrid.net> <20100928214438.GC1252@michelle.cdnetworks.com> <20100928230824.10533d7gmmba360w@webmail2.ukgrid.net> <20100928222532.GD1252@michelle.cdnetworks.com> <20101006174508.16931ioisevmzhy8@webmail2.ukgrid.net> <20101006174139.GC14879@michelle.cdnetworks.com> <20101008134251.367570jyw4igvkg8@webmail2.ukgrid.net> <4CAF1E0E.1080608@tomjudge.com> <20101008144851.12024aez0aoyd2qs@webmail2.ukgrid.net> In-Reply-To: <20101008144851.12024aez0aoyd2qs@webmail2.ukgrid.net> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: bge watchdog timeout errors FreeBSD 7.3 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Oct 2010 14:10:00 -0000 On 10/08/2010 08:48 AM, a.smith@ukgrid.net wrote: > Quoting Tom Judge : > >> >> The R610 has a NetXtream II chipset which uses the bce(4) driver. If >> you are going to doing heavy network traffic, or using jumbo frames I >> would personally recommend you fit an Intel PCIe card to this server >> before you put it in production. >> > > Ah, ok thanks for the feedback. I dont have any intention of using > jumbo frames, but I expect it to work on a gigabit switch port. Do you > have personal experience that these or bad, or what is the reason not > to use this chipset? > The hardware its self seems fine, but there are some outstanding driver issues: 1) Jumbo frames will cause mbuf zone memory fragmentation leaving to dropped frames/stack lock ups (visual indication). There is a work around for this issue (define BCE_HDR_SPLIT in sys/dev/bce/if_bcereg.h). 2) There are performance issues with streams of small frames (up to about 200 bytes) where the RX ring fills up and the firmware starts dropping packets. Flow control will /fix/ the issue but really it just plasters over the issue and moves the frame drops to the egress queue on the switch. These are the current issues and they affect all Dell 10th and 11th gen hardware (2950,1950,R710,R610,R410,etc,etc). There some patches floating around that attempt to address these issues. * One to turn header splitting into a loader tunable. * Flow control is supported on all stable branches and head. I don't think it is in a release. * There is a patch to be able to tune the size of the ring buffers used by the card but from my testing it is unstable, and unusable with anything but the default values. I have spent a week trying to get the nic's stable in a R710 after which management pulled me off the work and authorized funds to fit Intel cards to the boxes. Tom -- TJU13-ARIN