From owner-freebsd-net@FreeBSD.ORG Fri Jun 29 02:49:06 2007 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 976DB16A400 for ; Fri, 29 Jun 2007 02:49:06 +0000 (UTC) (envelope-from davidch@broadcom.com) Received: from mms2.broadcom.com (mms2.broadcom.com [216.31.210.18]) by mx1.freebsd.org (Postfix) with ESMTP id 6EE1613C4B0 for ; Fri, 29 Jun 2007 02:49:06 +0000 (UTC) (envelope-from davidch@broadcom.com) Received: from [10.10.64.154] by mms2.broadcom.com with ESMTP (Broadcom SMTP Relay (Email Firewall v6.3.1)); Thu, 28 Jun 2007 19:48:54 -0700 X-Server-Uuid: A6C4E0AE-A7F0-449F-BAE7-7FA0D737AC76 Received: by mail-irva-10.broadcom.com (Postfix, from userid 47) id 8231D2AF; Thu, 28 Jun 2007 19:48:54 -0700 (PDT) Received: from mail-irva-8.broadcom.com (mail-irva-8 [10.10.64.221]) by mail-irva-10.broadcom.com (Postfix) with ESMTP id 6DB7A2AE; Thu, 28 Jun 2007 19:48:54 -0700 (PDT) Received: from mail-irva-12.broadcom.com (mail-irva-12.broadcom.com [10.10.64.146]) by mail-irva-8.broadcom.com (MOS 3.7.5a-GA) with ESMTP id FKS39262; Thu, 28 Jun 2007 19:48:51 -0700 (PDT) Received: from NT-IRVA-0750.brcm.ad.broadcom.com ( nt-irva-0750.brcm.ad.broadcom.com [10.8.194.64]) by mail-irva-12.broadcom.com (Postfix) with ESMTP id 6CFDF69CA3; Thu, 28 Jun 2007 19:48:51 -0700 (PDT) X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Thu, 28 Jun 2007 19:48:50 -0700 Message-ID: <09BFF2FA5EAB4A45B6655E151BBDD903045714EF@NT-IRVA-0750.brcm.ad.broadcom.com> In-Reply-To: <09BFF2FA5EAB4A45B6655E151BBDD90304571430@NT-IRVA-0750.brcm.ad.broadcom.com> Thread-Topic: Problems with BCE network adapter (Dell PE2950) Thread-Index: Ace5kMf8tXReAU+tSNO0tue8ft3OFgANaqRgAAWpYmAABluJwA== References: <46680DB1.9050905@tomjudge.com> <09BFF2FA5EAB4A45B6655E151BBDD9030414B1EC@NT-IRVA-0750.brcm.ad.broadcom.com> <466873FA.9030800@tomjudge.com> <09BFF2FA5EAB4A45B6655E151BBDD9030423EE13@NT-IRVA-0750.brcm.ad.broadcom.com> <46823A78.7020501@tomjudge.com> <4683C578.6070009@tomjudge.com> <09BFF2FA5EAB4A45B6655E151BBDD90304571430@NT-IRVA-0750.brcm.ad.broadcom.com> From: "David Christensen" To: "Tom Judge" X-WSS-ID: 6A9AAC9C3DG643444-01-01 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Cc: freebsd-net Subject: RE: Problems with BCE network adapter (Dell PE2950) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 02:49:06 -0000 > > > Sorry for the top post, but I have just managed to repeat is=20 > > > exact crash=20 > > > twice on a new PE 1950 system. I have core files available. > > >=20 > > > It seems that after a couple of reboots the problem goes=20 > away. The=20 > > > system actually crashed 4 times but 2 of the cores where corrupt. > > >=20 > > > It also seems that the system will be stable if the following=20 > > > message is=20 > > > not produced shortly after /etc/rc.d/netif start: > > >=20 > > > bce0: /usr/src/sys/dev/bce/if_bce.c(3489): Too many free=20 > > > rx_bd (0xFFF9 >=20 > > > 0x01FE)! > > >=20 > >=20 > > The error indicates that too many receive buffer descriptors > > were freed from the receive chain. The driver must be losing > > count somewhere. The process for duplicating the error sounds > > simple enough, how much data is in your NFS mounted directory? > > Are you using TCP or UDP for the NFS mount? > >=20 > > Any idea what type of network activity is happening just after > > /etc/rc.d/netif start (DHCP, NTP, anything else)? > >=20 > > Dave >=20 > One other thing, are you using jumbo frames? What's your MTU setting? >=20 And one more thing. I've been passing line rate traffic for a few=20 hours (with both netperf running the tcp_stream_script and a constant stream of UDP traffic to the discard server on the FreeBSD system) and I haven't seen a hiccup yet on the tip of RELENG_6 with jumbo frames enabled on my Dell PE2950 (one dual-core CPU, 4GB RAM). Of course I don't have any real services running on it (load average is 0.19). Any unusual settings I should be aware of? Does anyone know a simple way to drive up CPU utilization and consume large amounts of memory to try and simulate a heavily loaded system? Dave