From owner-freebsd-net@FreeBSD.ORG Tue Feb 8 02:27:45 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 78F31106566B for ; Tue, 8 Feb 2011 02:27:45 +0000 (UTC) (envelope-from cowbert@gmail.com) Received: from mail-ew0-f54.google.com (mail-ew0-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id 056608FC12 for ; Tue, 8 Feb 2011 02:27:44 +0000 (UTC) Received: by ewy24 with SMTP id 24so2696780ewy.13 for ; Mon, 07 Feb 2011 18:27:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=pXGpfBmHwLSoW5esEfpi2c9VtRP054+8Z5ESnQp+tWQ=; b=DXkzFdF4h1Swadl7j7DfqBxBi2L0fgfJxhowx3qm2Sy7spxPe2krQdiV6SAuws6S38 nEzcf1570e4W2TaaS5PVDAL7cXyB9z3kpfhkSnRGE5niiOLxWXzVWCkXU3Patbms5ZXV XiNfT7yGtx7harN+JVt+TOdYv32VUxOWP77OM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=A+hkyFRdPMDJwyTzeqQUxAikr93LiCV3I0alD9I8vU/9kveP8YF4Fd3+yPIb2ZQuYo khlIC6QW8DExas0ViGf8Po3UG8Glf86Ih4j/L7YpGeAZNwoZkeq+wWDIt3k9ZJVh6WXI EZlOjXKiYuqQJOWWVBZvZ3PhM/xKbEG2jCF9E= MIME-Version: 1.0 Received: by 10.213.108.69 with SMTP id e5mr380518ebp.76.1297132063701; Mon, 07 Feb 2011 18:27:43 -0800 (PST) Received: by 10.213.31.65 with HTTP; Mon, 7 Feb 2011 18:27:43 -0800 (PST) Received: by 10.213.31.65 with HTTP; Mon, 7 Feb 2011 18:27:43 -0800 (PST) In-Reply-To: <20110208013841.GB1306@michelle.cdnetworks.com> References: <20110208013841.GB1306@michelle.cdnetworks.com> Date: Mon, 7 Feb 2011 20:27:43 -0600 Message-ID: From: Peter Lai To: pyunyh@gmail.com Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: bge wedging 8.2-RC1 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Feb 2011 02:27:45 -0000 On Feb 7, 2011 7:38 PM, "Pyun YongHyeon" wrote: > > On Mon, Feb 07, 2011 at 06:09:16PM -0600, Peter Lai wrote: > > Hello > > > > I've got a new Dell Precision workstation here with a BCM5761 on intel > > mobo for westmere xeons that is wedging with interrupt storm and will > > lockup the system randomly. I have turned HTT and auto powermanagement > > off in bios (system cannot sleep), lowest cpu acpi state is C1. > > > > Here is dmesg: > > bge0: > 0x5761100> mem 0xf3be0000-0xf3beffff,0xf3bf0000-0xf3bfffff irq 17 at > > device 0.0 on pci6 > > bge0: CHIP ID 0x05761100; ASIC REV 0x5761; CHIP REV 0x57611; PCI-E > > miibus0: on bge0 > > brgphy0: PHY 1 on miibus0 > > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, > > 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > > > > Here is pciconf -lv: > > bge0@pci0:6:0:0: class=0x020000 card=0x026d1028 chip=0x168114e4 > > rev=0x10 hdr=0x00 > > vendor = 'Broadcom Corporation' > > device = 'Broadcom 57XX Gigabit Integrated Controller (BCM5761)' > > class = network > > subclass = ethernet > > > > here is the setup in rc.conf: > > > > ifconfig_bge0="polling -tso -vlanhwtso -vlanhwtag -vlanmtu inet > > 192.168.123.124 netmask 255.255.255.0" > > > > I have the card plugged into a dlink DSS8 100mbps switch with one > > other 100mbps device on it (rich man's crossover cable). > > > > Before turning off TSO4 and VLAN tagging (because I don't use them), > > the card would do several things: > > 1. 1 out of 3 reboots: Fail to bring interface up. ifconfig would hang > > and systat/vmstat showed 800+ interrupts per second on IRQ256 > > This is strange. bge(4) does not use MSI if you build bge(4) with > DEVICE_POLLING so seeing IRQ256 interrupts looks odd to me. > Are you sure bge(4) is using IRQ256? This is with GENERIC. I will rebuild with POLLING and try... > > > 2. After a few hours lock up the system, requiring hard reboot > > > > After disabling TSO4 and VLAN stuff: > > bge0: flags=8802 metric 0 mtu 1500 > > options=80083 > > media: Ethernet autoselect (100baseTX > > ) > > > > Everything seemed fine for about two weeks and then suddenly started > > acting up again, locked up, after hard reboot, soft reboot, link will > > not come up and I see interrupt storm again.... > > > > If you don't use DEVICE_POLLING, rebuild bge(4) with > DEVICE_POLLING. For most cases, you don't need to enable polling on > intelligent controllers like bge(4). > > I also have BCM5761 PCIe controller which shows no such issues. I > know there is an edge case(send BD corruption) for BCM5761/BCM5784/ > BCM57780 which needs to be investigated. I'm not sure you're seeing > that edge case though. > > > I am close to buying an intel card to replace the bcm, but then I > > noticed that the main intel desktop PCI-E card is 82574L-based and > > people are having em driver wedging on that too. So now I have broken > > ethernet on this box; my primary link is atheros 5212 pci card and I > > may be out of pci slots (or else I might try a pci intel card).