From owner-freebsd-net@FreeBSD.ORG Tue Feb 8 01:38:39 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7F5F21065674 for ; Tue, 8 Feb 2011 01:38:39 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id 358398FC0A for ; Tue, 8 Feb 2011 01:38:38 +0000 (UTC) Received: by gxk8 with SMTP id 8so2098843gxk.13 for ; Mon, 07 Feb 2011 17:38:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=r4uowO65bsNInZT7pgMqWeW17C58wFXNgqcaDO5vaPQ=; b=WsE1olbaUbwIAkvxb6Ce8iWLH2HOHYzoEC6TZValSUiY/UNw1yVPVnxteSUw20Twte 08CdqlcxtVbfapJBw5TCNWOWor9nfcoCIEqpkCe1UaF+18Nbw4BY1tfCagbdVSpUhih8 9I+UA43zzG2p0o+DNeqTOaTs/sD+9Z6ueWsxE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=wCT11pyCOyO7SbWM4Nh16DiBJNb4RTmO5bec5BFRACyAuG+Mc6n01clUGXY5SPtmGA 3FhHueVJbr93nsYiSqWo6Yr+SYMcZCjjiCeSp1sNyR37faBqkY426G5c+8kADodev3p9 9HVLrbbQmBWkJa+AINlzMutn3YZc6/Xjx2o24= Received: by 10.151.18.19 with SMTP id v19mr8346450ybi.428.1297129118368; Mon, 07 Feb 2011 17:38:38 -0800 (PST) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id v39sm7640yba.7.2011.02.07.17.38.35 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 07 Feb 2011 17:38:37 -0800 (PST) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Mon, 7 Feb 2011 17:38:41 -0800 From: Pyun YongHyeon Date: Mon, 7 Feb 2011 17:38:41 -0800 To: Peter Lai Message-ID: <20110208013841.GB1306@michelle.cdnetworks.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-net@freebsd.org Subject: Re: bge wedging 8.2-RC1 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Feb 2011 01:38:39 -0000 On Mon, Feb 07, 2011 at 06:09:16PM -0600, Peter Lai wrote: > Hello > > I've got a new Dell Precision workstation here with a BCM5761 on intel > mobo for westmere xeons that is wedging with interrupt storm and will > lockup the system randomly. I have turned HTT and auto powermanagement > off in bios (system cannot sleep), lowest cpu acpi state is C1. > > Here is dmesg: > bge0: 0x5761100> mem 0xf3be0000-0xf3beffff,0xf3bf0000-0xf3bfffff irq 17 at > device 0.0 on pci6 > bge0: CHIP ID 0x05761100; ASIC REV 0x5761; CHIP REV 0x57611; PCI-E > miibus0: on bge0 > brgphy0: PHY 1 on miibus0 > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, > 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > > Here is pciconf -lv: > bge0@pci0:6:0:0: class=0x020000 card=0x026d1028 chip=0x168114e4 > rev=0x10 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'Broadcom 57XX Gigabit Integrated Controller (BCM5761)' > class = network > subclass = ethernet > > here is the setup in rc.conf: > > ifconfig_bge0="polling -tso -vlanhwtso -vlanhwtag -vlanmtu inet > 192.168.123.124 netmask 255.255.255.0" > > I have the card plugged into a dlink DSS8 100mbps switch with one > other 100mbps device on it (rich man's crossover cable). > > Before turning off TSO4 and VLAN tagging (because I don't use them), > the card would do several things: > 1. 1 out of 3 reboots: Fail to bring interface up. ifconfig would hang > and systat/vmstat showed 800+ interrupts per second on IRQ256 This is strange. bge(4) does not use MSI if you build bge(4) with DEVICE_POLLING so seeing IRQ256 interrupts looks odd to me. Are you sure bge(4) is using IRQ256? > 2. After a few hours lock up the system, requiring hard reboot > > After disabling TSO4 and VLAN stuff: > bge0: flags=8802 metric 0 mtu 1500 > options=80083 > media: Ethernet autoselect (100baseTX > ) > > Everything seemed fine for about two weeks and then suddenly started > acting up again, locked up, after hard reboot, soft reboot, link will > not come up and I see interrupt storm again.... > If you don't use DEVICE_POLLING, rebuild bge(4) with DEVICE_POLLING. For most cases, you don't need to enable polling on intelligent controllers like bge(4). I also have BCM5761 PCIe controller which shows no such issues. I know there is an edge case(send BD corruption) for BCM5761/BCM5784/ BCM57780 which needs to be investigated. I'm not sure you're seeing that edge case though. > I am close to buying an intel card to replace the bcm, but then I > noticed that the main intel desktop PCI-E card is 82574L-based and > people are having em driver wedging on that too. So now I have broken > ethernet on this box; my primary link is atheros 5212 pci card and I > may be out of pci slots (or else I might try a pci intel card).