From owner-freebsd-stable@FreeBSD.ORG Thu Aug 26 22:50:13 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C151C1065693 for ; Thu, 26 Aug 2010 22:50:13 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 492CC8FC0C for ; Thu, 26 Aug 2010 22:50:12 +0000 (UTC) Received: by eyx24 with SMTP id 24so1990163eyx.13 for ; Thu, 26 Aug 2010 15:50:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=l75idNCbsVk5Fwpa+9uMmg7s0S/XRKDbETzvCD0eKso=; b=KmKOBUXpxOpD1TF1Xrqz/wRCxdEwdzTzPFggWCIpG7i3fRDUM0ikkmrxuY9ovMKsVD 85zlQ7Ojj8jSiBTC7PvWOqmmvcP+WX3aF0bZJ+XaJarJHJTmaPkN8V5AdHKqbW5a7Ho6 FRhY8kvAwJtS5Y3uDRFkgD0ToqRYi+aQgkG5Q= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=fTrZS1p9IS5AH97zMWmqUXbxHKTHRmUARPcub9ooOuibwFWsXVZfju0B8F8DyuwxmU i8tsZpoYjSvWu7odMKtPpNTRl3qVRcDyNbhxBOlrOgjCG5K6qwE4EwefXFMluZV74PRO riorX51b4e0hS63pdM8mjZoWy9jClUv78Hp68= MIME-Version: 1.0 Received: by 10.216.186.70 with SMTP id v48mr106866wem.64.1282863011078; Thu, 26 Aug 2010 15:50:11 -0700 (PDT) Received: by 10.216.49.78 with HTTP; Thu, 26 Aug 2010 15:50:10 -0700 (PDT) In-Reply-To: <20100826221526.GA4760@icarus.home.lan> References: <4C744DC4.3070100@h3q.com> <201008250109.o7P19uEp046002@lava.sentex.ca> <4C76A226.5070302@h3q.com> <20100826212757.GA3391@icarus.home.lan> <4C76E320.9090008@h3q.com> <20100826221526.GA4760@icarus.home.lan> Date: Thu, 26 Aug 2010 15:50:10 -0700 Message-ID: From: Jack Vogel To: Jeremy Chadwick Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: PYUN YongHyeon , Philipp Wuensche , freebsd-stable@freebsd.org Subject: Re: Crashes on X7SPE-HF with em X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Aug 2010 22:50:13 -0000 On Thu, Aug 26, 2010 at 3:15 PM, Jeremy Chadwick wrote: > On Thu, Aug 26, 2010 at 11:56:48PM +0200, Philipp Wuensche wrote: > > Jeremy Chadwick wrote: > > > > > > CC'ing Jack Vogel of Intel and Yong-Hyeon PYUN who might have some > > > ideas. OP's backtrace is here: > > > > > > > http://lists.freebsd.org/pipermail/freebsd-stable/2010-August/058425.html > > > > > > Philipp, can you please provide the following output? > > > > > > * dmesg | egrep 'em[0-9]' > > > > em0: port 0xdc00-0xdc1f mem > > 0xfe9e0000-0xfe9fffff,0xfe9dc000-0xfe9dffff irq 16 at device 0.0 on pci2 > > em0: Using MSI interrupt > > em0: [FILTER] > > em0: Ethernet address: 00:25:90:04:6e:fa > > em1: port 0xec00-0xec1f mem > > 0xfeae0000-0xfeafffff,0xfeadc000-0xfeadffff irq 17 at device 0.0 on pci3 > > em1: Using MSI interrupt > > em1: [FILTER] > > em1: Ethernet address: 00:25:90:04:6e:fb > > > > > * uname -a (you can XXX out the machine name if need be) > > > > FreeBSD XXX 8.1-STABLE FreeBSD 8.1-STABLE #2: Wed Aug 25 10:38:50 CEST > > 2010 root@XXX:/usr/obj/usr/src/sys/XXX amd64 > > > > Date of source is Aug 17 14:09 CEST 2010. It happend with 8.1-RELEASE > > too, I can go back to RELEASE or any SVN revision you would like, if it > > is helping in any way. > > > > Kernel-config: > > > > include GENERIC > > > > ident XXX > > > > options IPSEC > > > > options DEVICE_POLLING > > options ACCEPT_FILTER_HTTP > > > > options ALTQ > > > > options ALTQ_CBQ > > options ALTQ_RED > > options ALTQ_RIO > > options ALTQ_HFSC > > options ALTQ_PRIQ > > > > device crypto > > device enc > > > > > > > * pciconf -lvc (only include the em(4) items please) > > > > em0@pci0:2:0:0: class=0x020000 card=0x060a15d9 chip=0x10d38086 > rev=0x00 > > hdr=0x00 > > vendor = 'Intel Corporation' > > device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' > > class = network > > subclass = ethernet > > cap 01[c8] = powerspec 2 supports D0 D3 current D0 > > cap 05[d0] = MSI supports 1 message, 64 bit enabled with 1 message > > cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1) > > cap 11[a0] = MSI-X supports 5 messages in map 0x1c > > em1@pci0:3:0:0: class=0x020000 card=0x060a15d9 chip=0x10d38086 > rev=0x00 > > hdr=0x00 > > vendor = 'Intel Corporation' > > device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' > > class = network > > subclass = ethernet > > cap 01[c8] = powerspec 2 supports D0 D3 current D0 > > cap 05[d0] = MSI supports 1 message, 64 bit enabled with 1 message > > cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1) > > cap 11[a0] = MSI-X supports 5 messages in map 0x1c > > > > > * vmstat -i > > > > interrupt total rate > > irq1: atkbd0 9 0 > > cpu0: timer 36544552 1994 > > irq256: em0 3801 0 > > irq257: em1 32963909 1799 > > irq258: ahci0 175662 9 > > cpu1: timer 36543525 1994 > > cpu2: timer 36543525 1994 > > cpu3: timer 36543525 1994 > > Total 179318508 9786 > > > > There is an shared IPMI interface on em0, but the interface is not used > > by FreeBSD. em1 is used by four VLANs. Polling is only in the > > Kernelconfig, not activated on the devices. > > So much complexity here. Tracking this down might be difficult. > > One thing that does concern me is the interrupt rate for em1. Jack et > al, is this normal? I don't see this behaviour on my 8.x systems with > em(4) driver 7.0.5, but my systems all use 82573E and 82573L, and don't > have MSI-X support. > > He is only using one vector anyway it seems, so MSIX isnt making things much more complex than your 573. The interrupt rate seems high but I'm not sure if its abnormal for a busy interface. I tend to agree with Yongari, let's eliminate all the complicating factors like IPSEC and ALTQ and see if it still occurs. >From the crash data I do not see a clear cause either. Jack