From owner-freebsd-stable@FreeBSD.ORG Wed Jun 15 07:57:57 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A4301065672 for ; Wed, 15 Jun 2011 07:57:57 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta03.westchester.pa.mail.comcast.net (qmta03.westchester.pa.mail.comcast.net [76.96.62.32]) by mx1.freebsd.org (Postfix) with ESMTP id CC3DC8FC0A for ; Wed, 15 Jun 2011 07:57:56 +0000 (UTC) Received: from omta15.westchester.pa.mail.comcast.net ([76.96.62.87]) by qmta03.westchester.pa.mail.comcast.net with comcast id w7xx1g0011swQuc537xxEr; Wed, 15 Jun 2011 07:57:57 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta15.westchester.pa.mail.comcast.net with comcast id w7xv1g00S1t3BNj3b7xwy3; Wed, 15 Jun 2011 07:57:57 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 736CC102C19; Wed, 15 Jun 2011 00:57:54 -0700 (PDT) Date: Wed, 15 Jun 2011 00:57:54 -0700 From: Jeremy Chadwick To: Joshua Boyd Message-ID: <20110615075754.GA54879@icarus.home.lan> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable , "Vogel, Jack" Subject: Re: em0 watchdog timeouts on 8-STABLE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Jun 2011 07:57:57 -0000 On Wed, Jun 15, 2011 at 03:14:43AM -0400, Joshua Boyd wrote: > I recently updated my server to the latest 8-STABLE, and upgraded to v28 > ZFS. I have not had these problems on any other version of 8-STABLE or > 7-STABLE, which this box was upgraded from some time ago. > > Now, during my weekly scrub, I get the following messages and em0 is > unresponsive: > > Jun 12 03:07:58 foghornleghorn kernel: em0: Watchdog timeout -- resetting > Jun 12 03:07:58 foghornleghorn kernel: em0: link state changed to DOWN > Jun 12 03:08:01 foghornleghorn kernel: em0: link state changed to UP > Jun 12 03:08:47 foghornleghorn kernel: em0: Watchdog timeout -- resetting > Jun 12 03:08:47 foghornleghorn kernel: em0: link state changed to DOWN > Jun 12 03:08:50 foghornleghorn kernel: em0: link state changed to UP > > My scrub is scheduled to start at 03:00:00, so it looks like watchdog > timeouts start occurring pretty quickly once I/O ramps up. > > Here's some possibly relevant information, let me know if anything else > would be helpful to troubleshoot. > > FreeBSD foghornleghorn.res.openband.net 8.2-STABLE FreeBSD 8.2-STABLE #17: > Mon Jun 6 19:40:19 EDT 2011 > root@foghornleghorn.res.openband.net:/usr/obj/usr/src/sys/FOGHORNLEGHORN > amd64 > > em0: port 0xe800-0xe83f > mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device 5.0 on pci7 > > em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086 rev=0x05 > hdr=0x00 > vendor = 'Intel Corporation' > device = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)' > class = network > subclass = ethernet > > And, the SAS cards: > > dev.mpt.0.%desc: LSILogic SAS/SATA Adapter > dev.mpt.0.%driver: mpt > dev.mpt.0.%location: slot=0 function=0 > dev.mpt.0.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9 > subdevice=0xa580 class=0x010000 > dev.mpt.0.%parent: pci1 > dev.mpt.0.debug: 3 > dev.mpt.0.role: 1 > dev.mpt.1.%desc: LSILogic SAS/SATA Adapter > dev.mpt.1.%driver: mpt > dev.mpt.1.%location: slot=0 function=0 > dev.mpt.1.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9 > subdevice=0xa580 class=0x010000 > dev.mpt.1.%parent: pci2 > dev.mpt.1.debug: 3 > dev.mpt.1.role: 1 > dev.mpt.2.%desc: LSILogic SAS/SATA Adapter > dev.mpt.2.%driver: mpt > dev.mpt.2.%location: slot=0 function=0 > dev.mpt.2.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x1000 > subdevice=0x30a0 class=0x010000 > dev.mpt.2.%parent: pci6 > dev.mpt.2.debug: 3 > dev.mpt.2.role: 1 Please provide output from the following commands (as root): # pciconf -lvcb # vmstat -i # sysctl -a | grep msi # dmesg -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |