From owner-freebsd-stable@FreeBSD.ORG Wed Jun 15 07:42:25 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D5697106564A for ; Wed, 15 Jun 2011 07:42:25 +0000 (UTC) (envelope-from boydjd@jbip.net) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 528358FC08 for ; Wed, 15 Jun 2011 07:42:25 +0000 (UTC) Received: by fxm11 with SMTP id 11so292005fxm.13 for ; Wed, 15 Jun 2011 00:42:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jbip.net; s=google; h=domainkey-signature:mime-version:from:date:message-id:subject:to :content-type; bh=E8W1CgudBcZjta8IxpCE9FMBApLVSMMfQq7On5Km3Zw=; b=BrgILHPZOjBM3cQV1eeNOnDUlgsX0J/9U1HrSe8Xf9y0weJFVqdtl2S3ScPPtcP94C pdfNNpIEL2vmI4kEBzaMfpYqkjYErDz4u7PKpIS5E5nxUkMVOcX00ixPayOjkjRWQw7N wThjvz1W2DlBiLxXE6MEoDiR9uPniyqS0dq3E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=jbip.net; s=google; h=mime-version:from:date:message-id:subject:to:content-type; b=RUgYlRCRf53ZsyBdMf4IlM1ZoUfbj32jgAtfwIhYai3i8ab8eIAB8MdpEXSOmLSPSH nAJOrpu9Jphlw3G1s1X+oT2FFYm6TKGXX8uCuNqpVS15w1eVCVPZWIVpwifcvWN8rzI/ Z7ccme6p8iDRkFJIWjA+6y4tH0sU1qeNv7AdQ= Received: by 10.223.55.27 with SMTP id s27mr164792fag.121.1308122103322; Wed, 15 Jun 2011 00:15:03 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.112.1 with HTTP; Wed, 15 Jun 2011 00:14:43 -0700 (PDT) From: Joshua Boyd Date: Wed, 15 Jun 2011 03:14:43 -0400 Message-ID: To: freebsd-stable Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: em0 watchdog timeouts on 8-STABLE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Jun 2011 07:42:25 -0000 I recently updated my server to the latest 8-STABLE, and upgraded to v28 ZFS. I have not had these problems on any other version of 8-STABLE or 7-STABLE, which this box was upgraded from some time ago. Now, during my weekly scrub, I get the following messages and em0 is unresponsive: Jun 12 03:07:58 foghornleghorn kernel: em0: Watchdog timeout -- resetting Jun 12 03:07:58 foghornleghorn kernel: em0: link state changed to DOWN Jun 12 03:08:01 foghornleghorn kernel: em0: link state changed to UP Jun 12 03:08:47 foghornleghorn kernel: em0: Watchdog timeout -- resetting Jun 12 03:08:47 foghornleghorn kernel: em0: link state changed to DOWN Jun 12 03:08:50 foghornleghorn kernel: em0: link state changed to UP My scrub is scheduled to start at 03:00:00, so it looks like watchdog timeouts start occurring pretty quickly once I/O ramps up. Here's some possibly relevant information, let me know if anything else would be helpful to troubleshoot. FreeBSD foghornleghorn.res.openband.net 8.2-STABLE FreeBSD 8.2-STABLE #17: Mon Jun 6 19:40:19 EDT 2011 root@foghornleghorn.res.openband.net:/usr/obj/usr/src/sys/FOGHORNLEGHORN amd64 em0: port 0xe800-0xe83f mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device 5.0 on pci7 em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' device = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)' class = network subclass = ethernet And, the SAS cards: dev.mpt.0.%desc: LSILogic SAS/SATA Adapter dev.mpt.0.%driver: mpt dev.mpt.0.%location: slot=0 function=0 dev.mpt.0.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9 subdevice=0xa580 class=0x010000 dev.mpt.0.%parent: pci1 dev.mpt.0.debug: 3 dev.mpt.0.role: 1 dev.mpt.1.%desc: LSILogic SAS/SATA Adapter dev.mpt.1.%driver: mpt dev.mpt.1.%location: slot=0 function=0 dev.mpt.1.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9 subdevice=0xa580 class=0x010000 dev.mpt.1.%parent: pci2 dev.mpt.1.debug: 3 dev.mpt.1.role: 1 dev.mpt.2.%desc: LSILogic SAS/SATA Adapter dev.mpt.2.%driver: mpt dev.mpt.2.%location: slot=0 function=0 dev.mpt.2.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x1000 subdevice=0x30a0 class=0x010000 dev.mpt.2.%parent: pci6 dev.mpt.2.debug: 3 dev.mpt.2.role: 1 -- Joshua Boyd JBipNet E-mail: boydjd@jbip.net Cell: (513) 375-0157 http://www.jbip.net