From owner-freebsd-fs@FreeBSD.ORG Thu Jul 21 04:40:42 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0E20D106566C for ; Thu, 21 Jul 2011 04:40:42 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta01.emeryville.ca.mail.comcast.net (qmta01.emeryville.ca.mail.comcast.net [76.96.30.16]) by mx1.freebsd.org (Postfix) with ESMTP id EA1E88FC14 for ; Thu, 21 Jul 2011 04:40:41 +0000 (UTC) Received: from omta13.emeryville.ca.mail.comcast.net ([76.96.30.52]) by qmta01.emeryville.ca.mail.comcast.net with comcast id AUgb1h00517UAYkA1Ugedv; Thu, 21 Jul 2011 04:40:38 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta13.emeryville.ca.mail.comcast.net with comcast id AUgf1h00X1t3BNj8ZUggCR; Thu, 21 Jul 2011 04:40:40 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 71BB1102C36; Wed, 20 Jul 2011 21:40:38 -0700 (PDT) Date: Wed, 20 Jul 2011 21:40:38 -0700 From: Jeremy Chadwick To: Michael DeMan Message-ID: <20110721044038.GA57436@icarus.home.lan> References: <188D255F-B83A-4B9A-89AF-9BF58050F816@deman.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <188D255F-B83A-4B9A-89AF-9BF58050F816@deman.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org Subject: Re: Marvell 88SX6081 timeouts, particularly when running 'zfs scrub' with regular I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jul 2011 04:40:42 -0000 On Wed, Jul 20, 2011 at 08:59:32PM -0700, Michael DeMan wrote: > I've found a few posts around about this, but nothing conclusive. > > We have been getting hit on this with two... > mvs0: port 0x9400-0x94ff mem 0xfc400000-0xfc4fffff irq 28 at device 1.0 on pci1 > mvs1: port 0x9800-0x98ff mem 0xfc500000-0xfc5fffff irq 29 at device 3.0 on pci1 > ...controllers. > > I went through and did a few things (an older Opteron 285 box) and disabled super-pages and permutations on other device.hints, loader.conf and live sysctl settings - all to no avail. > > I also found a few things via Google about being to patch from 9-CURRENT, but the idea with this box was to be able to re-purpose some older equipment for proof of concept using FreeNAS8. > > It is possible for me to build a version of that with the patches, etc - but I figured it would be better to post to the list first and gather feedback since this is pretty old/clunky hardware and newer patches may or may not solve the problem. > > Thanks, > > - mike deman > > > > Jul 19 16:46:41 freenas kernel: mvsch11: Timeout on slot 0 > Jul 19 16:46:41 freenas kernel: mvsch11: iec 02000000 sstat 00000123 serr 00000000 edma_s 00001023 dma_c 00000000 dma_s 00000000 rs 00000201 status 40 > Jul 19 16:46:41 freenas kernel: mvsch11: ... waiting for slots 00000200 > Jul 19 16:46:43 freenas kernel: mvsch4: Timeout on slot 4 > Jul 19 16:46:43 freenas kernel: mvsch4: iec 02000000 sstat 00000123 serr 00000000 edma_s 00001022 dma_c 00000000 dma_s 00000000 rs 00000010 status 40 > Jul 19 16:46:45 freenas kernel: mvsch1: Timeout on slot 0 > Jul 19 16:46:45 freenas kernel: mvsch1: iec 02000000 sstat 00000123 serr 00000000 edma_s 00001101 dma_c 00000000 dma_s 00000000 rs 00000001 status 40 > Jul 19 16:46:46 freenas kernel: mvsch11: Timeout on slot 9 > Jul 19 16:46:46 freenas kernel: mvsch11: iec 02000000 sstat 00000123 serr 00000000 edma_s 00001023 dma_c 00000000 dma_s 00000000 rs 00000201 status 40 > Jul 19 16:46:47 freenas root: ZFS: checksum mismatch, zpool=zpmir1 path=/dev/gpt/ada12 offset=52341838336 size=131072 You didn't disclose what FreeBSD version you're running and what your kernel/world build date is. It matters greatly since it will then give us some idea what exact source revision you're using for the mvs(4) driver. "uname -a" output is sufficient. Thanks. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |