Date: Fri, 22 Jul 2011 10:54:39 -0700 From: Michael DeMan <freebsd@deman.com> To: Jeremy Chadwick <freebsd@jdc.parodius.com> Cc: freebsd-fs@freebsd.org Subject: Re: Marvell 88SX6081 timeouts, particularly when running 'zfs scrub' with regular I/O Message-ID: <0542453F-C96F-45D8-8697-4D181DFED03D@deman.com> In-Reply-To: <20110721044038.GA57436@icarus.home.lan> References: <188D255F-B83A-4B9A-89AF-9BF58050F816@deman.com> <20110721044038.GA57436@icarus.home.lan>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi Jeremy, Info is: FreeBSD freenas.n.bli.openaccess.org 8.2-RELEASE-p2 FreeBSD = 8.2-RELEASE-p2 #0: Tue Jul 12 12:11:37 PDT 2011 = jpaetzel@servant.iXsystems.com:/b/home/jpaetzel/sf_freenas_build/obj.amd64= /b/home/jpaetzel/sf_freenas_build/FreeBSD/src/sys/FREENAS.amd64 amd64 Also, the problem I am seeing with the mvs driver seems suspiciously = close to a problem with ahci driver that is patched in 9-CURRENT = apparently by disabling NCQ? http://forums.freebsd.org/showthread.php?t=3D20412 The problem only occurs under high I/O - basically I can force it to = occur by kicking off a zfs scrub while there is also about 300 IOPS of = NFS traffic at the same time. On Jul 20, 2011, at 9:40 PM, Jeremy Chadwick wrote: > On Wed, Jul 20, 2011 at 08:59:32PM -0700, Michael DeMan wrote: >> I've found a few posts around about this, but nothing conclusive. >>=20 >> We have been getting hit on this with two... >> mvs0: <Marvell 88SX6081 SATA controller> port 0x9400-0x94ff mem = 0xfc400000-0xfc4fffff irq 28 at device 1.0 on pci1 >> mvs1: <Marvell 88SX6081 SATA controller> port 0x9800-0x98ff mem = 0xfc500000-0xfc5fffff irq 29 at device 3.0 on pci1 >> ...controllers. >>=20 >> I went through and did a few things (an older Opteron 285 box) and = disabled super-pages and permutations on other device.hints, loader.conf = and live sysctl settings - all to no avail. >>=20 >> I also found a few things via Google about being to patch from = 9-CURRENT, but the idea with this box was to be able to re-purpose some = older equipment for proof of concept using FreeNAS8. >>=20 >> It is possible for me to build a version of that with the patches, = etc - but I figured it would be better to post to the list first and = gather feedback since this is pretty old/clunky hardware and newer = patches may or may not solve the problem. >>=20 >> Thanks, >>=20 >> - mike deman >>=20 >>=20 >>=20 >> Jul 19 16:46:41 freenas kernel: mvsch11: Timeout on slot 0 >> Jul 19 16:46:41 freenas kernel: mvsch11: iec 02000000 sstat 00000123 = serr 00000000 edma_s 00001023 dma_c 00000000 dma_s 00000000 rs 00000201 = status 40 >> Jul 19 16:46:41 freenas kernel: mvsch11: ... waiting for slots = 00000200 >> Jul 19 16:46:43 freenas kernel: mvsch4: Timeout on slot 4 >> Jul 19 16:46:43 freenas kernel: mvsch4: iec 02000000 sstat 00000123 = serr 00000000 edma_s 00001022 dma_c 00000000 dma_s 00000000 rs 00000010 = status 40 >> Jul 19 16:46:45 freenas kernel: mvsch1: Timeout on slot 0 >> Jul 19 16:46:45 freenas kernel: mvsch1: iec 02000000 sstat 00000123 = serr 00000000 edma_s 00001101 dma_c 00000000 dma_s 00000000 rs 00000001 = status 40 >> Jul 19 16:46:46 freenas kernel: mvsch11: Timeout on slot 9 >> Jul 19 16:46:46 freenas kernel: mvsch11: iec 02000000 sstat 00000123 = serr 00000000 edma_s 00001023 dma_c 00000000 dma_s 00000000 rs 00000201 = status 40 >> Jul 19 16:46:47 freenas root: ZFS: checksum mismatch, zpool=3Dzpmir1 = path=3D/dev/gpt/ada12 offset=3D52341838336 size=3D131072 >=20 > You didn't disclose what FreeBSD version you're running and what your > kernel/world build date is. It matters greatly since it will then = give > us some idea what exact source revision you're using for the mvs(4) > driver. "uname -a" output is sufficient. >=20 > Thanks. >=20 > --=20 > | Jeremy Chadwick jdc at parodius.com | > | Parodius Networking http://www.parodius.com/ | > | UNIX Systems Administrator Mountain View, CA, US | > | Making life hard for others since 1977. PGP 4BD6C0CB | >=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0542453F-C96F-45D8-8697-4D181DFED03D>