From owner-freebsd-fs@FreeBSD.ORG Wed Sep 29 15:11:13 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D65371065673 for ; Wed, 29 Sep 2010 15:11:13 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta03.emeryville.ca.mail.comcast.net (qmta03.emeryville.ca.mail.comcast.net [76.96.30.32]) by mx1.freebsd.org (Postfix) with ESMTP id BCBBD8FC13 for ; Wed, 29 Sep 2010 15:11:13 +0000 (UTC) Received: from omta22.emeryville.ca.mail.comcast.net ([76.96.30.89]) by qmta03.emeryville.ca.mail.comcast.net with comcast id CdRT1f0061vN32cA3fBDjw; Wed, 29 Sep 2010 15:11:13 +0000 Received: from koitsu.dyndns.org ([98.248.41.155]) by omta22.emeryville.ca.mail.comcast.net with comcast id CfBB1f00R3LrwQ28ifBCu6; Wed, 29 Sep 2010 15:11:13 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 602A39B418; Wed, 29 Sep 2010 08:11:11 -0700 (PDT) Date: Wed, 29 Sep 2010 08:11:11 -0700 From: Jeremy Chadwick To: Karl Pielorz Message-ID: <20100929151111.GA91705@icarus.home.lan> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD 8.1-R/amd64 - zfs 'hangs' - help tracing? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Sep 2010 15:11:13 -0000 On Wed, Sep 29, 2010 at 10:20:22AM +0100, Karl Pielorz wrote: > > Hi All, > > I moved my machine from FreeBSD 7.2-S/amd64 to 8.1-R/amd64 about a > week ago. Since then I've noticed that ZFS just 'hangs' - e.g. it'll > work fine for a few days, then a process will get 'hung up' waiting > on ZFS. > > The machine is a Tyan motherboard (dual Opteron, dual cores, w/10Gb > of RAM). 7.2-S & ZFS ran perfectly under it. > > Anything else then that touches the pools, also 'hangs' - in top the > original process shows as: > > " > 1927 root 1 44 0 8224K 1544K zio->i 0 0:00 0.00% ls > " > > Anything else that touches the ZFS pools, ends up like: > > " > 2082 root 1 44 0 10284K 2976K zfs 3 0:00 0.00% csh > " > > I saw a while ago a command under 8.1 to get 'more info' for these > stuck processes, but can't for the life of me remember it? > > If someone can give me some pointers to try and track down what's hanging? > > The drives are spread over two Marvell 88SX6081's. I've tried the > mvs driver for that controller, which gave me a bucket load of > errors, and data corruption :( > > Switching back to the standard ATA drivers for that card, I just get > hangs :( - nothing is logged on the console, or syslog when this > happens. Can you provide (with the disks hooked to an ATA/SATA controller and the system not wedged waiting for ZFS I/O) the output from smartctl (you'll probably have to install ports/sysutils/smartmontools) as: smartctl -a /dev/adXX (one command per device) I can review these statistics to see if any of the disks look like they may be misbehaving. It would also help if you could provide dmesg output associated with the ATA/SATA controller which they're hooked to. Thanks! -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |