From owner-freebsd-fs@FreeBSD.ORG Tue Aug 4 19:50:54 2009 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8BA661065DF0; Tue, 4 Aug 2009 19:50:54 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206049004.chello.pl [87.206.49.4]) by mx1.freebsd.org (Postfix) with ESMTP id C2CFA8FC1C; Tue, 4 Aug 2009 19:50:52 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0309945C89; Tue, 4 Aug 2009 21:50:50 +0200 (CEST) Received: from localhost (chello087206049004.chello.pl [87.206.49.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 0648445C8C; Tue, 4 Aug 2009 21:50:45 +0200 (CEST) Date: Tue, 4 Aug 2009 21:51:12 +0200 From: Pawel Jakub Dawidek To: Juergen Unger Message-ID: <20090804195112.GB2181@garage.freebsd.pl> References: <4A6E06E6.9030300@mail.zedat.fu-berlin.de> <4A6EC9E2.5070200@icyb.net.ua> <20090729084723.GD1586@garage.freebsd.pl> <20090802092714.GA5813@jpru.ffm.jpru.de> <20090802093016.GB3071@garage.freebsd.pl> <20090803203226.GE5813@jpru.ffm.jpru.de> <20090804073416.GA4479@garage.freebsd.pl> <20090804075329.GI5813@jpru.ffm.jpru.de> <20090804094950.GD4479@garage.freebsd.pl> <20090804095648.GL5813@jpru.ffm.jpru.de> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Pd0ReVV5GZGQvF3a" Content-Disposition: inline In-Reply-To: <20090804095648.GL5813@jpru.ffm.jpru.de> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.6 required=4.5 tests=BAYES_00,RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@FreeBSD.org, "O. Hartmann" , freebsd-current@FreeBSD.org, spambox@haruhiism.net, Andriy Gapon Subject: Re: zfs: Fatal trap 12: page fault while in kernel mode X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Aug 2009 19:50:55 -0000 --Pd0ReVV5GZGQvF3a Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Aug 04, 2009 at 11:56:48AM +0200, Juergen Unger wrote: > On Tue, Aug 04, 2009 at 11:49:50AM +0200, Pawel Jakub Dawidek wrote: > > > testbox# sysctl debug.kdb.enter=3D1 > > > KDB: enter: sysctl debug.kdb.enter > > > [thread pid 11635 tid 100472 ] > > > Stopped at kdb_enter+0x3a: movl $0,kdb_why > > > db> show lock 0x87aac290 > > > class: sx > > > name: dp->dp_config_rwlock > > > state: XLOCK: 0x879e8480 (tid 100130, pid 172, "txg_thread_enter") > > > waiters: shared > > > db>=20 > >=20 > > Could you also try something like the following from DDB: > >=20 > > x/bx 0x879ad8a0,52 >=20 > db> x/bx 0x879ad8a0,52 > 0x879ad8a0: 82 1a 4b 87 0 0 71 2 0 0 0 0 0 0 0= 0 > 0x879ad8b0: 1 0 0 0 91 1a 4b 87 4 0 0 0 40 92 c= b 87 > 0x879ad8c0: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0= 0 > 0x879ad8d0: 0 0 0 0 9 1f 4b 87 0 0 71 2 0 0 0= 0 > 0x879ad8e0: 0 0 0 0 40 92 cb 87 e8 0 0 0 c8 0 0= 0 > 0x879ad8f0: a8 bb > db> This is dump of ZFS-specific rrwlock that some threads are waiting for. We can see here that thread owning the lock is 0x87cb9240, which is pid 86397 (zfs recv process). I don't think we will be able to gather more info from here. I'm builing HEAD at the moment and hopefully will be able to reproduce it. Thanks for all the info. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --Pd0ReVV5GZGQvF3a Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFKeJEwForvXbEpPzQRAvC0AJ99Mac7u8i/9Z+IkHYlX5G4s7szUgCgplRj FK7rLRYAfuP2QGxN8WI9RXM= =sk/E -----END PGP SIGNATURE----- --Pd0ReVV5GZGQvF3a--