From owner-freebsd-fs@FreeBSD.ORG Fri Aug 7 07:43:41 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49CD71065678 for ; Fri, 7 Aug 2009 07:43:41 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206049004.chello.pl [87.206.49.4]) by mx1.freebsd.org (Postfix) with ESMTP id 8E8158FC2A for ; Fri, 7 Aug 2009 07:43:40 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id E002845C9F; Fri, 7 Aug 2009 09:43:38 +0200 (CEST) Received: from localhost (pjd-w.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id CD88145C8A; Fri, 7 Aug 2009 09:43:33 +0200 (CEST) Date: Fri, 7 Aug 2009 09:44:00 +0200 From: Pawel Jakub Dawidek To: Boris Kochergin Message-ID: <20090807074400.GB1607@garage.freebsd.pl> References: <4A78AA71.9050107@acm.poly.edu> <4A78AFB2.10103@acm.poly.edu> <20090805115621.GG1784@garage.freebsd.pl> <4A798A12.4070408@acm.poly.edu> <20090807073738.GA1607@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="7ZAtKRhVyVSsbBD2" Content-Disposition: inline In-Reply-To: <20090807073738.GA1607@garage.freebsd.pl> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=4.5 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS RAID-Z panic on vdev failure + subsequent panics and hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Aug 2009 07:43:41 -0000 --7ZAtKRhVyVSsbBD2 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Aug 07, 2009 at 09:37:38AM +0200, Pawel Jakub Dawidek wrote: > On Wed, Aug 05, 2009 at 09:33:06AM -0400, Boris Kochergin wrote: > > Fatal trap 12: page fault while in kernel mode > > fault virtual address =3D 0xffffffffffffffe9 > > fault code =3D supervisor read data, page not present > > instruction pointer =3D 0x20:0xffffffff8103a9e7 > > stack pointer =3D 0x28:0xffffff8077f26430 > > frame pointer =3D 0x28:0xffffff8077f26500 > > code segment =3D base 0x0, limit 0xfffff, type 0x1b > > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > > current process =3D 972 (cp) > [...] > > /usr/src/sys/amd64/amd64/trap.c:494 > > #11 0xffffffff80854d73 in calltrap () at=20 > > /usr/src/sys/amd64/amd64/exception.S:224 > > #12 0xffffffff8103a9e7 in arc_evict (state=3DVariable "state" is not=20 > > available. > > ) at=20 > > /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/z= fs/arc.c:1489 >=20 > Could you tell me what do you have at this line in your source? I don't > think you use HEAD... What exact FreeBSD version are you using? You already gave version number in your first mail, sorry about that. 8.0-BETA2 should be very close to HEAD (or it actually was HEAD), so I guess this is the code we are looking at: 1488: /* "lookahead" for better eviction candidate */ 1489: if (recycle && ab->b_size !=3D bytes && 1490: ab_prev && ab_prev->b_size =3D=3D bytes) 1491: continue; If 'ab' is corrupted it should panic earlier, so it seems ab_prev is corrupted, can you see what it points to in gdb? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --7ZAtKRhVyVSsbBD2 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFKe9tAForvXbEpPzQRAoYQAJ93SwrZRKfO+oIxSIHSGoXPC4MSvQCeKp0b 4R79PwGqH+NIW3oGUYhD1mM= =Fs3k -----END PGP SIGNATURE----- --7ZAtKRhVyVSsbBD2--