From owner-freebsd-fs@FreeBSD.ORG Sat Mar 9 17:15:21 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 6C05BC60 for ; Sat, 9 Mar 2013 17:15:21 +0000 (UTC) (envelope-from stephane.lapie@darkbsd.org) Received: from denrei.darkbsd.org (denrei.darkbsd.org [IPv6:2001:41d0:1:f442::1]) by mx1.freebsd.org (Postfix) with ESMTP id CE58F113 for ; Sat, 9 Mar 2013 17:15:20 +0000 (UTC) Received: from denrei.darkbsd.org (localhost [127.0.0.1]) by denrei.darkbsd.org (Postfix) with ESMTP id 75AE4E88 for ; Sat, 9 Mar 2013 18:15:19 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=darkbsd.org; h=message-id :date:from:mime-version:to:subject:references:in-reply-to :content-type; s=selector1; bh=YQ7by/HY1wjz0vFBDcOoHHLKzTk=; b=h XtIJmvkAdQ8NVA1VGw0RTs5wK60W500svJOQjffBTIbb7x2Az/QdJ0luwBTVcEZ6 bLDnQRjNh7zAy1m2GS76QOTQz5fwGOs8E6zx5k0Y++3D+fbMEBvOwFHiS8PEeu9o /rz9p/wBdxdJxed6gRM17rKP7lg6/SN9mHekipQDzU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=darkbsd.org; h=message-id :date:from:mime-version:to:subject:references:in-reply-to :content-type; q=dns; s=selector1; b=R/IoL8TSv+G9IxLa0U2Do6v/uja 8L2qzuMTw8VQavjt5FYoPOOCsPHaP1txCREIlDm7Qpr8c7by7SVOuOSvwMdHpKtw j6Gao/ol983Kwqpz8s+hLDdZjcDt6NgP16kyUTX+pY0hnkc1Uqpq9F3sVYBk6oIm w3T6W65zvbARUKlc= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=darkbsd.org; h= content-type:content-type:in-reply-to:references:subject:subject :mime-version:user-agent:from:from:date:date:message-id:received :received; s=selector1; t=1362849317; bh=V9trAQghPHqibB25khouo7e HxhJx8JjPoTEuVx/phko=; b=TtlB7++GWzF5jQMfwCYobOYor9Jhs1yXiA6fx0t 3B/oT0Btsxja+echg4Og3J7kX3QBj+1WqkA4svn/dQj5LGKkQexc2n1mufbalhYs SVh1N6CB3QUYjZHFKjc7Vt1TPZuq2N+PXgu935nmADbBuxsE34nUN8WKlUUHQV0Z wkGQ= X-Virus-Scanned: amavisd-new at darkbsd.org Received: from denrei.darkbsd.org ([127.0.0.1]) by denrei.darkbsd.org (denrei.darkbsd.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 8Qs0FDBh8N7h for ; Sat, 9 Mar 2013 18:15:17 +0100 (CET) Received: from [IPv6:2001:470:24:42d::42] (archer.yomi.darkbsd.org [IPv6:2001:470:24:42d::42]) (Authenticated sender: darksoul@darkbsd.org) by denrei.darkbsd.org (Postfix) with ESMTPSA id 2BDF4E87 for ; Sat, 9 Mar 2013 18:15:15 +0100 (CET) Message-ID: <513B6E1E.6080805@darkbsd.org> Date: Sun, 10 Mar 2013 02:15:10 +0900 From: Stephane LAPIE User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130106 Thunderbird/17.0.2 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Re: Panic loop on ZFS with 9.1-RELEASE References: <513B58B6.2090903@darkbsd.org> In-Reply-To: <513B58B6.2090903@darkbsd.org> X-Enigmail-Version: 1.4.6 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig1A98E6B6132DA9A790EA46E6" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Mar 2013 17:15:21 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig1A98E6B6132DA9A790EA46E6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Posting a quick update. I ran a "zdb -emm" command to figure out what was going on, and it blew up in my face with an abort trap here : - vdev 0 has 145 metaslabs, which are cleared without any problems. - vdev 1 has 145 metaslabs, but fails in the middle : metaslab 32 offset 20000000000 spacemap 289 free 1.64G segments 19509 maxsize 41.7M freepct 2% metaslab 33 offset 21000000000 spacemap 303 free 11.9G error: zfs: allocating allocated segment(offset=3D2335563722752 size=3D10= 24) Abort trap(core dumped) Converting offset 2335563722752 from earlier kernel panic messages gives : 21fca723000, which matches the broken metaslab found by zdb. Is there anything I can do at this point, using zdb? It just sounds surrealistic I have ONE broken metaslab (seemingly?) and that I can't recover anything... Cheers, On 03/10/2013 12:43 AM, Stephane LAPIE wrote: > Hello list, > > I currently am faced with a sudden death case I can't understand at all= , > and I would be very appreciating of any explanation or assistance :( > > Here is my current kernel version : > FreeBSD 9.1-STABLE FreeBSD 9.1-STABLE #5 r245055: Thu Jan 17 13:12:59 > JST 2013 > darksoul@eirei-no-za.yomi.darkbsd.org:/usr/obj/usr/storage/tech/eirei-n= o-za.yomi.darkbsd.org/usr/src/sys/DARK-2012KERN=20 > amd64 > (Kernel is basically a lightened GENERIC kernel without VESA options an= d > unneeded controllers removed) > > The pool is a set of 3x raidz1 (5 drives), + 2 cache devices + mirrored= > transaction log > > Booting and trying to import the pool is met with : > Solaris(panic): zfs: panic: allocating allocated > segment(offset=3D2335563722752 size=3D1024) > > Booting single mode on my emergency flash card with a base OS and zpool= > import -o readonly=3Don is met with : > panic: solaris assert: zio->io_type !=3D ZIO_TYPE_WRITE || > spa_writeable(spa), file: > /usr/storage/tech/eirei-no-za.yomi.darkbsd.org/usr/src/sys/modules/zfs/= =2E./../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, > line: 2461 > > I tried zpool import -F -f, zpool import -F -f -m after removing the > mirrored transaction log devices, but after 40s of trying to import, it= > just blows up. > > I am currently running "zdb -emm" as per the procedure suggested here := > http://simplex.swordsaint.net/?p=3D199 if only to get some debug inform= ation. > > Thanks in advance for your time. > > Cheers, > > > --=20 > Stephane LAPIE, EPITA SRS, Promo 2005 > "Even when they have digital readouts, I can't understand them." > --MegaTokyo --------------enig1A98E6B6132DA9A790EA46E6 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iF4EAREIAAYFAlE7bh4ACgkQDJ4OK7D3FWSh6AEAjXH57LB79EthHQDPtaJkbLKt VgyGWQoa2mAgw2qPMagBAMvBfS2roNM0mC8eQq/v4mejgGNi5KJ0IvmB2xUTyYzC =H/PJ -----END PGP SIGNATURE----- --------------enig1A98E6B6132DA9A790EA46E6--