From owner-freebsd-fs@freebsd.org Sat Aug 29 10:02:36 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD0919C5B00 for ; Sat, 29 Aug 2015 10:02:36 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from anubis.delphij.net (anubis.delphij.net [64.62.153.212]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 94E581583 for ; Sat, 29 Aug 2015 10:02:36 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from Xins-MBP.home.us.delphij.net (unknown [IPv6:2601:646:8f00:8a91:f980:c96f:9a9:6dc9]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id C741F1E53F; Sat, 29 Aug 2015 03:02:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1440842556; x=1440856956; bh=UaMtOSL7piIPw56grsr6dG3h5Ze+nCNXgqvJeWgfnks=; h=Subject:To:References:From:Date:In-Reply-To; b=to3amZ1IoKX9jgXboQ+8XIElkjUdgxOgIUCWdPO4vKqYcgGY938HRq9+PXlt82cIc MUgDlOoExPcKxk/dXY9n5UrI1fcFI/TupZbPGQARICn1J4bOIufVrzP1a0mSR/ogc1 05jnPhRw2WsU7ARBMNP0jzK+S304w8s/C/EHcydw= Subject: Re: Panic in zfs_blkptr_verify() To: Peter Jeremy , freebsd-fs@freebsd.org References: <20150829062743.GA2996@server.rulingia.com> From: Xin Li X-Enigmail-Draft-Status: N1110 Message-ID: <55E18337.5030104@delphij.net> Date: Sat, 29 Aug 2015 03:02:31 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <20150829062743.GA2996@server.rulingia.com> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="nKq141d47nb6RwVjLWKTW7fpQOoopovQb" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Aug 2015 10:02:36 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --nKq141d47nb6RwVjLWKTW7fpQOoopovQb Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 8/28/15 23:27, Peter Jeremy wrote: > I'm trying to upgrade my main (amd64) server from 10-stable r276177 to > r287251 but the new kernel consistently panics: >=20 > Unfortunately, I'm not sure how to resolve this. zfs_blkptr_verify() w= as > MFH in r277582 so the checks don't exist in my old kernel. This means = it > could be a problem with one of my pools, rather than a software bug. B= ut > there's no information in the panic that would let me identify where th= e > dodgy offset was found other than it's DVA 0 of some undefined blkptr_t= =2E Unfortunately, I have to say that the pool may be beyond repair, and you may have to try importing it only and recreate the pool, or destroy it and restore from a backup. One thing worth trying is to set vfs.zfs.recover=3D1 from loader, and import the pool read-only. If this could succeed, you can migrate the as much data as possible out of the pool. You may also want to try zpool import -F (and -F -X if -F didn't work) to see if discarding a few latest txgs would be helpful. > I've tried setting dumpon prior to this point (and I can see that > dumpdev is set) but I don't get a crashdump. Since this is my primary That's probably not very useful because the panic is an assertion that we know the block pointer is bad, and from the backtrace, it looks like it was the toplevel dataset. Cheers, --nKq141d47nb6RwVjLWKTW7fpQOoopovQb Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJV4YM7AAoJEJW2GBstM+nsbeIP/37GDaxtS2wI+WjqFQReYdpv yGGKrA5jpFV0TxaN4dSyEVb3nm1An8rPYwxb6MGRvZSGuF+PadBkXrm/gzKWhRx0 ybg1YK0p5uP3mb1SWsUuWfdGtLOmJKSrVh4QNdI/kNws6oW9rjkKMOvnfzVVol+A 4L+mjLIweeNTIzEs9rY6EYykStd7Ly7oWiS44znqpzBZZom8nq3E1JU84vFGTHiB IHCjoH81p4nVH2jnxkRYGt0dkQTvXPjWTvnhWvuvigwWwNUNiduMB/u6MBPYdBu5 V5I9AHboLZfD/Sx5A79c84x7TDyjmDCY/9MOYNkwBJ/erBpH5GSXYwibI9MS/HNl rhrY/4wnNH/1w+0qyo0iFfWHjvd2PPa1fOFX9rQ8wyO4/P8pdHZTZrXU9FiWSXna VSavxQRqLgvf9XSQzhwHQVVhoBOYkkjWC7MOfDx31Rv+1uUdkfqGyVX+nE/Qu5YF +qJdlEPJjvzQPNiMLxZtX3qAezTcP9HbUaBS962eV5WDRw5Jeupum6qFXlMOg2Rm b6pesy6pkV58VIxU4MdY5ZD4i/cdY+AOPxSrAzWAFCROfkvczbjApKhLDyuNnuMX Sv0SnkNnmEwIvZ5RYOGhQ8k68V6j3VAhoexY+EBo9FnxPR5NruXMgQ7/ctn0jLfR Qn1TZKYTQbHRf0D9EI6n =P/78 -----END PGP SIGNATURE----- --nKq141d47nb6RwVjLWKTW7fpQOoopovQb--