From owner-freebsd-stable@FreeBSD.ORG Tue Aug 6 21:26:56 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 62A698E3; Tue, 6 Aug 2013 21:26:56 +0000 (UTC) (envelope-from jdavidlists@gmail.com) Received: from mail-ob0-x22c.google.com (mail-ob0-x22c.google.com [IPv6:2607:f8b0:4003:c01::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 205412613; Tue, 6 Aug 2013 21:26:56 +0000 (UTC) Received: by mail-ob0-f172.google.com with SMTP id er7so2076727obc.17 for ; Tue, 06 Aug 2013 14:26:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=I2bgZJkgdNj8rpd2Hh6QYdu9JxeHyvtEuTQlu995JN8=; b=oc1aFA5mygs25udofzufCWCWpVfN26SqAqd9upiFL9RK6wdjjIRmZDP1wUeuJDF/gK bxCFThtnHhtFTM72E16zvd+y/Yih8sXG0Qc7Cr01xbxTnICZccSD49QV/B34UhfLWcKS ECOnQkKuI6TDn3ipc6TZ3wYqPuBVhYBAlX9lHXIPfFHzAEVjyD03uYximlKFK1Sdlmrq pPDEYFogGZhZ/oNseUhnzIZGK7eEMEeYcJs6CMnhSKjXeDs1RgwXIVo9cQcpqrfw0Ixh 0dDnawvkqy6nVwtR4vHXESXemCadlcQDad89a4nEAKDz3A4T4rmaHnRPfIAZWNFq5Pan 3/4A== MIME-Version: 1.0 X-Received: by 10.42.215.11 with SMTP id hc11mr19344icb.9.1375824415339; Tue, 06 Aug 2013 14:26:55 -0700 (PDT) Sender: jdavidlists@gmail.com Received: by 10.42.150.196 with HTTP; Tue, 6 Aug 2013 14:26:55 -0700 (PDT) In-Reply-To: <5200C7A3.3070403@yandex.ru> References: <51FD5709.7050306@FreeBSD.org> <5200C7A3.3070403@yandex.ru> Date: Tue, 6 Aug 2013 17:26:55 -0400 X-Google-Sender-Auth: FSwO69iFRn4eX84cjays_onulsk Message-ID: Subject: Re: Problem with zfsloader on 9.2-BETA2 From: J David To: "Andrey V. Elsukov" Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: freebsd-stable@freebsd.org, Andriy Gapon X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2013 21:26:56 -0000 On Tue, Aug 6, 2013 at 5:53 AM, Andrey V. Elsukov wrote= : > looking to your `zfs status` output and this, we can see, that GPT > wasn't detected on most of disks. Can you try to boot with this loader: > http://people.freebsd.org/~ae/zfsloader > It's from 10-CURRENT and was build with -DPART_DEBUG, so you will see > some additional debug messages while booting. OK, some of the output scrolls too fast=85 since it can't load the filesystem it doesn't know to copy to serial console. But looking at the tail end, it's a lot of this: gpt_checkhdr: invalid entry size or number of entries gpt_checkhdr: invalid entry size or number of entries ptable_open: PMBR detected At least five sets of those, so I assume they are for at least disk2 - disk 7. Unfortunately I can't catch the output for disks 1 and 2, which are the only two bootable disks. :( Here's the bootparttest output: $ sudo ./bootparttest da0 GEOM provider "da0" opened Mediasize: 32296140800 Bytes (63078400 sectors) Sectorsize: 512 Bytes da0: read 1 blocks from the offset 0 [+0] da0: read 1 blocks from the offset 1 [+0] ptable_open: PMBR detected da0: read 1 blocks from the offset 1 [+0] da0: read 32 blocks from the offset 2 [+0] da0: read 1 blocks from the offset 63078399 [+0] ptable_gptread: new GPT partition added ptable_gptread: new GPT partition added ptable_gptread: new GPT partition added Partition table detected: GPT da0p1: FreeBSD boot 64k da0p2: FreeBSD swap 2048M da0p3: FreeBSD ZFS 28G GEOM provider "da1" opened Mediasize: 32000000000 Bytes (62500000 sectors) Sectorsize: 512 Bytes da1: read 1 blocks from the offset 0 [+0] da1: read 1 blocks from the offset 1 [+0] ptable_open: PMBR detected da1: read 1 blocks from the offset 1 [+0] da1: read 32 blocks from the offset 2 [+0] da1: read 1 blocks from the offset 62499999 [+0] ptable_gptread: new GPT partition added ptable_gptread: new GPT partition added ptable_gptread: new GPT partition added Partition table detected: GPT da1p1: FreeBSD boot 64k da1p2: FreeBSD swap 2048M da1p3: FreeBSD ZFS 27G $ sudo ./bootparttest da2 GEOM provider "da2" opened Mediasize: 1000204886016 Bytes (1953525168 sectors) Sectorsize: 512 Bytes da2: read 1 blocks from the offset 0 [+0] da2: read 1 blocks from the offset 1 [+0] ptable_open: PMBR detected da2: read 1 blocks from the offset 1 [+0] gpt_checkhdr: invalid entry size or number of entries da2: read 1 blocks from the offset 1953525167 [+0] gpt_checkhdr: invalid entry size or number of entries Partition table detected: None (Output for da3 - da7 are identical to da2.) So I'm guessing something doesn't like the metadata on the data drives. This is a raidz2, so I can certainly offline the disks one by one to rebuild the partition tables, though that'll take ages; the I/O performance of this system is awful. But I do wonder why the zfsloader from 8.4 can handle whatever's going on in there and 9.2 can't. Thanks!