From owner-freebsd-bugs@FreeBSD.ORG Thu Jul 15 23:00:08 2010 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0400E1065686 for ; Thu, 15 Jul 2010 23:00:07 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 29DDD8FC2B for ; Thu, 15 Jul 2010 23:00:05 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id o6FN05Tt091743 for ; Thu, 15 Jul 2010 23:00:05 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id o6FN04lf091742; Thu, 15 Jul 2010 23:00:05 GMT (envelope-from gnats) Resent-Date: Thu, 15 Jul 2010 23:00:05 GMT Resent-Message-Id: <201007152300.o6FN04lf091742@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Emil Smolenski Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 74F5A1065675 for ; Thu, 15 Jul 2010 22:58:45 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id 63BB68FC14 for ; Thu, 15 Jul 2010 22:58:45 +0000 (UTC) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.3/8.14.3) with ESMTP id o6FMwjBq026819 for ; Thu, 15 Jul 2010 22:58:45 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.3/8.14.3/Submit) id o6FMwjPX026818; Thu, 15 Jul 2010 22:58:45 GMT (envelope-from nobody) Message-Id: <201007152258.o6FMwjPX026818@www.freebsd.org> Date: Thu, 15 Jul 2010 22:58:45 GMT From: Emil Smolenski To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: misc/148655: [zfs] Booting from a degraded raidz no longer works in 8-STABLE [regression] X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Jul 2010 23:00:08 -0000 >Number: 148655 >Category: misc >Synopsis: [zfs] Booting from a degraded raidz no longer works in 8-STABLE [regression] >Confidential: no >Severity: serious >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Thu Jul 15 23:00:04 UTC 2010 >Closed-Date: >Last-Modified: >Originator: Emil Smolenski >Release: FreeBSD 8-STABLE >Organization: >Environment: FreeBSD 8.0-STABLE i386 >Description: After upgrade 8.0-RELEASE system to 8-STABLE, the machine no longer boots from degraded raidz. Booting stops with a message: error 1 lba 32 error 1 lba 1 Booting from a non-degraded raidz still works fine. After encountering a problem I prepared an isolated (qemu) environment to test this issue. In 8.0-RELEASE everything works fine. I can remove one disk and the system boots. My configuration: - gpart config: => 34 6291389 ad0 GPT (3.0G) 34 128 1 freebsd-boot (64K) 162 6291261 2 freebsd-zfs (3.0G) => 34 6291389 ad1 GPT (3.0G) 34 128 1 freebsd-boot (64K) 162 6291261 2 freebsd-zfs (3.0G) => 34 6291389 ad3 GPT (3.0G) 34 128 1 freebsd-boot (64K) 162 6291261 2 freebsd-zfs (3.0G) (with GPT labeling) - zpool (v13) config: NAME STATE READ WRITE CKSUM bijou ONLINE 0 0 0 raidz1 ONLINE 0 0 0 gpt/bijou0 ONLINE 0 0 0 gpt/bijou1 ONLINE 0 0 0 gpt/bijou2 ONLINE 0 0 0 - loader.conf: zfs_load="YES" vfs.root.mountfrom="zfs:bijou" - rc.conf: zfs_enable="YES" After upgrade to 8-STABLE (world and kernel) and BEFORE reinstalling bootcode booting from degraded raidz no longer works: http://img28.imageshack.us/img28/9118/raidz8stable.png . Note: the installworld upgrades /boot/loader. After reinstalling bootcode: gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ad0 gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ad1 gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ad3 booting stops with a message: error 1 lba 32 error 1 lba 1 ( http://img17.imageshack.us/img17/36/raidz8stablereinstalled.png ) Upgrading zpool to v14 doesn't help. I think this is serious regression -- disks often fail during reboot. The whole idea of raidz doesn't make any sense. >How-To-Repeat: 1. Have FreeBSD 8.0-RELEASE "RootOnZFS" raidz1 installation (like the one described here: http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/RAIDZ1 ) 2. Upgrade to 8-STABLE. 3. Physically remove one disk from raidz. 4. Boot the machine. >Fix: >Release-Note: >Audit-Trail: >Unformatted: