From owner-freebsd-bugs@FreeBSD.ORG Wed Dec 29 10:40:10 2010 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D32B91065679 for ; Wed, 29 Dec 2010 10:40:10 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 3C58F8FC1B for ; Wed, 29 Dec 2010 10:40:07 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id oBTAe7bJ037917 for ; Wed, 29 Dec 2010 10:40:07 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id oBTAe7qK037916; Wed, 29 Dec 2010 10:40:07 GMT (envelope-from gnats) Resent-Date: Wed, 29 Dec 2010 10:40:07 GMT Resent-Message-Id: <201012291040.oBTAe7qK037916@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, "Vladimir I. Pushkar" Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 719351065672 for ; Wed, 29 Dec 2010 10:38:03 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (unknown [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id 5FB428FC19 for ; Wed, 29 Dec 2010 10:38:03 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.4/8.14.4) with ESMTP id oBTAc3O3030584 for ; Wed, 29 Dec 2010 10:38:03 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.4/8.14.4/Submit) id oBTAc3vf030583; Wed, 29 Dec 2010 10:38:03 GMT (envelope-from nobody) Message-Id: <201012291038.oBTAc3vf030583@red.freebsd.org> Date: Wed, 29 Dec 2010 10:38:03 GMT From: "Vladimir I. Pushkar" To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: kern/153520: Boot from GPT ZFS root on HP BL460c G1 unstable X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Dec 2010 10:40:10 -0000 >Number: 153520 >Category: kern >Synopsis: Boot from GPT ZFS root on HP BL460c G1 unstable >Confidential: no >Severity: critical >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Wed Dec 29 10:40:06 UTC 2010 >Closed-Date: >Last-Modified: >Originator: Vladimir I. Pushkar >Release: 8.2-PRERELEASE >Organization: Digital Ventures LLC >Environment: FreeBSD temp.digital-ventures.net 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #0: Wed Dec 22 09:51:31 UTC 2010 root@temp.dvdev.org.ua:/usr/obj/usr/src/sys/GENERIC amd64 >Description: FreeBSD 8.2 installed using Fixit# environment on several HP ProLiant BL460c G1 servers with HP SmartArray mirror sometimes does not boot from ZFS pool. Installation done according to http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot with swap volume located on ZFS. There are 2 disks configured on HP SmartArray as RAID1 array. Thus there is one logical device da0 and two GPT partitions: # gpart show => 34 143305853 da0 GPT (68G) 34 128 1 freebsd-boot (64K) 162 143305725 2 freebsd-zfs (68G) # dmesg ciss0: port 0x4000-0x40ff mem 0xfde80000-0xfdefffff,0xfde70000-0xfde77fff irq 18 at device 8.0 on pci11 ciss0: PERFORMANT Transport ciss0: got 2 MSI messages] ciss0: [ITHREAD] da0 at ciss0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 135.168MB/s transfers da0: Command Queueing enabled da0: 69973MB (143305920 512 byte sectors: 255H 32S/T 17562C) # diskinfo -v da0 da0 512 # sectorsize 73372631040 # mediasize in bytes (68G) 143305920 # mediasize in sectors 0 # stripesize 0 # stripeoffset 17562 # Cylinders according to firmware. 255 # Heads according to firmware. 32 # Sectors according to firmware. P688MQ0598 # Disk ident. # pciconf -lv ciss0@pci0:11:8:0: class=0x010400 card=0x3211103c chip=0x3238103c rev=0x00 hdr=0x00 vendor = 'Hewlett-Packard Company' device = 'Smart Array E200/E200i SAS/SATA Controller' class = mass storage subclass = RAID # zfs list NAME USED AVAIL REFER MOUNTPOINT zroot 12,0G 55,0G 548M legacy zroot/home 56K 55,0G 56K /home zroot/storage 21K 30,0G 21K /storage zroot/swap 10G 65,0G 16K - zroot/usr 1,31G 55,0G 760M /usr zroot/usr/obj 20K 55,0G 20K /usr/obj zroot/usr/ports 267M 55,0G 267M /usr/ports zroot/usr/ports/distfiles 20K 55,0G 20K /usr/ports/distfiles zroot/usr/ports/packages 21K 55,0G 21K /usr/ports/packages zroot/usr/src 311M 55,0G 311M /usr/src zroot/var 125M 55,0G 247K /var zroot/var/db 125M 55,0G 121M /var/db zroot/var/db/pkg 3,94M 55,0G 3,94M /var/db/pkg zroot/var/log 215K 55,0G 215K /var/log zroot/var/mail 20K 55,0G 20K /var/mail # md5 /boot/gptzfsboot MD5 (/boot/gptzfsboot) = fd31f87e1c8e2bb4fa06b89658c63d06 # zdb -uuu zroot Uberblock magic = 0000000000bab10c version = 15 txg = 20726 guid_sum = 3529677120116096247 timestamp = 1293618442 UTC = Wed Dec 29 12:27:22 2010 rootbp = [L0 DMU objset] 800L/200P DVA[0]=<0:1200ee400:200> DVA[1]=<0:3803ec200:200> DVA[2]=<0:5c0005c00:200> fletcher4 lzjb LE contiguous birth=20726 fill=245 cksum=c37f85b6c:4b1d45d93d8:eb0f06388e48:1f34f5d644dceb Sometimes, after high disk load (e.g. buildworld) followed by reboot we got: error 1 lba 32 error 1 lba 1 No ZFS pools located, can't boot But after some numbers of reboots we can normally boot... >How-To-Repeat: 1. Install 8.2-RC1 amd64 according to http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot 2. reboot 3. rebuild/install world && kernel 4. reboot >Fix: >Release-Note: >Audit-Trail: >Unformatted: