From owner-freebsd-fs@FreeBSD.ORG Sun Nov 18 22:20:01 2012 Return-Path: Delivered-To: freebsd-fs@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 875E02C5 for ; Sun, 18 Nov 2012 22:20:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 5CF258FC08 for ; Sun, 18 Nov 2012 22:20:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id qAIMK1h5061510 for ; Sun, 18 Nov 2012 22:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id qAIMK1oY061509; Sun, 18 Nov 2012 22:20:01 GMT (envelope-from gnats) Date: Sun, 18 Nov 2012 22:20:01 GMT Message-Id: <201211182220.qAIMK1oY061509@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org Cc: From: Peter Wullinger Subject: Re: kern/153520: [zfs] Boot from GPT ZFS root on HP BL460c G1 unstable. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: Peter Wullinger List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Nov 2012 22:20:01 -0000 The following reply was made to PR kern/153520; it has been noted by GNATS. From: Peter Wullinger To: bug-followup@FreeBSD.org Cc: Subject: Re: kern/153520: [zfs] Boot from GPT ZFS root on HP BL460c G1 unstable. Date: Sun, 18 Nov 2012 23:10:42 +0100 I see this too on two identical HP Proliant 320 DL G6 with 9-STABLE. The machine usually needs some nudging in the form of warm restarts to boot the operating system. =3D=3D bootloader output =3D=3D error 1 lba 32 error 1 lba 1 No ZFS pools located, can't boot =3D=3D bootloader output =3D=3D =3D=3D gpart show =3D=3D =3D> 34 488326973 da0 GPT (232G) 34 128 1 freebsd-boot (64k) 162 67108864 2 freebsd-swap (32G) 67109026 421217981 3 freebsd-zfs [bootme] (200G) =3D=3D gpart show =3D=3D Root is on a hardware-mirror provided by the machine's HPQ Smart Array P410i The other 6 drives are configured as JBOD with a raidz2 data pool (not shown here) =3D=3D zpool status rpool =3D=3D zpool status rpool pool: rpool state: ONLINE scan: scrub repaired 0 in 0h12m with 0 errors on Wed Nov 7 04:47:21 2012 config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 da0p3 ONLINE 0 0 0 errors: No known data errors =3D=3D zpool status rpool =3D=3D =3D=3D zdb =3D=3D rpool: version: 28 name: 'rpool' state: 0 txg: 22695230816 pool_guid: 16981309850887562666 hostid: 1031366389 hostname: '...' vdev_children: 1 vdev_tree: type: 'root' id: 0 guid: 16981309850887562666 children[0]: type: 'disk' id: 0 guid: 6716485486554561877 path: '/dev/da0p3' phys_path: '/dev/da0p3' whole_disk: 0 metaslab_array: 23 metaslab_shift: 31 ashift: 9 asize: 215658790912 is_log: 0 DTL: 65 =3D=3D zdb =3D=3D =3D=3D dmesg =3D=3D Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.1-PRERELEASE #3 r242394: Wed Oct 31 13:15:48 CET 2012 src@...:/usr/obj/usr/src/sys/ML350 amd64 CPU: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz (2000.12-MHz K8-class = CPU) Origin =3D "GenuineIntel" Id =3D 0x106a5 Family =3D 0x6 Model =3D 0x1a= Stepping =3D 5 Features=3D0xbfebfbff Features2=3D0x9ce3bd AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant, performance statistics real memory =3D 6442450944 (6144 MB) avail memory =3D 6177263616 (5891 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20= 110527/tbfadt-638) ACPI Warning: Invalid length for Pm2ControlBlock: 32, using default 8 (2011= 0527/tbfadt-638) ioapic1 irqs 24-47 on motherboard ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 450 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 Event timer "HPET3" frequency 14318180 Hz quality 440 atrtc0: port 0x70-0x71 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0 pcib0: on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci4: on pcib1 ciss0: port 0x4000-0x40ff mem 0xfb000000-0xfb3fffff,= 0xfaff0000-0xfaff0fff irq 28 at device 0.0 on pci4 ciss0: PERFORMANT Transport pcib2: at device 2.0 on pci0 pci23: on pcib2 pcib3: at device 3.0 on pci0 pci5: on pcib3 pcib4: at device 4.0 on pci0 pci8: on pcib4 pcib5: at device 5.0 on pci0 pci11: on pcib5 pcib6: at device 6.0 on pci0 pci24: on pcib6 pcib7: at device 7.0 on pci0 pci14: on pcib7 ciss1: port 0x5000-0x50ff mem 0xfb800000-0xfbbfffff,0= xfb7f0000-0xfb7f0fff irq 30 at device 0.0 on pci14 ciss1: PERFORMANT Transport pcib8: at device 8.0 on pci0 pci25: on pcib8 pcib9: at device 9.0 on pci0 pci17: on pcib9 pcib10: at device 10.0 on pci0 pci20: on pcib10 mpt0: port 0x6000-0x60ff mem 0xfbff0000-0xfbff3= fff,0xfbfe0000-0xfbfeffff irq 33 at device 0.0 on pci20 mpt0: MPI Version=3D1.5.16.0 mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 ) mpt0: 0 Active Volumes (2 Max) mpt0: 0 Hidden Drive Members (10 Max) pci0: at device 20.0 (no driver att= ached) pci0: at device 20.1 (no driver att= ached) pci0: at device 20.2 (no driver att= ached) pcib11: at device 28.0 on pci0 pci2: on pcib11 pcib12: at device 0.0 on pci2 pci3: on pcib12 bge0: mem 0= xfaef0000-0xfaefffff,0xfaee0000-0xfaeeffff irq 16 at device 4.0 on pci3 bge0: CHIP ID 0x00009003; ASIC REV 0x09; CHIP REV 0x90; PCI-X 133 MHz miibus0: on bge0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000ba= seT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge0: Ethernet address: 00:25:b3:ad:a5:8c bge1: mem 0= xfaed0000-0xfaedffff,0xfaec0000-0xfaecffff irq 17 at device 4.1 on pci3 bge1: CHIP ID 0x00009003; ASIC REV 0x09; CHIP REV 0x90; PCI-X 133 MHz miibus1: on bge1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000ba= seT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge1: Ethernet address: 00:25:b3:ad:a5:8d uhci0: port 0x1000-0x101f irq = 20 at device 29.0 on pci0 usbus0 on uhci0 uhci1: port 0x1020-0x103f irq = 23 at device 29.1 on pci0 usbus1 on uhci1 uhci2: port 0x1040-0x105f irq = 22 at device 29.2 on pci0 usbus2 on uhci2 uhci3: port 0x1060-0x107f irq = 23 at device 29.3 on pci0 usbus3 on uhci3 ehci0: mem 0xfabf0000-0xfa= bf03ff irq 20 at device 29.7 on pci0 usbus4: EHCI version 1.0 usbus4 on ehci0 pcib13: at device 30.0 on pci0 pci1: on pcib13 vgapci0: port 0x3000-0x30ff mem 0xf0000000-0xf7fff= fff,0xfadf0000-0xfadfffff irq 23 at device 3.0 on pci1 pci1: at device 4.0 (no driver attached) pci1: at device 4.2 (no driver attached) uhci4: port 0x3800-0x381f irq 22 at device = 4.4 on pci1 usbus5 on uhci4 ipmi0: mem 0xfacf0000-0xfacf00ff irq 21 at device 4= =2E6 on pci1 ipmi0: using KSC interface isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x10c0-0x10c7,0x10c8-0x10cb,= 0x10d0-0x10d7,0x10d8-0x10db,0x10e0-0x10ef,0x10f0-0x10ff irq 17 at device 31= =2E5 on pci0 ata2: at channel 0 on atapci0 ata3: at channel 1 on atapci0 acpi_tz0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] qpi0: on motherboard ipmi1: on isa0 device_attach: ipmi1 attach returned 16 ipmi1: on isa0 device_attach: ipmi1 attach returned 16 orm0: at iomem 0xc0000-0xcafff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 coretemp0: on cpu0 est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est0 attach returned 6 p4tcc0: on cpu0 coretemp1: on cpu1 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est1 attach returned 6 p4tcc1: on cpu1 coretemp2: on cpu2 est2: on cpu2 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est2 attach returned 6 p4tcc2: on cpu2 coretemp3: on cpu3 est3: on cpu3 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est3 attach returned 6 p4tcc3: on cpu3 ZFS filesystem version 5 ZFS storage pool version 28 Timecounters tick every 10.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 480Mbps High Speed USB v2.0 usbus5: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 (probe0:ciss0:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe0:ciss0:0:0:0): CAM status: SCSI Status Error (probe0:ciss0:0:0:0): SCSI status: Check Condition (probe0:ciss0:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe0:ciss0:0:0:0): Error 22, Unretryable error ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 (probe1:ciss0:0:1:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe1:ciss0:0:1:0): CAM status: SCSI Status Error (probe1:ciss0:0:1:0): SCSI status: Check Condition (probe1:ciss0:0:1:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe1:ciss0:0:1:0): Error 22, Unretryable error ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: <0x103c> at usbus5 uhub5: <0x103c UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5 (probe2:ciss0:0:2:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe2:ciss0:0:2:0): CAM status: SCSI Status Error (probe2:ciss0:0:2:0): SCSI status: Check Condition (probe2:ciss0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe2:ciss0:0:2:0): Error 22, Unretryable error ipmi0: IPMI device rev. 1, firmware rev. 2.07, version 2.0 unknown: FAILURE - INQUIRY ILLEGAL REQUEST asc=3D0x24 ascq=3D0x00=20 ipmi0: Number of channels 0 (probe3:ciss0:0:3:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe3:ciss0:0:3:0): CAM status: SCSI Status Error (probe3:ciss0:0:3:0): SCSI status: Check Condition (probe3:ciss0:0:3:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe3:ciss0:0:3:0): Error 22, Unretryable error ipmi0: Attached watchdog (probe4:ciss0:0:4:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe4:ciss0:0:4:0): CAM status: SCSI Status Error (probe4:ciss0:0:4:0): SCSI status: Check Condition (probe4:ciss0:0:4:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe4:ciss0:0:4:0): Error 22, Unretryable error (probe5:ciss0:0:5:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe5:ciss0:0:5:0): CAM status: SCSI Status Error (probe5:ciss0:0:5:0): SCSI status: Check Condition (probe5:ciss0:0:5:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe5:ciss0:0:5:0): Error 22, Unretryable error (probe6:ciss0:0:6:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0=20 (probe6:ciss0:0:6:0): CAM status: SCSI Status Error (probe6:ciss0:0:6:0): SCSI status: Check Condition (probe6:ciss0:0:6:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command= operation code) (probe6:ciss0:0:6:0): Error 22, Unretryable error da0 at ciss0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device=20 da0: 135.168MB/s transfers da0: Command Queueing enabled da0: 238440MB (488327040 512 byte sectors: 255H 32S/T 59844C) da1 at ciss0 bus 0 scbus0 target 1 lun 0 da1: Fixed Direct Access SCSI-5 device=20 da1: 135.168MB/s transfers da1: Command Queueing enabled da1: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) da2 at ciss0 bus 0 scbus0 target 2 lun 0 da2: Fixed Direct Access SCSI-5 device=20 da2: 135.168MB/s transfers da2: Command Queueing enabled da2: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) da3 at ciss0 bus 0 scbus0 target 3 lun 0 da3: Fixed Direct Access SCSI-5 device=20 da3: 135.168MB/s transfers da3: Command Queueing enabled da3: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) da4 at ciss0 bus 0 scbus0 target 4 lun 0 da4: Fixed Direct Access SCSI-5 device=20 da4: 135.168MB/s transfers da4: Command Queueing enabled da4: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) da5 at ciss0 bus 0 scbus0 target 5 lun 0 da5: Fixed Direct Access SCSI-5 device=20 da5: 135.168MB/s transfers da5: Command Queueing enabled da5: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) da6 at ciss0 bus 0 scbus0 target 6 lun 0 da6: Fixed Direct Access SCSI-5 device=20 da6: 135.168MB/s transfers da6: Command Queueing enabled da6: 953837MB (1953459632 512 byte sectors: 255H 32S/T 65535C) sa0 at ciss1 bus 32 scbus3 target 3 lun 0 sa0: Removable Sequential Access SCSI-5 device=20 sa0: 135.168MB/s transfers sa0: Command Queueing enabled sa1 at mpt0 bus 0 scbus4 target 5 lun 0 sa1: Removable Sequential Access SCSI-5 device=20 sa1: 300.000MB/s transfers sa1: Command Queueing enabled cd0 at ata3 bus 0 scbus6 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device=20 cd0: 3.300MB/s transfers cd0: Attempt to query device size failed: NOT READY, Medium not present - t= ray closed ch0 at mpt0 bus 0 scbus4 target 5 lun 1 ch0: Removable Changer SCSI-5 device=20 ch0: 300.000MB/s transfers ch0: Command Queueing enabled SMP: AP CPU #3 Launched! ch0: 8 slots, 1 drive, 1 picker, 0 portals SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! Timecounter "TSC-low" frequency 15625916 Hz quality 1000 GEOM: da3: the primary GPT table is corrupt or invalid. GEOM: da3: using the secondary instead -- recovery strongly advised. GEOM: da4: the primary GPT table is corrupt or invalid. GEOM: da4: using the secondary instead -- recovery strongly advised. GEOM: da5: the primary GPT table is corrupt or invalid. GEOM: da5: using the secondary instead -- recovery strongly advised. GEOM: da6: the primary GPT table is corrupt or invalid. GEOM: da6: using the secondary instead -- recovery strongly advised. Root mount waiting for: usbus5 usbus4 usbus3 usbus2 usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 usbus4 ugen5.2: at usbus5 ukbd0: on usbus5 kbd2 at ukbd0 ums0: on usbus5 ums0: 3 buttons and [XY] coordinates ID=3D0 Root mount waiting for: usbus4 Root mount waiting for: usbus4 uhub4: 8 ports with 8 removable, self powered Trying to mount root from zfs:rpool []... ugen3.2: at usbus3 =3D=3D dmesg =3D=3D --=20 Erfahrung hei=DFt gar nichts. Man kann seine Sache auch 35 Jahre schlecht machen. =20 -- Kurt Tucholsky