Date: Thu, 18 Apr 2024 09:37:43 -0400 From: mike tancsa <mike@sentex.net> To: FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org> Subject: zfs boot error on mirrored drive Message-ID: <82761f2b-475f-43ab-b045-95c60c330db7@sentex.net>
next in thread | raw e-mail | index | archive | help
I have a strange bootup issue on a test box that I just updated from 11, to 12 and now RELENG13. Its a simple mirror. But if I boot up with ada0, I get an error and cannot boot further. Where as if I boot up with ada1, I get some errors and then proceeds to boot normally. For one thing, I dont get where zbackup1 is coming from. The pool I boot from is zroot ?!? Where would that reference be stored ? I think ada0 was part of another pool long ago (zbackup1). Here is the error when booting from disk 0 BIOS drive C: is disk0 BIOS drive D: is disk1 zio_read error: 5 zio_read error: 5 ZFS: i/o error - all block copies unavailable ZFS: can't read MOS of pool zbackup1 ZFS: can't find pool by guid Can't find /boot/zfsloader Can't find /boot/loader Can't find /boot/kernel/kernel FreeBSD/x86 boot Default: /boot/kernel/kernel boot: Here are the messages when booting from disk 1 Loading /boot/d| disk1 zio_read error: 5 zio_read error: 5 ZFS: i/o error - all block copies unavailable ZFS: can't read MOS of pool zbackup1 BIOS 615kB/3363840kB available memory FreeBSD/x86 bootstrap loader, Revision 1.1 and it continues on from there and boots After I did the zpool upgrade zroot, I did gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada1 pool: zroot state: ONLINE scan: resilvered 195G in 01:04:31 with 0 errors on Mon May 25 16:08:21 2020 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 errors: No known data errors Whats odd is that zbackup1 is not the name of the pool. Where is that coming from ? The pool I boot from is zroot on this box Loading /boot/defaults/loader.conf Loading /boot/loader.conf.local Loading /boot/d| disk1 zio_read error: 5 zio_read error: 5 ZFS: i/o error - all block copies unavailable ZFS: can't read MOS of pool zbackup1 BIOS 615kB/3363840kB available memory 1(nanobsd2)# gpart list ada0 Geom name: ada0 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029127 first: 40 entries: 128 scheme: GPT Providers: 1. Name: ada0p1 Mediasize: 524288 (512K) Sectorsize: 512 Stripesize: 0 Stripeoffset: 20480 Mode: r0w0e0 efimedia: HD(1,GPT,55d32563-9eba-11ea-87ad-0007430611a8,0x28,0x400) rawuuid: 55d32563-9eba-11ea-87ad-0007430611a8 rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f label: (null) length: 524288 offset: 20480 type: freebsd-boot index: 1 end: 1063 start: 40 2. Name: ada0p2 Mediasize: 21474836480 (20G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 1048576 Mode: r1w1e0 efimedia: HD(2,GPT,55d3938d-9eba-11ea-87ad-0007430611a8,0x800,0x2800000) rawuuid: 55d3938d-9eba-11ea-87ad-0007430611a8 rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b label: (null) length: 21474836480 offset: 1048576 type: freebsd-swap index: 2 end: 41945087 start: 2048 3. Name: ada0p3 Mediasize: 1978922958848 (1.8T) Sectorsize: 512 Stripesize: 0 Stripeoffset: 21475885056 Mode: r1w1e1 efimedia: HD(3,GPT,563d7775-9eba-11ea-87ad-0007430611a8,0x2800800,0xe6608000) rawuuid: 563d7775-9eba-11ea-87ad-0007430611a8 rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: (null) length: 1978922958848 offset: 21475885056 type: freebsd-zfs index: 3 end: 3907028991 start: 41945088 Consumers: 1. Name: ada0 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r2w2e3 0(nanobsd2)# gpart list ada1 Geom name: ada1 modified: false state: OK fwheads: 16 fwsectors: 63 last: 3907029134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada1p1 Mediasize: 524288 (512K) Sectorsize: 512 Stripesize: 0 Stripeoffset: 20480 Mode: r0w0e0 efimedia: HD(1,GPT,25a0d50e-4207-11e6-8ebd-003048d6ef12,0x28,0x400) rawuuid: 25a0d50e-4207-11e6-8ebd-003048d6ef12 rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f label: gptboot1 length: 524288 offset: 20480 type: freebsd-boot index: 1 end: 1063 start: 40 2. Name: ada1p2 Mediasize: 21474836480 (20G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 1048576 Mode: r1w1e0 efimedia: HD(2,GPT,25b0e143-4207-11e6-8ebd-003048d6ef12,0x800,0x2800000) rawuuid: 25b0e143-4207-11e6-8ebd-003048d6ef12 rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b label: swap1 length: 21474836480 offset: 1048576 type: freebsd-swap index: 2 end: 41945087 start: 2048 3. Name: ada1p3 Mediasize: 1978922958848 (1.8T) Sectorsize: 512 Stripesize: 0 Stripeoffset: 21475885056 Mode: r1w1e1 efimedia: HD(3,GPT,25c584a8-4207-11e6-8ebd-003048d6ef12,0x2800800,0xe6608000) rawuuid: 25c584a8-4207-11e6-8ebd-003048d6ef12 rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: zfs1 length: 1978922958848 offset: 21475885056 type: freebsd-zfs index: 3 end: 3907028991 start: 41945088 Consumers: 1. Name: ada1 Mediasize: 2000398934016 (1.8T) Sectorsize: 512 Mode: r2w2e3 It looks like if I do just a 0(nanobsd2)# zpool import pool: zbackup1 id: 5819795054093255811 state: UNAVAIL status: The pool was last accessed by another system. action: The pool cannot be imported due to damaged devices or data. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-EY config: zbackup1 UNAVAIL insufficient replicas raidz2-2 UNAVAIL insufficient replicas da5 UNAVAIL cannot open mfisyspd8 UNAVAIL cannot open mfisyspd7 UNAVAIL cannot open mfisyspd6 UNAVAIL cannot open ada0 UNAVAIL cannot open 17460231907795801757 UNAVAIL cannot open 0(nanobsd2)# it thinks ada0 is/was part of an old pool. How do I get rid of that reference ? ---Mike
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?82761f2b-475f-43ab-b045-95c60c330db7>