From nobody Thu Nov 2 16:50:54 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SLqr43NJ7z4yt1Q for ; Thu, 2 Nov 2023 17:00:20 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SLqr42ynrz3Fj1 for ; Thu, 2 Nov 2023 17:00:20 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 3A2GosKG097397 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Thu, 2 Nov 2023 12:50:54 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:c1c6:784b:c650:7216] ([IPv6:2607:f3e0:0:4:c1c6:784b:c650:7216]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 3A2Gor1P042795 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 2 Nov 2023 12:50:53 -0400 (EDT) (envelope-from mike@sentex.net) Content-Type: multipart/alternative; boundary="------------5GR0cuQ5jDdf1dJGRHRxpXX7" Message-ID: <515d5ad4-9fc8-4f86-936b-b71d8f43d564@sentex.net> Date: Thu, 2 Nov 2023 12:50:54 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: RELENG_13 to 14 upgrade fail Content-Language: en-US To: Xin LI Cc: FreeBSD-STABLE Mailing List References: <0c19b8a6-119c-4f5d-af26-d625afc7afec@sentex.net> From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4SLqr42ynrz3Fj1 This is a multi-part message in MIME format. --------------5GR0cuQ5jDdf1dJGRHRxpXX7 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 11/2/2023 12:39 PM, Xin LI wrote: > > > On Thu, Nov 2, 2023 at 9:28 AM mike tancsa wrote: > > On one of my VMs that I upgraded from RELENG_13 to RELENG_14, I > forgot > to update the boot loader so now at bootup, I have > ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 > > Can't find /boot/zfsloader > > What is the best way to recover from this ? Its a raw vm image. > gpart is > p1=freebsd-boot, p2=freebsd-swap,p3=freebsd-zfs > > I was thinking perhaps start up a second vm thats RELENG_14, mdconfig > the image, and then what do I need to do ? Just > > gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 md0 ? > > > Yes, note that if the host is running FreeBSD you can mdconfig the > image on the host directly and do it on the host too. > > BTW. pmbr is very simple and doesn't change that often, updating > gptzfsboot should be sufficient. > Thanks!  Another server I have (zoo) is EFI. I have not upgraded the boot pool yet, but its a mirror (ada8 and ada9). Both are p1=efi p2=freebsd-boot p3=swap p4=zfs root@zoo2:~ # mount_msdosfs /dev/ada8p1 /mnt root@zoo2:~ # ls -lR /mnt/EFI/ total 2 drwxr-xr-x  1 root wheel 512 Feb  1  2021 BOOT drwxr-xr-x  1 root wheel 512 Nov 21  2020 freebsd /mnt/EFI/BOOT: total 1747 -rwxr-xr-x  1 root wheel 894464 Feb  1  2021 BOOTX64.efi /mnt/EFI/freebsd: total 1747 -rwxr-xr-x  1 root wheel 894464 Feb  1  2021 loader.efi root@zoo2:~ # They appear to be the same.  Do I just replace both those files ? root@zoo2:~ # find /mnt -type f | xargs md5 MD5 (/mnt/EFI/freebsd/loader.efi) = 5dcb1e7bc59e5ee7a9bd04faaa20b7ee MD5 (/mnt/EFI/BOOT/BOOTX64.efi) = 5dcb1e7bc59e5ee7a9bd04faaa20b7ee root@zoo2:~ # with root@zoo2:~ # ls -l /boot/loader.efi -r-xr-xr-x  2 root wheel 659968 Oct 31 13:02 /boot/loader.efi root@zoo2:~ #     ---Mike --------------5GR0cuQ5jDdf1dJGRHRxpXX7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 11/2/2023 12:39 PM, Xin LI wrote:


On Thu, Nov 2, 2023 at 9:28 AM mike tancsa <mike@sentex.net> wrote:
On one of my VMs that I upgraded from RELENG_13 to RELENG_14, I forgot
to update the boot loader so now at bootup, I have
ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2

Can't find /boot/zfsloader

What is the best way to recover from this ? Its a raw vm image. gpart is
p1=freebsd-boot, p2=freebsd-swap,p3=freebsd-zfs

I was thinking perhaps start up a second vm thats RELENG_14, mdconfig
the image, and then what do I need to do ? Just

gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 md0 ?

Yes, note that if the host is running FreeBSD you can mdconfig the image on the host directly and do it on the host too.

BTW. pmbr is very simple and doesn't change that often, updating gptzfsboot should be sufficient.


Thanks!  Another server I have (zoo) is EFI. I have not upgraded the boot pool yet, but its a mirror (ada8 and ada9). Both are
p1=efi
p2=freebsd-boot
p3=swap
p4=zfs


root@zoo2:~ # mount_msdosfs /dev/ada8p1 /mnt
root@zoo2:~ # ls -lR /mnt/EFI/
total 2
drwxr-xr-x  1 root wheel 512 Feb  1  2021 BOOT
drwxr-xr-x  1 root wheel 512 Nov 21  2020 freebsd

/mnt/EFI/BOOT:
total 1747
-rwxr-xr-x  1 root wheel 894464 Feb  1  2021 BOOTX64.efi

/mnt/EFI/freebsd:
total 1747
-rwxr-xr-x  1 root wheel 894464 Feb  1  2021 loader.efi
root@zoo2:~ #

They appear to be the same.  Do I just replace both those files ?

root@zoo2:~ # find /mnt -type f | xargs md5
MD5 (/mnt/EFI/freebsd/loader.efi) = 5dcb1e7bc59e5ee7a9bd04faaa20b7ee
MD5 (/mnt/EFI/BOOT/BOOTX64.efi) = 5dcb1e7bc59e5ee7a9bd04faaa20b7ee
root@zoo2:~ #

with

root@zoo2:~ # ls -l /boot/loader.efi
-r-xr-xr-x  2 root wheel 659968 Oct 31 13:02 /boot/loader.efi
root@zoo2:~ #

    ---Mike

--------------5GR0cuQ5jDdf1dJGRHRxpXX7--