From owner-freebsd-current@freebsd.org Mon Jan 25 21:17:18 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CE5DE4F1F95 for ; Mon, 25 Jan 2021 21:17:18 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [IPv6:2607:f3e0:0:3::19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "pyroxene.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DPjPB1080z3MP5 for ; Mon, 25 Jan 2021 21:17:18 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:6803:7f97:bbf4:4a3c] ([IPv6:2607:f3e0:0:4:6803:7f97:bbf4:4a3c]) by pyroxene2a.sentex.ca (8.15.2/8.15.2) with ESMTPS id 10PLHHW6036699 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 25 Jan 2021 16:17:17 -0500 (EST) (envelope-from mike@sentex.net) To: Toomas Soome Cc: Michael Butler , freebsd-current , Mateusz Guzik References: <28fbf9cd-0f56-f6a0-1ddf-186aeed59b95@protected-networks.net> <9e183db9-2ca5-a7bd-2665-cc468d4b69db@sentex.net> <207F268A-30E3-45BE-9377-79C3DC31C328@me.com> From: mike tancsa Subject: Re: ZFS feature compatibility? Message-ID: Date: Mon, 25 Jan 2021 16:17:18 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.1 MIME-Version: 1.0 In-Reply-To: <207F268A-30E3-45BE-9377-79C3DC31C328@me.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Rspamd-Queue-Id: 4DPjPB1080z3MP5 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:3::19 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-1.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; HFILTER_HELO_IP_A(1.00)[pyroxene2a.sentex.ca]; HFILTER_HELO_NORES_A_OR_MX(0.30)[pyroxene2a.sentex.ca]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[me.com]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f3e0:0:3::19:from]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; SPAMHAUS_ZRD(0.00)[2607:f3e0:0:3::19:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_CC(0.00)[protected-networks.net,freebsd.org,gmail.com]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jan 2021 21:17:18 -0000 On 1/25/2021 4:03 PM, Toomas Soome wrote: > > >> On 25. Jan 2021, at 22:15, mike tancsa > > wrote: >> >> On 1/25/2021 2:37 PM, Toomas Soome via freebsd-current wrote: >>> >>>> On 25. Jan 2021, at 21:31, Michael Butler via freebsd-current >>>> > >>>> wrote: >>>> >>>> I have a few machines on which I've been hesitant to run 'zpool >>>> upgrade' as I'm not sure of the (boot?) implications. They report >>>> like this .. >>>> >>>> imb@toshi:/home/imb> uname -a >>>> FreeBSD toshi.auburn.protected-networks.net >>>> 14.0-CURRENT FreeBSD >>>> 14.0-CURRENT #25 main-eb61de5b78: Fri Jan 22 10:03:02 EST 2021 >>>> root@toshi.auburn.protected-networks.net >>>> :/usr/obj/usr/src/a= md64.amd64/sys/TOSHI >>>> amd64 >>>> >>>> imb@toshi:/home/imb> zpool status >>>> pool: zroot >>>> state: ONLINE >>>> status: Some supported features are not enabled on the pool. The >>>> pool can >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0still be used, but some features= are unavailable. >>>> action: Enable all features using 'zpool upgrade'. Once this is done= , >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0the pool may no longer be access= ible by software that does >>>> not support >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0the features. See zpool-features= (5) for details. >>>> >>>> Is it safe to upgrade the root pool? >>>> >>>> imb >>> We can not boot from encrypted pool and draid. Rest is all ok. >>> Please note, you may need to update the bootblocks. >>> >> last Friday on=C2=A0zoo.freebsd.org >> ,=C2=A0mjg@freebsd.org >> =C2=A0and I could not boot >> again because v2 bookmarks were on the boot pool.=C2=A0 I had to boot = from >> another disk, remove the bookmarks and then boot. This was on RELENG_1= 3 >> (stable/13-c256203-g51d73a3e46c) >> >> =C2=A0=C2=A0=C2=A0 =E2=80=94Mike > > /* > =C2=A0* List of ZFS features supported for read > =C2=A0*/ > static const char *features_for_read[] =3D { > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.illumos:lz4_compress", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:hole_birth", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:extensible_dataset", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:embedded_data", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.open-zfs:large_blocks", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.illumos:sha512", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.illumos:skein", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.zfsonlinux:large_dnode", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.joyent:multi_vdev_crash_dump", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:spacemap_histogram", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:zpool_checkpoint", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:spacemap_v2", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.datto:encryption", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.datto:bookmark_v2", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.zfsonlinux:allocation_classes", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.datto:resilver_defer", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:device_removal", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:obsolete_counts", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.intel:allocation_classes", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "org.freebsd:zstd_compress", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 "com.delphix:bookmark_written", > =C2=A0 =C2=A0 =C2=A0 =C2=A0 NULL > }; > > Are you sure you have bootblocks updated? ESP for UEFI boot and > freebsd-boot for BIOS boot. > > mjg did them IIRC.=C2=A0 I just checked to make sure both were done and t= hey seem identical root@zoo2:/home/mdtancsa # dd if=3D/dev/ada8p2 of=3D/tmp/8 1024+0 records in 1024+0 records out 524288 bytes transferred in 0.046479 secs (11280092 bytes/sec) root@zoo2:/home/mdtancsa # dd if=3D/dev/ada9p2 of=3D/tmp/9 1024+0 records in 1024+0 records out 524288 bytes transferred in 0.054717 secs (9581751 bytes/sec) root@zoo2:/home/mdtancsa # md5 /tmp/8 /tmp/9 MD5 (/tmp/8) =3D e294b1344cbb49c751474facc39998ec MD5 (/tmp/9) =3D e294b1344cbb49c751474facc39998ec root@zoo2:/home/mdtancsa # Is there a way to check from the bin if its the right version ? strings of the file doesnt seem to show anything useful.=C2=A0 I wonder if its th= e UEFI boot that got missed ?=C2=A0 Just gpart bootcode -p /boot/boot1.efifat -i 1ada8 gpart bootcode -p /boot/boot1.efifat -i 1ada9 I take it ? MD5 (/tmp/81) =3D ff8762fa2b885347a0030b45b0f3844e MD5 (/tmp/91) =3D e0fa5369ddb0471373bca6b29e027680 MD5 (/boot/boot1.efi) =3D c023e2c74479b2f0710ab0337a7bab4f root@zoo2:/boot # dd if=3D/dev/ada9p1 of=3D/tmp/91 bs=3D1m 200+0 records in 200+0 records out 209715200 bytes transferred in 0.557007 secs (376503669 bytes/sec) root@zoo2:/boot # dd if=3D/dev/ada8p1 of=3D/tmp/81 bs=3D1m 200+0 records in 200+0 records out 209715200 bytes transferred in 0.475806 secs (440757874 bytes/sec) root@zoo2:/boot # md5 /tmp/81 /tmp/91 /boot/boot1 boot1=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 boot1.efi* root@zoo2:/boot # md5 /tmp/81 /tmp/91 /boot/boot1.efi MD5 (/tmp/81) =3D ff8762fa2b885347a0030b45b0f3844e MD5 (/tmp/91) =3D e0fa5369ddb0471373bca6b29e027680 MD5 (/boot/boot1.efi) =3D c023e2c74479b2f0710ab0337a7bab4f I am guessing they extracted boot blocks should match, no ? =C2=A0=C2=A0=C2=A0 ---Mike