From nobody Sat Jun 10 09:21:51 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QdXYv0Cxbz4cjTF for ; Sat, 10 Jun 2023 09:23:31 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QdXYs1bLrz46r5; Sat, 10 Jun 2023 09:23:29 +0000 (UTC) (envelope-from grembo@freebsd.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=softfail (mx1.freebsd.org: 213.239.217.29 is neither permitted nor denied by domain of grembo@freebsd.org) smtp.mailfrom=grembo@freebsd.org; dmarc=none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 68000590; Sat, 10 Jun 2023 09:23:21 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 0aa0fa8e (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sat, 10 Jun 2023 09:23:21 +0000 (UTC) Date: Sat, 10 Jun 2023 11:21:51 +0200 From: Michael Gmelin To: Warner Losh Cc: Michael Gmelin , Glen Barber , FreeBSD Current Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: <20230610112151.306e4c01.grembo@freebsd.org> In-Reply-To: References: <20230608181115.7c97ea19.grembo@freebsd.org> <20230608162012.GV1219@FreeBSD.org> <20230608190623.14ab4ba8.grembo@freebsd.org> <20230608191637.21101c39.grembo@freebsd.org> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-2.09 / 15.00]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MIME_GOOD(-0.10)[text/plain]; BLOCKLISTDE_FAIL(0.00)[213.239.217.29:server fail]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; FREEFALL_USER(0.00)[grembo]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_SOFTFAIL(0.00)[~all:c]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4QdXYs1bLrz46r5 X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N On Thu, 8 Jun 2023 11:32:19 -0600 Warner Losh wrote: > On Thu, Jun 8, 2023, 11:18 AM Michael Gmelin > wrote: > > > > > > > Tried today's snaphot, same problem. > > > > > > # reboot > > > Waiting (max 60 seconds) for system process `vnlru' to stop... > > > done Waiting (max 60 seconds) for system process `syncer' to > > > stop... Syncing disks, vnodes remaining... 0 0 0 0 done > > > All buffers synced. > > > Uptime: 4m14s > > > Consoles: userboot > > > > > > FreeBSD/amd64 User boot lua, Revision 1.2 > > > ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 > > > ERROR: cannot open /boot/lua/loader.lua: no such file or > > > directory. > > > > > > > > > Type '?' for a list of commands, 'help' for more detailed help. > > > OK > > > > > > > > > That's after installing CURRENT in a fresh vm managed by vm-bhyve > > > using bsdinstall's automatic ZFS option. > > > > > > > Thinking about this, it's possible that vm-bhyve is using the zfs > > boot loader from the host machine. > > > > Please consider this noise, unless you hear from me again. > > > > Yes. It does. This can be an unfortunate design choice at times. > For completeness sake, this is how I boot 14.0 on 13.2 using sysutils/vm-bhyve: ISO=FreeBSD-14.0-CURRENT-amd64-20230608-653738e895ba-263444-bootonly.iso export ISO cd /mountpoint/for/pool/vm vm iso https://download.freebsd.org/snapshots/ISO-IMAGES/14.0/$ISO mkdir .loaders tar --strip-components 1 -C .loaders -xf .iso/$ISO boot/userboot.so mv .loaders/userboot.so .loaders/userboot14.so vm create test14 sysrc -f test14/test14.conf memory=1G sysrc -f test14/test14.conf \ bhyveload_loader="$(realpath .loaders/userboot14.so)" OS installation is done the usual way (using tmux instead of cu in this example): pkg install -y tmux sysrc -f .config/system.conf console=tmux vm install test14 $ISO tmux attach -t test14 Best Michael -- Michael Gmelin