From nobody Fri Mar 27 17:35:16 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fj7BH34q5z6WdPN for ; Fri, 27 Mar 2026 17:37:11 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fj7BG4r5hz3WyN for ; Fri, 27 Mar 2026 17:37:10 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20251104 header.b=jMqPObpA; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of bogorodskiy@gmail.com designates 2a00:1450:4864:20::52a as permitted sender) smtp.mailfrom=bogorodskiy@gmail.com Received: by mail-ed1-x52a.google.com with SMTP id 4fb4d7f45d1cf-66a9a2187a5so3720937a12.0 for ; Fri, 27 Mar 2026 10:37:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1774633024; x=1775237824; darn=freebsd.org; h=content-disposition:mime-version:message-id:subject:to:from:date :sender:from:to:cc:subject:date:message-id:reply-to; bh=I9lpsUfRyjIyljx3qx7wmYGfnmTnNOX5hS0i46s+Qdc=; b=jMqPObpAnoqRSdaWgxHO9iEsCy0DEKKJeLqLKc77pnK8f5lU8UH4Mq/sseTMhqUGUW 9incrhp8uG16DoC+xEBnlMUgUbvh6hnbZvUtoIzRbuc29Rgs1ALH/10vj5dZXitR3KEc 4+ym9BcFkIrrb1d8czUkTkHtLJ02Jt3yqnjuH7nrT0GMnxkqnd/tiUPCSzaON7RyoDJR oK8vGJ4SPjqP79SxMyEAm7Wz+059vEnRHaoXd0n2xtFGmwzRXJIfJ9qQ37ApVIjRBWlG J2grFr1/rLkglcGzqIoFugIzqc5NTJmhanpQMqegeuVXujEwij4vdELapHb/EBq6wc6z IhnA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1774633024; x=1775237824; h=content-disposition:mime-version:message-id:subject:to:from:date :sender:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=I9lpsUfRyjIyljx3qx7wmYGfnmTnNOX5hS0i46s+Qdc=; b=BPM4k0bd417e/nlsAy5Z5ba0DlLtZxS0q1cCZh6gTuGgRn5ae+nbA3l9zukVdKoq0d 9id+yvCwUyRSvrj7Y1s8ZOWfI4LyeVaOwDcAFC6HiLPWO1Dkio1QXSQEXOoHOezyjuOJ 89rmB9TzXZVSscLulta8grWV7ZC/P50zFK6fjKT+4bUuUU1F78cqJtmup1G6sDqIzBki W6bghgrk743UU/URcdqpB47IzgTN/cQJMUZeugpJ8ulqWHh+KIEJU8IXcF0VFufnVzbN HWi3Prc/mNSBewhUiJyU2ugJzrjUsG0jf+edJI3/JGeb42zpjBerVBshJMPLxe7uuRcb d8ww== X-Gm-Message-State: AOJu0Yy34ftLz+o5Lw4d0B6o1Y4YI6jsVbO6zVDPFB7e4NShSIfLWEd0 pk/qG+eFfI0M/AeTYM+cqdgpwaavL3okTjUqYMBOlqy9SzlMaZoanPLUm0HSdZ8C X-Gm-Gg: ATEYQzwpOIBKR5zipOSFxiKRQl5jAn5BXV5+Z9aQ+9vPOL8waVbXEW3GgKCFNHe8zAx VhcWznChX+uY3+RiYRGX1/ZNhtb2WsXJPvbxIiUnL5BZhiiE8SgNO1gqDJC9xRzRl4AVpVTXyyw sTTx4Sc86HGyChKK6+PS1kjKV47dbN+CfLTg6VQCsYvmLBoGA9U889nE3/5/t1agAoPSRM8+VXH OSrdTfl/q2TnhXyhhauoppqje6EFpZ3oUMbit14tRNaXYtk3JrMollnX6UoR6dpubhWn7JpSpkE RnwyojaCZXxPad+NNoGmDINEUPSMOsIbS1Fob4gLrtEyy3MEMCR9MaznrEO3YbJ6UluI4nZCt+E +L47rmfTSV26yjXKQ6O4gZggHHi2HS7NE6Lkl+VCl/qHeIg4zyqnvbvjcV9EBRao6GawteWc7QF X/jYBP1+frSbJ+ X-Received: by 2002:a17:907:971e:b0:b8e:796a:fd5c with SMTP id a640c23a62f3a-b9b507b20camr242510966b.27.1774633023944; Fri, 27 Mar 2026 10:37:03 -0700 (PDT) Received: from tulp ([2001:1c02:1a15:3000:ee82:4536:a8f2:9e22]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-b9b203ef86csm271568966b.49.2026.03.27.10.37.03 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 27 Mar 2026 10:37:03 -0700 (PDT) Date: Fri, 27 Mar 2026 18:35:16 +0100 From: Roman Bogorodskiy To: freebsd-virtualization@freebsd.org Subject: bhyve(load) does not start in jail on -CURRENT Message-ID: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Result: default: False [-2.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.89)[-0.888]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[novel@freebsd.org,bogorodskiy@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20251104]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), DKIM not aligned (relaxed),none]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[gmail.com:+]; ARC_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[novel@freebsd.org,bogorodskiy@gmail.com]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52a:from] X-Rspamd-Queue-Id: 4fj7BG4r5hz3WyN X-Spamd-Bar: -- Hi, I'm using jails to run some tests with bhyve and this setup works for me with 15.0-RELEASE, but does not with 16.0-CURRENT. The setup is as follows: jail.conf: testrunnergit { enforce_statfs = 2; devfs_ruleset = 44; exec.clean; exec.consolelog = /var/log/bastille/testrunnergit_console.log; exec.start = '/bin/sh /etc/rc'; exec.stop = '/bin/sh /etc/rc.shutdown'; host.hostname = testrunnergit; mount.devfs; mount.fstab = /usr/local/bastille/jails/testrunnergit/fstab; path = /usr/local/bastille/jails/testrunnergit/root; osrelease = 16.0-CURRENT; vnet; vnet.interface = e0b_bastille1; exec.prestart += "jib addm bastille1 vtnet0"; exec.prestart += "ifconfig e0a_bastille1 description \"vnet0 host interface for Bastille jail testrunnergit\""; exec.poststop += "ifconfig e0a_bastille1 destroy"; allow.chflags = 1; allow.raw_sockets = 1; allow.vmm = 1; allow.mount; allow.mount.devfs; allow.mount.fdescfs; allow.mount.procfs; mount.fdescfs; mount.procfs; } When I try to run bhyveload: root@testrunnergit:~ # bhyveload -m 1024 -d /var/cache/libvirt-tck/os-x86_64-hvm/disk-freebsd-11.1.img tck32424 bhyveload: vm_create: Operation not permitted (An unprivileged user must run VMs in monitor mode) root@testrunnergit:~ # root@freebsd16-current:~ # jls -j testrunnergit allow.vmm true root@freebsd16-current:~ # devfs -m /usr/local/bastille/jails/testrunnergit/root/dev rule show 100 include 4 200 path vmmctl unhide 300 path vmm unhide 400 path vmm/* unhide 500 path tap* unhide 600 path mem unhide 700 path kmem unhide 800 path nmdm* unhide 900 path pci unhide 1000 path io unhide 1100 path pf unhide root@freebsd16-current:~ # Am I missing anything? Thanks, Roman