From nobody Tue Jan 13 18:50:58 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4drJM50WWcz6NY2Y for ; Tue, 13 Jan 2026 18:54:25 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4drJM437Hkz3xfH for ; Tue, 13 Jan 2026 18:54:24 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=Mp+cDb+U; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of bogorodskiy@gmail.com designates 2a00:1450:4864:20::62f as permitted sender) smtp.mailfrom=bogorodskiy@gmail.com Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-b8716197f3eso403412166b.1 for ; Tue, 13 Jan 2026 10:54:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1768330457; x=1768935257; darn=freebsd.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :from:to:cc:subject:date:message-id:reply-to; bh=ehixk452swFhBjEMJcnrisyBjAkvUR9mVaQeq410Zng=; b=Mp+cDb+UJlpKluZ407ripZyMWJyw1g5A3M67IXLV45NtyJ/o+bfeII20K4UYn9ntof 9IgHtY7Ako5OQese7DE7FbklMZ3rMZcon/b76gllsWUQM4u5KuhwNFlHySrsLbgPst4S 7DC9Qi5diF5VIwetNHz9IfW21zUcfMKJ78H0SkN9rwSJyD+w6Z7RAL5/8Ks7y8gJ6h9J UyetIciqKuXL3z5WFJecwWOKbu6KWLR7p3RBd2K29+CD7tp5y6GBcfods8gDTdVTZ5zR XatC4lrteA/GaBP9LRmPQePhC4KkiF7gPYqUAGIFTj8T5us2tnipqA7Rmzs9B7jCvpu2 Ab2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768330457; x=1768935257; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ehixk452swFhBjEMJcnrisyBjAkvUR9mVaQeq410Zng=; b=H8pH07rn8CEt3ZKQ5DRu04uZ1VK6oLTr050heqgJBPsoNc+UFMjMV8e6TvIV736qPg AGoHeE0nUghQPmpyB+LDbki/nsl24jxbIj6jP+eQ5pg4fMXYPNT6Q4eZ4mEwa15C+LRO S3ztiv1WTpYoPAcBiuCxeYRE2LOgJVTAmVu7EQQJ4/tQ7hsSMaQ/TpxdSsWhMCcwj8af 2aNNynvgmZ4921J5dynxoy8dfJVsvWrcCeACkcFpysQ58dq77q06VAqVbWl8t3S5KLoJ bJj9VZTF+lx9aIDnwrYc8Su5PKzbYJtmhcvffM67C8GJkYKm9WGGSEJA/dkCeffwV6G6 hVnw== X-Gm-Message-State: AOJu0YxsgPaSSgf2EmLqFPeZx+NB6eFMEXSv8DgXhyGUI2xnqZXne4U5 cTYYN0KrDWeattQiIbhwalmvBFM07ESY99Ku6JITXTd25A+CGNKGlH52lk5+xriK X-Gm-Gg: AY/fxX7BAZG0GQrTb9me/wCAssVGxp2Eqrt8AhDjV4AC7r2lYiyy/cEjJANVWIw5og4 6JWzPaE4Y6xMxMkbsUe1VO0ByCFgyDExM7afAIrWABY0/VQ/UsNLkCQOQAAeCy1HhU5sC8ESB+b jQHLjbaC7/vYdSK76x2p2iZsW+7cXu9GX2kIOHz+eltJ80r9lmGVxxVdP6qKUnLV6uMZZM3CbM5 ZWU8HPRMzChOSm7f0y24mpdsJxM5AKR93uEaOv5EZyR/ZemwTVFbMV0nXIsf6Y6TyNRe1aJQksc OG7/ur+jb6BYbRjb7HIGHV+DjjzDLX8zA4fRSJRHXHror4VfLEGB4YOpuFDgx24FqWg8ufJncsn vJUE6SZkUMcG+gvJpBo9KV6XS2p4jwtG71cNpRjS7bZMRpGA2wnTGbeFvUelVJh54XaPSemPKE8 tcgKu7yn6Fntv7RzW+pgrirRBLjhYbU29pk/kZUNW1IwWDZamRyDny/EK9I6BQNNoP5qBw3QzdM f3ptg== X-Received: by 2002:a17:907:86a4:b0:b87:173f:61b with SMTP id a640c23a62f3a-b8760fe0ab2mr9782266b.9.1768330455822; Tue, 13 Jan 2026 10:54:15 -0800 (PST) Received: from tulp (2001-1c02-1a15-3000-c218-03ff-feb5-6cc4.cable.dynamic.v6.ziggo.nl. [2001:1c02:1a15:3000:c218:3ff:feb5:6cc4]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-b842a27c760sm2342992666b.24.2026.01.13.10.54.14 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 13 Jan 2026 10:54:15 -0800 (PST) Date: Tue, 13 Jan 2026 19:50:58 +0100 From: Roman Bogorodskiy To: Bojan =?utf-8?B?Tm92a292acSH?= Cc: freebsd-virtualization@freebsd.org Subject: Re: RFC: ACPI-based PCI device hotplugging for bhyve Message-ID: References: <66a1c389-6b87-4062-aa2d-a1123f9edc97@freebsd.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <66a1c389-6b87-4062-aa2d-a1123f9edc97@freebsd.org> X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.41 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.81)[-0.807]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[novel@freebsd.org,bogorodskiy@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), DKIM not aligned (relaxed),none]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[novel@freebsd.org,bogorodskiy@gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62f:from] X-Rspamd-Queue-Id: 4drJM437Hkz3xfH Bojan Novković wrote: > Hi everyone, > > Over the last couple of months I've been working on implementing PCI device > hotplugging in bhyve and would like to get some feedback on the changes. > The patch series from D54641 to D54656 implements an ACPI-based hotplugging > mechanism > that is accessible through an nvlist(9)-based IPC protocol. > Users can add to or remove an emulated PCI device from a running virtual > machine > by sending an appropriately crafted nvlist(9) object to a UNIX socket > located at '/var/run/bhyve/'. > The patch series also adds new command-line options to 'bhyvectl' > ('--pci-{add,remove}') to facilitate these operations. > Since the implementation ended up touching a lot of files and adding a lot > of > changes to the PCI emulation layer, I'll try to give a brief overview of the > problems each change is meant to solve and outline the major changes in this > patch series. > > Aside from implementing the ACPI-based hotplugging mechanism, adding PCI > hotplugging to bhyve required solving the following problems: >  1) bhyve's PCI BAR allocator can't allocate and free BARs during runtime, >  2) bhyve is sandboxed, which makes it impossible to initialize certain > emulated >     PCI devices during runtime since they might need to open files >     during initialization, >  3) Allowing users to request hotplug or hotremove operations from a running >     bhyve instance. > > The first problem was solved using 'libuvmem(3)', a userspace port of the > 'vmem(9)' general-purpose allocator. This allows us to manage resources > owned by > each virtual PCI bus during runtime. The second problem was solved by > delegating > parts of the PCI device initialization to 'bhyvectl'. Under this scheme, > 'bhyvectl' > opens all required files and sends the appropriate file descriptors to bhyve > over > a UNIX socket. To avoid unnecessary code duplication, parts of the bhyve's > device-specific initialization routines were moved to 'libbhyve', a new > private library. > The third problem was solved by generalizing bhyve's VM snapshotting IPC > thread. > This allows end users to invoke bhyve's PCI hotplugging routines through an > nvlist(9)-based IPC protocol. > > In summary, here's a brief overview of the changes made by this patch > series. > - Replacing bhyve's static PCI BAR allocation algorithm with 'libuvmem(3)' > (D54641), > - Adding ACPI methods that allow us to inject hotplugging events into the > guest (D54642 - D54646), > - Generalizing bhyve's IPC thread and introducing an nvlist(9)-based IPC > protocol (D54650), > - Refactoring and moving parts of the device initialization and > configuration code to 'libbhyve' (D54648), > - Adding hotplugging IPC commands to 'bhyve' and the corresponding > '--pci-{add,remove}' options to 'bhyvectl' (D54651 - D54653), > - Making the 'e1000' and 'virtio-net' network devices hotpluggable - (D54654 > - D54656). > > The network devices were chosen as a proof of concept. Other devices will > be added after this patch series gets reviewed. > Please feel free to leave comments on any of the reviews from D54641 to > D54656. > > Thanks, > Bojan > Hi Bojan, This is an exciting feature for bhyve! Do you have a public branch with all these changes? It's a bit cumbersome to pull them from arcanist. Roman From nobody Thu Jan 15 17:42:10 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dsVfy3PJsz6PDkw for ; Thu, 15 Jan 2026 17:42:18 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-ej1-x643.google.com (mail-ej1-x643.google.com [IPv6:2a00:1450:4864:20::643]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dsVfx39wMz3fcw for ; Thu, 15 Jan 2026 17:42:17 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=MaO2wA7n; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of bogorodskiy@gmail.com designates 2a00:1450:4864:20::643 as permitted sender) smtp.mailfrom=bogorodskiy@gmail.com Received: by mail-ej1-x643.google.com with SMTP id a640c23a62f3a-b8710c9cddbso174848366b.2 for ; Thu, 15 Jan 2026 09:42:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1768498933; x=1769103733; darn=freebsd.org; h=content-disposition:mime-version:message-id:subject:cc:to:from:date :sender:from:to:cc:subject:date:message-id:reply-to; bh=CNP0/edKzImowdU+pzEGPSaF08cy2XOBJ/TjB7A/UuM=; b=MaO2wA7ndvAnfccVymUSW1uiqieEpqYtFJinCUoS+rE+4fFmjE98LOUvgd8jVFu5dk e20r/uRiyMi66gY2b+KQtWiGpReuS40TaRlUS8DcxtOdZuM3AYYSPRip89L/RPEaqSDZ MxQAcDcKN2VjXTOEBqSqXqs2GPhd6S5XdiuiNc1wG1FMQJCJt8utZVUC2uOU/EB+aHKl /zOwGIF04F5daXVNlXvMSIchqNsk0v8G4nVOvkMA3oRlGppoJJdPsknRQcPuujZIqRrL sDhxO3eYbRQWZ194e8n2nS57QdZ9bDHRo83anUUVk0PuJ/7mq4Mt45etnv83iPg1QXHT mmWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768498933; x=1769103733; h=content-disposition:mime-version:message-id:subject:cc:to:from:date :sender:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=CNP0/edKzImowdU+pzEGPSaF08cy2XOBJ/TjB7A/UuM=; b=DtI9sK4TAkfGtZaN+aGyJzmD9oJD3FK5OvjLPBEzR2SMuZfZQ2aaaD7qBLtcqxTzi9 MqhH3HdtajEmo5faCZZVkvW04HTjgT4uttF0x16WHJKmpdm65tO5HFtk+EEeevknGktW ja1vgk+RF09tvfjZeGZ9rp1KO5gYF9xGfuOjewkLyIisJs++8sDIg5f/qtzFwRXnH14V oCrDQXPmQAipkV9oSRCn9UObRfZUKDILjvbhuR6OxV8bLdXmtCmDfKTqE7wEDXeSUewt 7NRT+POdUIjgVubAUV98jBrKsLyhNaAjZx2koj5dSMzJxj2FK9iXrCzBX//o6ypg1KEC p7tw== X-Gm-Message-State: AOJu0YyTq6gVrsL29W2Zo5/9SFcHPmbCfmxcxdskHLjfTAuzZltl9BFe 9g5Q4dIxMDcQ7NrV2fbr1otE2GOVzA7x/kG/wk5L1gQaQO74A0K+v6Pt8eZaKBhGX9Y= X-Gm-Gg: AY/fxX4OtfxTy1oSezxovYr1379IBlkI4kdbSWaF2/CU4i1jy/lcygXJ4geIbZm3bfo WuSlcjgQbWI+AkAYA4018pq8iFUh6Ar+ZJHgQYilICBlAIJLrWAr4K572WUdneoDz0xWR1/6Hvu 7l46dxQlTmI+ua+TzQf6BmqjSO1pxGzKac+iJ+UjVI/+T3eLaxQ6xTr6SukSc84M3bVQpd0J547 ozImYjNptLWwCweiLS2d0jRUb2+u4eUAQTJQDgKHaPShV4vvhc/UHKezYVEwsxhcicr82CNva0F 756eqwMGwSRixBlmtQpFRuhzcURFnWetYyQA86D/ENaBA2/4MFfIjtjxX0A4teyVw767Q3bBYss 3dom+CHRzAPGh72drdtJ+X0gxaHe4ZfmN/KP03CTsVqikxx0wDMkDJLrp7Ip71e0Ku3ktfqeaW3 YPVk3yLhjE7hw+2YBT/FyVul4mgpjZtXM/JRg6XTjMHmQj48m/DWpoh6vpgjZZjY6qZ5r0PzalZ LWQAA== X-Received: by 2002:a17:907:930a:b0:b84:2075:b902 with SMTP id a640c23a62f3a-b8792fc4218mr35402066b.36.1768498932963; Thu, 15 Jan 2026 09:42:12 -0800 (PST) Received: from tulp (2001-1c02-1a15-3000-c218-03ff-feb5-6cc4.cable.dynamic.v6.ziggo.nl. [2001:1c02:1a15:3000:c218:3ff:feb5:6cc4]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-b879513e967sm2805766b.8.2026.01.15.09.42.12 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 15 Jan 2026 09:42:12 -0800 (PST) Date: Thu, 15 Jan 2026 18:42:10 +0100 From: Roman Bogorodskiy To: freebsd-virtualization@freebsd.org Cc: freebsd-arm@freebsd.org Subject: Quartz64: vmm: No vgic found Message-ID: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.59 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[novel@freebsd.org,bogorodskiy@gmail.com]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), DKIM not aligned (relaxed),none]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[gmail.com:+]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[novel@freebsd.org,bogorodskiy@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::643:from] X-Rspamd-Queue-Id: 4dsVfx39wMz3fcw Hi, Loading of the vmm(4) module shows errors like: Jan 15 17:32:10 generic kernel: vmm: No vgic found Jan 15 17:32:10 generic kernel: module_register_init: MOD_LOAD (vmm, 0xffff0000e12931f0, 0) error 19 The module is listed in kldstat: $ kldstat |grep vmm 7 1 0xffff0000e1268000 4f000 vmm.ko $ But bhyve does not start: # bhyve -o bootrom=/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin -s 1,virtio-blk,./FreeBSD-15.0-RELEASE-arm64-aarch64-ufs.raw -o console=stdio vm0 bhyve: vm_openf: No such file or directory # Host system is: Pine64 Quartz64 Model A FreeBSD 15.0-RELEASE arm64 gic0: mem 0xfd400000-0xfd40ffff,0xfd460000-0xfd4dffff irq 12 on ofwbus0 gic0: using for IPIs CPU 0: ARM Cortex-A55 r2p0 affinity: 0 0 Cache Type = <64 byte CWG,64 byte ERG,64 byte D-cacheline,VIPT I-cache,64 byte I-cacheline> Instruction Set Attributes 0 = Instruction Set Attributes 1 = Instruction Set Attributes 2 = <> Processor Features 0 = Processor Features 1 = Processor Features 2 = <> Memory Model Features 0 = Memory Model Features 1 = Memory Model Features 2 = <32bit CCIDX,48bit VA,IESB,UAO,CnP> Memory Model Features 3 = <> Memory Model Features 4 = <> Debug Features 0 = Debug Features 1 = <> Auxiliary Features 0 = <> Auxiliary Features 1 = <> AArch32 Instruction Set Attributes 5 = AArch32 Media and VFP Features 0 = AArch32 Media and VFP Features 1 = CPU 1: ARM Cortex-A55 r2p0 affinity: 1 0 CPU 2: ARM Cortex-A55 r2p0 affinity: 2 0 CPU 3: ARM Cortex-A55 r2p0 affinity: 3 0 Does the board need something in addition to GICv3 that is missing that is needed to make vmm(4) work, or is that a configuration or vmm(4) issue? Thanks, Roman From nobody Thu Jan 15 18:06:45 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dsWCG1qPsz6PGCg for ; Thu, 15 Jan 2026 18:06:50 +0000 (UTC) (envelope-from bojan.novkovic@kset.org) Received: from mail-wm1-f53.google.com (mail-wm1-f53.google.com [209.85.128.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dsWCF1cqGz3lgx for ; Thu, 15 Jan 2026 18:06:48 +0000 (UTC) (envelope-from bojan.novkovic@kset.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of bojan.novkovic@kset.org designates 209.85.128.53 as permitted sender) smtp.mailfrom=bojan.novkovic@kset.org Received: by mail-wm1-f53.google.com with SMTP id 5b1f17b1804b1-47edffe5540so12808825e9.0 for ; Thu, 15 Jan 2026 10:06:48 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768500407; x=1769105207; h=in-reply-to:autocrypt:from:content-language:references:cc:to :subject:user-agent:mime-version:date:message-id:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=5VVtwEkITmS59zzbhRnlEcycBfs4TBZMv3/96IGBqf8=; b=tOkwpdIGncwNAksukaDi5fBbOhz7PcnK4TzFVXE3l4RJJhQn7IPmqPHYrRBJ5AezHq efMTe0spfC+rpDXbpiTy8hSJvJxN/A9O0c5ZfP5KI32gCS7WgW9cWxAaCzjiflul00MN dbQuOOYI0xarzqH0GD/a1RPhnf3e++uo8o/tOSdZ86dn+DFV3mtw4O3G0zvjTj+hbNd1 nPQI1k+e1MiC3qDwijqqJSPTDV0RlqF7Fu6WrjbSUGldujXTtsBLx6L07uOjK50YC/Ry efyImFTuou+dHpbUQgWn9GvdSeDsPOS9DtSdnTHv0H8uJV3q2OvvwtDSfpPeYrvp0Mjw CZHA== X-Gm-Message-State: AOJu0YwSEcX400MuZGnp6nWWArNoRh4R0wb9GFfA8peMKSNJSLT6g5EW nUtOYVqtZXa6uWfqP7fTFQM/wRsn3q61ZgHT2Prk6bZKetlE/Nv1We/szKPIoglPl10= X-Gm-Gg: AY/fxX4n7bN52EA0rRuYkbNitU/7X/ixR6mtx5a0iwVAQEgezfEadwWdT1YChia8gsS FdUXYz6laMjER+XeK8bDReNavizWUVcX+XXI92XvADhjL4kcqk5y7ulr7SdRCuMD0Q0i7fIkAV8 n/w4/3Pnu0QQ/bk2c2V2VSVdnXcV1s2W1vnZE/E4wh+VvrA7IalWg9lFsMFeb0xoLV930MwpHI5 g/aaEC480cMqJIxtJiZFQiHueWoKfLpoWVLaR2xdzdpQuFYK5eK6Z3W/An+e+HvNHZiCCQMShEX zRtbZSCREOuz2RjjLcyQhpy9SnEjQcoFEFVx90qSAqt5g2hIJULe/Pf59ktthPM9hQBV4wKdC3H JqSRHVZlLGdTaXXeAvabWKUAkM/wINi1HzwX9jNsnerFyJUUkUMo0nH0PLj+Ysf8fLzAkueU1/D bmn9awkowqMHzb7vpe X-Received: by 2002:a05:600c:458c:b0:476:4efc:8ed4 with SMTP id 5b1f17b1804b1-4801e30d9famr6888885e9.11.1768500407127; Thu, 15 Jan 2026 10:06:47 -0800 (PST) Received: from [192.168.0.91] ([188.252.173.121]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4801e9ee40asm514015e9.13.2026.01.15.10.06.46 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 15 Jan 2026 10:06:46 -0800 (PST) Content-Type: multipart/alternative; boundary="------------6hYKbeqa5YLJr409S0qfxHSK" Message-ID: Date: Thu, 15 Jan 2026 19:06:45 +0100 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: RFC: ACPI-based PCI device hotplugging for bhyve To: Roman Bogorodskiy Cc: freebsd-virtualization@freebsd.org References: <66a1c389-6b87-4062-aa2d-a1123f9edc97@freebsd.org> Content-Language: en-US From: =?UTF-8?Q?Bojan_Novkovi=C4=87?= Autocrypt: addr=bnovkov@freebsd.org; keydata= xjMEZdIQsxYJKwYBBAHaRw8BAQdA/V2uVmdN7VY2Ps8wDgLlWU3b9+kPdg9bf+FHgEEX49TN JUJvamFuIE5vdmtvdmnEhyA8Ym5vdmtvdkBGcmVlQlNELm9yZz7CmQQTFgoAQRYhBLAb6L2d hfD6hKflVB43npi7IZ8rBQJl0hCzAhsDBQkFo5qABQsJCAcCAiICBhUKCQgLAgQWAgMBAh4H AheAAAoJEB43npi7IZ8rzb0A/0aY3c/XubbtQzNyA0xzyKNZlDc9zesxEMVi6rOAZNz/AQC2 QmBTBEcbyOKDfJ5m02LpudVi9thZxlrr2n0ZX9kgA844BGXSELMSCisGAQQBl1UBBQEBB0Dn 3m+8g7KTp3yC4CLICis/CIonFfNqQcJOVv6Gd73adQMBCAfCfgQYFgoAJhYhBLAb6L2dhfD6 hKflVB43npi7IZ8rBQJl0hCzAhsMBQkFo5qAAAoJEB43npi7IZ8ruPcBAJM5wq5j64RFu4sc zrryK4FeCTt/Xhfyn3UhT2hHuYkPAQDWHDN6XZ097C5wUkWUr8ywHDlMM5gWIDbr9TMUudoc Aw== In-Reply-To: X-Spamd-Bar: / X-Spamd-Result: default: False [-0.24 / 15.00]; NEURAL_HAM_SHORT(-0.93)[-0.928]; NEURAL_SPAM_MEDIUM(0.82)[0.822]; FORGED_SENDER(0.30)[bnovkov@freebsd.org,bojan.novkovic@kset.org]; NEURAL_HAM_LONG(-0.23)[-0.233]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.128.53:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.128.53:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[bnovkov@freebsd.org,bojan.novkovic@kset.org]; RCPT_COUNT_TWO(0.00)[2]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4dsWCF1cqGz3lgx This is a multi-part message in MIME format. --------------6hYKbeqa5YLJr409S0qfxHSK Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Hi, On 1/13/26 7:50 PM, Roman Bogorodskiy wrote: > Do you have a public branch with all these changes? It's a bit > cumbersome to pull them from arcanist. Yes, the changes are available at this URL: https://github.com/bnovkov/freebsd-src/tree/bhyve/acpihp Sorry for not including this in the original email. Regards, Bojan --------------6hYKbeqa5YLJr409S0qfxHSK Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

Hi,

On 1/13/26 7:50 PM, Roman Bogorodskiy wrote: 
Do you have a public branch with all these changes? It's a bit
cumbersome to pull them from arcanist.

Yes, the changes are available at this URL: https://github.com/bnovkov/freebsd-src/tree/bhyve/acpihp
Sorry for not including this in the original email.

Regards,
Bojan

--------------6hYKbeqa5YLJr409S0qfxHSK-- From nobody Fri Jan 16 13:28:58 2026 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dt10B2KjTz6PH65 for ; Fri, 16 Jan 2026 13:28:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dt10B1b9Tz4L6G for ; Fri, 16 Jan 2026 13:28:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768570138; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=j1N3E59n8ChjXjCmxyko7WQh/FrXCfXxtUTmwf6uHdE=; b=ClgRwZjLbvkkNCACaHybjSknxnlPmyqkYeT3tJLLfSDCYhSIPsI6HVMdO9a6f+gbJRF2SO NGz7f14+0AXNQU41C8ZnrwKOK/ssWMCCr0XhFom57fbsARVPhEkUydkw7CNUFGKGeYxd1I XcPFuXWtcL97l622rZqM+unDG8y6dM5lyIe3a9W9xsiAzqILvSpQvwl48ao8Vz4EiqpY7O tMFM89Cro0e+C0F0eOfGZdhDa7+cajKNQW/7TS/sbUnpw511BCi2OWWuVY7FlO745nW4jP pnWVrxxklx9FU91yifquWY/p6GqlbFUvp+Q6/PxXX5WiOcWM/Gt5Vl/9o0C2mw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768570138; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=j1N3E59n8ChjXjCmxyko7WQh/FrXCfXxtUTmwf6uHdE=; b=u6205Xc3mFJNshJFM68W3yGJjqiMmKUJHxsYM8Bcufzp3oMRwKZgjEXFGGYS9fXX06SOFo StlCJVFo5kQ5yIEO5KyPgcHdov+eItr37Joro4/w7T+piVHpQIRl9ZP7FZmLwdBBvz2MAe nDSQ9iL6QHzoVPVjtswcLAZvknxAVTCEUvwaxXdxgP1MwV/x0jzs/c+8extxuQNUzjKDK4 ZibTF4rq7B1L9wUaIv/Vrd1LxE2WjYhxbH5tNE+VUrd4O8qKnBfTO1xFhgGBJjl7sCTp95 ABwFYcvSHE7mDBxyVtOLhCHnhIInnIcA8hdjMFBBKbwh3gVvRObka5eRvz+lsg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1768570138; a=rsa-sha256; cv=none; b=YR6NNFVAmJ+y71IeQ0WqqYsmNNuq8eZbUrZ10+GlAgAtArsIzk3x3LMStm81WGlV70lVT9 6FxygGynYBJCsMCRAO9s59TSYc4OnAjqO3Yl2HOMpwcY8nbwejhBoSBXrqAD0hkVeLso8d 6BVDSoSZMvPT4yiu90sA2W3NHE99fs5qY/s7EXjBKkro9aaHMJWssrSlF7t50b201HuFbX 2BP6t5XP1OV8bChlx8mtate5gAXz28Sg+Vzn4w6hnsiLqpXBkQoM8LIHNwto61t2qSrfcH QXLtjIAwFly39rRwsbp1aE0vaCXxhYeqmRpUWfG0VW7e/WOKsQSqaeX13N3wlw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4dt10B1B43zy0 for ; Fri, 16 Jan 2026 13:28:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 60GDSwbJ074375 for ; Fri, 16 Jan 2026 13:28:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 60GDSwhv074374 for virtualization@FreeBSD.org; Fri, 16 Jan 2026 13:28:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 284913] Bhyve: Allow to attach/detach ISO image (as virtual CD-ROM) Date: Fri, 16 Jan 2026 13:28:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: vermaden@interia.pl X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D284913 --- Comment #1 from Slawomir Wojciech Wojtczak --- Still needed. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Jan 16 17:06:01 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dt5ph5gc0z6NYLK for ; Fri, 16 Jan 2026 17:06:04 +0000 (UTC) (envelope-from markj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dt5ph4qDkz3d4Z for ; Fri, 16 Jan 2026 17:06:04 +0000 (UTC) (envelope-from markj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768583164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=qgjGt6cl6uPsGQCFGoe61fHbqats9fg/nVju3QQQbYY=; b=avgwvcOi1P6rimVtxZ3inzv8RbiRRfZGl9N70nx3allih45CpiHek06BY/a7aQpr963aty 14RJkqk2JsvjLVfHfkzYJxSyZuBJ5dswg/SXlUMm8AoQ5OAN1jg3iuQG28xl8W+hRLYS4W UjD39HerLbJmbmEZWOWl8ZxWnq+K9SA5I1U8w0qVR2EBKrW6jhPoXISjrH7Gdel9czldIj kgPD8rgxvlGyZAANSr8P6vXwGmN6GWRnDfD4zdFOs1/o+SgypB9K2BC5iqXFsDZQXva6BP szLIZ5znlFMU2HjVBgmvEEDgAPBfA9HyHnkFj3TMERK+E7aVw0xmVkayUHjXtg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768583164; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=qgjGt6cl6uPsGQCFGoe61fHbqats9fg/nVju3QQQbYY=; b=pl8bl4UXge55HTlB4cByoeAAT4/dTVUv9KOqh0jboAUwma6cSc771DbM2HHkc6jeWb5AMD NOAFW0tjKSXdfaf6unzYnEhv+lUGI/2JKwCBG2+o7qBDMFvfqrxGMGsPFu9GMMYXbT96Ab HlbyXScnhN6VatrcKvpV8ktdDTx2jue8lAu2cVsub7rcM74vCjoUv9rdVPeOj39nUYVEPw +JflMj06lU9eriXTAEstnULW5CcVMff8y0d6jA29uEBbtqJZ31W3r/2o9g9gsyGH2OV0xs TMLyJCS2tndfLqkEqEOWHJpSrCK7bqhDSBZjXKCC4L7sVwKuykzLwoyIjqXkeg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1768583164; a=rsa-sha256; cv=none; b=tyYDvsKhxHZhNnl5RaajtvxQYcZqBqyFHKyRDIErfKW9q8Qqq8C8tSRHt63Yxgj0v++u1f j5sndj3uDnh2rUnb+RcwIHLMtaGq7+URgUoWXh/iDZTVuTDUARwwvARfK+5VkTHwQtEJi1 XZBgFisKnlCc95GW7iKVQi/s/Zd0+LDDjqx4oUSZehSyReBIvj4BmQn+yGIwxkwQ+pqUKu aR3is6urW/UYFPVaeGwSftraSO/2u6Rmb9npQrgNJH0by2ZCUIIPfeyj33Kzr9gc+Tk5W4 hWStCw6vttGDQALcskjaOUYKZZgyHh/ICquhwUbNnGHqvF54iN5rlpHWWKt19w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from nuc (192-0-220-237.cpe.teksavvy.com [192.0.220.237]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: markj) by smtp.freebsd.org (Postfix) with ESMTPSA id 4dt5ph3Cl9z15v6 for ; Fri, 16 Jan 2026 17:06:03 +0000 (UTC) (envelope-from markj@freebsd.org) Date: Fri, 16 Jan 2026 12:06:01 -0500 From: Mark Johnston To: freebsd-virtualization@freebsd.org Subject: new vmm group to enable non-root bhyve use Message-ID: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi, I posted some patches for review which add a new "vmm" group and modify the default ownership and mode of /dev/vmmctl. The result is that regular users that belong to the vmm group will be able to create and run bhyve VMs, albeit with some caveats: - They must run bhyve in "monitor mode", i.e., with -M, to ensure that the VM is destroyed automatically upon last close. - PCI passthru cannot be used. - The user of course needs to be able to access any filesystem resources specified in the bhyve configuration, e.g., disk files or tap devices. Note that the slirp networking backend has recently gotten some improvements and can be used as an unprivileged user. The /dev/vmm* device files for a particular VM are owned by the user that created the VM, so the same user can inspect and destroy the VM with bhyvectl. The patch series starts here (follow the linked revisions in the "stack" tab): https://reviews.freebsd.org/D54739 Any feedback or comments would be appreciated. From nobody Fri Jan 16 20:30:30 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dtBLc4Dy1z6NqQY; Fri, 16 Jan 2026 20:30:32 +0000 (UTC) (envelope-from markj@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dtBLc3b58z3ZBr; Fri, 16 Jan 2026 20:30:32 +0000 (UTC) (envelope-from markj@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768595432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=QrWfLwdcLNeCKTWyohTC7e4uqoXv688t6USFgFX5eWw=; b=yIibmCimxgJH8U71oysC8/PzgciE1/KVeuvIRYotqlhf7/XBJfExBDPHABHk58hio4Vi1U kj/4VBv1ryf6ch+uuufHDEAE44I9nqQ/UFi3wTf8P1e7BPw7mxk9TRDV31OietYX8QQmYB Y7Or1ORkUenzEf9/2lQ1lL6j0pfo3OJETbwWpAjGc0dAWEgFYLCpH9h+raGmzEfAVE8K6f GO3XwgFvBTJWgCDhj3vr0DUcbsoSWaHhQWU30Zt13gxB5rK6kDfxZrjT5/BBVgh1yavFMe Sil9ACyC30LeXMOGgHc45OJ+aNq5r447Z6p29n5M/7wmZUQhklyIT5jUyIpwTQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768595432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=QrWfLwdcLNeCKTWyohTC7e4uqoXv688t6USFgFX5eWw=; b=Rv2ONwBjK5USG7z60nEP4Anjbo6vdLdPJZ3nXhHnmbyxCrumEM9hkY6aqbOU706pxuPobw hdr41JoJm7GxsltOLZTzyXHkp5sl9CpS3FNmDUG+zMqSG+degeuvedFKt8ml70ZFb2xG3V 7sRdACPk9QerMmdpFicNA+afPxUdgBWs84gGCva8ZG66An+ynWsiNCXuvMR7Tx1WbGJKmM ewrwiALOT6yGbbgELDLY8OWMoeDfd/+t1290PlOYr98EE3BlA7vi6shBHvZ0e9qt+AEwiG z3ocU7JZ40n2iL27l9ZMGka1h0ZpFWpfsvOY02jeDRFg9RSbJa6sfinQlayMxQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1768595432; a=rsa-sha256; cv=none; b=PLX4mmbJN3EvMmG9C3HhSEybTbXbwMvZKdr7VoC0h0n1hLsu3+h1sk/W4kbi6cf44nuFAV 4y/KwhgoI6iETrgacvwoWoMNSQrC9mwztDmoh8NXYUWPB429N83m1jL7PZLYabc2D3m7gy TFoOubcwbX/5rIIJkOC9Be3wlKTitHDVNAH5jhzIfup6Sn/a8vKJSqe1wH4o8EKVWCdVCB A76uxtCUxguM8SGvkELSkKS2SkgQYPz8fXhoKR9sKUReBP1zplw0mu14PwqpZemuDcN6Ay iO0N0fkmD7WbioeWwjLlICiKG2i2iVsVimVnjf+s+aNRWxMYpZYjWXPb+aM3Bw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from nuc (192-0-220-237.cpe.teksavvy.com [192.0.220.237]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: markj) by smtp.freebsd.org (Postfix) with ESMTPSA id 4dtBLc16kyz18YJ; Fri, 16 Jan 2026 20:30:32 +0000 (UTC) (envelope-from markj@freebsd.org) Date: Fri, 16 Jan 2026 15:30:30 -0500 From: Mark Johnston To: Roman Bogorodskiy Cc: freebsd-virtualization@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Quartz64: vmm: No vgic found Message-ID: References: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Thu, Jan 15, 2026 at 06:42:10PM +0100, Roman Bogorodskiy wrote: > Hi, > > Loading of the vmm(4) module shows errors like: > > Jan 15 17:32:10 generic kernel: vmm: No vgic found > Jan 15 17:32:10 generic kernel: module_register_init: MOD_LOAD (vmm, 0xffff0000e12931f0, 0) error 19 > > The module is listed in kldstat: > > $ kldstat |grep vmm > 7 1 0xffff0000e1268000 4f000 vmm.ko > $ This is due to a bug. vmm.ko should unload itself after the error you observed above: https://reviews.freebsd.org/D54750 > But bhyve does not start: > > # bhyve -o bootrom=/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin -s 1,virtio-blk,./FreeBSD-15.0-RELEASE-arm64-aarch64-ufs.raw -o console=stdio vm0 > bhyve: vm_openf: No such file or directory > # > > Host system is: > > Pine64 Quartz64 Model A > FreeBSD 15.0-RELEASE arm64 > > gic0: mem 0xfd400000-0xfd40ffff,0xfd460000-0xfd4dffff irq 12 on ofwbus0 > gic0: using for IPIs > > CPU 0: ARM Cortex-A55 r2p0 affinity: 0 0 > Cache Type = <64 byte CWG,64 byte ERG,64 byte D-cacheline,VIPT I-cache,64 byte I-cacheline> > Instruction Set Attributes 0 = > Instruction Set Attributes 1 = > Instruction Set Attributes 2 = <> > Processor Features 0 = > Processor Features 1 = > Processor Features 2 = <> > Memory Model Features 0 = > Memory Model Features 1 = > Memory Model Features 2 = <32bit CCIDX,48bit VA,IESB,UAO,CnP> > Memory Model Features 3 = <> > Memory Model Features 4 = <> > Debug Features 0 = > Debug Features 1 = <> > Auxiliary Features 0 = <> > Auxiliary Features 1 = <> > AArch32 Instruction Set Attributes 5 = > AArch32 Media and VFP Features 0 = > AArch32 Media and VFP Features 1 = > CPU 1: ARM Cortex-A55 r2p0 affinity: 1 0 > CPU 2: ARM Cortex-A55 r2p0 affinity: 2 0 > CPU 3: ARM Cortex-A55 r2p0 affinity: 3 0 > > Does the board need something in addition to GICv3 that is missing that > is needed to make vmm(4) work, or is that a configuration or vmm(4) > issue? The vgic driver is refusing to attach, apparently because we don't detect virtualization support when probing the controller. When booting from a FDT we look for an "interrupts" property to determine this, but it's not clear to me whether that's totally right. Can you share the device tree you're using with this board? From nobody Sat Jan 17 17:19:47 2026 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dtk4N1fXxz6P16K for ; Sat, 17 Jan 2026 17:20:04 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-ed1-x542.google.com (mail-ed1-x542.google.com [IPv6:2a00:1450:4864:20::542]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dtk4M6qKBz3g5K for ; Sat, 17 Jan 2026 17:20:03 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x542.google.com with SMTP id 4fb4d7f45d1cf-64b8123c333so4770756a12.3 for ; Sat, 17 Jan 2026 09:20:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1768670397; x=1769275197; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=4EM47Lu6Ph/FvGxY8fKoxSEL7etgrDeW2u/LunTJn1U=; b=RplqrvaYlJWB5jYScTjdvXVQqa9MW2qPLv4u/48JP8jCn68wvX5Tqud2DsckeCx2rn LWL9lamKShvxhraoGVk+B9Z7bzFEzSFXgJwMOukGPLbqYwAhcv5XeePJN80y2Hdrk4Ec qGnSknT/GVddZJnPvurM0NiSmLIGRRnvrwpsALSk9MKLrOyUdsuXs07OW5lvYIJAmlIq ke9E1hKg3gWlAu+tv1LOtQPQMEee9lRLd+0FzXyxJ5jFGwEL1yx0DAY6yeN4HmdvLs92 1hDUekTZiX1Sc9P1o7Jd6IjKv3JERPaVRNWgvZk3/gLuemrAeMAVbCKVGp8fpjitpvNg mvYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768670397; x=1769275197; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=4EM47Lu6Ph/FvGxY8fKoxSEL7etgrDeW2u/LunTJn1U=; b=fq6Rrmw8ZB6xn56oOiYrOiPe+YZw2xxb31b2xl8KJyvWP6b1dCxFPVSQtANziutajh SOJhJ9udh9nAcQYgzYuzOkPYPPVFpje4AKWkmAI+amzpKUjJop04g+sJEW9/1UKPvzRY MNdyvjDhFWdfuwPZGyiO7Zcd+J4qcJNaM3Z9Almmm6CqAcfeJJuXwlXhAayErSjjgyqa ldtixpQINHiGZhfFjEFwD5ef4QGaT3wiVriqXrQ2Iwb+c53Gk2FDpzyQ3F+KWb1HobOf a54y97dWkmzqvTx+T8i+xYgcYDReOM9960vcYDmTRkNtFucWJxd8ZVWIi0KxIFPfqhcD V4hA== X-Gm-Message-State: AOJu0Ywz11w/ptDyNUaqWsuGGy3KzxTIhIFGQgqIp4o7kqD587V0+lYS Qr7VrBCJmjGnmhkHzzJqy/b1GXOTeAtDOgXja/q5BI40yHYv5o3B8jTN/Dll6DFaMt0= X-Gm-Gg: AY/fxX5kZP5Tp3CAjhpr+1gDFmt/FL+N4th3rLrBkCYYDGJKG4aokBjpAs+YK66Av7R UmGVdr7badP6ngR5yvFf0yCSspT9+effAcQEcsg9rLdmb+MszyxAO6rx7ZH2tMkauQbwxqZnUzk 7tTDuJ/YC9yUqFRKO8dpqnHt+TaIDlmWYUlmMeRGaXJN6UEKr6XmP58+ejynt8T0L/IdnxsuWiL oSY6VI5wuVLkYqTJL+/XXAHFtEBop/9EHxW/UJ1trYzeIu6et65emsQ1bh+cCW15kweiN5E/MTb EgfFt7X7X9zJkYr0XhzHOErLgCDsXyOgki9qZP6B8f6n4iRF9daKlxH2LqpHy7WRp+FnFqqZeX7 TFpgylHIggjwSCul9g1JSd2dOmM5hyGRqCjo6eIWW9/ETp21epvhkZwSTWNxG7PsAtU+8WV4rHX bOqbjH+mTI8KlDxxkFcXZoPEDyBSXjyFGPxh08cjXFZlro3cCQizTj1R3Ef8/BYJSLe8/XwITuz 5Y7fw== X-Received: by 2002:a05:6402:2346:b0:649:9268:1f43 with SMTP id 4fb4d7f45d1cf-654bb32c88fmr4329982a12.21.1768670396796; Sat, 17 Jan 2026 09:19:56 -0800 (PST) Received: from tulp (2001-1c02-1a15-3000-c218-03ff-feb5-6cc4.cable.dynamic.v6.ziggo.nl. [2001:1c02:1a15:3000:c218:3ff:feb5:6cc4]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-654534c8694sm5681867a12.25.2026.01.17.09.19.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 17 Jan 2026 09:19:55 -0800 (PST) Date: Sat, 17 Jan 2026 18:19:47 +0100 From: Roman Bogorodskiy To: Mark Johnston Cc: freebsd-virtualization@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Quartz64: vmm: No vgic found Message-ID: References: List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4dtk4M6qKBz3g5K Mark Johnston wrote: > On Thu, Jan 15, 2026 at 06:42:10PM +0100, Roman Bogorodskiy wrote: > > Hi, > > > > Loading of the vmm(4) module shows errors like: > > > > Jan 15 17:32:10 generic kernel: vmm: No vgic found > > Jan 15 17:32:10 generic kernel: module_register_init: MOD_LOAD (vmm, 0xffff0000e12931f0, 0) error 19 > > > > The module is listed in kldstat: > > > > $ kldstat |grep vmm > > 7 1 0xffff0000e1268000 4f000 vmm.ko > > $ > > This is due to a bug. vmm.ko should unload itself after the error you > observed above: https://reviews.freebsd.org/D54750 Thanks for the fix. > > But bhyve does not start: > > > > # bhyve -o bootrom=/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin -s 1,virtio-blk,./FreeBSD-15.0-RELEASE-arm64-aarch64-ufs.raw -o console=stdio vm0 > > bhyve: vm_openf: No such file or directory > > # > > > > Host system is: > > > > Pine64 Quartz64 Model A > > FreeBSD 15.0-RELEASE arm64 > > > > gic0: mem 0xfd400000-0xfd40ffff,0xfd460000-0xfd4dffff irq 12 on ofwbus0 > > gic0: using for IPIs > > > > CPU 0: ARM Cortex-A55 r2p0 affinity: 0 0 > > Cache Type = <64 byte CWG,64 byte ERG,64 byte D-cacheline,VIPT I-cache,64 byte I-cacheline> > > Instruction Set Attributes 0 = > > Instruction Set Attributes 1 = > > Instruction Set Attributes 2 = <> > > Processor Features 0 = > > Processor Features 1 = > > Processor Features 2 = <> > > Memory Model Features 0 = > > Memory Model Features 1 = > > Memory Model Features 2 = <32bit CCIDX,48bit VA,IESB,UAO,CnP> > > Memory Model Features 3 = <> > > Memory Model Features 4 = <> > > Debug Features 0 = > > Debug Features 1 = <> > > Auxiliary Features 0 = <> > > Auxiliary Features 1 = <> > > AArch32 Instruction Set Attributes 5 = > > AArch32 Media and VFP Features 0 = > > AArch32 Media and VFP Features 1 = > > CPU 1: ARM Cortex-A55 r2p0 affinity: 1 0 > > CPU 2: ARM Cortex-A55 r2p0 affinity: 2 0 > > CPU 3: ARM Cortex-A55 r2p0 affinity: 3 0 > > > > Does the board need something in addition to GICv3 that is missing that > > is needed to make vmm(4) work, or is that a configuration or vmm(4) > > issue? > > The vgic driver is refusing to attach, apparently because we don't > detect virtualization support when probing the controller. When booting > from a FDT we look for an "interrupts" property to determine this, but > it's not clear to me whether that's totally right. Can you share the > device tree you're using with this board? Not sure what's the right way to share the device tree, so I used the command I found on wiki (https://wiki.freebsd.org/FlattenedDeviceTree), that is: sysctl -b hw.fdt.dtb | dtc -I dtb It's lengthy, so I uploaded it here: https://people.freebsd.org/~novel/misc/quartz64_devicetree.txt And some more details. Until today I was using u-boot, sysutils/u-boot-quartz64-a specifically. Then I tried using Tianocore EDK2. Apparently, it supports three modes for devices: - ACPI - ACPI + devicetree - Devicetree The devicetree mode behaves the same way as u-boot, i.e. the vgic fails to attach. In the ACPI (and ACPI + devicetree) mode I can actually start a bhyve VM. However, in this mode Ethernet interface is not detected. Earlier it was available as: eqos0: mem 0xfe010000-0xfe01ffff irq 28,29 on ofwbus0 and now it's completely missing, though I can see it in the device tree. Does it get confused by ACPI presence? Roman From nobody Sun Jan 18 21:00:12 2026 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dvQvw3VVFz6NwnK for ; Sun, 18 Jan 2026 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dvQvw1tv5z3pQ3 for ; Sun, 18 Jan 2026 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768770012; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jiTW2hzrif6t+eXs8ngbxNo5oHNW9Wh5DbNpJWWOYT4=; b=ZXKY9KXRcjS+c1+llx0Xgr2WK0IUvZwgRrccnhjQR/+CJti3/fAnLBWx2Uza1nzZLaidSg cB8GeVOOftdbaswGNUi/GL3ffi3h4DlPW3zcg8EOANCUHUTtI3wmoekSwRqDqDyvELJ0e8 vPMcuU6UVhJht3G7SbnCl35/wBp0mG1ZlVMi0Usacupsk0NBNC6GXJxEmafPc94A0am8NE n+NkBKzPbA+jykBXv8d7qiOH1Fz6Oz0B5Cyt+VphlkL3RFawH8G+bf+crNsw/7VDxwotgJ xrB50J3KTjMyvkMf3H7ICjvhWjG7siAyfYTYdVSaLHsKbQbGQmP+Dex6qAp8zg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768770012; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=jiTW2hzrif6t+eXs8ngbxNo5oHNW9Wh5DbNpJWWOYT4=; b=QTImQq5peybEqDsHgyRi7W0aJyITzIEBj4rkXbHy+tUmV7bDDbbJGezUnPoLzLJVjgFTIq r4+oZv51rBlNMUqlN6KhESlbk3/k9aQ0qub+MnKqG209khElfqWQnYsJ40gowhQUDWdvPO zjEtqIZqj2l6NHZLVDAxnt4gFIdIyNM0rYvWyzk+j4CC1RI14ZR1uYcvtgq4dfmUnoMTmZ eOToUXNym4xQ3GFT5Ssl0NXpy6s5qPiigZ93Q7n0+cO9moMwb6e3AB1z9z5/VAjuQM/94m slr67+fdgUj+ISm9zDQjnZ9YpAQ9yHuGzywjk4tC0zrN06IkzeiV0nY1sNom7Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1768770012; a=rsa-sha256; cv=none; b=xvMtdNGJMiASExHrtwxD8BS/8E+jO53LKxM8J0JSK1eWa/BXn835d5dI2hnfFhOUG2uNzd 2HPlefgsXIhrXSbdJAavGWJsu+su1MMuigSIcub2gdD88ZH3pV+qM4tAnHp3Jfj8GKX8Ff Ziz4pljerSyDDgMYOrz6IQPEdbs9OC6qsKnrjvBL/KmxPQBYp7MzrV92KOe+vt8GPwpjVR kVoT4hPWAprF5OKRILLL2LWlvUIchsLes2mE1oPsrtoDoefhYmWkiBQnwffyOBbR9GFK9C 1NDuF97E5bYQzmxaWG0iHCvHU8dkOoYm7rKOx/F9Nja8sm1+iMDZai3RTrAdcw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4dvQvw1VcWz12TX for ; Sun, 18 Jan 2026 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 60IL0Cdo011831 for ; Sun, 18 Jan 2026 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 60IL0Csh011830 for virtualization@FreeBSD.org; Sun, 18 Jan 2026 21:00:12 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202601182100.60IL0Csh011830@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 18 Jan 2026 21:00:12 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17687700121.26ce7e8.9429" Content-Transfer-Encoding: 7bit --17687700121.26ce7e8.9429 Date: Sun, 18 Jan 2026 21:00:12 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 289848 | Enable by default BHYVE_SNAPSHOT 1 problems total for which you should take action. --17687700121.26ce7e8.9429 Date: Sun, 18 Jan 2026 21:00:12 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
New         |    289848 | Enable by default BHYVE_SNAPSHOT

1 problems total for which you should take action.
--17687700121.26ce7e8.9429--