From nobody Tue Oct 28 15:58:01 2025 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cww5C4s9cz6F56j for ; Tue, 28 Oct 2025 15:58:07 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x72d.google.com (mail-qk1-x72d.google.com [IPv6:2607:f8b0:4864:20::72d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4cww5B6rsDz43mt for ; Tue, 28 Oct 2025 15:58:06 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=H3hK59UM; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::72d as permitted sender) smtp.mailfrom=markjdb@gmail.com Received: by mail-qk1-x72d.google.com with SMTP id af79cd13be357-8a479c772cfso142449785a.0 for ; Tue, 28 Oct 2025 08:58:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1761667085; x=1762271885; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=jaQUJ2URlM+Leai6XaFDYFuBh+vNYL5tkmmPviI24oU=; b=H3hK59UMWQYBmN3aHRO7NeMD9nS++4Q1bXexdvxx4tSlohed1/hOeACZWdwpT8DnvN 2gwxy4e8VQ8nmgNdB9nOcED9colzduZkjQxINRCR+O9ef89T6g7wQMJuwdu4/ibl1Iaf irBoSX7LFsx3rOIYN3XR5kLTuyUYKYtqtDsfGc+Va2+uz47vY/5cTJDHljIfxaed5xHZ kBPyPxVZz1qArT8CGsE31fVyfK8lwS022mmOk1/LIDS+oAtCGW71gIudorVZcemPeKYw h2IhXuUgwp/FRVSUztPUKy5EOPYlQ3Do2l8k7lqpS9He7zdK/pGbpJkru1SamJOf7EbI t/Qw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1761667085; x=1762271885; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=jaQUJ2URlM+Leai6XaFDYFuBh+vNYL5tkmmPviI24oU=; b=hO1gADLminC7t3Fz8kqJSAeBYOitysbgrWGPxrO87iLENdkBNR3ybvYvB3/xvQl83U CECNjcrCsVzPdfY67p76HSofcRQNDpTzfycXpJUNm+EfQqoN19P1xVfdBEM4v3Q3u+0A kJ39gX+TxSCoB3EZTKMkpq0qVPKr7m+3F/S+vqDY0Fowg3O0GgX3PJErarBW5TwnKsOQ VmGuklbzJkBOXdFbSUpoA3unGIldRoSa45eSnTUyJu4VRjyWVruSFDieH5rruKVSaLhH CmlO8YAo9iRG8fEXHbJKet3rIetaQoDRtSRbFgVlSFB/hTApv9214xkr7nQGUwq53BS4 ygZw== X-Gm-Message-State: AOJu0YxYo0+JAntbBwMTb8piNb2+ICmI5z+pmUtR9MLustCqynFT5CF/ qTh2+oGi84Ipz3XwX5v4n7aw0oa0ZciyY8qIF2BoC3N3Kdmi3AwhDIIL X-Gm-Gg: ASbGncv341wyahmGmXHK1hWTPV+izrh9eYk57RjjRaXM9+X061p9eRmsy9Rz77gcdxF Qh1rztz+qKIrrjiyq7LAdj3gdxL3iiNxD8EJyqK1DtBPhYlskk23FNWC79DnIymR/LsChHDWGUx 8t1GV/Vowywe2EbM03SIlB4Y70ct+lMetk33Om9mLT8JuNAXHPqFzYnZ8OWSH5n5hU0QRY1Bf3Q bfegASUh+CyEBgLzRQh/5MWui9521MABhKIJB40KTnUpXNRfzIUj+ianh2okWbHdEjcaWxjLYul 2reAckfI7+82ZLdtNBb8OsjVmK+rCBRUBmecFthDPaKEo8xGzTbywQ84CFEr+1XQXmkuwZFAyAY UFjYWilIwgcmAfOVeSm/pyOVrqkmU8NCzjhDF6k4PCIc+28A684R9JMppI2weKBjywQgkKXIhCz G8+b40wb0= X-Google-Smtp-Source: AGHT+IGwCF+npc4pJAuLffBJNVSCXe3lxK0oyW8gv1bYCiCvs8HyDpCW9QSwCq+ndIpbpiym5EqImA== X-Received: by 2002:a05:620a:44d6:b0:89e:c4d2:52f0 with SMTP id af79cd13be357-8a70137a5d9mr428469785a.77.1761667084504; Tue, 28 Oct 2025 08:58:04 -0700 (PDT) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id d75a77b69052e-4eba37d7db2sm74601101cf.11.2025.10.28.08.58.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 Oct 2025 08:58:04 -0700 (PDT) Date: Tue, 28 Oct 2025 11:58:01 -0400 From: Mark Johnston To: "Sean C. Farley" Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve command-line option order Message-ID: References: <385a62cf-22ad-c1ed-13fe-1ac8c7ab1408@FreeBSD.org> List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <385a62cf-22ad-c1ed-13fe-1ac8c7ab1408@FreeBSD.org> X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.60 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), DKIM not aligned (relaxed),none]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72d:from] X-Rspamd-Queue-Id: 4cww5B6rsDz43mt On Thu, Oct 23, 2025 at 10:00:42PM -0400, Sean C. Farley wrote: > I wrote a change to vm-bhyve[1] to be able to pass the options to bhyve in > the correct order to use GPU passthru. In the incorrect order, bhyve will > return an error. The question was raised: Is it expected that bhyve will > return an error depending upon the order of command-line arguments, or > should it be handling this scenario? > > The issue is when "-s 31, lpc" is presented to bhyve. If it is passed prior > to "-o pci.0.31.0.pcireg.vendor=host", then there is no error. However, if > it is in the opposite order, this is returned: > > $ bhyve ... -o pci.0.31.0.pcireg.vendor=host -s 31,lpc ... > pci slot 0:31:0 already occupied! > > I will be updating my PR to make things a bit easier regardless of the > answer, but it would be nice to know if this is intended or not. I don't really think it's intended, it's just an artifact of the way option handling is implemented. The -s option creates a PCI device and raises an error if one already exists in the configuration tree. The -o option adds arbitrary configuration nodes and silently overwrites existing nodes. One solution which allows both orders would be to process -o options after everything else. It's hard to say whether that might break some existing command-line invocations though. One other option would be to make -s more permissive, but that would make it easier to flub command-line invocations. > > Thank you. > > Sean > 1. https://github.com/freebsd/vm-bhyve/pull/56 > -- > scf@FreeBSD.org > From nobody Wed Oct 29 08:11:22 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cxKhB6Zfhz6DJVP for ; Wed, 29 Oct 2025 08:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4cxKhB5sbTz3qh1 for ; Wed, 29 Oct 2025 08:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1761725482; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ngJArPj/rFLh4ltEnbjJH9PEfvIr/0TZKI/5KwVIIdE=; b=a/v16QvK3TfB9M96QXe6/XckfYKhAZYoNR/W1mJIACkOmKgH+r53p6WCbDiInrjtQrS+4Z jmYLDIfBLY84u6nR0lqWauDmRdkgk/66xnnXbmnRp1n431XIn3KgLJ7jZCU6fptwfDLPZM 4RwzFqXkrAF1lxExT+6Axy4nuIhb9lMt8oOCqgPvolNxeweqECHwkAwtO+gR36vXwmR11o U181OttT/VDfiRtQ0hYBw9uWEWC2dxbeOLiEQS8EvyXy68F8q4EYCSNXMkcnSxUy5ZDOKI BC3SR5tVIqzdpII27CLf+DVYOgDQtKiAlzecx/MzMTJYojnioaSAtSBQn62/vA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1761725482; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ngJArPj/rFLh4ltEnbjJH9PEfvIr/0TZKI/5KwVIIdE=; b=fOwFbvF2Gc7REvMiwZX11N6NnmLBSnsvgotK4L0786eRDpLV54HsSmZ++8pf7l4L97vAwR aw/rwU+zNU/sKNX1SbolsAYYIP5mZ0IiGNMf8+Xqni5J5naVjcjmX9oqZM9M2XFE8W3ABU XOHKs+lCI7GAfDkSLuD2f0BVY9NU/Tfy+Ox5OdyDWPbZgMuUsJ4MEYFCwzNPyYG0M4LtLz lbIIxzRKOWNrc3HlUZiNVHc7ZZfygmFyN7YSPOirfl8lcnI5Ik0WV8Or3INPrDqgLe74/8 WFwSHz4PMFagohfX/6DAY284VGrIp2jbz8zNC2/9S9yZaexL7SvIPED4pmF3Jw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1761725482; a=rsa-sha256; cv=none; b=rsbHT12TieYXjxfrM7aUZF+n1FieoIpJmBmItr3ut6tXasiHx/2jR5Bo7Inbv/acc2btui 2dAuFdfAbMrFFEM7OiuzB3KhQTqE0rxHcwpBA0knLqolhhyoW3ObTsdnn9UR+S4YfwJF14 wAgfnuTQcvvNyyri7JRlPSbpI0arnCRzfhTOHKBZzCrSKrn5qgqxRD7NkwRU1qA7T6QbX/ trzjb+chD6uckAEPTu/15Nq1VaEEdSPK4A3UInW4zfvps9WDYho2mDsloFC3y/6FrBC+yK 2mLtaqQlxqQniOeaKTw8I10Szaix0w4b36yJPbVkeUdGjjZcEbfbwAir6VoQDA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4cxKhB5KX7zCGc for ; Wed, 29 Oct 2025 08:11:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 59T8BMJp075042 for ; Wed, 29 Oct 2025 08:11:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 59T8BMMh075041 for virtualization@FreeBSD.org; Wed, 29 Oct 2025 08:11:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 282891] gptboot and loader.efi can't work with geli encrypted virtio_block devices Date: Wed, 29 Oct 2025 08:11:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ant_mail@inbox.ru X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282891 --- Comment #1 from ant2 --- It seems that the problem is related to qcow2 image generated by FreeBSD sr= c. VMDK works OK. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Nov 2 09:39:22 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4czqRt4Gmxz6FP0G for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4czqRt3Tnvz3DVW for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762076362; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=OYzafobkkl7Ar3M2eJ4kCwjWdS5MfbqVWHIpOFsg7Oo=; b=NWS/VRLcKOHCmDBCGe1SK4ShMxIjmFvgiU3J/+dw9AOuZ1Zril1tGX3qHDoZibR6i39UA+ PLw8GIXwR/0xKoVqUYFeXPvvlwk0p+r1M/iSVHxfsO+hPqiG7gkVaSsxFmupzACR+Eb/7/ GxMAeZCPUGABmB+cHm/wTJzkgWSlNwzNlwk6t+bxidBjrL4plhZmiuMtBVKgPU5RyqZ7MW +HHzlRbd9NO9R8QI8xDckBfOiyvdQppZIIyubm6gcQFkCbwPJLr4ophOvDeFqte63scLwJ tEvWalukoBVzskhHmxKIVK/lCtoGOOQ4K88CwIjluYJVaGWFIHmjWx7Fu3K3Wg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762076362; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=OYzafobkkl7Ar3M2eJ4kCwjWdS5MfbqVWHIpOFsg7Oo=; b=qdev1Fa5Icjujczej2ZSZRMpgepqwZ6wZGO7vtoGgTMq+AXUwpIZAPm6kK2nJAdv7sn11p 5QrCV7RASJOO7XibtkWDu05b44SPyzTIlDl/bsiBov5viVngzIFq6Ruz3YkEOw5uw2MUR2 lowblhEH+Nj8Sl5yJU3f7fIzk04DABmUOXEMHCYnTqcl56URXQvJuGEQqKSHwMYTYMI8rY J3/ns0KP6nV3T+dltyEMwGFN+P0uPkwymLfl5K9ZkVSTToZJuYh5MNhx65N0xNZZF+V/E0 k+ppHiNVd4aiUZB1W3DxHE497jyxd1KZttS2ikw0YnlrgDtYRKIppMO5Mxg2pw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1762076362; a=rsa-sha256; cv=none; b=TxrId8u7pw4sTe8/dw/k63+z64shlLaMlLD1mGu2Q2PTiMd23yxpJl/HUdCZ3priQ2PCAH p1qgGVMPb1benRT2+G6LRQB5MwU231sldwepPx+xb2PmIUTk89vBPQ0jSEO62tFEuNW7rS OPb/cI24J35LU5ChD2GbTy1HXFEOW2d9IK6Tx8UODwqDdUhRvSoLTjr9DKJnS11pqLI+3E KijIYFIv2CkOpqxj9AYIV03Kpys2gtAGHdBQ+D0XcGUyFXO4eAK0y45/nfACH+6Xrbwk41 rH9asPUbeFsOPBww/mdPyiMygndsDSJ0gOk0JhUi4oL2rClvkUzljfzDNGIxIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4czqRt2hXQz3yD for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 5A29dMiE042024 for ; Sun, 2 Nov 2025 09:39:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 5A29dMpP042023 for virtualization@FreeBSD.org; Sun, 2 Nov 2025 09:39:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 290735] bhyve resume hangs Date: Sun, 02 Nov 2025 09:39:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: novel@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D290735 Bug ID: 290735 Summary: bhyve resume hangs Product: Base System Version: CURRENT Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: novel@FreeBSD.org I'm trying to use suspend/resume in bhyve. I use FreeBSD 16.0-CURRENT #0 main-n280778-f45608124286 as a host and Ubuntu 25.10 as a guest. I run the guest using: bhyve -c 2 -m 4096 -S -A -I -u -H -P -s 0:0,hostbridge -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -s 1:0,lpc -s 7:0,virtio-blk,/data/img/ubuntu2510.img -s 5:0,fbuf,tcp=3D127.0.0.1:5957 ubuntu2510 I can verify that the guest works fine, i.e. I can attach to it by VNC and = use it as expected. Then I suspend it using: bhyvectl --suspend=3D/var/run/libvirt/bhyve/ubuntu2510 --vm ubuntu2510 That also works as expected. Then I try to resume it using: bhyve -r /var/run/libvirt/bhyve/ubuntu2510 -c 2 -m 4096 -S -A -I -u -H -P -s 0:0,hostbridge -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -s 1:0,lpc -s 7:0,virtio-blk,/data/img/ubuntu2510.img -s 5:0,fbuf,tcp=3D127.0.0.1:5957 ubuntu2510 At this point VM freezes. I can connect to VNC, but it only seems to display the last frame of the previous session, it doesn't react to any inputs. I a= lso don't see anything on stderr or stdout from bhyve(8). When I do: truss -p $bhyvepid I see that it cycles through: ioctl(7,VM_RUN,0x2a80700efda8) =3D 0 (0x0) When in this state I destroy the VM, truss prints out the following before exiting: ioctl(7,VM_RUN,0x643205adda8) =3D 0 (0x0) ioctl(7,VM_RUN,0x64320a9eda8) ERR#6 'Device not configur= ed' ioctl(7,VM_RUN,0x643205adda8) ERR#6 'Device not configur= ed' write(2,"vm_run error -1, errno 6\n",25) =3D 25 (0x19) _umtx_op(0x2df9dae5f488,UMTX_OP_MUTEX_WAKE2,0x0,0x0,0x0) =3D 0 (0x0) _umtx_op(0x2df9dae5f488,UMTX_OP_MUTEX_WAIT,0x0,0x0,0x0) =3D 0 (0x0) write(2,"vm_run error -1, errno 6\n",25) =3D 25 (0x19) _umtx_op(0x641ced8c6a8,UMTX_OP_WAKE_PRIVATE,0x7fffffff,0x0,0x0) =3D 0 (0x0) _umtx_op(0x641ced8c6a8,UMTX_OP_WAIT_UINT_PRIVATE,0x3,0x0,0x0) =3D 0 (0x0) write(1,"fbuf frame buffer base: 0x643196"...,165) =3D 165 (0xa5) _exit(0x4) process exit, rval =3D 4 In bhyve output I can see after that: Unhandled ps2 mouse command 0x0a Unhandled ps2 mouse command 0x01 Unhandled ps2 mouse command 0x41 Unhandled ps2 mouse command 0x88 vm_run error -1, errno 6 vm_run error -1, errno 6 fbuf frame buffer base: 0x64319600000 [sz 33554432] Pausing pci devs... Restoring vm mem... ^M Restoring pci devs... Restoring kernel structs... Resuming pci devs... --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Nov 2 21:00:04 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4d06YK2Cdyz6FTST for ; Sun, 02 Nov 2025 21:00:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4d06YK0s7yz3h5H for ; Sun, 02 Nov 2025 21:00:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762117205; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=GE45hhNtpkW2bwvumtUdlZ7j4JFnpXVgix8nxbHmpiA=; b=WSIkFAP0t+VEFRBq8KZvw0R6nLqDsESycJ6YhYYWMJ6JQgWLRuwFYfLQw5oiHmEJ2w2hEj PK5MJgZ/97lM6B0tOTvCGAdoMymucvJRGTfMSEJjQSLwREAuL9CYiUWrZlLA2k/f1qwFOB rxrSMXrIP8IQtTyO7LqpEHl6BmMwzghbCNCzm/uNYznqLh+obb0/s8KnHzsooQ81Ktz2At hT11Pa33xnrxoYoJVujfG3oul0yvY4gKcCeWoC2zsNyx/ABV4F+YDJ89KiHNlM0z+l/1f+ amVcXVRkB5ECEasFnQfj6PIVL2xEu1T9qTSOmb56fBxsTVnpayaOC5z3PXIhYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762117205; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=GE45hhNtpkW2bwvumtUdlZ7j4JFnpXVgix8nxbHmpiA=; b=Nt+qy0MLjB3qN6rLpH9Dq2ea418475ksOFPxozieKcK0vyVI74FwbA+HujPeokf79SnmV/ Q4qfvljtEl1OSCzDG6EMYZ6qm+cJndNMzQLOIn+aqMTgwZX1uCU0YLnBcy/UUCccMH+8dJ ThoSjZWrQcadl5i4qmBTSL96M5MAYUwcamwHq4ihvqzuhR7oHlsUYcXEurl5klS73zTbu6 J2pcU21juGYoZ6/E93xAtbbXLyaH8fDd/CNpVtUYd5bXOjdGA11DcOiYr+DnB7Yr9kJKFy Z6XPW9HTAWGXCKmug6UY+Nq9BBzSd7HGwS+R6fBqpZoHLxU0cKg+RzNObNjkXg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1762117205; a=rsa-sha256; cv=none; b=MmEbYPdvLDIpJ3GWwM88idJTlTjuKFFYimjvNVWfGdXKomCBM0qa9slA2yjOQUpNpTzGVW nj0p0V9kwrlG5Zb68fA8oBaDPJENL7lBdxG3W4D748PX12ahrOiZX6U/aoWcjNJX4LTI9U gPBDfULUfGNqq1vOr8WLnkbccts/4QbUEGeN1ADIWvg4PsUJ0r6wpMF2Pt81HpdZuOkA/X 87B62HTeHysRZ7OZp/R/KAxw5oiT7rhzVEVYWmG89oJ24EZUpdmvmkvtXR79CfhgtB3EHt 9bGmJC37h7oE2cSnkE/n0E8p32rjDI2l/rUlw2CTz2Uor2VF7MMperdSUq6aJQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4d06YK0Hvpzj8S for ; Sun, 02 Nov 2025 21:00:05 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 5A2L04Yg038824 for ; Sun, 2 Nov 2025 21:00:04 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 5A2L04Ym038819 for virtualization@FreeBSD.org; Sun, 2 Nov 2025 21:00:04 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202511022100.5A2L04Ym038819@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 2 Nov 2025 21:00:04 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17621172043.00df4D.37350" Content-Transfer-Encoding: 7bit --17621172043.00df4D.37350 Date: Sun, 2 Nov 2025 21:00:04 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 289848 | Enable by default BHYVE_SNAPSHOT 1 problems total for which you should take action. --17621172043.00df4D.37350 Date: Sun, 2 Nov 2025 21:00:04 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
New         |    289848 | Enable by default BHYVE_SNAPSHOT

1 problems total for which you should take action.
--17621172043.00df4D.37350--