From nobody Sun Nov 2 09:39:22 2025 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4czqRt4Gmxz6FP0G for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4czqRt3Tnvz3DVW for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762076362; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=OYzafobkkl7Ar3M2eJ4kCwjWdS5MfbqVWHIpOFsg7Oo=; b=NWS/VRLcKOHCmDBCGe1SK4ShMxIjmFvgiU3J/+dw9AOuZ1Zril1tGX3qHDoZibR6i39UA+ PLw8GIXwR/0xKoVqUYFeXPvvlwk0p+r1M/iSVHxfsO+hPqiG7gkVaSsxFmupzACR+Eb/7/ GxMAeZCPUGABmB+cHm/wTJzkgWSlNwzNlwk6t+bxidBjrL4plhZmiuMtBVKgPU5RyqZ7MW +HHzlRbd9NO9R8QI8xDckBfOiyvdQppZIIyubm6gcQFkCbwPJLr4ophOvDeFqte63scLwJ tEvWalukoBVzskhHmxKIVK/lCtoGOOQ4K88CwIjluYJVaGWFIHmjWx7Fu3K3Wg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1762076362; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=OYzafobkkl7Ar3M2eJ4kCwjWdS5MfbqVWHIpOFsg7Oo=; b=qdev1Fa5Icjujczej2ZSZRMpgepqwZ6wZGO7vtoGgTMq+AXUwpIZAPm6kK2nJAdv7sn11p 5QrCV7RASJOO7XibtkWDu05b44SPyzTIlDl/bsiBov5viVngzIFq6Ruz3YkEOw5uw2MUR2 lowblhEH+Nj8Sl5yJU3f7fIzk04DABmUOXEMHCYnTqcl56URXQvJuGEQqKSHwMYTYMI8rY J3/ns0KP6nV3T+dltyEMwGFN+P0uPkwymLfl5K9ZkVSTToZJuYh5MNhx65N0xNZZF+V/E0 k+ppHiNVd4aiUZB1W3DxHE497jyxd1KZttS2ikw0YnlrgDtYRKIppMO5Mxg2pw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1762076362; a=rsa-sha256; cv=none; b=TxrId8u7pw4sTe8/dw/k63+z64shlLaMlLD1mGu2Q2PTiMd23yxpJl/HUdCZ3priQ2PCAH p1qgGVMPb1benRT2+G6LRQB5MwU231sldwepPx+xb2PmIUTk89vBPQ0jSEO62tFEuNW7rS OPb/cI24J35LU5ChD2GbTy1HXFEOW2d9IK6Tx8UODwqDdUhRvSoLTjr9DKJnS11pqLI+3E KijIYFIv2CkOpqxj9AYIV03Kpys2gtAGHdBQ+D0XcGUyFXO4eAK0y45/nfACH+6Xrbwk41 rH9asPUbeFsOPBww/mdPyiMygndsDSJ0gOk0JhUi4oL2rClvkUzljfzDNGIxIA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4czqRt2hXQz3yD for ; Sun, 02 Nov 2025 09:39:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 5A29dMiE042024 for ; Sun, 2 Nov 2025 09:39:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 5A29dMpP042023 for virtualization@FreeBSD.org; Sun, 2 Nov 2025 09:39:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 290735] bhyve resume hangs Date: Sun, 02 Nov 2025 09:39:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: novel@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D290735 Bug ID: 290735 Summary: bhyve resume hangs Product: Base System Version: CURRENT Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: novel@FreeBSD.org I'm trying to use suspend/resume in bhyve. I use FreeBSD 16.0-CURRENT #0 main-n280778-f45608124286 as a host and Ubuntu 25.10 as a guest. I run the guest using: bhyve -c 2 -m 4096 -S -A -I -u -H -P -s 0:0,hostbridge -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -s 1:0,lpc -s 7:0,virtio-blk,/data/img/ubuntu2510.img -s 5:0,fbuf,tcp=3D127.0.0.1:5957 ubuntu2510 I can verify that the guest works fine, i.e. I can attach to it by VNC and = use it as expected. Then I suspend it using: bhyvectl --suspend=3D/var/run/libvirt/bhyve/ubuntu2510 --vm ubuntu2510 That also works as expected. Then I try to resume it using: bhyve -r /var/run/libvirt/bhyve/ubuntu2510 -c 2 -m 4096 -S -A -I -u -H -P -s 0:0,hostbridge -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -s 1:0,lpc -s 7:0,virtio-blk,/data/img/ubuntu2510.img -s 5:0,fbuf,tcp=3D127.0.0.1:5957 ubuntu2510 At this point VM freezes. I can connect to VNC, but it only seems to display the last frame of the previous session, it doesn't react to any inputs. I a= lso don't see anything on stderr or stdout from bhyve(8). When I do: truss -p $bhyvepid I see that it cycles through: ioctl(7,VM_RUN,0x2a80700efda8) =3D 0 (0x0) When in this state I destroy the VM, truss prints out the following before exiting: ioctl(7,VM_RUN,0x643205adda8) =3D 0 (0x0) ioctl(7,VM_RUN,0x64320a9eda8) ERR#6 'Device not configur= ed' ioctl(7,VM_RUN,0x643205adda8) ERR#6 'Device not configur= ed' write(2,"vm_run error -1, errno 6\n",25) =3D 25 (0x19) _umtx_op(0x2df9dae5f488,UMTX_OP_MUTEX_WAKE2,0x0,0x0,0x0) =3D 0 (0x0) _umtx_op(0x2df9dae5f488,UMTX_OP_MUTEX_WAIT,0x0,0x0,0x0) =3D 0 (0x0) write(2,"vm_run error -1, errno 6\n",25) =3D 25 (0x19) _umtx_op(0x641ced8c6a8,UMTX_OP_WAKE_PRIVATE,0x7fffffff,0x0,0x0) =3D 0 (0x0) _umtx_op(0x641ced8c6a8,UMTX_OP_WAIT_UINT_PRIVATE,0x3,0x0,0x0) =3D 0 (0x0) write(1,"fbuf frame buffer base: 0x643196"...,165) =3D 165 (0xa5) _exit(0x4) process exit, rval =3D 4 In bhyve output I can see after that: Unhandled ps2 mouse command 0x0a Unhandled ps2 mouse command 0x01 Unhandled ps2 mouse command 0x41 Unhandled ps2 mouse command 0x88 vm_run error -1, errno 6 vm_run error -1, errno 6 fbuf frame buffer base: 0x64319600000 [sz 33554432] Pausing pci devs... Restoring vm mem... ^M Restoring pci devs... Restoring kernel structs... Resuming pci devs... --=20 You are receiving this mail because: You are the assignee for the bug.=