From nobody Sun Aug 6 16:47:27 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RJlk15Zjbz4m5S1 for ; Sun, 6 Aug 2023 16:47:37 +0000 (UTC) (envelope-from meka@tilda.center) Received: from c3po.tilda.center (c3po.tilda.center [108.61.164.129]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RJlk06JrTz4CVL for ; Sun, 6 Aug 2023 16:47:36 +0000 (UTC) (envelope-from meka@tilda.center) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tilda.center header.s=c3po header.b=AgvbF6GU; spf=pass (mx1.freebsd.org: domain of meka@tilda.center designates 108.61.164.129 as permitted sender) smtp.mailfrom=meka@tilda.center; dmarc=pass (policy=reject) header.from=tilda.center Received: from [192.168.111.178] (meka.rs [109.93.255.137]) by c3po.tilda.center (Postfix) with ESMTPSA id 7919533948; Sun, 6 Aug 2023 18:45:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tilda.center; s=c3po; t=1691340309; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=C+XMRPA+SSTVUUZdtGxGGDLj7w5hs4PNu95Ro1V/v5U=; b=AgvbF6GUPhuY0MCvMrQ2af0OMlmMtfwGHJevCskb3qU8OAGcD2dyDZUwNuW86k4M/+sQfb Hz10RkiXqiaHrtz2j4674uhBPKw+sJL/MLRYM9UHYOeKSYswJnkfT4+dXE/E4Scf3HWMzk TxcGVLJnT/GbSYp10Aw+7w1+XoHceAg= Content-Type: multipart/alternative; boundary="------------W0KCCeKHHIqE0uZCk00J25MY" Message-ID: <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> Date: Sun, 6 Aug 2023 18:47:27 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.13.1 Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? To: Michael Dexter , "freebsd-virtualization@freebsd.org" References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> Content-Language: en-US From: =?UTF-8?Q?Goran_Meki=c4=87?= In-Reply-To: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> X-Spamd-Result: default: False [-2.87 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.965]; DMARC_POLICY_ALLOW(-0.50)[tilda.center,reject]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[tilda.center:s=c3po]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ONCE_RECEIVED(0.10)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:20473, ipnet:108.61.164.0/22, country:US]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DKIM_TRACE(0.00)[tilda.center:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_SOME(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RJlk06JrTz4CVL This is a multi-part message in MIME format. --------------W0KCCeKHHIqE0uZCk00J25MY Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 8/2/23 02:28, Michael Dexter wrote: > Hello all, > > Long-time bhyve-in-production user Jason Tubnor pointed out that a > recent Windows 11 update breaks the "lab mode" under which Windows 11 > could be run without a TPM (Trusted Platform Module) chip via a > registry edit. Corvin has made significant progress with TPM > pass-through support but it only supports one VM associated with the > hardware TPM. > > This 3-clause BSD-license software TPM project has existed but I have > never heard it brought up in the bhyve context, possibly because of > the available workaround: > > https://github.com/stefanberger/swtpm > > Is anyone be willing to look into porting this to bhyve? > > All the best, > > Michael > Hello, If anyone can take a look and merge these, it would be a start: * libtpms https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=272972 * swtpm https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=272973 As I never read bhyve code before, I will start glancing it and trying to figure out stuff from Corvin's previous PR enabling pass-through for TPM. If anyone has any info to speed me up on this quest, please speak! Thank you! Regards, meka --------------W0KCCeKHHIqE0uZCk00J25MY Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit
On 8/2/23 02:28, Michael Dexter wrote:
Hello all,

Long-time bhyve-in-production user Jason Tubnor pointed out that a recent Windows 11 update breaks the "lab mode" under which Windows 11 could be run without a TPM (Trusted Platform Module) chip via a registry edit. Corvin has made significant progress with TPM pass-through support but it only supports one VM associated with the hardware TPM.

This 3-clause BSD-license software TPM project has existed but I have never heard it brought up in the bhyve context, possibly because of the available workaround:

https://github.com/stefanberger/swtpm

Is anyone be willing to look into porting this to bhyve?

All the best,

Michael

Hello,

If anyone can take a look and merge these, it would be a start:

As I never read bhyve code before, I will start glancing it and trying to figure out stuff from Corvin's previous PR enabling pass-through for TPM. If anyone has any info to speed me up on this quest, please speak! Thank you!

Regards,
meka --------------W0KCCeKHHIqE0uZCk00J25MY-- From nobody Sun Aug 6 21:00:26 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RJsKk5BRsz4mQG8 for ; Sun, 6 Aug 2023 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RJsKk2w8sz4nxL for ; Sun, 6 Aug 2023 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691355626; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ebO/UYeNJfVE2PUn/Cp3wCreOd20yvpG1mwf9oS+9vA=; b=YbB5kh6Y1gNOj6b0edmyeRUqIZslS4Ej8R/UxRaTaTypry594r62CgwnQyianDAukMboKC iUSdfnZnH06d6QmF9L4PLDi3LnZZSWdSEuqaUhtXQvn5QsBfcPeDcNrI4rY/FmeRN954cL uaHUK/kXKYBpOkeZK5Ix+vymZMbdgafaeWxW8PLSZqnp06USX9Fe5afu5k9SWDi1T+7IQ4 bhSifLiLQuwz+iGNoi75Gc2HIxsl6pPcpIcUapjFRcRZ0cO1cv+4WB5wyWDdOScBZUucoT ySbTwA8yofEzjEHxFV7pLIuqDR6LNSx4wS3/qxnauf1xEQUB0DsvPExpCKNpjg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691355626; a=rsa-sha256; cv=none; b=L85J+GbsPvSUk0FF6D0IDKzTigU5yTmogcyvrPS1CjuX++2xq19IqVrXSqlb5u8hV7hQ3h YAUA6gfVX3jZbOs/UQo/HAzeOXZT/IHxn/QgZqqUMsByMeTpYVLmLXnpPBsSBsv8xULBEr wEnGmiMTj5xJYMuXgJ5lHl6fFQuV2YPIbnjb/tWojUlT5a+nTjmV+gUbHcmnVgS8Y/J/v7 ByPpnVcM4Ic0SIjh+8hPN+hm9AbvqEGjNvj909/sGWnnAFRh5mqtYqhfa51og5fXNCAKbB hVDyAO3sh4yBf1/lyU3DgGhjcpTEl6UBgx57ynVcpe6cpvabZKy0NJHszd7VcA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RJsKk1twHz9D0 for ; Sun, 6 Aug 2023 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 376L0Qf4089075 for ; Sun, 6 Aug 2023 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 376L0QKl089074 for virtualization@FreeBSD.org; Sun, 6 Aug 2023 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202308062100.376L0QKl089074@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 6 Aug 2023 21:00:26 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16913556262.9CC4F4e2.86922" Content-Transfer-Encoding: 7bit --16913556262.9CC4F4e2.86922 Date: Sun, 6 Aug 2023 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 244838 | "bectl activate -t" does not honor the -t flag in 3 problems total for which you should take action. --16913556262.9CC4F4e2.86922 Date: Sun, 6 Aug 2023 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    247208 | mpt(4): VMWare virtualized LSI controller panics 
New         |    240945 | [hyper-v] [netvsc] hn network driver incorrectly 
Open        |    244838 | "bectl activate -t" does not honor the -t flag in

3 problems total for which you should take action.
--16913556262.9CC4F4e2.86922-- From nobody Mon Aug 7 07:53:31 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RK7qH2tTcz4m5LP for ; Mon, 7 Aug 2023 07:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RK7qH109Cz3BxS for ; Mon, 7 Aug 2023 07:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691394811; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+jSUI7HsHQVF6k1VxztEeA4gbyXT72zplDIev0KjYY0=; b=HKPQsJQBL7z4ZhlVyQbaYiWYLGq2W9IoRLcLHXKd1Ca1gKfCAiZagADQR1+2Sf7kEltP4Y aPgneGkp7V461lRlSSk3OSFcsxX3WpXk9kJoOY1//oxTJi7pHo8yvSOtUW2x+0g36c1q5j vS+UmOhjvuesWitXkcr3YO4a8lIOQkyb3re+X1Qzqrb1QUp5RRoJp7Qvp+XuAyAgvLzQun 1pZ6shqp8iAopeGxxXdJqut3gDCXyPCYRhMY/Ph1XaN2iN3GgCswQAn5t1XUXVlkxN58nA 0dnqJ1OFcdhOfdeiAa+Gu99rWJd+0Cv7wVw/+yUBr4YzWd3DHGdrGeJHkdWKkw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691394811; a=rsa-sha256; cv=none; b=OgvouXoOOhUmxBXrb2KndgFYb8I2XMu5goDlzEGiAw6Tyi9/0uzRiEnNy85HuoKY0nfWVy OqMHpCCKrqLD8Q/Q47OgLCX/AUzVtg74pjX4gt+koyEu2BOG7yzA1CeWSDqAf9imSfUUQA ZWVf2lJfGu6jAw7ym5DICUNpMmMj8mPaevqV1UwtfqKpZqHxM2uvftN/J0whXTzfdm9Y9O 9+pkJyoBdPp+IQa3hj8+05/GLIr5f2yPTRgV30jY3cK951IFJ9EcCYiT6xw2kzrqtfBxCc a5lf8KcR66DKDOkhiwof4e5B4y8NUUtMHbqGyMIBhFTIc2NQETJJWnqs0HbEbQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RK7qH02r8zkqk for ; Mon, 7 Aug 2023 07:53:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3777rUw3055367 for ; Mon, 7 Aug 2023 07:53:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3777rUGX055366 for virtualization@FreeBSD.org; Mon, 7 Aug 2023 07:53:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Mon, 07 Aug 2023 07:53:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: corvink@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 Corvin K=C3=B6hne changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |corvink@FreeBSD.org --- Comment #5 from Corvin K=C3=B6hne --- (In reply to attila.kover from comment #4) Are you able to perform a bisect? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Aug 7 08:04:38 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RK8492Bd9z4m6B0 for ; Mon, 7 Aug 2023 08:04:41 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RK8491f0zz3DDh; Mon, 7 Aug 2023 08:04:41 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691395481; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=68VBXw9ktFH+ApcZ2wui8xfnUA6Zd/oqJkXiqZkBDmY=; b=gAdr7MfKIuriqGp/txhS+2fwIdN8XZBZ4WM3MbqvHE4f9a8HTw/PqMCaRwhQXBwZoW5sY1 VCK8FdZzuLMdUdpfN26CaZ9V9ywFZNKxcRI7i91fUzoYkkEmvLUF3xg10WGgpJk3rELyVH skPcnANBASD9H+M9fXbBzEz7CCvbW5tIr+XBEyqiswm+imbFO/JU2F3/gSq1KzTFXKLlV6 G+v+KJOUl049DGSJm5rPi/WmYkezkijJ6nEhx5rdGMdpI9r1rfOloKv4Ksc5KY7cK6k1RS nRwp5FtViH3wcMHD8rFTxLfXSwl/kY2u/M9TTPhshPW8JpLaA61ChOFR4nRy2g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691395481; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=68VBXw9ktFH+ApcZ2wui8xfnUA6Zd/oqJkXiqZkBDmY=; b=sq8McrpcSzIUlhQcB6j9EkE4LSX8SzAGN6d9vE7YJr/f4sHpIZ4cskda+iZsVXz+aAOkKe yX0QhKp6D7K2lVTQmcAOPlnlL+UhVgv7tRNhX0Dq7Ht/XEHlW/X3EN7N1OWXOfsqeKLy2u Lf0A+raMxrf79+wxHg6zOvaj35ER7mlM5kODsSdz4q7hbVqngfhHsRxuMwMKtgE2CUwYOw r3toPs22e+N/Zi6/xC7zGU7rapae/PnofCemcprg09ohGvOU5JSEJTVbBOVcnLk6jX1bxt o7mreuHXC2A615u8MT8buFppyGyIc290m6MLZ1MaSM6cz8m/60glsLcJ29o00A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691395481; a=rsa-sha256; cv=none; b=ffmUPvPSRm/ECuDZk8MDGz5JppmxPEKte/dabiZS+QC7Vb72GKIdG1bTjsBOBqk5VBDf5m dXqPUUdngaioeMN2hDQ5U5mWkaT9Vn7Yygj/COUUd9PVKCdZPbTb8uI8y7xWviIqV7akX3 5YaTWMLh+PWW0JtwS4a51N4loerBHwx7PZC1gtLuKyQTQBbsJQtovQhrqJDqXHP2iMbWmu qcjzZnEXPts54eMXbXLbBrwDJ202ycrW43MzUWe50SIujBuZ/7BhIlt4RlzDbgaQulqxYT E+doGss19S+rVLlaYBBua2VGrUT9V7eFzu3fuZd5bRLJ33S1KQQSCCwJZlS71w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from [172.21.179.48] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RK848416Lz13SJ; Mon, 7 Aug 2023 08:04:40 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Goran =?iso-8859-2?Q?Meki=E6?= , Michael Dexter , "freebsd-virtualization@freebsd.org" Date: Mon, 07 Aug 2023 10:04:38 +0200 In-Reply-To: <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-x4WA/7BDJaYhC8j9upAc" User-Agent: Evolution 3.48.4 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-x4WA/7BDJaYhC8j9upAc Content-Type: multipart/alternative; boundary="=-PT3HxAg6BgH10g8tIXis" --=-PT3HxAg6BgH10g8tIXis Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, 2023-08-06 at 18:47 +0200, Goran Meki=C4=87 wrote: > =20 > On 8/2/23 02:28, Michael Dexter wrote: > =20 > > Hello all,=20 > >=20 > > Long-time bhyve-in-production user Jason Tubnor pointed out that a > > recent Windows 11 update breaks the "lab mode" under which Windows > > 11 could be run without a TPM (Trusted Platform Module) chip via a > > registry edit. Corvin has made significant progress with TPM pass- > > through support but it only supports one VM associated with the > > hardware TPM.=20 > >=20 > > This 3-clause BSD-license software TPM project has existed but I > > have never heard it brought up in the bhyve context, possibly > > because of the available workaround:=20 > >=20 > > https://github.com/stefanberger/swtpm=20 > >=20 > > Is anyone be willing to look into porting this to bhyve?=20 > >=20 > > All the best,=20 > >=20 > > Michael=20 > >=20 > Hello, > If anyone can take a look and merge these, it would be a start: > =20 > * libtpms https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272972 > * swtpm https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272973 > =20 > As I never read bhyve code before, I will start glancing it and > trying to figure out stuff from Corvin's previous PR enabling pass- > through for TPM. If anyone has any info to speed me up on this quest, > please speak! Thank you! > Regards, > meka=20 Hi, afaik, qemu is making use of the swtpm project too. So, it'd great to implement it in bhyve. My TPM passthrough emulation is currently under review. See=C2=A0https://reviews.freebsd.org/D32961. I designed it to easily integrate a swtpm in the future. You =C2=A0just hav= e to implement a new tpm backend by adding a new TPM_EMUL_SET. Take a look at the tpm_emul_passthru.c file. Btw: We may have to add additional functions to the TPM_EMUL_SET like a "startup_tpm" function. See=C2=A0https://elixir.bootlin.com/qemu/latest/source/include/sysemu/tpm_b= ackend.h#L52 --=20 Kind regards, Corvin --=-PT3HxAg6BgH10g8tIXis Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =20
On Sun, 2023-08-06 at 18:47 +0200, Goran Meki=C4=87 wrote:
On = 8/2/23 02:28, Michael Dexter wrote:

Hello all,

Long-time bhyve-in-production user Jason = Tubnor pointed out that a recent Windows 11 update breaks the "lab mode" un= der which Windows 11 could be run without a TPM (Trusted Platform Module) c= hip via a registry edit. Corvin has made significant progress with TPM pass= -through support but it only supports one VM associated with the hardware T= PM.

This 3-clause BSD-license software TPM project has existed bu= t I have never heard it brought up in the bhyve context, possibly because o= f the available workaround:

https://github.com/stefanberge= r/swtpm

Is anyone be willing to look into porting this to bhy= ve?

All the best,

Michael

=
Hello,

If anyone can take a look and merge these, it wou= ld be a start:

As I never read bhyve code befo= re, I will start glancing it and trying to figure out stuff from Corvin's p= revious PR enabling pass-through for TPM. If anyone has any info to speed m= e up on this quest, please speak! Thank you!

Regards,
meka

Hi,

afaik, qem= u is making use of the swtpm project too. So, it'd great to implement it in= bhyve.

My TPM passthrough emulation is currently = under review. See https= ://reviews.freebsd.org/D32961.

I designed it t= o easily integrate a swtpm in the future. You  just have to implement = a new tpm backend by adding a new TPM_EMUL_SET.
Take a look at th= e tpm_emul_passthru.c file.

Btw: We may have to ad= d additional functions to the TPM_EMUL_SET like a "startup_tpm" function. S= ee https://elixir.bootlin.com/qemu/latest/source/inclu= de/sysemu/tpm_backend.h#L52


-- 
Kind regards,
Corvin
--=-PT3HxAg6BgH10g8tIXis-- --=-x4WA/7BDJaYhC8j9upAc Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmTQpZYACgkQ2FTaVjFe AmpuLw/+NEg/hXPcvheiuhKQ0s2CyK8zLnmv4nuSftjbgem2DCD3PTFoxkbLF/7W F9QCdEjyjmEQbvdBcD23H/BiwfiOztcjuLFq0vrgs9mB+Er98Rj8LZ2RIfJA66lA C7np8QJ//kr1gfJm7dgGIiyt0k8mWHZIRoJI9hfYYtqz0ey6MRwGGcHqzA0WU72/ ajlqvihuqkRVCI2EpX1Mguq9tOmZ84LRDH5I3+GYz3txTGxGAnngkDPUF+0Sh49o Ti/3ZIjXbE4wsM0tO2iIbjlabFmvo9jZlIk0gC0SbAyKHTRLwmza83VsgxkzHxr4 l7NkMqWLhT1ltNH/lH8KukzUT6vqoSkwh0BqUbxVjLNX6lS1lwsGt9o/aNBy0D05 Mwt2O/CPFhGVQvuaYYtgZnHS8cy2sclEVEdUzDU5Jb8alcblW/WIQulBcHfeP+0y ZPABxRYvkME3TYHkKN4MAkluI85YH1zDK80ftnMmyb6a3F9CFbx+dlH+LWAB7Jxf 0C40QQJE0RvaYGylEGUFJ4TBFG9S045Qsv/LZhzABebikkG2/Cd3oumV0QdGaep0 UTOLzsi3CMmD/fA+JHi9h7BamhCE+K/rHDbCP4E/hl2/FVE8xYV1UGIgCmk8vv4n ploofjC83tPnTW+XP6xg+NRBdsKWsPZowTfBl9GTwCLQzDCEMG0= =8YAl -----END PGP SIGNATURE----- --=-x4WA/7BDJaYhC8j9upAc-- From nobody Mon Aug 7 09:31:20 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKB0D2L4dz4mFrQ for ; Mon, 7 Aug 2023 09:31:24 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RKB0D1tTnz3KVB; Mon, 7 Aug 2023 09:31:24 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691400684; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=LOJkCGRjIsSFhbb0QlQ3ITgSmifmMo8FWsOb7aHvLOs=; b=oyIZSEKVi9q6xoaSWwdK1LBjtwRwWjrpYDBrE5fgu0ZM/N/bOwNtKhbzoSn2Q7GGejYlDa JshS/blRhUZgUdWy0RTJPml9dvIqRrIAFWiDhBJL94rG2VMw0y0gnLz6LZilF0J1CAO4J6 kc3ZqjkNfvkg/Nd8yjJBh5usKGxIgSCtAkWTcRV4Nf/2R1Ics5ca9uqFYykPfYyNfXTCNm 6LUXaqa1VOXcJ9SdWLKDbwzDGrNbVBaaIxuDRgxW90vyYMp2I/z4TRW6huTQNOKLseBh2l ILU0ZCG+KBx91a0abPZln8alsNES+Szuv4u+KsHRZMVwxJ749shqppOCOMlKOQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1691400684; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=LOJkCGRjIsSFhbb0QlQ3ITgSmifmMo8FWsOb7aHvLOs=; b=TCABb9NBMi9J9QGLUM1EQpkEMgjyFalTE995QuX9yMP1eEYd/GiwfOfBM3sH2dkXNqWZqz McAWj7kJYuOZf45lq5sAWUcsq1CIRrId49MIvU4Wj06NJy+Ns6MzFaS03zTN2ycde0ivpw EVOTS8UXGbuBbhk995C0Npc4v7pluLV+mv8z79qREhmVmv3rmcKdB+B1WYevFt72oXTjte pfiNDZn8tJiFxnwfaFcIW7hqqtgbsj+8PYMDm1cyO3dKJDcYWQugfSkhVtxvrgWp/7cGd5 jBFwWRFq6bXSjN2YefdKNhweUpFl07xtvFtsEIepPwyl4GMJROKCJA3Xxq73VA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691400684; a=rsa-sha256; cv=none; b=BckBEBGxqvEvRrWeY7F8bR9Ec5ccSiLnAKwxV4fm7jzlA7ItuaX1pN14JXM/hBkt+PFikk fJXUd99+/vY1WxjA+evUXm8AucBMPAl76DnJfZMKOxeA0skUpidq5rPC9gWuAkVYVI3Rqs QA6fkYo9jgG34kGloaUEwSXfyX8So17YEcRe4F1SWHNm4SqVGnae6/09QnZYrbF0sbjdyo JC/tqSokvk6WBfLAELhe9Aetn71zc00Ot6fplctAtiL3sKDbdJySBOKrQp0KgHITicixqZ ha1tZdeam+7brgZNIv18VvmNMm/TLwaZYxplqVRvf52EGX5SZF2P5SV+eW1YRw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from [172.21.179.48] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RKB0C4MQxz14hc; Mon, 7 Aug 2023 09:31:23 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Goran =?iso-8859-2?Q?Meki=E6?= , Michael Dexter , "freebsd-virtualization@freebsd.org" Date: Mon, 07 Aug 2023 11:31:20 +0200 In-Reply-To: <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-CQAHCxf9xJZ/RRaLIjv/" User-Agent: Evolution 3.48.4 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-CQAHCxf9xJZ/RRaLIjv/ Content-Type: multipart/alternative; boundary="=-+EmgEC+25BJhENe9vXC7" --=-+EmgEC+25BJhENe9vXC7 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, 2023-08-07 at 10:04 +0200, Corvin K=C3=B6hne wrote: > On Sun, 2023-08-06 at 18:47 +0200, Goran Meki=C4=87 wrote: > > =20 > > On 8/2/23 02:28, Michael Dexter wrote: > > =20 > > > Hello all,=20 > > >=20 > > > Long-time bhyve-in-production user Jason Tubnor pointed out that > > > a recent Windows 11 update breaks the "lab mode" under which > > > Windows 11 could be run without a TPM (Trusted Platform Module) > > > chip via a registry edit. Corvin has made significant progress > > > with TPM pass-through support but it only supports one VM > > > associated with the hardware TPM.=20 > > >=20 > > > This 3-clause BSD-license software TPM project has existed but I > > > have never heard it brought up in the bhyve context, possibly > > > because of the available workaround:=20 > > >=20 > > > https://github.com/stefanberger/swtpm=20 > > >=20 > > > Is anyone be willing to look into porting this to bhyve?=20 > > >=20 > > > All the best,=20 > > >=20 > > > Michael=20 > > >=20 > > Hello, > > If anyone can take a look and merge these, it would be a start: > > =20 > > * libtpms https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272972 > > * swtpm https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272973 > > =20 > > As I never read bhyve code before, I will start glancing it and > > trying to figure out stuff from Corvin's previous PR enabling pass- > > through for TPM. If anyone has any info to speed me up on this > > quest, please speak! Thank you! > > Regards, > > meka=20 >=20 > Hi, >=20 > afaik, qemu is making use of the swtpm project too. So, it'd great to > implement it in bhyve. >=20 > My TPM passthrough emulation is currently under review. > See=C2=A0https://reviews.freebsd.org/D32961. >=20 > I designed it to easily integrate a swtpm in the future. You =C2=A0just > have to implement a new tpm backend by adding a new TPM_EMUL_SET. > Take a look at the tpm_emul_passthru.c file. >=20 > Btw: We may have to add additional functions to the TPM_EMUL_SET like > a "startup_tpm" function. > See=C2=A0https://elixir.bootlin.com/qemu/latest/source/include/sysemu/tpm= _backend.h#L52 >=20 >=20 Btw.: I've opened a review for your ports: https://reviews.freebsd.org/D41346 --=20 Kind regards, Corvin --=-+EmgEC+25BJhENe9vXC7 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =20
On Mon, 2023-08-07 at 10:04 +0200, Corvin K=C3=B6hne wrote:
On Sun, 2023-08-06 at 18:47 +0200, Goran= Meki=C4=87 wrote:
On 8/2/23 02:28, Michael Dexter wrote:
=
Hello all,

Long-time bhyve-i= n-production user Jason Tubnor pointed out that a recent Windows 11 update = breaks the "lab mode" under which Windows 11 could be run without a TPM (Tr= usted Platform Module) chip via a registry edit. Corvin has made significan= t progress with TPM pass-through support but it only supports one VM associ= ated with the hardware TPM.

This 3-clause BSD-license software TP= M project has existed but I have never heard it brought up in the bhyve con= text, possibly because of the available workaround:

https:= //github.com/stefanberger/swtpm

Is anyone be willing to look = into porting this to bhyve?

All the best,

Michael
=
Hello,

If anyone can take a look= and merge these, it would be a start:

As I = never read bhyve code before, I will start glancing it and trying to figure= out stuff from Corvin's previous PR enabling pass-through for TPM. If anyo= ne has any info to speed me up on this quest, please speak! Thank you!

<= div> Regards,
meka

Hi,

afaik, qemu is making use of the swtpm project too. So, it'= d great to implement it in bhyve.

My TPM passthrou= gh emulation is currently under review. See https://reviews.freebsd.org/D32961.

=
I designed it to easily integrate a swtpm in the future. You &nb= sp;just have to implement a new tpm backend by adding a new TPM_EMUL_SET.
Take a look at the tpm_emul_passthru.c file.

<= div>Btw: We may have to add additional functions to the TPM_EMUL_SET like a= "startup_tpm" function. See https://elixir.bootlin.co= m/qemu/latest/source/include/sysemu/tpm_backend.h#L52



=

Btw.: I've opened a review for your ports:
https://reviews.freebsd.org/D41346<=
/div>

-- 
Kind regards,
Corvin



--=-+EmgEC+25BJhENe9vXC7--

--=-CQAHCxf9xJZ/RRaLIjv/
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part

-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmTQuegACgkQ2FTaVjFe
AmrNMhAAq8mP1ZU5UrmFplf5BayaPsTQd5HxNYIOBcHxzeUVgFNeUnOf+kQAJ7gw
0S6mmAi7KlbPkos5t3G7IAr9hjB1/c3xGZ08YKJHAf/0k2Ayb5n/HcCOpJ35WSgG
ZC1QxHP+77zYSWVIbBBO0wv1qE/JcVXf8XkxVo4iTAUjFMGCTMn7GWYGErtXxF2l
rVSH6rbB313wAv4TGGR+aPymDw2WM0AGFtwffOcL7kaymNNDSDzz7wcU3GifrEdg
UrB5akNTs6/SjsMrLLsJ0yMcvNhXb0HYhPwVAamPKw5wbRsURGKIGogTFm8FHbzZ
JNUjfoP7VldJDnf14+cRqtg/YCXtMbT924h8SeqVATADKl1y0IBKjOAOj65LO5Jz
YTf7u+eqa4fDpiYSQwHAEs5ZzldljvdNLTaSzpl5Hu7j3gevpxThsPKWMvD1j3RG
ZfLvAafzMe6j/RcxqDJ1mCVEkX+RXgBKHNo/MntngmGs6i/JX/3WZwiPxlNAidIc
iZtmUZatZiB/gpHp9Z2RU2mW0BX+nZc0MG0xmNbi/6EQL7Ksey2cpCRFoe8UEelo
ApA3u0R7qfV3x+UHxes486IR9sQ1G0Sa7h5x3lZ/Yg5qtFKCTbTir6/wlsc20Ers
UDEC/rcdAwAnefkpQtKCK2S4rJ/nmW/Wn0NFtXTor7eE5ElyHw4=
=q4sP
-----END PGP SIGNATURE-----

--=-CQAHCxf9xJZ/RRaLIjv/--

From nobody Mon Aug  7 16:46:25 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKMf93Xmyz4TsLc
	for ; Mon,  7 Aug 2023 16:46:25 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKMf929Zsz4fxQ
	for ; Mon,  7 Aug 2023 16:46:25 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691426785;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=xbGfNfQ/ha6Hs4ti9/YYn/V8u0imXFpmZoOz+P9yMM8=;
	b=mcnnX7MGfTbtHg3yA+ON5iP4+1JTNlzMz7Hq3e/Z9cOaLtI1EpzjhteAvCOp4hCRkNyMV2
	91dQzuby6f593Aj3EJJwZEkkGkkeoKivucilIhTpzUSvRoTktN42jgds56CfqVn1yk7PDk
	SWYIlMR+7rXIRAPr1cWDt3BC5RlDTIeCW+Vi+l2zQ5vVKNOhGqH5YGKFJccrFs18qpFMm5
	0E3QzA4OFyao8YXosvzc2p820VnAUfHJ2XDdSH4IdIxj92MUNDIJ68AaykGpAgv3BHvCyz
	KeCVFEdmAI/rNkGVcxcbXFu56sUoJIH0CWDf1zIlmiBGW+2F3whMl5qVeV1hKw==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691426785; a=rsa-sha256; cv=none;
	b=jaimR8cJmBDfAk8eIExaHJU4B7OgpIhiNT13KZK+WNCOmp5BLpzIPPSa29gOnzbj1dJMT/
	Y24w6g4oUcA4rxuFhrVE96xI+OOgrjqezK7s+kjoTJtRviucC74ZM0uQrUQnmm4/7yGAv9
	70kiEj/RZafv2qU3DAjIf2DW6aIfGc371FnBVsuGF0HvYoZzsrb9L6gUitaX1qptkB6sUy
	9Df1bnzDQi+GiOTtI0fk2by3uqB86jqIsjzLIPFrAkAe7UeqNjz+iSUN49b9j4qvTbOvK1
	JMGT9S2flftPJk3qV2V/YCWSlMLbqyYvAEQhsid5Xu3QtMbx2PiqI50DHAfyXQ==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKMf912Dcz10Py
	for ; Mon,  7 Aug 2023 16:46:25 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377GkPlL051563
	for ; Mon, 7 Aug 2023 16:46:25 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377GkPAX051562
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 16:46:25 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots
 (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
Date: Mon, 07 Aug 2023 16:46:25 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: raul.munoz@custos.es
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966

--- Comment #6 from Ra=C3=BAl  ---
(In reply to attila.kover from comment #4)

I thought my problem was with SRIOV, maybe motherboard related (ASUS B550-E=
),
somehow small niche, only me?. Seeing that happens also with any pci passth=
ru
(ivhd) using server class (PowerEdge R7625) and that is trivial to reproduc=
e,
present on current, give me hope. Although 20~30 reboots for single guest l=
ook
like a lot, with multiple guests means constant host reboots required, bare=
ly
usable. Your problem report change to open, maybe we can help before releng=
_14
;).

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 16:56:51 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKMtC5nYlz4TtG6
	for ; Mon,  7 Aug 2023 16:56:51 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKMtC34qzz3CDB
	for ; Mon,  7 Aug 2023 16:56:51 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691427411;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=XwEhu9+oBoagL2FxL6vi+U87Kdbp7h3NFNdPW5xa9/c=;
	b=SVLelUOo/+Xil0rVqkJZLjLk+EvzQz2+3K0DF6/SQ+5etluwj13wvbsyqVdyl4cVdqmlKV
	NVyyFxB0BNO7wm+MZPcthUZYpXGEBUl5Cog+z7Nto+Mx9lrOvNvwIR076HhYKc8NTc3Eit
	YubtsB/k8yngBTCHu9dHoZ/eJ8AI5wBm6JcnMYrf2qO/9Gmbp0Q/PHtOCemgwL6zAmwcY3
	y2hVJqxzSLkI3NUgvZbqktotEApuDEUcsiPovZsDwJ0BklHAYFx2wWrUBykimZbcxRVzC8
	sm7XITcZkojwtyAZACEIpCqUJBjwLsixWHiEW+eP1/fE2MPcSvYfs/4pz66JyQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691427411; a=rsa-sha256; cv=none;
	b=oJcWqyEf3qcAvcY5lLSmMflXaYnTIJnfkLdhzEQ//FQUnmhgwmQ9+0yhnjdcFHKnEg6nGN
	7KNhEMi66sPWJrZfnUoawxlPa4cmx2HcIzvreMYB18m52TrlWHp5VA/UX4VjmVaaF/wxez
	Nla3ZERCHg/7Yhbo9qFs8alCv0z9iW+UV29ccbi3S65OoEwI7PxsQX7bTL8ILxI2TkVzGy
	OP705w03yCy3vkAjEANz2xD1Ktc8EwwgBGV3dKkX3BAU7lAg7PsbDZaSyUn1alWKAOw8xL
	Y7JizR+sRY0OiwiTMqCiTFO/vKLwoMW7jMAWviMfrQqz+KN0EE9dIIcBDWEPWw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKMtC28lTz10cp
	for ; Mon,  7 Aug 2023 16:56:51 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377Gup2S064610
	for ; Mon, 7 Aug 2023 16:56:51 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377GupDa064609
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 16:56:51 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots
 (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
Date: Mon, 07 Aug 2023 16:56:51 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: raul.munoz@custos.es
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966

--- Comment #7 from Ra=C3=BAl  ---
(In reply to Corvin K=C3=B6hne from comment #5)

Thanks for looking at this!. I'm assembling a new AMD based box for testing.
It'll be available by the end of month. I can stress test it bisecting from
releng 13.0

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 20:41:43 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKSsh0fsbz4mJDs
	for ; Mon,  7 Aug 2023 20:41:44 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKSsg5frcz3bjD
	for ; Mon,  7 Aug 2023 20:41:43 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691440903;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=JaOk6dZrRbp7f/YailDiez4w1hyi+Peo2SEUu59tJp4=;
	b=dTYl6iUncCdQdL6VPyCaedAij/zdlWcFcP4MsFsJ91dMYAGPQz4zrueNyhbnMk93PEpnqh
	9Kt9sxYg8rsq72Ii4XsvlBkKOA0H/7BWljLClqW8idGCGftyzHC8n9u3ah7kdVM5uQ7bgh
	EP2K92v+JnWleuHobgGH9FNhGpalK+frYJdZwxYpEm5XK/jWeEkHyhP0od7Z3BajHe8BEg
	rLS+wV/i0lT/feH1l+wMndM7awdS1PHksEwJ1nlZYqQulUIQopU+WdJj+SADrLVGr54B8h
	4CwtxYee3u7NLkxME7i+dtcBGwZKbNIQVuxDZJPI8WeAs/srbmIcjWViuo1YfA==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691440903; a=rsa-sha256; cv=none;
	b=oh82sX/ZIL+kol4uNI7FrTjcKra4IDDQ9akysy6UigSzpWNlRnj0YFUf5NMAJ+WktYXWtk
	5e7QLMKOx2vod3ZyhJc/bAOP3KtZ/0F6XAmKq4Jc3QQGCzS+fgG86L0eoffgV2o9NOY0wg
	qdumNm3yHhun19ILA+JApk2voghZsbOIVvDEW/HHq8EPE2F6QN3ovWqwdE7dkyTolR3IvV
	2kWuR9QEv81enUuL0BuAmKZ9D6T6P0awNC1bKX5S1/3+UvyGwTsJ1j/VOOz1D5xvrmgcom
	z7a5q7PQZl49aNxc2gUFBX228N0ZRPsWomCbtu96gUZzDb0Ee7TW+Db52IRiAA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKSsg4lDvz15xJ
	for ; Mon,  7 Aug 2023 20:41:43 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377KfhEu003598
	for ; Mon, 7 Aug 2023 20:41:43 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377Kfhw4003597
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 20:41:43 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots
 (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
Date: Mon, 07 Aug 2023 20:41:43 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: attila.kover@guardian.co.uk
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966

--- Comment #8 from attila.kover@guardian.co.uk ---
(In reply to Corvin K=C3=B6hne from comment #5)

Unfortunately I don't know how to do that.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 20:48:48 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKT1s0Cv1z4mJt7
	for ; Mon,  7 Aug 2023 20:48:49 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKT1r6Fzbz3dPV
	for ; Mon,  7 Aug 2023 20:48:48 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691441328;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=0AUsJU0CHSkhSjaqKFkrEv/r8tx9+0eaV5DIFov3YAg=;
	b=I5UiHXZsLjOjfmPwA1mOK347KyLenuF7BzhtBMuqyyoRLFB0nCjvwb4Nz1JfWjTaGwh48P
	hi+nd1LSyZ/z0HE1rRqTJrJqgr3KvRrnoHt+OPPqVC4FxzCxr9D0vGYUVHDkkboJBoaaJm
	284B6liGJAZqhs9UhvE9b5D+LOkTu1+VpjMFq+yStaUr5ZG8ewKqrhwkB528W2CVOARlIm
	oxX4LwPu62AbCI1Ery6XxNebRwEJY8YWrc1by31pGylibf0r+ryVqH5dWd5vZ3fgoKQtIZ
	VigrrLKo0rKRQ0xJbbL7jqaZOkuzNKgoio2+Nfz17aVcjQU7aoRSTkg629H56g==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691441328; a=rsa-sha256; cv=none;
	b=A/tURFEA0NIdnYgXlRQMO1O6V7j0HQ8G9GLBCQ/O2q8WmGwcsyWZkNVpwsZR3X7gq/Bwpk
	EeVB3yMwH4UY76bwhQkjo0dBFYH+7Eu2XbPRTn18AAz2HAHcCqGhdfJ1c2GrLchOUIe9Ih
	MOIw+vf6nA8Hs6gySvJqo+LWaoeikOrg2ufBGJWFFldUTmWVb4R1z2JEBbv/royw8VwSgv
	QbnMkC2y44t+AxHL1LmNWPmAAvd8G2TIxk3Mmgd+ZtGRKF5QnUWPukhpMgxkvWXVRTeMJV
	BVihb5K0Fy0TvaPH++Vv+T9OL9lJurLfcM/sDhudZ6o6EcVGMIRy5Hid3HyZcA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKT1r5M4bz16MW
	for ; Mon,  7 Aug 2023 20:48:48 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377Kmm4F007251
	for ; Mon, 7 Aug 2023 20:48:48 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377KmmwS007250
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 20:48:48 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots
 (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
Date: Mon, 07 Aug 2023 20:48:48 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: attila.kover@guardian.co.uk
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966

--- Comment #9 from attila.kover@guardian.co.uk ---
(In reply to Ra=C3=BAl from comment #7)


This same problem is already present in both 12.2 and 13.0 (fresh install, =
no
OS update, no patch, only vm-bhyve installed with pkg).

This time I've used a desktop machine, Asus M5A99X EVO board with a 4-port
Intel 82580 NIC.


Part of /var/log/messages in 13.0:

Aug  7 20:08:21 dlc kernel: ivhd0: Error: completion failed tail:0xbd0,
head:0x30.
Aug  7 20:08:21 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:08:21 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x2 0x800 0x0 0xa5=
a5
Aug  7 20:08:25 dlc kernel: ivhd0: Error: completion failed tail:0xc80,
head:0x30.
Aug  7 20:08:25 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:08:25 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x2 0x800 0x0 0xa5=
a5
Aug  7 20:08:25 dlc kernel: ivhd0: Error: completion failed tail:0xd30,
head:0x30.
Aug  7 20:08:25 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:08:25 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x2 0x800 0x0 0xa5=
a5
Aug  7 20:08:25 dlc kernel: ivhd0: Error: completion failed tail:0xde0,
head:0x30.
Aug  7 20:08:25 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:08:25 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x2 0x800 0x0 0xa5=
a5



Part of /var/log/messages in 12.2:

Aug  7 20:41:03 dlc kernel: ivhd0: Error: completion failed tail:0x9d0,
head:0x30.
Aug  7 20:41:03 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:41:03 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x1 0x512b029 0x0 =
0xa5a5
Aug  7 20:41:06 dlc kernel: ivhd0: Error: completion failed tail:0xa80,
head:0x30.
Aug  7 20:41:06 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:41:06 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x1 0x512b029 0x0 =
0xa5a5
Aug  7 20:41:06 dlc kernel: ivhd0: Error: completion failed tail:0xb30,
head:0x30.
Aug  7 20:41:06 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:41:06 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x1 0x512b029 0x0 =
0xa5a5
Aug  7 20:41:06 dlc kernel: ivhd0: Error: completion failed tail:0xbe0,
head:0x30.
Aug  7 20:41:06 dlc kernel: ivhd0: Dump last 1 command(s):
Aug  7 20:41:06 dlc kernel:   [CMD0, off:0x20] opcode=3D 0x1 0x512b029 0x0 =
0xa5a5

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 21:04:28 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKTMw44YPz4mKy0
	for ; Mon,  7 Aug 2023 21:04:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKTMw2bdXz3fdc
	for ; Mon,  7 Aug 2023 21:04:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691442268;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=IimStIB0kJTyQ7QQDQuHXq727nO7iM73TE81XpsgxlQ=;
	b=W6AeJejvqnDMknDuwJ4aol6N5NzDmoMO6Kwa0AImIEaqXjtS/99yEhHUJZl8rB/JmZPYQN
	WrNsigddbBzeDVzDQKLlg3X0uJTyWAjCVNKP5ZlBi0x/IykC+lsEzAaAqU666jB6mJ9GMd
	ZGRMhFvmlw/pvVv9KhwKJHC/B3nFDNbz+ZhlNegFSbYZVBq8fPg++J29ajQPbYbJDSXLIR
	oXbWgpE/YwaJNWpaoKuMqfVg0z8hu7GTDlFSh9XcqHZdjbSbQrDEg33mOsxdxWMYusSD99
	VPV5df30qqYAlgBVTtsTbbIhJUnCiUB2JOucy7MBLZUEemIU+oSMIpE9Wczzow==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691442268; a=rsa-sha256; cv=none;
	b=xv77uX82Tt0WgXiuS08rBxTRtnajcIg1jJzDxTsHsgqakfLlepIjibSHgE4KewbwNwwUaV
	LssJR904t8TED36XTAzA6aUHR0/xIH6IOCY9b7penZ792SzG/q+0TgJWizAetWfLQGm9oB
	5VMi0Hp4WxwA1z2CeMzF0KNcyMGRPzr9rrh6IILzOMiTuNuwYYO8DZ60O3eyBVadEYIZq7
	0nPRk7weVFj3UV7Rqu6mXRXavmuvfgGc+Tpq4uoQqFaPYCE48/SiVcZh2StOgrUDTZaG65
	wTVGvKvUV4O+fOOQc3wnoLiG8/1hhIImzhKkFY8jeuDkRxWf+8FZ0viywpnxBw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKTMw1h3Gz16rj
	for ; Mon,  7 Aug 2023 21:04:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377L4ScI032714
	for ; Mon, 7 Aug 2023 21:04:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377L4Sg9032713
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 21:04:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots
 (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
Date: Mon, 07 Aug 2023 21:04:28 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: attila.kover@guardian.co.uk
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966

--- Comment #10 from attila.kover@guardian.co.uk ---
(In reply to Ra=C3=BAl from comment #6)

I'd be eternally grateful if this would be sorted before 14.0 get released.=
 :)

First I thought that this (270966) and "mine" (266325) are closely related.
However after looking into the error messages, I've realized we might have =
two
separate issues. At first glance the two problems looks somewhat similar, b=
ut
the difference in the error messages suggests otherwise. Still possible that
the (yet unknown) root cause is the same.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 21:06:17 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKTQ12d5wz4mKyD
	for ; Mon,  7 Aug 2023 21:06:17 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKTQ06KwXz3fjg
	for ; Mon,  7 Aug 2023 21:06:16 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691442376;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=ceXu3hfkmYiINwi3psoc4oycTi7994NacMQhj+PzYl8=;
	b=yICum2xlYcUi0dM7qyH8ulGGHcTuWLfFnG34OzGwKg4G7v7hyphBjWGLTW2Z6iEKdKdMKd
	WBf6Oo2eOj1zYMq00sva95uh5Df+N2yZe3h4LyTt2sGxbFdwmSOj488gLD9gvyhpndwnJz
	q0KNkMFqk2OHGEkdS+rVUKFV/TlJvxPheec62SIr+Lo1OsT9LeEmY56dm47vBHdIJvoxO1
	mK8dfRR0cqo6A7JjU/+24Zecx89HExFF47T6xR00JnL3nDQQydA0YgY/bQpR9jw4JvxiOq
	n0AXei6ZbduAyiYb4csrJ2VWYcjKVf9adaNSGczP8xmLPfv0GRK8ohWnnvmGhQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691442376; a=rsa-sha256; cv=none;
	b=m23Ny0RQKUqO9srzG3LA/vN99QHPXTF6hv9gHbWSXuxEZ9Vsy5E96UI6iyklH6/JSYIN4Y
	j0Swj8A7/RV8XllTZlAzDxkjwt+pOmN75MsLZ7Hw5pHpvcqRH2zNCXFnWX37Z/NK3FXOIS
	2UXFk/Fgh0+JVvjF6ckyNjybkUsVhYPwlF0sGltIEG9lrwnjrZNXg2YMI5V0SwyA4iEjIB
	uPUEqLKw5ZjYKEviVBvD/pnDrBVJ+V5zwy5ruym2LlfURDyFOloPqIzPR5Y+YBMTHrlO13
	tWxrVRJTrFGmaK5JNawhdiF4xkcopi+0nyy0ZT7iJTLXSBn6tXVKwSrSV96ZBw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKTQ05PFMz16RR
	for ; Mon,  7 Aug 2023 21:06:16 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377L6Gh2033396
	for ; Mon, 7 Aug 2023 21:06:16 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377L6GlV033395
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 21:06:16 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 266325] vm ivhd bhyve nic passthru completely broken in 13.1
Date: Mon, 07 Aug 2023 21:06:17 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: 13.2-RELEASE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Many People
X-Bugzilla-Who: attila.kover@guardian.co.uk
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D266325

--- Comment #2 from attila.kover@guardian.co.uk ---

A bit more information from a recent test under 14.0-CURRENT (different
hardware):


vm-bhyve.log:

Aug 03 02:25:16: initialising
Aug 03 02:25:16:  [loader: bhyveload]
Aug 03 02:25:16:  [cpu: 2]
Aug 03 02:25:16:  [memory: 4G]
Aug 03 02:25:16:  [hostbridge: standard]
Aug 03 02:25:16:  [com ports: com1]
Aug 03 02:25:16:  [uuid: 2333ba09-dfe1-11ed-9ed6-9c5c8e54ad77]
Aug 03 02:25:16:  [debug mode: no]
Aug 03 02:25:16:  [primary disk: ptproba.img]
Aug 03 02:25:16:  [primary disk dev: file]
Aug 03 02:25:16: booting
Aug 03 02:25:16: bhyveload -c /dev/nmdm-ptproba.1A -S -m 4G -e
autoboot_delay=3D3 -d /root/vm-bhyve/ptproba/ptproba.img ptproba
Aug 03 02:25:22:  [bhyve options: -c 2 -m 4G -AHP -U
2333ba09-dfe1-11ed-9ed6-9c5c8e54ad77 -u -S]
Aug 03 02:25:22:  [bhyve devices: -s 0,hostbridge -s 31,lpc -s
4:0,virtio-blk,/root/vm-bhyve/ptproba/ptproba.img -s 5:0,passthru,8/0/0]
Aug 03 02:25:22:  [bhyve console: -l com1,/dev/nmdm-ptproba.1A]
Aug 03 02:25:22: starting bhyve (run 1)


The first few dozen messages are like the followings (couple of hundred
lines):

ivhd0: EVT INTR 0 Status:0x1a EVT Head:0x0 Tail:0x10]
  [CMD Total 0x24] Tail:0x240, Head:0x240.
ivhd0:  [Event0: Head:0x0 Tail:0x10]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]
ivhd0: EVT INTR 1 Status:0x1a EVT Head:0x10 Tail:0x20]
  [CMD Total 0x26] Tail:0x260, Head:0x260.
ivhd0:  [Event0: Head:0x10 Tail:0x20]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]
ivhd0: EVT INTR 2 Status:0x1a EVT Head:0x20 Tail:0x30]
  [CMD Total 0x26] Tail:0x260, Head:0x260.
ivhd0:  [Event0: Head:0x20 Tail:0x30]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]



...then the constant flood (about 35 lines per second in /var/log/messages):

ivhd0:  [Event63: Head:0x3e0 Tail:0x8d0]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]
ivhd0:  [Event64: Head:0x3f0 Tail:0x8d0]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]
ivhd0:  [Event65: Head:0x400 Tail:0x8d0]
        [INV_DTE devid:0xa0 addr:0xfdf9103300 type:0x3 tr:0]

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 22:09:06 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKVpV6Gv0z4mQT5
	for ; Mon,  7 Aug 2023 22:09:06 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKVpV5FZCz4LXv
	for ; Mon,  7 Aug 2023 22:09:06 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691446146;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=BJljQebvJ9fi+qatvpCi/IZlaKdixcTn5V38CX5OyB0=;
	b=HMhCu7zc1V5pZso0TWWuBLCDsekDf/S8LkGuEr1Lc31zyhj1exSM0pGajm2sZutA41zSac
	P/MK5xWKrK+vJQtP0/yk0WKvO+9sY75IUtgYe9aaKQQeSsMm/K8kiQbomP0qcah/Yu/QGX
	ZkYVDKsZF79EwhK9NNAEIT8p+loN/8VfJQv5izMR9ZUarHfR8sBcVA3dFWYJlbDPy3yL0Y
	HxVDGMZH8pAtQm2pnHYZz7ZN71XlYGZ4umyRh2M73A2GzsgRmNH7Ti9T05b44OumA8Ap1x
	DD7Ik0pR4Wdc4gu559OPPu6BPOce07HDg8N+qcnwZMInmUogNV0uCYAJeC04Pw==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691446146; a=rsa-sha256; cv=none;
	b=ejtgCGA9Ti9+DzlTjkX/RmsNBfDrHhIH9whu0o8+HuNUp5Z23kdIqh8yylj+VudLDN2415
	3+Lwze7pBrutvTXORoWaV2hkY+VOxKXFaD1lBJeHym49mqGpT+CmqW35jgNcb4B57jVKA1
	kXnJCeef3uTSPwnrKA3puaWSGBKFAug5L8r/Ga5zvAGMeJH56TTkqUNHj/QptmFKfpdJwt
	CkZsDTB8XFdA20MScO4tqrBDpI4eEu0KiJbZmaBzVEn5hR/aHyPVsxQnWOTEvhDd+eE4sI
	+e6TYEJ5urJp8e4jX7aO72VQumRN20nSjukwAuGNNMA758MswvIaiw34327Evw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKVpV4Kpdz18FG
	for ; Mon,  7 Aug 2023 22:09:06 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377M96Lf025835
	for ; Mon, 7 Aug 2023 22:09:06 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377M96ZQ025834
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 22:09:06 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Mon, 07 Aug 2023 22:09:06 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #6 from Max Khon  ---
I can confirm that switching Hetzner VM to i440fx (rescale to Intel plan, t=
hen
ask Hetzner support to switch to i440fx as some Intel VMs are also provisio=
ned
with Q35 chipset) solves the issue (on the same 13.2-RELEASE kernel):

--- cut here ---
ITEM                   SIZE  LIMIT     USED     FREE      REQ     FAILSLEEP
XDOMAIN
udp_inpcb:              496, 510927,      12,    1516,   70257,   0,   0,  =
 0
tcp_inpcb:              496, 510927,     649,    1383,  111267,   0,   0,  =
 0
udplite_inpcb:          496, 510927,       0,       0,       0,   0,   0,  =
 0
--- cut here ---

The difference between i440fx and Q35 is that the latter provides "modern"
virtio devices, while i440fx provides "legacy" virtio devices.

I suspect the problem is somewhere in "modern" virtqueue or modern vtnet
implementation (which has been added in FreeBSD 13). FreeBSD 12 does not ev=
en
boot on Q35 chipset because of missing "modern" support.

I would suggest to not do any MFC of "modern" virtio until this issue is fi=
xed.

On a side note: I have reproduced this issue with Q35 chipset ("modern" vir=
tio)
on a plain 13.2-RELEASE in a Hetzner Q35 VM (any AMD plan) with just nginx
serving static content (default nginx page) and running "ab -c 100 -n
1000000000 http://x.y.z.w/" in a loop:

--- cut here ---
ITEM                   SIZE  LIMIT     USED     FREE      REQ     FAILSLEEP
XDOMAIN
udp_inpcb:              496, 126863,   12187,     261,   12475,   0,   0,  =
 0
tcp_inpcb:              496, 126863,   29245,     219, 1204697,   0,   0,  =
 0
udplite_inpcb:          496, 126863,       0,       0,       0,   0,   0,  =
 0
--- cut here ---

Also, I noticed that nginx process becomes unkillable (even with SIGKILL) a=
nd
"ps axl | grep nginx" output is as follows:

--- cut here ---
   0  848    1 1  20  0 20024  7624 pause    Is    -     0:00.00 nginx: mas=
ter
process /usr/local/sbin/nginx
  80  898  848 0  33  0 20024  8480 -        R     -     1:44.88 nginx: wor=
ker
process (nginx)
--- cut here ---

Notice that nginx worker process does not have MWCHAN. Also, trying to do
ktrace/struss or attaching gdb to nginx process just hangs.

Additionally, adding a simple Django application (just default empty Django
application, run as "manage.py runserver") behind nginx increases a probabi=
lity
of inpcb leak (USER counters grows faster). I use simple reverse proxying l=
ike
this:

--- cut here ---
        location / {
            proxy_pass http://localhost:8000;
        }
--- cut here ---

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Mon Aug  7 22:47:15 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKWfX5WNYz4mT0v
	for ; Mon,  7 Aug 2023 22:47:16 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RKWfX2fsGz4RVd
	for ; Mon,  7 Aug 2023 22:47:16 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691448436;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=HgBB5Ayc/67p8HUCb7CIdFsy72QTL7tUbV9QtARyKks=;
	b=WEmYF78gO6i//9Eo1yF3HfgHhBDLhnPerge6v0rMw7a7aMrf1wTWWQWrjbUojFeMINPo9q
	/eow6P4nh3qckFpsg954Oc37nZmVDlg5lWOcA16BdyzwQVc+aU9uPuvlq1NHzIyVtHQqto
	2EbXuhnsq2uPri71qFwrOvNBA0LXMC7eA4y7GUpde4cwuat5vjDEGRA8BjPks3b56MwfXB
	V29c/jPWh8Yb62fHJ2m9so4I3SD9u3D5ih496bFVS3ZZ77V9y+l3wiNsvMzzKYbm07oIgc
	K5nAUIapBRdQGOGEoZi8qFhT76BYXRThsWlM9lCrUZWml1yOIla8B7L6qDJY6Q==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691448436; a=rsa-sha256; cv=none;
	b=npv5OHvb8jBL560VC5i8ioMhpYXd9uiUIRIAfKR+c0qBrFoj2JyA6GfKL4erz+mBQ7JnyL
	dzR5Dqq31WILURGw3UVKHLOqt2xWTUWS7cYppQ3GQ21EX3AO4U8JIfOTUa4KzrZHBAFBON
	HDzIYWHwzWej03l9v+3rG6ojEjEQOWD6L46RES3VIy1Zn9psRyfTF6ejQIBEznsSW6wIU2
	WJhdxCwF4t59cbboVpSOD8rH6wlxBjmwqLrE40I6zQhEQMTgZDjecn8tUPt0slQV1SKBpr
	Vr6m1UpaZMvY+NJIVc5zR1SlHrAGafcf5tTEJ5V1jicoTSP9fZplvcGssaxWBg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RKWfW5CxZz197y
	for ; Mon,  7 Aug 2023 22:47:15 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 377MlFlH089234
	for ; Mon, 7 Aug 2023 22:47:15 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 377MlFgK089233
	for virtualization@FreeBSD.org; Mon, 7 Aug 2023 22:47:15 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Mon, 07 Aug 2023 22:47:15 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: glebius@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #7 from Gleb Smirnoff  ---
Max, I'd appreciate if you run same tests on 14.0-CURRENT. The inpcb subsys=
tem
is significantly rewritten there. If the bug is still there, that means it =
is
outside of inpcb engine, but is isolated to one of its users. If the bug is=
n't
there, then I'd be inclined into setting it to FIXED in 14.0-RELEASE.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Wed Aug  9 08:55:26 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RLP5q1xSHz4mRFq
	for ; Wed,  9 Aug 2023 08:55:27 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RLP5p6gLzz4fYk
	for ; Wed,  9 Aug 2023 08:55:26 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691571326;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=XoORQsYI0+MZRcuDv+hHSzvSoEJYdUlYNwo2S4z3Jf8=;
	b=A/T5Ls41Yr56NqDCxaNJnT55qxzVeqRhNxylG2Yzpl6bdrd8oaFWlQUl1hfQyLOrHdSzSq
	V9qtWBhECz1toocIZm5ymtm7FqxLdIzc7XUlPZkssw24399DtLVRU1LRoCvbGnCLsIy2EB
	XeIvIlpA56Zn0exTsvZ4CXv8+C4RtGur63giuhhtrRp4KFVR6EFAnbe7+HVjtSkUAUmfXu
	dW4+UmBn1T8qYR+OGDwLA0CPg/F+HTXRWWIHrBb7n4w2nbFRTpMbdk8Hu1L7Aho0i70MCo
	b6vduimON+RAu3IGAms4Yz4UR/WbY5cdIO0GM1hoMQHfFvgw2xkQBAkC2M+GOQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691571326; a=rsa-sha256; cv=none;
	b=j+5Um1xc/d5Au9DW14R35s7ZtCHHehZ0JxO1pBp0XPz7S94C0t0N6vYMUc4jGdRcm9sJFz
	vhHdITEKZdR3MXzZNzN8RG/2cZVgUZmoY5/a/aAHR/M3wGLJjbSxCMG71XmDwRwtw9vcVn
	/XYU5ToQdCJRSRcbp70BXdMAD7id5kiD6JK41EjMln91+2GcnQuWm6zWMZDpc/5yTCl7OD
	PtF6/o88NPdi/R8rGv/ZXkg52MnLEixi6Xpdm7C1cc6vURuk5kHd/XWawlIy9W02xnZG5Y
	SM7dZpTQ+XuFuoP5y50QYltenpxe5mgow/pllCoVXzEVr+W5OpPaNN8fsmwokA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RLP5p5dWFz18RB
	for ; Wed,  9 Aug 2023 08:55:26 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3798tQat033784
	for ; Wed, 9 Aug 2023 08:55:26 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3798tQ8u033783
	for virtualization@FreeBSD.org; Wed, 9 Aug 2023 08:55:26 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 272015] make -j8 buildworld *** [vdev_raidz_math_sse2.o] Error
 code 1
Date: Wed, 09 Aug 2023 08:55:26 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: needs-qa
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: editor@callfortesting.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: cc
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272015

Michael Dexter  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |editor@callfortesting.org

--- Comment #3 from Michael Dexter  ---
Looking at the patch and the output, why is this flagged as "bhyve"?

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Wed Aug  9 08:58:14 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RLP935j0Xz4mR3S
	for ; Wed,  9 Aug 2023 08:58:15 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RLP925Krqz4fqn
	for ; Wed,  9 Aug 2023 08:58:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691571494;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=CFVfOg7l7mZrHjniPOc6f4CZzt40/7AMTcHXHJ4G9mc=;
	b=NcDHHYiLJ+/YckJKMrsW7ovxpy1TnFgP9c6Gy0o3YL8h7JuxbzfGjqHMPf5yV0cJzfSASf
	/twMHxHcY46M/AgDfPJglUJ3dJqLoT9AFu1fX1IlDhy6GbUJQRvGXCHnNZPetmYxs38ikK
	GxNzSLp8+eu3niROLGsWFsshrLfN90RtfCs/F9JQwGDnL6/7E1cXlPECfvvyjxqpG4Ei+W
	28LFDUT8jZ4abtp5FPXUGs0uaLXguYCq8zPcelj6dO50bMqj0NXRNDfpS5HrIDbQIkvQ0T
	6TFyo2pLqDyIVBYApnSpPZJWl7fuBvK+dy5TjzB8P0qAiy5BROiVqbYwDoYxTA==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691571494; a=rsa-sha256; cv=none;
	b=m56an86VhMiIgrH4S18QBh16Hsa8mxRNpuOyVE+WY78XP3ZdeSA8e8oqsEPO0aOriCUDP4
	uM0PmRejnQAVio8UbB0wM+gLBgtF1K/3rY6H5SS+s+bTro0cEMkALfFYrjUFxertnRnYWo
	JSuwUbecd/3/zj1rwBw/xKU/xJe9MMabip2xToQAcTKd/OIyH1kCfdsAdutxGzzZbLeTJR
	9DRNg8NqycsSeSfs/A1SqRqZ4oEsyXlScVHBpSYH/BxKbBeSFcow4HvEIID/gcidA11JQ5
	c3wLXe7i1X4Hy9fLfcD5IzwZu/24trLRK6W+DQLKfCZWMp1V6j6x0XzN4l9mqA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RLP924Pw6z18RN
	for ; Wed,  9 Aug 2023 08:58:14 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3798wEqr034901
	for ; Wed, 9 Aug 2023 08:58:14 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3798wEhs034900
	for virtualization@FreeBSD.org; Wed, 9 Aug 2023 08:58:14 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263057] Bhyve vm not starting
Date: Wed, 09 Aug 2023 08:58:14 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: Unspecified
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: editor@callfortesting.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: cc
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263057

Michael Dexter  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |editor@callfortesting.org

--- Comment #2 from Michael Dexter  ---
As 11.2 is end of life, are you still experiencing this issue on a supported
version of FreeBSD?

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Wed Aug  9 23:05:34 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RLlyk3tD2z4mQwn
	for ; Wed,  9 Aug 2023 23:05:34 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RLlyk1z5Yz4PFw
	for ; Wed,  9 Aug 2023 23:05:34 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691622334;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=IIDfsd6Npqu2dA7a15eY/zmu2MGVqo0+LPZFOBHjfVM=;
	b=yYIJQ9mC9v1yORSCUSoK7g4mGAupFwvLv7tEISj8pxW/nsCtidJt7p4QT7GbxeXYo2+reN
	i7UCw5raAr2PDQaSatiY+ltlu8gP29WEyf7kInZFlb3rgCzP10G2ZdYU0qQqfB5kNPATY1
	RQ/2IXNgfb3Xvxlr1eM1OIVvZlO/ruGoHccprKo0WWElLVSw/uRyNKa1VthaS9YLhKk7Sj
	0cCIj41DAAvXz2hPeWsu0IkEQNE6jvGwIg+cokX8DHpKJzXPt/Gi+EWDUj150WV4Ksd8HV
	z2OMLQwLrUPGJraiw/ISf4Ntt6OcduX2T0yyJkiIhThiQaWxiE+Fzdu25380Dw==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691622334; a=rsa-sha256; cv=none;
	b=fw/DOiygia5CgwJabk6TzTmBtAAngCeNnEjxz6AX5iozOX5438RwnkJyCNBkJxW8PgkiIH
	yFW8l8VtTD/yqZvOjyQqqOPNLjToTcIGvKYP+fI3UTiw5Hojp+4D2d3poKXP3sSHn705hA
	kXerTdgXhVhynX7IqcFy/oDKdFYRqzOJ9LxRGMuFft0HiwUXlgiN9XPlfbku/JC+p+dSwf
	Ma0LtzeckowxNuz9LTE4eVNlrAXw7qrxJoG79YMAEhKlNVMSYIpocLxaGj5cEBY5HWSOon
	DQis6SL1aKVoQJ5z8x410G5w0RkPM9grnVw1mlVXu0SnupiA7J2g9vA/g9ajaQ==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RLlyk123lzZDJ
	for ; Wed,  9 Aug 2023 23:05:34 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 379N5YfB074585
	for ; Wed, 9 Aug 2023 23:05:34 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 379N5YEk074584
	for virtualization@FreeBSD.org; Wed, 9 Aug 2023 23:05:34 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Wed, 09 Aug 2023 23:05:34 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #8 from Max Khon  ---
I built 14.0-CURRENT GENERIC kernel but "ab -c 100" makes nginx worker dorm=
ant
(stuck, not answering and in unkillable state) faster than it was on
13.2-RELEASE. So I don't get to the point where it may start leaking inpcb

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Wed Aug  9 23:12:27 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RLm6g65r2z4mRQR
	for ; Wed,  9 Aug 2023 23:12:27 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RLm6g4ltXz4Q2B
	for ; Wed,  9 Aug 2023 23:12:27 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691622747;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=0GId4y6bl6xxqgG0i+QBlpNIZE8hTOSLPZkowjia70g=;
	b=hAoWWKANdTOLXiPFD0byT3Hb1IkcyOGzX8mH40qbfHhnK0/WqlzzOR53XaEAdCjQM6/uXy
	PTVNii/+GFKzQfz9p04rkDDvK0/tR5oDTr2EI0ynDBcGQ1Iqw1SLKeXRA+NJuNNdIJA2a+
	hiuFKKZW7O6KpmvY5dPtNRmx91aqxjd6G2qnAV0cz1wpn59crNm2Qjz0fa7VctdaokUAmB
	qsBHQWlk69J2P+8/cUtgnCrqL+/Ws4fL++8y0hOTS+uqXGVYa+UdFWdAqA6jCFjWJEYSaU
	9hIf5BVfybKn+RVRuruUOmZBOYA1uAzXecFi6RTf9rW/OThBY60TRByfZEcCQA==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691622747; a=rsa-sha256; cv=none;
	b=R8sZwB7IJk1d5gGEzNi6OQXBf0T/VA4ljM7K/3vSM7kiS2388Kkb6lq9mda7XnX6uWIo3v
	KLdeomVUBlOSOJg6ttc9EUSxcu1wJzTxl+Y+TUwuI9Z4aQYXgIgBbYVKV53NRm9hGftIdZ
	VpOWMNH1OM3B4u44GHJwO5q1y3/+sZl+9Pmu7MbZW7OeoywqgIgtM1ZhpSuh9f4hL+fxaV
	8bQ+aH7aiko30fw241Yn6Ht1cMFqfJ/gRLmFiI8tPLGBpSlcrFHnjxVN3Tgd7qLOLnP5z6
	qLvkP2kkmcBJo1q2Biv4zvfrrelR3TpdFrH+Jwg1gcjza/Ganp2/5D1He2EIBw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RLm6g3rm9zZF8
	for ; Wed,  9 Aug 2023 23:12:27 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 379NCRnS088130
	for ; Wed, 9 Aug 2023 23:12:27 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 379NCRJW088129
	for virtualization@FreeBSD.org; Wed, 9 Aug 2023 23:12:27 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Wed, 09 Aug 2023 23:12:27 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #9 from Max Khon  ---
I will try again with GENERIC-NODEBUG kernel

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Wed Aug  9 23:37:52 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RLmh06qm5z4mSNW
	for ; Wed,  9 Aug 2023 23:37:52 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RLmh05pQRz4RJX
	for ; Wed,  9 Aug 2023 23:37:52 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691624272;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=xhj6xHL3baWm+fNwE2TV7Z6MUTEWlctpOsxxy0PevGU=;
	b=s/tY4akxfjPlKAFtygIdfzUq/aiBF78OV6bsRQCf6P+KlWrjojW+R18nunvMu4lkRXm9Yr
	uI/2UjkfuNG3qJIaOiRpcUdLrccgq7W1QDX5ezCKU/r4tFf6ZsJnCjfhLzKjtjLhT5Se7V
	18m8UMXUzzcsK19S37gdl6aKLnNyDzs6bhyfhQX18U5/gEonozHqGDPybrAMwJKXdiGI+t
	2KgjquMXFl/UhQ5b1vvB/dL0gMACddK1x8+RFUDmWIk4fe0CHkKgtiASEy0RhElJ9E3sZ+
	QChPnnDo63gVzgkRyprJoR4AhKtfp19yvfHGBIizbjbxSj6E6s9yFbVapaWfLQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691624272; a=rsa-sha256; cv=none;
	b=PGDa/1Hq6k4rA6bkbzYsZHC32qJ64D1eSXCg3rIul/0R5UCjrJqzaDXdq7jB99px//oSYi
	EEonTh3ckV7BrZ35uvZuA5QlH+OCn5q9Hu6m/isKfDEF8/GhMh/NUy18M32zyr2HMqtZRI
	EJ95DYFnl2FuerBPiHKreYFFyOoog5ADT18DMPgvINx3U4Bz6sJbgYjvyHnabFkdVsfTHH
	SQ4lHORU+jZorPSNBkorKxicU0RwIyINh+mHyOKfPmEBoS4VcIwNbNMlTO61YUdYlz6Rax
	KkfYpO8NbxaEIMnz/tilv5Yu+ZUIt2qWvNUIA6ul3ImiJFMFHNNqpqFBTMqjPw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RLmh04n9KzZst
	for ; Wed,  9 Aug 2023 23:37:52 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 379NbqG3017239
	for ; Wed, 9 Aug 2023 23:37:52 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 379NbqsA017238
	for virtualization@FreeBSD.org; Wed, 9 Aug 2023 23:37:52 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Wed, 09 Aug 2023 23:37:52 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #10 from Max Khon  ---
Eugene, if the problem is still actual for you, this is how you can get the
chipset:

--- cut here ---
$ sudo dmidecode -s baseboard-product-name
Standard PC (Q35 + ICH9, 2009)
$
--- cut here ---

On i440fx the output is:

--- cut here ---
$ sudo dmidecode -s baseboard-product-name
Standard PC (i440FX + PIIX, 1996)
$=20
--- cut here ---

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Thu Aug 10 11:56:28 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RM54D2lZ7z4m8yJ
	for ; Thu, 10 Aug 2023 11:56:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RM54D1m8Bz3CR8
	for ; Thu, 10 Aug 2023 11:56:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691668588;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=mT5c7lsD1q8xpRGo0LuVMprrsQpYpoiE1V/79Mx1ue8=;
	b=nqwJFjf94gyx8IbCRV0mHI52H+XsxPlwdFMpUO4OU8j41zalblpj5GhPwWHZBC9ECsA68h
	XQOx4utjj+9jBpzZllYi3s1TvDsveph/oLX2bvFC/pXPDbx5y0UwxaKYj8WwFgcCd321XA
	ZNCM3mEwyahv0nPiFnznLpWmDazNl/2ymgczcMHIvGNewWshtSzr5GofDWNfkHIGVoozyP
	JJGq815RmALHKSUDFLpSS1JIuxhVPt7tjJYXj0oTTevCzIgxRMYwh9Zm5Lz2O09OOZENZj
	iis7LW6Bs/sSd81/DK6z0vzv1cCw4F8ihnsoR9ozIpcdhIlfpbMILME6uiNiMQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691668588; a=rsa-sha256; cv=none;
	b=f4OwboxfQj3fKQMUCI/m+McfpYXvaMyMs7TaFbjES7EaeX9fGxPsoyLVsb3F4DKLQXWRGe
	E3ODX5tfbjBmuxRoXXfJKsrkSfc5CxfzDBciVYydS64DezQfFb6Bm6AkHjHNqYAAfeo3pg
	lKibwoXo+0+YXLmhCsGPUZOZV/6nZS26Yjy1YIsQ9whCR4W7U98nBC68d91ZQTRN9UMI3u
	2xuU86xWYro1MW8OQsArj0iS61BIgVNHZGImpfD1Ypkcy/AjNut533Pzp21+qSrh418sts
	s1dqgPWU4EZv5jgzRClgl0DMdzz5hDHbWuoJSBXUr3t5Z/GjyN3J6QKu5PC0Rw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RM54D0m31zwQP
	for ; Thu, 10 Aug 2023 11:56:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37ABuSiw002172
	for ; Thu, 10 Aug 2023 11:56:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37ABuSOh002171
	for virtualization@FreeBSD.org; Thu, 10 Aug 2023 11:56:28 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 250962] Bhyve Nested Virtualization on Xeon(R) CPU D-1540
 broken
Date: Thu, 10 Aug 2023 11:56:28 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: bhyve
X-Bugzilla-Version: 12.2-RELEASE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: mikael@FreeBSD.org
X-Bugzilla-Status: Closed
X-Bugzilla-Resolution: Works As Intended
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: bug_status resolution cc
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250962

Mikael Urankar  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|New                         |Closed
         Resolution|---                         |Works As Intended
                 CC|                            |mikael@FreeBSD.org

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Thu Aug 10 14:41:56 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RM8lM0t0bz4mMpl
	for ; Thu, 10 Aug 2023 14:42:07 +0000 (UTC)
	(envelope-from meka@tilda.center)
Received: from c3po.tilda.center (c3po.tilda.center [108.61.164.129])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RM8lL2M2lz3b0F
	for ; Thu, 10 Aug 2023 14:42:06 +0000 (UTC)
	(envelope-from meka@tilda.center)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=tilda.center header.s=c3po header.b=Bgd5z9Hg;
	spf=pass (mx1.freebsd.org: domain of meka@tilda.center designates 108.61.164.129 as permitted sender) smtp.mailfrom=meka@tilda.center;
	dmarc=pass (policy=reject) header.from=tilda.center
Received: from [192.168.111.178] (meka.rs [109.93.255.137])
	by c3po.tilda.center (Postfix) with ESMTPSA id 8CA9D3C91E
	for ; Thu, 10 Aug 2023 16:39:35 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tilda.center;
	s=c3po; t=1691678376;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=KVz+Z6/FyWrWrh7FeRhb2uE4Yovbjdhrz08ugAGo3Fk=;
	b=Bgd5z9HguIHhPizTfevcHvLcfjgcO+bRtN8h7ZD0moFA9TL5wLY5/BCHJcBhnl4+dcYARk
	49dnWN++FVN4A9HX6HOHp8ot+YrurWYG0HEIiL3R+afSvRKRh4jJqHgR9NeKFuSZZWlKQp
	nS/FDzSwxwH2uHeVluP10H52nF/M2pQ=
Content-Type: multipart/alternative;
 boundary="------------5JEomuJTZc5jI8v1L0YC1pHY"
Message-ID: <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center>
Date: Thu, 10 Aug 2023 16:41:56 +0200
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101
 Thunderbird/102.14.0
Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm?
Content-Language: en-US
To: "freebsd-virtualization@freebsd.org" 
References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org>
 <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center>
 <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org>
From: =?UTF-8?Q?Goran_Meki=c4=87?= 
In-Reply-To: <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org>
X-Spamd-Result: default: False [-2.87 / 15.00];
	SUBJECT_ENDS_QUESTION(1.00)[];
	NEURAL_HAM_SHORT(-1.00)[-1.000];
	NEURAL_HAM_LONG(-1.00)[-0.999];
	NEURAL_HAM_MEDIUM(-0.97)[-0.970];
	DMARC_POLICY_ALLOW(-0.50)[tilda.center,reject];
	R_SPF_ALLOW(-0.20)[+mx];
	R_DKIM_ALLOW(-0.20)[tilda.center:s=c3po];
	ONCE_RECEIVED(0.10)[];
	MIME_GOOD(-0.10)[multipart/alternative,text/plain];
	ASN(0.00)[asn:20473, ipnet:108.61.164.0/22, country:US];
	RCVD_TLS_ALL(0.00)[];
	MIME_TRACE(0.00)[0:+,1:+,2:~];
	RCVD_COUNT_ONE(0.00)[1];
	FROM_EQ_ENVFROM(0.00)[];
	MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org];
	DKIM_TRACE(0.00)[tilda.center:+];
	MID_RHS_MATCH_FROM(0.00)[];
	FROM_HAS_DN(0.00)[];
	ARC_NA(0.00)[];
	TO_DN_EQ_ADDR_ALL(0.00)[];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	RCPT_COUNT_ONE(0.00)[1];
	PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org];
	RCVD_VIA_SMTP_AUTH(0.00)[]
X-Spamd-Bar: --
X-Rspamd-Queue-Id: 4RM8lL2M2lz3b0F

This is a multi-part message in MIME format.
--------------5JEomuJTZc5jI8v1L0YC1pHY
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

On 8/7/23 10:04, Corvin Köhne wrote:
> Hi,
>
> afaik, qemu is making use of the swtpm project too. So, it'd great to 
> implement it in bhyve.
>
> My TPM passthrough emulation is currently under review. See 
> https://reviews.freebsd.org/D32961.
>
> I designed it to easily integrate a swtpm in the future. You  just 
> have to implement a new tpm backend by adding a new TPM_EMUL_SET.
> Take a look at the tpm_emul_passthru.c file.
>
> Btw: We may have to add additional functions to the TPM_EMUL_SET like 
> a "startup_tpm" function. See 
> https://elixir.bootlin.com/qemu/latest/source/include/sysemu/tpm_backend.h#L52

Hello,

I was looking at tpm_emul_passthru.c and I've seen it uses open(2) and 
write(2) for initialization and command execution. From before 
(https://youtu.be/5wDs1K5ppbQ?t=940) I know you planned on adding tpm 
pass-through, which I think was just merged. Anyway, if pass-through 
uses open and write, can it be used together with swtpm, maybe? I can 
successfully run the following command:

swtpm socket --tpmstate dir=/tmp/mytpm1 --ctrl 
type=unixio,path=/tmp/mytpm1/swtpm-sock --tpm2 --log level=20

I can see /tmp/mytpm/swtpm-sock but I don't know how to try to use it 
with pass-through.

Regards,
meka

--------------5JEomuJTZc5jI8v1L0YC1pHY
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit


  
    
  
  
    
On 8/7/23 10:04, Corvin Köhne wrote:

    

    

      
      
      
Hi,

      


      

      
afaik, qemu is making use of the swtpm project too. So, it'd
        great to implement it in bhyve.

      


      

      
My TPM passthrough emulation is currently under review. See https://reviews.freebsd.org/D32961.

      


      

      
I designed it to easily integrate a swtpm in the future. You
         just have to implement a new tpm backend by adding a new
        TPM_EMUL_SET.

      
Take a look at the tpm_emul_passthru.c file.

      


      

      
Btw: We may have to add additional functions to the
        TPM_EMUL_SET like a "startup_tpm" function. See https://elixir.bootlin.com/qemu/latest/source/include/sysemu/tpm_backend.h#L52

    

    
Hello,

    
I was looking at tpm_emul_passthru.c and I've seen it uses
      open(2) and write(2) for initialization and command execution.
      From before (https://youtu.be/5wDs1K5ppbQ?t=940) I know you
      planned on adding tpm pass-through, which I think was just merged.
      Anyway, if pass-through uses open and write, can it be used
      together with swtpm, maybe? I can successfully run the following
      command:

    
swtpm socket --tpmstate dir=/tmp/mytpm1 --ctrl
      type=unixio,path=/tmp/mytpm1/swtpm-sock --tpm2 --log level=20

    
I can see /tmp/mytpm/swtpm-sock but I don't know how to try to
      use it with pass-through.

    
Regards,

      meka

    

  


--------------5JEomuJTZc5jI8v1L0YC1pHY--

From nobody Fri Aug 11 03:24:27 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMTg026vtz4m61H
	for ; Fri, 11 Aug 2023 03:24:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RMTg00grwz4NkN
	for ; Fri, 11 Aug 2023 03:24:28 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691724268;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=oCZfubGpyx1QMTQUMw10pBURNz0qUxvlbhuPl+t7isM=;
	b=jhF7w5G9Bno7TKrA9Yv6RJNVwpZ+CO3XE6cbGZpFylphH/zUDfjVH0ZIVnjYGIQGOxhzvs
	va7OsSrWhEPErexQRtUm6qAomitFco5pfYzie2nqg2tUbG5bcpbGgDvCq5CadJUc/ae0Ce
	AT0tkJo1RTg5qJBk8E407jFtM9C+SP7cwSyBachRp5kENN3fWfhcxqbi7PPdmBuf2nKDX3
	qPBYCldugefrhJtL5WNfrB3zPNkufI5Ja612sAg+dNzC8aei+TmwvwmowSLcQ0CchpNrIr
	Byz5OMg8+z/N1EAAq96svYceGNEMoAnHtymbJ3m1sAD+QNGsH0R8TykzDT7lBg==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691724268; a=rsa-sha256; cv=none;
	b=jT3dHbEXeiIgGCWC34eUfwR+2z5laVFeg5geqdyd8asRmhoT9JvpGkPbvHkY6II5lb7VYV
	SC4Jmq12J3EW59gkBhcSWtDVIqJjesYm5DL5AO0DKsU+vwQS24as7XRtEInO7cEEAC6VIM
	PLCjBPCTfADlyJMXwzpVA54v8ug1p/XneY0Coa7HEVil/qzEo3YJXYnWr5CVBz4Pv27HPo
	ZQclghV7DvEA2Ecu6xquvi59OGYgsAOtfNPVAxUQOlh74S62e6IDuo3oKsQ70j+5Vwt1t8
	Y0mGN5q9P/IJ9dTwfRI4PCw+5eab7wwfDNkaR/ZlCyXsV7QrwoXI5WM4/Ac/YA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RMTfz6sbmz80M
	for ; Fri, 11 Aug 2023 03:24:27 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37B3ORnL074372
	for ; Fri, 11 Aug 2023 03:24:27 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37B3ORjm074371
	for virtualization@FreeBSD.org; Fri, 11 Aug 2023 03:24:27 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Fri, 11 Aug 2023 03:24:27 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #11 from Max Khon  ---
With the help from glebius@, kib@ and afedorov@ the root cause has been
identified to be this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D=
269823

The patch (https://reviews.freebsd.org/D38898) resolves the issue with inpcb
leak in 13-STABLE (and with user processes stuck on close(2) in 14-CURRENT).

The symptom (without the patch) is as follows:

--- top -HSP ---
last pid:  2699;  load averages:  4.35,  3.16,  1.41=20=20=20=20=20=20=20=
=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20
      up 0+00:02:53  03:35:34
807 threads:   8 running, 773 sleeping, 26 waiting
CPU 0:  0.0% user,  0.0% nice, 99.2% system,  0.0% interrupt,  0.8% idle
CPU 1: 47.5% user,  0.0% nice,  2.8% system,  0.3% interrupt, 49.4% idle
CPU 2: 46.9% user,  0.0% nice,  2.9% system,  0.3% interrupt, 49.9% idle
CPU 3: 47.2% user,  0.0% nice,  2.6% system,  0.5% interrupt, 49.7% idle
Mem: 4098M Active, 1130M Inact, 955M Wired, 483M Buf, 1522M Free
Swap: 3676M Total, 3676M Free

  PID USERNAME    PRI NICE   SIZE    RES STATE    C   TIME    WCPU COMMAND
    5 root        -16    -     0B    16K CPU0     0   2:51 100.00%
rand_harvestq
   11 root        155 ki31     0B    64K RUN      1   1:27  73.97% idle{idl=
e:
cpu1}
   11 root        155 ki31     0B    64K RUN      2   1:30  71.97% idle{idl=
e:
cpu2}
   11 root        155 ki31     0B    64K CPU3     3   1:29  69.97% idle{idl=
e:
cpu3}
 2665 sentry       79    0   338M   143M CPU2     2   0:03  23.97% python3.9
  910 kafka        21    0  5150M   443M uwait    1   0:07   1.95% java{C2
CompilerThread0}
 1246 sentry       20    0   241M   148M uwait    3   0:00   0.98%
python3.9{rdk:main}
    0 root        -16    -     0B   640K swapin   3 690:21   0.00%
kernel{swapper}
 1204 www          78    0    24M    13M RUN      0   0:07   0.00% nginx
...
--- cut here ---

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Fri Aug 11 03:25:03 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMTgg5Hfvz4m5pX
	for ; Fri, 11 Aug 2023 03:25:03 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RMTgg4FSWz4NmF
	for ; Fri, 11 Aug 2023 03:25:03 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691724303;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=8+Qr/HWdPOWJ/LYLI9Tksscb9uPVj6EHzwbmJMs3o34=;
	b=SsBZLRx+wG5jjYdc/RcCQDCS0wTZ0+kDfg+F9qJX3EC+FXe4iodRq31ueyPHUSbWhDnUdF
	2KLCm5zEPr2OulnnxXbtHnELkg0dClUGs/zQV8hgsKvobTjrO37gl9QHn7Riym1dzSXVyX
	7oXPjkhUSx1tqllrLj0LMXJrac/tDIa5AuizgPx3VaeVLdhrYu2MMXdJjGcM+D3muy8sVf
	T6Uc9jzlHP6jOGBQazRZ+wc2ZbsIxzbY1XRtWUNqNQyezch5s81Mdjue7hM8Ht45mEYcad
	q9TNPj/cOR2UWJ78fuW/HR2rrEqvkZOhI+HwJ5c+F89hnDWwmKVAVL7GlTg0pg==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691724303; a=rsa-sha256; cv=none;
	b=QOsDJNfTpyO3tBRUjBSwJO+A6Ank8z0rGhd6qBdc1Y7dPajUqUiyYwQyCS8l8wbnrnXeh1
	h1tda1IYe9guerU+lWfK0+kND0mVfkER6i0iuahIYit7NS7nlbCp47TjVaMRo+bh9VLHrY
	UrHdO3tMeEDtv37E222r7NAJWZyPynqFKDuXPcroBV/L9kOXBhACv2lcOwmC4pJy2Pm2sZ
	s4A2rv0H74sBaNxZJ0wOxZr12xDldM1ZOA+Uq/nwIlhFd0hmZl47vkZB1ZoLTUqpjShn2F
	vWOLr3TxwWMU/gn1/7nN+IngXu1HAaAxL0/8cn6yrTeV4PQDjCnzKYA10EOZZA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RMTgg3Ktfz852
	for ; Fri, 11 Aug 2023 03:25:03 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37B3P3bO074682
	for ; Fri, 11 Aug 2023 03:25:03 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37B3P3oM074681
	for virtualization@FreeBSD.org; Fri, 11 Aug 2023 03:25:03 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Fri, 11 Aug 2023 03:25:03 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: see_also cc
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

Max Khon  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.freebsd.org/bu
                   |                            |gzilla/show_bug.cgi?id=3D2=
698
                   |                            |23
                 CC|                            |jmg@FreeBSD.org

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Fri Aug 11 03:25:03 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMTgh2rmMz4m63G
	for ; Fri, 11 Aug 2023 03:25:04 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RMTgh1Dzgz4Npt
	for ; Fri, 11 Aug 2023 03:25:04 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691724304;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=AfZcxbAKi4MX9oIouUlRDZbAiYDdCsK9vfTEVPsYPY4=;
	b=U2Sp7xaUmDA/NjX8NAm7ffYU6xS7liauJkeMb2x2ripiVlgHmdkjcRo9mR/nq9ucxrENku
	l9RrJ+RuoMhgAgalKWDf8LR8jh4CUkHm4/2++HYCU+CFNBZNPKztWmEYabja40Rhg2J3Po
	YIocaoPNrWdksqSl7/ZFwAtJ4nwfK4cyAd3dOPOSkzRtrjXMb82zJhRvpomuLz52gVun86
	AaGeNoiMPViGWZLfYwnOWJvx+CUlCelLpLZ3/68qKGaxiwP/EIb+9OIY95upq7OPfe8rpH
	11xV9A2eq2OaqndZiSY2oYJE/Cudag0HYLMTRlM7VVyyR8bD33oR683xgJ/57w==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691724304; a=rsa-sha256; cv=none;
	b=Gl4CYdWiXDSIAfeBdLlvB0Ys5PVElCWrXIQArgbZnDwvI31pVg/FIZUpATBS2wyVLQbwVC
	hgDfD2jeTqR+Z6Pbtgpu2hZBen8i7AK6xCwvI9Hi6ZfUiiULy4Xt1HwYoYSCHOrO7e0jhE
	mcuta1cviKBLUqmHGQxy/AU46xb84Qv/ir54FX6oXlvPYoDzA+6VUXHOlHVI4aXWU+P+V+
	9Kd0+Y+Wl+Qz5ppmzPI5XI6kbcfVygly7zDha/CyM2NE1zdW4Wad5L81dlcKhCUJ9vQYXN
	MaSXv64ceEZ+BxBkm52DJ+QnaoSoctSnFbyKqCGAoB+oPeq3W1h+TQnNwtSWqA==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RMTgh0H12z80Q
	for ; Fri, 11 Aug 2023 03:25:04 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37B3P3ib074706
	for ; Fri, 11 Aug 2023 03:25:03 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37B3P3Sw074705
	for virtualization@FreeBSD.org; Fri, 11 Aug 2023 03:25:03 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 269823] rand_harvest produces 100%CPU on 1 CPU with
 virtio_random.ko loaded
Date: Fri, 11 Aug 2023 03:25:03 +0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: CURRENT
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: fjoe@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: bugs@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: see_also
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D269823

Max Khon  changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.freebsd.org/bu
                   |                            |gzilla/show_bug.cgi?id=3D2=
630
                   |                            |62

--=20
You are receiving this mail because:
You are on the CC list for the bug.=

From nobody Fri Aug 11 03:44:08 2023
X-Original-To: virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMV5j2G1Zz4m7Dn
	for ; Fri, 11 Aug 2023 03:44:09 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RMV5j1G2Tz4SKL
	for ; Fri, 11 Aug 2023 03:44:09 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691725449;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=+igxSbYNnwWf+Jbxh8Ow9ZrIUqMqst5s+tKwVxGTh/A=;
	b=OKwHQa/jfC85rXo0nlp8xipsUC7nOdqlJbf8Bke2TadLCrizjvUenkLRqbogl+kbX3TcYW
	hNKSn+TwWvrSqfg9DgjLsl0HLlkJQQH8GNMjUunhzs266s7JQpl7LBsUDUu+tVZxvcDoLp
	bGpIjFZqzCMoKc4x22ZWf0Qw40X/OqMg0JVA+HKBoS2kY5OSJuZCepCnOeBi+OHdWOygou
	pjrKXZJZg4KJWu/WzKYxnyRW0v83RYc0E8CY6vVz+A9D4lBqNa8+DIWB4P/8R86PyZ0ew5
	fqUHivmcWpaUv6xfz4lk1Xsn+rVPDEzXYWnqg8TDvK4FLTOcaQVoZ/oLv/fpxw==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691725449; a=rsa-sha256; cv=none;
	b=MyPuNB0qV5/8zhzzX/8+SCSgH3P0UVLXFTsLsTvFXlpkakiCYtT1/OFlI4AXRYpppoUI+1
	DmrnzyHDdcwaopKjltZwWW/OUfUfMsmfUKZWE/5hDXQtvzD7FZtrEMGL1PHAKWp06fTC3G
	7ZHz5bp7gHxWCMdU8G/3O+vZhw3oOzklKCvV/s6qpBfrzjU6F3fGXZ1A76m6abOYT2YL+G
	ESm2iaOKcNC4NEgCVECIH5uZxlJK9fCEmzN8FiYLSZ7tG8pwrEzZfTGfL7bzW/o+AjoJ2B
	xhAYwjfkCrUfWyv0K4Cy9R/dY0PziHy5OFtYhd6FlXXxv0PXGxlsgBqCjz9Ldw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RMV5j0L6Gz8TM
	for ; Fri, 11 Aug 2023 03:44:09 +0000 (UTC)
	(envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.5])
	by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37B3i8YW004538
	for ; Fri, 11 Aug 2023 03:44:08 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
	by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37B3i8C4004537
	for virtualization@FreeBSD.org; Fri, 11 Aug 2023 03:44:08 GMT
	(envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: virtualization@FreeBSD.org
Subject: [Bug 263062] tcp_inpcb leaking in VM environment
Date: Fri, 11 Aug 2023 03:44:08 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Base System
X-Bugzilla-Component: kern
X-Bugzilla-Version: 13.1-STABLE
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: glebius@FreeBSD.org
X-Bugzilla-Status: Open
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: virtualization@FreeBSD.org
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: 
Message-ID: 
In-Reply-To: 
References: 
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062

--- Comment #12 from Gleb Smirnoff  ---
I'm not 100% sure D38898 resolves all of inpcb problems on stable/13, as the
patch is irrelevant to inpcbs. However, it definitely is a requirement for
proper operation in some VM environments.

--=20
You are receiving this mail because:
You are the assignee for the bug.=

From nobody Fri Aug 11 07:06:05 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RMZZn00KYz4mMnq
	for ; Fri, 11 Aug 2023 07:06:09 +0000 (UTC)
	(envelope-from corvink@FreeBSD.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RMZZm5VMkz3HKR;
	Fri, 11 Aug 2023 07:06:08 +0000 (UTC)
	(envelope-from corvink@FreeBSD.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1691737568;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=ShMd+6yxb6+DKcFTHWrjAfmc0ZKSA9S9/R8d6Hx1svc=;
	b=TpjZzMfKTwPKjKrod3ZrViEnoojWQqA7g2UoU0hD2ajOp2VFoJhHjHoZ460WHwFES5vW2b
	vxsIrEB6j/b+V8AxEmEdyunV7r45ZOiBcok8hKCHotI7fAdxWBBNqoshDUvba6t+Vp40jK
	ajPRa5QAQPBhi6UXYonsS1RF1ZcasJn6guvhkdNLW34HzzCJ7Y1habwYXjWXZzuzuCCbKH
	N0cpSMXEYIYoE7nDerUdqsP6D+qnCbHUQlchmd5ZVPPX2K1nsnB62NNt8pFaF5xexhtncx
	WWfU2i3elren1J308+4ucyDDWbQNbbLqbaQ/fvoSoXzdINCj5wppqQv8CcN7Zw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1691737568;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=ShMd+6yxb6+DKcFTHWrjAfmc0ZKSA9S9/R8d6Hx1svc=;
	b=tsUUwx8DR5bq7ffOO4vHhFhmsMVZ4oGH8uzbxdAeOAtW/mzllqQySZC/tfmZyfezvebWmn
	2OP4tp4fdpnw2mV1NWxFs7oCr2jWkUpiAuG3ckAKmW+yRah6rxQ7O5A7qIoh9VMvjEKinY
	apriS/QZLFohgHLvm9eA+LTxilHFL5Ol7GzG45miOT4wmt6HY6cu80LSN8jPB6eC108Ee4
	NMlLgSvaBJwGtZyZEHoUblhutsvQEQDSyNzm8R7/7k8dU1pWlHN+dAqUOF2LTcbmJlj2jv
	vq6Zmn/fBK0nbe3k6knDD5SGR13uFz2793Zks7DoK9q4tXC5LebBYC77Kxp8wQ==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1691737568; a=rsa-sha256; cv=none;
	b=LTLBLujLr9ETuxUguYe7DDDQMvIDbua7rI/HVIeAb8oqDvI0nb0RFeTkfruCLvu5S4E+3j
	LzF2u07acCbaUzhbgmznLgeNUaeytbyquAK4Ljwy9S5rYxEakNba3TvwSDid+aBhmc/XQT
	ElhoZq3Mw51Crl6Wq3/1ebiZPJy3qwrDcfAtrrojAziVbwaU/cKtvujelhtscKblro/nl2
	Zhvz9q5vUQJWK1sMQvfcE1d79+kQGMwDcuX8wP8MhCslITy/kPl2p/9xq5dwxLXtWomf7z
	v5f4pZVPTDkqD+QNNWa8YZ1Iw5T5+rQAm+U9tQoXThbpzLCe6VrZcY+002ZCKg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
Received: from [172.21.179.63] (unknown [195.226.174.194])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: corvink)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4RMZZm1T6pzsyj;
	Fri, 11 Aug 2023 07:06:08 +0000 (UTC)
	(envelope-from corvink@FreeBSD.org)
Message-ID: <2c1205c0fc48e8c6ac103d3f3ca0c722a7cd3c6e.camel@FreeBSD.org>
Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm?
From: Corvin =?ISO-8859-1?Q?K=F6hne?= 
To: Goran =?iso-8859-2?Q?Meki=E6?= , 
	"freebsd-virtualization@freebsd.org"
	 
Date: Fri, 11 Aug 2023 09:06:05 +0200
In-Reply-To: <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center>
References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org>
	 <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center>
	 <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org>
	 <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center>
Content-Type: multipart/signed; micalg="pgp-sha256";
	protocol="application/pgp-signature"; boundary="=-gyC+CqPwAv19MqzDm2BC"
User-Agent: Evolution 3.48.4 
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0


--=-gyC+CqPwAv19MqzDm2BC
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Thu, 2023-08-10 at 16:41 +0200, Goran Meki=C4=87 wrote:
> =C2=A0
> On 8/7/23 10:04, Corvin K=C3=B6hne wrote:
> =C2=A0
> =C2=A0
> > =C2=A0=C2=A0=C2=A0
> > Hi,
> > =C2=A0
> >=20
> > =C2=A0
> > =C2=A0
> > afaik, qemu is making use of the swtpm project too. So, it'd great
> > to implement it in bhyve.
> > =C2=A0
> >=20
> > =C2=A0
> > =C2=A0
> > My TPM passthrough emulation is currently under review.
> > See=C2=A0https://reviews.freebsd.org/D32961.
> > =C2=A0
> >=20
> > =C2=A0
> > =C2=A0
> > I designed it to easily integrate a swtpm in the future. You =C2=A0just
> > have to implement a new tpm backend by adding a new TPM_EMUL_SET.
> > =C2=A0
> > Take a look at the tpm_emul_passthru.c file.
> > =C2=A0
> >=20
> > =C2=A0
> > =C2=A0
> > Btw: We may have to add additional functions to the TPM_EMUL_SET
> > like a "startup_tpm" function.
> > See=C2=A0https://elixir.bootlin.com/qemu/latest/source/include/sysemu/t=
p
> > m_backend.h#L52
> > =C2=A0
> =C2=A0
> Hello,
> =C2=A0
> I was looking at tpm_emul_passthru.c and I've seen it uses open(2)
> and write(2) for initialization and command execution. From before
> (https://youtu.be/5wDs1K5ppbQ?t=3D940) I know you planned on adding tpm
> pass-through, which I think was just merged.

There are still two open reviews required for tpm passthrough to work
properly:
https://reviews.freebsd.org/D40462
https://reviews.freebsd.org/D32961

> Anyway, if pass-through uses open and write, can it be used together
> with swtpm, maybe? I can successfully run the following command:
> =C2=A0
> swtpm socket --tpmstate dir=3D/tmp/mytpm1 --ctrl
> type=3Dunixio,path=3D/tmp/mytpm1/swtpm-sock --tpm2 --log level=3D20
> =C2=A0
> I can see /tmp/mytpm/swtpm-sock but I don't know how to try to use it
> with pass-through.
> =C2=A0

I don't think that this will work because the swtpm has to be
initialized before using while the passthrough device doesn't. So, it's
not implemented in bhyve yet. See
https://elixir.bootlin.com/qemu/latest/source/backends/tpm/tpm_emulator.c#L=
417
https://elixir.bootlin.com/qemu/latest/source/hw/tpm/tpm_crb.c#L279

> Regards,
> =C2=A0meka


--=20
Kind regards,
Corvin

--=-gyC+CqPwAv19MqzDm2BC
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part

-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmTV3d0ACgkQ2FTaVjFe
AmoJGg/8CEwZS/yuNU+5tEaNE+GzAyP5lKWBgYOcLjX4bckSkKTBu8jJk+CYuSwh
Np0BG/5cCkbckULSBzvTNMVbH/+hzQDqMnUv8K9zmHlwYTID6YDKjaaqPrVwIuiG
hwcm18NsiogYPAhoW3GaviqBggG8i0QvQBa3lDKAO5vgZRaOuQOj6z7BH7C169VR
rqhUoEVf51XuBcZye++wt+cj5dgHwguss6rKLAvveoQGk8WU2xjJQ3UjEekYMLtm
xXiHn5Xwa1whvy0Np1cediJiNn9LgkTObO3SJ479LO2G8wVbSM6I7Z7ZYtM6u0T6
33KREn4iNlhKJs1gbzJ1BMvdfD/ERuLCXEP0VN9OeTT84PpV7AOr99pBokKdDoFX
dL499b9/D59FGwudL9vYYOJdDlQU/oW9fPJNmKgeqo3iGYOtJOl/R2GolnsUBrdm
1RDb49i2otDZEUSqf+qBrqwVDkqdkBLhDtNIaor1vr4P2PZOTuDsBt+5EenGCJ3D
Pdk8GgmO8zSBODmRuZoNpj649XJvnVT+v1MUsGj++39biC8glrWswQ84ftRlDO6R
5Te5v81tg9MEcI61XeYnaJmB0qjI9LnNDUmKldLkWX1bSDpAHC8o3yKqWbddzQFq
/B4akROaBJ8zYJv954fsBItyp8tbmu9H7frSMGOSgZrq4jfS0Kg=
=K4+x
-----END PGP SIGNATURE-----

--=-gyC+CqPwAv19MqzDm2BC--

From nobody Sat Aug 12 09:24:28 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNFcj5GgRz4mF15
	for ; Sat, 12 Aug 2023 09:25:09 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Received: from mail-lj1-x22f.google.com (mail-lj1-x22f.google.com [IPv6:2a00:1450:4864:20::22f])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNFch4KtFz4PwR
	for ; Sat, 12 Aug 2023 09:25:08 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=gmail.com header.s=20221208 header.b="i04gwt/q";
	spf=pass (mx1.freebsd.org: domain of odhiambo@gmail.com designates 2a00:1450:4864:20::22f as permitted sender) smtp.mailfrom=odhiambo@gmail.com;
	dmarc=pass (policy=none) header.from=gmail.com
Received: by mail-lj1-x22f.google.com with SMTP id 38308e7fff4ca-2b9c0391749so43858621fa.0
        for ; Sat, 12 Aug 2023 02:25:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691832305; x=1692437105;
        h=to:subject:message-id:date:from:mime-version:from:to:cc:subject
         :date:message-id:reply-to;
        bh=4j1ciUvRunjee47rmOyzl/q+KqpdsMwbw6AuNXSM204=;
        b=i04gwt/qBsyniU3dqPB7HcURctwY2Py/Vur0l1k7MV84iOE6Dr9MOg9YYtfNklTLdZ
         3d+qJM0RvvWenUdE4O/FHl6dm17jFV1kFWXdGRr8oRR/jKpvA8Uf8P0chWIZArJbe5A5
         2cZ3L8r65hCscXRpvoWSxaURggYusbRFDM0qAzFFcpwtcDEsoLTiy72bEIy6kKl0Km4X
         JIlPXnwFJuCO81DU1DL9tFSlmytBUwet/g1AVqhFDSDga47eTCFW7dGxEqdi0MQVvvgp
         d/9ajlrAYtt6RuQPlxm0otv3kcgh6Q9f/Lkoz6vCFieGzigIoIbC9J+GGJaEAPkuXYWc
         c25w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691832305; x=1692437105;
        h=to:subject:message-id:date:from:mime-version:x-gm-message-state
         :from:to:cc:subject:date:message-id:reply-to;
        bh=4j1ciUvRunjee47rmOyzl/q+KqpdsMwbw6AuNXSM204=;
        b=Pz1NwDtlf9yv0+WSoUpL08a5vD9n+BWwhB+FDz1j31wTddpfyp/jOPl12ptTom9NqR
         blLxEu85CPkhtpHaJcGCpaqrLWl5AJ5MHQnO87NjG8hmiWbYj9nstcZLw/lghNmNzlU+
         ufvRAzxnrFjmDSZxDOTSc+7y8d3wczCCfdWrG2sJlTQ1sT4ZTDsNkKs8Gq6g4dNCJ53b
         PFyAOCy3qxi+H7LocP9z6YsylJkJZIIC/sWjkp/IqYswTKhRqGweSqOEWxtx7cZyn0gD
         kMajMgpkKF7sU5Kz4h1/swcQUsHXxdY8p7/jQHLMpbEXvKhbi0F4wApo5bIZgtZVzwVc
         oEEg==
X-Gm-Message-State: AOJu0YzyxgUzcrGriYYRiFagUDv2KGdqwVwBrBXbDX8HD3MJ92aX1rZm
	1W1TtPquI4bp69bNarsbfLwkWR+q2CZvAEEXP4ptxKw3YeDxNpCy
X-Google-Smtp-Source: AGHT+IFTu9ro0oM5gPtDRkaH1POj/RaOTXxXG62swvtb64kk2ZIv4LiHkIPSEPPY0xAkS3Dyw9YMGhcBSNXiTTON/t4=
X-Received: by 2002:a2e:9555:0:b0:2b6:e96c:5414 with SMTP id
 t21-20020a2e9555000000b002b6e96c5414mr2854780ljh.52.1691832304868; Sat, 12
 Aug 2023 02:25:04 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
From: Odhiambo Washington 
Date: Sat, 12 Aug 2023 12:24:28 +0300
Message-ID: 
Subject: Starting the bhyve journey
To: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="0000000000008d22b50602b6673d"
X-Spamd-Result: default: False [-3.97 / 15.00];
	NEURAL_HAM_SHORT(-1.00)[-0.997];
	NEURAL_HAM_MEDIUM(-0.99)[-0.993];
	NEURAL_HAM_LONG(-0.98)[-0.980];
	DMARC_POLICY_ALLOW(-0.50)[gmail.com,none];
	R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208];
	R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36];
	MIME_GOOD(-0.10)[multipart/alternative,text/plain];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	FROM_HAS_DN(0.00)[];
	FREEMAIL_FROM(0.00)[gmail.com];
	RCPT_COUNT_ONE(0.00)[1];
	PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org];
	BLOCKLISTDE_FAIL(0.00)[2a00:1450:4864:20::22f:server fail];
	ARC_NA(0.00)[];
	RCVD_TLS_LAST(0.00)[];
	RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::22f:from];
	DKIM_TRACE(0.00)[gmail.com:+];
	MID_RHS_MATCH_FROMTLD(0.00)[];
	TO_DN_NONE(0.00)[];
	DWL_DNSWL_NONE(0.00)[gmail.com:dkim];
	RCVD_COUNT_ONE(0.00)[1];
	MIME_TRACE(0.00)[0:+,1:+,2:~];
	FROM_EQ_ENVFROM(0.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US];
	FREEMAIL_ENVFROM(0.00)[gmail.com];
	MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]
X-Spamd-Bar: ---
X-Rspamd-Queue-Id: 4RNFch4KtFz4PwR

--0000000000008d22b50602b6673d
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hello all.

I am new to bhyve and have read a lot about it, so I decided to try
creating a few VMs.
I found a HOWTO that is detailed and which appears to be the easiest to
follow: https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
The only differences are that I did not install a fresh FreeBSD-13 server
as I already had one, and I am not using ZFS on my server (host).
I have gotten stuck midway and cannot figure out why: I cannot boot the VMs
I create.
I have tried creating a Windows2019 as well as a Debian12 VM, but both
don't boot.

vm-public: flags=3D8843 metric 0 mt=
u
1492
        ether ce:6f:18:51:d4:51
        id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
        maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        member: em1 flags=3D143
                ifmaxaddr 0 port 2 priority 128 path cost 20000
        groups: bridge vm-switch viid-4c918@
        nd6 options=3D9
tap0: flags=3D8943 metric 0
mtu 1492
        description: vmnet/debian12/0/public
        options=3D80000
        ether 58:9c:fc:10:ff:ed
        inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
        groups: tap vm-port
        media: Ethernet autoselect
        status: no carrier
        nd6 options=3D21

1.  Windows2019 VM:
    vm create -t uefi -s 100G -m 8G -c8 windows2019
    vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso

2. Debian12 VM:
    vm create -s 60G -m 8G -c 8 debian12
    vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm list
NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
debian12     default            bhyveload    8         8G             -
   Yes[2]         Bootloader (91866)
windows2019  default        uefi               8        8G             -
   Yes [1]     Stopped

>From the above output of `vm list`, you can see that none of them is
booting up.

What is it that I could be missing?


--=20
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
[How to ask smart questions:
http://www.catb.org/~esr/faqs/smart-questions.html]

--0000000000008d22b50602b6673d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


Hello all.

I am new to bhyve and have r=
ead a lot about it, so I decided to try creating a few VMs.
I fou=
nd a HOWTO that is detailed and which appears to be the easiest to follow:=
=C2=A0https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1=
/
The only differences are that I did not install a fresh Fre=
eBSD-13 server as I already had one, and I am not using ZFS on my server (h=
ost).
I have gotten stuck midway and cannot figure out why: I can=
not boot the VMs I create.
I have tried creating a Windows2019 as=
 well as a Debian12 VM, but both don't boot.

v=
m-public: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric=
 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether ce:6f:18:51:d4:51
=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fw=
ddelay 15
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 20 holdcnt 6 proto rstp max=
addr 2000 timeout 1200
=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:0=
0:00 priority 32768 ifcost 0 port 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: =
em1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 2 priority 128 p=
ath cost 20000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: bridge vm-switch viid=
-4c918@
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D9<PERFORMNUD,IFDISA=
BLED>
tap0: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,S=
IMPLEX,MULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 descr=
iption: vmnet/debian12/0/public
=C2=A0 =C2=A0 =C2=A0 =C2=A0 options=3D80=
000<LINKSTATE>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 58:9c:fc:10:ff:ed=

=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefix=
len 64 scopeid 0x6
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: tap vm-port
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 media: Ethernet autoselect
=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 status: no carrier
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D=
21<PERFORMNUD,AUTO_LINKLOCAL>

1.=C2=A0 W=
indows2019 VM:
=C2=A0 =C2=A0 vm create -t uefi -s 100G -m 8G -c8 =
windows2019
=C2=A0 =C2=A0=C2=A0vm install windows2019 /usr/local/=
bhyve-vms/.iso/server2019.iso

2. Debian12 VM:
=C2=A0 =C2=A0=C2=A0vm create -s 60G -m 8G -c 8 debian12
=C2=
=A0 =C2=A0=C2=A0vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm list
NAME =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0 CPU =C2=A0MEMORY =
=C2=A0VNC =C2=A0AUTO =C2=A0 =C2=A0 STATE
debian12 =C2=A0 =C2=A0 default=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0 =C2=A0 8=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Boot=
loader (91866)
windows2019 =C2=A0default=C2=A0 =C2=A0 =C2=A0 =C2=A0 uefi=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 8G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0=
 =C2=A0 =C2=A0Yes [1]=C2=A0 =C2=A0 =C2=A0Stopped

From the above output of `vm list`, you can see that none of them is boo=
ting up.

What is it that I could be missing?
=



-=
- 
Best regards,
Odh=
iambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
&qu=
ot;Oh, the cruft.",=C2=A0egrep -=
v '^$|^.*#'=C2=A0=C2=AF\_(=E3=83=84)_/=C2=
=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questi=
ons.html]


--0000000000008d22b50602b6673d--

From nobody Sat Aug 12 09:46:51 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNG6V4KMLz4mGy7
	for ; Sat, 12 Aug 2023 09:47:30 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNG6V2L7rz4RMq
	for ; Sat, 12 Aug 2023 09:47:30 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-99c4923195dso376463566b.2
        for ; Sat, 12 Aug 2023 02:47:30 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691833648; x=1692438448;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=LfP/xNMuL57O73HNpP0v2DfyciKetdcK/Mgkolei68c=;
        b=sPvVvPQ17/tFMlfiLxJ1xFucmeV03Z/PZl5T9nXOKzjJGVLsnqWyuztbEliVLD6BuH
         mXR9X3xSGHd/CIbpSFVj+JGvMWX4uJy+hrtpXsfEEB7KawSDgcOL+GJvCFAiI5b1zALE
         HsAdSNpXnOh9pmwkTPw4j9M4iQhQcjiPOS5Z7YPztVVRqA0CwYGcxf6HU+wL2bdu/eVn
         umGuUu3G0zWmsvraDwo2pjuwq/x7wAYheuAQ+vZVQPAPZMFc8kLE4WrWKQyhLY1GkqJu
         KrAl96tcHpmIiLGO4CdMZ687ok4HTBJVPBvFvhlvw/vbug6EMHpNe4aHGPbJC7Zamp1d
         r3yQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691833648; x=1692438448;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=LfP/xNMuL57O73HNpP0v2DfyciKetdcK/Mgkolei68c=;
        b=aUPnQvFzekhorm7P//fWhFGGsJE6IQDA+2Jj54Lz77yxdB3Pjkb4c+Sis/mQHuEVJa
         AiJNKUdAsuhI7oHpGN4LBAnO+nxlusSUAXuJijLWghzsNh0K2i61+FZDmxpjrHwFOeN+
         4oWwsX47k1lV9eH3T6ZX++oCmc8dcxFqd1FdZgD21P/4kSQWOyGOsuBo2sEIUzh6n9Ts
         usqusour1aVwye18QQJqKBqh4f1jpag0nM7lxD6Bqzdm2ko1jhDv/QK5HzrCTzSI9yLv
         LHtjN+oXKV+eUEtgqedUkXfyxMub0/K/953i4qG5bbD4MXY1Z9/Un/pWbOI5mNnb9Cqh
         XObw==
X-Gm-Message-State: AOJu0YxP03ePiTjBf5UfyczmIccGq6iTJfiB6/4i9rqGNoAbqzRQXYc5
	5riT63JTlgdLUjLg+p9akU8amUqbbD+tQd1UqwcAFeI0t1s=
X-Google-Smtp-Source: AGHT+IGxogBaYdLWwKgAwm+WvabsCaAKqk8CVinHrZoTXLMYU38llV3ObItaBjQ0Xy141Im8FPHdM/fx/PiL7Uw14s4=
X-Received: by 2002:a17:906:13:b0:993:e9b8:90ec with SMTP id
 19-20020a170906001300b00993e9b890ecmr4068981eja.22.1691833648090; Sat, 12 Aug
 2023 02:47:28 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
In-Reply-To: 
From: Mario Marietto 
Date: Sat, 12 Aug 2023 11:46:51 +0200
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Odhiambo Washington 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="0000000000009d10e20602b6b7ef"
X-Rspamd-Queue-Id: 4RNG6V2L7rz4RMq
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--0000000000009d10e20602b6b7ef
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

In my opinion,the usage of the wrapper creates some difficulties to
understand how bhyve and the networking works. You should start from the
very beginning,studying bhyve and the freebsd networking,instead of
learning how to correctly use the wrapper.

On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington 
wrote:

> Hello all.
>
> I am new to bhyve and have read a lot about it, so I decided to try
> creating a few VMs.
> I found a HOWTO that is detailed and which appears to be the easiest to
> follow: https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1=
/
> The only differences are that I did not install a fresh FreeBSD-13 server
> as I already had one, and I am not using ZFS on my server (host).
> I have gotten stuck midway and cannot figure out why: I cannot boot the
> VMs I create.
> I have tried creating a Windows2019 as well as a Debian12 VM, but both
> don't boot.
>
> vm-public: flags=3D8843 metric 0 =
mtu
> 1492
>         ether ce:6f:18:51:d4:51
>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>         member: em1 flags=3D143
>                 ifmaxaddr 0 port 2 priority 128 path cost 20000
>         groups: bridge vm-switch viid-4c918@
>         nd6 options=3D9
> tap0: flags=3D8943 metric=
 0
> mtu 1492
>         description: vmnet/debian12/0/public
>         options=3D80000
>         ether 58:9c:fc:10:ff:ed
>         inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
>         groups: tap vm-port
>         media: Ethernet autoselect
>         status: no carrier
>         nd6 options=3D21
>
> 1.  Windows2019 VM:
>     vm create -t uefi -s 100G -m 8G -c8 windows2019
>     vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
>
> 2. Debian12 VM:
>     vm create -s 60G -m 8G -c 8 debian12
>     vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso
>
> root@gw:/usr/local/bhyve-vms # vm list
> NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
> debian12     default            bhyveload    8         8G             -
>    Yes[2]         Bootloader (91866)
> windows2019  default        uefi               8        8G             -
>      Yes [1]     Stopped
>
> From the above output of `vm list`, you can see that none of them is
> booting up.
>
> What is it that I could be missing?
>
>
> --
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
> [How to ask smart questions:
> http://www.catb.org/~esr/faqs/smart-questions.html]
>


--=20
Mario.

--0000000000009d10e20602b6b7ef
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


In my opinion,the usage of the wrapper creates some diffic=
ulties to understand how bhyve and the networking works. You should start f=
rom the very beginning,studying bhyve and the freebsd networking,instead of=
 learning how to correctly use the wrapper.

On Sat, Aug 12, 2023 at 11:2=
5=E2=80=AFAM Odhiambo Washington <odhiambo@gmail.com> wrote:
Hello all.

I am new to bhyve and have read a lot about it, so I decided to try=
 creating a few VMs.
I found a HOWTO that is detailed and which a=
ppears to be the easiest to follow:=C2=A0https://klar=
asystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
The on=
ly differences are that I did not install a fresh FreeBSD-13 server as I al=
ready had one, and I am not using ZFS on my server (host).
I have=
 gotten stuck midway and cannot figure out why: I cannot boot the VMs I cre=
ate.
I have tried creating a Windows2019 as well as a Debian12 VM=
, but both don't boot.

vm-public: flags=3D8843=
<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1492
=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 ether ce:6f:18:51:d4:51
=C2=A0 =C2=A0 =C2=A0 =C2=A0=
 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200<=
br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 priority 32768 ifc=
ost 0 port 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: em1 flags=3D143<LEAR=
NING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 2 priority 128 path cost 20000
=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 groups: bridge vm-switch viid-4c918@
=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 nd6 options=3D9<PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> =
metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 description: vmnet/debian1=
2/0/public
=C2=A0 =C2=A0 =C2=A0 =C2=A0 options=3D80000<LINKSTATE><=
br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 58:9c:fc:10:ff:ed
=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: tap vm-port
=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 media: Ethernet autoselect
=C2=A0 =C2=A0 =C2=A0 =C2=A0 status: no=
 carrier
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D21<PERFORMNUD,AUTO=
_LINKLOCAL>

1.=C2=A0 Windows2019 VM:
<=
div>=C2=A0 =C2=A0 vm create -t uefi -s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm install windows2019 /usr/local/bhyve-vms/.iso/server=
2019.iso

2. Debian12 VM:
=C2=A0 =C2=A0=
=C2=A0vm create -s 60G -m 8G -c 8 debian12
=C2=A0 =C2=A0=C2=A0vm =
install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm list
NAME =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0 CPU =C2=A0MEMORY =C2=A0VNC =C2=A0A=
UTO =C2=A0 =C2=A0 STATE
debian12 =C2=A0 =C2=A0 default=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0 =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =
=C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Bootloader (91866)
=
windows2019 =C2=A0default=C2=A0 =C2=A0 =C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08=C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=A0=
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes [=
1]=C2=A0 =C2=A0 =C2=A0Stopped

From the above o=
utput of `vm list`, you can see that none of them is booting up.
=

What is it that I could be missing?


-- 
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+2=
54 7 2274 3223
"Oh, the cruft.",=C2=A0egrep -v '^$|^.*#'=C2=A0=C2=
=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart question=
s:=C2=A0http://www.catb.org/~=
esr/faqs/smart-questions.html]



-- 
Mario.


--0000000000009d10e20602b6b7ef--

From nobody Sat Aug 12 10:00:42 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGQT62qzz4mJ7Q
	for ; Sat, 12 Aug 2023 10:01:21 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGQS5f9rz4SZB
	for ; Sat, 12 Aug 2023 10:01:20 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=gmail.com header.s=20221208 header.b=ShHP5v4t;
	spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2a00:1450:4864:20::62f as permitted sender) smtp.mailfrom=marietto2008@gmail.com;
	dmarc=pass (policy=none) header.from=gmail.com
Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-99357737980so372643966b.2
        for ; Sat, 12 Aug 2023 03:01:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691834479; x=1692439279;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=TraIWhW+QrGIsUDg0uHmAD3I2+MPBir1668p+/Qs6ew=;
        b=ShHP5v4t2PJ07IOFt0qcAqsZ6ZTMnjysvjbCT2DINgahJm81+2Dk/2P3GvXWmbodHP
         GIIuM+RWM31Yr1V3ld2mst6iLMsUNC6zOuMsBW0txa4jpff/XE8enDv3yqWU2ScofFz7
         yKB2FtZ33uBOId1X2gxzybFxDI9X0y03NLYqZW8DOy2G0oTdKJtA2OYm9cdWDhTQp/xn
         hicllAmQ7zlu9rSxLDGY79EoJ7JnF3BIalyQ0QxTROISBxLNkaQx5k7y55zF/Rc5eHZs
         DyROm+j2Rw3N5a4ULzZngx3gYxTjM78vDhfkKn92490HDqs6rk/SqVOJ61OT4pC6rwyx
         KqzA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691834479; x=1692439279;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=TraIWhW+QrGIsUDg0uHmAD3I2+MPBir1668p+/Qs6ew=;
        b=kUwt9Ftx/PUtVaVsQYYd6HF3fryK8rT+wmLUIgMmZM41c+MWYI/2fPuNpheHB535DA
         5hH6wRVoNBdHNFeyIH5fmm3ZrGsJLhcGF/RFrda1aoc+JDs/vhDTIpVGt3OlBihLg4rW
         M7wNhU0MkVklWju5T6C7uQfD6FE3TXFjoH2YHjmLd2W6dnz+2EqEuGkJTdlBUdN74f0u
         L7Wd2mzhZlGmHCWLWfORMZ3+xzpgIU4GUhrN5AlyJsQkoNcGRcttAKYp78ttO72ZKBuw
         z/5leiZj4opwA/GFbIkGMUlLBtnEMQkQPW5XaRjw5dpv0C5WDpw/PHrhQl/VSrlnKbPv
         PqSA==
X-Gm-Message-State: AOJu0YysbZrbwkw0AOabl34xg2nFZqBxrAfCKDAmYE1VzkbeTFaTdG+N
	wjozh7mH02yVvUYZDDFAq0Wojkvw00BVRdcVJrH86c1jqoau4Q==
X-Google-Smtp-Source: AGHT+IEctCocdMtt1IbRod4jxNeK/THc/6x2odfizEfjFd4GsWVR8l0dYTc7KBNnnCXZm2NhTfbjxaEvID0oMIGn03U=
X-Received: by 2002:a17:907:77c9:b0:982:1936:ad27 with SMTP id
 kz9-20020a17090777c900b009821936ad27mr3399481ejc.11.1691834478479; Sat, 12
 Aug 2023 03:01:18 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
 
In-Reply-To: 
From: Mario Marietto 
Date: Sat, 12 Aug 2023 12:00:42 +0200
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Odhiambo Washington 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="0000000000001bd4ef0602b6e9cd"
X-Spamd-Result: default: False [0.04 / 15.00];
	URI_COUNT_ODD(1.00)[9];
	HTTP_TO_IP(1.00)[];
	NEURAL_SPAM_LONG(1.00)[0.997];
	NEURAL_HAM_SHORT(-1.00)[-0.997];
	NEURAL_HAM_MEDIUM(-0.96)[-0.963];
	DMARC_POLICY_ALLOW(-0.50)[gmail.com,none];
	R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208];
	R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36];
	MIME_GOOD(-0.10)[multipart/alternative,text/plain];
	FROM_HAS_DN(0.00)[];
	TO_DN_SOME(0.00)[];
	PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org];
	ARC_NA(0.00)[];
	RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62f:from];
	TO_MATCH_ENVRCPT_SOME(0.00)[];
	DWL_DNSWL_NONE(0.00)[gmail.com:dkim];
	FREEMAIL_ENVFROM(0.00)[gmail.com];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US];
	DKIM_TRACE(0.00)[gmail.com:+];
	MID_RHS_MATCH_FROMTLD(0.00)[];
	FREEMAIL_FROM(0.00)[gmail.com];
	RCVD_TLS_LAST(0.00)[];
	RCPT_COUNT_TWO(0.00)[2];
	FREEMAIL_TO(0.00)[gmail.com];
	RCVD_COUNT_ONE(0.00)[1];
	MIME_TRACE(0.00)[0:+,1:+,2:~];
	FROM_EQ_ENVFROM(0.00)[];
	MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]
X-Spamd-Bar: /
X-Rspamd-Queue-Id: 4RNGQS5f9rz4SZB

--0000000000001bd4ef0602b6e9cd
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Try like this :

bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
-s 13,virtio-net,tap1 \
-s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,h=3D950,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:1 < /dev/null & sleep 2 && vncviewer 0:1

Doing this way you will learn better how to compose the bhyve
parameters and how they should be formatted naturally.
As you can see,the vm-bhyve wrapper "muddies the waters". And I think
that you should also learn how to create a bridge on FreeBSD.


On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto 
wrote:

> In my opinion,the usage of the wrapper creates some difficulties to
> understand how bhyve and the networking works. You should start from the
> very beginning,studying bhyve and the freebsd networking,instead of
> learning how to correctly use the wrapper.
>
> On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington 
> wrote:
>
>> Hello all.
>>
>> I am new to bhyve and have read a lot about it, so I decided to try
>> creating a few VMs.
>> I found a HOWTO that is detailed and which appears to be the easiest to
>> follow:
>> https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
>> The only differences are that I did not install a fresh FreeBSD-13 serve=
r
>> as I already had one, and I am not using ZFS on my server (host).
>> I have gotten stuck midway and cannot figure out why: I cannot boot the
>> VMs I create.
>> I have tried creating a Windows2019 as well as a Debian12 VM, but both
>> don't boot.
>>
>> vm-public: flags=3D8843 metric 0
>> mtu 1492
>>         ether ce:6f:18:51:d4:51
>>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>>         member: em1 flags=3D143
>>                 ifmaxaddr 0 port 2 priority 128 path cost 20000
>>         groups: bridge vm-switch viid-4c918@
>>         nd6 options=3D9
>> tap0: flags=3D8943 metri=
c 0
>> mtu 1492
>>         description: vmnet/debian12/0/public
>>         options=3D80000
>>         ether 58:9c:fc:10:ff:ed
>>         inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
>>         groups: tap vm-port
>>         media: Ethernet autoselect
>>         status: no carrier
>>         nd6 options=3D21
>>
>> 1.  Windows2019 VM:
>>     vm create -t uefi -s 100G -m 8G -c8 windows2019
>>     vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
>>
>> 2. Debian12 VM:
>>     vm create -s 60G -m 8G -c 8 debian12
>>     vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso
>>
>> root@gw:/usr/local/bhyve-vms # vm list
>> NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
>> debian12     default            bhyveload    8         8G             -
>>      Yes[2]         Bootloader (91866)
>> windows2019  default        uefi               8        8G             -
>>      Yes [1]     Stopped
>>
>> From the above output of `vm list`, you can see that none of them is
>> booting up.
>>
>> What is it that I could be missing?
>>
>>
>> --
>> Best regards,
>> Odhiambo WASHINGTON,
>> Nairobi,KE
>> +254 7 3200 0004/+254 7 2274 3223
>> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>> [How to ask smart questions:
>> http://www.catb.org/~esr/faqs/smart-questions.html]
>>
>
>
> --
> Mario.
>


--=20
Mario.

--0000000000001bd4ef0602b6e9cd
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


Try like=
 this :

bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A=
 \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
-s 13,virtio-net,tap1 \
-s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,=
h=3D950,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:1 < /dev/null & sleep 2 && vncviewer 0:1

<=
/pre>
Doing this way you will learn be=
tter how to compose the bhyve parameters and how they should be formatted n=
aturally. 
As you can see,the vm-bhyve wrapper "muddies the waters". And I think that yo=
u should also learn how to create a bridge on FreeBSD.
On Sat, =
Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto <marietto2008@gmail.com> wrote:
In my opinion,the=
 usage of the wrapper creates some difficulties to understand how bhyve and=
 the networking works. You should start from the very beginning,studying bh=
yve and the freebsd networking,instead of learning how to correctly use the=
 wrapper.

On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington &=
lt;odhiambo@gmail.c=
om> wrote:
Hello all.

I am new to bhyve and have=
 read a lot about it, so I decided to try creating a few VMs.
I f=
ound a HOWTO that is detailed and which appears to be the easiest to follow=
:=C2=A0https://klarasystems.com/articles/from-0-to-bh=
yve-on-freebsd-13-1/
The only differences are that I did not =
install a fresh FreeBSD-13 server as I already had one, and I am not using =
ZFS on my server (host).
I have gotten stuck midway and cannot fi=
gure out why: I cannot boot the VMs I create.
I have tried creati=
ng a Windows2019 as well as a Debian12 VM, but both don't boot.

vm-public: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,M=
ULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether ce:6f:1=
8:51:d4:51
=C2=A0 =C2=A0 =C2=A0 =C2=A0 id 00:00:00:00:00:00 priority 327=
68 hellotime 2 fwddelay 15
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 20 holdcnt=
 6 proto rstp maxaddr 2000 timeout 1200
=C2=A0 =C2=A0 =C2=A0 =C2=A0 root=
 id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 member: em1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>=
;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 po=
rt 2 priority 128 path cost 20000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: br=
idge vm-switch viid-4c918@
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D9&l=
t;PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<UP,BROADCAS=
T,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 description: vmnet/debian12/0/public
=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 options=3D80000<LINKSTATE>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ethe=
r 58:9c:fc:10:ff:ed
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe=
10:ffed%tap0 prefixlen 64 scopeid 0x6
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups=
: tap vm-port
=C2=A0 =C2=A0 =C2=A0 =C2=A0 media: Ethernet autoselect
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 status: no carrier
=C2=A0 =C2=A0 =C2=A0 =C2=
=A0 nd6 options=3D21<PERFORMNUD,AUTO_LINKLOCAL>

1.=C2=A0 Windows2019 VM:
=C2=A0 =C2=A0 vm create -t uefi =
-s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm install windo=
ws2019 /usr/local/bhyve-vms/.iso/server2019.iso

2.=
 Debian12 VM:
=C2=A0 =C2=A0=C2=A0vm create -s 60G -m 8G -c 8 debi=
an12
=C2=A0 =C2=A0=C2=A0vm install debian12 .iso/debian-12.0.0-am=
d64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm li=
st
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0=
 CPU =C2=A0MEMORY =C2=A0VNC =C2=A0AUTO =C2=A0 =C2=A0 STATE
debian12 =C2=
=A0 =C2=A0 default=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0=
 =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0Bootloader (91866)
windows2019 =C2=A0default=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes [1]=C2=A0 =C2=A0 =C2=A0Stopped
=


From the above output of `vm list`, you can see that no=
ne of them is booting up.

What is it that I could =
be missing?


-- 
Best regards,
Odhiambo WASHINGTON,<=
br>Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.&qu=
ot;,=C2=A0egrep -v '^$|^.*#'=
;=C2=A0=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]




-- 
Mario.




-- 
Mario.


--0000000000001bd4ef0602b6e9cd--

From nobody Sat Aug 12 10:05:46 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGXL0bNcz4mJ8m
	for ; Sat, 12 Aug 2023 10:06:26 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Received: from mail-lj1-x22f.google.com (mail-lj1-x22f.google.com [IPv6:2a00:1450:4864:20::22f])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGXK0Rghz4SlT
	for ; Sat, 12 Aug 2023 10:06:25 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=gmail.com header.s=20221208 header.b=BykouRvR;
	spf=pass (mx1.freebsd.org: domain of odhiambo@gmail.com designates 2a00:1450:4864:20::22f as permitted sender) smtp.mailfrom=odhiambo@gmail.com;
	dmarc=pass (policy=none) header.from=gmail.com
Received: by mail-lj1-x22f.google.com with SMTP id 38308e7fff4ca-2b9bf52cd08so40526151fa.2
        for ; Sat, 12 Aug 2023 03:06:25 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691834783; x=1692439583;
        h=to:subject:message-id:date:from:in-reply-to:references:mime-version
         :from:to:cc:subject:date:message-id:reply-to;
        bh=Rz7ws8Cbk4yQ4EmZk5FRBSpAdpwtjU5zMwcK1+AcGvA=;
        b=BykouRvRumjvZ9H0GuFxIKKFd3rRt3fgL0sB/U0xcH+4N2dMRzmRYid6G50VpsAcF9
         2a8OomrP6CW6/Yea8SleEI7poL0gCwDFwFPUC3txtJ6thLjxw1xxbks92/REBZ5muqZa
         QBYQJAg4l8P8rrz3WP6Bp6z4ztDNfyq4+ridmyOw61F/Bhu/d0oFt+gRlvMi1AV1E2F7
         RHAJJI67jXAOCEqG29mAzi6pMS1wdos346eZYlv5cGrzOBDd040iNcpWL2U5WgMbdfC+
         /lUL18XdGb6IPgNfug58CaB9zMfsnPq36QG8rIXKN1LhmwrxVKCXUbVwqTUEiZUo6wlO
         V1ww==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691834783; x=1692439583;
        h=to:subject:message-id:date:from:in-reply-to:references:mime-version
         :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
        bh=Rz7ws8Cbk4yQ4EmZk5FRBSpAdpwtjU5zMwcK1+AcGvA=;
        b=etOdQodmrbmESZ/c5s+popOJhh6PimrL+E00M474SqWNYFMLKN/qy99NdNWU1v+kO5
         jLcHzxr0QkbTNTV9v6f/kND37nayfBCOSbuuA3nI+ISwSU3WOah7og6nf+apQlDC60gN
         lfYQirfi5yfgZ8bN0Wrw6iJ1MSV8AphJp+zWOAjvn9SYaGJmm4AKhdGbK8b0kPh6gb2w
         LNfdQOwnU9tt+T0a3Bv1hSXsEaK0WtiYJPAskgkreywyRVV94xyLc/sUp0KMrP3SeVoU
         LrF64ChGFccqylinH0YXFCa8W9OrYtOOYCoBX2ygbxWfr713vExP0DVumXvJpLAgeNpc
         f7Qw==
X-Gm-Message-State: AOJu0YzX0Sop2BeD9iVgGhwyDqyGtcSvtqVFSXbm+5h3Wcp9wKfksZA9
	mWQR8/EoFHGuturk5mi8JyrYsP4FnG6m/ukg0dTixLyAsTXBrESy
X-Google-Smtp-Source: AGHT+IERlaH3v99S8sHejxgKKqt5w1se8If81aMFUkMKt4bU0qCgOZHtHhm7uzh+A5VjsdXasEHjfJ6TvZL4cXaojFw=
X-Received: by 2002:a2e:b61a:0:b0:2b7:11f8:27d with SMTP id
 r26-20020a2eb61a000000b002b711f8027dmr3223066ljn.7.1691834783082; Sat, 12 Aug
 2023 03:06:23 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
In-Reply-To: 
From: Odhiambo Washington 
Date: Sat, 12 Aug 2023 13:05:46 +0300
Message-ID: 
Subject: Re: Starting the bhyve journey
To: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="00000000000043b0960602b6fbfc"
X-Spamd-Result: default: False [-3.97 / 15.00];
	NEURAL_HAM_SHORT(-1.00)[-0.997];
	NEURAL_HAM_MEDIUM(-1.00)[-0.996];
	NEURAL_HAM_LONG(-0.98)[-0.978];
	DMARC_POLICY_ALLOW(-0.50)[gmail.com,none];
	R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36];
	R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208];
	MIME_GOOD(-0.10)[multipart/alternative,text/plain];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US];
	FREEMAIL_ENVFROM(0.00)[gmail.com];
	RCVD_COUNT_ONE(0.00)[1];
	FROM_EQ_ENVFROM(0.00)[];
	MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org];
	RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::22f:from];
	MIME_TRACE(0.00)[0:+,1:+,2:~];
	ARC_NA(0.00)[];
	RCVD_TLS_LAST(0.00)[];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	FREEMAIL_FROM(0.00)[gmail.com];
	FROM_HAS_DN(0.00)[];
	DKIM_TRACE(0.00)[gmail.com:+];
	PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org];
	RCPT_COUNT_ONE(0.00)[1];
	TO_DN_NONE(0.00)[];
	MID_RHS_MATCH_FROMTLD(0.00)[];
	DWL_DNSWL_NONE(0.00)[gmail.com:dkim]
X-Spamd-Bar: ---
X-Rspamd-Queue-Id: 4RNGXK0Rghz4SlT

--00000000000043b0960602b6fbfc
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Sat, Aug 12, 2023 at 12:24=E2=80=AFPM Odhiambo Washington 
wrote:

> Hello all.
>
> I am new to bhyve and have read a lot about it, so I decided to try
> creating a few VMs.
> I found a HOWTO that is detailed and which appears to be the easiest to
> follow: https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1=
/
> The only differences are that I did not install a fresh FreeBSD-13 server
> as I already had one, and I am not using ZFS on my server (host).
> I have gotten stuck midway and cannot figure out why: I cannot boot the
> VMs I create.
> I have tried creating a Windows2019 as well as a Debian12 VM, but both
> don't boot.
>
> vm-public: flags=3D8843 metric 0 =
mtu
> 1492
>         ether ce:6f:18:51:d4:51
>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>         member: em1 flags=3D143
>                 ifmaxaddr 0 port 2 priority 128 path cost 20000
>         groups: bridge vm-switch viid-4c918@
>         nd6 options=3D9
> tap0: flags=3D8943 metric=
 0
> mtu 1492
>         description: vmnet/debian12/0/public
>         options=3D80000
>         ether 58:9c:fc:10:ff:ed
>         inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
>         groups: tap vm-port
>         media: Ethernet autoselect
>         status: no carrier
>         nd6 options=3D21
>
> 1.  Windows2019 VM:
>     vm create -t uefi -s 100G -m 8G -c8 windows2019
>     vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
>
> 2. Debian12 VM:
>     vm create -s 60G -m 8G -c 8 debian12
>     vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso
>
> root@gw:/usr/local/bhyve-vms # vm list
> NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
> debian12     default            bhyveload    8         8G             -
>    Yes[2]         Bootloader (91866)
> windows2019  default        uefi               8        8G             -
>      Yes [1]     Stopped
>
> From the above output of `vm list`, you can see that none of them is
> booting up.
>
> What is it that I could be missing?
>

I found the problem. The .templates/uefi.conf had a wrong value
for  network0_switch.
It should be "vm-public" instead of "public".



--=20
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
[How to ask smart questions:
http://www.catb.org/~esr/faqs/smart-questions.html]

--00000000000043b0960602b6fbfc
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable




=

On Sat, Aug 12, 2023 at 12:24=E2=80=
=AFPM Odhiambo Washington <odhiamb=
o@gmail.com> wrote:
Hello all.

I am new to bhyve=
 and have read a lot about it, so I decided to try creating a few VMs.
I found a HOWTO that is detailed and which appears to be the easiest =
to follow:=C2=A0https://klarasystems.com/articles/fro=
m-0-to-bhyve-on-freebsd-13-1/
The only differences are that I=
 did not install a fresh FreeBSD-13 server as I already had one, and I am n=
ot using ZFS on my server (host).
I have gotten stuck midway and =
cannot figure out why: I cannot boot the VMs I create.
I have tri=
ed creating a Windows2019 as well as a Debian12 VM, but both don't boot=
.

vm-public: flags=3D8843<UP,BROADCAST,RUNNING,=
SIMPLEX,MULTICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ethe=
r ce:6f:18:51:d4:51
=C2=A0 =C2=A0 =C2=A0 =C2=A0 id 00:00:00:00:00:00 pri=
ority 32768 hellotime 2 fwddelay 15
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 2=
0 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 member: em1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,=
AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifma=
xaddr 0 port 2 priority 128 path cost 20000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =
groups: bridge vm-switch viid-4c918@
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 opt=
ions=3D9<PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<U=
P,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1492
=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 description: vmnet/debian12/0/public
=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 options=3D80000<LINKSTATE>
=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 ether 58:9c:fc:10:ff:ed
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 fe80::5=
a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 groups: tap vm-port
=C2=A0 =C2=A0 =C2=A0 =C2=A0 media: Ethernet a=
utoselect
=C2=A0 =C2=A0 =C2=A0 =C2=A0 status: no carrier
=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 nd6 options=3D21<PERFORMNUD,AUTO_LINKLOCAL>

1.=C2=A0 Windows2019 VM:
=C2=A0 =C2=A0 vm c=
reate -t uefi -s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm=
 install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
2. Debian12 VM:
=C2=A0 =C2=A0=C2=A0vm create -s 60G -=
m 8G -c 8 debian12
=C2=A0 =C2=A0=C2=A0vm install debian12 .iso/de=
bian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhy=
ve-vms # vm list
NAME =C2=A0 =C2=A0 =C2=A0 =C2=A0 DATASTORE =C2=A0LOADER=
 =C2=A0 =C2=A0 CPU =C2=A0MEMORY =C2=A0VNC =C2=A0AUTO =C2=A0 =C2=A0 STATEdebian12 =C2=A0 =C2=A0 default=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 bh=
yveload=C2=A0 =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0Bootloader (91866)
windows2019 =C2=A0default=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A08=C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=
 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Yes [1]=C2=A0 =C2=A0 =C2=A0Stoppe=
d

From the above output of `vm list`, you can =
see that none of them is booting up.

What is it th=
at I could be missing?

I found =
the problem. The .templates/uefi.conf had a wrong value for=C2=A0=C2=A0netw=
ork0_switch.
It should be "vm-public" instead of "=
public".


<=
br>
-- 
Best r=
egards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 22=
74 3223
"Oh, the cruft.",=C2=A0egrep -v '^$|^.*#'=C2=A0=C2=AF\_(=
=E3=83=84)_/=C2=AF=C2=A0:-)<=
/div>
[How to ask smart questions:=C2=
=A0http://www.catb.org/~esr/f=
aqs/smart-questions.html]


--00000000000043b0960602b6fbfc--

From nobody Sat Aug 12 10:06:40 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGYM6LW5z4mJFT
	for ; Sat, 12 Aug 2023 10:07:19 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Received: from mail-lj1-x22b.google.com (mail-lj1-x22b.google.com [IPv6:2a00:1450:4864:20::22b])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGYM3b82z4THd
	for ; Sat, 12 Aug 2023 10:07:19 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-lj1-x22b.google.com with SMTP id 38308e7fff4ca-2b9dc1bff38so40637221fa.1
        for ; Sat, 12 Aug 2023 03:07:19 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691834837; x=1692439637;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=NCohHHEH//FVFvUA/PjyHMFid1TA0gEzyTNDhtXmSwA=;
        b=VXcaD00RNFwTTaddWjb0K18CAbegHYxwxn/nGa6fVgHc0GKlf7XBXg4Fy2cNHHvqKp
         zQzR0c6G/0OSnWrfaU/N3QDCcM88wSLk2CTSAazD2MyuOoH8spNPIcesL20/A88bhhzj
         n82cEBowg5mAf8VAF61OaY9antEQ16MCmjPNh8a4kORb0LhCI818RM9Nqnnhpu9aiGhY
         RJ7fzxlM9O6/SXnXy//OxMrhMlCoYkHkFgIcQmbfHMoElLb2QP9Wxqi/evir3IwDrwXJ
         j7+8x1l8EXkJYWQr9C+Bf+V2aKRDaGPG7fYi8SVgg7256Va2vGIsiNT0A5NkO7jk+IaE
         FMRA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691834837; x=1692439637;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=NCohHHEH//FVFvUA/PjyHMFid1TA0gEzyTNDhtXmSwA=;
        b=RhZ3OINjQN8OJFEXhykeVVEMd//NINB55IyD13GcAgS92sxQWJq2eKhNznBe4ino5B
         /ZYbb530ERQP0WrPABIh7gYh/pThUIc0VlQuHPtXqadervQzF62TXh07puhE4yxFpE6b
         hJiMfbhyZ4C7o31TiA5Up7o8l6xDeegG5sbM5t/ekWKgXD/7zpVlv0ag9O8U1PwAKcmP
         fsm8FUV5ud1E9CMEqO7JREzTJcYQJwEUtvpAjMcO+NUHKDoOaVRMdhktEsgbvThj9kbo
         +iax41vYcn4cHXhy4KBDdEUGpC+/qVS2XlzZberPw4BiBxAMIRAU/C/nz/NmBmCqi15v
         RvZg==
X-Gm-Message-State: AOJu0YyN2A0vB847Em1Qvq3bxDXBEDmSUaF2f0uD1IXeCTrwMITnCC0L
	2GWlWj/uzMkvzp7s12ZnN8obSaENcDPi1ilLLNE=
X-Google-Smtp-Source: AGHT+IF3KdAQ00NIsMJ0XozazrNwBCvs8rVz+bc6eF2Qyt2e2yy/FgGjGolmQqkns/fT10fcLYA7XejN8YgtUXB8QZY=
X-Received: by 2002:a05:651c:110:b0:2b6:ecdd:16cf with SMTP id
 a16-20020a05651c011000b002b6ecdd16cfmr2975557ljb.40.1691834837187; Sat, 12
 Aug 2023 03:07:17 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
 
In-Reply-To: 
From: Odhiambo Washington 
Date: Sat, 12 Aug 2023 13:06:40 +0300
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Mario Marietto 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="0000000000007d41640602b6fe75"
X-Rspamd-Queue-Id: 4RNGYM3b82z4THd
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--0000000000007d41640602b6fe75
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Sat, Aug 12, 2023 at 12:47=E2=80=AFPM Mario Marietto 
wrote:

> In my opinion,the usage of the wrapper creates some difficulties to
> understand how bhyve and the networking works. You should start from the
> very beginning,studying bhyve and the freebsd networking,instead of
> learning how to correctly use the wrapper.
>

I have previously read about those and will continue to.

--=20
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
[How to ask smart questions:
http://www.catb.org/~esr/faqs/smart-questions.html]

--0000000000007d41640602b6fe75
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable




=

On Sat, Aug 12, 2023 at 12:47=E2=80=
=AFPM Mario Marietto <marietto=
2008@gmail.com> wrote:
In my opinion,the usage of the wrapper creat=
es some difficulties to understand how bhyve and the networking works. You =
should start from the very beginning,studying bhyve and the freebsd network=
ing,instead of learning how to correctly use the wrapper.

I have previously read about thos=
e and will continue to.

-- 
Best regards,
Odhiambo WASHINGTON,
Nai=
robi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.",=
=C2=A0egrep -v '^$|^.*#'=C2=
=A0=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]<=
/div>


--0000000000007d41640602b6fe75--

From nobody Sat Aug 12 10:08:43 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGbk5dRPz4mJFb
	for ; Sat, 12 Aug 2023 10:09:22 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGbk3XZBz4TfD
	for ; Sat, 12 Aug 2023 10:09:22 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-lj1-x229.google.com with SMTP id 38308e7fff4ca-2ba1e9b1fa9so42217761fa.3
        for ; Sat, 12 Aug 2023 03:09:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691834960; x=1692439760;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=XiDw1qELYcdX2JudGnIObrjzJfdz7NJDoi87NOi8UAY=;
        b=Ys55P3GC7BIryDgwL0eO8UAdIu7+AfP9X0YdRpUoIMc+I4Ob2HlK7jiimGT7YcVXMf
         nwWRSAiXmuySSCZe7b3388fnQdyyIrNQecTxIKt5W7PA8LBozgRJRChvJ++GG7e9x/0W
         jQVJTpghX/Z1U2FHTMfcTmnpaTQbw6Dh+inKvOi1kMoU7jiQ2ERvzB9rUYisQM/extVw
         NHUDqnR6fN9qAfMl2wM5ygKy6KGGwFg1lG4hm9deKljzrLN2QBoXzDp4bMQrXW9bo10e
         4YtnTo/uDSPCQ1/qW/v9gu5XYbswbuVI6jZPQih7WaCPAz7y8C0UF6Yi0X8g9AolHP8o
         3tMA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691834960; x=1692439760;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=XiDw1qELYcdX2JudGnIObrjzJfdz7NJDoi87NOi8UAY=;
        b=EC0q7zV1FLz9jwpYKE89kpG8mnky5aREU5o323LkJgw13g06YMNQqvmqTSVUjKyra8
         O7Asc9FjFLC65rIw/DDopTKhLXZSwNLiu7/uTyjdIY3nbkpLX2T/frey6B4DE+jHLfv3
         a8BQK2JyfK/67T2R0TuKNIVtHI1wdAl7HQhvOUxYat8m/bmWJM/ltIBo5fKo2UR6vLUq
         Gpyt+7RT0keJwiSDvp2mZwzlOct99XhDXrhBvz7Bjxb7SJYRwfuHt0zh7esovwVrUqwu
         cRXMNunyk4OpTBFLPhgDY3/LC7kqcIvcXDmhwNX6He04+7gHYx9dDQoc8V1vK0hz2nlV
         rljg==
X-Gm-Message-State: AOJu0YytcmJ1RLUdA8u4v1c0OnuGRcMcbrjWGJVHs1dzjVpaPnUX1kSG
	PaCgVI9/jMkDZBFvjikyaz3N6MWlOuGdn3+F1tPWE1EWQH6Qn5qU
X-Google-Smtp-Source: AGHT+IHImwuHYdKMBuGlBZw9oVX3gxD7CCGpu38NpH0Swx4V9JJMpy+xJgFo/yo9rKh5Bp5i/UDNEFpzVn7ESegn4DQ=
X-Received: by 2002:a2e:3a12:0:b0:2b9:e701:ac4d with SMTP id
 h18-20020a2e3a12000000b002b9e701ac4dmr3096569lja.26.1691834960175; Sat, 12
 Aug 2023 03:09:20 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
  
In-Reply-To: 
From: Odhiambo Washington 
Date: Sat, 12 Aug 2023 13:08:43 +0300
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Mario Marietto 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="000000000000d1e5b40602b70554"
X-Rspamd-Queue-Id: 4RNGbk3XZBz4TfD
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--000000000000d1e5b40602b70554
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I have read https://wu.e-shell.org/articles/hw-to-bhyve.html as well as
https://www.netscylla.com/blog/2021/06/11/FreeBSD-and-Bhyve.html and many
more.
I will just master it with time.

On Sat, Aug 12, 2023 at 1:01=E2=80=AFPM Mario Marietto 
wrote:

> Try like this :
>
> bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A \
> -s 0,hostbridge \
> -s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
> -s 13,virtio-net,tap1 \
> -s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,h=3D950,wait \
> -s 30,xhci,tablet \
> -s 31,lpc \
> -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
> vm0:1 < /dev/null & sleep 2 && vncviewer 0:1
>
> Doing this way you will learn better how to compose the bhyve parameters =
and how they should be formatted naturally.
> As you can see,the vm-bhyve wrapper "muddies the waters". And I think tha=
t you should also learn how to create a bridge on FreeBSD.
>
>
> On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto 
> wrote:
>
>> In my opinion,the usage of the wrapper creates some difficulties to
>> understand how bhyve and the networking works. You should start from the
>> very beginning,studying bhyve and the freebsd networking,instead of
>> learning how to correctly use the wrapper.
>>
>> On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington 
>> wrote:
>>
>>> Hello all.
>>>
>>> I am new to bhyve and have read a lot about it, so I decided to try
>>> creating a few VMs.
>>> I found a HOWTO that is detailed and which appears to be the easiest to
>>> follow:
>>> https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
>>> The only differences are that I did not install a fresh FreeBSD-13
>>> server as I already had one, and I am not using ZFS on my server (host)=
.
>>> I have gotten stuck midway and cannot figure out why: I cannot boot the
>>> VMs I create.
>>> I have tried creating a Windows2019 as well as a Debian12 VM, but both
>>> don't boot.
>>>
>>> vm-public: flags=3D8843 metric =
0
>>> mtu 1492
>>>         ether ce:6f:18:51:d4:51
>>>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>>>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>>>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>>>         member: em1 flags=3D143
>>>                 ifmaxaddr 0 port 2 priority 128 path cost 20000
>>>         groups: bridge vm-switch viid-4c918@
>>>         nd6 options=3D9
>>> tap0: flags=3D8943 metr=
ic
>>> 0 mtu 1492
>>>         description: vmnet/debian12/0/public
>>>         options=3D80000
>>>         ether 58:9c:fc:10:ff:ed
>>>         inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
>>>         groups: tap vm-port
>>>         media: Ethernet autoselect
>>>         status: no carrier
>>>         nd6 options=3D21
>>>
>>> 1.  Windows2019 VM:
>>>     vm create -t uefi -s 100G -m 8G -c8 windows2019
>>>     vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
>>>
>>> 2. Debian12 VM:
>>>     vm create -s 60G -m 8G -c 8 debian12
>>>     vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso
>>>
>>> root@gw:/usr/local/bhyve-vms # vm list
>>> NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
>>> debian12     default            bhyveload    8         8G             -
>>>      Yes[2]         Bootloader (91866)
>>> windows2019  default        uefi               8        8G
>>>  -       Yes [1]     Stopped
>>>
>>> From the above output of `vm list`, you can see that none of them is
>>> booting up.
>>>
>>> What is it that I could be missing?
>>>
>>>
>>> --
>>> Best regards,
>>> Odhiambo WASHINGTON,
>>> Nairobi,KE
>>> +254 7 3200 0004/+254 7 2274 3223
>>> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>>> [How to ask smart questions:
>>> http://www.catb.org/~esr/faqs/smart-questions.html]
>>>
>>
>>
>> --
>> Mario.
>>
>
>
> --
> Mario.
>


--=20
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
[How to ask smart questions:
http://www.catb.org/~esr/faqs/smart-questions.html]

--000000000000d1e5b40602b70554
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


I will just master it with time.
On =
Sat, Aug 12, 2023 at 1:01=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
Try like this :

bhyve -S -c sockets=3D2,cores=3D2,threads=
=3D2 -m 4G -w -H -A \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
-s 13,virtio-net,tap1 \
-s 29,fbuf,tcp=3D0.0.0.0:=
5918,w=3D1600,h=3D950,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:1 < /dev/null & sleep 2 && vncviewer 0:1

<=
/pre>
Doing this way you will learn better how to compose the bhy=
ve parameters and how they should be formatted naturally. 
As you can se=
e,the vm-bhyve wrapper "muddies the waters&qu=
ot;. And I think that you should also learn how to create a bridge on FreeB=
SD.

On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto <=
;marietto2008@g=
mail.com> wrote:
In my opinion,the usage of the wrapper creates som=
e difficulties to understand how bhyve and the networking works. You should=
 start from the very beginning,studying bhyve and the freebsd networking,in=
stead of learning how to correctly use the wrapper.

On Sat, Aug 12, 2023=
 at 11:25=E2=80=AFAM Odhiambo Washington <odhiambo@gmail.com> wrote:
Hello all.
I am new to bhyve and have read a lot about it, so I decide=
d to try creating a few VMs.
I found a HOWTO that is detailed and=
 which appears to be the easiest to follow:=C2=A0http=
s://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
The only differences are that I did not install a fresh FreeBSD-13 server=
 as I already had one, and I am not using ZFS on my server (host).
I have gotten stuck midway and cannot figure out why: I cannot boot the V=
Ms I create.
I have tried creating a Windows2019 as well as a Deb=
ian12 VM, but both don't boot.

vm-public: flag=
s=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1492=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether ce:6f:18:51:d4:51
=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 tim=
eout 1200
=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 priority=
 32768 ifcost 0 port 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: em1 flags=3D1=
43<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0=
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 2 priority 128 path cost 2000=
0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: bridge vm-switch viid-4c918@
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D9<PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULT=
ICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 description: vmn=
et/debian12/0/public
=C2=A0 =C2=A0 =C2=A0 =C2=A0 options=3D80000<LINK=
STATE>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 58:9c:fc:10:ff:ed
=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scop=
eid 0x6
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: tap vm-port
=C2=A0 =C2=A0=
 =C2=A0 =C2=A0 media: Ethernet autoselect
=C2=A0 =C2=A0 =C2=A0 =C2=A0 st=
atus: no carrier
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D21<PERFORM=
NUD,AUTO_LINKLOCAL>

1.=C2=A0 Windows2019 VM=
:
=C2=A0 =C2=A0 vm create -t uefi -s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm install windows2019 /usr/local/bhyve-vms/.is=
o/server2019.iso

2. Debian12 VM:
=C2=A0 =
=C2=A0=C2=A0vm create -s 60G -m 8G -c 8 debian12
=C2=A0 =C2=A0=C2=
=A0vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm list
NAME =C2=A0 =C2=A0 =C2=A0=
 =C2=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0 CPU =C2=A0MEMORY =C2=A0VNC =C2=
=A0AUTO =C2=A0 =C2=A0 STATE
debian12 =C2=A0 =C2=A0 default=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0 =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=
=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Bootloader (91866)=

windows2019 =C2=A0default=C2=A0 =C2=A0 =C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08=C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Ye=
s [1]=C2=A0 =C2=A0 =C2=A0Stopped

From the abov=
e output of `vm list`, you can see that none of them is booting up.

What is it that I could be missing?

<=
div>
-- 
<=
div>Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004=
/+254 7 2274 3223
"Oh, the cruft.<=
/span>",=C2=A0egrep -v '^$|^.*#'=C2=A0=
=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-=
)
[How to ask smart quest=
ions:=C2=A0http://www.catb.or=
g/~esr/faqs/smart-questions.html]
<=
/div>



-- 
Mario.




-- 
Mario.




-- 
Best regards,
Odhiambo WASHINGTON,<=
br>Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.&qu=
ot;,=C2=A0egrep -v '^$|^.*#'=
;=C2=A0=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]


--000000000000d1e5b40602b70554--

From nobody Sat Aug 12 10:22:33 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNGvh1jnNz4mK0h
	for ; Sat, 12 Aug 2023 10:23:12 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNGvg52mxz4W5X
	for ; Sat, 12 Aug 2023 10:23:11 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-ej1-x62a.google.com with SMTP id a640c23a62f3a-99bf1f632b8so389093466b.1
        for ; Sat, 12 Aug 2023 03:23:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691835790; x=1692440590;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=J/KWaPN/mLpSRTn9lDDY5tLuSGSrCqr5CgOoZN7CjzU=;
        b=IppHi7VLJkxwM80j5NZRrcFqkTjQoGKrUEpcsdjLbzgEDP/1lF7ggJdMEJDUh2YBxc
         1XUKjlQs42lQMCpqWhEcsR24dgJrBhFNAD9/T8YovVMrUioxmyURddKfm/vUMQsvsUvJ
         wZ6Utce5uf2lK1MfpAGo+uK9Al0R8rc/2FZMJV7Ev4++6WIbL0/K90zXhbrfEUmtQBTN
         EslKCbCmZUqLU1byncHCFlmHu5jIU1xV1i9t6nrSd6YvaNUX08rM3yrcaadhuB9ZGX2K
         m2hn0/ppNwdJ2+dE6+zeRuFM0dwIjae+hL/ZZVcmWfSDxxYNSNTo5xuXFcHV4uu1EO6p
         wKww==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691835790; x=1692440590;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=J/KWaPN/mLpSRTn9lDDY5tLuSGSrCqr5CgOoZN7CjzU=;
        b=ja72wQ+M8QF+RNAPQTDbI/tnGvrkuRo4MvxbiZ3mqUu4tNEoh1JTviTT8R6Nppsfap
         Ha9ukgRIns0iiunsE6Gu9L6mSP+a1AvYeO/zRdNVkJAGUxW90SxS4vLUzN8Es28mMhyu
         CKQP22xo9DZiV4lFOsIwYQBWJYppOFMEwtqYhJxY+E5wH8Qr2fPwrm6OVyOrd2ZXurlA
         CPKPAyizK1GAMksXYXdJG904TefmNH9MYh33hnAoGv9YyP5mj72h/xJl0If2BNy0Ty5P
         e3X87vgbszUKbaFS2zlwp5L/PlfRkGkrNqhU/LynwMnH/ROQsfXVY515Y8C/Ul+SlkUq
         +Omg==
X-Gm-Message-State: AOJu0Yw6Dr820RAh8NeswvWNmr0FZBwhmU0pEyC1FtRMI4XqwWYsXWit
	NNxnR5NiIoGR5iV0Rj4lq288DbATU+WsnYCrLdGv0VqJabI=
X-Google-Smtp-Source: AGHT+IHbOZEENObbNHt3p2x3nfksbEsTMC9qF43XwIrbLqiORHkcRfm9wD+eTvsH0rksJgVsFlI0JkKmAStEWZAoyRE=
X-Received: by 2002:a17:906:cc0d:b0:997:caf0:9945 with SMTP id
 ml13-20020a170906cc0d00b00997caf09945mr3340428ejb.12.1691835789707; Sat, 12
 Aug 2023 03:23:09 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
 
  
In-Reply-To: 
From: Mario Marietto 
Date: Sat, 12 Aug 2023 12:22:33 +0200
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Odhiambo Washington 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="000000000000438f440602b73757"
X-Rspamd-Queue-Id: 4RNGvg52mxz4W5X
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--000000000000438f440602b73757
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

As I had suspected,the first tutorial wants you learn vm-bhyve and iohyve
(the wrapper for zfs and bhyve),as he says :

*I=E2=80=99m not saying this is the way to go*. Really, really, If you are =
planning
on setting things up from scratch to have a nice FreeBSD virtual machines
server, look into all the cool projects out there like vm-bhyve
 or iohyve
 (to name two of them, I=E2=80=99m sure t=
here are
more).


That's not good. If you want to set up from scratch you should not focus
too much on studying the vm-bhyve or iohyve,it makes things even more
complicated because these are tools that change themself during the time so
you should keep updated with more knowledge.

Take a look at this tutorial :

https://www.cyberciti.biz/faq/how-to-install-linux-vm-on-freebsd-using-bhyv=
e-and-zfs/

On Sat, Aug 12, 2023 at 12:09=E2=80=AFPM Odhiambo Washington 
wrote:

> I have read https://wu.e-shell.org/articles/hw-to-bhyve.html as well as
> https://www.netscylla.com/blog/2021/06/11/FreeBSD-and-Bhyve.html and many
> more.
> I will just master it with time.
>
> On Sat, Aug 12, 2023 at 1:01=E2=80=AFPM Mario Marietto 
> wrote:
>
>> Try like this :
>>
>> bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G -w -H -A \
>> -s 0,hostbridge \
>> -s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootinde=
x=3D1 \
>> -s 13,virtio-net,tap1 \
>> -s 29,fbuf,tcp=3D0.0.0.0:5918,w=3D1600,h=3D950,wait \
>> -s 30,xhci,tablet \
>> -s 31,lpc \
>> -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
>> vm0:1 < /dev/null & sleep 2 && vncviewer 0:1
>>
>> Doing this way you will learn better how to compose the bhyve parameters=
 and how they should be formatted naturally.
>> As you can see,the vm-bhyve wrapper "muddies the waters". And I think th=
at you should also learn how to create a bridge on FreeBSD.
>>
>>
>> On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto 
>> wrote:
>>
>>> In my opinion,the usage of the wrapper creates some difficulties to
>>> understand how bhyve and the networking works. You should start from th=
e
>>> very beginning,studying bhyve and the freebsd networking,instead of
>>> learning how to correctly use the wrapper.
>>>
>>> On Sat, Aug 12, 2023 at 11:25=E2=80=AFAM Odhiambo Washington 
>>> wrote:
>>>
>>>> Hello all.
>>>>
>>>> I am new to bhyve and have read a lot about it, so I decided to try
>>>> creating a few VMs.
>>>> I found a HOWTO that is detailed and which appears to be the easiest t=
o
>>>> follow:
>>>> https://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
>>>> The only differences are that I did not install a fresh FreeBSD-13
>>>> server as I already had one, and I am not using ZFS on my server (host=
).
>>>> I have gotten stuck midway and cannot figure out why: I cannot boot th=
e
>>>> VMs I create.
>>>> I have tried creating a Windows2019 as well as a Debian12 VM, but both
>>>> don't boot.
>>>>
>>>> vm-public: flags=3D8843 metric=
 0
>>>> mtu 1492
>>>>         ether ce:6f:18:51:d4:51
>>>>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>>>>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>>>>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>>>>         member: em1 flags=3D143
>>>>                 ifmaxaddr 0 port 2 priority 128 path cost 20000
>>>>         groups: bridge vm-switch viid-4c918@
>>>>         nd6 options=3D9
>>>> tap0: flags=3D8943 met=
ric
>>>> 0 mtu 1492
>>>>         description: vmnet/debian12/0/public
>>>>         options=3D80000
>>>>         ether 58:9c:fc:10:ff:ed
>>>>         inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scopeid 0x6
>>>>         groups: tap vm-port
>>>>         media: Ethernet autoselect
>>>>         status: no carrier
>>>>         nd6 options=3D21
>>>>
>>>> 1.  Windows2019 VM:
>>>>     vm create -t uefi -s 100G -m 8G -c8 windows2019
>>>>     vm install windows2019 /usr/local/bhyve-vms/.iso/server2019.iso
>>>>
>>>> 2. Debian12 VM:
>>>>     vm create -s 60G -m 8G -c 8 debian12
>>>>     vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso
>>>>
>>>> root@gw:/usr/local/bhyve-vms # vm list
>>>> NAME         DATASTORE  LOADER     CPU  MEMORY  VNC  AUTO     STATE
>>>> debian12     default            bhyveload    8         8G
>>>>  -       Yes[2]         Bootloader (91866)
>>>> windows2019  default        uefi               8        8G
>>>>  -       Yes [1]     Stopped
>>>>
>>>> From the above output of `vm list`, you can see that none of them is
>>>> booting up.
>>>>
>>>> What is it that I could be missing?
>>>>
>>>>
>>>> --
>>>> Best regards,
>>>> Odhiambo WASHINGTON,
>>>> Nairobi,KE
>>>> +254 7 3200 0004/+254 7 2274 3223
>>>> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>>>> [How to ask smart questions:
>>>> http://www.catb.org/~esr/faqs/smart-questions.html]
>>>>
>>>
>>>
>>> --
>>> Mario.
>>>
>>
>>
>> --
>> Mario.
>>
>
>
> --
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
> [How to ask smart questions:
> http://www.catb.org/~esr/faqs/smart-questions.html]
>


--=20
Mario.

--000000000000438f440602b73757
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


As I had suspected,the first tutorial wants you learn=
 vm-bhyve and iohyve (the wrapper for zfs and bhyve),as he says : 


On Sat, Aug 12, 2023 at 12:09=E2=80=AFPM Odhiambo Washi=
ngton <odhiambo@=
gmail.com> wrote:
I will just master it with time.

On Sat, Aug 12, 2023 at 1:01=E2=
=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
=
Try like this :

bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 4G =
-w -H -A \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/zroot2/zroot2/bhyve/img/Windows/windows11.img,bootindex=
=3D1 \
-s 13,virtio-net,tap1 \
-s 29,fbuf,tcp=3D0.0.0.0:=
5918,w=3D1600,h=3D950,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:1 < /dev/null & sleep 2 && vncviewer 0:1

<=
/pre>
Doing this way you will learn better how to compose the bhy=
ve parameters and how they should be formatted naturally. 
As you can se=
e,the vm-bhyve wrapper "muddies the waters&qu=
ot;. And I think that you should also learn how to create a bridge on FreeB=
SD.

On Sat, Aug 12, 2023 at 11:46=E2=80=AFAM Mario Marietto <=
;marietto2008@g=
mail.com> wrote:
In my opinion,the usage of the wrapper creates som=
e difficulties to understand how bhyve and the networking works. You should=
 start from the very beginning,studying bhyve and the freebsd networking,in=
stead of learning how to correctly use the wrapper.

On Sat, Aug 12, 2023=
 at 11:25=E2=80=AFAM Odhiambo Washington <odhiambo@gmail.com> wrote:
Hello all.
I am new to bhyve and have read a lot about it, so I decide=
d to try creating a few VMs.
I found a HOWTO that is detailed and=
 which appears to be the easiest to follow:=C2=A0http=
s://klarasystems.com/articles/from-0-to-bhyve-on-freebsd-13-1/
The only differences are that I did not install a fresh FreeBSD-13 server=
 as I already had one, and I am not using ZFS on my server (host).
I have gotten stuck midway and cannot figure out why: I cannot boot the V=
Ms I create.
I have tried creating a Windows2019 as well as a Deb=
ian12 VM, but both don't boot.

vm-public: flag=
s=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1492=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether ce:6f:18:51:d4:51
=C2=A0 =C2=A0 =C2=
=A0 =C2=A0 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 20 holdcnt 6 proto rstp maxaddr 2000 tim=
eout 1200
=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 priority=
 32768 ifcost 0 port 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: em1 flags=3D1=
43<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0=
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 2 priority 128 path cost 2000=
0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: bridge vm-switch viid-4c918@
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D9<PERFORMNUD,IFDISABLED>
tap0: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULT=
ICAST> metric 0 mtu 1492
=C2=A0 =C2=A0 =C2=A0 =C2=A0 description: vmn=
et/debian12/0/public
=C2=A0 =C2=A0 =C2=A0 =C2=A0 options=3D80000<LINK=
STATE>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 58:9c:fc:10:ff:ed
=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 inet6 fe80::5a9c:fcff:fe10:ffed%tap0 prefixlen 64 scop=
eid 0x6
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: tap vm-port
=C2=A0 =C2=A0=
 =C2=A0 =C2=A0 media: Ethernet autoselect
=C2=A0 =C2=A0 =C2=A0 =C2=A0 st=
atus: no carrier
=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 options=3D21<PERFORM=
NUD,AUTO_LINKLOCAL>

1.=C2=A0 Windows2019 VM=
:
=C2=A0 =C2=A0 vm create -t uefi -s 100G -m 8G -c8 windows2019
=C2=A0 =C2=A0=C2=A0vm install windows2019 /usr/local/bhyve-vms/.is=
o/server2019.iso

2. Debian12 VM:
=C2=A0 =
=C2=A0=C2=A0vm create -s 60G -m 8G -c 8 debian12
=C2=A0 =C2=A0=C2=
=A0vm install debian12 .iso/debian-12.0.0-amd64-DVD-1.iso

root@gw:/usr/local/bhyve-vms # vm list
NAME =C2=A0 =C2=A0 =C2=A0=
 =C2=A0 DATASTORE =C2=A0LOADER =C2=A0 =C2=A0 CPU =C2=A0MEMORY =C2=A0VNC =C2=
=A0AUTO =C2=A0 =C2=A0 STATE
debian12 =C2=A0 =C2=A0 default=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 bhyveload=C2=A0 =C2=A0 8=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A08G=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=
=A0 =C2=A0 =C2=A0Yes[2]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Bootloader (91866)=

windows2019 =C2=A0default=C2=A0 =C2=A0 =C2=A0 =C2=A0 uefi=C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A08=C2=A0 =C2=A0 =C2=A0 =C2=A0 8G=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0-=C2=A0 =C2=A0 =C2=A0 =C2=A0Ye=
s [1]=C2=A0 =C2=A0 =C2=A0Stopped

From the abov=
e output of `vm list`, you can see that none of them is booting up.

What is it that I could be missing?

<=
div>
-- 
<=
div>Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004=
/+254 7 2274 3223
"Oh, the cruft.<=
/span>",=C2=A0egrep -v '^$|^.*#'=C2=A0=
=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-=
)
[How to ask smart quest=
ions:=C2=A0http://www.catb.or=
g/~esr/faqs/smart-questions.html]
<=
/div>



-- 
Mario.




-- 
Mario.




-- 
Best regards,
Odhiambo WASHINGTON,<=
br>Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.&qu=
ot;,=C2=A0egrep -v '^$|^.*#'=
;=C2=A0=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]



-- 
Mario.


--000000000000438f440602b73757--

From nobody Sat Aug 12 11:06:43 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNHtf6pGcz4mMyB
	for ; Sat, 12 Aug 2023 11:07:22 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Received: from mail-lj1-x233.google.com (mail-lj1-x233.google.com [IPv6:2a00:1450:4864:20::233])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNHtf4gyzz4Zjh
	for ; Sat, 12 Aug 2023 11:07:22 +0000 (UTC)
	(envelope-from odhiambo@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-lj1-x233.google.com with SMTP id 38308e7fff4ca-2b9d07a8d84so44272981fa.3
        for ; Sat, 12 Aug 2023 04:07:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691838441; x=1692443241;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=6yEebFvpMDkMikeW1pbq9I9+slKGQMq9OXFhe0OytQo=;
        b=pkPm4h9brlAVNwmTFK9f0AqUc3PkzWsvu4l6J5xpkAeQXym1EQLQRKSzDWnehWWSB4
         zLdtq6OhtWP+JOpQ7X6GIoRRw74cHDOabehcnVEJrLg3/WYFPwfoj6MZrhrAmYfHzGHv
         Z2yZ1WMWxUszhhPrNQZAe7vT//Gal1xC8tl5QcMF1XFxhtMNK5xvTPfr5m8hbGuElOU6
         A4jIKQuNsbc2KLaObdxC62+WwBpYsKqRJKJnjRht0D93neZk5GCbQcvHcQr3ejnbnjKV
         GHDfVd8zsxHtzowUeFrNX+x1RTQ0OInLfB70RMnJHYqrjekbVZZIaTT18BfyNGTECOgX
         zWOw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691838441; x=1692443241;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=6yEebFvpMDkMikeW1pbq9I9+slKGQMq9OXFhe0OytQo=;
        b=D3skaj8uSTiQHImuiX+mHI/jTmMnGPBgQmQMxUtukNi3c+1fZcYO1pmP0RFtLOvChz
         tz46GV3jqtZX8ECMj5xklZcmosxvyP37eeb+Y84lkbnv++WfM5KXxARxKwKolWWnbj11
         ap2RGAIEHWqq3NKC2mYmzwuWRFht0EFJKvo7BAp1CdLSF1LYZHBwTWnRBmuKPzsrFeqR
         X0nvHNVc2DRMFub89qEbm0cfVvcxe6W42VLQsJZQHZ6X+CzkW9/BmDx+ycpjbaDsjbpY
         gIDBv89Yjh7FTCkvpnzos6HQTX7ZeAs9MZ71tTlRV4nI7oJr8OoUYeBMB7/Rn4aQXQs6
         Zklw==
X-Gm-Message-State: AOJu0YyWPUjXV8Yq+NqwMfOg8G+BDlD8+/klYY862G6JV/yM/j3DlkE0
	RhloLhhM9+uCYOAWjjwBtgyIGLb25k43EgxdE4K9s6lb3xFzcg==
X-Google-Smtp-Source: AGHT+IHsZQrzhYjEdEvk0QA6m6d3emv2v/D0BLTr5576jfVVRV+Bvc4Gj0Fw7OaNSkgvvowGAtnkWotnCPyLEwil74U=
X-Received: by 2002:a2e:9644:0:b0:2b9:a6a1:f12 with SMTP id
 z4-20020a2e9644000000b002b9a6a10f12mr3706105ljh.43.1691838440595; Sat, 12 Aug
 2023 04:07:20 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
 
 
  
In-Reply-To: 
From: Odhiambo Washington 
Date: Sat, 12 Aug 2023 14:06:43 +0300
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Mario Marietto 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="00000000000044e5900602b7d5ad"
X-Rspamd-Queue-Id: 4RNHtf4gyzz4Zjh
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--00000000000044e5900602b7d5ad
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Sat, Aug 12, 2023 at 1:23=E2=80=AFPM Mario Marietto 
wrote:

> As I had suspected,the first tutorial wants you learn vm-bhyve and iohyve
> (the wrapper for zfs and bhyve),as he says :
>
> *I=E2=80=99m not saying this is the way to go*. Really, really, If you ar=
e
> planning on setting things up from scratch to have a nice FreeBSD virtual
> machines server, look into all the cool projects out there like vm-bhyve
>  or iohyve
>  (to name two of them, I=E2=80=99m sure=
 there
> are more).
>
>
> That's not good. If you want to set up from scratch you should not focus
> too much on studying the vm-bhyve or iohyve,it makes things even more
> complicated because these are tools that change themself during the time =
so
> you should keep updated with more knowledge.
>
> Take a look at this tutorial :
>
>
> https://www.cyberciti.biz/faq/how-to-install-linux-vm-on-freebsd-using-bh=
yve-and-zfs/
>
TBH, I had used this and even had two VMs running (FreeBSD and Debian).
But I had issues wrapping my head around the tapX networks and also
automatically starting the VMs.
That's why I headed towards using this wrapper.


--=20
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
[How to ask smart questions:
http://www.catb.org/~esr/faqs/smart-questions.html]

--00000000000044e5900602b7d5ad
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable




=

On Sat, Aug 12, 2023 at 1:23=E2=80=AF=
PM Mario Marietto <marietto200=
8@gmail.com> wrote:
As I had suspected,the first tutorial want=
s you learn vm-bhyve and iohyve (the wrapper for zfs and bhyve),as he says =
: 

TBH, I had use=
d this and even had two VMs running (FreeBSD and Debian).
But I h=
ad issues wrapping my head around the tapX networks and also automatically =
starting the VMs.
That's why I headed towards using this wrap=
per.


-- 
Best regards,
Odhiambo WASHINGTON,
Nairob=
i,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.",=C2=
=A0egrep -v '^$|^.*#'=C2=A0=
=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]


--00000000000044e5900602b7d5ad--

From nobody Sat Aug 12 11:15:18 2023
X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RNJ4Z0hBQz4mP5x
	for ; Sat, 12 Aug 2023 11:15:58 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RNJ4Y30TDz4bvT
	for ; Sat, 12 Aug 2023 11:15:57 +0000 (UTC)
	(envelope-from marietto2008@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-ej1-x634.google.com with SMTP id a640c23a62f3a-99bcc0adab4so372579566b.2
        for ; Sat, 12 Aug 2023 04:15:57 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20221208; t=1691838955; x=1692443755;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:from:to:cc:subject:date:message-id:reply-to;
        bh=4lvli/56bkaFhytPj8KfEtAE8Yv5sP5EfafU7ZyWw5w=;
        b=NRU12nb047d9XdLlz9455nwTjUGWXrlj1munEZLiIJTvzPtpxWgCWkG4C6JHRlKqET
         rlu9Kx0Y6FPxfwvpWlhTfaZg5vkLJQiHEzrUnN6jcnxrYhNxcOvweTT3ClG2NmW75G9L
         RMIXr116XIl4m9HftDvAzbje2MehzU4DkF7r6Ys+OjxmdQRpjF8PL/7jzKxPG+FpFSD2
         +qXg/ISWoUVKc2SUAs5xOrpTt/JUio1OrpyhOva9fS/ZZG6pHVNZAkP7Ox7OQm89hDvr
         x5SLHl+o1E1VJOh7JsojcMYDuaFOBFadYBJpAABSdhjMeVESdnH9Npb0E7yYSniziDj+
         wUNw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20221208; t=1691838955; x=1692443755;
        h=cc:to:subject:message-id:date:from:in-reply-to:references
         :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
         :reply-to;
        bh=4lvli/56bkaFhytPj8KfEtAE8Yv5sP5EfafU7ZyWw5w=;
        b=aPw3PYXos2zptvW1EfF3GFPqLEptsXxKXWOixaWRA5ouAdUw1I8M59DKzPHWOdf1BW
         PeYAsSM210nYyJlJb55I6+FVySDawTovvJale/mV8u7gATW64nGEiGXULaQrk8MhkVhy
         /LB6l5hbIUdm81VArYc4Eyw2MPjNmC56GQZ4lEmEYKO5OrH33PkBL7a6auscJVKGbj+d
         SqPebcYPVGv/eerFmlisKGFIXt17/+5OC/iXDxxdhdNL8kJm/LuZyD99Fpu5XzlvOzm7
         2xpFoSdb+LvdC2ABp1uhCsIvlRLiNTHf/O8ryIiUh6I9mHR9D8wk8XfhjFPwnksAKB/3
         6yYg==
X-Gm-Message-State: AOJu0YwVPqkQ8MY27i5Fld7sb+S3rMlsLeu8jQ10RoWNQ81Ut5eLTUib
	jK8TqD8A+hIED9IqvDlgsadr+/D0XqWEYHFxiEU=
X-Google-Smtp-Source: AGHT+IHPdOuooDNBsCErIzsdG6bHJ5cc9wA5vYRtQ3QvEPXKj0Jf1zU2siGdjOwpz5BkW1T5uln6YazEwqE29BroLJs=
X-Received: by 2002:a17:906:cc4e:b0:99d:6ab0:9e1d with SMTP id
 mm14-20020a170906cc4e00b0099d6ab09e1dmr3875963ejb.22.1691838954756; Sat, 12
 Aug 2023 04:15:54 -0700 (PDT)
List-Id: Discussion 
List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-virtualization@freebsd.org
X-BeenThere: freebsd-virtualization@freebsd.org
MIME-Version: 1.0
References: 
 
 
 
  
In-Reply-To: 
From: Mario Marietto 
Date: Sat, 12 Aug 2023 13:15:18 +0200
Message-ID: 
Subject: Re: Starting the bhyve journey
To: Odhiambo Washington 
Cc: freebsd-virtualization@freebsd.org
Content-Type: multipart/alternative; boundary="000000000000ea60630602b7f3d3"
X-Rspamd-Queue-Id: 4RNJ4Y30TDz4bvT
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]

--000000000000ea60630602b7f3d3
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Do you plan to fix the problem by using shortcuts like the wrappers ? I
know,the temptation is high....

On Sat, Aug 12, 2023 at 1:07=E2=80=AFPM Odhiambo Washington 
wrote:

>
>
> On Sat, Aug 12, 2023 at 1:23=E2=80=AFPM Mario Marietto 
> wrote:
>
>> As I had suspected,the first tutorial wants you learn vm-bhyve and iohyv=
e
>> (the wrapper for zfs and bhyve),as he says :
>>
>> *I=E2=80=99m not saying this is the way to go*. Really, really, If you a=
re
>> planning on setting things up from scratch to have a nice FreeBSD virtua=
l
>> machines server, look into all the cool projects out there like vm-bhyve
>>  or iohyve
>>  (to name two of them, I=E2=80=99m sur=
e there
>> are more).
>>
>>
>> That's not good. If you want to set up from scratch you should not focus
>> too much on studying the vm-bhyve or iohyve,it makes things even more
>> complicated because these are tools that change themself during the time=
 so
>> you should keep updated with more knowledge.
>>
>> Take a look at this tutorial :
>>
>>
>> https://www.cyberciti.biz/faq/how-to-install-linux-vm-on-freebsd-using-b=
hyve-and-zfs/
>>
> TBH, I had used this and even had two VMs running (FreeBSD and Debian).
> But I had issues wrapping my head around the tapX networks and also
> automatically starting the VMs.
> That's why I headed towards using this wrapper.
>
>
> --
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
> [How to ask smart questions:
> http://www.catb.org/~esr/faqs/smart-questions.html]
>


--=20
Mario.

--000000000000ea60630602b7f3d3
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable


Do you plan to fix the problem by using shortcuts like the=
 wrappers ? I know,the temptation is high....

On Sat, Aug 12, 2023 at 1:=
07=E2=80=AFPM Odhiambo Washington <odhiambo@gmail.com> wrote:


On Sat, Aug 12, 20=
23 at 1:23=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> wrote:
As I =
had suspected,the first tutorial wants you learn vm-bhyve and iohyve (the w=
rapper for zfs and bhyve),as he says : 

TBH, I had use=
d this and even had two VMs running (FreeBSD and Debian).
But I h=
ad issues wrapping my head around the tapX networks and also automatically =
starting the VMs.
That's why I headed towards using this wrap=
per.


-- 
Best regards,
Odhiambo WASHINGTON,
Nairob=
i,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft.",=C2=
=A0egrep -v '^$|^.*#'=C2=A0=
=C2=AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart questions:=C2=A0http://www.catb.org/~esr/faqs/smart-questions.html]




-- 
Mario.


--000000000000ea60630602b7f3d3--