From nobody Sat Aug 19 15:27:37 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSjL14cHMz4qpkb for ; Sat, 19 Aug 2023 15:27:53 +0000 (UTC) (envelope-from meka@tilda.center) Received: from c3po.tilda.center (c3po.tilda.center [108.61.164.129]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSjL016Hgz4JGL for ; Sat, 19 Aug 2023 15:27:52 +0000 (UTC) (envelope-from meka@tilda.center) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tilda.center header.s=c3po header.b=nh5pKShZ; spf=pass (mx1.freebsd.org: domain of meka@tilda.center designates 108.61.164.129 as permitted sender) smtp.mailfrom=meka@tilda.center; dmarc=pass (policy=reject) header.from=tilda.center Received: from [192.168.111.193] (meka.rs [109.93.255.137]) by c3po.tilda.center (Postfix) with ESMTPSA id D03A222A52 for ; Sat, 19 Aug 2023 17:25:15 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tilda.center; s=c3po; t=1692458716; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ogrttzrRlYqiu3qWSj8Dtn+fKn9SsDWM5lllUBbeNAs=; b=nh5pKShZBv7fzonUeurmVf6fO9D3MKo5X+pClDPaTlmA20L7Ch7KKcXIWbKzHGPPtLMzM4 7xVU+qDKzS+eR92VMNKEoqGscKL3pBJj2ORcOPZ97yWI+sxWC1hvNFNH6+qTO7yam6LzOS srR1J182ND1s30GH6qnzQHkr0ozW89Q= Message-ID: Date: Sat, 19 Aug 2023 17:27:37 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? To: virtualization@freebsd.org References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center> <2c1205c0fc48e8c6ac103d3f3ca0c722a7cd3c6e.camel@FreeBSD.org> <06ae27b6-7a38-ff73-8d9b-70b6be517ccc@tilda.center> <82499999351da778ffb9735f76ecc5d522305273.camel@FreeBSD.org> <2d2f8c74-47d0-ebb1-154f-3aab68d8a084@tilda.center> Content-Language: en-US From: =?UTF-8?Q?Goran_Meki=c4=87?= In-Reply-To: <2d2f8c74-47d0-ebb1-154f-3aab68d8a084@tilda.center> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-2.90 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[tilda.center,reject]; R_DKIM_ALLOW(-0.20)[tilda.center:s=c3po]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:20473, ipnet:108.61.164.0/22, country:US]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[tilda.center:+]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RSjL016Hgz4JGL On 8/19/23 10:27, Goran Mekić wrote: >>> With updated port there's also support for CUSE, which would allow >>> swtpm >>> to be used with pass-through. The problem is that socket and CUSE >>> have >>> problems which I described in upstream issue: >>> https://github.com/stefanberger/swtpm/issues/820. If there are any >>> suggestions how to fix that fuse error, I'd like to hear them and try >>> and fix it. >>> >>> Regards, >>> meka > > Hello, > > I was wrong. Linux CUSE is extension of FUSE while FreeBSD CUSE has > totally different implementation, so it can not be used by swtpm. As > swtpm has control and server channels, I suppose we need both. To > start both: > > # swtpm socket --tpmstate dir=/tmp/mytpm1 --ctrl > type=unixio,path=/tmp/mytpm1/ctrl --tpm2 --log level=20 --server > type=unixio,path=/tmp/mytpm1/server > > Now to initialize it one should run > > # swtpm_ioctl --unix /tmp/mytpm1/swtpm-sock -i > > If -i is replaced with --stop, swtpm is stopped. Now if I understand > correctly, init function of bhyve should do -i, deinit should do > --stop. If that's correct, I will start implementing init and for now > ignore deinit. As swtpm is BSD licenced, I think it is OK for us to > reuse parts of swtpm_ioctl code. Anyway, if I'm wrong about anything, > please point it out. > > Regards, > meka > > I managed to initialize the swtpm by butchering swtpm_ioctl code and creating this: https://bsd.to/Dq7c. I know that for bhyve it's not viable to include from port, but at this point I just want to make some progress and then I'll see how to properly do it. As swtpm is BSD-3-Clause licensed, we should probably import it to base, but I'll worry about that part when at least something starts working. Regards, meka From nobody Sun Aug 20 17:52:43 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTNVx6Gnjz4qW6m for ; Sun, 20 Aug 2023 17:52:57 +0000 (UTC) (envelope-from meka@tilda.center) Received: from c3po.tilda.center (c3po.tilda.center [108.61.164.129]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTNVw46gQz4dqy for ; Sun, 20 Aug 2023 17:52:56 +0000 (UTC) (envelope-from meka@tilda.center) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tilda.center header.s=c3po header.b=sYQaDIFB; spf=pass (mx1.freebsd.org: domain of meka@tilda.center designates 108.61.164.129 as permitted sender) smtp.mailfrom=meka@tilda.center; dmarc=pass (policy=reject) header.from=tilda.center Received: from [192.168.111.178] (meka.rs [109.93.255.137]) by c3po.tilda.center (Postfix) with ESMTPSA id BE39724187 for ; Sun, 20 Aug 2023 19:50:18 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tilda.center; s=c3po; t=1692553819; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=b4XbUeOOJ696AjnidN1eztF6KfIHM0bc0lSWtKPj7S8=; b=sYQaDIFBT6klw+92xNGYd6sIB7AjQuk4dwJ4mlom5lGBUnH/0uT0b1RavQXYjRRlJtM6vU Ysx7zAoB864QITO3D1YDCU6AvW52zt36LJrfZReqZQRSZkGUz9FiT2ookfze68gc/QrXVq QhiTTBaBkKu5lpJbrT5yzeke+E7axmw= Message-ID: <4cf9b819-2a41-8bc1-16a7-60a1eac04e28@tilda.center> Date: Sun, 20 Aug 2023 19:52:43 +0200 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? To: virtualization@freebsd.org References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center> <2c1205c0fc48e8c6ac103d3f3ca0c722a7cd3c6e.camel@FreeBSD.org> <06ae27b6-7a38-ff73-8d9b-70b6be517ccc@tilda.center> <82499999351da778ffb9735f76ecc5d522305273.camel@FreeBSD.org> <2d2f8c74-47d0-ebb1-154f-3aab68d8a084@tilda.center> Content-Language: en-US From: =?UTF-8?Q?Goran_Meki=c4=87?= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-2.90 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[tilda.center,reject]; R_DKIM_ALLOW(-0.20)[tilda.center:s=c3po]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:20473, ipnet:108.61.164.0/22, country:US]; PREVIOUSLY_DELIVERED(0.00)[virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[virtualization@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[tilda.center:+]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RTNVw46gQz4dqy On 8/19/23 17:27, Goran Mekić wrote: > On 8/19/23 10:27, Goran Mekić wrote: >>>> With updated port there's also support for CUSE, which would allow >>>> swtpm >>>> to be used with pass-through. The problem is that socket and CUSE >>>> have >>>> problems which I described in upstream issue: >>>> https://github.com/stefanberger/swtpm/issues/820. If there are any >>>> suggestions how to fix that fuse error, I'd like to hear them and try >>>> and fix it. >>>> >>>> Regards, >>>> meka >> >> Hello, >> >> I was wrong. Linux CUSE is extension of FUSE while FreeBSD CUSE has >> totally different implementation, so it can not be used by swtpm. As >> swtpm has control and server channels, I suppose we need both. To >> start both: >> >> # swtpm socket --tpmstate dir=/tmp/mytpm1 --ctrl >> type=unixio,path=/tmp/mytpm1/ctrl --tpm2 --log level=20 --server >> type=unixio,path=/tmp/mytpm1/server >> >> Now to initialize it one should run >> >> # swtpm_ioctl --unix /tmp/mytpm1/swtpm-sock -i >> >> If -i is replaced with --stop, swtpm is stopped. Now if I understand >> correctly, init function of bhyve should do -i, deinit should do >> --stop. If that's correct, I will start implementing init and for now >> ignore deinit. As swtpm is BSD licenced, I think it is OK for us to >> reuse parts of swtpm_ioctl code. Anyway, if I'm wrong about anything, >> please point it out. >> >> Regards, >> meka >> >> > I managed to initialize the swtpm by butchering swtpm_ioctl code and > creating this: https://bsd.to/Dq7c. I know that for bhyve it's not > viable to include from port, but at this point I just want to make > some progress and then I'll see how to properly do it. As swtpm is > BSD-3-Clause licensed, we should probably import it to base, but I'll > worry about that part when at least something starts working. > > Regards, > meka > > To make it easier to progress, I created repository for my TPM playground: https://github.com/mekanix/tpmplay. The code currently somewhat resembles tpm_emul_passthru.c. It implements init, deinit and ctrlcmd. I'm confused a bit because swtpm has two sockets, one for control one for data. Looking at tpm_emul_passthru.c I can see one fd is used for all commands. If I'm correct, TSS is used for data channel: https://github.com/stefanberger/swtpm/wiki/Using-the-IBM-TSS-with-swtpm#socket-interface. How come pass-through doesn't have ctrl/data channels? Regards, meka From nobody Sun Aug 20 21:01:28 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTShS6l0sz4qjSV for ; Sun, 20 Aug 2023 21:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTShS4ZLQz3cS2 for ; Sun, 20 Aug 2023 21:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692565288; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=isQdDtWG5CGYuQwqzgXkfkuahwV36o/wWU2qtwdYCPg=; b=LOE/HmFN2eS+S5uKT8PA6PVmBDjyTqMcEWBDh+4RMGZ7/vuogK3kMn70MykfgfeYlxwvY0 hA+r4sZ1A6BMtbf1T2IEHGL9RzCgH8wPPitT/jsoy79Lz0u2uWYUXMo2yv3wdtQ7Aj3l10 wipLsEm9a/3AqMvgw10TlNkK+Tpx8Cs5+rvMbH5Z37KyKJfelqnPCrkofXJoAnQ/rOS+zD RZsXiEnrQRcMejbrEGFVZngUQPCws+GiRjyN19dgPS5zrqhajQp3NY1WViXUV9bn71slem G8DA68gnsnoEQG/aAU1Q7qo6TIUTFqDiam/se10fO71YINH9Q2hSNhQy12Cg9g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692565288; a=rsa-sha256; cv=none; b=ur9JqQ7ZJBRdMXxkLlaBdVBdVxBa12ClXqjMakXlYOnKtPuQCd5NjahksShaVpteb25biQ lFoROBdZOuKADBCiOI/vwIGgybrgX/zgJr9VZIKqdhDrPMPEu5L1Gd46GD1kj+Y6qJPKmD NOSoh3C0/MPJ/MXqpe16q9H1WQkDGFKIiHmwWMnKJTIp+bIxYCmCODX6kyCUgahLkL/7Ny un5Yg7sFBOsHJS0r7R7TUDlbiWWV3zlcGmIWmiWTl1CEgxiaZqX1lqd4uXDJy9EZJdIQHX aWizNBJp2Qjk6DYg0DELKTkikTIwdpqts4RqgtY+qxLAPlG91nv0losbgSWZlw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RTShS3hxyztR5 for ; Sun, 20 Aug 2023 21:01:28 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37KL1Svh000655 for ; Sun, 20 Aug 2023 21:01:28 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37KL1SBZ000654 for virtualization@FreeBSD.org; Sun, 20 Aug 2023 21:01:28 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202308202101.37KL1SBZ000654@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 20 Aug 2023 21:01:28 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16925652884.97735.96121" Content-Transfer-Encoding: 7bit --16925652884.97735.96121 Date: Sun, 20 Aug 2023 21:01:28 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 244838 | "bectl activate -t" does not honor the -t flag in 3 problems total for which you should take action. --16925652884.97735.96121 Date: Sun, 20 Aug 2023 21:01:28 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    247208 | mpt(4): VMWare virtualized LSI controller panics 
New         |    240945 | [hyper-v] [netvsc] hn network driver incorrectly 
Open        |    244838 | "bectl activate -t" does not honor the -t flag in

3 problems total for which you should take action.
--16925652884.97735.96121-- From nobody Mon Aug 21 06:35:54 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTjRK5Ly9z4qJKD for ; Mon, 21 Aug 2023 06:35:57 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTjRK39jkz3PSH; Mon, 21 Aug 2023 06:35:57 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692599757; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MyrLMj9CoX6vYNkc3xSXLxuCnXcHc6GpuxMD5IpnXTI=; b=ynwaU7BCKD4ECEinnxu022SKLW0USDtRl6XFCvG5pmxJ7U5CLJLr8mtnl0j3+uEBE5E4Fy CUI28QOn9M7FB+4TM8vi2/riBw0UpneCYiEaHrkrgjYx/zIJojOTp0J3HaPVYyVuFBxLhz 9QELJSoiK2ovYnEQ1NP99yqJO5D7fdbMuyP5dEXZCQizdm2HvGWkc4iHJppJOF/bfGKnDY DQ8NthjXlBVOY4qeYW6cayjUm9UhYIL00DdW3uyWlwEB0Edp10vGhXSQ4PekTmbUPwoZ0N Qzk6gjjUmv5XMbWbTEStwDmGRWb6uwwjOdSad2LArLqjR2jWDeO8tm6gG2ELqw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692599757; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MyrLMj9CoX6vYNkc3xSXLxuCnXcHc6GpuxMD5IpnXTI=; b=KaXwQp4qq8ml7/iVVf+qK0l2e17mBs6xHlS2SX2qf91uBvjMgdenPhDcLD2/SXeXg+V3M8 wXPeT3ytxGAInp5tCHqSMXtTI349YrZ02h8Urp29GV0IEg39u/udFJuSDqvIvSoh46PMFZ uOiKk16XAz86mAtPwS72qjl0j4/jZUQYevox1tCrnfpiqR6QaGH1JPrqkq4kHVr1MO1Ok+ +7VAGz46s3NwctkJUiQI2eDihr3I1ROBkTPAHTBygs7qSns9wIhWeIMC4Auy1/HNe2QrQH gA4qaySJ2mqhOi06xRl7gpDnUplJmv3HvYCg7/bn/8ct+L4AO379CSIGbovq7Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692599757; a=rsa-sha256; cv=none; b=L36MOWmTMrV9fy1/1oZVzT8EtPBrTs6jkeM8JvAkgMB1oYr17WvUZRfjz0VlvtM1yU1Zbh VdMBAUGfJ8kMipUXF9AFqm3xT0S5JIxA9QbrgHvtxLBqvczYdhfKNqlxtkwv62yJeDDKMM AUAEjCno6fyp0YWbcgeE1JYemjtz7Lc5MuAM3pMsY/RwGc/7Ddk4+Q3QaWdYnPYzvhfFHF m+BpzsAwW2xfwBsMo9XTcFJjjOx3fR8pvawCekagyWuWsbIJA7eyuvPlEp5zfxtt9VIXTp +lz+lcshNE46rkxV3koSRjq1yQGDvI9WYvBOfXGa/KwXy1/ryv7ncXmJ9O+S8g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from [172.21.179.63] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RTjRJ6VJzz1RZd; Mon, 21 Aug 2023 06:35:56 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <1a0a0a4fd3f71a281876d9cb726fc59a45501b06.camel@FreeBSD.org> Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Goran =?iso-8859-2?Q?Meki=E6?= , virtualization@freebsd.org Date: Mon, 21 Aug 2023 08:35:54 +0200 In-Reply-To: <4cf9b819-2a41-8bc1-16a7-60a1eac04e28@tilda.center> References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center> <2c1205c0fc48e8c6ac103d3f3ca0c722a7cd3c6e.camel@FreeBSD.org> <06ae27b6-7a38-ff73-8d9b-70b6be517ccc@tilda.center> <82499999351da778ffb9735f76ecc5d522305273.camel@FreeBSD.org> <2d2f8c74-47d0-ebb1-154f-3aab68d8a084@tilda.center> <4cf9b819-2a41-8bc1-16a7-60a1eac04e28@tilda.center> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-mDIwsmfdWE//J3VgenKc" User-Agent: Evolution 3.48.4 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-mDIwsmfdWE//J3VgenKc Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, 2023-08-20 at 19:52 +0200, Goran Meki=C4=87 wrote: > On 8/19/23 17:27, Goran Meki=C4=87 wrote: > > On 8/19/23 10:27, Goran Meki=C4=87 wrote: > > > > > With updated port there's also support for CUSE, which would > > > > > allow > > > > > swtpm > > > > > to be used with pass-through. The problem is that socket and > > > > > CUSE > > > > > have > > > > > problems which I described in upstream issue: > > > > > https://github.com/stefanberger/swtpm/issues/820. If there > > > > > are any > > > > > suggestions how to fix that fuse error, I'd like to hear them > > > > > and try > > > > > and fix it. > > > > >=20 > > > > > Regards, > > > > > meka > > >=20 > > > Hello, > > >=20 > > > I was wrong. Linux CUSE is extension of FUSE while FreeBSD CUSE > > > has=20 > > > totally different implementation, so it can not be used by swtpm. > > > As=20 > > > swtpm has control and server channels, I suppose we need both. To > > > start both: > > >=20 > > > # swtpm socket --tpmstate dir=3D/tmp/mytpm1 --ctrl=20 > > > type=3Dunixio,path=3D/tmp/mytpm1/ctrl --tpm2 --log level=3D20 --serve= r=20 > > > type=3Dunixio,path=3D/tmp/mytpm1/server > > >=20 > > > Now to initialize it one should run > > >=20 > > > # swtpm_ioctl --unix /tmp/mytpm1/swtpm-sock -i > > >=20 > > > If -i is replaced with --stop, swtpm is stopped. Now if I > > > understand=20 > > > correctly, init function of bhyve should do -i, deinit should do=20 > > > --stop. If that's correct, I will start implementing init and for > > > now=20 > > > ignore deinit. As swtpm is BSD licenced, I think it is OK for us > > > to=20 > > > reuse parts of swtpm_ioctl code. Anyway, if I'm wrong about > > > anything,=20 > > > please point it out. > > >=20 > > > Regards, > > > meka > > >=20 > > >=20 > > I managed to initialize the swtpm by butchering swtpm_ioctl code > > and=20 > > creating this: https://bsd.to/Dq7c. I know that for bhyve it's not=20 > > viable to include from port, but at this point I just want to make=20 > > some progress and then I'll see how to properly do it. As swtpm is=20 > > BSD-3-Clause licensed, we should probably import it to base, but > > I'll=20 > > worry about that part when at least something starts working. > >=20 > > Regards, > > meka > >=20 > >=20 > To make it easier to progress, I created repository for my TPM=20 > playground: https://github.com/mekanix/tpmplay. The code currently=20 > somewhat resembles tpm_emul_passthru.c. It implements init, deinit > and=20 > ctrlcmd. I'm confused a bit because swtpm has two sockets, one for=20 > control one for data. Looking at tpm_emul_passthru.c I can see one fd > is=20 > used for all commands. If I'm correct, TSS is used for data channel:=20 > https://github.com/stefanberger/swtpm/wiki/Using-the-IBM-TSS-with-swtpm#s= ocket-interface > . > How come pass-through doesn't have ctrl/data channels? >=20 > Regards, > meka >=20 >=20 Hi, The passthrough implementation is conceptionally similar to qemu's passthrough implementation. You can take a look at it here: https://elixir.bootlin.com/qemu/v8.0.4/source/backends/tpm/tpm_passthrough.= c The swtpm implemenation of qemu is found here: https://elixir.bootlin.com/qemu/latest/source/backends/tpm/tpm_emulator.c I'd prefer that the swtpm of bhyve is similar to qemu's implemenation as well. Afaik, qemu doesn't include the swtpm code. Would be nice for bhyve too. Looking at the use cases of the ctrl channel (set_locality, stop_tpm, get_established_flag, ...), none of them are used by the passthrough implementation or they are dummy implementations. Note, that most of them, if not all, don't make sense for a passthrough implementation. --=20 Kind regards, Corvin --=-mDIwsmfdWE//J3VgenKc Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmTjBcoACgkQ2FTaVjFe AmrDbw/+P69+s+1WsGVMdsElHYxHmjkyTNYSYsp89dmc5e+lB9GBfx02lfMUZf8V b686NwDzzXOffturXz1IdMF6sNWQvnr0Gbk0+JNmsV4aWN3d1B5Jo5N5PBEpgItE XxJzza6gqz1/RfPjcqO8DmZerGq59N4/kPCFOm1rcC6TH1sMYrMSzIqlUiKlS9yf GW9AN8/jBtU1WnRFUEJfqaU00ylKkq2cvNKWDeLp4jmpMEr0YadbWnlxtM/N15iO ZOIJ2C3VYv6cmUPOnaa+MUHQyW2Q1OK7B3peY8cMdrOwEPrQU1Hzkr8R7zS+tCLV PpVJuG7VfL/QKBTxJTch3VNi7faoa23sdyhmXRqwm19CoKGPx94a2sSxqZYTCIXU PL5V9CpZRtwLwCzJDSnl5eNd8OuqRz5mYA4laBcDyN/B/JnNXUx7cfNaxj9xTrQ9 9sk/8Xc2hvAIeCYStIJlKI4jhJs4/ay0vqTEc8U7b1H6ZFrjU+oM9Go9/p5J1Syi vLCc4e1aZ6l7fQnTEDS8vt+mrfuu0u46Sfwb+SDSCAaBhvlRsniL1otfY9MsgLo9 oIk8YiQlpr7P1/D6xLXh4YfEIHL5PJqa/n3T0nIVLtMaAwlJJLKZBL2E/y95ej87 0g/yI4/krJ16+JrgMkuA1cWWaHeEfVhbaCr/M4uN1KsJzvtODds= =Ezbg -----END PGP SIGNATURE----- --=-mDIwsmfdWE//J3VgenKc-- From nobody Mon Aug 21 06:45:42 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTjfc4pNlz4qK0f for ; Mon, 21 Aug 2023 06:45:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTjfc4HG5z3Ryk; Mon, 21 Aug 2023 06:45:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692600344; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=pENlj1FOAyvbjFWqwrb8dTOpCcOuK1cJdaCohcEqG4k=; b=rcjfZAq9Cl6zhkJF8EnjxD/eIzZM/bD7Uk8ww5TlhZgMfD5gA/LGdBTwYeLXA7Z8l+N+f7 i1uhAoELM4Kv+5xVy3MtGI2xwLvbCc/Qwgac64xdv8MjIXF5+ZBGQzcmN12ftEVzbl5jr2 +e/UEISg0GGlR3CHXu6Q/J6BrRiCBHyB+DPhttMJwwtl2viSS79kuB0cgh1JMjQcLTQQYn 2GZP5OSoUjPwmfr4uiYAspBfP0S+3cc1JXYBZ9nBWq/MiwBHPCavy9hucvL1jopv2OQMVO 2vWnRPX85wr62zWJfGPeUvOuCW4q+fi4dNvaRV1UQOoDBqSlZOZ3XDGu30CCPw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692600344; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=pENlj1FOAyvbjFWqwrb8dTOpCcOuK1cJdaCohcEqG4k=; b=nwHTqguwxtWPMEMNfnh8XrNyEeC5zmqGo8Cms+n+gcUG+9lYl8OOD9oyvfkpPB5dKKLiQB sQvSYDJJyX85XGAjVC7lN4livOVQJHpr3urJnQQ3tsviaYlGjoVmA8S0/ec2OTVdSoeFnj TRqEan1TM9KXj7mkZ8F/q/8WyNmG0n+AcxzEZM+XVW9/2zY1FM5sSbOnjerjQnurA4n81n MjLbd/VT8pWUYXi4j/P3trMfGPd2MRpOLz+80bSHjEG7pO68Yb5xRDdhYTYu0DPdQiNNSj LKDjWhP0zHtd5g1UlYj0bPEixYaz4eMKIckgR1nJ+w/0E2cjhtO8wJrZW7BaJA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692600344; a=rsa-sha256; cv=none; b=v+J0fYlwqBzgCx50CRIALTxWDvkSk4qw+mKM/TUlVZNZ8e/7XExVDdffWfOtOX0uG99Xzc 2tu3Hh691N+j4zy3lPGL3/AM5aCHwHquvNzacDMe8/3/ziiuz50ydtFpMsRLPt0i5yo0DC Rg8K17ckrGDDAnB3eQPEaYofjqBuSkmChZes8LJxzvvJR3UFXmHkR4qNuzEN+1drW9INBU Dl/vw0gI1EYUpwzDmPyoLdWTrggFRITssFK+im3ZKqlwuGAKYWzsPNG3HAX4eWyOFeeNwr mVIyiI2OVlt4mlGAduMlE72JoO2mKFUddzj2a4sWuCuKs/2P571WPCLtqHB+TQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from [172.21.179.63] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RTjfc05vWz1S2D; Mon, 21 Aug 2023 06:45:43 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <17c2de9cdefd2d04b65038ddff17b584f48833ea.camel@FreeBSD.org> Subject: Re: Sudden need for bhyve TPM Emulation... willing to port swtpm? From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Goran =?iso-8859-2?Q?Meki=E6?= , virtualization@freebsd.org Date: Mon, 21 Aug 2023 08:45:42 +0200 In-Reply-To: <1a0a0a4fd3f71a281876d9cb726fc59a45501b06.camel@FreeBSD.org> References: <662af723-de9f-36d9-c960-ef08379ca26e@callfortesting.org> <1d4e6558-0c56-5758-d87e-e9bf4aacc0a5@tilda.center> <85ee3beda055c5bc9fae26c07247fe0cea1458e9.camel@FreeBSD.org> <2f1539fc-f8b2-2ec5-9c68-c60f68e66c0e@tilda.center> <2c1205c0fc48e8c6ac103d3f3ca0c722a7cd3c6e.camel@FreeBSD.org> <06ae27b6-7a38-ff73-8d9b-70b6be517ccc@tilda.center> <82499999351da778ffb9735f76ecc5d522305273.camel@FreeBSD.org> <2d2f8c74-47d0-ebb1-154f-3aab68d8a084@tilda.center> <4cf9b819-2a41-8bc1-16a7-60a1eac04e28@tilda.center> <1a0a0a4fd3f71a281876d9cb726fc59a45501b06.camel@FreeBSD.org> Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-Rv3eDWkqFvI8vXtk/mZ1" User-Agent: Evolution 3.48.4 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-Rv3eDWkqFvI8vXtk/mZ1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, 2023-08-21 at 08:35 +0200, Corvin K=C3=B6hne wrote: > On Sun, 2023-08-20 at 19:52 +0200, Goran Meki=C4=87 wrote: > > On 8/19/23 17:27, Goran Meki=C4=87 wrote: > > > On 8/19/23 10:27, Goran Meki=C4=87 wrote: > > > > > > With updated port there's also support for CUSE, which > > > > > > would > > > > > > allow > > > > > > swtpm > > > > > > to be used with pass-through. The problem is that socket > > > > > > and > > > > > > CUSE > > > > > > have > > > > > > problems which I described in upstream issue: > > > > > > https://github.com/stefanberger/swtpm/issues/820. If there > > > > > > are any > > > > > > suggestions how to fix that fuse error, I'd like to hear > > > > > > them > > > > > > and try > > > > > > and fix it. > > > > > >=20 > > > > > > Regards, > > > > > > meka > > > >=20 > > > > Hello, > > > >=20 > > > > I was wrong. Linux CUSE is extension of FUSE while FreeBSD CUSE > > > > has=20 > > > > totally different implementation, so it can not be used by > > > > swtpm. > > > > As=20 > > > > swtpm has control and server channels, I suppose we need both. > > > > To > > > > start both: > > > >=20 > > > > # swtpm socket --tpmstate dir=3D/tmp/mytpm1 --ctrl=20 > > > > type=3Dunixio,path=3D/tmp/mytpm1/ctrl --tpm2 --log level=3D20 -- > > > > server=20 > > > > type=3Dunixio,path=3D/tmp/mytpm1/server > > > >=20 > > > > Now to initialize it one should run > > > >=20 > > > > # swtpm_ioctl --unix /tmp/mytpm1/swtpm-sock -i > > > >=20 > > > > If -i is replaced with --stop, swtpm is stopped. Now if I > > > > understand=20 > > > > correctly, init function of bhyve should do -i, deinit should > > > > do=20 > > > > --stop. If that's correct, I will start implementing init and > > > > for > > > > now=20 > > > > ignore deinit. As swtpm is BSD licenced, I think it is OK for > > > > us > > > > to=20 > > > > reuse parts of swtpm_ioctl code. Anyway, if I'm wrong about > > > > anything,=20 > > > > please point it out. > > > >=20 > > > > Regards, > > > > meka > > > >=20 > > > >=20 > > > I managed to initialize the swtpm by butchering swtpm_ioctl code > > > and=20 > > > creating this: https://bsd.to/Dq7c. I know that for bhyve it's > > > not=20 > > > viable to include from port, but at this point I just want to > > > make=20 > > > some progress and then I'll see how to properly do it. As swtpm > > > is=20 > > > BSD-3-Clause licensed, we should probably import it to base, but > > > I'll=20 > > > worry about that part when at least something starts working. > > >=20 > > > Regards, > > > meka > > >=20 > > >=20 > > To make it easier to progress, I created repository for my TPM=20 > > playground: https://github.com/mekanix/tpmplay. The code currently=20 > > somewhat resembles tpm_emul_passthru.c. It implements init, deinit > > and=20 > > ctrlcmd. I'm confused a bit because swtpm has two sockets, one for=20 > > control one for data. Looking at tpm_emul_passthru.c I can see one > > fd > > is=20 > > used for all commands. If I'm correct, TSS is used for data > > channel:=20 > > https://github.com/stefanberger/swtpm/wiki/Using-the-IBM-TSS-with-swtpm= #socket-interface > > . > > How come pass-through doesn't have ctrl/data channels? > >=20 > > Regards, > > meka > >=20 > >=20 >=20 > Hi, >=20 > The passthrough implementation is conceptionally similar to qemu's > passthrough implementation. You can take a look at it here: > https://elixir.bootlin.com/qemu/v8.0.4/source/backends/tpm/tpm_passthroug= h.c > The swtpm implemenation of qemu is found here: > https://elixir.bootlin.com/qemu/latest/source/backends/tpm/tpm_emulator.c > I'd prefer that the swtpm of bhyve is similar to qemu's implemenation > as well. Afaik, qemu doesn't include the swtpm code. Would be nice > for > bhyve too. >=20 > Looking at the use cases of the ctrl channel (set_locality, stop_tpm, > get_established_flag, ...), none of them are used by the passthrough > implementation or they are dummy implementations. >=20 > Note, that most of them, if not all, don't make sense for a > passthrough > implementation. >=20 >=20 Btw. you can also look into qemu's doc on how it starts a tpm emulator: https://qemu-project.gitlab.io/qemu/specs/tpm.html#the-qemu-tpm-emulator-de= vice --=20 Kind regards, Corvin --=-Rv3eDWkqFvI8vXtk/mZ1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmTjCBYACgkQ2FTaVjFe AmrF3w//WJCCC3dbEgIeZrQh2+I6lE6fb1KpHNJc41LaBzhpMFp9sriQiywhzfOT V07O9OpTGK0x5KNY23tvKOWJilRfLkuPG/fyGny+fZ5AE/q7aLhzwCvx/epyGhsd z03c3Pi8ZmFcsLGXLhrv4KThBPkgz6L7O8g2YcLJCqfPOcdgJ7NxQ3auXujp+/MW 1cEE3gvMIlA5k2f0UpkSNMtWJdVRpL0HrMcgTAth60FU1auPh5+JPsiLxk65W7an yQEv45UBef3CH9xfW40Bzz4OnxSCfVAIvzLvlziEmHxHuPtgEjDkwSSmTHyqmOla sf/ueyJxrL2tgulCc9VrjVgIalRMO0qY9YsHwjkNKxlaf9VB/FyLKsO/6P9eB+p0 xwiwIxJykY70iKpv/DXIWem77x42H6VJg9pN4rOIl/BOVp11BnmAjZZRGp21BI3A YSN3Yy1apUHO5Nyq6qnn9yJXxEu1pnwXfVbVjrDQQFm8DHp542wFUVQhbsvShNcv 7zE16Pd8wAJpn0oqYksAH5HmeJqwUcdoilQp2BasWU0MJJLw1eYjHBsE70H5Wm/h hVvehLDhK0ingnzMHBCGHtqpLGzDQYJJz/EBl4ctvexnl5Bpeef4G798WuB0M1y/ t4KaAcEFbi14WGnU+RX4yfIsBg/iJF0WWIJyG2KQkDM4hrYf5oY= =mz8T -----END PGP SIGNATURE----- --=-Rv3eDWkqFvI8vXtk/mZ1-- From nobody Thu Aug 24 09:33:08 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWdDN4lVtz4qtwt for ; Thu, 24 Aug 2023 09:33:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWdDN3g7Hz3LdW for ; Thu, 24 Aug 2023 09:33:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692869588; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=h4ltR3/+y3GRIV3VSXWe3qqNoOc8MVhYyvl8f5trZy4=; b=u+0thasY8Sd3PvqRT2H4qz8qd7t3gRY5WPlDJ2y8MsfRG576rMdIr3swijT52e91foLeXv 9vAUy2oV2G12kTMLGqp2YvwiWxVpFZodIsXJIYVNNEJ7St1qtlYpNjKzcqzxwFq4uA8Oii saBZhL4ykRpN732a6DC20DASZfH7yNAmiimvFMjw2Vvw54o+EyaM1ny6PuqDZKk3Ok76+N hsK0aQaZzkTmhf1wTqANutzuW61ZF4va1g2LTIkenmhEHALpvuk/9B6VNHaYpljIzUxvoT FJYY7rmVPvMU0sJHfSVCQtwf6CPvSsa5tLorxl9oO18c00BzP8w/+j82CesBTg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692869588; a=rsa-sha256; cv=none; b=EEQq1a4wpd5Ji8MtCn2wnL6iBQGI1lS0fOE2SsfecsGtYXEZTcJCY+32o2vHkwB3Bx0PQ8 q2B3ATGtdjWN43GKtDuCgATRYYxX9WN/3+5ymcNfW03drAUP1Rv9N4L0IBpElDvuCcf3K8 nR48gtAokpRtg3VWUpnxjZhEEDVAaC+af/wFFzUmvOpIgRCIRgYDrA+sI9hNUdNiWXqEPA 7LAfo5sk3AyPHgVp2c52Tz3CJdJbOFQsgthuqH24+4Pwp7nGFes+0dIEfG9Sd0G+/UDE3r TkieSr8FVkgB7OJyzeFejKyGJzcHQRleEBewt3zHC2AFYANwbM7s1QC0e0cySg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RWdDN2bVSz6hd for ; Thu, 24 Aug 2023 09:33:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37O9X84d000712 for ; Thu, 24 Aug 2023 09:33:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37O9X83r000711 for virtualization@FreeBSD.org; Thu, 24 Aug 2023 09:33:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Thu, 24 Aug 2023 09:33:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #11 from Ra=C3=BAl --- Tested today's 'FreeBSD 14.0-ALPHA2 amd64 1400096 #1 main-n264998-d9fee1d02= 178: Thu Aug 24 10:02:38 CEST 2023' no changes. Tested also on a intel based desktop running 13.2p2 release, it doesn't exh= ibit the problem after more than hundred reboots. I'll try on the epyc server running older releases. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Aug 24 12:11:03 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWhkb2NVLz4r5Tt for ; Thu, 24 Aug 2023 12:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWhkb0WBlz3XFp for ; Thu, 24 Aug 2023 12:11:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692879063; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Y46ScfKu0jZZ+yiHKYwW/+Wcd2Qv41qCD6V5Zt6zaK8=; b=we80WqESavLtEXPZebKD+KsSpev6+uCGwcmXgyc+hn3VTZDXQssybPGeUE114+FhBwxI3y 8E+3h2dVDCw2RTNsQE6K7jvK+CB/UUlS6n6fNoobBjaAGSViRWMzblLhSvX3Tg5nyHE/fe hoe2UGEbOYNehccd3Bg3XVqIrCtVj6QrozoSMVxSScf8mJ+wGdSCcDoNAV9oSqUukGLPTF onpJ+E/yMrE0HFR8J6v0tp84eds4fliqMOXd1IsQBTKS2UjGm66/DbqHxYvPAn9vZnUkyP iI1zwJVrbk9iwugpoQn312tinIMEnovwq3kLof+gvYJpsAbfARyrmXCaUddrLQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692879063; a=rsa-sha256; cv=none; b=X89d5pxSBBZHeaHoJlqioZohZbjzfR4si41/IM4n9cv0h000y3DhnLq6GgAdTjwftvHE46 +WeYWL1JHd/jR6MoFxZoSWBeB8LisaednIg7ehZjbw0cDGZ5n4eeJdi6LOf6hBR9S+lz5o LgXBybbPahm5/0bAGSGkoVEIshfg3vUhcnopvQwD8xOqrvEewUtyudt9mFPoxeWoUhNzsF fntB37333YyWpn8BJbXWOR5WSh+Lygsfu/qmOZAFoAEbk40XZ5hVkEi8FJ8d4BL6Mh49nY M4j9k2EXN+3mTx+cTfpSo+lIwFc0kyadgh/O8Rni3XSzHRN99RczNuGCftxnVA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RWhkZ6j3DzBv9 for ; Thu, 24 Aug 2023 12:11:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37OCB2EG040459 for ; Thu, 24 Aug 2023 12:11:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37OCB2Qv040458 for virtualization@FreeBSD.org; Thu, 24 Aug 2023 12:11:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Thu, 24 Aug 2023 12:11:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #12 from Ra=C3=BAl --- '13.1-RELEASE FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64' fails at boot 31. I'll trying older versions looking for a 'good' version to bisect. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Aug 24 16:47:52 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWpt04DbJz4rMPk for ; Thu, 24 Aug 2023 16:47:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWpt02L1vz4TMs for ; Thu, 24 Aug 2023 16:47:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692895672; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6JrFycy//Mbjk/n3Qa31d2pndTGuFoc/NPSxqLMkRuw=; b=UFeioIWjD/amczZ5+1rVeBlFJza+N5zsJ1h+JafKobOvFXy/9ug5NANcHQJ2xWDjpP7LiQ yJAVg+pcFEOratQgQOowScHfNqYvf7kDI/Qcut0X2jMnCiPrk/ZzpNocFdYZDGXWxtKL8l suGoIznWcNDZ59cLGHaPGWk8rPHh1EkHzwcjDCQ8FD0dH8WhaDxTwjIT38ldiPSTGIImQQ HdPtfm+h4wZDbgdRgjNq454WUGUV0gC2TlWw0/4uXS+MPxeNyFOsDfbpXUjJ85xYbZf+Tp nEXZohomvxgqFOsE1j+m6ciPAaWYAeeVcxNsXGI5c2YOiPvANuyvxgHy6dtEJw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692895672; a=rsa-sha256; cv=none; b=SkoBjXudDdhwVHpNL4+uyXyj9i9DRHATmsb0jUD96uc+qWHXgSiDQ/5gsvFQ4hgy5ecLAT i/RC2GoVd0kIZtvUK25Vhpcu3HnrklaVnaQ0PnOpteMqxMoh0dBdYPadSLLdXw67NiUXHz kEDEAF6te7fI0h68FAbHV4JI4uOnOu4Bnwns7GzhvqYH6w/e/wR+ODNiCuVO7oww8udtIp 2/jrP73JwD8vyv8rYmU1liQl3E+iePGmzQWUjv4b/0Glq4VM0s3sOohQdZmCONWUA0nZt5 lgCUrnzJfnSupL6KXboC1X6tNG82oZv/WgR4LQqGOo2A9uOqHOOfQ8QH5GH4WQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RWpt01PC8zZvk for ; Thu, 24 Aug 2023 16:47:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37OGlqq2071968 for ; Thu, 24 Aug 2023 16:47:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37OGlqsh071967 for virtualization@FreeBSD.org; Thu, 24 Aug 2023 16:47:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Thu, 24 Aug 2023 16:47:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: attila.kover@guardian.co.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #13 from attila.kover@guardian.co.uk --- (In reply to Ra=C3=BAl from comment #12) You might want to try something pre-12.2. As I've mentioned earlier, this s= ame problem is already present in both 12.2 and 13.0 (see comment #9). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Aug 25 08:26:27 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RXCj01KC4z4r3JV for ; Fri, 25 Aug 2023 08:26:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RXChz2zRXz3b9W for ; Fri, 25 Aug 2023 08:26:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1692951987; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Yl1y8uWtGNgslB5EwKBWt7JI/vvcXrkMjOXWEDYHvPM=; b=TAloch3Y3qlkb5ZGimVqnlqo48qKiJnd1xXRjfosJR7e+M5y8rfaO0/AqfgxOfaPs+Vtiy yw42M2JdM8oKBZFe381rgiWMP1mGtlgwqK/xO6gt2mrHMmMh1lqqkV4YqNUZ68zjaIlOWj 4SJ3klW4rFJByfYVxvzwWFAoKiqMDJQUbOOHaU1AVjQhC4K5r7fFVQjgE7oMkyoDdmr/Hb y3SB4RainFkYLbxmb+UULqymlJ26qcBUF8NvcE5j7grfnI01svqHW8x6WaVZRED62sDueJ 2BuPJVbr17mSXppzaaxgopktf6TX7NBdTV5Ms6Xyut3qAkAlATPxhABxuW0DPQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1692951987; a=rsa-sha256; cv=none; b=nabu1XTnYIZDKe8zxiHTCTuauraCUOY9QLcV0OnP/zARPakXU6A1M5s8p1LxT7on5HoQTQ iHrzj4t3RBq7VMCNhPXOoubfTV7Xx0I928yem9Q+9anVSC9Mm1hE/PR6DNFEP6hrpcIUKX a46UCqfc02vFKQmDMi41fElMXtLagrfDfTCU43OgOFnaLRXW/6UAyaz5ozq1zQT01pLGVL zYInU0aTuXmf2wtBxXW23AsmsP2Gvl9Vd7lMgbyPnsXMkuQPrNPoc6yOi/peAC5pyR82rC qkPgeD2V+BAobMg6Q5NZOH4ZdO1V5Gar843OznlGSNgqC4xTFzxokB4brCocuQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RXChz15mWz11xC for ; Fri, 25 Aug 2023 08:26:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37P8QRtF050423 for ; Fri, 25 Aug 2023 08:26:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37P8QRmP050421 for virtualization@FreeBSD.org; Fri, 25 Aug 2023 08:26:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Fri, 25 Aug 2023 08:26:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #14 from Ra=C3=BAl --- (In reply to attila.kover from comment #13) No easy way to install, given the circumstances, 12.1, 12.2 and 12.3 on this box, installation fails after boot. It look's like it misses installation m= edia from (a DELL IDRAC v7 on a PowerEdge R7615) virtual storage. No physical ac= cess nor remote hands to locally plug storage so no quick way to test that versi= ons. On 12.4 release, passthru fails at reboot 32. Intel desktop continue rebooting the vm with passthru fine since yesterday, 2377 successful reboots right now so no problem there. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 26 15:24:32 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RY0wx4Z1nz4qfP0 for ; Sat, 26 Aug 2023 15:24:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RY0wx3Qhrz3QHk for ; Sat, 26 Aug 2023 15:24:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693063473; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Qgq2XeN86JONt61cS49wwPo07cCbXGSYoGigFcbGBZ8=; b=CJAsd/nSyctPOT/QZINcE4dDiJ1wl4qs5nfexUku/y0NDOM5/C9n80gTFS3EFgGiYWzEji wFaPH/l3lnrpALVC/ooPx1eaizImoEcWSj2O3YQOajGJMmiJhXGTYlzOq6tBwKA0pbSYIL YfM8yEP8+aaL6OzpLGn7oVBN7i5YlRhJNrhL17ucIwkeZkxjeT2qIdBTklaqp+2iHHAVPB 0dCm+evLLn+2ldzMZ56ITR8aAraqb19LSqdpk9TE+O7WJJnBlZ8J9THhlRlgzn8v7QNRck MyHlYFmghdtnCnU0E9FgV5q/4fce38weC5FsQ4tbGU50VK9gHlIfLYJHnR3UXQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693063473; a=rsa-sha256; cv=none; b=yiQOmIhYcI+Zcr9Kn/r+ZqI13dY03jhZv2hQxDjap0rUWUEmBQ8pr2ACYql1arMchWQz0o ovfQZBJFStD4MBUkds7fF2lDnInZhUv84lPtvVVUU4M3sYAbSNMllaqeRGM/dSaNzLxdGM WHN4BVGtDNApCThmcqjZpnY2UhNgU8FuWWVNb9a7xLoWnPteKQmpTxUVf0VilRoPq6Suek 0sTGSmRMC5yn4au8bHLrDuLUZ7R6Do6jVTBajGPLrzGg8Ak5SKSu7ocGD4wdK1MYSYDX8T +WRULQzzlJBpjd/mY13+iaN2JM8oxFCioqiQQ0O1/QTenXq8NhbeXDRRHSJvrw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RY0wx2SP2zfsJ for ; Sat, 26 Aug 2023 15:24:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37QFOXtc043861 for ; Sat, 26 Aug 2023 15:24:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37QFOXrG043860 for virtualization@FreeBSD.org; Sat, 26 Aug 2023 15:24:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Sat, 26 Aug 2023 15:24:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: attila.kover@guardian.co.uk X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #15 from attila.kover@guardian.co.uk --- (In reply to Ra=C3=BAl from comment #14) I've pxe booted a diskless box with a fresh 12.0 and installed vm-bhyve via pkg. The problem is already present in 12.0 A short snippet from the serial console log of the host after about a dozen= vm reboots: [CMD82, off:0x540] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD83, off:0x550] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD84, off:0x560] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD85, off:0x570] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD86, off:0x580] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD87, off:0x590] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD88, off:0x5a0] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 ivhd0: Error: completion failed tail:0x660, head:0x30. ivhd0: Dump all the commands: [CMD0, off:0x20] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD1, off:0x30] opcode=3D 0x3 0x10 0xe 0x7ffffffffffff003 [CMD2, off:0x40] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD3, off:0x50] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD4, off:0x60] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD5, off:0x70] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD6, off:0x80] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD7, off:0x90] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 [CMD8, off:0xa0] opcode=3D 0x1 0x3b72829 0x0 0xa5a5 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 26 22:31:33 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RYBPd68Q0z4r7Dl for ; Sat, 26 Aug 2023 22:31:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RYBPd3j7lz3DCX for ; Sat, 26 Aug 2023 22:31:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693089093; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=XgSj7YFDSehw7ISKXT7I3I/IZeRNZ7WlolT6pu2qBgA=; b=qzAKpcOqKzuY1ecr4/Ke9SFBsy3BRNEfqQQqGI8U1s+JQiqETJs1BPC/AtotL4BqLCQKsB JtGpmsJDqE2A+jipkPoLaWla7Q4R3zOpMZHMRbWZ3yoEzhP353E9/wblBqOvLJyqUQcNGy UO/CCS7rJPTHdzuWq15Px3e/0dVXNFinHDS35ilQXS/qAUPrgMgfpThJ/s77V+gGeGYghG zrWl5U4o8R4JbhxshYGR+I3s7xNIR9FUNvReu7GX5yuhxRatp6wIbHW24GhpriKiMkakn3 sOrZyCJZOnNkPhFJ0osAnBk8J8dXahER1KyS3E4c2UArudaSN74ABQoCiT20PQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693089093; a=rsa-sha256; cv=none; b=xUNRHT6hmu5BZ/8s+8NfEq0fFRwfGjpiIzuhRoKqLudLFP6A8Nao+vpTV6EnI7CnLM5ygT Mbp+m+D9EwzJ3nw/GTgr2YKqI2wEr1Wur5MgsTpShFmiTfurU6WqCWSfwmbt0CFD1xughh k14cewUIH5l9GsIz2TZ9z1TziWaaFM+5Q+Y98GT2w8mv2M0fFxf9TS48eeuUgy0jaAe+IG 3H6kZMirJgrh5OUbB744MQh2l4Gqpfs+hk289LOjqd6jaJMW9+jdcyueSgn87VT9mjxs5q 2uf+OfaC4Noy0EmGxA2eiwZhq+7c7MFWifOUVVnqCtAX+EaD3LawH3llSA2n5A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RYBPd2pHTzsWQ for ; Sat, 26 Aug 2023 22:31:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37QMVXDV069793 for ; Sat, 26 Aug 2023 22:31:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37QMVXeU069792 for virtualization@FreeBSD.org; Sat, 26 Aug 2023 22:31:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 273372] SR-IOV Networking in Bhyve Causes Chelsio T520-SO-CR to Fail on Host, Kernel Panic if Reset Date: Sat, 26 Aug 2023 22:31:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mark@markmcb.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273372 Bug ID: 273372 Summary: SR-IOV Networking in Bhyve Causes Chelsio T520-SO-CR to Fail on Host, Kernel Panic if Reset Product: Base System Version: 13.2-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Many People Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: mark@markmcb.com If I setup SR-IOV for bhyve using a Chelsio T520-SO-CR network adapter, sta= rt the install process for a FreeBSD guest, but shortly (maybe a minute) after= I load the driver for the pci device in the guest, the network card stops responding in the guest and host. # Relevant /boot/loader.conf vmm_load=3D"YES" nmdm_load=3D"YES" t5fw_cfg_load=3D"YES" if_cxgbe_load=3D"YES" if_cxgbev_load=3D"YES" # Relevant /etc/rc.conf iovctl_files=3D"/etc/iov/cxl1.conf" vm_enable=3D"YES" vm_dir=3D"zfs:zapps/bhyve" vm_list=3D"" vm_delay=3D"5" # Relevant /etc/iov/cxl1.conf PF { device : "cxl1";=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 num_vfs : 14; } DEFAULT { passthrough : false; } # ... # VFs for bhyve VF-10 { mac-addr : "aa:88:44:00:02:20"; passthrough : true; } # ... ### pciconf -lvbc in host ppt0@pci0:2:0:49: class=3D0x020000 rev=3D0x00 hdr=3D0x00 vendor=3D0x1= 425 device=3D0x5807 subvendor=3D0x1425 subdevice=3D0x0000 vendor =3D 'Chelsio Communications Inc' device =3D 'T520-SO Unified Wire Ethernet Controller [VF]' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 32, base 0xdd00a000, size 4096, enabl= ed bar [18] =3D type Memory, range 32, base 0xdd060000, size 32768, enab= led bar [20] =3D type Memory, range 32, base 0xdd194000, size 8192, enabl= ed cap 10[70] =3D PCI-Express 2 endpoint max data 256(2048) FLR NS max read 512 link x0(x8) speed 0.0(8.0) cap 11[b0] =3D MSI-X supports 8 messages Table in map 0x20[0x0], PBA in map 0x20[0x8000] cap 05[50] =3D MSI supports 32 messages, 64 bit, vector masks ecap 0001[100] =3D AER 2 0 fatal 0 non-fatal 0 corrected ecap 000e[140] =3D ARI 1 ecap 0017[150] =3D TPH Requester 1 Use vm install freebsd-test FreeBSD-13.2-RELEASE-amd64-bootonly.iso Config line for passthru: passthru0=3D"2/0/49" Connect with vm console freebsd-test Installer starts, choose shell. ### pciconf -lvbc in guest, prior to driver load none0@pci0:0:5:0: class=3D0x020000 rev=3D0x00 hdr=3D0x00 vendor=3D0x1= 425 device=3D0x5807 subvendor=3D0x1425 subdevice=3D0x0000 vendor =3D 'Chelsio Communications Inc' device =3D 'T520-SO Unified Wire Ethernet Controller [VF]' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 32, base 0xc000e000, size 4096, enabl= ed bar [18] =3D type Memory, range 32, base 0xc0000000, size 32768, enab= led bar [20] =3D type Memory, range 32, base 0xc000c000, size 8192, enabl= ed cap 10[70] =3D PCI-Express 2 endpoint max data 256(2048) FLR NS max read 512 link x0(x8) speed 0.0(8.0) cap 11[b0] =3D MSI-X supports 8 messages Table in map 0x20[0x0], PBA in map 0x20[0x8000] cap 05[50] =3D MSI supports 32 messages, 64 bit, vector masks # kldload cxlv t5vf0: mem 0xc000e000-0xc000efff,0xc0000000-0xc0007fff,0xc000c000-0xc000dfff at device= 5.0 on pci0 t5vf0: 1 ports, 2 MSI-X interrupts, 3 eq, 2 iq cxlv0: on t5vf0 cxlv0: 1 txq, 1 rxq (NIC) ### pciconf -lvbc in guest, after driver load t5vf0@pci0:0:5:0: class=3D0x020000 rev=3D0x00 hdr=3D0x00 vendor=3D0x1= 425 device=3D0x5807 subvendor=3D0x1425 subdevice=3D0x0000 vendor =3D 'Chelsio Communications Inc' device =3D 'T520-SO Unified Wire Ethernet Controller [VF]' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 32, base 0xc000e000, size 4096, enabl= ed bar [18] =3D type Memory, range 32, base 0xc0000000, size 32768, enab= led bar [20] =3D type Memory, range 32, base 0xc000c000, size 8192, enabl= ed cap 10[70] =3D PCI-Express 2 endpoint max data 256(2048) FLR NS max read 512 link x0(x8) speed 0.0(8.0) cap 11[b0] =3D MSI-X supports 8 messages, enabled Table in map 0x20[0x0], PBA in map 0x20[0x8000] cap 05[50] =3D MSI supports 32 messages, 64 bit, vector masks Shortly after loading the driver, I lose networking on the host. dmesg shows nothing after event # ifconfig looks normal cxl0: flags=3D8843 metric 0 mtu 1500 =20=20=20=20=20=20=20 options=3D6ec07bb ether 00:07:43:36:bc:80 inet 10.0.1.201 netmask 0xffffff00 broadcast 10.0.1.255 media: Ethernet 10Gbase-Twinax status: active nd6 options=3D29 # ifconfig cxl0 down # ifconfig cxl0 up # Aug 26 15:21:11 core18 kernel: t5nex0: command 0x16 in mbox 4 timed out (0x4014c010). Aug 26 15:21:11 core18 kernel: t5nex0: mbox 4 cmdsent 16a0094400000001 05dc050000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 Aug 26 15:21:11 core18 kernel: t5nex0: mbox 4 current 16a0094400000001 05dc050000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 Aug 26 15:21:11 core18 kernel: t5nex0: encountered fatal error, adapter sto= pped (1). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 26 22:35:52 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RYBVc5qRhz4r7FY for ; Sat, 26 Aug 2023 22:35:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RYBVc32Cxz3DqS for ; Sat, 26 Aug 2023 22:35:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693089352; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7zavGxKjmFTKj/7G/1lxzOt3OL/hhVvU5btuV/NQ4UY=; b=InUF22Veom5tjfKlobuGAO+S03FYjg/pkXMYCJyJeGL4GIB1FcuoQ3XPeoOQANkHDH+EqE sGmj8fEwhBgcIrOwCS9OINXtZRdohVgekniL38DPvQxz9XTVTQh0sUePRlj4slAs/1m1p4 Hta8M1qeBWYg6qfL+J7KNxX3BWoFuLxIk9Y7PNgXFl1N8Xhx3pYuvaA/BgKe5wtIkf3ZHF bjT0oslQTYu/VgbtRGxggZ5wa96FPPttglMgYH+hBDRfD5FkHt/phI7fHYGT15EYcznQp6 gp2r0/pQiMIZUFJG+WnrjyAH/qMqcdAjd0Ar6eOa0teKRSx9qfUMRvifuiWf+w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693089352; a=rsa-sha256; cv=none; b=dMbSTANTtNZoQdg8AHwEVHcsUEIRP4SGAU1zMOf1XKeOkMJCHyUQPbIqNxfDGMKYxOEdOf Ou+mzy1PwCKL8U+bTwKjbw6PACBvhsZmpbiT0bPONC8H+NsYEECeACvnlNpWQtKN3mRNih sMbsqnHnuZq/t4d3JPwt+6tvU9hDuSxtwBqkIY/mjfEVm9CySWzWhKDFgKCbXahD4e4kZ0 v1dzmCk8Sc1QcWKZ3WoWKvZvM9Mimvn2BPlYsgU0s+lmI80+Y/RrOLosSfofNSQYg+w9qq WU4Ej9mc4ZqUP/p9GMXbW/XIJOCnC/tId7Y1BFQSj6YkfKIHTndDYkpTf9PA5g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RYBVc1CY8zsQQ for ; Sat, 26 Aug 2023 22:35:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37QMZqRP076790 for ; Sat, 26 Aug 2023 22:35:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37QMZqvE076789 for virtualization@FreeBSD.org; Sat, 26 Aug 2023 22:35:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 273372] SR-IOV Networking in Bhyve Causes Chelsio T520-SO-CR to Fail on Host, Kernel Panic if Reset Date: Sat, 26 Aug 2023 22:35:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: bhyve X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mark@markmcb.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273372 Mark McBride changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |bhyve --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Aug 26 23:50:08 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RYD8K0Xy7z4rBwB for ; Sat, 26 Aug 2023 23:50:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RYD8J5Z6cz3L6K for ; Sat, 26 Aug 2023 23:50:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693093808; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Pviy77cqGpbscwTj1qjdFNrw/wOpHYdYTwAPnLffJxI=; b=EG5b0rs+LrMTe59wKD092I0KrecOmD+nQ7Ry+1AEdUJczW/q9FFNMtvkNyBiAw4pNnFWWp lDAQb9o2+VeVOXVxKXAVsWDyUO9V1oG3o/0YQfrHDoQRywy59dekVf/CKUtvdQi9J3txU4 W+BkUIzHAG4duV4XPNHa+5BhnDzEn2ZPPdE21uxA67BWc2Ff/avIWumz3QvINqB+E6SFsQ QhoHepej6mmyXfRsLk3NGOFKt5WCv06FUkuBog5RaamQQnDoz+3yOQMjvbcjaQ12IhsHk2 Fl7IgLkzAMd4B09YIw71IF+OVekaXv6g4bMdT+qeVicpHTi+MsF5A8Ieb8eBDQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693093808; a=rsa-sha256; cv=none; b=j+QMzoULagQFLtLVd41P87AMEiPr2cISCP8NuHXb3JDkCjrhTEhSHqFxFUUw5JGW2ZalM2 9q2mCsbIve/04MpbOChsyxZyz6A1fQeuR2S9bPEKyhNaVvDdGEkNpiyrbM5VUAgFXjvTc7 UZZmKuNmzhc5axVTI1MGUMPgNXLQLenNqLL2623P0MNlKtPLHQp1vNcHPcs0BxnXa4AEvK uFlpoHjca673xJBx/Pbz+ldhsGYOumywDQIeZ5kS+I3mxT9zg6CHk9iKczKrHMYlYJdi0s w2dZ1S+VsEY3aJU7YjBcHh9LvttLyHhZlhEXNzDq1DJMKdTW85+OGVZUzL1mfQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RYD8J4d9mzvF1 for ; Sat, 26 Aug 2023 23:50:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37QNo8Dc074312 for ; Sat, 26 Aug 2023 23:50:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37QNo83F074311 for virtualization@FreeBSD.org; Sat, 26 Aug 2023 23:50:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 273372] SR-IOV Networking in Bhyve Causes Chelsio T520-SO-CR to Fail on Host, Kernel Panic if Reset Date: Sat, 26 Aug 2023 23:50:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: bhyve X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mark@markmcb.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273372 --- Comment #1 from Mark McBride --- Tried with 14.0-ALPHA3 from https://download.freebsd.org/snapshots/VM-IMAGES/14.0-ALPHA3/amd64/Latest/ Same results. Driver loads in guest. All seems well for a few seconds, and = then the all networking becomes unavailable. --=20 You are receiving this mail because: You are the assignee for the bug.=