From nobody Sun Aug 27 15:48:50 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RYdQV46YBz4rLrT for ; Sun, 27 Aug 2023 15:48:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RYdQT6WbWz4HSH for ; Sun, 27 Aug 2023 15:48:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693151329; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=27pLtVF51+bjpk6G5EHvkm/UEPwSe67aTHkn4h69mlo=; b=AoZT2q7QzhT3JM3t/VM57tCVQtkkLJiLfQX+F71Myjd0ZDBkA33Kn/0A/drIf+THIw98U2 k3oHQq0g1QX7BZS6UhuLCI4syluNdCcU3JkCVfFUmdqJeZmB0SS0/4WKiB3x7hekUzEfmx piFDCIl+DopvKfWBGIbC7s5c2QTb03/Ntt1oePVFW8UYaSX7JcaGxMKCPyF17fPPL9l7XF YpZ7mb4pchtjQlP9zcv1AyMccK17IjrQZyn2Va3vbMMG6uMphFEbFMNPnHTYU8oEgeOrMn GsteESHyOAML3z/d1bjM3NG0cr1dUktOa+d9MJLFeL1lm1nNKyPTbkZudUG0Yw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693151329; a=rsa-sha256; cv=none; b=Soh4LlJ77gqzNEZaJqtJqFcj2fPvmdIrghXn5R9QDaivDY9lqUwfOPSFRVBAcybLf7IOTM Ugc0doNAflX1TZu/P6VMX9PjQCyw+S1dYro4hKVaHupWTEOU4zbCAmKXqgDCCC5Taj+dJD foQeRQbV4y45pDJPI23TfnpG87dxoZB9D2NJdvcm2C3M/iV8I9VEx3T0YgsJgUh79tR4pi L6FAXIPsVxKoIEQEk52iqgORaHgwgwN7sT4LAG2xSiIbmwzKHq02qHx4hIwWpKD5n81MVt tDR7wtj7AFHiAYmUnvVjh1Bop+xX7QAjBJHp9UgxBwGamhh5BXHy3LX/faXTHg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RYdQT5V0szY81 for ; Sun, 27 Aug 2023 15:48:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37RFmnxq067493 for ; Sun, 27 Aug 2023 15:48:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37RFmnSd067492 for virtualization@FreeBSD.org; Sun, 27 Aug 2023 15:48:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Sun, 27 Aug 2023 15:48:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sm@codenetworks.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 Santiago Martinez changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |sm@codenetworks.net --- Comment #16 from Santiago Martinez --- Hi Raul,=20 I'm seeing the same issue on AMD EPYC proc. Checking on kernel.org (Linux) seems that they also had issues with AMD-VI. In the Linux world, many people are using iommu=3Dpt to overcome this. This is also a known bug on Redhat K= B. I'm running a script similar to yours and the server behaves quite erratic. My script does the following: - Start and stop 200 times a VM with a PCI pass (in this case is a SRIOV VF, but it does the same without SRIOV, or with any other device, non-network related). - After that 200 times, it reboots the server.=20 - When the server starts it runs the script again. Sometimes, the script can start and stop the VM 200 times, even if I see IVH errors (command not completed or cmd error), and sometimes can only start a= nd stop the VM once, and the server reboots after a few IO_PAGE_FAULT (somethi= ng gets corrupted and the NVME stops responding and machines reboots after com= mand retry-timeout). The server showing the issue is a SuperMicro H12SSW-NT. - AMD EPYC 7552 48-Core Processor=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20 I have updated the BIOS to the latest release as on the Linux forum they mentioned issues with the SP3. Michael Dexter and I also tried to replicate it on other AMD processors without any success. - AMD EPYC 7702P 64-Core Processor - AMD Ryzen 7 3700X 8-Core Processor=20 - Ryzen 6800H --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Aug 27 21:00:55 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RYmLb4hMKz4rdKn for ; Sun, 27 Aug 2023 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RYmLb2TwYz3GRP for ; Sun, 27 Aug 2023 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693170055; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=heZuG6tyLBhe414eqlAbGAPcpKIlJR8cZ5y24V9B7Gg=; b=x5sCrEw2MAdLnJgDMNS+w/iMPt2orgdJ9hUphb0p4YlMKTooqdi3VTHE+J2U2YLDdhpirA GXtiLt9txyBGlpJGyDYxnyRJ+kZiIIvFzqg5mu0K19gbFhqaiO0LXLmvbyH6nIiBDLpzpN KOLHPmS/dE+W/qk5Av5T6d/h3j1UoPgWQcgaaeNkQ352vsJ3cPqzr7g1Iq4HNiTwQmpFDd 4/GpILlHIXA747/XKc9vsKjsfbYPZYJwaB6fgAJJ79xQRVjUj2EaXJf7l5b65CSrbQQLjG 6H8que1LDOkpwI+DBVT/5kzOo0dlfJWAW//tsiwkfP6wlW3XgVB9EyM4wILQsg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693170055; a=rsa-sha256; cv=none; b=igZ9QkwKxa8eG+gEdGN92CfJUpk0sLdPuPc21Ic0mxc5jGYJicIbeUCgzP/GxzXfGS/sWj CI64v9+FSkurh3bxIz5uG5yWqWEtlmq7sDVZ6EqJGDoT1gdI1TFpUTTeKOcoviw2HpLuZB EMaom6VejvoRfiyFgDAnM8XC71eDh4meeaeq7qK8+nRkQ+Sr6SU0rfI/S1atN+XbXRBbkm 7oq1b6R2S7T01rja+cS+mL79IxAZcvU7zB1BXn3l5vZypHeBYw5nXlZuwFI24lCOHpKsYZ +iowhSeb8ADlUm/yoWedlJPoNPoV14H9JcIyo7SJN6sDGTdPvZbSrzWJe3x8tA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RYmLb1YWTzhq1 for ; Sun, 27 Aug 2023 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37RL0t4r022989 for ; Sun, 27 Aug 2023 21:00:55 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37RL0thp022988 for virtualization@FreeBSD.org; Sun, 27 Aug 2023 21:00:55 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202308272100.37RL0thp022988@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 27 Aug 2023 21:00:55 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16931700551.48EafF15.20175" Content-Transfer-Encoding: 7bit --16931700551.48EafF15.20175 Date: Sun, 27 Aug 2023 21:00:55 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 247208 | mpt(4): VMWare virtualized LSI controller panics New | 240945 | [hyper-v] [netvsc] hn network driver incorrectly Open | 244838 | "bectl activate -t" does not honor the -t flag in 3 problems total for which you should take action. --16931700551.48EafF15.20175 Date: Sun, 27 Aug 2023 21:00:55 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
In Progress |    247208 | mpt(4): VMWare virtualized LSI controller panics 
New         |    240945 | [hyper-v] [netvsc] hn network driver incorrectly 
Open        |    244838 | "bectl activate -t" does not honor the -t flag in

3 problems total for which you should take action.
--16931700551.48EafF15.20175-- From nobody Mon Aug 28 11:53:18 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RZ88H4Lwcz4rT1Z for ; Mon, 28 Aug 2023 11:53:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RZ88H3JqKz3cbH for ; Mon, 28 Aug 2023 11:53:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693223599; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cuSE/uEagdqvuhfM9SoSYecWs0E6CHmjA4WqlkW+kj0=; b=xNj1a6VqgKPt8u6ZjKVqTOsqlRxhydEBHYLOeLMqWVbSpUY6pHzS5qUty7fUbK5TWlPdKY xOH/qYLbzVs6rcMLfloR+w6uOq3pYwvHjya1vxRnGDZl8962dt7zd5p+L+l1vGDwtwBeoQ 8VOySICm3FdZrzuakbc+KIKKQfuxdhx1I0u9essRwhLPrEq3aNOtRFibRA4s7s1nbObSO3 gGIMYjh0stmnhdWYaJ3YtF8Y1pef4lZZFkEN7Te6UDOjSI70S7OsZMgVAd8CwKsPCMNs9M 6l5XtWsEMTojevzrhCNaRa7AY0RrleNFYI3b+zq/hMY0WiwtIG2BlzWkUfLOoA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693223599; a=rsa-sha256; cv=none; b=Q/wsS+Fwpi/HmdVUKl5QSCHYexg04iDaDGH4nmpp0WxGiSc/bZyZSunr4KGi2wIXxin/3g yCRhepzM91cF/IveY4JgWXmggozK0T42tN94XWseJXt/817lDB1UDIzj57SwAfBPpBiaem JWQVWcnVyyW/i328gsOesHcYS7kXRLJBh9oh6uUyxa28HKaFHlck7Bk5Hp/e1Tb8mkACQ/ 0BvTyuiJiRjlYYPqllBW1qTOcZZD9M6fQKkH7yQDM1FHihbyyg70J2iVuxvN61UcT/A6Xy vhIwTEREpwPP0dwQ0IS7lRDli8rTLCfRUg1FxeKcvjXVSNAESqzYBzzYMiOA9Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RZ88H2NQcz16S9 for ; Mon, 28 Aug 2023 11:53:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37SBrJ9p012247 for ; Mon, 28 Aug 2023 11:53:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37SBrJ6Q012246 for virtualization@FreeBSD.org; Mon, 28 Aug 2023 11:53:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Mon, 28 Aug 2023 11:53:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #17 from Ra=C3=BAl --- (In reply to attila.kover from comment #15) So no good known version to bisect. Thinking about my initial statement, 'since 13.1', it's evident that was wr= ong. What I think happened at that time it's that we started moving from xeon e3/e5/e7 to ryzen/epyc. Maybe passthru has never worked fine on AMD :/ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Aug 28 12:40:16 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RZ9BS2dLTz4rW3M for ; Mon, 28 Aug 2023 12:40:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RZ9BS1bk0z4Dv0 for ; Mon, 28 Aug 2023 12:40:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693226416; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Kbs2KgeSKPtgkL9VqIVKBUi4ocU6ckGYKOrtHFoHv6I=; b=dXjFvvWL0vevDnrdGi9sVc1LpcwRPOShqEckCzkLxmt1HxanM5Eah94V8pzE3KKfIA3r3u OX+uKzu1EBkZM7BNPPiA7lUnay+nT+jYxeh+hcW0xRvWY/0ZY35K6DsKVDFw/G2X4Ts77X NY5e220tYL1K//lmFgfR4O6WDyN9qv1EkHWgrud80Qp+jMApuIfXQ1yG+Ch7a2kyqcpGTE L/t7GG5EVl3OoImlWJcXBARkXjXsm/FwHGX1v1qG2QCEE6yKkKK69vrrKtalSU+wWXx3JH M5p+AMZ+aMXfiA4FkrLPj/IIavWq7RRXZrWw+Ug2IOhgPykbLdvbKr3HZaok8w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693226416; a=rsa-sha256; cv=none; b=qrEkxnYlZD46sJM6heAQSqwM4uAiPMFYMDG4Myqlkf+K7tc4bKAa7KlWr8IU/lyKGPlqNm 9hH/sGbakT1vvTWbiDzh+sO1njCvyztf84Bmg4PqsqP6CThpUuI1KIhKMneW62CM3fjtmw 2oM+X+mzQhpJL1H5IEbjeJxyafSOClWCAI7BCBcaLCaeMl0aVYGxjFq92TzbvLOwgSb2GX Uc0uTL2eHIzGLHKQT1upSpB0tMfFPk53AO0CrEte4/YkIkDh/pY/LrkU58FVqMxQ5y0O3t lPeriXtcKt93O5HsgiFbpgBczJX18+7C98ojP2EhHYq0W0gz9rpKLFQ4N4s+Ow== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RZ9BS0Xcjz17cJ for ; Mon, 28 Aug 2023 12:40:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37SCeGTe075642 for ; Mon, 28 Aug 2023 12:40:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37SCeGvd075641 for virtualization@FreeBSD.org; Mon, 28 Aug 2023 12:40:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Mon, 28 Aug 2023 12:40:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: raul.munoz@custos.es X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #18 from Ra=C3=BAl --- (In reply to Santiago Martinez from comment #16) Hi Santiago, never thought it can be processor related, I've seen this problem on a 3700= x. Two hundred successful reboots? looks like too much without problems. I'll try on a 'AMD Ryzen 9 5950X 16-Core Processor'. About strange behavior after reboot, on that 3700x, changing lots of times sleeping time between pooling on a Mellanox mlx5 VF from a linux guest (ubu= ntu 22.04 with nvidia ofed driver, dpdk 23.03), the adapter stop working after a bhyve host reboot. That reboot was not related to that interface, was worki= ng fine. After reboot, no errors at all, neither on PF or VF, but no ping anywhere. Rebooting again didn't solve it, reset button did. Something happ= ened that needed 'hardware' reset. Nics nowadays are too smart and alive XD. May= be something more to consider on this problem?. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Aug 29 12:20:48 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RZmjX759wz4rkdh for ; Tue, 29 Aug 2023 12:20:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RZmjX5PCvz4tJD for ; Tue, 29 Aug 2023 12:20:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693311648; a=rsa-sha256; cv=none; b=VMClqCKkkaG/OfrSBLQszkNeIZVcDZJeJPO/0rSxM4XUlG1CmfPrgtElxX+0/cuNWBieJl myH+RKlhHeCqrwpAYwY/2s+thmFo2K0SM4LrjgIClx6x5xYVAn4SosjIxS1nia1iaf9p47 jdp+vorFgtr4wf1UIcS0Z7g5M3Me7ftKAH5YJ5uMr9DfkM6nwqhmVY8wAJZGClIDKkjxvS KwiKePdRAtPvFk7cRTEy+cEeI1QmdxRTWvJ1+rXSrLGj1jAeGyUESnlRCbQc8kaRrJK3px YECzMVHCccaiG2wsAy70rBZCfm81ssONFVvNaZPuDcp580NK1q+mbTX/OAccOw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693311648; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cryhGqyM3GDq0TFeAsVqE1Gf9kwxJnnKt8jqZkTF8kM=; b=Kd9WR8zvzodDCyPtvMa2kVbN1xOagbbQH8OgKOGA6MEOnWVg/Okn8uzsL0c9i/KK3W7/0+ Pa4FWSgXQvMxgzeneXEdrZh0pvOV3hpvZAYmQSMy8JhtI5gHf9HYWLrORUiLxzPV7BBCN5 j1yivK9zNZzNqzsQ5PrTLlgUNjTKfNfajN/Tc6BYGfWS5+bJMtMdwQbCH7/iMuJT5brsSe +T7Vc4oGpCb6lB16V2hAwPtBM/+x+jxd9ptauk0vhMQ7TAoieDxGs3ynLm5J8NzOQB3iyB OtR/dF+5Qn/1Zs8wKgV6Xhq7qhdAI64MTRnXkvtN2HscYERA9hQbf03cZYWfAw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RZmjX4QbrzrWs for ; Tue, 29 Aug 2023 12:20:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37TCKmOn090000 for ; Tue, 29 Aug 2023 12:20:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37TCKmP5089999 for virtualization@FreeBSD.org; Tue, 29 Aug 2023 12:20:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT) Date: Tue, 29 Aug 2023 12:20:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sm@codenetworks.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D270966 --- Comment #19 from Santiago Martinez --- Hi Raul,=20 I got another AMD EPYC server failing with the same error.=20 We definitely have something broken with AMD and IOMMU. Santi --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Aug 30 08:18:29 2023 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RbHHV2Bbcz4rryT for ; Wed, 30 Aug 2023 08:18:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RbHHV16Vtz3H8l for ; Wed, 30 Aug 2023 08:18:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693383510; a=rsa-sha256; cv=none; b=urKcWv7DT/CuvULvjn9JFc0+116I7ZWaBTZr0RrONv9U54q0oYp3ef9GCDsMo5QKiQtmI9 GN9x6D6krmitrib2ydnvnCvY2G8s1NWJmh3/dbrMVUtDeyn07JJhS6KdF9cZvOF543PgZH VTf1J2kMhepQVyHkZbzReZgmQmuMh9EOj8g2Nnfoxr4It5GQnRE5FmI8nb2wE3qpNHrA1n COJvPGVjXWx1dgow1iG79V7CoDUqhSYT+GcMuttUTAyRWlbYEJdAu9L7BSF3aHhPE75Mr+ OD5N7DTKmkM6yNJcSFsRjOOus09nNjIOoP/Uiylwxuvs3RIHZDDmM0LuXkehqA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693383510; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cr3gUHw9n10eftVthOlG5zeJtBLcEatThjHSaMildmo=; b=UBP2nwUynLzhSEDFotU01JJO0uq3IJuvFYaRIRLLMsHhoUYfdYQcAZHNhG8rwONrkwqPsW SJuze2X8w90zAnscbz5vR8/GfAJH7Pz5Vi7OEU+0V2wBd3T0CeaKUp56QT3cXZfCwB3qjU Tea5u+3U3hYKMdQ3FEf9LYOPcVu4+cG7DorDLU1N6DT7gCxFU37OEVSKJAScDYuk6QmV6w UvltHU8Y7yMAvrO/M5+3ihK4gC96nvFzf3L+BwJpsKRZwpbnZWTwG9m+r+KoNij8h66v9e d5uhVW8lB+13MuUi07td5Lb9wlujNFigSdMAlVVLtv6bD9qTvoihJ+j6XIL5Bw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4RbHHT70nDzC1s for ; Wed, 30 Aug 2023 08:18:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 37U8ITUY039802 for ; Wed, 30 Aug 2023 08:18:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 37U8ITbN039801 for virtualization@FreeBSD.org; Wed, 30 Aug 2023 08:18:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 263062] tcp_inpcb leaking in VM environment Date: Wed, 30 Aug 2023 08:18:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: t@ida2.de X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D263062 t@ida2.de changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |t@ida2.de --- Comment #13 from t@ida2.de --- Hi, I've got a related issue: * Hetzner VM with AMD CPU * FreeBSD 13.2-RELEASE-p2 GENERIC amd64 I've set up a mailrelay which uses rspamd for filtering. rspamd heavily uses DNS queries, therefore unbound is installed and running. For now the server already has stopped working three times with: Aug 10 07:25:38 mailrelay kernel: [zone: udp_inpcb] kern.ipc.maxsockets lim= it reached I guess the DNS queries are the reason for this. I've just rescaled the VM to Intel, but still it's Q35 chipset: # dmidecode -s baseboard-product-name Standard PC (Q35 + ICH9, 2009) vmstat after the reboot says this: # vmstat -z | egrep 'ITEM|inpcb' ITEM SIZE LIMIT USED FREE REQ FAILSLEEP XDOMAIN udp_inpcb: 496, 256000, 58, 12646, 5519436, 0, 0, = 0 tcp_inpcb: 496, 256000, 47, 465, 1146, 0, 0, = 0 udplite_inpcb: 496, 254671, 0, 0, 0, 0, 0, = 0 If problem persists I'll talk to Hetzner support to change chipset to i440FX and give feedback here. --=20 You are receiving this mail because: You are the assignee for the bug.=