From nobody Wed Mar 6 15:10:14 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TqbTM20Qkz5CllB for ; Wed, 6 Mar 2024 15:10:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TqbTM04tGz4XFM for ; Wed, 6 Mar 2024 15:10:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709737815; a=rsa-sha256; cv=none; b=uZGfUDqm9uE3LoZjDhEYytmAK0xjT4SBh/WcLjvaleAmZwdCBuijj5bPzVryE7vHrBzcBz 8rQY3ptklqbYshlPyzG/rJqKXqwIwOE+6bqxQceBtbCFBNTplD6hENNaB478MaKiQZukte bGfMELXH7m7Jg+raQcoIO7sjDHYxIT3xaoRPIaFMyNKVYMEIUhcImhJrAJWGpn1GLtR7CY ufVRohpK52cY+61z8ol2jMYP9CG43FJ8eFeQN8QUsKnpYAOrZaT7PmPTOKrs5X+Jycn6eq mkbaAbOJVOwf0fIqtFfSjIWqZ+bHlQUJmZmd3qOc+0QFf3NxKCVAF4vWVHvAkQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709737815; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=91GyXbq9L+Wsi9Mm5YxFwJ8OM9VJiPNL0oUxqgxhcS4=; b=klAvvNFXYAgttlcRNLq/37WO1gLrYTkQ/sOpIhcDWi8ffi0laqBZtFE6inptr/Gys2DfvD kEgVfniYI9eg3UgXGtV0eL7dK5VF3C2fvujsH/PQgxNXqpQZhFjPK2qOeoTERCdSbF8z6B yEn1aqAa1cU4MJ+Z4u57tPeb5ema98cbT9RvXAYObBnoIjiRx+rI7n2c9skKLU02xM0iLS FvLb6vkVudHW+JmdVWDZubaLARAff2Dd99AU7Lret/41APNXGWvS+wFXr0J8xS723Xjxz3 ErROLwKFOzfbcASTXp0dKDJNr4pTz6Ax8xfiGK/+TuN+e1/A+gRPhFtvFENGXA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TqbTL6h5KzvKG for ; Wed, 6 Mar 2024 15:10:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 426FAE6a020909 for ; Wed, 6 Mar 2024 15:10:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 426FAEML020908 for virtualization@FreeBSD.org; Wed, 6 Mar 2024 15:10:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277530] vmm(4) manpage doesn't emphasize importance of early loading Date: Wed, 06 Mar 2024 15:10:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: michael@galassi.us X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277530 Bug ID: 277530 Summary: vmm(4) manpage doesn't emphasize importance of early loading Product: Base System Version: 15.0-CURRENT Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bhyve Assignee: virtualization@FreeBSD.org Reporter: michael@galassi.us Created attachment 248975 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D248975&action= =3Dedit clarifying patch for vmm(4) manpage The vmm(4) manpage could use a bit of emphasis on the fact that vmm.ko need= s to be loaded early (from loader.conf) rather than just mentioning that it can = be loaded from loader.conf. This would have saved me a full day of chasing my tail around in circles. The attached patch provides that emphasis. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Mar 6 15:45:24 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TqcFw2cqZz5CpQp for ; Wed, 6 Mar 2024 15:45:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TqcFw1XDgz4b6S for ; Wed, 6 Mar 2024 15:45:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709739924; a=rsa-sha256; cv=none; b=a7snX7yoFHigvX1jWaqSscThAa7YART98CjZmAZA1QJE62aY9GlFNp5Rob89Mg6Qvtm1Ad 1Q3Qc+82pS9WtZdEfAl34lY/B4SLWct4z+sIfPU2Wum4JjLnufQjMTVEwkrp1ofo/M4fhp MfIvdGYgO+/7P8GePVwew3qadCBjgMS5GM5gFR8y0hWeJfD1urqFVHbODWI8iUGBmk/+nz BYFvIPMq9iCteCdAjgirVCNEdnhnqKoEJD0Hl4jiDfcxtXhZCZOWFbBYfOXLhbvTlsST95 kgY07Vkg1gKfiQd9A5naubmb4s9OPYUYuzTfarCY5YSBK9Iudrgwv9GUUH+WpA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709739924; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v7zWEK1MuIinRaF+89iV9FlnmjjGG5frBV6PLOzcrOU=; b=WrpRmhpneLEZlHKSvswLhLLQ2BtyZ1Ztf+Lr/Yy1Vkd/MPciGMXfarAydBB2WPAkqYBkm7 ePnxzKfMaHiSvVPT+KGtpPb1vMVKmxmogm6Vq2RxCPiQdQIa31dDEtnZWme3kPujR9hhq1 BKd/t6oqZpoUsql6r9u+o0HvdSEZ3YTX40BW5hbAsByGRs2oMr8d559n/e5GrdUy4Wbym4 zL9pDTXnjN2V+bzdCS7fbxW7Hkv2jR3z+FtAXo4kBsCVrkmsCZrNO0/lJVtgt6KAgvP2E2 8Dhtn5IVl1VfR36ZSc0fdrsSSkzb/fR5C6b35oO10iNbHrL0OQ/VI4ttfPyXfw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TqcFw169gzw8m for ; Wed, 6 Mar 2024 15:45:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 426FjOGc004291 for ; Wed, 6 Mar 2024 15:45:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 426FjODC004288 for virtualization@FreeBSD.org; Wed, 6 Mar 2024 15:45:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277530] vmm(4) manpage doesn't emphasize importance of early loading Date: Wed, 06 Mar 2024 15:45:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: 0mp@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: 0mp@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277530 Mateusz Piotrowski <0mp@FreeBSD.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open Assignee|virtualization@FreeBSD.org |0mp@FreeBSD.org CC| |0mp@FreeBSD.org --- Comment #1 from Mateusz Piotrowski <0mp@FreeBSD.org> --- Thanks for the submission. I'll clean up the patch a bit and commit it soon. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Mar 8 07:26:18 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Trd564Mrbz5D4KD for ; Fri, 8 Mar 2024 07:26:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Trd560M93z4lby for ; Fri, 8 Mar 2024 07:26:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709882778; a=rsa-sha256; cv=none; b=xfVwoiMTsaUU6QLh8ijTRRTr4IVT2m5KgQZ4hBSm9nH/0zX528AToEflWIOxqVJbVDE9Vb b3S3ZIWWHo7QGDkrD/eoLidAjaF7XMphkEhLcE8NhhFKdCWUQ+gy6wDp2UqzI2lzKG/uCx lfcnvHAp1NwxBU01UBjpYd4JJ6pgoN7qsbvIs61tE7wjtXo4y0gZnkGfbHtnuGmf4TPIPY O0erhJyLZH+GngwNwpOg8qiZqNQpWMsa7XLAJWDhzOLD957JHfYqMqcs2PhKhEqPrgBxGt Rbc8Fhn7DHMPkEkLbm2rwdsSCv0oBMtq+bBlv8hF8u8P2lYkGkgJ+JYjbKsHrQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709882778; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2KY1Gt1sjzcaPwzxWZaHnhJyR9VF+DTYlHxD7OZH1is=; b=Oe+MBCpa3xhyhRom0m9ecHbDdFhYG+30Jrfu/PPLTk5txIhCmNsvHhIT2cJRPIgBKwey/4 5Zb1AREJjis5a49Sg1qtIA6Xk3LPaWRmtAa85GE0e+fIyklIqgo99EwzC5tDzE5+/SYUO6 5aQ/I/iq2O2pJnD+JCRpfUOHVgPrOKk+7MNZm9BuPB4xt0AbJfz3WJULum/fy2J/cMdUsq atdsdvY4bE0aWjVLAzmP51+K0+aHr5oDLLoLSsqxkyYqUHaF6OskzTGAbZoE8uCFUGZdXn tMqOzEpVj7UO1DzmoVygd2tU89gssx5Ehf5Qau3CTpZJj/y7KuDperZHEyc3lw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Trd5575DCz17d0 for ; Fri, 8 Mar 2024 07:26:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4287QHmG006669 for ; Fri, 8 Mar 2024 07:26:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4287QHX1006668 for virtualization@FreeBSD.org; Fri, 8 Mar 2024 07:26:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277559] kldload vmm sometimes hangs kernel on arm64 Date: Fri, 08 Mar 2024 07:26:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash Assignee|bugs@FreeBSD.org |virtualization@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Mar 8 08:17:19 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TrfD010Tfz5D8Mk for ; Fri, 8 Mar 2024 08:17:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TrfCz6MSkz4qt9 for ; Fri, 8 Mar 2024 08:17:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709885839; a=rsa-sha256; cv=none; b=THVm3J0BeRiQjPeKXAZQa5DQFpSvyb+iA6UfhUBAie6P1bvNM4fb4SkfpmPYzyJBYnktoq Vx1/GBr4wL76nAmDOCS+yzmhxiApof5IAvvKs6lOcyO3fusZvlwJJACoy6AQCwadqEsj7j eHFitdmioiWuUE5zaNhLSakFZKNCabZEFfMyE0L0l92IP3tcB8xtIHkOEsFNY4F9uOoKeG ag8x8Gk+g9viTAOJ5v+S72g3apmbuu+CG7KPRVAt5f+qNbI7y4h0YLzYeey/7ds8lnPQim c4vK9BfRgWHL3L3n9FdFZYM/Q4xgnhl0o6UHqXWPKgTIIp5bdPKjOqbPuCFurA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709885839; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GWfbuJ+GGzWR2pwHRzOUotoCWK8tPKwfqSiIU7PfbWM=; b=rap6daJp/Y41dKPwaNf+Gx4+TCcQkQSwiXkMp0N9DkxC12PCPXWu2fXlI0NO/fjq91xRgR nt2EP74NtN7nJ83EuUwXCyYVW8XSZYmpKyxVzNZlfC+SA+6I0LYZDhNKhQjnopOjRimgio rd9zhEghsZZ344Gx4oMZG0fEQlRwToYM1K2yg+lT29lyRyD5/Hach5D+b+8sAJQ2tiv8pA Rtfx97nodqCpOtZ9oFNjeY8kfKwUiZw4++rMduUY3+EfyfVkpRDAep4gP1FL/V6z4ldOJZ AlO0aD3+LtjdY2oEY3PXdhtEzZeec/n/Y6++PY81AkaMgK5qbNnh891ciR6W/A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TrfCz5xyZz19Kj for ; Fri, 8 Mar 2024 08:17:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4288HJ8N070142 for ; Fri, 8 Mar 2024 08:17:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4288HJuW070137 for virtualization@FreeBSD.org; Fri, 8 Mar 2024 08:17:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277559] kldload vmm sometimes hangs kernel on arm64 Date: Fri, 08 Mar 2024 08:17:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 Peter Grehan changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |grehan@FreeBSD.org --- Comment #1 from Peter Grehan --- I'm going to hazard a guess this is due to the differences in capabilities between the A53 and A72 cores (having seen a problem with that on Linux/KVM= on the same RockPro64). The theory is that if kldload runs on an A72 core, the passed tcr_el2/vtcr_= el2 values aren't compatible with A53 cores, but it's ok the other way around. One way to see if this is the case would be to pin the kldload onto an A72 core, and then onto an A53 core, and see if it works one way but hangs the other. cpuset -l kldload vmm.ko where cpu-num is the number assigned to an A72 or A53 core. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Mar 8 13:46:06 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TrnWM2yDLz5DB1Y for ; Fri, 8 Mar 2024 13:46:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TrnWM06Fwz4Tbs for ; Fri, 8 Mar 2024 13:46:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709905567; a=rsa-sha256; cv=none; b=eoJPLt7EIQD6H8IqPCpv8KVYwj4fOLgkjOfXnZIg/CSLTYw35eN2QlA5CbS+I9/JcxNYee Qp/LURZKSvsGHsz4ivVTlNL5ixr0gHAV+QBfzfSTYygkifTR4WTCOWUwMnzqdwFUUryIa4 G3hWSfiLuyI6ReB1O1tZMQ9pHG9ozMKWZcpQNh7RmI+2PEMhI9613OTaTkr8lIvQo1oOM+ lP6YyaVi8rd5L8MmjjaHD7EGlSWaVGJ/qRl+lpL04W7MXhfpXf/8GkapsgY06fap4rVjmt HFONdG0jgsD+lXOikZlSGRdpofZM7BVfWU/OGiDneQb8QIAVZ1MvVkZwnceW/w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709905567; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Y6UXLRGWrMQOKt2oHEhnjE0qvly2wWIoF2sRTm7W4d4=; b=jHGaYLMvinow9Kt8a85xUcekShgIWfPpfRXMsi9lBtQS031v4DT7VynZtkhcjTUjCMMz2u g/LOupdD1kuCvrDkDeT/Xn8714GyD92C21JdgWhepKvHl5uetPJAYXSeLdWMEtyvPl3N2g 7U7frBdO7PERiMHpgV5riF/ychiwQ0GGm3VyhFJf41Oo4amFnd6ig1o2BulqY+waWoSAgd ovQCooScrwhE6ae5+hfsWGnJErnxue4ZI29SVKP5h7mp1dzd5326p0PK4FEXEFapxn1A0G NlxKdxLbXIFaTwQQ7/Xn6CEssKUiZscujIQ6G7LuODkcVKq361LoBS2twglnVQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TrnWL6XqGzKvv for ; Fri, 8 Mar 2024 13:46:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 428Dk6MY043412 for ; Fri, 8 Mar 2024 13:46:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 428Dk6u4043411 for virtualization@FreeBSD.org; Fri, 8 Mar 2024 13:46:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277559] kldload vmm sometimes hangs kernel on arm64 Date: Fri, 08 Mar 2024 13:46:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 --- Comment #2 from John F. Carr --- Loading vmm sometimes hangs on either type of CPU. Hangs appear to be more likely on the low numbered A53 CPUs. The bits are the same whichever CPU is in charge, tcr_el2=3D80823510 and vtcr_el2=3D80023559. Notably, one of the hangs on CPU 0 had debugging output from after the smp_rendezvous: # cpuset -l 0 kldload vmm vgic0: on gic0 vmm_handler 0xffffa000f4017180 0 0 vmmdev_init() vmmdev init returned vmm_init vm_maxcpu =3D 6 vmm_regs_init returned 0 vmmops_modinit 0 ID_AA64MMFR0_EL1 =3D 1122 vmm_virt_bits =3D 39 vmmops_modinit rendezvous 0xffff0000d5e18380 {80823510, 80023559} vmmops_modinit rendezvous returned vmmops_modinit disable interrupts The last lines come from this code I added at the end of vmmops_modinit: printf("vmmops_modinit disable interrupts\n"); pause("vmmon", 2); daif =3D intr_disable(); cnthctl_el2 =3D vmm_call_hyp(HYP_READ_REGISTER, HYP_REG_CNTHCTL); intr_restore(daif); printf("vmmops_modinit enable interrupts\n"); vgic_init(); printf("vmmops_modinit vgic ininitalized\n"); vtimer_init(cnthctl_el2); printf("vmmops_modinit vtimer_init(cnthctl_el2=3D%lx) returned\n", cnthctl_el2); The next time I tried the same command it worked: # cpuset -l 0 kldload vmm vgic0: on gic0 vmm_handler 0xffffa00002782300 0 0 vmmdev_init() vmmdev init returned vmm_init vm_maxcpu =3D 6 vmm_regs_init returned 0 vmmops_modinit 0 ID_AA64MMFR0_EL1 =3D 1122 vmm_virt_bits =3D 39 vmmops_modinit rendezvous 0xffff0000bd5e7380 {80823510, 80023559} vmmops_modinit rendezvous returned vmmops_modinit disable interrupts vmmops_modinit enable interrupts vmmops_modinit vgic ininitalized vmmops_modinit vtimer_init(cnthctl_el2=3D3) returned vmm init returned 0 Console output from every other hang stopped before the "vmmops_modinit rendezvous returned" message. Has anybody successfully used a JTAG debugger on the RockPro64? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Mar 9 03:16:54 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ts7Vt43fvz5Chdj for ; Sat, 9 Mar 2024 03:16:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ts7Vt0mz5z4g42 for ; Sat, 9 Mar 2024 03:16:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709954214; a=rsa-sha256; cv=none; b=awQ8s5dikhmO2qLLKJMHOKeCL+Xa/JehF3eQLmaDx3aIUF4VbT6lt2qgOTF+n4XSwbD7Fr CPLzXocWINzsoPoT44Q69goaIylUCp0UBNdPM1Utfnpho8ccinm7ir4je86cEkwFRdiPW9 VU8+kTnuua4CTUsk7JpLvHFXHdJ554qsyLGVKXc0bp47W4uR+ezNj80OJd0aFvtdYIyfY5 b8oXmYFY3BrbMN5RXovWpL1KMN3rt0ieJXUaJLoTgzfwtBFgc3P+jGZlLStp3BKcQpHzB6 6nN5t32QYOazUYAVtFXKXTw8d51ds9VxM4UsO1If25oLnQYfPHTaEfUWzSf/pw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709954214; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1avz2O/FlzLBgyuXX5SPixXyY6YMeoRVVdgtvt8NoXE=; b=OnjLO5tPlNVYtj4jvztEn18neYewuE0VbJyRj/8QHt8BBAEpu+r9lkczxLPNLzcG/5Ayow N7aha1L0B7nRjdMAQ7v3m5DCWlDLe/v1p75v2Odyq5Bpb4YwVCIiz6UJdTQcmVY7x4o0Gj BkPCqQaoOL42M48GmC8yP+dutpTB6Kmk/JasnOXVi54PmNZ4Wo/lY04rjynbK6tjAHzv5J sPIdczzdy6grFrFylzAZKE2HKw8IhMVHOaqpyWlSVwS8f+ZER6sx31CjcytXjdmyEA4End YjkqeXiREYx+GeL0ncmw+cDWyp4sq8yasqg8JlPGvpdhswCGPYIns/tdXqLWyw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Ts7Vt0NWMzlWx for ; Sat, 9 Mar 2024 03:16:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4293GrAZ065595 for ; Sat, 9 Mar 2024 03:16:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4293GrCw065594 for virtualization@FreeBSD.org; Sat, 9 Mar 2024 03:16:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277559] kldload vmm sometimes hangs kernel on arm64 Date: Sat, 09 Mar 2024 03:16:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: grehan@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 --- Comment #3 from Peter Grehan --- Thanks for giving that a try: rules out that theory. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Mar 10 00:27:03 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Tsghj3lfVz5CnY5 for ; Sun, 10 Mar 2024 00:27:17 +0000 (UTC) (envelope-from brad@facefault.org) Received: from wfhigh4-smtp.messagingengine.com (wfhigh4-smtp.messagingengine.com [64.147.123.155]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Tsghh4mGqz4qLt for ; Sun, 10 Mar 2024 00:27:16 +0000 (UTC) (envelope-from brad@facefault.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=facefault.org header.s=fm3 header.b=DfbaKEPV; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=rBfAGG++; dmarc=none; spf=pass (mx1.freebsd.org: domain of brad@facefault.org designates 64.147.123.155 as permitted sender) smtp.mailfrom=brad@facefault.org Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailfhigh.west.internal (Postfix) with ESMTP id 774CB180009A for ; Sat, 9 Mar 2024 19:27:15 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Sat, 09 Mar 2024 19:27:15 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=facefault.org; h=cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:message-id:mime-version:reply-to :subject:subject:to:to; s=fm3; t=1710030434; x=1710116834; bh=CX 2uqAB6RYr7WtbSyP+k7o53JJMfFMvbLY0qDgUG6vY=; b=DfbaKEPVUN/b7XmHPc LH/ioBSOmnD7OjJbD9gYtmveu3zt/veOuu0OtqmzFwrjnFyz34hjSDtpfhbwraCu XvNAE9dQKn3i6DXVUip0QgA9R6OO20jYw6yxmWUBxELyUjh6eT3Q/Ah51TKfiM6r 8VFY2tz0fO0lMvhaGZIMlPjqaS8NwSUuvTBkDqd4yRpa5d9C/pJzRrD04/yv98bi yOgCO3tOCytIuyEUF+epGIPslCOE9MW9YAMISVcAdvueWzZDE2LFWtUtVgAtPhjo v9xKFXMRPq4sKPDrFwy0BQilF2Jk0dU9Fq1MiPScWsqJlr6QI4xaDb+QfzoSogox PnrQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:message-id:mime-version:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; t=1710030434; x=1710116834; bh=CX2uqAB6RYr7WtbSyP+k7o53JJMf FMvbLY0qDgUG6vY=; b=rBfAGG++399L7wkn9AZInp1cGdcAiLx+Ojs90IU0l9XV xI2iUqOrE2v+a/wSQ5GV9eVEDVDfntUMRB2ynCdkZaZ+61i7D6drVXE/XyJrcZqB B8Yv9nyg2CA+j6Otu+LOcdhnD00OBuuIaCn9dcQxQJ2oNufFaGN5lbqb/vfeFPqp h+vTsiFJE6auM5R392Jx8yN95+XwbEzo+149nFdZPP+LeQYEzs6+diy9lR8WdR8c yGSfhd9Ly0vwWrExJ24G2KVpRJ4NYK2w+o1ikUjZpdbEKLYnAuWnuKTe/HMNzVIl vEzmj0Y7vHuXsifKDOzc4gfaHQULdYHgR4DqO+LHHQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrieekgddvvdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhephfgtgfgguffkfffvofesthhqmhdthh dtjeenucfhrhhomhepuehrrgguucettghkvghrmhgrnhcuoegsrhgrugesfhgrtggvfhgr uhhlthdrohhrgheqnecuggftrfgrthhtvghrnhepudfffefhjeeludekvdejffegjeekle euieejffetjedvueejvedufffhtdelhfevnecuvehluhhsthgvrhfuihiivgeptdenucfr rghrrghmpehmrghilhhfrhhomhepsghrrggusehfrggtvghfrghulhhtrdhorhhg X-ME-Proxy: Feedback-ID: ib09641b5:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 9 Mar 2024 19:27:14 -0500 (EST) From: Brad Ackerman Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.500.171.1.1\)) Subject: 14.0-RELEASE and 15-CURRENT have high interrupt count/latency in Xen domu (xcp-ng host) Message-Id: <92898E90-B3BA-4B89-8929-34F397BDE9BF@facefault.org> Date: Sat, 9 Mar 2024 16:27:03 -0800 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3774.500.171.1.1) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.10 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.128/27]; R_DKIM_ALLOW(-0.20)[facefault.org:s=fm3,messagingengine.com:s=fm1]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.155:from]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[facefault.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[facefault.org:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4Tsghh4mGqz4qLt On an xcp-ng VM running 14.0-RELEASE (also tested on p5 and 15-CURRENT), = top shows a lot of CPU time in interrupts (always a double-digit = percentage, usually around 70% but it varies all over the place). Based = on dtrace, the problem appears to be in ata_interrupt and I=E2=80=99d = guess it=E2=80=99s mutex-related. What else do I want to do to investigate this issue? All of below is on an instance with 1GB RAM and 2 vCPUs; the host is = xcp-ng 8.2 with all available patches. dtrace -n '::*interrupt*:entry { self->ts =3D timestamp; } = ::*interrupt*:return /self->ts/ { @[probefunc] =3D quantize(timestamp - = self->ts); self->ts =3D 0; }' run for one minute on an otherwise idle VM produces: zio_delay_interrupt value ------------- Distribution ------------- count 512 | 0 1024 |@@@@@@@ 2 2048 |@@@ 1 4096 | 0 8192 |@@@@@@@@@@@@@@@@@@@@ 6 16384 |@@@@@@@@@@ 3 32768 | 0 ata_interrupt value ------------- Distribution ------------- count 65536 | 0 131072 |@@@ 3 262144 |@@@@@@@@@@@@@@@@@ 19 524288 |@@@@@@@@ 9 1048576 |@@@@@@@@@@@@ 13 2097152 | 0 On CURRENT, that dtrace invocation returns nothing at all; dtrace -l = shows an entry but not return for ata_interrupt so that appears to be an = fbt issue.=20 The disk does appear to be using the PV driver: xbd0: 32768MB at device/vbd/768 on xenbusb_front0 xbd0: attaching as ada0 xbd0: features: write_barrier xbd0: synchronize cache commands enabled. There are two mutex warnings that show up on CURRENT, but they seem = unrelated: Invoking IPv6 network device address event may sleep with the following = non-sleepable locks held: exclusive sleep mutex xnrx_1 (netfront receive lock) r =3D 0 = (0xfffffe00496d2d48) locked @ = /usr/src/sys/dev/xen/netfront/netfront.c:679 stack backtrace: #0 0xffffffff80bc9a35 at witness_debugger+0x65 #1 0xffffffff80bcab99 at witness_warn+0x3e9 #2 0xffffffff80d793c4 at in6_update_ifa+0xcb4 #3 0xffffffff80da4f80 at in6_ifadd+0x1e0 #4 0xffffffff80da16d9 at nd6_ra_input+0x1029 #5 0xffffffff80d73de0 at icmp6_input+0x870 #6 0xffffffff80d8c4ae at ip6_input+0xc8e #7 0xffffffff80cadbbd at netisr_dispatch_src+0xad #8 0xffffffff80c9065a at ether_demux+0x16a #9 0xffffffff80c91d73 at ether_nh_input+0x403 #10 0xffffffff80cadbbd at netisr_dispatch_src+0xad #11 0xffffffff80c90ab9 at ether_input+0xd9 #12 0xffffffff809c6ebc at xn_rxeof+0x5dc #13 0xffffffff809c8238 at xn_intr+0x48 #14 0xffffffff80b0d556 at ithread_loop+0x266 #15 0xffffffff80b09972 at fork_exit+0x82 #16 0xffffffff8102e06e at fork_trampoline+0xe lock order reversal: (sleepable after non-sleepable) 1st 0xfffffe00496d2d48 xnrx_1 (netfront receive lock, sleep mutex) @ = /usr/src/sys/dev/xen/netfront/netfront.c:679 2nd 0xffffffff81abe830 in6_multi_sx (in6_multi_sx, sx) @ = /usr/src/sys/netinet6/in6_mcast.c:1217 lock order netfront receive lock -> in6_multi_sx attempted at: #0 0xffffffff80bc95f3 at witness_checkorder+0xb63 #1 0xffffffff80b5f0fd at _sx_xlock+0x5d #2 0xffffffff80d81b11 at in6_joingroup+0x31 #3 0xffffffff80d7977d at in6_update_ifa+0x106d #4 0xffffffff80da4f80 at in6_ifadd+0x1e0 #5 0xffffffff80da16d9 at nd6_ra_input+0x1029 #6 0xffffffff80d73de0 at icmp6_input+0x870 #7 0xffffffff80d8c4ae at ip6_input+0xc8e #8 0xffffffff80cadbbd at netisr_dispatch_src+0xad #9 0xffffffff80c9065a at ether_demux+0x16a #10 0xffffffff80c91d73 at ether_nh_input+0x403 #11 0xffffffff80cadbbd at netisr_dispatch_src+0xad #12 0xffffffff80c90ab9 at ether_input+0xd9 #13 0xffffffff809c6ebc at xn_rxeof+0x5dc #14 0xffffffff809c8238 at xn_intr+0x48 #15 0xffffffff80b0d556 at ithread_loop+0x266 #16 0xffffffff80b09972 at fork_exit+0x82 #17 0xffffffff8102e06e at fork_trampoline+0xe (The "non-sleepable locks held=E2=80=9D backtrace shows up a second time = but without a lock reversal.) systat -vmstat on RELEASE: 3 users Load 0.13 0.19 0.22 Mar 10 00:21:55 Mem usage: 89%Phy 78%Kmem VN PAGER SWAP = PAGER Mem: REAL VIRTUAL in out in = out Tot Share Tot Share Free count Act 47944K 20684K 406M 24480K 107M pages All 50736K 23368K 446M 57372K ioflt = Interrupts Proc: cow 69 = total r p d s w Csw Trp Sys Int Sof Flt zfod = atkbd0 1 31 91 2 67 36 1 ozfod = ata1 15 %ozfod = uhci0 23 0.0%Sys 78.9%Intr 0.0%User 0.0%Nice 21.1%Idle daefr 17 = cpu0:xen | | | | | | | | | | | prcfr 17 = cpu1:xen +++++++++++++++++++++++++++++++++++++++ totfr = cpu0:r dtbuf react = cpu0:itlb Namei Name-cache Dir-cache 62482 maxvn pdwak 4 = cpu0:b Calls hits % hits % 17168 numvn 5 pdpgs = cpu1:r 7 7 100 16002 frevn intrn = cpu1:itlb 772M wire 6 = cpu1:b Disks ada0 cd0 pass0 13M act 13 = xen_et0:c0 KB/t 0.00 0.00 0.00 60M inact 11 = xen_et0:c1 tps 0 0 0 0 laund = xenstore0 MB/s 0.00 0.00 0.00 107M free = xbd0 2113 %busy 0 0 0 0 buf 1 = xn0 2114 = xn0 2115 = xn0 2116 = xn0 2117 and on CURRENT: 4 users Load 0.15 0.12 0.16 Mar 10 00:23:11 Mem usage: 35%Phy 8%Kmem VN PAGER SWAP = PAGER Mem: REAL VIRTUAL in out in = out Tot Share Tot Share Free count Act 103M 14608K 454M 16848K 626M pages All 105M 16908K 486M 49620K ioflt = Interrupts Proc: cow 274 = total r p d s w Csw Trp Sys Int Sof Flt zfod = atkbd0 1 29 272 1 49 137 1 ozfod = uhci0 23 %ozfod 114 = cpu0:xen 0.0%Sys 56.0%Intr 0.0%User 0.0%Nice 44.0%Idle daefr 23 = cpu1:xen | | | | | | | | | | | prcfr 2 = cpu0:r ++++++++++++++++++++++++++++ totfr = cpu0:itlb 6 dtbuf react 12 = cpu0:b Namei Name-cache Dir-cache 62833 maxvn pdwak 1 = cpu1:r Calls hits % hits % 920 numvn 10 pdpgs = cpu1:itlb 7 7 100 126 frevn intrn 17 = cpu1:b 217M wire 100 = xen_et0:c0 Disks ada0 31M act 4 = xen_et0:c1 KB/t 0.00 84M inact = xenstore0 tps 0 0 laund = xbd0 2113 MB/s 0.00 626M free 1 = xn0 2114 %busy 0 80M buf = xn0 2115 = xn0 2116 = xn0 2117 =E2=80=94=20 Brad Ackerman brad@facefault.org From nobody Sun Mar 10 21:00:55 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TtC483NGsz5CrhQ for ; Sun, 10 Mar 2024 21:00:56 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TtC476flxz4V34 for ; Sun, 10 Mar 2024 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1710104455; a=rsa-sha256; cv=none; b=ZBg7f9Xj35etmMWnSIr9v8d1yAX5bwi99PmvifVH3EoLbgoJGuopNaOLZBliSmcZeiiP75 NIBOB0binh+X6mCXSpCazdsXrEtcmhJOftsBoSMkmBUJ29/p0J22ddeXksHuZ5BZaHYnX5 dJRtWG/lRgPHvJ303kRoVgkyp1ZdAqLeEAoBYeXJTQCl5cHpHpEbF0vpAGj9QSunGfXl65 Dl+J/lYWkgOCyK4b1ImIsUZ6JE/262+3HYH+Tp70lYppl3ASAtnXq69r574G+lcdAEkbn+ S/WAcUp6N22xtuQaiH2VoCKKcAsf+f89Q98uwkiC2aV16SeSHwsEkqV256Jj2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1710104455; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=0WDEBFgHWVP32NwIkj145jLAuOiDkCnVPVljq3wvyvU=; b=vrsyLG1Y6I84UNUOFf6HgCtTtvj7f49hTKW8oqLZb5XggFjncUo97AaYWUoJe/Rox8xQ6f 0lQjvNK1EA9QH/yJ5GN8x7X/idaa8Lo8snFyt1mAU+wg/dHTiaaukWMmzkYwqPixTYZ4RD TX/tbRT7dmtJ50VJq0gqpGvyz5YqdHkuJ2UhmSA4YzpMFDxU6l6GssRpidPNw585k/8nZ3 xVZUiINwB8SROdq5ftA2sHjD+M77KKBQkzSbJ0Pzafbt1bIhGUFilMB+A5m4h3aFo+l37D AFks3SVkypIEI7BC/XgKeLhm0XDlI7ca19bHUx89i0rvjEItV6Ihr6KTifNG+A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TtC476H2Tz11y4 for ; Sun, 10 Mar 2024 21:00:55 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 42AL0tAc004153 for ; Sun, 10 Mar 2024 21:00:55 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 42AL0tSj004152 for virtualization@FreeBSD.org; Sun, 10 Mar 2024 21:00:55 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202403102100.42AL0tSj004152@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: virtualization@FreeBSD.org Subject: Problem reports for virtualization@FreeBSD.org that need special attention Date: Sun, 10 Mar 2024 21:00:55 +0000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17101044553.039cEC.92531" Content-Transfer-Encoding: 7bit --17101044553.039cEC.92531 Date: Sun, 10 Mar 2024 21:00:55 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 264253 | hyperv: ifconfig media autoselect on FreeBSD 13.0 1 problems total for which you should take action. --17101044553.039cEC.92531 Date: Sun, 10 Mar 2024 21:00:55 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    264253 | hyperv: ifconfig media autoselect on FreeBSD 13.0

1 problems total for which you should take action.
--17101044553.039cEC.92531--