From nobody Fri Mar 8 13:46:06 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TrnWM2yDLz5DB1Y for ; Fri, 8 Mar 2024 13:46:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TrnWM06Fwz4Tbs for ; Fri, 8 Mar 2024 13:46:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1709905567; a=rsa-sha256; cv=none; b=eoJPLt7EIQD6H8IqPCpv8KVYwj4fOLgkjOfXnZIg/CSLTYw35eN2QlA5CbS+I9/JcxNYee Qp/LURZKSvsGHsz4ivVTlNL5ixr0gHAV+QBfzfSTYygkifTR4WTCOWUwMnzqdwFUUryIa4 G3hWSfiLuyI6ReB1O1tZMQ9pHG9ozMKWZcpQNh7RmI+2PEMhI9613OTaTkr8lIvQo1oOM+ lP6YyaVi8rd5L8MmjjaHD7EGlSWaVGJ/qRl+lpL04W7MXhfpXf/8GkapsgY06fap4rVjmt HFONdG0jgsD+lXOikZlSGRdpofZM7BVfWU/OGiDneQb8QIAVZ1MvVkZwnceW/w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1709905567; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Y6UXLRGWrMQOKt2oHEhnjE0qvly2wWIoF2sRTm7W4d4=; b=jHGaYLMvinow9Kt8a85xUcekShgIWfPpfRXMsi9lBtQS031v4DT7VynZtkhcjTUjCMMz2u g/LOupdD1kuCvrDkDeT/Xn8714GyD92C21JdgWhepKvHl5uetPJAYXSeLdWMEtyvPl3N2g 7U7frBdO7PERiMHpgV5riF/ychiwQ0GGm3VyhFJf41Oo4amFnd6ig1o2BulqY+waWoSAgd ovQCooScrwhE6ae5+hfsWGnJErnxue4ZI29SVKP5h7mp1dzd5326p0PK4FEXEFapxn1A0G NlxKdxLbXIFaTwQQ7/Xn6CEssKUiZscujIQ6G7LuODkcVKq361LoBS2twglnVQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4TrnWL6XqGzKvv for ; Fri, 8 Mar 2024 13:46:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 428Dk6MY043412 for ; Fri, 8 Mar 2024 13:46:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 428Dk6u4043411 for virtualization@FreeBSD.org; Fri, 8 Mar 2024 13:46:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 277559] kldload vmm sometimes hangs kernel on arm64 Date: Fri, 08 Mar 2024 13:46:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jfc@mit.edu X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 --- Comment #2 from John F. Carr --- Loading vmm sometimes hangs on either type of CPU. Hangs appear to be more likely on the low numbered A53 CPUs. The bits are the same whichever CPU is in charge, tcr_el2=3D80823510 and vtcr_el2=3D80023559. Notably, one of the hangs on CPU 0 had debugging output from after the smp_rendezvous: # cpuset -l 0 kldload vmm vgic0: on gic0 vmm_handler 0xffffa000f4017180 0 0 vmmdev_init() vmmdev init returned vmm_init vm_maxcpu =3D 6 vmm_regs_init returned 0 vmmops_modinit 0 ID_AA64MMFR0_EL1 =3D 1122 vmm_virt_bits =3D 39 vmmops_modinit rendezvous 0xffff0000d5e18380 {80823510, 80023559} vmmops_modinit rendezvous returned vmmops_modinit disable interrupts The last lines come from this code I added at the end of vmmops_modinit: printf("vmmops_modinit disable interrupts\n"); pause("vmmon", 2); daif =3D intr_disable(); cnthctl_el2 =3D vmm_call_hyp(HYP_READ_REGISTER, HYP_REG_CNTHCTL); intr_restore(daif); printf("vmmops_modinit enable interrupts\n"); vgic_init(); printf("vmmops_modinit vgic ininitalized\n"); vtimer_init(cnthctl_el2); printf("vmmops_modinit vtimer_init(cnthctl_el2=3D%lx) returned\n", cnthctl_el2); The next time I tried the same command it worked: # cpuset -l 0 kldload vmm vgic0: on gic0 vmm_handler 0xffffa00002782300 0 0 vmmdev_init() vmmdev init returned vmm_init vm_maxcpu =3D 6 vmm_regs_init returned 0 vmmops_modinit 0 ID_AA64MMFR0_EL1 =3D 1122 vmm_virt_bits =3D 39 vmmops_modinit rendezvous 0xffff0000bd5e7380 {80823510, 80023559} vmmops_modinit rendezvous returned vmmops_modinit disable interrupts vmmops_modinit enable interrupts vmmops_modinit vgic ininitalized vmmops_modinit vtimer_init(cnthctl_el2=3D3) returned vmm init returned 0 Console output from every other hang stopped before the "vmmops_modinit rendezvous returned" message. Has anybody successfully used a JTAG debugger on the RockPro64? --=20 You are receiving this mail because: You are the assignee for the bug.=