From nobody Thu Jan 15 14:51:06 2026 X-Original-To: dev-commits-src-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dsQsQ6Q0Wz6P4XF for ; Thu, 15 Jan 2026 14:51:06 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dsQsQ11Rmz3Jlv for ; Thu, 15 Jan 2026 14:51:06 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768488666; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Kard8ev3eLkvF00cqLGY81Y8E4e70tNChUrCXKm00+w=; b=jSxkBTe/bbTaWlXGJtxRyvePw84OdVhVSun1cUjFjSZTT1CPEZDwRDqCMEMscgOleW7Qqh nEKXqOl9eRrKX1OI+yDzeisCo90d1O+5PTbt+7mtMfPnMiElKlKqMGx7FK9JD8zjhRa1k5 DsUHsUTnAB6fbb1DczOEuJX9Gm9NL0qqsNKMEl5UuZb3JjBRX3pUKly5pAdw34/W0QyFNY FotBLI+2PriJbmrm8rYVdKZ8jmLfy4kGyZ5wHzQ0zDYVq9nyS3tQLX8IxinXpbVkcdJYSJ 8dYdhgTJJ9oPmoXT6EAxdh8YajhoOkF0Xrt3esGgPGeSN1jaF6ei7IicUhestg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1768488666; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=Kard8ev3eLkvF00cqLGY81Y8E4e70tNChUrCXKm00+w=; b=V19Aiq0w2vQI1+gjkSgip43FXrL7MNIKSdpt6QH1TicrNZX6uHeArhCGgYlMODQGQSzDX1 gZhfGGuFq8V5ZtoaWBaL4A9Re+FXPeauCBTMgi4Yjs5kBoKfpkKtktXb5fiUlsxUWSlsqq IDhZVb5s8Rhmr8ZmtoiKsFyAyDpUiSp6vyZSA+hMAnOJHdKuEaV6cGFdSq8CBrI2yXfPae ImjJYEW6wDJW2du4eewAJMMwkARQCSQW+PW2L6ZAnSWDdw0Pb1QWikPFv9dhIAPQyp0d3u PtTVmBeDE/LJ/F9oiTdL1EJjvl/H3csJuxFA9Nm5jeISu2RIFif3oPiM6v2Q/Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1768488666; a=rsa-sha256; cv=none; b=nlDC0CTVIs0N3b2gbpNqhWGdoT9U+ihmbxV8a00ygwNhfpnVa0LUnERNJk6qx6nGdOHDuj hTp/tyvDi4XnX39ldrhXbVf67VK0a1o//CtaFxVWAsCeUKpLv06tOMJRObrYatYhgszFpc PgrmhCDGWzK5Ybc9RSRaF3UFPNwHrah7Zym5x6xvOMTgmH6Mle7NGg3IdOfnerexoanIqY WUa/YFEA/VoyJnpWdn7P4l4h34w0zhiI8ScvXpfktCYNF4uh6AEpkHttEy96dbINY2r2Et M7ouU8wRtQS+JSAsgJ9KBKhdFAoC4qVK4NgFHqWrARZx6Ke1cNks2x0QFA158A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4dsQsQ0cgjzZ9Q for ; Thu, 15 Jan 2026 14:51:06 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from git (uid 1279) (envelope-from git@FreeBSD.org) id 2233f by gitrepo.freebsd.org (DragonFly Mail Agent v0.13+ on gitrepo.freebsd.org); Thu, 15 Jan 2026 14:51:06 +0000 To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, dev-commits-src-branches@FreeBSD.org From: Andrew Turner Subject: git: a5371aed0235 - stable/14 - arm64: Create a TLBI invalidate for the kernel List-Id: Commit messages for all branches of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-all List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: dev-commits-src-all@freebsd.org Sender: owner-dev-commits-src-all@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: andrew X-Git-Repository: src X-Git-Refname: refs/heads/stable/14 X-Git-Reftype: branch X-Git-Commit: a5371aed0235915187a3d39809a637a63d510b37 Auto-Submitted: auto-generated Date: Thu, 15 Jan 2026 14:51:06 +0000 Message-Id: <6968feda.2233f.430c3983@gitrepo.freebsd.org> The branch stable/14 has been updated by andrew: URL: https://cgit.FreeBSD.org/src/commit/?id=a5371aed0235915187a3d39809a637a63d510b37 commit a5371aed0235915187a3d39809a637a63d510b37 Author: Andrew Turner AuthorDate: 2025-09-04 17:24:07 +0000 Commit: Andrew Turner CommitDate: 2026-01-14 21:14:14 +0000 arm64: Create a TLBI invalidate for the kernel Add pmap_s1_invalidate_all_kernel to remove the need to check for the kernel_pmap when it's passed in. While here replace pmap calls to cpu_tlb_flushID with pmap_s1_invalidate_all_kernel as they are identical. Reviewed by: kib Sponsored by: Arm Ltd Differential Revision: https://reviews.freebsd.org/D52183 (cherry picked from commit 8df4dc90952be7afee36e3cc80c1a76e2c66fbac) --- sys/arm64/arm64/pmap.c | 19 +++++++++++++++---- 1 file changed, 15 insertions(+), 4 deletions(-) diff --git a/sys/arm64/arm64/pmap.c b/sys/arm64/arm64/pmap.c index a3014fd5cee3..b25c862b8ea3 100644 --- a/sys/arm64/arm64/pmap.c +++ b/sys/arm64/arm64/pmap.c @@ -194,6 +194,8 @@ __exclusive_cache_line static struct pmap_large_md_page pv_dummy_large; #define pv_dummy pv_dummy_large.pv_page __read_mostly static struct pmap_large_md_page *pv_table; +static __inline void pmap_s1_invalidate_all_kernel(void); + static struct pmap_large_md_page * _pa_to_pmdp(vm_paddr_t pa) { @@ -1186,7 +1188,7 @@ pmap_bootstrap_dmap(vm_paddr_t min_pa) } } - cpu_tlb_flushID(); + pmap_s1_invalidate_all_kernel(); } static void @@ -1327,7 +1329,7 @@ pmap_bootstrap(vm_size_t kernlen) /* And the l3 tables for the early devmap */ pmap_bootstrap_l3(VM_MAX_KERNEL_ADDRESS - (PMAP_MAPDEV_EARLY_SIZE)); - cpu_tlb_flushID(); + pmap_s1_invalidate_all_kernel(); #define alloc_pages(var, np) \ (var) = bs_state.freemempos; \ @@ -1728,6 +1730,15 @@ pmap_invalidate_range(pmap_t pmap, vm_offset_t sva, vm_offset_t eva, pmap_s2_invalidate_range(pmap, sva, eva, final_only); } +static __inline void +pmap_s1_invalidate_all_kernel(void) +{ + dsb(ishst); + __asm __volatile("tlbi vmalle1is"); + dsb(ish); + isb(); +} + /* * Invalidates all cached intermediate- and final-level TLB entries for the * given virtual address space. @@ -6615,7 +6626,7 @@ pmap_mapbios(vm_paddr_t pa, vm_size_t size) pa += L2_SIZE; } if ((old_l2e & ATTR_DESCR_VALID) != 0) - pmap_s1_invalidate_all(kernel_pmap); + pmap_s1_invalidate_all_kernel(); else { /* * Because the old entries were invalid and the new @@ -6691,7 +6702,7 @@ pmap_unmapbios(void *p, vm_size_t size) } } if (preinit_map) { - pmap_s1_invalidate_all(kernel_pmap); + pmap_s1_invalidate_all_kernel(); return; }