From nobody Tue Dec 30 12:41:30 2025 X-Original-To: dev-commits-doc-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dgXlH1KtLz6Lrwm for ; Tue, 30 Dec 2025 12:41:31 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4dgXlH0JxGz3PQB for ; Tue, 30 Dec 2025 12:41:31 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1767098491; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=EFW6BILuXIL7b31zlnWXt2Vf6jn9kVcRA1ZmkuFBKTY=; b=we9sZ8kczX0cj4yiBPO9tyhfPIGAg6Ssvbyo7TagbWQ77co1Nqv+OaD6GzaSyyHICiGpDt XIABWkxCc0BLMsog71twOcbBhiPyBsKqRDjP8NLhd0xXR8UMZqr1QpGJApUQWKkPdRgxnV 0Jw+5s6HlUDECyD4SYxMD9SKYruZmF5ooi/ZPdoys5Ej0sA7oBvSoeOfh4imQshy+V3RqK 6HUnhhT80KBGJW+H4aoqIJ4QTRVNLx+IPi5SfiuCTfw599+Y0tCBQ9yg/8YnxYp3Rhv7gf xvH8opaXl8IcficFhi5N0CBl+mhnUndo/83J6fd2ip+6yvaxQcE7YZuuIoA2Tw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1767098491; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=EFW6BILuXIL7b31zlnWXt2Vf6jn9kVcRA1ZmkuFBKTY=; b=pS6/lvQFtSIcXiCtAabY0Vv+XSsj1sT47sfSMiC8VgQ6cXULBWY8WFSJWFUcb0gih911TX +5luz4knnNgTA//wm3Ob8zOhLWlUrXz49Szz1NbLgxGcdUUhsG7USqUu2zGn2MCvBfZGXT Zf0G/yOYasdbA7PK3NR+smizEr8aoxO3AdU0BuLNWl23SeI8w6Li5CxWWtvCuKgzX8TbbX JFHmwWv5zIrwsVs/XPbh8ZMEp86qRw1PIa5mxsbD2bfHUbUz4nXQizS4GNfntFIz976CLq GpXY+YxPcsDCvV5JhcZRXnqhzID995CU4h/uW0DFsPdxe2HE1cOq46nqs9zu4w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1767098491; a=rsa-sha256; cv=none; b=bc9EJN9pLe/WWZ9l+WEnHHsERZsTvVrMAXA9Pxl11nkMGPxqdvMuOl8vXTxosqN1zA2dqS McWcLqrxXbZlK10bbO4VEy9Poc+2cU93tUScsS0MuBT29RfJzv3DGERtU9YHPXcQemBVd/ qXXitFDwG6W3Wazxrf4CuBdJOcKAxXd3K54v+QmNJO5RYegZ2Ik9QT3+SxjTcc1o97arvy VoRPwS/AUiN4fMl/mJTB/TRUEPcyjEMu9zIVM9XmYh5xpZaF7IzKMKnVcIt7Aa6LUBj1CF V3SGohT+zissAbzfxmWiSwjHL+4MpH8WbJJ15SoJZza7fWHWnpXFUcAMSQc71g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4dgXlG6yt3z11Vs for ; Tue, 30 Dec 2025 12:41:30 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from git (uid 1279) (envelope-from git@FreeBSD.org) id 39136 by gitrepo.freebsd.org (DragonFly Mail Agent v0.13+ on gitrepo.freebsd.org); Tue, 30 Dec 2025 12:41:30 +0000 To: doc-committers@FreeBSD.org, dev-commits-doc-all@FreeBSD.org Cc: GenericRikka From: Lorenzo Salvadore Subject: git: 5350f6a327 - main - Status/2025Q4/hpc-ports-modernization.adoc: Add report List-Id: Commit messages for all branches of the doc repository List-Archive: https://lists.freebsd.org/archives/dev-commits-doc-all List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: dev-commits-doc-all@freebsd.org Sender: owner-dev-commits-doc-all@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: salvadore X-Git-Repository: doc X-Git-Refname: refs/heads/main X-Git-Reftype: branch X-Git-Commit: 5350f6a327b01f00d9eda6006c03a197bfd57921 Auto-Submitted: auto-generated Date: Tue, 30 Dec 2025 12:41:30 +0000 Message-Id: <6953c87a.39136.135c100@gitrepo.freebsd.org> The branch main has been updated by salvadore: URL: https://cgit.FreeBSD.org/doc/commit/?id=5350f6a327b01f00d9eda6006c03a197bfd57921 commit 5350f6a327b01f00d9eda6006c03a197bfd57921 Author: GenericRikka AuthorDate: 2025-11-24 19:37:19 +0000 Commit: Lorenzo Salvadore CommitDate: 2025-12-30 10:58:57 +0000 Status/2025Q4/hpc-ports-modernization.adoc: Add report Pull Request: https://github.com/freebsd/freebsd-doc/pull/570 --- .../hpc-ports-modernization.adoc | 34 ++++++++++++++++++++++ 1 file changed, 34 insertions(+) diff --git a/website/content/en/status/report-2025-10-2025-12/hpc-ports-modernization.adoc b/website/content/en/status/report-2025-10-2025-12/hpc-ports-modernization.adoc new file mode 100644 index 0000000000..5e5f256333 --- /dev/null +++ b/website/content/en/status/report-2025-10-2025-12/hpc-ports-modernization.adoc @@ -0,0 +1,34 @@ +=== FreeBSD HPC Ports Modernization: Slurm 25.11 and Unbundled PMIx/PRRTE + +Links: + +link:https://cgit.freebsd.org/ports/commit/?id=1536bac0dd26d81e315652929b8bfaff9c136089[sysutils/slurm-wlm: 23.11.7 → 25.11.0] URL: link:https://cgit.freebsd.org/ports/commit/?id=1536bac0dd26d81e315652929b8bfaff9c136089[] + +link:https://www.freshports.org/net/pmix/[net/pmix: Process Management Interface for Exascale (PMIx)] URL: link:https://www.freshports.org/net/pmix/[] + +link:https://www.freshports.org/net/prrte/[net/prrte: PMIx Reference RunTime Environment (PRRTE)] URL: link:https://www.freshports.org/net/prrte/[] + +link:https://www.freshports.org/sysutils/py-clustershell/[sysutils/py-clustershell: Python framework for efficient cluster administration] URL: link:https://www.freshports.org/sysutils/py-clustershell/[] + +link:https://kavocado.net/reports/[Kavocado Monthly Status Reports – FreeBSD HPC notes] URL: link:https://kavocado.net/reports/[] + +Contact: Generic Rikka + +During this quarter, a significant amount of work has gone into making FreeBSD a more practical target for modern HPC clusters by bringing key components of the Slurm + PMIx + PRRTE stack up to date and available as first-class ports. + +==== Work completed + +* Updated package:sysutils/slurm-wlm[] from 23.11.7 to 25.11.0, tracking the latest upstream long-term series and drastically reducing the number of local patches required for FreeBSD. +* Refreshed the Slurm rc.d scripts so that `slurmctld` and `slurmd` integrate better with a typical FreeBSD deployment (configurable config/log directories, pidfiles, status and cleanup helpers). +* Introduced package:net/pmix[] and package:net/prrte[] as standalone ports, and switched package:net/openmpi[] to use these unbundled runtimes instead of the copies shipped inside the OpenMPI distfile. + This aligns FreeBSD more closely with how many Linux HPC distros package the MPI runtime stack. +* Added package:sysutils/py-clustershell[], a Python framework widely used for scalable cluster administration, providing FreeBSD users with a familiar tool found on many production HPC systems. + +==== Work in progress + +* Iterating on additional Slurm integration improvements (plugins, defaults, documentation) to make it easier to deploy Slurm on FreeBSD in real clusters. +* Extending the HPC userland stack with further tools such as test frameworks and job-oriented utilities, so that FreeBSD can serve as a realistic development and validation platform for HPC software. +* Porting package:sysutils/mpifileutils[] and its dependencies (package:devel/libcircle[], package:devel/lwgrp[], package:devel/lwgrpd[]) to provide MPI-parallel file utilities commonly used on large HPC filesystems (currently under review). +* Adding and refining HPC-oriented Python tooling, including package:benchmarks/py-reframe[] (HPC regression testing framework) and continued work around package:sysutils/py-clustershell[]. +* Initial work on bringing package:devel/spack[] to FreeBSD as a complementary tool for HPC software development and experimentation, with the goal of improving compatibility with existing HPC workflows. + +==== Future plans + +* Continue tracking upstream Slurm, PMIx and PRRTE releases closely so that FreeBSD remains a viable target for sites that expect a modern MPI/Slurm stack. +* Document a “reference” Slurm + OpenMPI + PMIx + PRRTE setup on FreeBSD, to lower the barrier for new sites that want to experiment with FreeBSD in an HPC context. +* Identify and address FreeBSD-specific gaps or regressions to ensure the software stack remains feature-complete and robust on FreeBSD.