From nobody Sun Dec 31 12:46:06 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T2zPk43Ccz55gxn for ; Sun, 31 Dec 2023 12:46:18 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T2zPk3XY2z3cPp for ; Sun, 31 Dec 2023 12:46:18 +0000 (UTC) (envelope-from theraven@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704026778; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=6wk5dfQjYB7DeIxfBIon3KqgxFkEgdml+Z8BqQos+Uc=; b=neaivBHcSXYNMlYyefrrYEuStcOZvC9SgdIrxL5wPHnaJR6rYhhx4ECT4TWA5+SrJqTPOY Xfck2nXrKsCsImEw0GOkgK+A8ZBkigFed3GbZ/cKcnyd6LPXEN7YNJf4aw1V1Xz7yNYtAZ Nb8kwz6n027SBI2K9yiruGGvqHd4qS2fiG/N123WnteMGDngHxT2p/shcLVVN0K3HrE6xD 5pCVkVTY2rX7qndreidcmODgXet5UMnNqjW0X1mCvm1svu+xe/6BNphXmlBEnl6j3qoeZd iT9e0Z2hLY28enRVENUwOwgHL+f33WItT5Jmxh6pxLbdF1dzorNnvJZmxUV0+g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1704026778; a=rsa-sha256; cv=none; b=bfFz6rfBK7hj2zwwHk34L5ew9AxwGK1nzupzpW9NYxzwxYuWW6+r8spr0Sx+MZU5y06++G i0GOyhnxn4HdZwtdCLh4bYNnGQhCqQeP6HBWj3dvRXfDnAnq45qU6xPyaDELf3u2PXP2xU 1UcEdxA9ZFNAEhVKsOnhY0EEchbeon/ugYHBPIr6pmXB/e3Q2Nzlvl6M8BLnicsa+vP4Xv 524ooRJRHQ5ppR1yflylvgV7PL7dnMrm0jzVSaFeu1SWpyH1EMK/kLLOkH8/XwgVboRoMr dQFA5nQ/u6FXqOaTkynGtZwjxd/F7vTc2biK4S/uMscjJVDynImI0GE9x09HyA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704026778; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=6wk5dfQjYB7DeIxfBIon3KqgxFkEgdml+Z8BqQos+Uc=; b=vynei59D0eGfF0xSL7Qcnoh51Efky/u4l9rcRHAJE3EbQ7M4yQ4KpU+GsytdDeEVK+C9E/ S4rDQw9VdKXRWSgxYqxytjiPaSX4iNwxIU4QurtVLrQhUlexHxIYLo+NFBujEtlUbJPa8P qoVymkipEjOg+i0OX7uVTrWWyq2LXYIW6XRvKxBiQLgJJJc9Qd0zS72mGMQJjHY7VTwngd f4yl1L+zBm6qpRhg4sC9WFzuDTmDClOs/mOLOsTW5xWAecuwNDpecWQ5K77rq2Qzse4PCs v1SD+I/kdRAbpwrWdhCTfTZLKEKzzKnnwGHjiZVGBqsy9+i7sMeo5WpsLe4jCQ== Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T2zPk2R7CzCGk for ; Sun, 31 Dec 2023 12:46:18 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtpclient.apple (host86-151-98-83.range86-151.btcentralplus.com [86.151.98.83]) by smtp.theravensnest.org (Postfix) with ESMTPSA id C14FAA258 for ; Sun, 31 Dec 2023 12:46:17 +0000 (GMT) From: David Chisnall Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.200.91.1.1\)) Subject: Is anyone working on VirtFS (FUSE over VirtIO) Message-Id: Date: Sun, 31 Dec 2023 12:46:06 +0000 To: FreeBSD Hackers X-Mailer: Apple Mail (2.3774.200.91.1.1) Hi, For running FreeBSD containers on macOS, I=E2=80=99m using dfr=E2=80=99s = update of the 9pfs client code. This seems to work fine but Podman is = in the process of moving from using QEMU to using Apple=E2=80=99s native = hypervisor frameworks. These don=E2=80=99t provide 9pfs servers and = instead provide a native VirtFS server (macOS now ships with a native = VirtFS client, as does Linux). =20 I believe the component bits for at least a functional implementation = already exist (FUSE and a VirtIO transport), though I=E2=80=99m not sure = about the parts for sharing buffer cache pages with the host. Is anyone = working on connecting these together? David From nobody Sun Dec 31 14:35:37 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T31r76ks4z55sdK for ; Sun, 31 Dec 2023 14:35:51 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ua1-f43.google.com (mail-ua1-f43.google.com [209.85.222.43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T31r7513Jz4Llm; Sun, 31 Dec 2023 14:35:51 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ua1-f43.google.com with SMTP id a1e0cc1a2514c-7cbf98dd9efso5188452241.1; Sun, 31 Dec 2023 06:35:51 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704033350; x=1704638150; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=+H5u+6xVnb6Zjn4zioo/5HXxGi+uW+dexlPpRCN+CFQ=; b=ZgKqtpFZHOZKlkzGYIgHJWlSMHzQO2Lk/5A5DV6lAGt0CD00apLYxKyDWAEsFDTUs9 M4T9ShAwTe/eCBdx4ganIwwND9iBfmB9Z/Z0m/6/zwmz0X8Ov7zLKeXCjX0ryb3zaZpF msJ7yEPlpwV4osDWBc0+FmxmdKxmTS8/X8hQDq/H042kW0lu2JyDkOTJUnxuo20s1UoL EyHPFIXoocB4oUSvmsit+aGVcTRwHpsE8T7rxYn7wRu+AKWynvl8eEigW+YQ36SfyuMF HP2bdXJUDg7w0x1iYG1HtRPze2Bm7CgWtlRbGX+3BbGmpIaqT6BY0G3oYR/RyWbljL/e V8cQ== X-Gm-Message-State: AOJu0Yy/xYgAYSek3hGDjm+t2o6525Hdv76Y5kyJ3z0NXY7N9a+v51UH vhw2Ea0Pn1YKQCEvACyDujrU6ablIVSQMO7M4vUrb/iJ X-Google-Smtp-Source: AGHT+IEru7zaOdy4OPpQ9nRSA5wbZDoTlYbatTr3aJrh6ovaUh0qR8btWQ0+OfzR6AZfApMoCeZ8nvXZUH4XRX4kiOY= X-Received: by 2002:a05:6102:4b16:b0:467:6d5b:bb14 with SMTP id ia22-20020a0561024b1600b004676d5bbb14mr1294988vsb.31.1704033350114; Sun, 31 Dec 2023 06:35:50 -0800 (PST) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 31 Dec 2023 07:35:37 -0700 Message-ID: Subject: Re: Is anyone working on VirtFS (FUSE over VirtIO) To: David Chisnall Cc: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4T31r7513Jz4Llm On Sun, Dec 31, 2023 at 5:46=E2=80=AFAM David Chisnall wrote: > > Hi, > > For running FreeBSD containers on macOS, I=E2=80=99m using dfr=E2=80=99s = update of the 9pfs client code. This seems to work fine but Podman is in t= he process of moving from using QEMU to using Apple=E2=80=99s native hyperv= isor frameworks. These don=E2=80=99t provide 9pfs servers and instead prov= ide a native VirtFS server (macOS now ships with a native VirtFS client, as= does Linux). > > I believe the component bits for at least a functional implementation alr= eady exist (FUSE and a VirtIO transport), though I=E2=80=99m not sure about= the parts for sharing buffer cache pages with the host. Is anyone working= on connecting these together? > > David Nobody that I know of. And while I understand the FUSE stuff well, I'm shakier on VirtIO and the buffer cache. Do you think that this is something that a GSoC student could accomplish? From nobody Sun Dec 31 15:24:50 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T32x072npz55xxq for ; Sun, 31 Dec 2023 15:25:08 +0000 (UTC) (envelope-from theraven@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T32x04jxrz4RL5; Sun, 31 Dec 2023 15:25:08 +0000 (UTC) (envelope-from theraven@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704036308; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HibMLCyBPf5AIs0QGDw1UwxAmQFNQEAgiHZvRGa7B7g=; b=ZHqTV7Yr+c5Om3h16Sob1wukry1FBzSGJ708U7k89hmfqyNcZUTjaYmvbOUMUYxDNBh6Pc xOGxGdWyPhW4QEc8QO3pLcbTXnrwpGledGCRQyp3KwZd76aUV2WUdDO+kkBlpaIN5S/dV9 6GRKfvFzrqOTL/xt7aIWCh+sESeErSdjaQ/rspiCdeVeZSpQalSZWs6/3XuDmic/vGp5B+ ke5/6/yud0+dxOQRwjooBVp5vVfEX3FhuAAO4kV+n9ubahDq6S2AlWSTG3sxQ8RzNeC1cm LBVgL97eWBCobpLfXr0dzHRSeaT4lXu/0iW+pUKHtfIQGPXB19uYUBBJgJIj1Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1704036308; a=rsa-sha256; cv=none; b=YguN9bmalqCmlUjK1zDQOcFe4CRDr5MtasMYApeWxMtk8YwgAKaOlcCGLxlYwXIdOzOUmG AS801QGPfd4qXsJ1rKCuOKTmtIx3YysppGArw9GFIJzbHAc8xr+x4wd0aft/boYj1dEkR3 UuU9dYxJ+GjdCHaKCMWwOrhYKrz4K1+uIQYi7YkByF4XOv+S4s4JkQQ/V+kqYZ7nu77z0q FJMfUo9VNxkfJ/MqCuPzyZbdPqVT5FOnqrAatRFIM4eiHjz7p4y/1IDSMbwFhB7cUPiwTp M+fc/hzWzU9iVYupncInV2Yy887Xpzi/7aqsZTuYkCOf6e3YsSIfMw9OCgW+6g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704036308; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HibMLCyBPf5AIs0QGDw1UwxAmQFNQEAgiHZvRGa7B7g=; b=HV+qRqBKiAe2RL8ZRbs9i6v17NMjzK8uZFZLwB4lNpVL7OZ9Z3/GQn4HeHqMcNBVHdNbEz CqAyy1ljGPcW8seiIqsd+CRM3FChJGM/bvMSzIcTV2zx2ohjUp7V0WAmeuXYvDMUYFbHi1 b8hPJnAUQrJO7+6Bo9We2P+bd2cvyOt6S7FrUB2VEH/1Np/G4VahkmYOeBC6y51K1aiU/Z sAoLe7QcOpAJfZZvfGZA/2zS/Z7vkaZDmldtzweGwktCvhcdtrkwQK/KNLTiHRtbm9yOfH TDfiaoLgKO0FChbWcHh5SNbk72du3DHnRaYNvTznUHc/M7WV5qKWpBFIyzUigw== Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T32x03f9yzlWK; Sun, 31 Dec 2023 15:25:08 +0000 (UTC) (envelope-from theraven@freebsd.org) Received: from smtpclient.apple (host86-151-98-83.range86-151.btcentralplus.com [86.151.98.83]) by smtp.theravensnest.org (Postfix) with ESMTPSA id 2ED22A25A; Sun, 31 Dec 2023 15:25:02 +0000 (GMT) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: David Chisnall List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: Is anyone working on VirtFS (FUSE over VirtIO) Date: Sun, 31 Dec 2023 15:24:50 +0000 Message-Id: References: Cc: FreeBSD Hackers In-Reply-To: To: Alan Somers X-Mailer: iPad Mail (21C62) On 31 Dec 2023, at 14:36, Alan Somers wrote: >=20 > =EF=BB=BFOn Sun, Dec 31, 2023 at 5:46=E2=80=AFAM David Chisnall wrote: >>=20 >> Hi, >>=20 >> For running FreeBSD containers on macOS, I=E2=80=99m using dfr=E2=80=99s u= pdate of the 9pfs client code. This seems to work fine but Podman is in the= process of moving from using QEMU to using Apple=E2=80=99s native hyperviso= r frameworks. These don=E2=80=99t provide 9pfs servers and instead provide a= native VirtFS server (macOS now ships with a native VirtFS client, as does L= inux). >>=20 >> I believe the component bits for at least a functional implementation alr= eady exist (FUSE and a VirtIO transport), though I=E2=80=99m not sure about t= he parts for sharing buffer cache pages with the host. Is anyone working on= connecting these together? >>=20 >> David >=20 > Nobody that I know of. And while I understand the FUSE stuff well, > I'm shakier on VirtIO and the buffer cache. Do you think that this is > something that a GSoC student could accomplish? I=E2=80=99m not familiar enough with either part of the kernel to know. A co= mpetent student with two mentors each familiar with one of the parts might, b= ut this is increasingly strategically important. The newer cloud container-h= osting platforms are moving to lightweight VMs with VirtFS because it lets t= hem get the same sharing of container image contents between hosts but with f= ull kernel isolation. It would be easy to plug FreeBSD in as an alternative t= o Linux with this support. The VirtFS protocol is less well documented than I=E2=80=99d like, but it ap= pears to primarily be a different transport for FUSE messages and so may be q= uite easy to add if the FUSE code is sufficiently abstracted. David From nobody Sun Dec 31 16:19:23 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T347t4RWCz563Mp for ; Sun, 31 Dec 2023 16:19:38 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lf1-x135.google.com (mail-lf1-x135.google.com [IPv6:2a00:1450:4864:20::135]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T347t1yrTz4XJ0 for ; Sun, 31 Dec 2023 16:19:38 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x135.google.com with SMTP id 2adb3069b0e04-50e7aed09adso6062334e87.0 for ; Sun, 31 Dec 2023 08:19:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1704039575; x=1704644375; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=xnD4fLRQ4yCJsZWkDyz2WxR1quabROy3rQ+nAKyIVdc=; b=m9VVciVbmqvF8jNn5ftbfDMmsZn456u2td+6bybjOXlrg8A7zD6g5YLzBYIxqP0d9l Xs4LhgKVpXXd6ghkk0MP+7f9M39rBcM6yEJmGn44m9N9P7gbOmMu8fveLfXVFCyUi6UA ElmDrVfNSkDfNijIY2sxsuYDCyPNl8UZN26z3CaqXpnoc0Mee5XUBcNJVR2/c1kAhrRQ R43Xpd6Ru+P9PUw9ncW1BRXzpik7tD+f2zowr7r9CFiMmb8TwVXWqzfXVewvoPYdReYO jS2miA8oojZE0eWhPjtEoEX3Jvv11mRSGemtE6rwt9yutYr1yYKC7t0rdFGHMVCDhh4U 6MoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704039575; x=1704644375; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=xnD4fLRQ4yCJsZWkDyz2WxR1quabROy3rQ+nAKyIVdc=; b=CzCxpGLRjAjhfoq8RRFR0NRAtn4cX68CW+hCCJjvgyQWWwkKCGOC0Tf5MZ/ODEW0kX G4yEV2XYk/kutTmjkDKNGNc0jHV1qWvJDw/io9cg7FMUzGIKBIaI6JcqcmvB0oIoqIZ3 LgSu4av+WHQn/UeqxmwqIRiSIo8400zVKB/2Va5NfGufr2puUZ75wm3P0gHKkGpaE6X8 z0UbZqmnMI5qW2za9vBuQBs+HQ04GrhXRCTE1j3R/633gX5ouA/brNMhhpVdNnh7gIHh UHjZHI1oYEx+V1VrzjNs+TZeb4c55e5JombdPQcv5sdO+lYfMz/IiS85phaFKiD4BPmz 8U8A== X-Gm-Message-State: AOJu0Yx+0m8UmVd8/AIWY8Tk1VK0192pQZght8G8riTyLlDG+ZyqIl/w 474+s4oObea2HMloYsO1a3f6dUaQeEUHzWiEPFaskSfqm6rOTi8srcEb2rgvbPA= X-Google-Smtp-Source: AGHT+IHbH3gtb37FHcVCsqONi2TFAq/hiUdj5AcS5rTJnAErHC+o/aU2yZ3jzoudD2auQTOuOZXacXlA919nYf4jjWE= X-Received: by 2002:a05:6512:b94:b0:50e:8e98:c25c with SMTP id b20-20020a0565120b9400b0050e8e98c25cmr2891827lfv.70.1704039574575; Sun, 31 Dec 2023 08:19:34 -0800 (PST) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Sun, 31 Dec 2023 09:19:23 -0700 Message-ID: Subject: Re: Is anyone working on VirtFS (FUSE over VirtIO) To: David Chisnall Cc: Alan Somers , FreeBSD Hackers Content-Type: multipart/alternative; boundary="00000000000086acec060dd0a1c3" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4T347t1yrTz4XJ0 --00000000000086acec060dd0a1c3 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Top posting: I think you mean VirtioFS, not VirtFS. The latter is the 9p thing that dfr is doing, the former is FUSE over VirtIO. I'll assume you mean that. On Sun, Dec 31, 2023 at 8:25=E2=80=AFAM David Chisnall wrote: > On 31 Dec 2023, at 14:36, Alan Somers wrote: > > > > =EF=BB=BFOn Sun, Dec 31, 2023 at 5:46=E2=80=AFAM David Chisnall > wrote: > >> > >> Hi, > >> > >> For running FreeBSD containers on macOS, I=E2=80=99m using dfr=E2=80= =99s update of the > 9pfs client code. This seems to work fine but Podman is in the process o= f > moving from using QEMU to using Apple=E2=80=99s native hypervisor framewo= rks. > These don=E2=80=99t provide 9pfs servers and instead provide a native Vir= tFS server > (macOS now ships with a native VirtFS client, as does Linux). > >> > >> I believe the component bits for at least a functional implementation > already exist (FUSE and a VirtIO transport), though I=E2=80=99m not sure = about the > parts for sharing buffer cache pages with the host. Is anyone working on > connecting these together? > >> > >> David > > > > Nobody that I know of. And while I understand the FUSE stuff well, > > I'm shakier on VirtIO and the buffer cache. Do you think that this is > > something that a GSoC student could accomplish? > > I=E2=80=99m not familiar enough with either part of the kernel to know. A > competent student with two mentors each familiar with one of the parts > might, but this is increasingly strategically important. The newer cloud > container-hosting platforms are moving to lightweight VMs with VirtFS > because it lets them get the same sharing of container image contents > between hosts but with full kernel isolation. It would be easy to plug > FreeBSD in as an alternative to Linux with this support. > We shouldn't pin our hopes on GSoC for this. If it is important, it needs to be funded. > The VirtFS protocol is less well documented than I=E2=80=99d like, but it= appears > to primarily be a different transport for FUSE messages and so may be qui= te > easy to add if the FUSE code is sufficiently abstracted. > Yea. The FUSE protocol is going to be the challenge here. For this to be useful, the VirtioFS support on the FreeBSD needs to be 100% in the kernel, since you can't have userland in the loop. This isn't so terrible, though, since our VFS interface provides a natural breaking point for converting the requests into FUSE requests. The trouble, I fear, is a mismatch between FreeBSD's VFS abstraction layer and Linux's will cause issues (many years ago, the weakness of FreeBSD VFS caused problems for a company doing caching, though things have no doubt improved from those days). Second, there's a KVM tie-in for the direct mapped pages between the VM and the hypervisor. I'm not sure how that works on the client (FreeBSD) side (though the description also says it's mapped via a PCI bar, so maybe the VM OS doesn't care). Now, having said that it's a challenge shouldn't be taken as discouragement. I think it's going to take advice from a lot of different people to be successful. It sounds like a fun project, but I'm already over-subscribed to fun projects for $WORK. I cast no doubt on its importance. Warner --00000000000086acec060dd0a1c3 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Top posting: I think you mean VirtioFS, n= ot VirtFS. The latter is the 9p thing that dfr is doing, the former is FUSE= over VirtIO.=C2=A0 I'll assume you mean that.

On Sun, Dec 31, 2023 at 8= :25=E2=80=AFAM David Chisnall <t= heraven@freebsd.org> wrote:
On 31 Dec 2023, at 14:36, Alan Somers <asomers@freebsd.org> wrot= e:
>
> =EF=BB=BFOn Sun, Dec 31, 2023 at 5:46=E2=80=AFAM David Chisnall <theraven@freebsd.or= g> wrote:
>>
>> Hi,
>>
>> For running FreeBSD containers on macOS, I=E2=80=99m using dfr=E2= =80=99s update of the 9pfs client code.=C2=A0 This seems to work fine but P= odman is in the process of moving from using QEMU to using Apple=E2=80=99s = native hypervisor frameworks.=C2=A0 These don=E2=80=99t provide 9pfs server= s and instead provide a native VirtFS server (macOS now ships with a native= VirtFS client, as does Linux).
>>
>> I believe the component bits for at least a functional implementat= ion already exist (FUSE and a VirtIO transport), though I=E2=80=99m not sur= e about the parts for sharing buffer cache pages with the host.=C2=A0 Is an= yone working on connecting these together?
>>
>> David
>
> Nobody that I know of.=C2=A0 And while I understand the FUSE stuff wel= l,
> I'm shakier on VirtIO and the buffer cache.=C2=A0 Do you think tha= t this is
> something that a GSoC student could accomplish?

I=E2=80=99m not familiar enough with either part of the kernel to know. A c= ompetent student with two mentors each familiar with one of the parts might= , but this is increasingly strategically important. The newer cloud contain= er-hosting platforms are moving to lightweight VMs with VirtFS because it l= ets them get the same sharing of container image contents between hosts but= with full kernel isolation. It would be easy to plug FreeBSD in as an alte= rnative to Linux with this support.

We = shouldn't pin our hopes on GSoC for this. If it is important, it needs = to be funded.
=C2=A0
The VirtFS protocol is less well documented than I=E2=80=99d like, but it a= ppears to primarily be a different transport for FUSE messages and so may b= e quite easy to add if the FUSE code is sufficiently abstracted.

Yea. The FUSE protocol is going to be the challen= ge here. For this to be useful, the VirtioFS=C2=A0support on=C2=A0the FreeB= SD=C2=A0 needs to be 100% in the kernel, since you can't have userland = in the loop. This isn't so terrible, though, since our VFS interface pr= ovides a natural breaking point for converting the requests into FUSE reque= sts. The trouble, I fear, is a mismatch between FreeBSD's VFS abstracti= on layer and Linux's will cause issues (many years ago, the weakness of= FreeBSD VFS caused problems for a company doing caching, though things hav= e no doubt improved from those days). Second, there's a KVM tie-in for = the direct mapped pages between the VM and the hypervisor. I'm not sure= how that works on the client (FreeBSD) side (though the description also s= ays it's mapped via a PCI bar, so maybe the VM OS doesn't care).

Now, having said that it's a challenge shouldn&#= 39;t be taken as discouragement. I think it's going to take advice from= a lot of different people to be successful. It sounds like a fun project, = but I'm already over-subscribed to fun projects for $WORK. I cast no do= ubt on its importance.

Warner
--00000000000086acec060dd0a1c3-- From nobody Tue Jan 2 03:26:37 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T3yv52b1fz564mw for ; Tue, 2 Jan 2024 03:26:41 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T3yv521yXz4Tgc; Tue, 2 Jan 2024 03:26:41 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704166001; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MkroFJAGzg9sbfh4xI8pZB6thCvxLupNi/PFRSd0Juc=; b=c0EJz4JAQLOGDvLZCofoCnAZr8Lhkqu8PeEd1ADMk3qc/k2yFjC6ck9Ra8XKQ/jA9seLc1 jf4RUR32OSjocDHnI7BrXeDsExuiX1XoBU7xIxdBUSTN+cLP5oVtoM+XrJkThfsVdx8zn/ fMtMyDOHesRfN+REEPaL0WiJalULrHxd0JFosDcc7MV72Iirl7RyvuCBizx2T02lo7NrSZ 8hbpXnOA5JnqZKzmaC9Hcuegec7o0EqUk3WQ7dSj9C9xMILqsoipDS6L+8gW1Djo4iQLAS 8wkO6lIGBQLqE+4r5wdyMR91Jas1ZFoLYfgpe+apBwAZgGIFXGpW/+h7oHi2hA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1704166001; a=rsa-sha256; cv=none; b=BBCYlgpwR3ffrX7pV4s6c+D4lcwK6gKqR0eGDn4LnxWulmPZI12G27RpPP9RUI7L2Hcr/v ppTiX2Cbq2YQcdYdO4wnRSTS5Gg48LoobgxAKBGVUkDuuGaLavFNWglhXAP5FSgVb9D1WO bSXz5KhoxDmugwJvnLfAkz7Zu4RuFnH4EXJ4qq2uHZIRbJbMJ8GdNliL5644fhmx3rv4Ua jZ1F6FFD8fVOlrnP3oWnakbVwmTqcnXJx9ldECvYI9uTnJ2kzagK9vUfAfCPWyHthnOypi kTkkyKsvBb7h/bJmZKa7KyaywhVJmuVwQaL6J37kbaeLjv6mfblp23fHxdCpXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704166001; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=MkroFJAGzg9sbfh4xI8pZB6thCvxLupNi/PFRSd0Juc=; b=PPT7pHYq7LSozLuWdtJZwwHTgHlxNgeov4A1qW07bcr/FASAD9qJ/oJnSDlOKEnqMY7EUm XeZvJpTohyKraFRiTnIc9pjd45ZLqoQl6t4vrvEt5isfbqfJW2pfQ4mOe8oSfWNuKOuqFI xwsX/DO5Qij9Hr6ip1b7eC2l4nCgiBIS/vXBQ6Vpv8emdSP8BMcCvs6MspxKEpRAACyUY9 /hNbu2D39/+cfIJHrhJgU5BQizjHVjksKGwvj4r0P7aDF10qBPSSi37g4ivGZ+Yo1TF8NI 0qR0LtpgsG05DdhvLJJN+pUY+0Lf5eVJrtzsbu2xamUa03byiBoaquc+IIE0gA== Received: from auth1-smtp.messagingengine.com (auth1-smtp.messagingengine.com [66.111.4.227]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T3yv50tLBz6m; Tue, 2 Jan 2024 03:26:41 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailauth.nyi.internal (Postfix) with ESMTP id 9BC6127C005A; Mon, 1 Jan 2024 22:26:40 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Mon, 01 Jan 2024 22:26:40 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdeguddgiedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffokfgjfhggtgesthdtmhdtredttdenucfhrhhomheprfhhihhl ihhpucfrrggvphhsuceophhhihhlihhpsehfrhgvvggsshgurdhorhhgqeenucggtffrrg htthgvrhhnpeegfeevgfejueeggfefffdtiefgteefkeeghffgheeugeelveetvdetgeel gfelvdenucffohhmrghinhepuggrnhgprghtpghlrghnghhilhhlvgdrohhrghdpfhhrvg gvsghsugdrohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhl fhhrohhmpehphhhilhhiphdomhgvshhmthhprghuthhhphgvrhhsohhnrghlihhthidqud duieeivdeivdegkedqvdefhedukedttdekqdhphhhilhhipheppehfrhgvvggsshgurdho rhhgsehtrhhouhgslhgvrdhish X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon, 1 Jan 2024 22:26:39 -0500 (EST) From: Philip Paeps To: Mark Millard Cc: dan@langille.org, FreeBSD Hackers Subject: Re: list of valid ABI combinations Date: Tue, 02 Jan 2024 11:26:37 +0800 X-Mailer: MailMate (1.14r6014) Message-ID: In-Reply-To: <6BD2CBAF-7ADC-4ADC-B8F0-1280FECEC155@yahoo.com> References: <6BD2CBAF-7ADC-4ADC-B8F0-1280FECEC155.ref@yahoo.com> <6BD2CBAF-7ADC-4ADC-B8F0-1280FECEC155@yahoo.com> List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed On 2023-12-07 23:03:33 (+0800), Mark Millard wrote: > Dan Langille wrote: >> My goal is to automatically maintain this table, from which >> FreshPorts fetches package information: >> >> freshports.dev=# select * from abi order by name; >> id | name | active >> ----+----------------------+-------- >> 9 | FreeBSD:12:aarch64 | t >> [...] >> 53 | FreeBSD:15:riscv64 | t >> (31 rows) > > The name list in the middle (/bin/sh context): > > # fetch https://pkg.freebsd.org/index.html > index.html 3606 B 103 > MBps 00s > > # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@' | > sort > FreeBSD:12:aarch64 > [...] > FreeBSD:15:powerpc64le > > There might be issues at times with https://pkg.freebsd.org/index.html > not > being in sync. As far as I can tell, that page is manually maintained. clusteradm updates that page to match what we're actually distributing. If it doesn't reflect reality, that's a bug, and we'd like to know please. :-) Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From nobody Tue Jan 2 04:38:47 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T40Xz31JNz56Cs0 for ; Tue, 2 Jan 2024 04:41:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-35.consmr.mail.gq1.yahoo.com (sonic315-35.consmr.mail.gq1.yahoo.com [98.137.65.59]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T40Xy5vHfz4gL5 for ; Tue, 2 Jan 2024 04:41:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1704170464; bh=kMnHvYWJCk4mrwvvxTQXwPfIab4ua+xp3NbfeLe1Bk8=; h=From:Subject:Date:References:Cc:In-Reply-To:To:From:Subject:Reply-To; b=GqOIa8kwSK+U/10VbR1iYoDIRzLOhOd+en6bH1q4VLg55WS3HouLLG0/j9ScR4AEBMSukNRVIvPS6Vus2/IVMsexdc5nf8McYy1eRJynjZik7SRp6ckivkWnacDzNYwH0Rh7R71/j3CsD1zfyKUgXPy7rR5tPHj7hT6vDJhZ4kqvgQV/0EpN276dRqFoNNlMs7Ii/Asn2OrImpc7fQT6b1f+ot7YCGSTQDmadwpnYPz2Ss5oWdDj4f2OvSf+y0dyMA13oIpIJ4JEtMSPOdeETjfI9mSmD+XV2/NTW7KmbuTexqjRXOP1cP/URSwDV94tLfo9ahnlG2G/L+7ahAGjIQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1704170464; bh=E3xPBz7Bob9GdPQW0UvSS3/Yus+oaglyOFWyN6XcAKL=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=hAEblUMHoBlCSFS5RiV4rAVoONheWGybzfXypeh5uGJdfANVrfgD/j9TeITeNAOahobioq1N5ui4LgOqP/iL2j34rK5ToKOULJl1awE8wLbhGobcXWljcEhcFTN27IzbVp2s96S2FpxRb0c9YkgSOFohMBwANQ+N2uqCrMYqCfJJZNWfp5xKrUpWmiRs5FYDTZbC+lxQ/6XuYTdqiK4xzQ3zwoiAXdPh2TcgtebPR8d7wwyC5dJgGGlxiAY9+iyK3B/GGvNtizHwMumaj+0hOE5G/qGxUEynesBIvpE/ClDXjEGdVgdHntwe8lNWKWpnVF7TVaAfG/J25Hbjv64bUw== X-YMail-OSG: TBWDuNAVM1lZZlUiwdrpEQ4YWprYi9ciGHJElOXDCn_KvTN_TaqEnUg5vIStjq0 AS2EI0AyR4DaCNfSrnvriiEWZgU_ePmFQSpmQ.a1AVZY8cFGYRBX0eXlb5dZqkcQ2p_XopXa1eSP gEsN0zFeXJCT4g75vSsmRqdq_DxxG2nydpPhWVIAkcpDadhdbbUX4IL96jBiTj_0xmZFuwicuyDC of8BC1Y1Mn1qHAfQ2BFFb5jjBaZnCzKAv0s6hpMEpeuRuQpe52Va.c.AXY6fBKHTz9B0Ugi1hhdz QAUw9OonsTzHq2A17hCDHxOhSkWP2kjR71iTjxyErvL07xz2zksG3fQb7iPhGjc5o6tmBFod.L24 m6xsSZBGo6jPDPjM09dLhDAhjr4aVi5b68b_QR3veGLIIabttQe3G4LtCxL2EDdO2KipAB9G1g3U yqeG_r53W4RafN6MXgeYk9gvP8Chc93pHxsoq7SbWVbXxSHFzVlBd82ilatjmHE9BzeqRP1iuPpo rgApVKFVtTO547ZnlTQTo4prqH9CalJdxXvDoRP6HSjJgJGdpmDUhQyHn8wAXxu59UesB23tr7U2 UgOzpej3k.RlmD7dSUJ86Q9BI4tsQKSv7dQBj.SMTIA81fONg4zextzm89IGj4EMUhZ7xBGGVuRx cPOR._ooFZPNNWjNqjKYZA6Y77GNGb6jp29i3tD9F4kmdn3mUkifgyG60IThW8ajH2n8zCMgBq31 kEFqvh7rTHW99Xf8IStX5ylLta.jneSDjLiii4nUkRusDOPxH_bL.5OPOCnqsxkofE08XvM4_Esb 7fdGhSLfB1HPwgYM8PQHZgm3XnTG08Wf2YUSpUvZE_Fx.VY5uXPunM_RgmS2z5nRc0IuKE67kJbw 2lVNiG3VlFjukaJYhPqjWGo2S0OUQQ2PQ5Kd5ovPaupG2.Huv.5gunxGgldDmmEwFuVuWuQ.v.f1 NrPL5QOetx1XE_QqtalLxqUOoee9xftXkkxGphAFwlC60E.5rVkwo0FXZaRv9hm07ZUX75xx1i1e J9KiktKRGQtwfvxgBSmyRIWzJQIbPqX8j8AA72g3ndSo6IUImcTe_9vxaucgJYO7kXSXKhdqJq59 HCPhnJfoaemAUEH2mSkR6DkPd7LnnEFtADwf3mxJDPIhN6nUlZ5OgVvH22TR._WtmjCGbve5Tfrw oiSWluZ.TpuYf_6suiSXXlMnEuvLR3Gb9h4bUDVWCFbZ_lacfdECIw.VrmeFIaPMnqg.RO9BvMol NOCPjn_gN8YmNSRBNw3IYtYW3r0OJCSw8G.VmT33r1LubfnL1B3sWayK.5xJmXzw2anjcmgPoWd. pQ9EN1Ya8uVR9DLh3G4xbreDgNEqf7NzwgE0Kf38WeBzQUhSMQgrk7Cl2tfk5ppoKpPXj6uqrkza Uq67s2utvmNEz4HW2shXxCZ.8jfoOtgi5Mrxd3DrFvDZ.woVKDcf18ziWXEU1vwb9RZcvkUhODWn 6AMvZYjfUcnwNdX_l5teIXuh9nYUTUNd5Xt77viC2jsOHPp2J7Tm3XahognBCmnNwAnabpK9wuFI ZzpcZUY4LgvGAD0798VChR7gnFbuAH0OF6UV.m5zFIf7PzDqt4dLwD3VvZUgU8FcJKi7nzPQnFkA 1WFV2D1FNdtbwfkgJuo4kakk0X5zI0vbKMPfpRYThQL5SGzIszKJuOkJePAJl.WFaOZ2rRWGqpvi FWLz0ENq.lIs6fQl3d0drZt6ul_ZQi6r3NNBMQmIagDwTWhp7Xe9w9FHH79ujDAumXtAP0yIw7xc B0EpTec9.h_Xmvh5NZV9oQ2bcXPjhTVhfqMMfgrkcz2O9GHimegz_dduIZ4mIlaAFhcWfLpbYs_2 kI1.gyZGEyOzTciQmRsCdng9hQmflClZvSFv5bdQs1MSSQCRo9p0z1RV8yvnoyQTPIfosxs2xA9r c1Zf3fx_RCVon8hBlULJ9QJf.Y75S763SR3acbvNMOuYmTRwAzAZ49aD2H0IqzyOYFWhuCPIvdGj 4nxygBz758I0vsqA6.DSoDr5LaIMmn0FODnwj7OzbNTlzWWM_D74nQtb7bnGbG3c4FfEub0DRvif qkZImJdzEyuBXbdo6Tmx6n1ApQtr.fqSZ6GZu35lJ1g1z1tV4D7yYO7XHqb249IT7bTcSPy2pcjw SXAaIqtZU701CzSL2VxHrfpghK0RQe1bUI_MmVoY5FUcQslfIhv.UrfTxrtAYa6WqpRxhBcHogaV J5BwMDULhWgvoJbArpPjXOye.f3Qjubzvc5cymjMxl48fsYDGqeQDrhoTNDnw X-Sonic-MF: X-Sonic-ID: 7baf493e-3851-4281-85d9-674b75eebf43 Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Tue, 2 Jan 2024 04:41:04 +0000 Received: by hermes--production-gq1-6949d6d8f9-qkzts (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f4c0a61a1d2f0f209366118fa4826846; Tue, 02 Jan 2024 04:38:58 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Mark Millard List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: list of valid ABI combinations Date: Mon, 1 Jan 2024 20:38:47 -0800 Message-Id: References: Cc: dan@langille.org, FreeBSD Hackers In-Reply-To: To: Philip Paeps X-Mailer: iPhone Mail (21C66) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4T40Xy5vHfz4gL5 [FYI: My internet access is limited to a cellphone for some number of days.]= > On Jan 1, 2024, at 19:26, Philip Paeps wrote: >=20 > =EF=BB=BFOn 2023-12-07 23:03:33 (+0800), Mark Millard wrote: >> Dan Langille wrote: >>> My goal is to automatically maintain this table, from which FreshPorts f= etches package information: >>>=20 >>> freshports.dev=3D# select * from abi order by name; >>> id | name | active >>> ----+----------------------+-------- >>> 9 | FreeBSD:12:aarch64 | t >>> [...] >>> 53 | FreeBSD:15:riscv64 | t >>> (31 rows) >>=20 >> The name list in the middle (/bin/sh context): >>=20 >> # fetch https://pkg.freebsd.org/index.html >> index.html 3606 B 103 MBps = 00s >>=20 >> # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@' | sort= >> FreeBSD:12:aarch64 >> [...] >> FreeBSD:15:powerpc64le >>=20 >> There might be issues at times with https://pkg.freebsd.org/index.html no= t >> being in sync. As far as I can tell, that page is manually maintained. >=20 > clusteradm updates that page to match what we're actually distributing. I= f it doesn't reflect reality, that's a bug, and we'd like to know please. :-= ) Does that include the =E2=80=9Conly ??? Is updated=E2=80=9D sorts of notes? = For example, FreeBSD:13:armv6 Latest dates back to 2021-Jan-25 but there is n= o note about quarterly only. Various FreeBSD:15:* do not have notes about La= test only, despite having no quarterly at all. Some other cases have notable= but shorter differences in the Latest vs. Quarterly time frames, suggesting= only one is being updated but no fixed difference is definitive for that st= atus. Dan=E2=80=99s activities with the page do not use such notes as far as I kno= w. > Philip >=20 > -- > Philip Paeps > Senior Reality Engineer > Alternative Enterprises From nobody Tue Jan 2 05:45:47 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T41zh5jTWz56KFR for ; Tue, 2 Jan 2024 05:45:52 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T41zh5DcYz3J9s; Tue, 2 Jan 2024 05:45:52 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704174352; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=98lrDSX6cwSt73Rw60TGkZ4Zu7EzAWWReWVpGUgoBPI=; b=tqMqjtHPcc3mr2pvdHWfkFdKYimyzY36Y6Mop7DBbN7bLhM+Rbr5Mdjuq/qNMKwez7z+Q7 MjJrdI7we6CsMtv30GZo2A2J5nAT7slM/NeAOU1ujWURRFXus7gcL7t7etBfT/6Z7/l1fU BZS21aBEi89Obxzfz0dvmopxCHvAgkMF8O4JTTiMPUnE/p3CMGsnNZKRKATe2LlLgwiF0M Hwz2qc9pNbHzNeDOUodCTVXBoZVpaNEzkzYwlSVetZEFMcYI0zyfaypy06zAfNAQ8ejhMK VavFGwKU77qgTIIIk5WmdObgMr3JuhwIbgrUth2wSfNH9rH59kpeimL2+V19og== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1704174352; a=rsa-sha256; cv=none; b=qXQHFmZg1RiCwhhnoaEzs//k2nhQ53Hua3XED+yri8Sn9B1fu/ahhCB2D5k4st/wNTAQyz 1ruPDI7KiYs8sJ9fNEIwrxGwQ9K83Zly2ICc87SGs3xM1vRHx5B3xM3QbUgtT4As0IUGAe odkUxrhaUAzmd28XEYNj+aF/yDvpsiULa1tul50dX6CJgq0WdBUsc5MbkZFONYdmXgO/i4 1e+3H5c1t8JTTNE9qOEgNKzLGx5xpsgXH4c2BXof4QCZYSmXOPT1/N9W1HoyvN6W0mdfH8 oFyIlJMpyIiS3nJxNaHYh9YTTdbsGvFpfAVK6KYDCPeVIa6dIoITM9xDv6ehHA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704174352; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=98lrDSX6cwSt73Rw60TGkZ4Zu7EzAWWReWVpGUgoBPI=; b=hJR7q2X8gS7Vh7byaspPfWUUrBYWB8e8bX4LBo91iwSRC3e3KRc+7aN2HWwxpQQ+FJ6Ln2 k0kki9NzvlrFsFub5mhV/KwBq+CJ92oMMF2wBFg3ri7FUt7+6/yIRWxlhKcrI+nQ1sfsDa 2yVRohRe1LV2/KwPS6Z+noZrMP24Vqq61QH7JaOVqnnwXxifFm3O2u3oG343NixFybYIG2 LcdF1FjEzo8c/Y5IuIJY0TuXJ4RbnWIwdLSKsQfeMvF52QFOnErkLVQKLUo9LkF0wrQ0El mEXxpg/hO67MVIkrtgtLC/omb5G+EMKDawolNWoS0tntGkPpW+vKRTRpUjDLgA== Received: from auth2-smtp.messagingengine.com (auth2-smtp.messagingengine.com [66.111.4.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T41zh432Qz22J; Tue, 2 Jan 2024 05:45:52 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailauth.nyi.internal (Postfix) with ESMTP id 2664727C005A; Tue, 2 Jan 2024 00:45:52 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Tue, 02 Jan 2024 00:45:52 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdeguddgkeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffokfgjfhggtgfgsehtkehmtdertdejnecuhfhrohhmpefrhhhi lhhiphcurfgrvghpshcuoehphhhilhhiphesfhhrvggvsghsugdrohhrgheqnecuggftrf grthhtvghrnhepffegjeeffeeuvefhteegjeelkeevhffhudekkeevhefgvefhtdduvdeu keeghffhnecuffhomhgrihhnpegurghnpggrthgplhgrnhhgihhllhgvrdhorhhgpdhfrh gvvggsshgurdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghi lhhfrhhomhepphhhihhlihhpodhmvghsmhhtphgruhhthhhpvghrshhonhgrlhhithihqd duudeiiedviedvgeekqddvfeehudektddtkedqphhhihhlihhppeepfhhrvggvsghsugdr ohhrghesthhrohhusghlvgdrihhs X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 2 Jan 2024 00:45:50 -0500 (EST) From: Philip Paeps To: Mark Millard Cc: dan@langille.org, FreeBSD Hackers Subject: Re: list of valid ABI combinations Date: Tue, 02 Jan 2024 13:45:47 +0800 X-Mailer: MailMate (1.14r6015) Message-ID: In-Reply-To: References: List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 2024-01-02 12:38:47 (+0800), Mark Millard wrote: > [FYI: My internet access is limited to a cellphone for some number of > days.] > >> On Jan 1, 2024, at 19:26, Philip Paeps wrote: >> >> On 2023-12-07 23:03:33 (+0800), Mark Millard wrote: >>> Dan Langille wrote: >>>> My goal is to automatically maintain this table, from which >>>> FreshPorts fetches package information: >>>> >>>> freshports.dev=# select * from abi order by name; >>>> id | name | active >>>> ----+----------------------+-------- >>>> 9 | FreeBSD:12:aarch64 | t >>>> [...] >>>> 53 | FreeBSD:15:riscv64 | t >>>> (31 rows) >>> >>> The name list in the middle (/bin/sh context): >>> >>> # fetch https://pkg.freebsd.org/index.html >>> index.html 3606 B 103 >>> MBps 00s >>> >>> # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@' | >>> sort >>> FreeBSD:12:aarch64 >>> [...] >>> FreeBSD:15:powerpc64le >>> >>> There might be issues at times with >>> https://pkg.freebsd.org/index.html not >>> being in sync. As far as I can tell, that page is manually >>> maintained. >> >> clusteradm updates that page to match what we're actually >> distributing. If it doesn't reflect reality, that's a bug, and we'd >> like to know please. :-) > > Does that include the “only ??? Is updated” sorts of notes? Yes. Please let clusteradm know if the notes don't appear to reflect reality. clusteradm maintains the pkgsync infrastructure, which includes the index page on the mirrors. pkgmgr is responsible for scheduling the builds. (And ports committers are responsible for making sure packages are even buildable). > For example, FreeBSD:13:armv6 Latest dates back to 2021-Jan-25 but > there is no note about quarterly only. Various FreeBSD:15:* do not > have notes about Latest only, despite having no quarterly at all. Some > other cases have notable but shorter differences in the Latest vs. > Quarterly time frames, suggesting only one is being updated but no > fixed difference is definitive for that status. The pkgsync infrastructure doesn't really care how often packages are updated. If memory serves, we first added a "quarterly only" note when the thunderxX generation of aarch64 builders broke with distressing regularity. The ampereX builders are much more reliable. I think the current situation for armv6 is "updated irregularly". PowerPC is in the same boat as aarch64 in the ThunderX era: when the hardware works, packages are updated. > Dan’s activities with the page do not use such notes as far as I > know. Would it help if we added an easy to parse text file listing the ABIs we're currently distributing? That won't tell you anything about the build schedule, but it'll at least tell you what's live, without having to parse HTML and hope we don't break it. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From nobody Tue Jan 2 08:08:30 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T458m30Dcz56YPS for ; Tue, 2 Jan 2024 08:08:56 +0000 (UTC) (envelope-from himanshu@thechauhan.dev) Received: from mail-pl1-x62f.google.com (mail-pl1-x62f.google.com [IPv6:2607:f8b0:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T458l3JTvz3Zrg for ; Tue, 2 Jan 2024 08:08:55 +0000 (UTC) (envelope-from himanshu@thechauhan.dev) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=thechauhan.dev header.s=google header.b=V6ZOqUvw; spf=pass (mx1.freebsd.org: domain of himanshu@thechauhan.dev designates 2607:f8b0:4864:20::62f as permitted sender) smtp.mailfrom=himanshu@thechauhan.dev; dmarc=none Received: by mail-pl1-x62f.google.com with SMTP id d9443c01a7336-1d4c27cd502so1304485ad.0 for ; Tue, 02 Jan 2024 00:08:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=thechauhan.dev; s=google; t=1704182933; x=1704787733; darn=freebsd.org; h=to:date:message-id:subject:mime-version:content-transfer-encoding :from:from:to:cc:subject:date:message-id:reply-to; bh=g3pZp56SOEbMGUPXNjIeRfdAq5zsDcg0GuxkYNMg+HQ=; b=V6ZOqUvwqLdJ+Gc9aXURvBeXSOqoxi8Dc5U5cLM+nC9yDZaUg/3lrt/JPwCwd+cQ6Y yCYI04HUl9EBgnvacJW8XWJZHfNUX7qbz+qR+odQ9B+4pvKFpjpaClTNdcseaF6k92zo yiNeQzzvP4vzptIvilE2XA4edCKdVhdp1iYL977+kZMfmSGG4FDVZOxJhkuJlS8Cce+O H/dpLZeJykwA8ABucz/dSz7NeUxfTuuBdvLHPjXcHuQ+UsDEsRr9dsWKRZhvGKNaIWGh 43Xi32zR2CLICP6UPUAYlAX1smj4L7V52fmhCOBofxkbcIFNZ9/vy3kUlexoL17hrKgd d58g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704182933; x=1704787733; h=to:date:message-id:subject:mime-version:content-transfer-encoding :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=g3pZp56SOEbMGUPXNjIeRfdAq5zsDcg0GuxkYNMg+HQ=; b=gb8SVF1nV5ySfa61+/9psafcj2PCGQIIfPE7AA5rcQWwiovKliWGc3+gNnfnPS0Ae6 5w80iccpufv2J25dA8yP3mGlAWnYASgoEE+XUw0iZz0bl7ZZ4kald959jAzgv8Esrx3u Ohak/azf9QKa5NsaiM3DbG7VwYKtBBFU32GlSj9QpC2WkmvJPzB+WTPzxtiew+IYx8eu 4dryAo/AUCoB5n6VewUIxaLJuvR8f+/Z4bc9aMScY4aAilgv9o09lWj1SKsgGA1PTXh2 VZrzJzilfQTG1XPsF0hd+g0VYKr2Y8whARm1Iy23EvS4FG/2Bof7tJknKw5E5narqiOK okbQ== X-Gm-Message-State: AOJu0YwnCONBRy+VxcHCs67/14zPrRbvP2gyGnHqr1G7XPeRKFrVtFwv sklTVO75JYhN0EJBkKe9H4Z7mFmCilI8VRw61zw2brRIxw== X-Google-Smtp-Source: AGHT+IHVRw1aP8xz3Dqv8zbpLe5xwuuqX/bRz9MUgYJbRqdFNCSQbU1qFCJFhK9A+Zn+q3dd/uW4vA== X-Received: by 2002:a17:903:22cf:b0:1d4:c339:3a29 with SMTP id y15-20020a17090322cf00b001d4c3393a29mr597007plg.18.1704182933222; Tue, 02 Jan 2024 00:08:53 -0800 (PST) Received: from smtpclient.apple ([2405:201:d019:cbd3:317f:b8d8:3ee3:aa04]) by smtp.gmail.com with ESMTPSA id bf5-20020a170902b90500b001d43af66d28sm17202591plb.152.2024.01.02.00.08.52 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 02 Jan 2024 00:08:52 -0800 (PST) From: Himanshu Chauhan Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Detailed information on interrupts Message-Id: <664FECCF-BBFE-41E4-9103-AFF851F9F643@thechauhan.dev> Date: Tue, 2 Jan 2024 13:38:30 +0530 To: "freebsd-hackers@freebsd.org" X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[thechauhan.dev:s=google]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62f:from]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[thechauhan.dev:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[thechauhan.dev]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4T458l3JTvz3Zrg X-Spamd-Bar: -- Hi, How to get the details information on interrupts in FreeBSD system. I am looking information equivalent to =E2=80=9C/proc/interrupts=E2=80=9D = on a Linux system. Thanks Regards Himanshu From nobody Tue Jan 2 15:46:26 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T4HK45KJPz55h03 for ; Tue, 2 Jan 2024 15:46:48 +0000 (UTC) (envelope-from dan@langille.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T4HK44s4zz3Nx8; Tue, 2 Jan 2024 15:46:48 +0000 (UTC) (envelope-from dan@langille.org) Authentication-Results: mx1.freebsd.org; none Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailout.nyi.internal (Postfix) with ESMTP id 033955C01D2; Tue, 2 Jan 2024 10:46:48 -0500 (EST) Received: from imap42 ([10.202.2.92]) by compute7.internal (MEProxy); Tue, 02 Jan 2024 10:46:48 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm2; t=1704210407; x=1704296807; bh=7zLV0ITdZ2V1NahXzash1AOfTJOlvdMEIY3XkP0seYE=; b= GMMgTmtj2OU7FPeDK/wl8f9mtKg2hYkYeaOHC5eFRvb18uSWpwInFF2++Y/Wkcw4 XgVQ9hVDC9GLpFWkM+5Dfhen/1GJ1IJmqaA2U5LcOEKaE5cZ2JNG8na67YDVRh8s hO7GPbUe/ZeLNfOuCbFXoxs6nXZOaHcn7ptD3XXTxhGD3vi0rwrhzWgYBlZK5avE ibnuzaUzNHd84GLafaj81JD6hGdzb7fuphuqrBYFbAEHyzYNL9oaYzyt0wb0DTJI BpGONOY3QlzM+Sh63VyvSmo2ilRNXFD3pvVKmst39c9Tgxgopnjkmzx73wHURnJ4 Z42TVtJphLbwMcwCSvXHOQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1704210407; x= 1704296807; bh=7zLV0ITdZ2V1NahXzash1AOfTJOlvdMEIY3XkP0seYE=; b=g 5fYdp4Of80wEDhVgJaRgsPWcGN60DlMDtOs6Sdy3HMyCEeLrMxyjos48K/oy/v7t M9rWASoBiySgDok1Mmot2sGcPqHj+MepzwSPvuQRQrx0FJ0faFDRbnVDZXuTNbJt 9sOPJ1rO1QiVfBi12fn/4PAnFajzP+eYaoSG0ejB+3ueHlS8kvHIoWFVuYHGa1Ie iGuprVcGKMy8JmC915LywWz7NrLXfttXUVNlDoaVf3Rsx1Z3WNvI0tzeU5XVJi0X 7f6WFyKRwhHxg4VbSYuV7eHb1MslchC13vu3OWil/7egPb2ytbqvL03sWCB+tkJa kLeSsxXcaDeR54U89ax+w== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdegfedgudduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtgfesthhqredtreerjeenucfhrhhomhepfdff rghnucfnrghnghhilhhlvgdfuceouggrnheslhgrnhhgihhllhgvrdhorhhgqeenucggtf frrghtthgvrhhnpedvieeuhfdujeeigedtfedvgfelieefuedvjedtgfelheeileduteek tdevfefhveenucffohhmrghinhepuggrnhgprghtpghlrghnghhilhhlvgdrohhrghdpfh hrvggvsghsugdrohhrghdpghhithhhuhgsrdgtohhmnecuvehluhhsthgvrhfuihiivgep tdenucfrrghrrghmpehmrghilhhfrhhomhepuggrnheslhgrnhhgihhllhgvrdhorhhg X-ME-Proxy: Feedback-ID: ifbf9424e:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id B5C95BC007E; Tue, 2 Jan 2024 10:46:47 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: In-Reply-To: References: Date: Tue, 02 Jan 2024 10:46:26 -0500 From: "Dan Langille" To: "Philip Paeps" , "Mark Millard" Cc: "FreeBSD Hackers" Subject: Re: list of valid ABI combinations Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4T4HK44s4zz3Nx8 On Tue, Jan 2, 2024, at 12:45 AM, Philip Paeps wrote: > On 2024-01-02 12:38:47 (+0800), Mark Millard wrote: >> [FYI: My internet access is limited to a cellphone for some number of=20 >> days.] >> >>> On Jan 1, 2024, at 19:26, Philip Paeps wrote: >>> >>> =EF=BB=BFOn 2023-12-07 23:03:33 (+0800), Mark Millard wrote: >>>> Dan Langille wrote: >>>>> My goal is to automatically maintain this table, from which=20 >>>>> FreshPorts fetches package information: >>>>> >>>>> freshports.dev=3D# select * from abi order by name; >>>>> id | name | active >>>>> ----+----------------------+-------- >>>>> 9 | FreeBSD:12:aarch64 | t >>>>> [...] >>>>> 53 | FreeBSD:15:riscv64 | t >>>>> (31 rows) >>>> >>>> The name list in the middle (/bin/sh context): >>>> >>>> # fetch https://pkg.freebsd.org/index.html >>>> index.html 3606 B 103=20 >>>> MBps 00s >>>> >>>> # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@' = |=20 >>>> sort >>>> FreeBSD:12:aarch64 >>>> [...] >>>> FreeBSD:15:powerpc64le >>>> >>>> There might be issues at times with=20 >>>> https://pkg.freebsd.org/index.html not >>>> being in sync. As far as I can tell, that page is manually=20 >>>> maintained. >>> >>> clusteradm updates that page to match what we're actually=20 >>> distributing. If it doesn't reflect reality, that's a bug, and we'd=20 >>> like to know please. :-) >> >> Does that include the =E2=80=9Conly ??? Is updated=E2=80=9D sorts of = notes? > > Yes. Please let clusteradm know if the notes don't appear to reflect=20 > reality. > > clusteradm maintains the pkgsync infrastructure, which includes the=20 > index page on the mirrors. pkgmgr is responsible for scheduling the=20 > builds. (And ports committers are responsible for making sure package= s=20 > are even buildable). > >> For example, FreeBSD:13:armv6 Latest dates back to 2021-Jan-25 but=20 >> there is no note about quarterly only. Various FreeBSD:15:* do not=20 >> have notes about Latest only, despite having no quarterly at all. Som= e=20 >> other cases have notable but shorter differences in the Latest vs.=20 >> Quarterly time frames, suggesting only one is being updated but no=20 >> fixed difference is definitive for that status. > > The pkgsync infrastructure doesn't really care how often packages are=20 > updated. If memory serves, we first added a "quarterly only" note whe= n=20 > the thunderxX generation of aarch64 builders broke with distressing=20 > regularity. The ampereX builders are much more reliable. > > I think the current situation for armv6 is "updated irregularly". =20 > PowerPC is in the same boat as aarch64 in the ThunderX era: when the=20 > hardware works, packages are updated. > >> Dan=E2=80=99s activities with the page do not use such notes as far a= s I=20 >> know. > > Would it help if we added an easy to parse text file listing the ABIs=20 > we're currently distributing? That won't tell you anything about the=20 > build schedule, but it'll at least tell you what's live, without havin= g=20 > to parse HTML and hope we don't break it. I think this threads provides sufficient information for 'automatically = know the list of valid ABI' to proceed: https://github.com/FreshPorts/freshports/issues/508 Also, the (much appreciated-here) script provided by Mark on 2023-12-07 = still runs true after the removal of 12.4 from the build page. [15:42 empty dan ~/tmp] % fetch https://pkg.freebsd.org/index.html index.html 3068 B 37 MBps = 00s [15:42 empty dan ~/tmp] % grep FreeBSD: index.html | sed -e 's@.*\(FreeB= SD:[^ <]*\).*@\1@' | sort FreeBSD:13:aarch64 FreeBSD:13:amd64 FreeBSD:13:armv6 FreeBSD:13:armv7 FreeBSD:13:i386 FreeBSD:13:powerpc FreeBSD:13:powerpc64 FreeBSD:13:powerpc64le FreeBSD:14:aarch64 FreeBSD:14:amd64 FreeBSD:14:armv6 FreeBSD:14:armv7 FreeBSD:14:i386 FreeBSD:14:powerpc FreeBSD:14:powerpc64 FreeBSD:14:powerpc64le FreeBSD:15:aarch64 FreeBSD:15:amd64 FreeBSD:15:armv7 FreeBSD:15:powerpc FreeBSD:15:powerpc64 FreeBSD:15:powerpc64le [15:42 empty dan ~/tmp] %=20 FYI, the goal is for FreshPorts to fetch and display package information= only for the ABI listed by this script. Thank you --=20 Dan Langille dan@langille.org From nobody Wed Jan 3 01:02:26 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T4Wfb6QmHz56Htw for ; Wed, 3 Jan 2024 01:02:47 +0000 (UTC) (envelope-from varun@guag.net) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T4Wfb3bWBz3fff for ; Wed, 3 Jan 2024 01:02:47 +0000 (UTC) (envelope-from varun@guag.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=guag.net header.s=fm2 header.b=Ehot0hTY; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=ep4FOAOI; spf=pass (mx1.freebsd.org: domain of varun@guag.net designates 66.111.4.29 as permitted sender) smtp.mailfrom=varun@guag.net; dmarc=pass (policy=none) header.from=guag.net Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 0CA6C5C0003 for ; Tue, 2 Jan 2024 20:02:47 -0500 (EST) Received: from imap43 ([10.202.2.93]) by compute6.internal (MEProxy); Tue, 02 Jan 2024 20:02:47 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=guag.net; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:subject:subject:to:to; s=fm2; t=1704243767; x=1704330167; bh=2IWRxn3tZvh8HDHp4OUPokOAtid1VXxb s2rhaGmDcY8=; b=Ehot0hTYUNg7i4aPC6dBdCnDIj1gSmHC6m92d34drrhSJL7x Sze7UbsR8ymZ0rCu7MT/bWFvwR8XjXN4utlFtP9fg4Tvj/PBOIu+CDp+KalSUkKz hHxa+NvUFtAy8oNWgHGGGF/oeKwM9AmrnE+BALBK3XfTHUeNRzAJ28xznv0dTplD mDM39olVeKhhMR2hmeRP4wfmO6wJTZM7cM9X1DyKjfLyC4mxhSrwY0stSrUEdjJU dOn4isFIeRVe/u4gbWmQnHqdngbw+sVQ3xpjVdsF3mgG/W+LJTboR18JBhR9nHsg gF9i3zps5rY9peJ94oFwLXaRlmTuxnjfiANWEw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t= 1704243767; x=1704330167; bh=2IWRxn3tZvh8HDHp4OUPokOAtid1VXxbs2r haGmDcY8=; b=ep4FOAOIUDlidL2FUYIn72KYSRNSFGQ8XZely/JPNn3Q42SFQUM FTvfP5WAHv0+7Xm+THknctr8iyKp7IcqbwC75FPwtUDc7Ktn8s1EqoGu80b6rqrh PuDJEImL7oyZQP3WFD9e1eRmaj0gcw2YUgLxrWCnkkv6rN19zm7IspoR6LLpvZAY 5SFkS4rxue90y4F7vnOvxN0cPQHYH09uxxBEjhfLETi5xJ0lJO0+i6cD41iM7OCV ad6GhXqAPdxRP6oQZJwF+2mJc9/O8mPd/qXtsAfqUMq7U12BUZ6tyjRqzMDUpROf i90rObVYdr2YVK/gD44jRABCRZbmCP9Uq3w== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdeggedgvdelucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfffhffvufgtsegrtderre erredtnecuhfhrohhmpedfgggrrhhunhcutehgrhgrfigrlhdfuceovhgrrhhunhesghhu rghgrdhnvghtqeenucggtffrrghtthgvrhhnpeetgedtleetieeiueegffdtieegfeeggf fgvedtheeggeejkeeiveehtdffjeetveenucevlhhushhtvghrufhiiigvpedunecurfgr rhgrmhepmhgrihhlfhhrohhmpehvrghruhhnsehguhgrghdrnhgvth X-ME-Proxy: Feedback-ID: i2c114938:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id C4E3D2D4007D; Tue, 2 Jan 2024 20:02:46 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: <3e3c368e-e00f-495c-9832-1ab743646dc2@app.fastmail.com> Date: Tue, 02 Jan 2024 20:02:26 -0500 From: "Varun Agrawal" To: freebsd-hackers@FreeBSD.org Subject: Collecting performance counter on AMD Zen processors Content-Type: multipart/alternative; boundary=cf3abf9a535b466fab41e9c796f6f389 X-Spamd-Result: default: False [-4.49 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[guag.net,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29:c]; R_DKIM_ALLOW(-0.20)[guag.net:s=fm2,messagingengine.com:s=fm2]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; MLMMJ_DEST(0.00)[freebsd-hackers@FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DKIM_TRACE(0.00)[guag.net:+,messagingengine.com:+]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4T4Wfb3bWBz3fff X-Spamd-Bar: ---- --cf3abf9a535b466fab41e9c796f6f389 Content-Type: text/plain Hello, I run FreeBSD 14 on a machine with AMD Zen3 cores. I want to collect CPU performance metrics such as IPC, L1/L2/L3 miss rate, TLB miss rate, etc. To my surprise, I don't find any tool that supports collecting this data. I find that FreeBSD has support for collecting this data using hwpmc, but hwpmc only supports the AMD K7 and K8 architecture. Is someone planning to add support for AMD Zen cores? If not, I can help add this support. If there is another way to collect CPU performance counter data on FreeBSD, I would like to learn about that too. Regards, Varun --cf3abf9a535b466fab41e9c796f6f389 Content-Type: text/html
Hello,

I run FreeBSD 14 on a machine with AMD Zen3 cores. I want to collect CPU performance metrics such as IPC, L1/L2/L3 miss rate, TLB miss rate, etc. To my surprise, I don't find any tool that supports collecting this data.

I find that FreeBSD has support for collecting this data using hwpmc, but hwpmc only supports the AMD K7 and K8 architecture. Is someone planning to add support for AMD Zen cores? If not, I can help add this support.

If there is another way to collect CPU performance counter data on FreeBSD, I would like to learn about that too.

Regards,
Varun
--cf3abf9a535b466fab41e9c796f6f389-- From nobody Wed Jan 3 16:35:13 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T4wLx61KTz56DLY for ; Wed, 3 Jan 2024 16:35:37 +0000 (UTC) (envelope-from dan@langille.org) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T4wLx0qxSz4hgd; Wed, 3 Jan 2024 16:35:37 +0000 (UTC) (envelope-from dan@langille.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm2 header.b=VokGZRY+; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="E q0JnZL"; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 66.111.4.29 as permitted sender) smtp.mailfrom=dan@langille.org Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailout.nyi.internal (Postfix) with ESMTP id CCDCC5C0127; Wed, 3 Jan 2024 11:35:35 -0500 (EST) Received: from imap42 ([10.202.2.92]) by compute7.internal (MEProxy); Wed, 03 Jan 2024 11:35:35 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm2; t=1704299735; x=1704386135; bh=OBclzwjNR99ozde1gooUQ5EH389s7OAWgo9Spyp1awI=; b= VokGZRY+R/fBBiFLFReNICs4x4x9PcdtTFZK5Zlq0qP114GXtpbDMxcWF5sp03TC q3TPSx1lVQ1zUAoRMR3QZfoRyNj7gu8ykOG5TXyxQdrvvN5c6YtQwcflXDcJ4sGM pY7oF9oMV70f8Gd3km5NgjaZVyYc6xAqUcJVTjxFaAJBFa0PSa6KnYYjzR7Xd3xl alpS2OGjvHw2GP718C6D4qotzwkgMqgkP6zg3rrln8KOmjGE5ckggmiDsJXcf1iK ZpnLUtys2lSF1Qxm4A2RrRKa1uO6OQ0uaY5g5Uo1Y9R+z7zFM6TAVWt2k5CbLr/l RixMHxCVs6Y+ZPl6kiXKsw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1704299735; x= 1704386135; bh=OBclzwjNR99ozde1gooUQ5EH389s7OAWgo9Spyp1awI=; b=E q0JnZLTKqi0HkiFynqVnyDAEaXICztL1otZ2vdTDCEACIUZMsSNxUbQYcLGdooFD TRclVn4GSZlO/NoXrzZ9ZNcd12wqVvKAHQiqP3Aoop54Ct1qgHORFv157zaD17d0 RzPxQ81LPxl6+N+A128tSCSac/hBRju6tQOsFRUMpZhrdV10IBSXrIU/LoSg1JNz OTcrtnMVsS097s5Kay5B+K+fEf1fZsq3zaWu2NzCEB//dKjvZaw+Lu9qtli0Nd5f DEXsjNFCRJ991NIhQ9Yb22Xx2NyiuSYIAo27Vn6h1upOyBsuI/TBnHB6Xy0Jonob UA/gkYiGLuciZHPBIR8ew== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdeghedgledtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtgfesthhqredtreerjeenucfhrhhomhepfdff rghnucfnrghnghhilhhlvgdfuceouggrnheslhgrnhhgihhllhgvrdhorhhgqeenucggtf frrghtthgvrhhnpeduveeihfffgeethefgueelgffggfegvdekhfdtfeejueejgfefudet keevfeeugeenucffohhmrghinhepuggrnhgprghtpghlrghnghhilhhlvgdrohhrghdpfh hrvggvsghsugdrohhrghdpfhhrvghshhhpohhrthhsrdhorhhgpdhgihhthhhusgdrtgho mhenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpegurg hnsehlrghnghhilhhlvgdrohhrgh X-ME-Proxy: Feedback-ID: ifbf9424e:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 6F404BC007D; Wed, 3 Jan 2024 11:35:35 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: <284b50b2-4e3a-4ca2-8433-dd6a2e3ec31f@app.fastmail.com> In-Reply-To: References: Date: Wed, 03 Jan 2024 11:35:13 -0500 From: "Dan Langille" To: "Philip Paeps" , "Mark Millard" Cc: "FreeBSD Hackers" Subject: Re: list of valid ABI combinations Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.21 / 15.00]; NEURAL_HAM_SHORT(-0.72)[-0.717]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; XM_UA_NO_VERSION(0.01)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FREEFALL_USER(0.00)[dan]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_TO(0.00)[freebsd.org,yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4T4wLx0qxSz4hgd On Tue, Jan 2, 2024, at 10:46 AM, Dan Langille wrote: > On Tue, Jan 2, 2024, at 12:45 AM, Philip Paeps wrote: >> On 2024-01-02 12:38:47 (+0800), Mark Millard wrote: >>> [FYI: My internet access is limited to a cellphone for some number o= f=20 >>> days.] >>> >>>> On Jan 1, 2024, at 19:26, Philip Paeps wrote: >>>> >>>> =EF=BB=BFOn 2023-12-07 23:03:33 (+0800), Mark Millard wrote: >>>>> Dan Langille wrote: >>>>>> My goal is to automatically maintain this table, from which=20 >>>>>> FreshPorts fetches package information: >>>>>> >>>>>> freshports.dev=3D# select * from abi order by name; >>>>>> id | name | active >>>>>> ----+----------------------+-------- >>>>>> 9 | FreeBSD:12:aarch64 | t >>>>>> [...] >>>>>> 53 | FreeBSD:15:riscv64 | t >>>>>> (31 rows) >>>>> >>>>> The name list in the middle (/bin/sh context): >>>>> >>>>> # fetch https://pkg.freebsd.org/index.html >>>>> index.html 3606 B 103=20 >>>>> MBps 00s >>>>> >>>>> # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@'= |=20 >>>>> sort >>>>> FreeBSD:12:aarch64 >>>>> [...] >>>>> FreeBSD:15:powerpc64le >>>>> >>>>> There might be issues at times with=20 >>>>> https://pkg.freebsd.org/index.html not >>>>> being in sync. As far as I can tell, that page is manually=20 >>>>> maintained. >>>> >>>> clusteradm updates that page to match what we're actually=20 >>>> distributing. If it doesn't reflect reality, that's a bug, and we'= d=20 >>>> like to know please. :-) >>> >>> Does that include the =E2=80=9Conly ??? Is updated=E2=80=9D sorts of= notes? >> >> Yes. Please let clusteradm know if the notes don't appear to reflect=20 >> reality. >> >> clusteradm maintains the pkgsync infrastructure, which includes the=20 >> index page on the mirrors. pkgmgr is responsible for scheduling the=20 >> builds. (And ports committers are responsible for making sure packag= es=20 >> are even buildable). >> >>> For example, FreeBSD:13:armv6 Latest dates back to 2021-Jan-25 but=20 >>> there is no note about quarterly only. Various FreeBSD:15:* do not=20 >>> have notes about Latest only, despite having no quarterly at all. So= me=20 >>> other cases have notable but shorter differences in the Latest vs.=20 >>> Quarterly time frames, suggesting only one is being updated but no=20 >>> fixed difference is definitive for that status. >> >> The pkgsync infrastructure doesn't really care how often packages are=20 >> updated. If memory serves, we first added a "quarterly only" note wh= en=20 >> the thunderxX generation of aarch64 builders broke with distressing=20 >> regularity. The ampereX builders are much more reliable. >> >> I think the current situation for armv6 is "updated irregularly". =20 >> PowerPC is in the same boat as aarch64 in the ThunderX era: when the=20 >> hardware works, packages are updated. >> >>> Dan=E2=80=99s activities with the page do not use such notes as far = as I=20 >>> know. >> >> Would it help if we added an easy to parse text file listing the ABIs=20 >> we're currently distributing? That won't tell you anything about the=20 >> build schedule, but it'll at least tell you what's live, without havi= ng=20 >> to parse HTML and hope we don't break it. Could that extra file be useful to clusteradm, and is the 'single source= of truth', then yes, that would be useful to third parties as well.=20 Changes to FreshPorts ABI table just tells it what ABI to attempt to imp= ort. All that is lost/found is the package information. As such, it does not otherwise affect the service. Right now, I have a script which works. It will be deployed on dev.fres= hports.org later today. It will refresh the ABI on a daily basis. > I think this threads provides sufficient information for 'automaticall= y know > the list of valid ABI' to proceed: > > https://github.com/FreshPorts/freshports/issues/508 This is all implemented by short shell scripts, the longest of which is = 32 lines. See the URL above for details. --=20 Dan Langille dan@langille.org From nobody Thu Jan 4 14:42:58 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T5TpY5M4Rz56X54 for ; Thu, 4 Jan 2024 14:43:01 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4T5TpY4rnrz4KWG; Thu, 4 Jan 2024 14:43:01 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704379381; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hsyPWnh+qs6FSsHrWXa8FJSXlVLI0H3LvaYBRdNqnvw=; b=fcB6b1QshM/7esq8rybB/s7RA1OUWQFx0Q2su8nG4+cz/TzWKJspTDYHytWXKj+OmiFc7o iJUY3PsRAQaJVod/yy5nDn+0mQsk8Z1ObP1YNTcIBNCf92YNiTNY1aufrVZHjnQi4KV79F 0RxNRqkt87vfAfoSHNcYX6VSfGZc4sOwd8vSfn+eTFZtnY59cqw/VpBynULCb/yp2Rz/Py mtmyhwi8Jcgc7MbulmFOTE7mkHx+3aVHFKBrUHBfHH7IBOpHqOH/uCIKRPzlcIj/WBA2UE 1XgJGe3VR/ybx8WyJjtp2Ec1vaNTbE7QJU47rAY2DphF1EeQYD+HsDWdgv5UIQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1704379381; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hsyPWnh+qs6FSsHrWXa8FJSXlVLI0H3LvaYBRdNqnvw=; b=aHm7+K51m0PCOBZxrHSWtQAd4Ev73+n41BX5HzsKeCHcpDd8Xk1iFoEEUXSkBvGjcH15Jc EvC9OvJC/EobhwZLg3qMvkKIyvDaMeeC2wMYVi6jPsF08DJcgM2GSEZKOSoPjVVLT10BhK Bhv0RIzdhwvyrK0MwlAWQNys490U2U5ADl4O+kyuiOhp6HuEalU617yip/Fp5w+LssTmbW O/YAIyGXMPBtrdFu8a3PTrLfTGn9ni06ATso/Bo/JaslRQwZiywYe4pOpu63+T3ocIMjpS gWs0VmEeRv8r6D5FIWVsehBg0gsdbsyGc2JN/NKrNlug3YivICzbZ6cJSz5IDw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1704379381; a=rsa-sha256; cv=none; b=KUJJe0wiCJRRE84QJaOKxRb50HUWTRicaq4cJeDvEKtlDxNNopt8QvOZ68EtmmPItEypz9 oyYHxGaIlcGTsgPSrCmxrlCCH/Qz1KS2Mtjn56brtTGnIaNhNEYztDIAJrfjVq12EAbi4X eiIoSrGk7k7LKxgMU9iNuOf/XJz8k1AbuLz8/viBQ7WUzCcTn0PY0ni+fLWVVCM3xYAmC2 A6K0gEY3GJMyYYNPKC/oGbqv7xccrI0RD1uoyS8D6Uv5HNgAHYiPqDREQLGRMi7at/ehwX vYwiDv8s8nW3SE4CDY+KhU3ZFuSt396ooc/jgOtuYcmbhPH3Wa0buvsdJm/3/w== Received: from ltc.des.no (48.115.65.81.rev.sfr.net [81.65.115.48]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4T5TpY3HZWz1VD8; Thu, 4 Jan 2024 14:43:01 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 07FE080309; Thu, 4 Jan 2024 15:42:58 +0100 (CET) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Himanshu Chauhan Cc: "freebsd-hackers@freebsd.org" Subject: Re: Detailed information on interrupts In-Reply-To: <664FECCF-BBFE-41E4-9103-AFF851F9F643@thechauhan.dev> (Himanshu Chauhan's message of "Tue, 2 Jan 2024 13:38:30 +0530") References: <664FECCF-BBFE-41E4-9103-AFF851F9F643@thechauhan.dev> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Thu, 04 Jan 2024 15:42:58 +0100 Message-ID: <86y1d5p3bh.fsf@ltc.des.no> List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Himanshu Chauhan writes: > How to get the details information on interrupts in FreeBSD system. > I am looking information equivalent to =E2=80=9C/proc/interrupts=E2=80=9D= on a Linux system. `vmstat -i` perhaps? DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sat Jan 6 22:47:34 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T6wTC3qkxz55hmj for ; Sat, 6 Jan 2024 22:47:59 +0000 (UTC) (envelope-from farhan@farhan.codes) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T6wTB2Vlkz4PkB for ; Sat, 6 Jan 2024 22:47:58 +0000 (UTC) (envelope-from farhan@farhan.codes) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=farhan.codes header.s=fm1 header.b=QTvTSe3l; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=udlOOSGr; dmarc=none; spf=pass (mx1.freebsd.org: domain of farhan@farhan.codes designates 64.147.123.21 as permitted sender) smtp.mailfrom=farhan@farhan.codes Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id 407B53200A29 for ; Sat, 6 Jan 2024 17:47:56 -0500 (EST) Received: from imap45 ([10.202.2.95]) by compute5.internal (MEProxy); Sat, 06 Jan 2024 17:47:56 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=farhan.codes; h= cc:content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:subject:subject:to:to; s=fm1; t=1704581275; x=1704667675; bh=cBUxkjM7q7D+z0SOx3iyfPxyVsaCv7pY eKuJegSuRYQ=; b=QTvTSe3lhLPlltWHrCMSqKPQmmzs4un340KUROFy+rG3oo/g Bci2A04GonkwZIMikaeaXlYbiRxiqHrAG65tf8LJWgZtd5ZUauRhASYLKVyIxLDN mtpfvD/+V5Cb2OmGmW2GkbS5lU60Mlbe4NFYGHN0u6TQ6vCo8hA1l8/pFFRKCDcM 1eQ3ds/66RdkBf/uYW1cgimsM2yTCgbmiwNiecv+pjQR+XHiD0K/wIpvhXmZgknn t9oipPCrg8TvA1p3Nbz4xMoPCxC11hlYN4CCtaT5bhfXWWCu4LgyYay94uCjy9WV vbo4MTMBm/zhNmH5zydJR5uQB6owNAxRIS4aqA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t= 1704581275; x=1704667675; bh=cBUxkjM7q7D+z0SOx3iyfPxyVsaCv7pYeKu JegSuRYQ=; b=udlOOSGrbtY/ERp4Vf9xNiNELPQTTQongmff8v/fTIQ3kkP3Etj TP2F7sQdCOTSSR0oGYCP3eW18ZzFeBIh/tBvGwdWweNLUJEu4Pu5sAUlE+/l1mai sTH4N+NsVFwpW78DmGHxAxMt10JwZhXTbzVvdrOoyE8AR6AMLO2Of/Y+7Q7U69Sg n/54ru9CbEuCufoj7E/w7hEh4nKk8LuIXV3PiL6I+XybXgp/1yhWS5NI8Vz33G/t gWP56Jt4ueOh6fkNjsY4nAsSFwjbI6Hgx1CEpjPZhmQ0AlDXCFAdN0XJKqcisXVj DjKRqUkK38Y3SKjx78smi/L9k37VmMAqbTA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdehvddgtdefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfffhffvufgtsehttdertd erredtnecuhfhrohhmpedfhfgrrhhhrghnucfmhhgrnhdfuceofhgrrhhhrghnsehfrghr hhgrnhdrtghouggvsheqnecuggftrfgrthhtvghrnhepieejtdegteevhfegvdefieeghe ethfduudffkeevffejueegudevfeffuddvheegnecuvehluhhsthgvrhfuihiivgeptden ucfrrghrrghmpehmrghilhhfrhhomhepfhgrrhhhrghnsehfrghrhhgrnhdrtghouggvsh X-ME-Proxy: Feedback-ID: i61914458:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 71896272007D; Sat, 6 Jan 2024 17:47:55 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: <5fe4d15c-f976-4a41-ac50-38ce6a25c289@app.fastmail.com> Date: Sat, 06 Jan 2024 17:47:34 -0500 From: "Farhan Khan" To: freebsd-hackers@freebsd.org Subject: jemalloc_rtree failed assertion error Content-Type: text/plain X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RWL_MAILSPIKE_EXCELLENT(-0.40)[64.147.123.21:from]; R_DKIM_ALLOW(-0.20)[farhan.codes:s=fm1,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.21:from]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[farhan.codes]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[farhan.codes:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4T6wTB2Vlkz4PkB Hi all, I am writing some code on FreeBSD 15.0-CURRENT and getting this error that I do not understand: : jemalloc_rtree.c:205: Failed assertion: "!dependent || leaf != NULL" In this case, it happens during a realloc() call. This may very well be a bug in my code, but the message is unclear to me. I found the section the section in the code (/usr/src/contrib/jemalloc/src/rtree.c) but without thoroughly diving into the malloc() call I do not understand it. The jemalloc(3) man page has a section called "DIAGNOSTIC MESSAGES", but it does not offer many details. What does this error mean? As an aside, I recommend that this is either documented in more detail because I found several people citing the problem but I did not find an explanation. Thanks! -- Farhan Khan PGP Fingerprint: 1312 89CE 663E 1EB2 179C 1C83 C41D 2281 F8DA C0DE