From owner-freebsd-current@freebsd.org Sun May 2 03:12:20 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9729E5E61E9 for ; Sun, 2 May 2021 03:12:20 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: from mail-wm1-x32b.google.com (mail-wm1-x32b.google.com [IPv6:2a00:1450:4864:20::32b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXrkW3PxCz3lN7 for ; Sun, 2 May 2021 03:12:19 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: by mail-wm1-x32b.google.com with SMTP id g65so1275062wmg.2 for ; Sat, 01 May 2021 20:12:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:date:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=Heifkuk59IbvXiBx151bEc1nKWPuFAcfq020DUpcDoc=; b=RhNDXirCWF38XLSEAtWXSRkO2QBua9bultP0pPLyM7DVJWQ4LQZyhixxfCY4VoEe/b OkgcBVqevFJ1gMhLnT0j7KKMd9BafdBzdB5ZDxOoh9WsmTAp7dVsx4fSS1bmhq6vyx7B 6jXn1S9D2eGrD80WybFLx4GGEnMU4NZKTRpT9Mh4Mu5U5LCUhM5r/4RogGw29Z+H0OPO /+wjqQNrvA15dAxZCiUXAAGKyMs0+gaH3PyrEcTonVXh/6/SRhIIkFWa3lEx9kbSE2C/ 7soNHtaK0yAI+0jh9i/UJaTCdn2YjKKMNP2JkZAcBMlE1JolnLP8kCFMajAcAzpt2/AH OkAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:date:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=Heifkuk59IbvXiBx151bEc1nKWPuFAcfq020DUpcDoc=; b=nkc+WVJBZ7icNURFcTbLIOE9dYAAAwt6QpOAwiaoCTaV54CYnYawvRMLbioWSpcLF3 7kxMccSlLewmzd/eVE8ECC5hnynz8hsuJraciWQxL4wsdGPvaii+P2kcYYUmrmG6vUfK 0vu2oQYK358fDAfTKXyfU5WfSksyQIuWhH754ioiioBr9AWGWTcb57sHP/EqloGpajYX uLDcK6nLDj4MOxn90Gp4+Dt7sYYc4Hz/Uho50+QcOPKhlL/DnD0Z9qQGjQjUaKu4W0q9 Uo751mKz9u0+6Dw9nprp16lBYh4Nn+F+5HtMkIM6AjCGk6dfWtvJfh/ELMsjg0l3rgKI pMuw== X-Gm-Message-State: AOAM532s551HmChId5CScwtbUoo6RbPbF9u6zVRXIxHWGXhN4WFgzFuA sB+ZQBxzqv2xeAtLxxrdq7U= X-Google-Smtp-Source: ABdhPJz20OBf/3JWS7rt5JnG2fbuyVOsFpjwZntwKR/p4H9/FAgqpsjb258AlxUPPyW7/GwyCaAU2A== X-Received: by 2002:a7b:c4cf:: with SMTP id g15mr14267939wmk.163.1619925137452; Sat, 01 May 2021 20:12:17 -0700 (PDT) Received: from rimwks.local ([2001:470:1f15:3d8:551e:a391:d007:c90]) by smtp.gmail.com with ESMTPSA id p10sm7309679wrr.58.2021.05.01.20.12.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 01 May 2021 20:12:17 -0700 (PDT) From: Rozhuk Ivan X-Google-Original-From: Rozhuk Ivan Date: Sun, 2 May 2021 06:12:15 +0300 To: Chargen Cc: freebsd-current@freebsd.org Subject: Re: WSLg update on 1-5-2021 - BSD / WSL Message-ID: <20210502061215.47def07b@rimwks.local> In-Reply-To: References: X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FXrkW3PxCz3lN7 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=RhNDXirC; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rozhukim@gmail.com designates 2a00:1450:4864:20::32b as permitted sender) smtp.mailfrom=rozhukim@gmail.com X-Spamd-Result: default: False [-3.89 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.89)[-0.891]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::32b:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::32b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32b:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 03:12:20 -0000 On Sat, 1 May 2021 21:42:38 +0200 Chargen wrote: > With FreeBSD subsystem and interops , windows should feel less > monolithic > Waste our resourses to increase MS money profit. From owner-freebsd-current@freebsd.org Sun May 2 05:03:21 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EEE05F8EC2 for ; Sun, 2 May 2021 05:03:21 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FXvBc5tbJz3qD5 for ; Sun, 2 May 2021 05:03:20 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: by mailman.nyi.freebsd.org (Postfix) id C84845F8EC1; Sun, 2 May 2021 05:03:20 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C81485F8EBF for ; Sun, 2 May 2021 05:03:20 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from id.bluezbox.com (id.bluezbox.com [45.55.20.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXvBb51ZTz3qbJ; Sun, 2 May 2021 05:03:19 +0000 (UTC) (envelope-from gonzo@bluezbox.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=bluezbox.com; s=mail; h=In-Reply-To:Content-Type:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=00hvfXQ1/OyL+3sWFCVQZDpgjwrz5Xk4MDhkQMeMZZk=; b=QcBCP/nbLppGegZFNdQh9zG3pe cOyR/FnSPd7MT2piSVMg94Dxz7vCOKUpknghywb9AFQJPw8yGMCGxsqGTYsr6L6bHGjlvmMfh2EUH HUZPSkget4CPzhIVUOoV3B1DTCt8olFcG+E30GFXA8QpWI1PBzWxrLTe6DFw6ugMk2cg=; Received: from localhost ([127.0.0.1] helo=id.bluezbox.com) by id.bluezbox.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94 (FreeBSD)) (envelope-from ) id 1ld4G7-00019v-7x; Sat, 01 May 2021 22:03:12 -0700 Received: (from gonzo@localhost) by id.bluezbox.com (8.15.2/8.15.2/Submit) id 14253At3004458; Sat, 1 May 2021 22:03:10 -0700 (PDT) (envelope-from gonzo@bluezbox.com) X-Authentication-Warning: id.bluezbox.com: gonzo set sender to gonzo@bluezbox.com using -f Date: Sat, 1 May 2021 22:03:10 -0700 From: Oleksandr Tymoshenko To: Kubilay Kocak Cc: Yuri Pankov , current@freebsd.org, Bugmeister Subject: Re: linking to git revisions in bugzilla Message-ID: <20210502050310.GA4428@bluezbox.com> References: <134b5580-360a-43c9-8c8f-2a50c2524e7e@www.fastmail.com> <36286647-e005-d289-45d6-9630d39d6430@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <36286647-e005-d289-45d6-9630d39d6430@FreeBSD.org> X-Operating-System: FreeBSD/11.2-RELEASE-p10 (amd64) X-Spam-Level: -- X-Spam-Report: Spam detection software, running on the system "id.bluezbox.com", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Kubilay Kocak (koobs@FreeBSD.org) wrote: > On 12/04/2021 9:02 am, Yuri Pankov wrote: > > While filing a bug, I noticed that the help only mentions svn revision numbers, and "Preview" tab had no output [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Rspamd-Queue-Id: 4FXvBb51ZTz3qbJ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bluezbox.com header.s=mail header.b=QcBCP/nb; dmarc=none; spf=pass (mx1.freebsd.org: domain of gonzo@bluezbox.com designates 45.55.20.155 as permitted sender) smtp.mailfrom=gonzo@bluezbox.com X-Spamd-Result: default: False [-3.41 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bluezbox.com:s=mail]; FREEFALL_USER(0.00)[gonzo]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[bluezbox.com]; R_SPF_ALLOW(-0.20)[+mx]; SPAMHAUS_ZRD(0.00)[45.55.20.155:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bluezbox.com:+]; NEURAL_HAM_SHORT(-0.91)[-0.910]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[45.55.20.155:from]; ASN(0.00)[asn:14061, ipnet:45.55.0.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 05:03:21 -0000 Kubilay Kocak (koobs@FreeBSD.org) wrote: > On 12/04/2021 9:02 am, Yuri Pankov wrote: > > While filing a bug, I noticed that the help only mentions svn revision numbers, and "Preview" tab had no output when I tried putting "base ", so I'm wondering how do you link to git revisions? > > We'll (bugmeister) be adding parsing support for it (along with a few > other related auto-linking things) > > I'd encourage people to use " " (repo = src|doc|ports) > where short hash is at least 8 chars in the meantime. Once parsing is > added all previous references will be linked. Links to git hashes should work now, please test and let us know if feature works as expected. As Michael mentioned - preview is a different matter, I'll try to look into it later. -- gonzo From owner-freebsd-current@freebsd.org Sun May 2 08:27:00 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CBB4F5FCBC9 for ; Sun, 2 May 2021 08:27:00 +0000 (UTC) (envelope-from se@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FXzjc5CcXz4SBf; Sun, 2 May 2021 08:27:00 +0000 (UTC) (envelope-from se@freebsd.org) Received: from Stefans-MacBook-Pro-449.fritz.box (p200300cd5f1fe900ac6f17871294b3ea.dip0.t-ipconnect.de [IPv6:2003:cd:5f1f:e900:ac6f:1787:1294:b3ea]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 27AF29F42; Sun, 2 May 2021 08:27:00 +0000 (UTC) (envelope-from se@freebsd.org) To: Greg Rivers References: <202105011909.141J9kQ4068083@server.i805.com.br> <2429724.0dHE6SNnxz@no.place.like.home> <2191438.sMrx5ctUpN@no.place.like.home> From: Stefan Esser Cc: FreeBSD CURRENT Subject: Re: Problems with realtek NIC Message-ID: <5d97d26f-e713-5f34-c0d9-5d6de782b0f8@freebsd.org> Date: Sun, 2 May 2021 10:26:58 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <2191438.sMrx5ctUpN@no.place.like.home> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="4h0oDhv8PXQiJlDlsTa6SS7CgdGcLTE2T" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 08:27:00 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --4h0oDhv8PXQiJlDlsTa6SS7CgdGcLTE2T Content-Type: multipart/mixed; boundary="Tp97K9dAsoWw1VAJsxxtIQiqikjBiEk6A"; protected-headers="v1" From: Stefan Esser To: Greg Rivers Cc: FreeBSD CURRENT Message-ID: <5d97d26f-e713-5f34-c0d9-5d6de782b0f8@freebsd.org> Subject: Re: Problems with realtek NIC References: <202105011909.141J9kQ4068083@server.i805.com.br> <2429724.0dHE6SNnxz@no.place.like.home> <2191438.sMrx5ctUpN@no.place.like.home> In-Reply-To: <2191438.sMrx5ctUpN@no.place.like.home> --Tp97K9dAsoWw1VAJsxxtIQiqikjBiEk6A Content-Type: multipart/mixed; boundary="------------8FB00872F82C6056968EB090" Content-Language: de-DE This is a multi-part message in MIME format. --------------8FB00872F82C6056968EB090 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Am 02.05.21 um 01:37 schrieb Greg Rivers: > On Saturday, 1 May 2021 16:45:03 CDT Stefan Esser wrote: >> Am 01.05.21 um 21:48 schrieb Greg Rivers via freebsd-current: >>> On Saturday, 1 May 2021 14:09:46 CDT Nilton Jose Rizzo wrote: >>>> I using a FreeBSD 14-Current and get random error with my NIC. The w= atchdog timer send a timeout message and I loose connection temporaly. In=20 logs show only this message: >>>> >>> Switch to the official Realtek driver in ports: net/realtek-re-kmod >> >> The "official" RealTek driver is based on a very old version of "our" >> driver that was written by Bill Paul. >> >> It lacks many features that have been introduced in FreeBSD in the >> last decade (or even earlier) like NETMAP-Support. >> >> The RealTek-driver has special cases for some 50 variants of RealTek >> Ethernet chips and contains individual firmware patches for nearly all= >> of them. >> >> I had started to merge chip specific changes from the official driver >> to the FreeBSD driver in the hope to get it to support the RTL8125A/B >> chips. But I have stopped that project for lack of RTL8125 documentati= on, >> especially regarding the PHY, which has its own driver module in our >> version but not the RealTek code. (And somebody claimed to know that >> another FreeBSD developer was working on RTL8125 support but did not >> tell who that might be and whether he had documentation.) >> >> Anyway, there are changes regarding the initialization and error recov= ery >> of different RealTek chips in the official driver that could be merged= >> into our version. But I do not know whether these changes require the >> firmware changes provided by the RealTek driver to correctly work. >> > Thanks for the information Stefan, and for your work on FreeBSD. My use= > of the term "official" was apparently inaccurate. I was not aware of th= e > deficiencies in the RealTek driver. I would prefer to use the FreeBSD > driver, but I don't for purely pragmatic reasons: the FreeBSD driver > continually locks up and resets under load (as described by the OP), > while the RealTek driver does not. Hi Greg, the RealTek driver is "official" in the sense that it is provided by the vendor and written with knowledge about all the (many!) deficiencies of the RealTek Ethernet chips. And yes, the FreeBSD drived definitely needs work to fully support all variants of the RealTek chip. I guess that due to uncovered chip specifics or hardware issues, the FreeBSD driver will often lack the special code (or firmware patches) and will have to recove= r chip operations be going through a hard reset. If you look at the "official" driver sources, you'll find #ifdefs for FreeBSD versions before 4.9, but that is not the reason the main driver source file is more than 30000 lines long. The driver distinguishes between more than 70 different chip versions (identified by MACFG_3 to MACFG_84 with some IDs missing). And each one has specific requirements regarding firmware patches, initialization and reset behavior, error handling, ... I have analyzed these differences (see the attached file) but for lack of RTL8125 documentation not preceded with this project at this time. (The column lx_fw identifies firmware patches used by the Linux driver, while rt_fw identifies those embedded into the RealTek driver for FreeBSD - and those differ somewhat, and I have no idea why ...). I have local modifications of the re driver in my sources, but have one other project that I really want to get ready in the next few months (after working on it for nearly 2 years) and I do not want to become responsible for issues of the RealTek driver in base (after committing fixes that also might cause regressions, if they need to be accompanied by firmware patches ...) > FWIW, here are the particulars on the RealTek chip-set that I've got: >=20 > re0: port 0= xe000-0xe0ff mem 0xb0804000-0xb0804fff,0xb0800000-0xb0803fff irq 16 at de= vice 0.0 on pci1 > re0: Using 1 MSI-X message > re0: Chip rev. 0x2c800000 > re0: MAC rev. 0x00100000 The Chip rev. indicates that you have got a RTL8168E_VL, which does not need a firmware patch according to RealTek driver, but gets one in Linux.= It is identified by MACFG_38 in the RealTek driver, BTW, and there are only a few chip specific code fragments relevant to that chip. It seems, it needs special handling when the MAC address is programmed, but I did not spot any other special code for that particular chip in the "official= " driver. > re0@pci0:1:0:0: class=3D0x020000 rev=3D0x06 hdr=3D0x00 vendor=3D0x10ec = device=3D0x8168 subvendor=3D0x1458 subdevice=3D0xe000 > vendor =3D 'Realtek Semiconductor Co., Ltd.' > device =3D 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Cont= roller' > class =3D network > subclass =3D ethernet >=20 > Would the FreeBSD Foundation be able to help with getting documentation=20 from RealTek? I have no idea - there is a RTL8125 driver in OpenBSD (which is separate from the RTL8111/8168 drivers, there) and that driver is actually relativ= ely short, but it consists just of sequences of register reads and writes wit= hout any comments that could help understand the purpose of these operations. And there are not so many differences between the RTL8125 and prior chips= (except that the RTL8125 expects 32 bit wide register writes, while the RTL8111 was limited to 16 bit reads/writes - but this is trivially solved= by having 2 sets of low-level routines without any impact on the higher level code). There is also driver code in Linux that can be used to reverse engineer device specific setup and operation procedures. But that driver is ugly (IMHO at least) and I'm afraid that there might be legal issues if I use initialization sequences, firmware patches or other information that can be found in that driver. Therefore I have only taken a cursory look and identified the internal chip IDs in the Linux driver and the firmware patches used for each supported chip. If there was detailed documentation (detailed register set specification and operation details like initialization sequence, delays/timeouts that are required, etc.) this would greatly help getting the RTL8125 into our version of the "re" driver (with NETMAP and other features that we have that are not present in the driver from RealTek). I might try to get support from the author of the OpenBSD driver, but he might have received documentation under an NDA that does not allow to sha= re it with us. Anyway, since the RealTek driver packages works quite well, I can use my RTL8125 chip (on an AMD B550 mainboard) and it was not that urgent (for m= e) to get that chip supported in base. But if I get documentation, I might be able to integrate the RTL8125 (and= at the same time apply all the special handling and firmware patching the= RealTek driver does - it is still BSD licensed, but in the 4-clause form)= during summer. Best regards, STefan --------------8FB00872F82C6056968EB090 Content-Type: text/plain; charset=UTF-8; x-mac-type="0"; x-mac-creator="0"; name="RealTek Ethernet Device Characteristics.txt" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="RealTek Ethernet Device Characteristics.txt" RealTek Version: #define RL_FLAG_MSI 0x00000001 #define RL_FLAG_PHYWAKE_PM 0x00000004 #define RL_FLAG_DESCV2 0x00000040 #define RL_FLAG_MSIX 0x00000800 #define RL_FLAG_MAGIC_PACKET_V2 0x20000000 #define RL_FLAG_PCIE 0x40000000 #define RL_FLAG_MAGIC_PACKET_V3 0x80000000 FreeBSD Version: #define RL_FLAG_MSI 0x00000001 // ? #define RL_FLAG_AUTOPAD 0x00000002 #define RL_FLAG_PHYWAKE_PM 0x00000004 // ? #define RL_FLAG_PHYWAKE 0x00000008 #define RL_FLAG_JUMBOV2 0x00000010 #define RL_FLAG_PAR 0x00000020 // Ethernet-Address Access Mode #define RL_FLAG_DESCV2 0x00000040 #define RL_FLAG_MACSTAT 0x00000080 #define RL_FLAG_FASTETHER 0x00000100 #define RL_FLAG_CMDSTOP 0x00000200 #define RL_FLAG_MACRESET 0x00000400 #define RL_FLAG_MSIX 0x00000800 // ? #define RL_FLAG_WOLRXENB 0x00001000 #define RL_FLAG_MACSLEEP 0x00002000 #define RL_FLAG_WAIT_TXPOLL 0x00004000 #define RL_FLAG_CMDSTOP_WAIT_TXQ 0x00008000 #define RL_FLAG_WOL_MANLINK 0x00010000 #define RL_FLAG_EARLYOFF 0x00020000 #define RL_FLAG_8168G_PLUS 0x00040000 #define RL_FLAG_MAGIC_PACKET_V2 0x20000000 // "new" register layout (RTL= 8139C+ and newer) #define RL_FLAG_PCIE 0x40000000 // ? #define RL_FLAG_LINK 0x80000000 // ? #define RL_FLAG_MAGIC_PACKET_V3 0x80000000 // 8125 only ??? XXX duplicat= e def chip rev macfg linux jumbo cmd cfgmode power magic lx_fw rt_fw rl_flags -------------------------------------------------------------------------= --------------------------------------------------------------- ?8169 MACRESET 8169S 0x008 3 2 7 0xff00 cfg1 - - MACRESET 8110S 0x040 3 3 7 0xff00 cfg1 - - MACRESET 8169_8110SB 0x100 4 4 7 0xff00 cfg1 - - MACRESET|PHYWAKE 8169_8110SBL? MACRESET|PHYWAKE 8169_8110SC 0x180 5 5 7 0xff00 cfg1 - - MACRESET|PYHWAKE 8169_8110SCE 0x980 6 6 7 0xff00 cfg1 - - MACRESET|PHYWAKE 8100E 0x308 ? 14 0 0xe700 cfg1 - - FASTETHER|AUTOPAD 8101E 0x340 11 13 0 0xe700 cfg1 - - FASTETHER|AUTOPAD 8101E 0x342 12 16 0 0xe700 cfg1 - - FASTETHER|AUTOPAD 8101E 0x343 13 10 0 0xe700 cfg1 - - FASTETHER|AUTOPAD ?8102E 0x348 ? 7 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD 8102E 0x349 14 8 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD 8102E 0x34A 15 9 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD 8102E 0x34B 16 9 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD 8103E 0x34C 17 9 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD|MACSLEEP 8103E 0x34D 18 9 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD|MACSLEEP 8103E 0x34E 19 9 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETHE= R|CMDSTOP|AUTOPAD|MACSLEEP ?8102EL 0x248 ? 7 0 0xe700 cfg2 - - PHYWAKE|PAR|DESCV2|MACSTAT|FASTETH= ER|CMDSTOP|AUTOPAD 8102EL 0x249 14 8 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|FASTET= HER|CMDSTOP|AUTOPAD 8102EL 0x24A 15 9 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|FASTET= HER|CMDSTOP|AUTOPAD 8102EL 0x24B 16 9 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|FASTET= HER|CMDSTOP|AUTOPAD 8102EL_SPIN1 0x24C 17 9 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|F= ASTETHER|CMDSTOP|AUTOPAD 8102EL_SPIN1 0x24D 18 9 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|F= ASTETHER|CMDSTOP|AUTOPAD 8102EL_SPIN1 0x24E 19 9 0 0xe700 cfg2 pm - PHYWAKE|PAR|DESCV2|MACSTAT|F= ASTETHER|CMDSTOP|AUTOPAD 8168B_SPIN1 0x300 21 11 4 0xe700 cfg2 - - PYHWAKE|MACSTAT|WOLRXENB 8168B_SPIN2 0x380 22 12 4 0xe700 cfg2 - - PYHWAKE|MACSTAT|WOLRXENB 8168B_SPIN3 0x384 23 17 4 0xe700 cfg2 - - PYHWAKE|MACSTAT 8168C 0x3C0 24 19 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTO= P|AUTOPAD|JUMBOV2|WOL_MANLINK|MACSLEEP? 8168C 0x3C2 25 20 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTO= P|AUTOPAD|JUMBOV2|WOL_MANLINK|MACSLEEP? ?8168C 0x3C3 ? 21 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTO= P|AUTOPAD|JUMBOV2|WOL_MANLINK|MACSLEEP? 8168C_SPIN2 0x3C4 26 22 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|C= MDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK|MACSLEEP ?8168CP 0x3C8 ? 18 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDST= OP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168CP 0x3C9 27 23 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDST= OP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168CP 0x3CB 28 24 6 0xc700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|CMDST= OP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168D 0x281 31 25 9 0x8700 cfg2 pm - 8168d_1 PYHWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168D 0x282 32 26 9 0x8700 cfg2 pm - 8168d_2 PYHWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168D 0x283 33 26 9 0x8700 cfg2 pm - 8168d_2 PYHWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168DP 0x288 63 27 9 0x8700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|AUTOP= AD|JUMBOV2|TXPOLL|WOL_MANLINK 8168DP 0x289 64 ? 9 0x8700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|AUTOPA= D|JUMBOV2|TXPOLL|WOL_MANLINK 8168DP 0x28A 65 28 9 0x8700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|AUTOP= AD|JUMBOV2|TXPOLL|WOL_MANLINK 8168DP 0x28B 66 31 9 0x8700 cfg2 pm - PYHWAKE|PAR|DESCV2|MACSTAT|AUTOP= AD|JUMBOV2|TXPOLL|WOL_MANLINK 8168E 0x2C1 36 32 9 0x8700 cfg2 pm - 8168e_1 PYHWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168E 0x2C2 37 33 9 0x8700 cfg2 pm - 8168e_2 PYHWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|WOL_MANLINK 8168E_VL 0x2C8 38 34 9 0x8700 cfg2 pm mp2 8168e_3 PYHWAKE|PAR|DESCV2|MAC= STAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8168E_VL 0x2C9 39 34 9 0x8700 cfg2 pm mp2 8168e_3 PYHWAKE|PAR|DESCV2|MAC= STAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8401E 0x240 41 13 0 0xe700 cfg2 pm - PHYWAKE|PHYWAKE_PM|PAR|DESCV2|MAC= STAT|FASTETHER|CMDSTOP|AUTOPAD 8105E 0x409 42 29 0 0xe700 cfg2 pm - 8105E_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8105E 0x40A 43 30 0 0xe700 cfg2 pm - 8105e_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8105E 0x40B 43 30 0 0xe700 cfg2 pm - 8105e_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8105E_SPIN1 0x40C 43 30 0 0xe700 cfg2 pm - 8105e_1 PHYWAKE|PHYWAKE_PM|PA= R|DESCV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8168F 0x480 50 35 9 0xbf00 cfg2 pm mp2 8168f_1 PYHWAKE|PAR|DESCV2|MACST= AT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8168F 0x481 51 36 9 0xbf00 cfg2 pm mp2 8168f_2 PYHWAKE|PAR|DESCV2|MACST= AT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8411 0x488 52 38 9 0xbf00 cfg2 pm mp2 8411_1 PYHWAKE|PAR|DESCV2|MACSTAT= |CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK 8402 0x440 53 37 0 0xe700 cfg2 pm mp2 8402_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD|CMDSTOP_WAIT_TXQ 8106E 0x448 54 39 0 0xe700 cfg2 pm - 8106e_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8106E 0x449 55 39 0 0xe700 cfg2 pm - 8106e_1 PHYWAKE|PHYWAKE_PM|PAR|DES= CV2|MACSTAT|FASTETHER|CMDSTOP|AUTOPAD 8106EUS ? ? 43 8106e_2 PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTOP|AUTOPAD|= CMDSTOP_WAIT_TXQ|8168G_PLUS|FASTETHER 8107E ? ? 47 8107e_1 PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTOP|AUTOPAD|CM= DSTOP_WAIT_TXQ|8168G_PLUS|FASTETHER 8107E ? ? 48 8107e_2 PYHWAKE|PAR|DESCV2|MACSTAT|CMDSTOP|AUTOPAD|CM= DSTOP_WAIT_TXQ|8168G_PLUS|FASTETHER 8168G 0x4C0 56 40 9 0xcf00 cfg2 pm mp2 8168g_2 8168g_1 PYHWAKE|PAR|DESCV= 2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS= 8168G 0x4C1 57 41 9 0xcf00 cfg2 pm mp2 PYHWAKE|PAR|DESCV2|MACSTAT|CMDS= TOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS 8411B 0x5C8 60 44 9 0xcf00 cfg2 pm mp2 8411_2 8411b_1 PYHWAKE|PAR|DESCV2= |MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS 8168EP 0x500 61 49 9 0xcf00 cfg2 pm mp2 PYHWAKE|PAR|DESCV2|MACSTAT|CMD= STOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS 8168EP 0x501 62 50 9 0xcf00 cfg2 pm mp2 8168ep_1 PYHWAKE|PAR|DESCV2|MAC= STAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS 8168EP 0x502 67 51 9 0xcf00 cfg2 pm mp2 8168ep_2 PYHWAKE|PAR|DESCV2|MAC= STAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|8168G_PLUS 8168GU 0x508 58 ? 9 0xcf00 cfg2 pm mp2 8168gu_1 PYHWAKE|PAR|DESCV2|MACS= TAT|CMDSTOP|AUTOPAD|CMDSTOP_WAIT_TXQ|8168G_PLUS|JUMBOV2|WOL_MANLINK 8168GU 0x509 59 42 9 0xcf00 cfg2 pm mp2 8168g_3 8168gu_2 PYHWAKE|PAR|DES= CV2|MACSTAT|CMDSTOP|AUTOPAD|CMDSTOP_WAIT_TXQ|8168G_PLUS|JUMBOV2|WOL_MANLI= NK 8168H 0x540 68 45 9 0xcf00 cfg2 pm mp2 8168h_1 6168h_1 PYHWAKE|PAR|DESCV= 2|MACSTAT|CMDSTOP|AUTOPAD|CMDSTOP_WAIT_TXQ|8168G_PLUS|JUMBOV2|WOL_MANLINK= 8168H 0x541 69 46 9 0xcf00 cfg2 pm mp2 8168h_2 6168h_1 PYHWAKE|PAR|DESCV= 2|MACSTAT|CMDSTOP|AUTOPAD|CMDSTOP_WAIT_TXQ|8168G_PLUS|JUMBOV2|WOL_MANLINK= 8168FP 0x549 70 ? 9 0xcf00 cfg2 pm mp2 6168fp_1/2 ?PYHWAKE|PAR|DESCV2|M= ACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8168FP(8117?) 0x54A 71 52 9 0xcf00 cfg2 pm mp2 8168fp_3 8168fp_3 ?PYHWAKE= |PAR|DESCV2|MACSTAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|= EARLYOFF 8168FP 0x54B 72 9 0xcf00 cfg2 pm mp2 8168fp_4 ?PYHWAKE|PAR|DESCV2|MACS= TAT|CMDSTOP|AUTOPAD|JUMBOV2|CMDSTOP_WAIT_TXQ|WOL_MANLINK|EARLYOFF 8125A 0x608 80 60 9 0xcf00 cfg3 pm mp3 8125a_1 ?DESCV3 8125A 0x609 81 61 9 0xcf00 cfg3 pm mp3 8125a_3 8125a_2 ?DESCV3 8125B 0x640 82 9 0xcf00 cfg3 pm mp3 8125b_1 ?DESCV3 8125B 0x641 83 9 0xcf00 cfg3 pm mp3 8125b_2 ?DESCV3 --------------8FB00872F82C6056968EB090-- --Tp97K9dAsoWw1VAJsxxtIQiqikjBiEk6A-- --4h0oDhv8PXQiJlDlsTa6SS7CgdGcLTE2T Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAmCOYlIFAwAAAAAACgkQR+u171r99UQM iQgAhFX3sdOSf+Hvzn78zDKyuzpxpDpJRVb5wRgWTUUp5giOxsREHqFz7b+mpNTthdR1TpvUMNFn bn9o/zsFgmcRS3x8lH4R1X16aNdX+8rx8ZZ7NCKWPb77qec8lB7iB9eeIS7q3uOYomfA/iylWKIG E2DAyJwanBoWjU2ywhqplW82G7BGSbJjHg0sHHVVgZCGemPVzetW3482yc6cjXpcZils4fcZEe71 XPtlO4YglIVqzhhoImMM3B946ZTtG63Qvz3lDtfG3IzGEMajX8No02tGsF4c6w23yuxaKoxBGCLo CSUrLKkxMGRMDTPh/p1mTAkgCM66qm9KP++P6JLmRg== =MjeC -----END PGP SIGNATURE----- --4h0oDhv8PXQiJlDlsTa6SS7CgdGcLTE2T-- From owner-freebsd-current@freebsd.org Sun May 2 11:42:29 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E0C1622810 for ; Sun, 2 May 2021 11:42:29 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x332.google.com (mail-wm1-x332.google.com [IPv6:2a00:1450:4864:20::332]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY4381lkXz4b45 for ; Sun, 2 May 2021 11:42:27 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x332.google.com with SMTP id l24-20020a7bc4580000b029014ac3b80020so57314wmi.1 for ; Sun, 02 May 2021 04:42:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-language; bh=Pm/QonMBfw1YOj2PMOLwew5RU9mQmW35DspVe2ppGdo=; b=FczhIEVKPzr9P3mV1HS5zhBv64watxh4IxShQf7CBVWU+oxU92FEMHMS9qoQTabRYQ y8d/DYpjtfWMnHLZiWEL1tzy3VXv0KHTXQOH5wKX4Gfno6G+PCMpTtNxGeW9ny1Fq/mx 5u1RYfLCDgOF+otA8xwtaGSpptaJCrYhTgLpaXdOSD6Bzgsfu7zv2od85leF/2JXzOfW 2jraRWZsOxKWtOIvuFT6UB6Z6VQwNgz+cmcCxLDh8kL/cSyslYWMxi3inXltdAfuvUoi StgYsdeHeDoe52wriWH4Gi4H+FLSSh8lmOFx8TLVjjTaRTNU+Tz55nEpEqwj87+tWcwa ILNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-language; bh=Pm/QonMBfw1YOj2PMOLwew5RU9mQmW35DspVe2ppGdo=; b=mOQ4848xKT9vrs9K9qIHb4wnFWV6tVA1V9eArELgF8//87pnfwgA2fpuv4Wq2LUD38 yImnDVWq2bcKVRLsPwLCxvKKhUzNOU6is9n86kWZq+6HpknVDIR2KO23EJgB5Ruv/qix WVGA/ODIY6E8uAzbQ+f0GPcFhWLcGwJZVSeBwzZPyibA5qth/TuU9lQDTsvu/bKET6Z/ xbpux1wNLNEO+nIK23kG4hTkLEz9lMUr7V8tun/Ncl6pNjYMpzd37XmhSwBFS6JK4BPm DCsAr34ObpEjR8JxdwiRgldxX2IsWmMpH+3Gpil7kDfT+XL4Cu44PN85O/59639GRbBh QnKQ== X-Gm-Message-State: AOAM530QCYQPIEeoCWouIKqiufgUlO5o84cUY2t2PqxURaymiSwH7Xb7 FhL8knuWeSMjhWw/Fnjrr0bqxBzrPk10vQ== X-Google-Smtp-Source: ABdhPJyUmO3ocUihH5NolzhGqwCtbbvAAZ9S88jKyptTA/15BGl+5UIM87PYbZXt1gfpncuP5O/yCA== X-Received: by 2002:a1c:2786:: with SMTP id n128mr27365171wmn.82.1619955745618; Sun, 02 May 2021 04:42:25 -0700 (PDT) Received: from [192.168.1.10] (88-105-96-80.dynamic.dsl.as9105.com. [88.105.96.80]) by smtp.gmail.com with ESMTPSA id k15sm8637660wro.87.2021.05.02.04.42.24 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 02 May 2021 04:42:24 -0700 (PDT) To: FreeBSD CURRENT From: Graham Perrin Subject: bectl, chroot, pkg upgrade, no record of the upgrade in /var/log/messages Message-ID: <27513f2a-af86-d476-cf9a-6b9cf7dc7042@gmail.com> Date: Sun, 2 May 2021 12:42:24 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------5BCF18215B69807A1CE6BEC9" Content-Language: en-GB X-Rspamd-Queue-Id: 4FY4381lkXz4b45 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=FczhIEVK; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::332 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-1.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; HAS_ATTACHMENT(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.992]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::332:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.32)[-0.320]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[88.105.96.80:received]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.988]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::332:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::332:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 11:42:29 -0000 This is a multi-part message in MIME format. --------------5BCF18215B69807A1CE6BEC9 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit This morning I created a boot environment, mounted it at /tmp/up – then chroot to /tmp/up and at 09:52, pkg upgrade -y -r FreeBSD Upgrade succeeded. I activated then unmounted the environment, restarted. No record of the upgrade in /var/log/messages – is this normal? --------------5BCF18215B69807A1CE6BEC9 Content-Type: text/plain; charset=UTF-8; name="2021-05-02 10:48 messages without a record of recent pkg upgrade.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename*0="2021-05-02 10:48 messages without a record of recent pkg upg"; filename*1="rade.txt" JSBkYXRlIDsgdXB0aW1lIDsgdW5hbWUgLXYKU3VuICAyIE1heSAyMDIxIDEwOjQ4OjQxIEJT VAoxMDo0OGEubS4gIHVwIDExIG1pbnMsIDUgdXNlcnMsIGxvYWQgYXZlcmFnZXM6IDAuNDIs IDEuNDUsIDEuMDcKRnJlZUJTRCAxNC4wLUNVUlJFTlQgIzkzIG1haW4tbjI0NjMzMC01ZWI5 YzkzYTIwZDogVHVlIEFwciAyNyAwNToxNDoyNiBCU1QgMjAyMSAgICAgcm9vdEBtb3dhMjE5 LWdqcDQtODU3MHA6L3Vzci9vYmovdXNyL3NyYy9hbWQ2NC5hbWQ2NC9zeXMvR0VORVJJQy1O T0RFQlVHIAolIGdyZXAgcGtnIC92YXIvbG9nL21lc3NhZ2VzIHwgZ3JlcCAtdiBkZWluc3Rh bGxlZApBcHIgMjYgMjA6MDM6MDIgbW93YTIxOS1nanA0LTg1NzBwIHBrZ1s4MDI3NV06IHRy ZWVsaW5lLTMuMS40XzIgaW5zdGFsbGVkCkFwciAyNiAyMDowNzozNyBtb3dhMjE5LWdqcDQt ODU3MHAgcGtnWzgwNjg4XTogaG5iLTEuOS4xOCBpbnN0YWxsZWQKQXByIDI2IDIwOjIyOjUz IG1vd2EyMTktZ2pwNC04NTcwcCBwa2dbODkwOTJdOiB3eDMwLWd0azMtMy4wLjUuMSBpbnN0 YWxsZWQKQXByIDI2IDIwOjIyOjU1IG1vd2EyMTktZ2pwNC04NTcwcCBwa2dbODkwOTJdOiBw eTM3LXd4UHl0aG9uNDAtNC4wLjdfMSBpbnN0YWxsZWQKQXByIDI2IDIwOjUxOjU2IG1vd2Ey MTktZ2pwNC04NTcwcCBwa2dbOTMwNDhdOiBxdXRlYnJvd3Nlci0yLjIuMCBpbnN0YWxsZWQK QXByIDI3IDA2OjI1OjU5IG1vd2EyMTktZ2pwNC04NTcwcCBwa2ctc3RhdGljWzU2MzldOiBk cm0tZGV2ZWwta21vZC01LjQuOTIuZzIwMjEwNDE5IGluc3RhbGxlZApBcHIgMjcgMDY6MjY6 MTggbW93YTIxOS1nanA0LTg1NzBwIHBrZy1zdGF0aWNbNzA0MV06IGdwdS1maXJtd2FyZS1r bW9kLWcyMDIxMDMzMCBpbnN0YWxsZWQKQXByIDI3IDE1OjIzOjUwIG1vd2EyMTktZ2pwNC04 NTcwcCBwa2dbNDQ1MjJdOiBweXRob24zOC0zLjguOSBpbnN0YWxsZWQKQXByIDI3IDE1OjIz OjUwIG1vd2EyMTktZ2pwNC04NTcwcCBwa2dbNDQ1MjJdOiBweTM4LXNldHVwdG9vbHMtNDQu MC4wIGluc3RhbGxlZApNYXkgIDEgMjE6MTM6MjggbW93YTIxOS1nanA0LTg1NzBwIHBrZ1s2 MzEzXTogcHl0aG9uMzktMy45LjQgaW5zdGFsbGVkCk1heSAgMSAyMToxNDozOCBtb3dhMjE5 LWdqcDQtODU3MHAgcGtnWzYzOTBdOiBweTM5LXNldHVwdG9vbHMtNDQuMC4wIGluc3RhbGxl ZApNYXkgIDEgMjE6MTQ6MzggbW93YTIxOS1nanA0LTg1NzBwIHBrZ1s2MzkwXTogcHkzOS1z cWxpdGUzLTMuOS40XzcgaW5zdGFsbGVkCk1heSAgMSAyMToxNDozOCBtb3dhMjE5LWdqcDQt ODU3MHAgcGtnWzYzOTBdOiBtcGcxMjMgcmVpbnN0YWxsZWQ6IDEuMjYuNSAtPiAxLjI2LjUg Ck1heSAgMSAyMToxNzo0MyBtb3dhMjE5LWdqcDQtODU3MHAgcGtnWzY1NTRdOiBweTM4LXRr aW50ZXIgdXBncmFkZWQ6IDMuNy4xMF82IC0+IDMuOC45XzYgCk1heSAgMSAyMToxNzo0NiBt b3dhMjE5LWdqcDQtODU3MHAgcGtnWzY1NTRdOiBweTM4LW51bXB5IHJlaW5zdGFsbGVkOiAx LjE2LjYsMSAtPiAxLjE2LjYsMSAKTWF5ICAxIDIxOjIyOjM4IG1vd2EyMTktZ2pwNC04NTcw cCBwa2dbNjgwNl06IHB5dGhvbi0zLjdfMywyIGluc3RhbGxlZApNYXkgIDEgMjE6NDQ6MjMg bW93YTIxOS1nanA0LTg1NzBwIGtlcm5lbDogcGlkIDI5NTg0IChwa2cpLCBqaWQgMCwgdWlk IDA6IGV4aXRlZCBvbiBzaWduYWwgNiAoY29yZSBkdW1wZWQpCk1heSAgMSAyMTo0Nzo1MSBt b3dhMjE5LWdqcDQtODU3MHAga2VybmVsOiBwaWQgMjk2MjEgKHBrZyksIGppZCAwLCB1aWQg MDogZXhpdGVkIG9uIHNpZ25hbCA2IChjb3JlIGR1bXBlZCkKTWF5ICAxIDIxOjUwOjM2IG1v d2EyMTktZ2pwNC04NTcwcCBwa2dbMjk4MDldOiBweTM3LXd4UHl0aG9uNDAtNC4wLjdfMSBp bnN0YWxsZWQKTWF5ICAxIDIxOjUwOjM3IG1vd2EyMTktZ2pwNC04NTcwcCBwa2dbMjk4MDld OiBqYW5zc29uIHJlaW5zdGFsbGVkOiAyLjEzLjEgLT4gMi4xMy4xIApNYXkgIDEgMjE6NTA6 MzcgbW93YTIxOS1nanA0LTg1NzBwIGtlcm5lbDogcGlkIDI5ODA5IChwa2cpLCBqaWQgMCwg dWlkIDA6IGV4aXRlZCBvbiBzaWduYWwgNiAoY29yZSBkdW1wZWQpCk1heSAgMSAyMjozMjo0 MCBtb3dhMjE5LWdqcDQtODU3MHAga2VybmVsOiBwaWQgMzAwNzggKHBrZyksIGppZCAwLCB1 aWQgMDogZXhpdGVkIG9uIHNpZ25hbCA2IChjb3JlIGR1bXBlZCkKTWF5ICAxIDIyOjMyOjU0 IG1vd2EyMTktZ2pwNC04NTcwcCBwa2ctc3RhdGljWzMxNzQ3XTogcGtnLTEuMTYuMyBpbnN0 YWxsZWQKTWF5ICAyIDAxOjIzOjU3IG1vd2EyMTktZ2pwNC04NTcwcCBrZXJuZWw6IHBpZCAz OTE0OSAocGtnKSwgamlkIDAsIHVpZCAwOiBleGl0ZWQgb24gc2lnbmFsIDYgKGNvcmUgZHVt cGVkKQpNYXkgIDIgMDE6MjU6MDQgbW93YTIxOS1nanA0LTg1NzBwIGtlcm5lbDogcGlkIDM5 MjE0IChwa2cpLCBqaWQgMCwgdWlkIDA6IGV4aXRlZCBvbiBzaWduYWwgNiAoY29yZSBkdW1w ZWQpCk1heSAgMiAwMToyNTo0MCBtb3dhMjE5LWdqcDQtODU3MHAga2VybmVsOiBwaWQgMzky NDYgKHBrZyksIGppZCAwLCB1aWQgMDogZXhpdGVkIG9uIHNpZ25hbCA2IChjb3JlIGR1bXBl ZCkKTWF5ICAyIDAxOjI2OjM5IG1vd2EyMTktZ2pwNC04NTcwcCBwa2dbMzkyOTldOiBweTM3 LXBpcC0yMC4zLjQgaW5zdGFsbGVkCk1heSAgMiAwMToyNjo0MSBtb3dhMjE5LWdqcDQtODU3 MHAgcGtnWzM5Mjk5XTogcGtnIHJlaW5zdGFsbGVkOiAxLjE2LjMgLT4gMS4xNi4zIApNYXkg IDIgMDE6MjY6NDEgbW93YTIxOS1nanA0LTg1NzBwIHBrZ1szOTI5OV06IHB5MzctcGJyLTUu NS4wIGluc3RhbGxlZApNYXkgIDIgMDE6MjY6NDIgbW93YTIxOS1nanA0LTg1NzBwIHBrZ1sz OTI5OV06IGZsYWMgcmVpbnN0YWxsZWQ6IDEuMy4zIC0+IDEuMy4zIApNYXkgIDIgMDE6MzE6 MTAgbW93YTIxOS1nanA0LTg1NzBwIHBrZ1szOTU0Nl06IHB5MzctcGlwIHJlaW5zdGFsbGVk OiAyMC4zLjQgLT4gMjAuMy40IApNYXkgIDIgMDE6MzI6NTYgbW93YTIxOS1nanA0LTg1NzBw IHBrZ1szOTYxM106IHB5dGhvbjM3IHJlaW5zdGFsbGVkOiAzLjcuMTAgLT4gMy43LjEwIApN YXkgIDIgMDE6MzU6MTUgbW93YTIxOS1nanA0LTg1NzBwIHBrZ1szOTc2NV06IHB5MzctcGJy LTUuNS4wIGluc3RhbGxlZApNYXkgIDIgMDk6NTE6MzAgbW93YTIxOS1nanA0LTg1NzBwIHBr Z1s2MjczNF06IHBsYW5rLTAuMTEuODkgaW5zdGFsbGVkCiUgYmVjdGwgbGlzdCAtYyBjcmVh dGlvbgpCRSAgICAgICAgICAgICAgICAgICAgQWN0aXZlIE1vdW50cG9pbnQgU3BhY2UgQ3Jl YXRlZApyMzU3NzQ2LVdhdGVyZm94ICAgICAgLSAgICAgIC0gICAgICAgICAgNTkuMkcgMjAy MC0wMy0xMCAxODoyNApuMjQ1ODI3LTM2MWU5NTAxODAwLWEgLSAgICAgIC0gICAgICAgICAg MTAuOUcgMjAyMS0wNC0wNSAxODo0OApuMjQ2MTIzLTIxYWZlZDRiMWQxLWYgLSAgICAgIC0g ICAgICAgICAgODk0TSAgMjAyMS0wNC0yNiAwMzoxOApuMjQ2MzMwLTVlYjljOTNhMjBkLWEg LSAgICAgIC0gICAgICAgICAgMTEyTSAgMjAyMS0wNC0yNyAwNjoxNApuMjQ2MzMwLTVlYjlj OTNhMjBkLWIgLSAgICAgIC0gICAgICAgICAgMTIzTSAgMjAyMS0wNS0wMSAxNzo0NApuMjQ2 MzMwLTVlYjljOTNhMjBkLWMgTlIgICAgIC8gICAgICAgICAgMTE3RyAgMjAyMS0wNS0wMiAw OTo1MgolIHN1ZG8gYmVjdGwgbW91bnQgbjI0NjMzMC01ZWI5YzkzYTIwZC1iIC90bXAvaHVo ClN1Y2Nlc3NmdWxseSBtb3VudGVkIG4yNDYzMzAtNWViOWM5M2EyMGQtYiBhdCAvdG1wL2h1 aAolIGdyZXAgcGtnIC90bXAvaHVoL3Zhci9sb2cvbWVzc2FnZXMgfCBncmVwIC12IGRlaW5z dGFsbGVkCmdyZXA6IC90bXAvaHVoL3Zhci9sb2cvbWVzc2FnZXM6IE5vIHN1Y2ggZmlsZSBv ciBkaXJlY3RvcnkKJSBscyAtaGwgL3RtcC9odWgvdmFyL2xvZwp0b3RhbCAxCi1ydy1yLS1y LS0gIDEgcm9vdCAgICB3aGVlbCAgICA1MThCIDMxIEphbiAwNDo1MiBic2RzdGF0cwpkcnd4 ci14ci14ICAyIGNsYW1hdiAgY2xhbWF2ICAgICAyQiAyNiBKYW4gMTE6NTUgY2xhbWF2CmRy d3hyLXhyLXggIDIgcm9vdCAgICB3aGVlbCAgICAgIDNCIDMwIE1hciAgMjAyMCBDb25zb2xl S2l0CmRyd3hyLXhyLXggIDIgcm9vdCAgICB3aGVlbCAgICAgIDJCIDMxIEphbiAwMzo1OCBj dXBzCmRyd3hyd3gtLVQgIDIgZ2RtICAgICBnZG0gICAgICAgIDJCIDIxIEZlYiAwNDozOCBn ZG0KLXJ3LXItLXItLSAgMSByb290ICAgIHdoZWVsICAgIDM3MksgMjEgSnVuICAyMDIwIGlu aXQubG9nCmRyd3hyd3hyLXggIDIgcm9vdCAgICB3aGVlbCAgICAgIDJCIDIxIEphbiAwMzoz MCBvbmVkcml2ZQpkcnd4ci14ci14ICAyIHJvb3QgICAgd2hlZWwgICAgICAyQiAzMSBKYW4g MDQ6MDkgc2FtYmE0Ci1ydy1yLS1yLS0gIDEgcm9vdCAgICB3aGVlbCAgICAyLjdLIDEzIFNl cCAgMjAyMCBzZGRtLmxvZwpkcnd4LS0tLS0tICAyIHJvb3QgICAgd2hlZWwgICAgICAyQiAx OCBBcHIgMTY6MjEgc3NzZApkcnd4ci14LS0tICAyIF90b3IgICAgX3RvciAgICAgICAyQiAy NiBKYW4gMjM6NTIgdG9yCi1ydy0tLS0tLS0gIDEgcm9vdCAgICB3aGVlbCAgICAyMTZCIDIz IEZlYiAwODo0NCB1c2VybG9nCi1ydy1yLS1yLS0gIDEgcm9vdCAgICB3aGVlbCAgICAgMjFL IDEzIFNlcCAgMjAyMCBYb3JnLjAubG9nCi1ydy1yLS1yLS0gIDEgcm9vdCAgICB3aGVlbCAg ICAgMTJLIDEzIFNlcCAgMjAyMCBYb3JnLjAubG9nLm9sZAolIHN1ZG8gcGtnIHVwZ3JhZGUK VXBkYXRpbmcgRnJlZUJTRCByZXBvc2l0b3J5IGNhdGFsb2d1ZS4uLgpGcmVlQlNEIHJlcG9z aXRvcnkgaXMgdXAgdG8gZGF0ZS4KVXBkYXRpbmcgRnJlZUJTRC1iYXNlIHJlcG9zaXRvcnkg Y2F0YWxvZ3VlLi4uCkZyZWVCU0QtYmFzZSByZXBvc2l0b3J5IGlzIHVwIHRvIGRhdGUuClVw ZGF0aW5nIHBvdWRyaWVyZSByZXBvc2l0b3J5IGNhdGFsb2d1ZS4uLgpwb3VkcmllcmUgcmVw b3NpdG9yeSBpcyB1cCB0byBkYXRlLgpBbGwgcmVwb3NpdG9yaWVzIGFyZSB1cCB0byBkYXRl LgpDaGVja2luZyBmb3IgdXBncmFkZXMgKDMgY2FuZGlkYXRlcyk6IDEwMCUKUHJvY2Vzc2lu ZyBjYW5kaWRhdGVzICgzIGNhbmRpZGF0ZXMpOiAxMDAlCkNoZWNraW5nIGludGVncml0eS4u LiBkb25lICgwIGNvbmZsaWN0aW5nKQpZb3VyIHBhY2thZ2VzIGFyZSB1cCB0byBkYXRlLgol IHBrZyBpbmZvIG5ldGRhdGEgfCBncmVwIEluc3RhbGxlZApJbnN0YWxsZWQgb24gICA6IFN1 biBNYXkgIDIgMTA6MTE6NDUgMjAyMSBCU1QKJSBzdWRvIGJlY3RsIHVtb3VudCBuMjQ2MzMw LTVlYjljOTNhMjBkLWIKJSAK --------------5BCF18215B69807A1CE6BEC9-- From owner-freebsd-current@freebsd.org Sun May 2 13:21:26 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C11126252EC for ; Sun, 2 May 2021 13:21:26 +0000 (UTC) (envelope-from tsoome@me.com) Received: from pv50p00im-tydg10021701.me.com (pv50p00im-tydg10021701.me.com [17.58.6.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY6FK6Cdcz4gX0 for ; Sun, 2 May 2021 13:21:25 +0000 (UTC) (envelope-from tsoome@me.com) Received: from smtpclient.apple (148-52-235-80.sta.estpak.ee [80.235.52.148]) by pv50p00im-tydg10021701.me.com (Postfix) with ESMTPSA id 673DD84015F; Sun, 2 May 2021 13:21:23 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Toomas Soome Mime-Version: 1.0 (1.0) Subject: Re: bectl, chroot, pkg upgrade, no record of the upgrade in /var/log/messages Date: Sun, 2 May 2021 16:21:21 +0300 Message-Id: <6530D5EE-FA52-4BBA-926F-0925B93B0B1F@me.com> References: <27513f2a-af86-d476-cf9a-6b9cf7dc7042@gmail.com> Cc: FreeBSD CURRENT In-Reply-To: <27513f2a-af86-d476-cf9a-6b9cf7dc7042@gmail.com> To: Graham Perrin X-Mailer: iPhone Mail (18E199) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.761 definitions=2021-05-02_06:2021-04-30, 2021-05-02 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-2009150000 definitions=main-2105020108 X-Rspamd-Queue-Id: 4FY6FK6Cdcz4gX0 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.57 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[me.com]; R_SPF_ALLOW(-0.20)[+ip4:17.58.0.0/16]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[me.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[me.com,quarantine]; NEURAL_HAM_SHORT(-0.97)[-0.970]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_IN_DNSWL_LOW(-0.10)[17.58.6.54:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[me.com]; ASN(0.00)[asn:714, ipnet:17.58.0.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[me.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[17.58.6.54:from]; R_DKIM_ALLOW(-0.20)[me.com:s=1a1hai]; FREEFALL_USER(0.00)[tsoome]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[17.58.6.54:from:127.0.2.255]; RECEIVED_SPAMHAUS_PBL(0.00)[80.235.52.148:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 13:21:26 -0000 BE as snapshot + clone? zpool history has that fact, but if anything else is= logged (syslog or direct file write), it will be in old BE. Unless /var/log= is created as shared dataset. Sent from my iPhone > On 2. May 2021, at 14:42, Graham Perrin wrote: >=20 > =EF=BB=BFThis morning I created a boot environment, mounted it at >=20 > /tmp/up >=20 > =E2=80=93 then chroot to /tmp/up and at 09:52, >=20 > pkg upgrade -y -r FreeBSD >=20 > Upgrade succeeded. I activated then unmounted the environment, restarted. >=20 > No record of the upgrade in /var/log/messages =E2=80=93 is this normal? >=20 > <2021-05-02 10:48 messages without a record of recent pkg upgrade.txt> > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"= From owner-freebsd-current@freebsd.org Sun May 2 22:51:24 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C32B5FCAC7 for ; Sun, 2 May 2021 22:51:24 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYLtz3Dbfz3Q7B for ; Sun, 2 May 2021 22:51:23 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x433.google.com with SMTP id l14so3664968wrx.5 for ; Sun, 02 May 2021 15:51:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=rP2usBT4m6MYv104fz9I/PHpR1TmMWgvLQob3fDCs4w=; b=QkJNTjUEB6iYmGKeW4oNx2N2irMySv/vA7VoIJtmdf/buwtA8w0+2r5mEcVHBCXxeS PdLObxkldvQOmEZnK96ij2FLaBEWyVls/1ULUvWVotaHanNb+wxSfBx2sVKUSf065MeI +nwXSzyht/pH1R4ytid9oL2e0hlmSRz23spoePktQBg8kn+U4jJccPIjf6BQuZSxlAeQ f4dwgL2+5zuU80/zh6h4nRvRaGws4J2jkCkusmcTpFYFM+DLYhnQF3SRbvcx/jsjAUDK EQkkSpNHZGtfj0Yclvw9gaEAVB/dcbsRArgWipjT0xH4t2aretUWQAjPirMatEYPReFS Kmog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=rP2usBT4m6MYv104fz9I/PHpR1TmMWgvLQob3fDCs4w=; b=C3mzTGZ90S2r7f9txTlYUKocNDXdWZgOeqLwSs3beAJLgqE0/7k+maZOZ+uEj1BjcX +EFv8oPSlBmR+aZeH3HMnKGSg4iLwbUmTwkqo4EgQQJnDKfoMHYBmT81lJFvbsGdE6kI M9nEIywPr2Pi2MHbltbsZofUQKgGIxZ3dlM2AIbpCVEvfeAJ4KJmqsTHjEXleEadCg7z Df+1IPraxVc7spJnOJYg1M8zbIIGeBgArhEC35IosCVpEw1NgiZgc2IHJB9WbB9VJVo4 R/iSGfLCN1VgF78mL7wwaTxORDFfQskzj51pVBAdu21UGbscq5S8ZJ1zwBcaYR5ugWDC MouA== X-Gm-Message-State: AOAM531LV0BAh0kyq+D3k+kXUnrApoPv/jSUpZUHGI/5CyhooGIBeqDn 55MGUG4Q99mmmy9i/VLfNLj0Gz3fYkgepQ== X-Google-Smtp-Source: ABdhPJznS08Z5POoUa9cfTkkroCvdSg0tvvyQLZnDzbG6sqbrjrO+sZC2gbG3uW0Nptri3KhA+16EA== X-Received: by 2002:a05:6000:1ac7:: with SMTP id i7mr8157974wry.380.1619995881361; Sun, 02 May 2021 15:51:21 -0700 (PDT) Received: from [192.168.1.10] (88-105-96-80.dynamic.dsl.as9105.com. [88.105.96.80]) by smtp.gmail.com with ESMTPSA id n22sm7121984wmo.12.2021.05.02.15.51.20 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 02 May 2021 15:51:20 -0700 (PDT) Subject: Re: bectl, chroot, pkg upgrade, no record of the upgrade in /var/log/messages To: Toomas Soome Cc: FreeBSD CURRENT References: <27513f2a-af86-d476-cf9a-6b9cf7dc7042@gmail.com> <6530D5EE-FA52-4BBA-926F-0925B93B0B1F@me.com> From: Graham Perrin Message-ID: Date: Sun, 2 May 2021 23:51:20 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <6530D5EE-FA52-4BBA-926F-0925B93B0B1F@me.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4FYLtz3Dbfz3Q7B X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=QkJNTjUE; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::433 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-1.96 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[me.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::433:from]; RECEIVED_SPAMHAUS_PBL(0.00)[88.105.96.80:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.950]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; NEURAL_SPAM_SHORT(0.99)[0.986]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::433:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::433:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 22:51:24 -0000 Thank you, On 02/05/2021 14:21, Toomas Soome wrote: > … if anything else is logged (syslog or direct file write), it will be in old BE. I wondered about that. In the text attachment to my previous e-mail, ls -hl /tmp/huh/var/log – listed a few items, but not messages. > Unless /var/log is created as shared dataset. It's a simple ZFS file system. From owner-freebsd-current@freebsd.org Mon May 3 00:29:58 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6357A5FFD09 for ; Mon, 3 May 2021 00:29:58 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32f.google.com (mail-wm1-x32f.google.com [IPv6:2a00:1450:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYP4j5KPRz3l4b for ; Mon, 3 May 2021 00:29:57 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x32f.google.com with SMTP id j3-20020a05600c4843b02901484662c4ebso3129977wmo.0 for ; Sun, 02 May 2021 17:29:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=8Ih/lb3qXKhO7XZob7DO95Xvet+Z17s+aSeNpjM4KKk=; b=aXSuf0EwNTFdNzrOFZbVgMCcCh4I51IMkZvMtzTKlzpsVHgwlaKWfF8fJZg8/j8CSA svOc+4L9fqWpvEKIGuxANg2nzaINaRjGl4pLG9RGbjVrCJOX9gKUgzaGVS4r2z6TU5a6 9ISmFdaNWIIMToXroDTQF5tSu81L/4S+jAaynqP0svyqANi7PBb7cunTbPTuAgWcD1z6 PBgEuNSZ4hfBkQwfJEc2yoESch7ghP28puHnrWzrH2MJJ4l8VwUwhS1hix9VNZHs3uRk GQmNd09TOkMhrqtA5NdFCHPMRd6fWCu9zZUnzvqA+5nZHKHJoF8Tg+Mv2eTm1d7xo/dw /sTQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=8Ih/lb3qXKhO7XZob7DO95Xvet+Z17s+aSeNpjM4KKk=; b=jOqnX7ZjECn8EXxIftrKdSjY8Q7F5DaNM2y17b87Wvu5Xy2Uu1PLAp5y5nhGMbVvqk E0bmf/7mSz1jXhBLp+Kk08mCMIm5Ll0DzM43mUHXHvYoiX4CSrN926KVCcJaOPoFIvTy lqT8P5UxbUNIhlKKAE9ko69A6hVpxnte2zcEtIQzkhOwEJel8UpT2D3tN2VkTCZ2TbRH 45LjIvh5kMM99UQ5bfHRRyM5tK48vKsR4CzEwuZ+vmx/yWqumluVZgYATalJVsEN5x0X 0aB9BdynVnBVeyomF5q+FJ7QRjS43UJt2hsi4nI2RYdidDhixa7aPjZ59CNmcojXiXTn OYGQ== X-Gm-Message-State: AOAM530DCamEMthcSuKmRk4P2S+LgwoNCNj7R/vSSTKOuJiulqst+xWW uTkZKutCHJgSaCg13SQB6HpEMizA9Dmvyw== X-Google-Smtp-Source: ABdhPJzM0kV4IIdLTozp/zhMGKk8mp3Pk78NsVtWCCi2OxR2qu3njxNz6lsl/4Jn5NgoPmWeEh5p4A== X-Received: by 2002:a1c:2:: with SMTP id 2mr18899941wma.113.1620001796044; Sun, 02 May 2021 17:29:56 -0700 (PDT) Received: from [192.168.1.10] (88-105-96-80.dynamic.dsl.as9105.com. [88.105.96.80]) by smtp.gmail.com with ESMTPSA id y5sm9474807wmj.25.2021.05.02.17.29.55 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 02 May 2021 17:29:55 -0700 (PDT) Subject: DHCP no longer working for em(4): networkmgr issue 56 (and /var/log/messages weirdness) To: freebsd-current References: From: Graham Perrin Message-ID: Date: Mon, 3 May 2021 01:29:54 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4FYP4j5KPRz3l4b X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=aXSuf0Ew; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32f as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-3.81 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.81)[-0.814]; RECEIVED_SPAMHAUS_PBL(0.00)[88.105.96.80:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::32f:from]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::32f:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32f:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 00:29:58 -0000 On 27/04/2021 12:33, David Wolfskill wrote: > I am not seeing the issue. Thanks for checking. I realised a cause of the problem after reading , which led me to report . updated to 5.0 on 23rd April. I wonder why I see no log of the update: root@mowa219-gjp4-8570p:/var/log # ls -ahlrt messages* -rw-r--r--  1 root  wheel    61K Mar  5 09:00 messages.4.bz2 -rw-r--r--  1 root  wheel    71K Mar 16 18:00 messages.3.bz2 -rw-r--r--  1 root  wheel    63K Mar 31 15:00 messages.2.bz2 -rw-r--r--  1 root  wheel    53K Apr 15 11:00 messages.1.bz2 -rw-r--r--  1 root  wheel    62K Apr 26 06:00 messages.0.bz2 -rw-r--r--  1 root  wheel   809K May  3 00:48 messages root@mowa219-gjp4-8570p:/var/log # bzcat messages.1.bz2 | grep networkmgr root@mowa219-gjp4-8570p:/var/log # bzcat messages.0.bz2 | grep networkmgr root@mowa219-gjp4-8570p:/var/log # cat messages | grep networkmgr May  3 00:40:20 mowa219-gjp4-8570p pkg[41146]: networkmgr-5.0 deinstalled root@mowa219-gjp4-8570p:/var/log # Related: bectl, chroot, pkg upgrade, no record of the upgrade in /var/log/messages From owner-freebsd-current@freebsd.org Mon May 3 14:47:55 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 692D56342EE; Mon, 3 May 2021 14:47:55 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-il1-f174.google.com (mail-il1-f174.google.com [209.85.166.174]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYm6f2NFtz4skf; Mon, 3 May 2021 14:47:53 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-il1-f174.google.com with SMTP id i22so3844652ila.11; Mon, 03 May 2021 07:47:53 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=14wmHnw9J91Z6E+mgjOMzXrqMVyYtz6PQ9uIY2PBlKI=; b=ijuYfjMH7woVc/rzTmUrEj9PNWeHTJ4LikYgYYrJoIel8j+CLwm+AlRdVFXngmnmVZ GYAGAOF4a3+I6J/IFZVydAJJwKTUc6bW3OxfrKX62g2HgwAalurZt54YVtg04bqrfsYa itu2+qeEpzLOXFmrvbAmEG5pgplSTV7H5PdoOcOy4f8qLu49esfHbi2ErNgOQp5u/OCa YzxFiKxr3/2mJyzUu3yqtim6NZzqNJJnwPz0QKFlN3lIJdRZvaJHJewHzK+sr8CFsYhP 6LtEX5ZXfCNvZxNVIXFbLRSUKD69gH3rbj05A4AE/JgL7GU1T3rR/fkJHSLnRi2ErFih ea7g== X-Gm-Message-State: AOAM532w4D1pNUm+sYpeUdwPG+pNY87z2iDk2IQVnh7acBDb/DRGfD1m LpG60UvOVa6HjpdGJoIQ6t8M9FGZAPLqSODeIiJtwcR2 X-Google-Smtp-Source: ABdhPJyjGQq/Lr7BwLPwH4SrbYHxlOoAXWiCjcofYvvJ2TKvCQmDRXp6NyOotvSlsHxFklTwAcBA3zy0eAwc+TDbjJk= X-Received: by 2002:a05:6e02:92c:: with SMTP id o12mr16581939ilt.256.1620053273039; Mon, 03 May 2021 07:47:53 -0700 (PDT) MIME-Version: 1.0 References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> In-Reply-To: <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> From: Ed Maste Date: Mon, 3 May 2021 10:47:02 -0400 Message-ID: Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? To: Mark Millard Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FYm6f2NFtz4skf X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.174 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.94 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.939]; FREEMAIL_TO(0.00)[yahoo.com]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.166.174:from]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[carpeddiem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[209.85.166.174:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.174:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.174:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable,freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 14:47:55 -0000 On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current wrote: > > Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ > Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ > Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... This is unexpected. Unfortunately I haven't looked at reproducibility in a while, and my work was all on x86. This could be a regression or a longstanding issue with arm64. If you install the diffoscope package (py37-diffoscope) and run it on the two directories / files it should give a more convenient view of the differences. (Or, if you can make a tarball of the differing files I can take a look.) From owner-freebsd-current@freebsd.org Mon May 3 17:52:00 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0ABBC6387B8 for ; Mon, 3 May 2021 17:52:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYrC3003Bz3JTh for ; Mon, 3 May 2021 17:51:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620064317; bh=1dgeJS5JPt2OZJx8GDASMil/yPADC1mbzFQ1/NviMwu=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=HJUTCV2AmjTfqwQFNuS2McEK3uiNHV8a6ffQmWn/U1qx1CP3jUyh8+vF0ZyfjAuiqzyenZyNfjFRrTuF684KaOAjrhgd/HQ3lro1tuWhEJnrNy1Jw1xwHiXiIhmk1EsbzoTH/9VNke1dOf/V2TKG6FPNq9QeLaDoC1pQ5q+lX8FOMgDjIrqDV6jnLk4GJzcik2ku6FmqruvFnhbx/Wrd8EIk88Ex13LqvEpCZG9aogqO4qW/BkRyp05EY5eCjWArxxERodbhz+n4z40UDIJZU7kku04yEfCenowzF3uBlbQhpb3VQP7BVkcsUJHYSkC23REDFUIc7an6uJQiFXFETg== X-YMail-OSG: r8XUusAVM1ksaPHQMjYGeoFCyI3C.5F0VYB7V2FHLNQwlGU73IPIjiKe6tSUA6Z yYUe0XoLw5y_8qIiKD_9WOq1Whn0Uzl3grizre_D8f7WyrL20w2qbpL3XirdoTyuVnxdnlckaNyQ 0oGLv8P8SQWnPM2UsodUuULrPyNiQx0q1GoNgCjAzl7TPCrSe_xSOXCZ6_Umenao3BPXVss1Ecq5 qw1oqiN_P7b1vPACVbH23vGr0v_GCKBGvp42YNiwYL1.GKMg1wi.Qs3_4.dsEBu3nnhlmGo.UM6a HTHrCSjxqMcMaOEI5KgtirWHYypYRfAfxAodoe1tJQg4NITCu2wVxgpkKr7TsmHGF7saewU4zi4y h3a5KkTiFw7OFXLXf_WELODpzR6aOPpqhfzwlfW6sQFrK_nxFHN56DhHG47Laa17viHnlCRMmuvd arWXTP_ZKM7EelzQOL758pY76SsPGgv9YaDSwCyFvX4BiT_ALCU00HFAhk4XOn5eoKPrkdQ.nvsu 7f7jswPCw6negCPg5qg9uYOa7dcSZrZuiYkjA5PwT3tp19t7S0.wSBF8WEhIUgtCtuvG72ZGgLpq _SW7y66IW5fSCqjxXBUjqvljYpdPBeG.udHh1dg0JvVVvb9MxYmuRpJfB4NGcmWDSfsW9uMUFqnJ E0KpBsnNo5fPQyS5v.00GANg3JMQhyMtLPJHGWgIfkFs70dLkeL7FL_ToLwtsDcSMos_OwClkB.o fYyhOlS77v7eqk3Qo3kGY.mjA9fwB_KFcQGHKHzvzLLaliF3xtkqRIaf831JWO.lCI3qZbGS2Bxc wNXwvshK1RkmhALkhCG8rsVK2iZVZVjM3bI6rqcOrv8rddHQUTAfeE88EY0LSphrN2j_sOr9MPdY f8I54TddSq7g6Huk1C2mECWAvMhZdKCj3PUBi0FtCMl7GSSaGAnkNnkQ47nmakBPvEh9k55PfyTA Q8pVkytardVU.WyQjwRDBrhnWobXkACgF2gECcjg7YzlkyS5bSL3FEiibc9ZVh4e3lJBSheXBB0Q 8KD0zDN0RCnYJdkn3vgyvcWxg0QlEipSXt2fSUPOEVEInArsH8FDsarK0kCsbU_RmrnTi8LhaLYv FR176runNKAVUSjL_gALzw8eKxs3irZOv3ugjk4bHyCxoAkr9tcOsoEvZAGza.KyH8CPd8LlUm55 sf41wOq5Bs17FbQ49ga5Ss.05KpJPEyJ.MThT.1HGBhPIeYzTyGN.RimYz1VJRCrP0i6a7oeKRPg s3r2FzfkCrdZhLy7ADCMwBpo_Y7ESu_ZuuMDj9gHfCH8LNd5AlAX8pt01FOwoILRjbCzkVekaV1e o53x9Y4e3qbpaeql9Na3NSHzbaaJ5eY7Ek5a6biAk3I7kgYF2e8vrnG7iDKp9eYHjvSxRB8vjInH 3HqUup6TtXTHlFgm3i3dr5N2aKwcJfPu_C29HjKEfCJ2Fq9iaPlaDlezdZAsriVJPMZSM1TfqIDO 1SNjWr7tDXvAm9InrXaZ_.VuI.vhC9XQGeTj9r03d2cJg0Owu6Z.wT.GDM9VExGGKNiXMoMH7BPg xE16oYejIyhWKX2q6asRNnxd3y87x4ppUltNk_Ejd5qm5t9q4MxvFZ7eO78eEq_NrzUvcNQRLSDY DwRBsTE8i9ttQanwvy20Z.Sg_BCdOdZPWuThYu3SonCHgjFYwZ_FdBS0wcmEFZpGt8ZQk3LlR7AJ HX0MqhFpp7hK36LT3LwkxcR_5G8cLeHjgyZ_IN4Y1YVkichP5Jz7mnx1VFr7sBGe9QWV0aPauFU7 d1oRln3b.Az0kwnxFTOQxWr5qpKpowEAWcL7F0V8mvwC3C4dz100jIH1lHWdYfz9M56dR9frgxgE g7L6UJVSj7nU._hhOO7MniUK0NHurTHuIdTs7dINgoFzShE3IcgL7cYyKAPye62hQT56_cDwMu4v fXPCFXz5Z.0VCzpmaCyT_CdVkZtv8dlTjpRV.9k66HIYwnveStzFapMfCLsF66M_4xWyujtfu8DN hnrxhijlcTQJ1GtNPFfffdbB_FYrFpWSMRPNF.I_e2cRXyMdY3nEXJ8E8pnz2Rxf0J4ZtzVAoZiH WsNkAO7wfu8iZlduuFiQ2fvxOFs49VxdQwvbBLnBc_ej_mnohzyqbChU5mqhXIrQxl4.n.RcX4lT X44L7fk_rifKB2xQ7r0Hi58qH0Z56Npqdht9keQNTqcTtvjZeEnFz.hsb1TB5puH3i.mNgVxo1ld a5O107I9YB0MTtpztmlx47HpQ1curbgyc50_d7ewDhfORQndZQJTFQHKxldDjOmo2uNjdoP2K9f5 IwuEU4IK7HazH1g1TQQTjkjZ_qdsyBSFe7I5NAfjejdBgL5zhq6awEAGjiESl0ZwOfTq8Lo_RluU SNUEpOGBmDGkr4CU02CRnNsTZ0KYuWRCPDcVEQkc0LJtbICzkDP1aEdFs0LG.nOHuSHFx.t4OGKn UQqmVnRi17QmTJKHss1iiC4FVms59gx5_xVw3WZ1iVS13dluCI.m.Nv5wYdPCDM.Q6Uzo2eTclWZ D4gUcfWCbQt8COQa9zapjBDrCfzyNqg1isGvbFS0sfEdTGyjAArsm66cxrKSOE52bCMA.yOEO_wr 8bqiSG3sDPeUIhBrrWZ.ZmioJ5U67bk8JgTZq7ksXVBHJF50.mpPBmxdxIf57 X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Mon, 3 May 2021 17:51:57 +0000 Received: by kubenode573.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 8b311bf104a2bbdf9f2ada34ac0923f1; Mon, 03 May 2021 17:51:56 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: Date: Mon, 3 May 2021 10:51:55 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FYrC3003Bz3JTh X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.47 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.97)[-0.971]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.147:from]; SPAMHAUS_ZRD(0.00)[98.137.65.147:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.147:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 17:52:00 -0000 On 2021-May-3, at 07:47, Ed Maste wrote: > On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current > wrote: >>=20 >> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ >> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ >> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and = /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... >=20 > This is unexpected. Unfortunately I haven't looked at reproducibility > in a while, and my work was all on x86. This could be a regression or > a longstanding issue with arm64. >=20 > If you install the diffoscope package (py37-diffoscope) and run it on > the two directories / files it should give a more convenient view of > the differences. (Or, if you can make a tarball of the differing files > I can take a look.) I no longer have the same content in those directory trees: newer rebuild and the same buildworld used to installworld to both places, instead of 2 different buildworld's. I'm also unsure how reproducible getting differences was. I can eventually do experiments to test multiple separate buildworld's and installworld's, but the machine is busy building ports and the llvm builds involved means it will be some time before I'd switch activities. And the buildworld's involve llvm builds as well and take notable time themselves. So my next comparison will not be any time soon. I'll let you know if I manage to generate another example, this time being sure to keep the data. If I try multiple times without finding any differences, I'll eventually decide "enough is enough" and let you know. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Mon May 3 21:37:19 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1B7E163E4E5 for ; Mon, 3 May 2021 21:37:19 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYxC14zxBz3ltq for ; Mon, 3 May 2021 21:37:17 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.160] (cpe-24-24-163-126.socal.res.rr.com [24.24.163.126]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id e34d2f8c (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 3 May 2021 21:37:08 +0000 (UTC) Subject: Re: WSLg update on 1-5-2021 - BSD / WSL To: Chargen , freebsd-current@freebsd.org References: From: Pete Wright Message-ID: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> Date: Mon, 3 May 2021 14:37:07 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4FYxC14zxBz3ltq X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[nomadlogic.org:s=04242021]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[66.165.241.226:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[nomadlogic.org:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[nomadlogic.org,quarantine]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.165.241.226:from]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 21:37:19 -0000 On 5/1/21 12:42 PM, Chargen wrote: > Dear all > > please note that I hope this message will be discussed to get this on the > roadmap for FreeBSD. Perhaps there is already talk about && work done on > that. > I would like to suggest having a BSD side for Microsoft FOSS ambitions and > get to know the BSD license. I hope the tech people here, know which nuts > and bolts would be ready to boot a *BSD subsystem kernel and make that > available on Windows 10 installations. I believe most of the effort make this happen lies with Microsoft - it is their product after all. WSL under the covers is Hyper-V which supports FreeBSD pretty well. I believe most of the work would be on the Windows side to get the plumbing in place to spin up a FreeBSD VM.  There are open discussions on the WSL github system where people have asked for this but it has not gained much traction by Microsoft. -p -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-current@freebsd.org Tue May 4 02:26:13 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6BB7662147F for ; Tue, 4 May 2021 02:26:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-25.consmr.mail.gq1.yahoo.com (sonic312-25.consmr.mail.gq1.yahoo.com [98.137.69.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZ3cN45R5z4V4v for ; Tue, 4 May 2021 02:26:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620095170; bh=UR3wi6xHhFv9EGqIW8qVhLasqn9Pa8PMArOOi8VXfrz=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=BG1EOffVGlY9Aoub1xWMz+VbR3JuohuDnaEcr932xgNH/8hnAQUxavelwMw9lX31I4Cqk7kDIMJ8gBAy++kUgN0ABwfGXF7zOJQbGkgFErTZJB+xydHDVXX73BfxQjYL8/H1wKiWxBd18N6SVyhxrwNe4dcrD3M+DvUmLw6eKtXY24PlbAvEwNnL/mZphIOgYbxpmjA1yd4niJqTSLkO2edYjkrcxcDKDXPxom+Ggj6XZv18df0QdntSt3d5gjZCcbYKEBI8Pr5JAE4jYGnhwdbplNDPCWZIh0IaebcgbpXkHPXG4oZSwzzaX1RvF2+dgSiVu2BGK7J/F9c+G5lENw== X-YMail-OSG: GBguPP4VM1mPxEdFzDXJ0_R5J9qZIVIvskx80xOQVjR91PVHUbKVHsv7q0ubuqu BhJeUE8WohYJh.o3fKgsjmTBKEa9..alIb4Diij.7eYcExOPK83E6YcT29o9dBxaQVO_qRNqI9zD ngya22e5yZBIuHUCU36uTt2IVSVo6fSuPzVLIfmmqk80IJjsdVe3GuQwh2kW2P9YT9XA0MS.2r0N SSBhB9mE9h51uqoqcQUPk3yMgpLItuR2aAZM6S2QmTCMOFVYpE33n0yPaMUT7iogA7WuCFVct2wP 6v1I_BgUJnSE9L844OfKNzL9.s768kMMbHfaAGej7QFzYoIrfju6Cgai0IUQ.YVKMSC4ro6hxBSF bi4x1T37IZpb_59lsMCz0R.5JlnvbjZ8P4P0fO20eYUctQJkIeCWsz3OrlgnpZpS28dlvQrARDah 3NzVG4sgmfig7dSNcaHQ4T7uH4cp_xU5I.MGvcCOkwSNCmimNrb2VLvylazjHiGLg3QpRvrys3Tl EEh_RzuyiEHPWbdIoJTr5gJ9mdhp7G3NHkrPTS4LhPP1b_f1BqWSYOsG66R2ZBKprXBCZDouhmPd Ac9pUsgK9JruvwFduxkpUydFLxUqKg7BCy2Oa2aUZ7btloWelPSaOhGW_65bas76GJaPpHmjUlpR VlYmNCbXhL_Aig.DywUVWq5h8fGV0s8xmax85pwg6hPGOxqsUQcSXpZg9neN2kswYEwZuEwtujCp _yzHR7wVhr5KZCYM1lyRXR6._IAsKhqsG3kMq9pzIm10niQ_7_mByRlfRjtNw81NlU7abWt9kAp3 DrsZV3D8aHzHsmIWp4m48LBWBRNIAjho8K2P0Vzs7LlVgMDi5SNxeye1Dx3RsrUSW6LoBN270q0w UvR.vryfWhXLwdfhQ_J.RnB1wpC12YnCfMo3LIf.L_3WiNqHT4T7E0thz0Pq3uTu4.oLXu_wi6vD .RNPaj6y_ObJH4ZoL0C44m2U5FxhfGamlJmOrsZ7mhie7fbrJ2wttvIL.V4bzNrOh1D2AV1fTcB_ f9TLAE4DJ.QNNyWSQ1AuUn5El2ZeP07MZhnWL76zVm6flJFMtCbpbDuaFNHPk5Q0i9vz3SxXakM. TuvA5QYSo0hGWHL738niQFJsdJExkiULAackW_y5FNSeDayCqy9C3lZYiiUO40p3WCm7oYs_Bt.D YPwkrOnXxo9byQXW3D4fB87plCC7QyhFfrjhRT7iOEgvrpEdOhK37IxwnY69fLDspjQgOo7Ed7m1 JLj6qQ5SEw8wox7Bugw5hqdzl6fqJMtRVWwVywiscQVneqTMA0qbXgq.PaDDb2eiAIx0rZz9f5OX 71aGvbU8y.CbaCXUCHAQpTMZdusEgsFtZ2.uT3cnRrQGqzFdJRcZysp3rdC6odLTqnuveUHNauBE JlNkriJWkOBx0oOFFE9OzvkjjA9LVpmGGWmgpWQjp66KY29m7vLXyZTVTH0rARSNzj8zv_kufIGy 0cUGANIDNhqFKq25l4_NmuNEsxXquH5gs6rxV0PCqTK02LghT5y3aEzK5dGMFYSRjWC02RJ_JacU GCXbNrVWLZPm8CrwetExaG9qraLb6MosTY3S8Z8jjOsM2PsnPQfDSMBk.9LR4HrT5Dy5H8uc8cCv LalMh9XdIConO0fygF3LxOKIsj7TGQKQch0BIaKavfizIuA7_ZiyZkW0j1p10LyYhVJ4NZj5MOQP 5ux3LdmOTBDxO05VnJQ0866fAkSehSMglLsRvkSqvmbOgC4BwXJGdW8m827XvDBbcikyx1AZ8iQN BuVxDaxsJenBsrpQSCycAWi.vaKgvmJu5TevZZGAHPzLwI93Ewxkdk8d.io8Y2Fs09IGkebwDopy 3ilb7jtRCfVMXXMY57DYGrG2Z1LUSqvb.VxuBk_8KdHpk9tkXftn4t._X7WIBbBtR51lAgY4Jk1C PnYK0dc67XfvJUIjM39gJYG6sZcArf4SUxaKduDJ5tTlgbdQqIu7XLThsbK._9CK3nCizuwVqqzs i6cooCUHm2frxEin_A2vYNa9qTMoiFjo2u2vhWdj1CXljRxdoFvNkEu4HD.bj8qUPZEwYU_PiQ7Q iywiUF6GfvRWNtyOgL_XFN4.YJu3iyShLciLzxib5vRxmW5veroWOiPq4YmpCMIsCEJPDML1snW4 _Nli1gtoYbeK5XW3zxG2OzyMxPYqTmoSwh6H7G9qqluTqZ5aBcSHn4nv25NsXm1h62ydbBcwkwFs yBMBPAEgIhqeT8lI8JhzFJZAdLDOar2TlBdI7Sv.ZtJgEJefLRxXMWotNq03X.UhdMQLz603NhKe GnpEy_qg.xBsy1DSpd37ylOQBjw3VUA41U.zlOHdYdM_t8BYz.r_lMUs.mPeQ_m9xYSpREg65YOu dnkXwqUuF7Nro3lUd_kZMxxMUgeUuxJYDBj9OKqTkqY8jPPzTx11uJeHRUi8B12YPB0TRDQ9Xs06 S_xC_bn3GPUWD6PCBDGd4G5lSAQWyMTM2NBBoFQs0Pp9uB4JyhkPTrS44UtU4rYDJRY0F5ZqXZUa Cj3nTUA89ZAC14VwHA0RxLQxbBCId6sFgTDCuxz7J0ouKB73HMHFnRQ8dtW65RTUKBPLbvz7G125 WeASZSTuDa96OklulBRxSu1e9dYTwJlYl5.DsyzWnhBSsgWkzxVyJe_6CYKR0ur02oGPyWX_zUCX VwOoFuO5vMOOfJpRhqraRdZT_sOE1KCjf0kpbAc9T X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 02:26:10 +0000 Received: by kubenode507.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1427c9896a661f47101f2c9304e55cd3; Tue, 04 May 2021 02:26:06 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> Date: Mon, 3 May 2021 19:26:04 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZ3cN45R5z4V4v X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.49 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.99)[-0.994]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.206:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.206:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.206:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 02:26:13 -0000 On 2021-May-3, at 10:51, Mark Millard wrote: > On 2021-May-3, at 07:47, Ed Maste wrote: >=20 >> On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current >> wrote: >>>=20 >>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ >>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ >>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and = /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... >>=20 >> This is unexpected. Unfortunately I haven't looked at reproducibility >> in a while, and my work was all on x86. This could be a regression or >> a longstanding issue with arm64. >>=20 >> If you install the diffoscope package (py37-diffoscope) and run it on >> the two directories / files it should give a more convenient view of >> the differences. (Or, if you can make a tarball of the differing = files >> I can take a look.) >=20 > I no longer have the same content in those directory > trees: newer rebuild and the same buildworld used to > installworld to both places, instead of 2 different > buildworld's. I'm also unsure how reproducible getting > differences was. >=20 > I can eventually do experiments to test multiple separate > buildworld's and installworld's, but the machine is busy > building ports and the llvm builds involved means it > will be some time before I'd switch activities. And the > buildworld's involve llvm builds as well and take notable > time themselves. So my next comparison will not be any > time soon. >=20 > I'll let you know if I manage to generate another example, > this time being sure to keep the data. If I try multiple > times without finding any differences, I'll eventually > decide "enough is enough" and let you know. I've still got a long ways to go to do the first actual comparison of builds. But I'll note that I've built and stalled py37-diffoscope (new to me). A basic quick test showed that it reports: W: diffoscope.main: Fuzzy-matching is currently disabled as the "tlsh" = module is unavailable. As I'm not familiar with the tool, you might need to send notes about how you want me to use the tool to get the output that you would want. (And, so, I get to learn . . .) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 04:27:17 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 663A062537D for ; Tue, 4 May 2021 04:27:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZ6J42tmlz4Zvm for ; Tue, 4 May 2021 04:27:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620102434; bh=5vn3CYtZvFsTpF5Obu35isw8a6/iG1ZCO6qVLijwEqU=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=paJQRbzYGTyzQCn10x0pQvjOPAT2lRQ85Iflx1Rr25diXcHcKMbpB36KLT4yi103ozz8tIRXbfuSgO7g11DkDogGQpAYh/4wNiUBfZuKZFBPRNXGycqbKo2/VulwlkcyzaZZbWAdgSwuFMK48EgWtcl1t3ra+u0NmjV5f1EQp9Qts44BvxxLfQOSMLubzDi2AmND5Xq5G56HowMzpTp2P1rhsHUFotI23RpiI4O7oU01bNGO2E4QPlme2XF/2+l2Itni7lZ/WljxrqaCk7T3L+DNfuzHN8K2wDw2rw7JRj54IoFSzL4mzJyAHTthPwCHNEWoTzGU9s0F72POxs9H0A== X-YMail-OSG: 4CVIMHkVM1m1Ebnvf8orEQVhXRBTik6nAZl6w9qKXUypiBEuDTXRwDOqnlpxlzB F88wS67sqkcBwP8LDjcoRvy1syyg0A821jOuzQ9zBf1115BNbJSNj2VV5GiOKPX8oHf7_uc4MB.f gWSVgF.BYNW55k4GQTJeuveFX7pIkoUTfVBFsIALf4qZch2EhHF62ZslTsLUXTM8.OKEvFWSqauX tEvKso1W6nf3iiKWPgJ5chqmc2AJN1OX.gULbwNcJjrthCI7pH7VWW8UH_BiwFCFpgluhHiQTQGl jI2OylLV26hh1SRjG09Se49IJdAMtJbHKif3Nm_DvTBxYoMDXGTvX_PECyw6PGzlxRAgtCjA.uLi e2.XhAvzSbi4JnBn1RrFf3_XtTVdMZ9aaVqdOQtRaeXQEcO2FtLdEBnoQ3syWH3wqBo9W9wNT5tk 4.MNzQTRtZBrLIs8dr0Mv.zIPNY3AH200EbZQJfk2bHTaKdKWqKfFo.wnnTuEzGiO_C8m2FxWu60 eT_DPszAPmy1.n_ZFCAnVW_elasMYuZh.bapmioONjWKaPvqJEPKH2r_xJSBnVQ6pOdbriAILCCE scuuTjw_SCz7SVaG64kfqXe245g.Eg1YPme0pw0OUG4n5jX4nFcDH8GKt1p.kPjRaeJyDVx.9x.F KVphon6hVk._lyk2hXW5jo3KHBcD08kCT3fQKyBEH3xQpvvPNdq5c40GNmJzuYZ8E5UBZWBQljK5 MnCctirF7PKq7MadurQOQUL5FuVgLv5iZMpkonlN.oKT_Doux0umADJDwSaVu321vp.W1dcIZYMC AOaKo89BfExl0I2SKNZdzw7yakX4RdJCj.sThfgru0Zu6QCZRAvLbyAq4SVb4tlPWa5gI35OfpER PobYHUxt4T23YMs4p6Bpkv6A7pSDjK_1T438nK5QCo86nRL8zm7B0_kiLcfEs_C3ye8kmD6_4Y75 MZxj5x8Dzqmi5QosYM4gHvjdHK2MIdKzkyAuAyu78Zu.zL.6h.QcliQJXl8qQ7YPyiaNsyZskzxO .uoPGENP3CQ64pWuEfASfYGqDgHs6y0N.VH0XCUcTA1f21Cu.GaAnfnfkOlpaj9G8WgnDCXE59Uw 5kjJq8DvErNihFxU.1E7qTiPTfgHOHQoQne4SM09Q9gONIXxeTUeu6ZXgFALgKI4uqSU.FlbcP8K VbO7p.U8wjw39V76Fzdo_y10xf3nP7Kdrhg1vPCNPcHrzjqWrWvxD4z6Gbf1LdeCWxg6bJT.ZQam ovi2ANbn5mPek9aIJMjkae6ysjRJdENdNYamFVVZJBMF1TNVQK9Keh3krpJZBMEcAQfOnRVEqv4V 4mLTBatFVDxWaCMFEQn2f7bD9or_yLmBwaORk7r4_pVvEPPCE9EhMXfDYDgT66yvhcY2R12Cl7Wn ud0huD1_BMuJYC5RGfQhx_J1DIahCxD9QPC4bzhaYj5VnbgR5SlrZ4.spI2WDV96eWHF.mN7orw9 pMf27qlg6pzU7lCvxRKCAMtUNDetEjhIq2UBQHY4fXDC_Nqf14mOb2k5M.P21obVd0BQh7DOW8vv e8V2wCTxe26JYoTmbSvx4KdRNhCOBKPHPi_vGxGkJvM9lYWx7Whj56u0FUombeIJPQ8GnsOdfxNY gqej6lHzOLFk1u9fShw0kSXVar6A80fk3hJgnG6IDFgesG6UMDo5Wkw_Gk.ajnEj3tv_CIvtXEff JpHVx.5LbxdA2Duj_0wWHlFOrax8MwY4aj1m9TCQAKsyshavtm3k_hGoOitaJO2dBV2iLYqhdK2T 0pu.U0HwygFk.zYjhUPA6x5DrpBlB0EJUEbtlEeFtLmLCmhE3aS_CZyw9jFQDDfJUZ4Jh1Wtpppq a7cpM0Id3IyI3ezw.2_mDElcWBkbV.X7buL3DuvwUP7EZTkRJIzKTGSsq72NS4x59yg.X2zloJlx ua8I.s8cO9QmVR2U.Pr1G1XW0s5dpelsC.fZuJPSv2AKvbb2RF.fnv7iqoSF9qqZ8s4i4u4mw_JJ Qb6UBtU1Vuflm0p7AELMU9oYYuy_gD2mU2gKorZrK07aQwm4IN44bgokPEbVQ48jPYDxTmXlGYY4 yW8CGTSTyruGXzOZ_eSrEOU8gdzGLGKZr2MAdVCd_3i72GW2r.mswQii_MFsYRif3BliohJhB0qr UyX1h7vfglft2yslNWM97zvPj.1QnQ5TZJReqnqqPGu1YjVVLFfi7H4to3YydOvxm9VKhOPMelT6 xihUvRH0Cmp2mgS6mBsAedMW1RhlY08e5ZAguBMSSh2nEQ9DdmQQOt0W.QgVdKpPnAnBlao.lrZJ XgdYed5jO0KZi8mMaAPG1aee56k.26_SPHGr0thL3FdrayHx7VUxrYLZfa48t0VhOV.IWjUNpQei HiCPuoN8gWDYIcxtEu..1wA2LsQw0mjTommJxFk9QOwW8D_62uoSLHi__zxV6V3lXQ3Fo16GW2tS gW9Pn5rmAA5FEmf8Gm6d2QUEAQspyLZ1A_dAmSYMWRlE48sgpIbtTKBm6Amsy_MuLqTfFMMMU_Wo JGrCI0kvy8y5vfRRizJ39beWgUeospZ3BFzpkti4uqYgCO5maIw2WAPhPL.c46mDu8WXNK4UaNiv c.LI9W9KgtZiLt8URRsjVV0KMUnBJ11or7Exa9jZMMClBrX_qKrvyY4DTlMefdpC3bCRQVrAZhHO HCNMK2C9hD_EUsjCkN.8Hi0JvBrQybBeFtBrsoK6dQA-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 04:27:14 +0000 Received: by kubenode508.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID ab1cae79be7857d625e2d1658bf2680a; Tue, 04 May 2021 04:27:09 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> Date: Mon, 3 May 2021 21:27:07 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZ6J42tmlz4Zvm X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.148:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.148:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 04:27:17 -0000 On 2021-May-3, at 19:26, Mark Millard wrote: > On 2021-May-3, at 10:51, Mark Millard wrote: >=20 >> On 2021-May-3, at 07:47, Ed Maste wrote: >>=20 >>> On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current >>> wrote: >>>>=20 >>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ >>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ >>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and = /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... >>>=20 >>> This is unexpected. Unfortunately I haven't looked at = reproducibility >>> in a while, and my work was all on x86. This could be a regression = or >>> a longstanding issue with arm64. >>>=20 >>> If you install the diffoscope package (py37-diffoscope) and run it = on >>> the two directories / files it should give a more convenient view of >>> the differences. (Or, if you can make a tarball of the differing = files >>> I can take a look.) >>=20 >> I no longer have the same content in those directory >> trees: newer rebuild and the same buildworld used to >> installworld to both places, instead of 2 different >> buildworld's. I'm also unsure how reproducible getting >> differences was. >>=20 >> I can eventually do experiments to test multiple separate >> buildworld's and installworld's, but the machine is busy >> building ports and the llvm builds involved means it >> will be some time before I'd switch activities. And the >> buildworld's involve llvm builds as well and take notable >> time themselves. So my next comparison will not be any >> time soon. >>=20 >> I'll let you know if I manage to generate another example, >> this time being sure to keep the data. If I try multiple >> times without finding any differences, I'll eventually >> decide "enough is enough" and let you know. >=20 > I've still got a long ways to go to do the first > actual comparison of builds. >=20 > But I'll note that I've built and stalled py37-diffoscope > (new to me). A basic quick test showed that it reports: >=20 > W: diffoscope.main: Fuzzy-matching is currently disabled as the "tlsh" = module is unavailable. >=20 > As I'm not familiar with the tool, you might need to send > notes about how you want me to use the tool to get the > output that you would want. (And, so, I get to learn . . .) I've tried another experiment (* in the path matches "28" and "30"): # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh $<3/>2021-05-03 21:08:48 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. $<3/>Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 745, in main sys.exit(run_diffoscope(parsed_args)) File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 677, in run_diffoscope difference =3D load_diff_from_path(path1) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path return load_diff(codecs.getreader("utf-8")(fp), path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff return JSONReaderV1().load(fp, path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load raw =3D json.load(fp) File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load return loads(fp.read(), File "/usr/local/lib/python3.7/codecs.py", line 504, in read newchars, decodedbytes =3D self.decode(data, self.errors) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: = invalid start byte The two older snapshots of a Boot Environment have bin/sh files that compare equal. But every program I tried the above sort of thing against on got the same UnicodeDecodeError result from diffoscope, byte value and position matching. These snapshots have more than an installworld in them and so are messy to compare overall. But the installworld (and installkernel) content show similar differences to what I reported before as far as example files with differences go. But this is aarch64, not armv7. It will still be notable time before I have simple installworld tree's to compare. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 07:10:28 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9A44F62872B for ; Tue, 4 May 2021 07:10:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-20.consmr.mail.gq1.yahoo.com (sonic310-20.consmr.mail.gq1.yahoo.com [98.137.69.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZ9wM536sz4hKj for ; Tue, 4 May 2021 07:10:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620112225; bh=TXn+exF8+ws+Nv/mmJg8+Lo6gi2ok16zp0rVnBFjxig=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=i9y2XJS8ph1MZy9Zq6b2cNKZUjuQiYIHVcluaZgFk6Q1Xroe+3QoAt7XTvJA2vgKTIjlYjoOX1kClGwf55OcHz3k5Lji+55iZod+kND1NAB5hCvnLB5JfRkb90C/SAoCDT9BB3VFZt6/WfXs9XpkiqQXp5WY7deTX9jpECgGtDRBory0efn8vVJ8kctbWR6tlaiG31pE1Tzsa6rPHHJO1/5R2suIvLvFgHfruJMvtJ5BKyno6Pf+dXefmFuGOAzQNWU6++6Wprpb4tCmk8xBc01JYY00gE9D/Ktj1N8eaAiF7YqlAKArWNz6iiAtUenVBAiq1w7B+DZ2kun8MLnTrA== X-YMail-OSG: z_T7vscVM1mPnc_KHLs0GWzwxZdJOWLxX4WBJlJ5UZfPh5XgNcInxZLpbqKdRhZ vnFz6pVxx.bpxNteBtoIeju02HVMUQsgYr.2OkZr8ql80NnT1VGeuQl2SjBvUEQs3iIS5ff4LT1X EeMYUGDbh0wy54byJ4Qm8JicanTqAQ.zUHiw043rzl6HOdswfNFnXNIzBkoQuccoJUgIkZtGm17H 0BqCfxL61u10PUFK4uTPpTAzqbHk5jVlnxHZ89blker.UmYyF3RaWL9e1vNVfv6nWkKqN8giSujw S1E0Mth97JeCTdFO6IAPaW1x2a86zxhAZeKzAloWCmC5i9T.Xs73HqI2jSQQLfqR62a4BKe5Z3nR wHVZ32GdyrY5URij5GkvN7u8Q05GzOSpvLuV4aouHBkBHfKij5ox8vKX8tWAsBnPRseIvT6MaYJ8 b1DAM3YEM0opRxnTTCfLpDG9KVOEEt1dL7H8XFemP7s2iF8ryZliPFLeJ1qWZ61BJ7WBzNFKuVRV lmMkl_Bt_uiY_RNAKjhFvvKsqJsjBt8CxKOQj97nmnQW08aXefEx16VNvPaVVcJVa_1nMYqYxGtb fk9ajJ6pHzHXQtUeIhVadLi9XOl_r.zfQree1EbAdowdy.SasT7GmdNn6Es.eYTtgvLJT0DmJDLo nc9X3gTXxBMjhjArYmkDVoZma3xTHVWWWMpqIPicT9WuriB1oNhnYIiLi6AIQ.2sOefF6drLgB4z nloujHgmlM6Aij6w.Km_XUmpZcd4SGLgvaqTkFP8JStunSiyyaPTgFgPDA7Qimv8sE2KgnR5lPKI 7f_cnkZcZdW0sXZh6r8Jq8CRWPT0DFHYl4NjDPdaVM2Rl1jWOGcGS3c_y0Kt2e51KIxcWX_kXYGI 0OJt9OwGqpugMl4RN8QMgnYXgTkSxrJNBBT6RNo4p7xaDJKGqtQk2ivsMIAZbZsW.kryIadUlAcm sH1zi3dkIjmuRHC2Z38mflIghIe0vQrY5NpgwGJO8yo6wEaluDwOP4w375eX_e_3BDiWy5HS9_gZ fhXPMjGJw0uZbfRvubKUKyjtvgvzVYEoxuwvtss6OuDNbrvjemSFqiU0dD0Z8p9aQjIKWCrLvUaO PneV4szVoxgB1gkcxMGL3oDK2bFlmLwOUT8h03recyit4bFA.d9mfA97IEeHFP94IyJkr8BD6_aG AphVZg.ibSPEKdx8ygCTgoN4HkdVIv7wUzbH5qiXkzMSE98UzY7rSXsoKGNM2ahUU5yxfhuu7ezh X0e0_ZHJ_ofOwZJ09EqouVvbwJtKLMR2WkTMSqc6Dq2eCAoLX91YzlEUMheoNxBS81_oL352JFuX 0.qf5XLoTopgpVQM8E5Q1xwQpbxnrZO6xKH9i5.MRca6IAwqL1NFvuj.MHPFRTMIVxc3ZxID5RRT FrgGSP96woNxdkXBTgah7xwugeTzSCdcLwQ2HnmuF0xNt346Dt8pnOeKCvYBp2YigMrdchBHWXoM ewvDuNsCkpQz9p_TeU.JhlgcrumDQPwy4ndqMb32TJ9mlen0VpHJ27kz0eAiuJ0OLzBLEWeHDaAn GJNCyELAnjrPI11afW10ZKh9ds7KqsqtwJkWmOJIGsmjxKfYrK1GbkpZ_MrFQdIAqfc9p3.PoEfA 8N52SIxdcWBg9Xsa9hZytp6LmKNZPcz1mPnJmL6AUkcbV3zaN1JW3FrF7OQYblYuMvuFCoIF5yOj mpj4awwxuIkQAKdKKgMk3gGw72t2.Opn7wHRkPFXwKmC1kULmePptPCqgT2TLcfmNbf4CjvKQOtl wMgvr9bpdNOCfTZACK4hYfyYSpAqQUQ8GqGNMG5.BVBALsPqMGpy5NY2IPEVYAYlGouWvi.Q7OEN aeYWlNEmVQBlg7bpdcgW7ZXXYR1gyCvADNRYLEUjvt_RZHNAMHBh9bP6slO6ez_ez0H3qs.E6NZz gd9AKc1nq00LKmE2MoESB5BULb0gBvau_tJgaqcAmcCym_8fcUZORlxGg4_4VVY731pdF46q6R3K m9jLZN9TtoELcFAH7Fi1WF5IC2RkQoVWiUGySBBdBd7TLjGDDKfn.0JFz3nPe6VZPEiPaYXRYojy a6nyHElV_ywFuwqeF140cKjd5khhfCvAif9pbwT.JcgktjyU0WCaL.rKSH3PTt9BLyVeIXqqw_kG VMDDSngekaK07u7VvOb7twgUwiBMbnzf.xzH7sJK3NjCMKhsXUuaYKTTv3SNhUGC9Mz2UKpiYIAj GrBxSn1YhKkXggW4O2XBnHKndvCabM0yJr2WONALwRTCG9JSnh0lvupoHP0deTBOVzHMe8Lj1tR9 6Uo1xcMzapTdag705VrKHtUJ4TM3BcvwFY7R5Js6UgFGYy9l7AhjGmuY3BIqnJ5obFJKuCReKBR3 xzk_kLMVpl0nnXRX9q8oCx7cTCBUlJRtB8cPTc8CHHq0WjpL5kHOS1W7UxEV51yeFLCnehZyDqzF QywLERj.bCWUMivUlW8JAuXmJncOCpCf64tK0y0i5VcCiUNUDRMTfz4htqCNshyIyGCLvPHQ_JxE OZxxEm8BhnE8hs9qbHsYx40aS8QH17UPXchNGs.DtsT.L54wKq9NOjz_i9Vl9zdh6eKGHme7k6cW S1PP5xW_kDb5932PFmNece67Y0gLx0HYGLwcWZm9ItyhkZcr5vSJ42Ystk73VEUy0wP7lYZYfyVI nNfMdz_Uu82WaOKkCXgTdg2anvBNOLhOaU.QRQFl. X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 07:10:25 +0000 Received: by kubenode547.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b42c6738fb9278c8f9dc9d01867b8717; Tue, 04 May 2021 07:10:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: Date: Tue, 4 May 2021 00:10:16 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <7D83A5C8-FDB4-46D6-A148-15011606B3BE@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZ9wM536sz4hKj X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.146:from]; SPAMHAUS_ZRD(0.00)[98.137.69.146:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.146:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.146:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 07:10:28 -0000 On 2021-May-3, at 21:27, Mark Millard wrote: > On 2021-May-3, at 19:26, Mark Millard wrote: >=20 >> On 2021-May-3, at 10:51, Mark Millard wrote: >>=20 >>> On 2021-May-3, at 07:47, Ed Maste wrote: >>>=20 >>>> On Thu, 29 Apr 2021 at 02:50, Mark Millard via freebsd-current >>>> wrote: >>>>>=20 >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping differ >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/sbin/ping6 and = /usr/obj/DESTDIRs/13_0R-CA7-poud/sbin/ping6 differ >>>>> Files /usr/obj/DESTDIRs/13_0R-CA7-chroot/usr/bin/ntpq and = /usr/obj/DESTDIRs/13_0R-CA7-poud/usr/bin/ntpq differ... >>>>=20 >>>> This is unexpected. Unfortunately I haven't looked at = reproducibility >>>> in a while, and my work was all on x86. This could be a regression = or >>>> a longstanding issue with arm64. >>>>=20 >>>> If you install the diffoscope package (py37-diffoscope) and run it = on >>>> the two directories / files it should give a more convenient view = of >>>> the differences. (Or, if you can make a tarball of the differing = files >>>> I can take a look.) >>>=20 >>> I no longer have the same content in those directory >>> trees: newer rebuild and the same buildworld used to >>> installworld to both places, instead of 2 different >>> buildworld's. I'm also unsure how reproducible getting >>> differences was. >>>=20 >>> I can eventually do experiments to test multiple separate >>> buildworld's and installworld's, but the machine is busy >>> building ports and the llvm builds involved means it >>> will be some time before I'd switch activities. And the >>> buildworld's involve llvm builds as well and take notable >>> time themselves. So my next comparison will not be any >>> time soon. >>>=20 >>> I'll let you know if I manage to generate another example, >>> this time being sure to keep the data. If I try multiple >>> times without finding any differences, I'll eventually >>> decide "enough is enough" and let you know. >>=20 >> I've still got a long ways to go to do the first >> actual comparison of builds. >>=20 >> But I'll note that I've built and stalled py37-diffoscope >> (new to me). A basic quick test showed that it reports: >>=20 >> W: diffoscope.main: Fuzzy-matching is currently disabled as the = "tlsh" module is unavailable. >>=20 >> As I'm not familiar with the tool, you might need to send >> notes about how you want me to use the tool to get the >> output that you would want. (And, so, I get to learn . . .) >=20 > I've tried another experiment (* in the path matches "28" and "30"): >=20 > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > $<3/>2021-05-03 21:08:48 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. > $<3/>Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 745, in main > sys.exit(run_diffoscope(parsed_args)) > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 677, in run_diffoscope > difference =3D load_diff_from_path(path1) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path > return load_diff(codecs.getreader("utf-8")(fp), path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff > return JSONReaderV1().load(fp, path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load > raw =3D json.load(fp) > File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load > return loads(fp.read(), > File "/usr/local/lib/python3.7/codecs.py", line 504, in read > newchars, decodedbytes =3D self.decode(data, self.errors) > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte >=20 > The two older snapshots of a Boot Environment have > bin/sh files that compare equal. But every program I > tried the above sort of thing against on got the same > UnicodeDecodeError result from diffoscope, byte value > and position matching. >=20 > These snapshots have more than an installworld in them > and so are messy to compare overall. But the > installworld (and installkernel) content show similar > differences to what I reported before as far as > example files with differences go. But this is aarch64, > not armv7. >=20 > It will still be notable time before I have simple > installworld tree's to compare. While waiting for the 2nd buildworld to complete, I used the 1st buildworld's materials to installworld twice (to different, empty directory trees) and then did a diff. The diff reported: # diff -rq /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/ = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm2/ | more diff: /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local: No = such file or directory diff: = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/sys/pjdfstest/tests/t= ests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tes= ts/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests/tests= /tests/tests/tests/tests/tests/tests/tests: Too many levels of symbolic = links FYI: # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local lrwxr-xr-x 1 root wheel 14 May 3 23:18:22 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/usr/tests/local -> = ../local/tests So this looks like the expected result and suggests that the problem(s) are at the buildworld stage. (No surprise.) I should be sleeping by the time the 2nd buildworld for cortex-a72 (aarch64) is done. (That is what I decided to test initially.) So it will be more hours until I have basic comparison results from 2 distinct buildworlds. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 08:20:28 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4F45A62A602 for ; Tue, 4 May 2021 08:20:28 +0000 (UTC) (envelope-from filippomore@yahoo.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZCT80NRpz4lJL for ; Tue, 4 May 2021 08:20:28 +0000 (UTC) (envelope-from filippomore@yahoo.com) Received: by mailman.nyi.freebsd.org (Postfix) id 0D1C962A048; Tue, 4 May 2021 08:20:28 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0CE2962A585 for ; Tue, 4 May 2021 08:20:28 +0000 (UTC) (envelope-from filippomore@yahoo.com) Received: from sonic317-34.consmr.mail.ne1.yahoo.com (sonic317-34.consmr.mail.ne1.yahoo.com [66.163.184.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZCT71MsHz4lG3 for ; Tue, 4 May 2021 08:20:26 +0000 (UTC) (envelope-from filippomore@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620116425; bh=rl69yJ8CcAZkKaJqrz/oO/wOXnJFpHm146kk4fwEuW4=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=ig7noNGrt3tP3uW36L3dJMkvCiIf08fvICrZgQWSd9H4xwviNrU2O0wH1SRMNA98FJP8qJcjhck0YID0CoCBxHrhkP6I9i2usaEJCzLSXmb/vwKQClKQ1pkPhxjmK/RJXnYg4IEiZG0sNklV6+UuD7qqOZuXaAMBjvamuG6GV9eDIYGp6pHdYJC4sU39TatBtW9NlK0qz5ymk0K/pIySVrvVrvON+I079L2DMO41Ug1PfOJoD1I5oeHB7B4RnAM1K+BRPYbgGrWkOwKZCKCp0bAo3tux6HFt5ekgujmwhmwA6dXeYTlKk0tZU8muCi61eUJFLZkNnwOfrQB97GMCSQ== X-YMail-OSG: anlMrbsVM1m3sSLCA6kBoYyv4YQ14PXJfK1lcKTOYXSkxRytXFOJe0DMNyrt8wU kC5EFNwQnJ6P7ehZSDIO.kTSQ4QUare0QFLVKjeDWE_S_ABNqtMo5lvb41CZEcOHvn0nJwDCdfGn vHS1fZtgBksUSIV3lYIwiSXaPUVq7kAuxj1sStshyAIkiUE8gQrrm6uGw13KAZBbMkuJ2JnmX8dN Ffb77t1n5tv.bwa7XEaKjdy5wKWot3fN537T8387mqvEWtQmsMrALkG3hRCBs_XzxH1PWIkKcT4c hIjnQbVmjkQhu3TwUsK54s6UOTBdROt01p0Le_w0l_XEtyHKJrMAU2oMAgovO3cySMH5Mw5._nMW 2pNLzKXr8UQe9bmurN6_FrwmPygpSeRTalCVXbtVyUEFFRqeFKb4rhBRXdmrSGtpvLPHjkMu495U pgFSHNQNNbwuwc2Y.yYkPwv4sIItsu.4CyfpkbZkoO10yklve1Gye8JpsNFPKFZOuJtWMj8y.gn0 BgJuXMtg0q3veltXNRhPeqlWKy2NxrXgH1eGTvz_JhfRe9Cn0KUY1Mym6HWNF2gwV5wIbjooFq2i qNP9RJGPSg8q9ybUKen_e5S4pmg7IqdG3vLAuLgbpMoc3VFjN8XC6CWZXMw3oZ2o6e4H5uoh0m3s EOTyF3dHcAQUmU_Uvp7T4W_sfXsrVDz9FASjrg9EBsmPJJw5nqUxaeYR35kvbtkTPwS2Snw807k9 KluuS0HMPduu_ask1mBSAlO1p89ks8hgBgILUEgh9T_UDr8AiFWZJrGFwfJbZ5Rmp24gDKeTRDM9 .dCPq.vt62hGgnZGGjjytLt2DJWvwJvd0Des6d44XJ4azyAbmIxZ4AE8abzDU9m2xb.rNGEYzThn .V13wwzh7Vu_NXG.rXVC45rQ6qnmYqn6BKG.45BlcIjXcf67xymLvaXmGR3zLC4lkdLon0mpvXGA NHf8PmhUf8cQYAu2oyflCbY_fdy3Di7T2nVOvQOlyymot3dQ83D314Wz5kLNqpl5Y8KMAzWiNd0a nUwyQQaml2jSkfB_dmmcHzlymvNBbHrauMwCj6MHJmW6mkM3OmQSw8Xh7xtnfWPdgrDM0WmALtcf DJbAxtOOzXheRz2wVhK8VHBLkMzaPmmOR81L..kcoKNGBrEz.iklmfHlQgA.AsHsK1mU7cm82lkR 7tEuYLIgcBKHTEMr_EhvH6lyIndey98EgWdvejELyZWXsysX_l0wSlSHV9z1ETEvrLzi.ogzHlPX m4DXgS5w0i6Cfjr_SooFT7j0gtDnwlrFMwc8NUshUu3bLx2FIRKU07W1QZKq3cJPzacuBjz81D1C BNJTLeUbAs0_Kzyb_vnzjf4XCxC6.Rtc7QCX.AbfQAsy5fXvApVisza.P8souqmA_vw7V4G5tEzM 8T4skWQRAhm7pKoJ5Vffr5TytOytGIojQKO2Ds3BonuiRf00NJqEUtBHK0AtxDwPXnd2F2O2OmVB uL8XKeRBQ4wn2BOiOjiAv73SKK_9OhZJqptbMf3nRByL2IomBctBsIIcSHtH2ijjWP5MghbnVCvO GmrtlmSGvuWqE66tvHRCLy13fqoT0lbMlG2Wzpv.9660PHypWwnyO8yEtG2HOHgm1k1cvVqO6wkH 0bdiQlYRw7QNUFLqLSekAoHd89KnLIs00jpNswo39JXn_yFQ0pI6s8JnS2dmx3.f41CPMyyqBCKm bHNlHCvIc1bRsWf09QcdEAQQTDRzY2UWV0jpVYAkZj2JGQewIvwmjjhlGgl62npEqgToNNaGSn61 YzJU2XReto.Ka7ODK4vb6dzBGRqqIXCS4s5rncV87O4m0DWYr7w2eAp1LxkR0vc0oOeqJlAfw8em dcRbvctualfQGBLKp1LY7Zx.qXtnoGP2a8vjkY6y4.3wLX_LUBsrUkOuPgyOwF4CyDGUgqlJAAqG z7eaRbedMJQcYQI3DOtbCS6AyJK6Ud9O2c4DTVcy4FTm8nR8Y_.EL7BoXN5USoiOX3cmyh96z4Gd WB6bxzo.wsDViFpuLKJo_s.946tzTaEVbNKvQOZ9GwcrtuO_CIn7a3lwAOWqs5S.VY1zjG_fLl95 RK42hvcEgU1zKrd4qxGS.lX4326aitCQszmr7ox8ng4Bvxn03pe.3UlX4r4vw1ARMe8CdNdG.aBR itmIXuyoE.Nd_eOZOKpK2PfrCaaLyzOqDlVnN85_YjoEwx3IQWwQHGXHlEeR3vbrT0psfZvZcGz8 ZQsdi_PMwcTzMsnlt7GvAAcd4nHAWgOfDj86zNPUIafAYZBCxiAnD0SWP7Pg6SRIL2HcLTKc3rtq hSM34jryZIaDz0RGLHlVjCJC_ZemZAMF25mXlNVVAyiaiJdtNAn_M74EaYp86ukO3jkD4rWcBAF5 Se0W71w-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.ne1.yahoo.com with HTTP; Tue, 4 May 2021 08:20:25 +0000 Date: Tue, 4 May 2021 08:20:24 +0000 (UTC) From: Filippo Moretti To: FreeBSD Current Message-ID: <1098908076.164540.1620116424648@mail.yahoo.com> Subject: Problem compiling harfbuzz MIME-Version: 1.0 References: <1098908076.164540.1620116424648.ref@mail.yahoo.com> X-Mailer: WebService/1.1.18231 YMailNorrin Mozilla/5.0 (X11; FreeBSD amd64; rv:88.0) Gecko/20100101 Firefox/88.0 X-Rspamd-Queue-Id: 4FZCT71MsHz4lG3 X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.163.184.45:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.163.184.45:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[66.163.184.45:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.163.184.45:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[current] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 08:20:28 -0000 Good morning,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 harfbuzz did not compile with he following error:=C2=A0 File "/usr/loca= l/lib/python3.8/site-packages/mesonbuild/modules/gnome.py", line 449, in _g= et_dependencies_flags =C2=A0=C2=A0=C2=A0 if use_gir_args and self._gir_has_option('--extra-librar= y'): =C2=A0 File "/usr/local/lib/python3.8/site-packages/mesonbuild/modules/gnom= e.py", line 498, in _gir_has_option =C2=A0=C2=A0=C2=A0 p, o, e =3D Popen_safe(exe.get_command() + ['--help'], s= tderr=3Dsubprocess.STDOUT) =C2=A0 File "/usr/local/lib/python3.8/site-packages/mesonbuild/mesonlib/uni= versal.py", line 1320, in Popen_safe =C2=A0=C2=A0=C2=A0 p =3D subprocess.Popen(args, universal_newlines=3DTrue, = close_fds=3DFalse, =C2=A0 File "/usr/local/lib/python3.8/subprocess.py", line 858, in __init__ =C2=A0=C2=A0=C2=A0 self._execute_child(args, executable, preexec_fn, close_= fds, =C2=A0 File "/usr/local/lib/python3.8/subprocess.py", line 1704, in _execut= e_child =C2=A0=C2=A0=C2=A0 raise child_exception_type(errno_num, err_msg, err_filen= ame) FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/bin/g-i= r-scanner' =3D=3D=3D>=C2=A0 Script "configure" failed unexpectedly. Please report the problem to desktop@FreeBSD.org [maintainer] and attach th= e "/usr/ports/print/harfbuzz/work/harfbuzz-2.8.1/_build/meson-logs/meson-log.= txt" including the output of the failure of your make command. Also, it might be a good idea to provide an overview of all packages installed=20 My setup:FreeBSD STING FreeBSD STING 14.0-CURRENT FreeBSD 14.0-CURRENT #24 = main-n246214-78ffcb86d98: Tue Apr 20 17:51:50 CEST 2021=C2=A0=C2=A0=C2=A0= =C2=A0 root@STING:/usr/obj/usr/src/amd64.amd64/sys/STING=C2=A0 amd64 regardsFilippo From owner-freebsd-current@freebsd.org Tue May 4 10:54:08 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 887A062D833 for ; Tue, 4 May 2021 10:54:08 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZGtS2d5hz4sKp for ; Tue, 4 May 2021 10:54:08 +0000 (UTC) (envelope-from herbert@gojira.at) Received: by mailman.nyi.freebsd.org (Postfix) id 5863C62D832; Tue, 4 May 2021 10:54:08 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 582DD62D831 for ; Tue, 4 May 2021 10:54:08 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.bsd4all.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZGtR1cp3z4sWL for ; Tue, 4 May 2021 10:54:06 +0000 (UTC) (envelope-from herbert@gojira.at) Date: Tue, 04 May 2021 12:53:21 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1620125639; bh=QGxte+XNcwDhDmar67TzQnJa8AdnlCoqn7EIWJ399zQ=; h=Date:Message-ID:From:To:Subject:MIME-Version:Content-Type; b=GqpOrssueiQ8zJ7VkIV9LmF2FMhc5IeTYJ/f4quXMMx15npj8KdXJANwMPFcxsXJ2 mrOqQbJ2mufS8GEDrAWyYqG830TRG+h9BHLDzH6XKC2hIGO0iEgciyRgR4PwLYqlrT IYkfjZryTc6K1s5x2j8Bcan5t6anhaMgUUF5G/McNtiBqv1QzyPp8GPEDpsIs3F+jX EVfccpTTMrMz6p2XlGkcvEE5OufaKWp9Z+aW3dxSFGfoFLjpBhVyEdtFTOi1U5JFKR Y0o45+2+BaoNYWPN2BjEe/4LJb92rkeCja+DnXblZJ44GmpKqI1DYPPNxZm1u5s680 MxESp7xFlk4pw== Message-ID: <87pmy6ahy6.wl-herbert@gojira.at> From: "Herbert J. Skuhra" To: current@freebsd.org Subject: Re: Problem compiling harfbuzz In-Reply-To: <1098908076.164540.1620116424648@mail.yahoo.com> References: <1098908076.164540.1620116424648.ref@mail.yahoo.com> <1098908076.164540.1620116424648@mail.yahoo.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/28.0 Mule/6.0 MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4FZGtR1cp3z4sWL X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b=GqpOrssu; dmarc=none; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 94.130.200.20 as permitted sender) smtp.mailfrom=herbert@gojira.at X-Spamd-Result: default: False [-2.50 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:94.130.200.20]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[gojira.at]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[94.130.200.20:from:127.0.2.255]; DKIM_TRACE(0.00)[gojira.at:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[94.130.200.20:from]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE]; MAILMAN_DEST(0.00)[current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 10:54:08 -0000 On Tue, 04 May 2021 10:20:24 +0200, Filippo Moretti via freebsd-current= wrote: > = > Good morning,=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0 harfbuzz did not compile with he following error:=A0 File = "/usr/local/lib/python3.8/site-packages/mesonbuild/modules/gnome.py", l= ine 449, in _get_dependencies_flags > =A0=A0=A0 if use_gir_args and self._gir_has_option('--extra-library')= : > =A0 File "/usr/local/lib/python3.8/site-packages/mesonbuild/modules/g= nome.py", line 498, in _gir_has_option > =A0=A0=A0 p, o, e =3D Popen_safe(exe.get_command() + ['--help'], stde= rr=3Dsubprocess.STDOUT) > =A0 File "/usr/local/lib/python3.8/site-packages/mesonbuild/mesonlib/= universal.py", line 1320, in Popen_safe > =A0=A0=A0 p =3D subprocess.Popen(args, universal_newlines=3DTrue, clo= se_fds=3DFalse, > =A0 File "/usr/local/lib/python3.8/subprocess.py", line 858, in __ini= t__ > =A0=A0=A0 self._execute_child(args, executable, preexec_fn, close_fds= , > =A0 File "/usr/local/lib/python3.8/subprocess.py", line 1704, in _exe= cute_child > =A0=A0=A0 raise child_exception_type(errno_num, err_msg, err_filename= ) > FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/b= in/g-ir-scanner' > =3D=3D=3D>=A0 Script "configure" failed unexpectedly. > Please report the problem to desktop@FreeBSD.org [maintainer] and att= ach the > "/usr/ports/print/harfbuzz/work/harfbuzz-2.8.1/_build/meson-logs/meso= n-log.txt" > including the output of the failure of your make command. Also, it mi= ght be > a good idea to provide an overview of all packages installed Have you tried to (re)build devel/gobject-introspection? I think ports list is more appropriate. -- Herbert From owner-freebsd-current@freebsd.org Tue May 4 13:02:35 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6B2C5631981; Tue, 4 May 2021 13:02:35 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-il1-f170.google.com (mail-il1-f170.google.com [209.85.166.170]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZKkZ08p4z3GVJ; Tue, 4 May 2021 13:02:29 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-il1-f170.google.com with SMTP id l19so6242470ilk.13; Tue, 04 May 2021 06:02:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=LthTeXlz074DBmzKyJn1728JnXgN4bhkxNT5P3WSM64=; b=b+RnMf4Od/tK7d4zgoAGUEQ3tEIepPCNgO41Nn6hsCCVK4NVDHv1UT91GKbgnGOp1Z OJjQG4vCyj1jm55UTF7G181JmVG8UcdrFNqvWrXklRAwGCRPVVmDcvhTm5703hqe+9vj 88SZuS55X3zJ+Qe8YcYWYA+Jyyy0zQkf06y3LyLMVKLzpwv13zmxMIdmS/p4TlzzRYnZ oJ3M97x1H17ikkS0UTBgyysIPYCxMhfp7UwtkgjzujCTfCyW3EujTaq8iG3LcC5x+FEa co9RmIDk3JYDGF6A6XwaRuBFBJ3y3FOLT6hhzcpvhmLYJUWTsu9HF/KhifgW5V/B0d5d rMPQ== X-Gm-Message-State: AOAM532VG1TwSXw05kynTTkdFZOIGue/c3o+EAFUMULOnGLqZC5ocooS MUvIHC7agVG3MMX5Glqbldbn9Sihd+OvfC82wug= X-Google-Smtp-Source: ABdhPJy8Wi0KbdkuzOOHRI7tyqZlrKN/LDYKcgWnZBdbepJuJ/1JhOXg4fPQGRDtWzSUrv/45rA5gS8wyz3+VG0M958= X-Received: by 2002:a05:6e02:102:: with SMTP id t2mr16143626ilm.182.1620133348597; Tue, 04 May 2021 06:02:28 -0700 (PDT) MIME-Version: 1.0 References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> In-Reply-To: From: Ed Maste Date: Tue, 4 May 2021 09:01:34 -0400 Message-ID: Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? To: Mark Millard Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FZKkZ08p4z3GVJ X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.170 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[yahoo.com]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.166.170:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FREEFALL_USER(0.00)[carpeddiem]; SUBJECT_ENDS_QUESTION(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.166.170:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[209.85.166.170:query timed out]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.170:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.170:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable,freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 13:02:35 -0000 On Mon, 3 May 2021 at 22:26, Mark Millard wrote: > > But I'll note that I've built and stalled py37-diffoscope > (new to me). A basic quick test showed that it reports: > > W: diffoscope.main: Fuzzy-matching is currently disabled as the "tlsh" module is unavailable. I just looked up tlsh - its "A Locality Sensitive Hash"; I presume diffoscope uses it to infer file renames. I believe the warning emitted here should have no impact on the output we're looking for. As far as the utf-8 issues go, diffoscope requires a utf-8 locale and I suspect that is the issue. If you don't have LANG set already, try setting LANG=C.UTF-8 in your environment. From owner-freebsd-current@freebsd.org Tue May 4 15:51:58 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BEE20636B2E for ; Tue, 4 May 2021 15:51:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZPV55fd4z3R91 for ; Tue, 4 May 2021 15:51:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620143516; bh=clcec9wkVDW3poI9b8J7ttC+NTMCfnWQLvLIvG/V57A=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=egZs7NpSYoUcdrjR9nb43q3yUgA5LX395Se7y0CEFviedYOAtHLji/zSPwnYLB34R+BHOYblRUc6lterlCeAUAhkePXSvPKjfbti4tTGG11xMaWqJmsa1/lGqEslB0t1Id60chXBVE9F2SM5fB2EaETH9e/zX8dLS2UOg3/g7YbbDsbjOgIWij6GW646eBmyiDRjokMIeDw5dd98oDD4AyE9dg1CR4uO2mnmi0a/B9MUq2C0JKBXx3VlzXb5e+/RMBSfi0bPp8QVhmrZeuVKukxHQd5FMJxugB+KoCVy0VHZpkTCOaYPwDldp7IfJP91Y2SFGhNH1BP3aCyJB5O/sg== X-YMail-OSG: 0g77.OoVM1mbrLyUD4uLM.ZvuOqIdPLvw88bBFEL5f3ynau0OK45fb04ZraeQ.p KwA77j2C7MN4DbGlIYvujsjalGnAB44btUsntRD3eWeQL3dqmxKiCf304uFJ3E8MU9fK9IGdiyrc yZB6XeULFe9BE2.02zGE.YetIUdFSLkkMJG9IGWdU4Rp.f24HUMhG9h1Pc1NukiWPtKqQmGPAJUi 9hRipjDlUkLWP7MU4y46RCsbIAHxcuLRFOfatm5Dx8NXVRWrhySs5ELma69.TyxM0P66Bbo_S1i1 B9IliDd3S0WgAqqF_ukWJPW..y0KwmCyddsv22A2YkJGuuakPgG0vuyNv25iAAFdc_3cBv.ksa7E oHrH6l7q1gBCEmqpvH3uqxYFgkCJYqxpV75dUIfOW19eU0A3e6ifPHQevUv7ciRBrWRdYlfpafWo u2oOVmfVQc21w5DC.vHx7Wi4qC0_gdl.KiIXAQmHR7OGOSI9a5JmLmQ8dhttED2M5V51hdVsvKgt PNMrZIe3vlm7Hn_MRqqczwdDHbUIZE3t7iAKb.u2mVkkp_4C_IBMkFI12RdGAIPEo7e7MC1ARFPV 0SR6jDH1ecsnjvK189L1XOOpz0v5hLAvbZyQVVj4RW6.GZsfPSzVBcblmMnN2eOhDB6JTir0W42T iQTFq1UnS8vNUCzgShmwCReFuxL5OM_9McjHSr9UPquFu3NVD7lpPO1vCHfcytYds0h1Nj4poaZw C7ASQJG6lHKxK8y4lb9RyiM4dkyN7I1HIlScNnve6H4Ny_5p0WEYmOJuR3FAc732gmPwtdZ_L9OF BgzV4Qf.R9ZZWsm1q683OFA_23tPdJ9OEBKPhYMelJ8rhr_FC_W04SmdicP6AE3_OkcQDU2sTA67 7BsElzS.onI4.YhWwf6FXOoFBDCkVKIENfpE9fajJmUGiaT6QIg7lQweNWJmAbe1tyaaDu5S9Bhb nCNjo3ULOiybgBW7QWc_37E4iBPgKozRMNuxjzHIE2agjfstj4kLh0kHN0zB4ESSDSanPKWMDVHI ZjVZFCFDaRJMAlSIBxpzWue_6g_WuUVBCUMF_c979uAanD1OV2U3kC9S6r5ttsFYhU_JB68H9PEO ZwrDeU9bb5y8tP4prBXBoTNuDuyLoYmCH4Ui3brfMTmeA3NieWUjLmW5TrdmkJIm1f8mdLrBZYtw ej1dAuH1eiBM4E5ikj8Qs2tLh2dtB8AejE9KufXweV09nKQ8WOd3aNv5LEyQcEBwRRz9_ry_2naC i56cMo5mHnfYBgIXNVnnMyo1TA3vF08QFOSUDJvBREZrpv8p2kOOl6z5NY_EXjVIU6GUlS1905CT tUWnmWsS7xObVgCxI3qsKSzyzJADB9.A29HUhpxilnAUvRyfgBnF0.DmEWa.Vt4uJ8Mo6lj1DRxp 4xPr9W562Nv4l9CQSvVbrsbayH5SBXpgrTBKGeaWK_lRITXl9JaT7pvcQVIyueoGoYFMDx.IJUPs 1QD0_7ChdCEWDmNjv6pfK6ln.noID3sHK8dVfUvuFQUSvk5mqggdwvsteI9Edrw90pcHcSsk1z_U YbJX3DkjSamttnZXwQHPi5AB9HHxjqSkXuCaucd2gEKT7UhspjMeh7eMj47VgLzLO_nN0.89o1MQ 987Hu6_UWjD_EV20_h_1AEKsoooQaiV49i2bNAYDtWtDdcJTte5AAK6387IwD58BxtryxKm530Ps HdrBSWrN1jeEHe.cYm8uekPu0RoLhAwZnZjl5bl_Zb67SzHyeRcU6Zru_0xIfeJIC7yOR4Iw9jKL NA7hJscnVRA_4eU_M3VjqmSQLUpMNBwpb26XwPZn3P6RvCTZbmCiloMaVH4BwUBYxL.UkAsvxCI7 wD1oIvvUcF2KSkngwxvn9IetewbEGVlqPXBZ3Q0Q3XMqzAIwiv41noBnBOogYbo8wwxsYUE8ax2J kYgoSuLH95N9qTtQ_afIaUrgFBnlLcgzH2yj3PZuM2sLpgFtVpVt2paV3XgWLmIwZMrBqVHLQw0X 71osrfX39U7tGvNCx6K4YWZZF_7ivNmbK43zAz3pQoXIpdxsuJZm.Enw3Ied2AEe.4ST42ilVBim EdsRHq1pcuSIqjFXQ2jfM0wrOHgmefPLG4WXickk6fbdFaN5Fvg7bLQUYPUa9pqp.RZOGs8hXDPA HJvzKvOas3KCMukd2G41EZOB6NFdUFo5mIr91r0rkBFroTLhTJglOH4B83ThcIVjfZzhfihfgii7 znm.vJg0XIOIGFBJ0bQbW4BaRsIrkjY0wBxl_pfnByg4O_2JgLMpfYSgfSTirUDJVSabxI7HBRYA nvvGlr5CzEVHAc.eypPP.Bie9nqgZd6_shDuI3UEvzd.TeDxiYdUpfrrqKewKAXqwmcmxz6Csabq agf9bZvpFOjN.azRo_Rota.wwZ0zy28B_IsMXYHY_iizAmYy._xI7ai1NR3ZljzCjIoXR891S0Ne ONYlbOKAMCIeT5XzYHNiC2uamIU2sYFfee.y8ETw0F4B7.I_DHKdl2lXTdTjQrhSNtnV5vOG8vEs Qj9uGyF4QZ3UR8p3acxkCn9DAicpsvl7hfzdSjCkOVWUgCXpzsfKh20Ljsi6P6aCnfHGMShNUngj j543tz931nAdeLd8yNvYPz77OcI9lVvhUZURIUO_F86uE9i36nhwq_C14TKnOk7.VbEYxDflHli5 xPbJqbbfPWDbSWnnkPRUMUVjJthn6ujE1lQaeL0Xq X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 15:51:56 +0000 Received: by kubenode562.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 248506260a44890ad829ac6f4f1c1881; Tue, 04 May 2021 15:51:51 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: Date: Tue, 4 May 2021 08:51:50 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZPV55fd4z3R91 X-Spamd-Bar: - X-Spamd-Result: default: False [-1.10 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.205:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.40)[0.399]; SPAMHAUS_ZRD(0.00)[98.137.65.205:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.205:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.205:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 15:51:58 -0000 On 2021-May-4, at 06:01, Ed Maste wrote: > On Mon, 3 May 2021 at 22:26, Mark Millard wrote: >>=20 >> But I'll note that I've built and stalled py37-diffoscope >> (new to me). A basic quick test showed that it reports: >>=20 >> W: diffoscope.main: Fuzzy-matching is currently disabled as the = "tlsh" module is unavailable. >=20 > I just looked up tlsh - its "A Locality Sensitive Hash"; I presume > diffoscope uses it to infer file renames. I believe the warning > emitted here should have no impact on the output we're looking for. Okay. > As far as the utf-8 issues go, diffoscope requires a utf-8 locale and > I suspect that is the issue. If you don't have LANG set already, try > setting LANG=3DC.UTF-8 in your environment. That is not the issue for the UnicodeDecodeError: # echo $LANG C.UTF-8 # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. $<3/>Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 745, in main sys.exit(run_diffoscope(parsed_args)) File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 677, in run_diffoscope difference =3D load_diff_from_path(path1) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path return load_diff(codecs.getreader("utf-8")(fp), path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff return JSONReaderV1().load(fp, path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load raw =3D json.load(fp) File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load return loads(fp.read(), File "/usr/local/lib/python3.7/codecs.py", line 504, in read newchars, decodedbytes =3D self.decode(data, self.errors) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: = invalid start byte =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 16:56:49 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DB66F5F939A; Tue, 4 May 2021 16:56:49 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f52.google.com (mail-io1-f52.google.com [209.85.166.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZQww5bW9z3m0X; Tue, 4 May 2021 16:56:48 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-io1-f52.google.com with SMTP id k25so7770079iob.6; Tue, 04 May 2021 09:56:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=yvYZEOLtbQSpF61Px6IhxYagIqcItrcyki0blF33n0w=; b=OdWgi0ve/dosh3c/oeCdA2ZGY10UiW8ItCfNbv7AgqimuBZwgXy7VCVRDJ6l1hRvVB ZLXODyXvagNyyWfcpZbbU2aelU0F6EN2zDw+vEdyj1n79JGXgwznKkaTl7krl8MDsa1w +/EH1aKbyfZKklGE1uIOvI0QFxdX9X0EZqpJ8FYbW57c+N3BjY5WoenwlCmB4PMhf67H 8dMrSUq7Vgwnku2qUpqD1VEueUtx3dSQx+PbGe0u4R0nFz6r6Uh0tlpBYo44dndewGYn /wTDZUhzbVUpG2MSWL/XZcuE88GuXUz6DjkLV7tWv9Iw/QFMj6/D/Lf9EVPIX4bhOF5T Svqg== X-Gm-Message-State: AOAM532b0JpjyEBK6bc7F1V636LFzkOoZy4PFmzWEKZZkoCvzkhBplcF lcEmUiekR9gxoavd2rr6oSYeuI/v6pjq/P1WVLM= X-Google-Smtp-Source: ABdhPJwK2xNBK4OLyYlqmTjSrpckuOd0vteVSsfVvPqY8ujaZmswTH6O4tgR/5xEh6yiQqr9L7nnU0veY61zvMUnIv4= X-Received: by 2002:a05:6638:37a6:: with SMTP id w38mr20980791jal.106.1620147407450; Tue, 04 May 2021 09:56:47 -0700 (PDT) MIME-Version: 1.0 References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> In-Reply-To: <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> From: Ed Maste Date: Tue, 4 May 2021 12:55:52 -0400 Message-ID: Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? To: Mark Millard Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FZQww5bW9z3m0X X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.52 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.99 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[yahoo.com]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.166.52:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FREEFALL_USER(0.00)[carpeddiem]; SUBJECT_ENDS_QUESTION(1.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.166.52:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.52:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.52:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable,freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 16:56:49 -0000 On Tue, 4 May 2021 at 11:52, Mark Millard wrote: > > > As far as the utf-8 issues go, diffoscope requires a utf-8 locale and > > I suspect that is the issue. If you don't have LANG set already, try > > setting LANG=C.UTF-8 in your environment. > > That is not the issue for the UnicodeDecodeError: > > # echo $LANG > C.UTF-8 > > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > [...] > $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is currently disabled as the "tlsh" module is unavailable. > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: invalid start byte Hmm, interesting - if you don't mind sharing I'd be interested in a copy of /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh, in order to track down what appears to be a diffoscope issue. To investigate the non-reproducibility though we can just manually run through the same sort of process that Diffoscope uses. I would suggest cmp -x to find the offsets of the difference(s), then use readelf -S to determine which section(s) have differences. From owner-freebsd-current@freebsd.org Tue May 4 17:01:25 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 54DE65FA033 for ; Tue, 4 May 2021 17:01:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-19.consmr.mail.gq1.yahoo.com (sonic314-19.consmr.mail.gq1.yahoo.com [98.137.69.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZR2D2y4qz3md4 for ; Tue, 4 May 2021 17:01:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620147682; bh=7BIiPqAM/LhnxKPot5GI2Bflf4HIDLcquhABCiIfFUv=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=s7VMdMiOJqMeJiQ8xlHc0dLIvap39FPGG7XIgeSi3Flh0LsCIoU05zjzJIJ5HmIiOf8JyJNUSsL0cHnjlI9vy6RmvmOuuTikzH6EvyTUul/igqDrAYHJhtLbuGRsfDvX3i2oESWnnfDcaB/9viXlFIxdB/bFLf58KfCA67CevQCCyMbhz5/WQAjTgqTL3T03mKCd4lTS74ZInUxRQnSDB+tT+MerWaxnL5d/99p0KWOAPeBn4dQ0u5ItH+jgGMn+GfMO12gxZwVeyzv+AOllYvWbvcFhHgU/Imo+n+MNLwltbMc4+hcfBZKnFqvJqhcMV6mFe+S9e2UbM9MpxbZNSA== X-YMail-OSG: oslOhY8VM1lsaDBsmMAnZPpJ60kzzIGgsY6UKYYTArp2w2mzorUW9pZcWgOOxpp QUsOkyumH5E5q9GE1A_4B..vweaZMa2c_ZcNb4isKhJExyoDUtD_lThKQewFu5XKodirLPUqgQch REGW0buuMAh1CjiH0Du8z35GUktdvhSZbQ7s9hUD5cJbC2CapO_IJKABSiK6xh2zmtaFAiIsHjMX AoU_J2b2byqS4taqatCAqVVf.VkaFprgcpPgVVykRoF907YtNgD7JE2jjA0Y5Uwl7jU2Vv6Hx6_N ieCX4VXrasBoNRkPUaa7Kg13R7KbAOgZygblBHX1ZxdmIQQFM44sB6pKETTuoaJ2NQHmakG8Kzix 8sihZWjORFNra2qeFxBmRjF_Du28G1rt9.gz38vzSUmyaIICaYaeQJ.xI_QditrmY93NZG3aoteU CsP9iyvyh4H8c6UOOe6T9cguzGMKPusAsA7FpFKMSDGHpIwUZlgz9D5qHa_IFmghsV2mFaTEkrK9 tP.ssaSUKugVwNvu2GmFD.mvxsU1f15WoxjF.rlXFbkSTQFeOKAChQdO.KmrEgwed4XwuaOabBPx qCgIHxl7OIKjocqWiqZhshbGw_cJo0zGfS3Grk56QJFQUh8haZ7Ir_4lme.7eztBTkot0WL_UoOI h6NJ41Kou2IJSS_auBtgtJePFKQgTaZRBytWUJPoJ2bXXp.XK12x0XW6Rr7GVk.3oh6rTi2eHgzm ygR5a0jwtPmCiLpdfzROfdC2fgiKgAuxXXrbgZ.dvyfQIcx3iCIOjrajX8mVATnVCD4VdMd0JHn. na5ilpcomsKx8Zhlm4fL_vmGmFYOc6qwu3apS1Vzu5gWe8vOtHi6OexoHHcv_NCjAJ9kYj_aCSVz eoWFAlmE52j5rKAdkYlz_t6lKGtKg_QfDfAMkU6lQ.itW3X7km2oHFqaMyJicMmKkojt.eYpYhXY hJeNAA4fO_9YeSer9DrJEB2FkT2Df0pVuhyvEF49bHWUW.1bwzG_CCuMScNnxs3xoQ_NWtBBm6xY FdhOpdtI06vDz5pjbk0iTvSjys4zGH4pHwPXzlq_GKJyOKxtTD9a7KpTl_JoGOpe0MawnQhfC_OG zV.t8hG8HkV4huGihHwGP5Wytzj0be073i35_HNrCoFP71DTqH1j_Cd1BZWpnQJW97Nunf2K1G9N OlYCYKL6Fsxhh6oDY4b8vcQAzFN7suNZBu6Hm5TK4Gyq.SWr7yuB2iLqm3ImMCGqP6qhb9eI1mJE M.bcO7haqbbhZDqmamR8eZ2UjApheISJhMvkOHad7C9AI7LufNSGU_w2rdqVlbFjWYFvSGA2d4bY CCgBMAPHtZPgaq_KQ1Fp5EyU0pCijQk6zeUTltQaiB.PkBg0i0qkM25GaYaX7qYimiEntLfOMHyd kTH4.ougDx4IfzKHtoDd7eJsCJA4aZ1RTQxFN1Qojp7yQRpe62S5f.4lPKl2p9G3Ez_pi34QXX6r cnkcLjqjvJ3Af9Aw3wWsZXSDnx_Xmt8Apph1_2dFktM6qvfiaCVqv_BBdWRHe2YtisKVlYqS3xj5 NJOQTVAi5CBaT5FitHF9WHTXbKWeGwWeEcutLcL3Fo2R2eXTSCpjuYwqyPEdCYSx87IEfH9.sDa0 N2ZLW_upJQOk1XFSo06O6_04qDYOC.iflYNNVsv73s6hd9j9Za_Xw59xKFsk.sb6tVd.u9NDLF.c UpiFAxBNx0utVXK6Ak.FcMsz4mIcFz3foT7LFJ9z3qpVW2aDwBJx2YmZ8fq2wQDa9NXmm2Q5DrPz 1SwSJP27V9RwjvuPV_VXY.3npH9ckYARycZSl6Y._LhI.tnpK2Vc6N4N9c6TYmV3AFAhcKo36Xly NYA5fA.DkhugqMeNmqr_gEotJAEBladGsMwkblfg_PsFV8kRdB22YIyYcAUX68jJfCbgseHILhJ4 WTMB0x1xjybfAbTRy.6YCga2dQ5z28ZJ434ce_xfYpBJDje8OKV_rtpnLmeYpYpdaTY8TTvNjA2s LAhIylF_R1989uHiE3z0oIkXzEkmn.HRF8WdWC75JWznepZshGZlDMfQ60a7w2UQZt4FdbuAnPAX 2vShHJ2fmAzdhJmZI8EmEbLeKvjM4I.JRE1biXUR.jmAj34kmFkKPSmdeXigIpnWB2w62o.WGLoj YTuxucLLl1TBnJKQeA2_KqMKRcXZ4z0UOk4THsPltNMDTNrUVe.WAoTkBArNWPrvbFMAg6CpidO6 OkeN.clAh8BMD8rTFu93zC77Q77hSR_ORoeuNxOyGwa8KY.LRPWTOdmOD7KmHDV9ahK2wxLranND Tsdp1fh0zY4PHKHyBGMyPxseydfzUBvaYqraLvx1oq4sKCH2IhpyzIISrfeARiLOybAM6xgA7cti BJyYNMQ4i96u1KTHsc9L5EOgp2HJLyGyFJ3k0eyzrbu5l2vIOqOT3.SdMuoRu_D4gBNQU5WmJIse tOKTwpeQA0Eb8bJQPKYHQokGSPTsxd12CQfJ9aBTA8Fo73MuRBPf3MBhR0aXSTtCMcNTJ9L49uTT l69hRqSI3fwwP4RD2a4rBE0o0knfcUTGMZt9IzG.Ho8a23Z4ZC6GHvyHSajzGhOXqjSMwmynjg6r gChPhQ1byk7uX.1IraMHOy90QNIkV1woal71kUPUi7TRCzDmOBwMB65oIvFgh5lZG7ixEQtH.m9E bPS1iEsVhNfLWnzhNo58wIXH211kSmFm1YltEoWq00fx7_g-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 17:01:22 +0000 Received: by kubenode538.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID c435762641fda1a4169dcdc43b265b30; Tue, 04 May 2021 17:01:17 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> Date: Tue, 4 May 2021 10:01:15 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZR2D2y4qz3md4 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.82:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.82:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.82:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.82:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 17:01:25 -0000 On 2021-May-4, at 08:51, Mark Millard wrote: > On 2021-May-4, at 06:01, Ed Maste wrote: >=20 >> On Mon, 3 May 2021 at 22:26, Mark Millard wrote: >>>=20 >>> But I'll note that I've built and stalled py37-diffoscope >>> (new to me). A basic quick test showed that it reports: >>>=20 >>> W: diffoscope.main: Fuzzy-matching is currently disabled as the = "tlsh" module is unavailable. >>=20 >> I just looked up tlsh - its "A Locality Sensitive Hash"; I presume >> diffoscope uses it to infer file renames. I believe the warning >> emitted here should have no impact on the output we're looking for. >=20 > Okay. >=20 >> As far as the utf-8 issues go, diffoscope requires a utf-8 locale and >> I suspect that is the issue. If you don't have LANG set already, try >> setting LANG=3DC.UTF-8 in your environment. >=20 > That is not the issue for the UnicodeDecodeError: >=20 > # echo $LANG > C.UTF-8 >=20 > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. > $<3/>Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 745, in main > sys.exit(run_diffoscope(parsed_args)) > File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 677, in run_diffoscope > difference =3D load_diff_from_path(path1) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path > return load_diff(codecs.getreader("utf-8")(fp), path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff > return JSONReaderV1().load(fp, path) > File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load > raw =3D json.load(fp) > File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load > return loads(fp.read(), > File "/usr/local/lib/python3.7/codecs.py", line 504, in read > newchars, decodedbytes =3D self.decode(data, self.errors) > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte >=20 Well, the list of differing files is huge. But this seems to be .gnu_debuglink content for the area it is in. I'll note that I did installworld but not the likes of distrib-dirs or distribution this time. This test did buildworld to two distinct directories: zroot/BUILDs/13_0R-CA72-nodbg-clang 5.13G 118G 5.13G = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang zroot/BUILDs/13_0R-CA72-nodbg-clang-alt 4.28G 118G 4.28G = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt and installworld to 2 distinct directories: zroot/DESTDIRs/13_0R-CA72-instwrld-alt 1.44G 118G 1.44G = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 118G 1.44G = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm Previously (armv7 target) I had built, installed, rebuilt to same directory (after clean-out) and installed to an alternate directory. That had gotten only a few files different but I do not know (yet) if it was the procedural difference that made the difference. Prefix of the list of different files this time: # diff -rq /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/ = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/ | more Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/[ and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/[ differ Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat differ Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags differ Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio differ . . . Looking, aarch64 seems to typically get a back-to-back sequence of 4 bytes different in native programs in my builds: # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat 00003bd4 1d 65 00003bd5 eb a3 00003bd6 bb ca 00003bd7 8e 1a # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat -r-xr-xr-x 1 root wheel 18448 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat -r-xr-xr-x 1 root wheel 18448 May 3 23:16:36 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat Sections: Idx Name Size VMA LMA File off = Algn . . . 25 .gnu_debuglink 00000010 0000000000000000 0000000000000000 = 00003bc8 2**0 CONTENTS, READONLY 00003bd4-00003bc8 =3D=3D 0xC # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags 00002208 88 a1 00002209 e6 40 0000220a 60 94 0000220b bf ce # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags -r-xr-xr-x 1 root wheel 11440 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags -r-xr-xr-x 1 root wheel 11440 May 3 23:16:36 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags Sections: Idx Name Size VMA LMA File off = Algn . . . 25 .gnu_debuglink 00000014 0000000000000000 0000000000000000 = 000021f8 2**0 CONTENTS, READONLY 00002208-000021f8 =3D=3D 0x10 # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio 000050c4 6b 3e 000050c5 08 ca 000050c6 7a 2f 000050c7 5d 64 # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio -r-xr-xr-x 1 root wheel 23728 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio -r-xr-xr-x 1 root wheel 23728 May 3 23:16:37 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio Sections: Idx Name Size VMA LMA File off = Algn . . . 25 .gnu_debuglink 00000010 0000000000000000 0000000000000000 = 000050b8 2**0 CONTENTS, READONLY 000050c4-000050b8 =3D=3D 0xC For all I know, some individual byte(s) in the 4 might accidentally match sometimes. The addition offset after .gnu_debuglink's file offset does vary (0xC and 0x10 above). The content of those differences do not look like file path components, for example the 0x08 byte. I do build with: # Avoid stripping but do not control host -g status as well: DEBUG_FLAGS+=3D # WITH_REPRODUCIBLE_BUILD=3D WITH_DEBUG_FILES=3D But that was true for the earlier armv7 target example that I reported that only got a few files with differences. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 17:17:42 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E4B25FA932 for ; Tue, 4 May 2021 17:17:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-24.consmr.mail.gq1.yahoo.com (sonic304-24.consmr.mail.gq1.yahoo.com [98.137.68.205]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZRNw4BS1z3nTP for ; Tue, 4 May 2021 17:17:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620148654; bh=5hPBqD1eQ4r3oEFTQXB4jZ+ruJJjDNzv3EnxgpC8AxD=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=JDGeFUZmtnZPWcq5PjQ/zWtytZOXvtgjBjnCx8pHb+kxdI9idJQEAsFrEKViietcW0OdKHkhssLQWbgOqOsi9nNprQ1qySXqEc1iyoOKRoHUCRbg1482dkSW+FcVoqvdwoJLs7mhexKSWjuSkAWz4mKEY5Sa658lThZ4FENlxbpqCzVksDFurHdbKRHc437C+OnMQUTyq/PtcAiXOYPNWbctj9MWbRfkF8iC3kl4/yJ2qpi1oLsZYJ5kvK3LqR24820qQhL1Gc3ArHyCywBgW8cfY8oWqJ6pE+ELKBAw7RMA8fpQ1iJuNgRG3FyjsC44hhIPXc9i9yxYHPX22KYyRg== X-YMail-OSG: jab7ix8VM1kUz_1QVWzmsslDaw.he.zwmC1cgpNUdVfFLIGPbOT4GOAyCIo9J8v vfHqo1GN4HqHm2jA4Zsae2XMTmHGMveWZ2lVQ3FQvctlbCOcJQFbi.Ggjlv4y0BMHIZnTNGLbC4t oOfISLjDLHdfRz7S2uK3Ay.Gvd0wLllS1s58aKkzrJ647WZMZkf3cC9YSugPH0JVgnw8xjuhvuKO fEo1P0K._Uwjb.f3HhNHTpKQ1J9vstozA855DU3VpcUJLdc59NGIrVUFdI9mvEUEQhell._lHiMi 9p6_sN0.zzAFMrliE0mKeqpMirndwXFi60IDqZNVb15ysVc_ygxS2OS6KsBqPOSJBWOFgUWKvuB1 nMRJKxmUEO2zp4Wf1hjGr2yBOgReqwErXL07dMKX2i9s.O8.R6m2jwGkwAb9tCyEa0pfLHMyDv5q KeGrc85GZqVHRqlkFQnJ3yCiGlftmQlgDOygnM.c7tGx8WhAoLgKHZ_gA931RkflI6p1Y6aCk3cE boRyh2JxKghqyVhceFV8ulVg1Ws4HErccxE.Uk9wVWpg0O1hc3LK6hDKnThhoW_W5qCDXZcLOZhA UB2S8I7USm.LcAs39jsFegNmtqh2oNUi4sy0jk59KAoQATJ01tkJvbcHt5eYsrdviNTpINIFUXaJ X23LiGK37PrE5I2mE85yVDNEYVRwaBe8hQV1z3g__nYRCHg63MmOUMQvYVX9fsHJt94VeYsiL59S z_x.tqcpxtQL0_xXMX9oFCuq4c4S5o0uBz_9GIKRr7IE6_0qX8uOHaCF6bXh1MjtkFwRbbbJi4cP jQwUNqWIm_MDPoYbyGk2UvWLRL252IFwwHXDNyS3hzWQDR5re3UOWVvWR7tuO0y1SN5EhEuwIqzB VpJpc0SHlrt2OLHOCTxBC9jeHGWd72KwVezR9z28ahTfx2wo0e58ohfCDJdllg2TPXXMHphSAsjg qnwdJM_zLc6eY9hjxtoEyZnsHXh4E7tZjwpGb8NznMxeRQrN1IqiRjzlB2CfAZlYW6dA.gTBmNJL 8jmvmQov0zh8jrgSKChh_fU2tYDLrvLo7iFVjgE0ySrINlltNvmVHs0AiTkW7GtueaHc8fSapd30 2bgy9JVIhtbQ19YhwQMVqWm.bjIrinVifrJV5XzcU7szUkaBs6sXeDjdYpLgYY4A7tSdHK2QKbqr C3zRGuV_0dCV3u45j0dMG.qI1upHqo8PLzDjT5zmzEkHLnz06j5U62MM9QQjuYUgMRVrm20NaD5k BkFSokCsXkYAlzTDhNhOWeaU1IbCVUZBYk.sw5xiqy858RId5yXbWXCsQjRJEUu4va9CalYuQyai p08nKOcl9LHV1Ag2p6noFXYuY9Wnuroffa_qaWYch3y6D3tJ_mM33iRDJGyNXPSgkXHCiEUgRd0P ROsAB4I_dqB1SsdHeYjL8TuA2RRQwS3ul0dSQ4JnJyXT11DvNEGRD6oQXYEo02Ysjn01mTsL71qC Ki82fUXWZ4rkR6TBklKKITouuPXV6ZT1.jqegkV0k3WQYn2tS_gG_UwnKQg4cNoOydUzR0b2K.K6 Pj09JjM8AfI8eym4pmTlLN5h.tfhLs5R.DnZt25f1JDApoNYO8DZsvgu6_x9FW.Dmn4nXWjMIulW Cdtp4ruSTBvli94fI_DSnIrCXXjqIPivMt4MYuhVqoAQXsdNq8S9bFj_AKfw5FIUxtPtrNPcGUTP O6xFCAqP0cz5AX3rziiBxdfaBiz875x09rIRw8mFIRjVGx5Tr9Bsm0d_LNTAyyBvtVpOlo.8USjO YHZYHeZdlkhmNL1dyyGy7BktDNQanCu5nF463V5iZ6ApyrHvW91rShRPPJlGDyqAVJFrknZ6uNjI VLCdKCJbQrQP_KnE_U7cjN79hHz1Lc9qbLuWvAx8k1DhWc1d.KcDKV7J7NgsttN0Bkhtx2sugwBp 4f7Cl6.9Icd9Wh9KKbWZcq6lCWRJIXCe31qRluX8roI_k1fjbS3qsDke9kGJmUDSNVz3HkONkIa5 CNgQ8M4jXEEmrhveILjhz3AFGZQw4na4nnCfgJK_DROFPFe9oVTQm.aNSVbxp3HcU3cO2V6gLMRw xUSOoR0Ghp07T6yq9ZRbJXGLiZREYRH6URsWzUvjUzoWIrbbIPupWdWXL88PbQv4cTcZyGXcjpOd LvFPQW5cdGKUwBipgTqEFSBKHhzDpsTMbSRoC8lK5vzD8abZkj7k4GC4.PAMrmFZb.j1TDDwhhuU _aj5ubZARUjJi3mFjcNp3OTY_0OWvctLIF13eCmzV41EaWXAHekCOzcYreDsjPLb689xpn3qzb0Q p_vypr9uyQmq9gRx.cRrbDU4QEhR11cEAKG6zl6dc41tMD7daJ4FKcpdUb9aGbHgEPNTnl2oK9rT X_GB_UV64r.I4IDacd.KfbkeNhPAXPmVzRC1ehTtlrbMTENialJc48Maag7iW_pnwzGooUu8oJ3Y amGfi182KfS8wD32ZW3D5zUYLZeOR77znfGsn9GEcpBdYFkhCvdtUUlIQKJWr1BKWN66TIPXPTZl LehESH8xxCHeNIWkcebaLK8LtsamsK2bGtteV1tIDBlgdkHUToy_BJO1JP0C3CPsVPsJS6GW0LFl 2TaMrYfGBcaqhzM9muCCTnfM4kj4JDxFGne_Eb3pAPNcybP7WYiEoLfRDcof0eb0MEg-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 17:17:34 +0000 Received: by kubenode542.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 3916381615388a11c064df3a50eecc99; Tue, 04 May 2021 17:17:30 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? From: Mark Millard In-Reply-To: <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> Date: Tue, 4 May 2021 10:17:27 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZRNw4BS1z3nTP X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.205:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.205:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.68.205:query timed out]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.205:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.205:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 17:17:42 -0000 [Just adding readelf -S info since it seems to show more.] On 2021-May-4, at 10:01, Mark Millard wrote: > On 2021-May-4, at 08:51, Mark Millard wrote: >=20 >> On 2021-May-4, at 06:01, Ed Maste wrote: >>=20 >>> On Mon, 3 May 2021 at 22:26, Mark Millard wrote: >>>>=20 >>>> But I'll note that I've built and stalled py37-diffoscope >>>> (new to me). A basic quick test showed that it reports: >>>>=20 >>>> W: diffoscope.main: Fuzzy-matching is currently disabled as the = "tlsh" module is unavailable. >>>=20 >>> I just looked up tlsh - its "A Locality Sensitive Hash"; I presume >>> diffoscope uses it to infer file renames. I believe the warning >>> emitted here should have no impact on the output we're looking for. >>=20 >> Okay. >>=20 >>> As far as the utf-8 issues go, diffoscope requires a utf-8 locale = and >>> I suspect that is the issue. If you don't have LANG set already, try >>> setting LANG=3DC.UTF-8 in your environment. >>=20 >> That is not the issue for the UnicodeDecodeError: >>=20 >> # echo $LANG >> C.UTF-8 >>=20 >> # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh >> $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. >> $<3/>Traceback (most recent call last): >> File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 745, in main >> sys.exit(run_diffoscope(parsed_args)) >> File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", = line 677, in run_diffoscope >> difference =3D load_diff_from_path(path1) >> File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path >> return load_diff(codecs.getreader("utf-8")(fp), path) >> File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff >> return JSONReaderV1().load(fp, path) >> File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load >> raw =3D json.load(fp) >> File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load >> return loads(fp.read(), >> File "/usr/local/lib/python3.7/codecs.py", line 504, in read >> newchars, decodedbytes =3D self.decode(data, self.errors) >> UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte >>=20 >=20 > Well, the list of differing files is huge. But this seems to > be .gnu_debuglink content for the area it is in. Specifically: the last 4 bytes of the .gnu_debuglink section. > I'll note > that I did installworld but not the likes of distrib-dirs > or distribution this time. >=20 > This test did buildworld to two distinct directories: >=20 > zroot/BUILDs/13_0R-CA72-nodbg-clang 5.13G 118G 5.13G = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang > zroot/BUILDs/13_0R-CA72-nodbg-clang-alt 4.28G 118G 4.28G = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt >=20 > and installworld to 2 distinct directories: >=20 > zroot/DESTDIRs/13_0R-CA72-instwrld-alt 1.44G 118G 1.44G = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt > zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 118G 1.44G = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm >=20 > Previously (armv7 target) I had built, installed, rebuilt > to same directory (after clean-out) and installed to an > alternate directory. That had gotten only a few files > different but I do not know (yet) if it was the procedural > difference that made the difference. >=20 > Prefix of the list of different files this time: >=20 > # diff -rq /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/ = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/ | more > Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/[ and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/[ differ > Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat differ > Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags differ > Files /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio and = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio differ > . . . >=20 > Looking, aarch64 seems to typically get a back-to-back > sequence of 4 bytes different in native programs in my > builds: >=20 > # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat > 00003bd4 1d 65 > 00003bd5 eb a3 > 00003bd6 bb ca > 00003bd7 8e 1a >=20 > # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat > -r-xr-xr-x 1 root wheel 18448 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/cat > -r-xr-xr-x 1 root wheel 18448 May 3 23:16:36 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/cat >=20 > Sections: > Idx Name Size VMA LMA File = off Algn > . . . > 25 .gnu_debuglink 00000010 0000000000000000 0000000000000000 = 00003bc8 2**0 > CONTENTS, READONLY Section Headers: [Nr] Name Type Address Offset Size EntSize Flags Link Info Align . . . [25] .comment PROGBITS 0000000000000000 00002c70 00000000000000b2 0000000000000001 MS 0 0 1 [26] .gnu_debuglink PROGBITS 0000000000000000 00003bc8 0000000000000010 0000000000000000 0 0 1 [27] .shstrtab STRTAB 0000000000000000 00003bd8 0000000000000100 0000000000000000 0 0 1 [28] .symtab SYMTAB 0000000000000000 00002d28 0000000000000ea0 0000000000000018 29 96 8 [29] .strtab STRTAB 0000000000000000 00003cd8 00000000000003b3 0000000000000000 0 0 1 > 00003bd4-00003bc8 =3D=3D 0xC Note: 0xC+0x4 =3D=3D 0x10 (the size), so the last 4 bytes of .gnu_debuglink > # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags > 00002208 88 a1 > 00002209 e6 40 > 0000220a 60 94 > 0000220b bf ce >=20 > # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags > -r-xr-xr-x 1 root wheel 11440 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chflags > -r-xr-xr-x 1 root wheel 11440 May 3 23:16:36 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chflags >=20 > Sections: > Idx Name Size VMA LMA File = off Algn > . . . > 25 .gnu_debuglink 00000014 0000000000000000 0000000000000000 = 000021f8 2**0 > CONTENTS, READONLY Section Headers: [Nr] Name Type Address Offset Size EntSize Flags Link Info Align . . . [25] .comment PROGBITS 0000000000000000 000016d8 00000000000000b2 0000000000000001 MS 0 0 1 [26] .gnu_debuglink PROGBITS 0000000000000000 000021f8 0000000000000014 0000000000000000 0 0 1 [27] .shstrtab STRTAB 0000000000000000 0000220c 0000000000000100 0000000000000000 0 0 1 [28] .symtab SYMTAB 0000000000000000 00001790 0000000000000a68 0000000000000018 29 83 8 [29] .strtab STRTAB 0000000000000000 0000230c 000000000000021f 0000000000000000 0 0 1 > 00002208-000021f8 =3D=3D 0x10 Note: 0x10+0x4 =3D=3D 0x14 (the size), so the last 4 bytes of .gnu_debuglink > # cmp -x /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio > 000050c4 6b 3e > 000050c5 08 ca > 000050c6 7a 2f > 000050c7 5d 64 >=20 > # ls -Tld /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio > -r-xr-xr-x 1 root wheel 23728 May 4 08:55:01 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt/bin/chio > -r-xr-xr-x 1 root wheel 23728 May 3 23:16:37 2021 = /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm/bin/chio >=20 > Sections: > Idx Name Size VMA LMA File = off Algn > . . . > 25 .gnu_debuglink 00000010 0000000000000000 0000000000000000 = 000050b8 2**0 > CONTENTS, READONLY Section Headers: [Nr] Name Type Address Offset Size EntSize Flags Link Info Align . . . [25] .comment PROGBITS 0000000000000000 00004298 00000000000000b2 0000000000000001 MS 0 0 1 [26] .gnu_debuglink PROGBITS 0000000000000000 000050b8 0000000000000010 0000000000000000 0 0 1 [27] .shstrtab STRTAB 0000000000000000 000050c8 0000000000000100 0000000000000000 0 0 1 [28] .symtab SYMTAB 0000000000000000 00004350 0000000000000d68 0000000000000018 29 100 8 [29] .strtab STRTAB 0000000000000000 000051c8 0000000000000363 0000000000000000 0 0 1 > 000050c4-000050b8 =3D=3D 0xC Note: 0xC+0x4 =3D=3D 0x10 (the size), so the last 4 bytes of .gnu_debuglink > For all I know, some individual byte(s) in the 4 might accidentally > match sometimes. The addition offset after .gnu_debuglink's file > offset does vary (0xC and 0x10 above). Specifically: the last 4 bytes of the .gnu_debuglink section. > The content of those differences do not look like > file path components, for example the 0x08 byte. >=20 > I do build with: >=20 > # Avoid stripping but do not control host -g status as well: > DEBUG_FLAGS+=3D > # > WITH_REPRODUCIBLE_BUILD=3D > WITH_DEBUG_FILES=3D >=20 > But that was true for the earlier armv7 target example > that I reported that only got a few files with > differences. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 17:32:00 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7DE225FB47F for ; Tue, 4 May 2021 17:32:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-55.consmr.mail.gq1.yahoo.com (sonic308-55.consmr.mail.gq1.yahoo.com [98.137.68.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZRjW0LVYz3pGx for ; Tue, 4 May 2021 17:31:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620149517; bh=ND/hpKdx0OSW/CqhlkX3ybbEYvJsDOrYeKwxZj6OhD+=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=rDOvBDcWbG3NToHu4av64s8KXN4EraiZ1uDsvX1yrCeQXMpLKgdL9+Q7iuvZfMM0AKh8qvwHN1/UungdQ+94Bxu/YUVh5K0nxbuk5Dg7dYzSaXRnPZOs3A83zhghVNFCuxk38C5TNoreElpIlgFJieYuTTKMBjHP7R9f2fC7uLXEk+5M5KK+2PwYVD3rMlkvQqQGarPCvrKHPJ0f1K2XThIRnF+2/9v6eqYXBVN2t4asYq6vtBC0a1xZ9yo1AEeJS9+yoxntyT4hUYG0rioNdXW6uvhobrTeSlLhbtzGxsr7Kzd/CHrEE2c/6pYRSPsEHL0yB+xJgP4nN8rnAy5fsg== X-YMail-OSG: THc9opkVM1mH71BplFVrdO1UNVqrpaPqVhr33S1fdkf8CFSm9TXiC76GJsk26g4 65IYeq69lvwj24SHdC_Gx8MuxrqDgSoC4GKY4XFSnc0g2EFV22d64RwHVoqA2SONcGnBrERtpKDG w1MpsB.0kHFqw4XvXFNMVgiiwQ2gGBTIobrg_BcSIJF9u2r99EyXOASqngr3pmc4mWfhyQbNVlZM VDz.s0RaA9zOK33FAwwhW7qvbK6PIv7F7CxMokzS6zZ5X2FuffWEQx3zinHIGhPOlxxJToUm.kAh IBVgImKDoF7kPnkuCwp5ISyvvIF04OHJbNxghX0eHZNXmt1cLg0FUIgTuNV38gj9pu79vQhETI7v foCpe5z6soxjVl.9LtzdvvTk28VJaNcVi4Xok9bUSV.QTqjaKfORqYKdr5TB_XcTNEX_N2eGlFTA 3EV9Nqn7O7WZR5hZfWHusq7ftbaFuZ68wr7CfEcCEC0zQwgMTjeHD9dJLOjHK9ZMuc6yduGwznuk j3xUtaJilTcolQECcbMWS9tGm7hRLZUlXM832RH1BtLithlBgtK0IKb5N2unWBUYyRE4BhSMenUC J2snLkMhwNFNt811IDsAUZG1vXBhLYSR.sf7JnmJmeOamgVyYcDTZhKb.nnds0p4JXBMbF3baDCH 3Z5VLC_Kpi9rDPIPlPZR1hp6SamzKPTCoFpVa7BZ8rjZTPMzkQ6smvosSZqf7wioxeh7CFtDlLyl pP5RA7qVF92crSZX7k93KijN.QXfSNpzef5e7b0cLaZIzCeMlZTApYwrE.aD5fetycKSvQcWDeLY wQyoKFseiRxFod_L9ML2DPzr1lFB0TrwKtwhZyyWv11wtdMg0Iy_Yp_eYqMi8O9CPLLd1YsFL0ko VSqeVCgnesBh6uDEbc1rhINmHOEB.m1A0Q4.dWxT9LpIFrtGZu3tL_XNUvn0yKvtDEPD_tPt5cas yckl.Tycl2.pjjUgEIUeg1Jn_bpVHmk1KzgpYpQ7wG9DZalIvp53ESa6LFZj4L1t4NGdAwfeNhDK 7O.wSPqaHAdaTw8MQmbCjGarkBNT0D1qwm0RhGLZG401W2OATw5OKgEH2lBpzp6J4.2w9waLGJ8y Xgo2IJ5n.ExDZ.3p0WV1v_diT8B5GPs18q9umPmmsDQBV0K38RrDW5nRo8UAACd2ifzbMBBXSs4l 9H8hangCfdcF5WzJKPhb.iusxZ0fOq2qeho.Szz1pPN8lQxKnj9iTlNEMl.uJZbJFr38STOUUCcl Tk.mMSMxlqZCobBs2L6_TgoSHHGXSAJEnTVpvKy2ZssAwb_aZ5o5U.8CDgMJW6MbMUjU5SBQWK4E IbZyZTzEeCBhBKsFPm.mcI7yTulpuh79PI2RP5OkyDVXAVxopi.7uvqiwhGSRce_AKmtqrL3qkvm w9dyk.3l.z.SGATkoC34uXiiu7S6eCK95PJm0nlut6nl2V_J1nuv7NB04.wAsapKHE9q0cEdcXQ2 1WJGkyI4vVMBdDiZlpmw71fepRrC3cSxOwv9D2vP8JTsH9oV1IdpU4b4DVUvSEmoMsFili5F3Nck 5sY2YyeuPJA46oPTFFAju3hFtRmJB7iSAY31RHcCIPM.jDm1eW.2xDJ8P1mXQVJ7gFdGuvFbhl_w rqaAHspfWt6OTwWYNmtV4FNf6hJt14KPaBEjwOfs5_txPBulIKR0WQ6rDTnYCAYFb8B6ricu0LtE 870S1s7cp2Cazkm1._Q.Fi81CnNUa_HtFw0JCZlvi1ULAGi609oPPBeO7XK0SgfLCDHiUJH6a9V2 fjMrFMBYTGLLqCDfNRfsGzoTzT9HZW1fO_BC6rKv3h7lkwMgHNGfiUhTbfz6LLq2RYWqWm4IhJAW bR4n05LgfunMLK.Qw2hVzOef3fFw9AY__JeUVSjwppAxBu3wE2QwcDE2Kam8t9VI4q7ZmNbInEfN XeT5Mydjs3LiMIARmic6mLGSeEwdR42V4AhVeicX1dJadcuWumWzmIBYT8unRuMTc8jmeUz5GNPS Mv7Zz3SW3sPW4JfHG3ViQcUQP2ZAVHpgkgJ7gYri1Sb0XyEMNTpaQ9E_zv7VOIsT3auS_764L.wM byFVTDI5XoEjmxR6zv90dawXL_KcvDOPbh3ilOCV8MHcF3jJqYsRVIIs_wIR1_RbwA_MOxwf7.hS D4uTIQsBQpzSBWtge0.e_XNyHj0zcSXYWpS_CwWQvgx3K9s26Z6fHLchDb7VDTN6hjcc2RnuOX3F UeDdIS370fNCbmuCjGSbM9ScGblShOpRjL45zSNPiyytYAvYOP0abIRYyt1VJjT7NiJMR8hsDfY6 8jmq2YYStP3TXAqR.GaUz_xpS13OADmwFrn.90jMFt6DPXPATqbcf3BE7yDLk77KK8vUR3WyQYBv _pl6gqF9aPD20DRcEVriGZlFlRGsRhpnbGzZmipSIY3i.Z7WawU5ITdje7BHuiTW.UQwVe1vgtlW TygesMgMaKZXZF4KUiL2Z1hq8TUu.5uwWjolunFK1i8uh0qMQ8R_a.9HrkZtAPQAu64sJFXwy__G MEkF43Th5oCOQ5Y3Eyug_lhcNsdnXGzjFmL5o_XXjH9RxuiHF11OAbCmPCE1O5dEpfIy4RAnRHUa rY0kTQ63oXt23axf1StQdt7bXqxzapcrNwLUBcpTBx44RKnEnErTuQKNnowyK8MkEuuppKN9EElb tTqO8EfF_MI_25gPWjbjtEqzNbyxgEF6pDZ8YIstArsMKJg.G83H5bkL2y0ocqSvvrTpQQh2.hxP 7T1GwEDOpNqp15z_vua970_9STJOWhx.Ohh.DAKafPk14M4ia X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 17:31:57 +0000 Received: by kubenode548.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 77048009a4be959ffd146f7875073e75; Tue, 04 May 2021 17:31:55 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [Ignore recent test: -dirty vs. checked-in usage difference] From: Mark Millard In-Reply-To: Date: Tue, 4 May 2021 10:31:50 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: 7bit Message-Id: <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZRjW0LVYz3pGx X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 17:32:00 -0000 I probably know why the huge count of differences this time unlike the original report . . . Previously I built based on a checked-in branch as part of my experimenting. This time it was in a -dirty form (not checked in), again as part of my experimental exploration. WITH_REPRODUCIBLE_BUILD= makes a distinction between these if I remember right: (partially?) disabling itself for -dirty style. To reproduce the original style of test I need to create a branch with my few patches checked in and do the buildworlds from that branch. This will, of course, take a while. Sorry for the noise. === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 18:14:14 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 97CA75FCB93 for ; Tue, 4 May 2021 18:14:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZSfG174Bz3rZc for ; Tue, 4 May 2021 18:14:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620152051; bh=GmPNLOvMfHVGBSRe1VVRcsmnoYcseLJp8+XosYnOH8T=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ERyzCF6jF5NRqhaW0mzjSPZPRPMlMjzhSE35UOGE/lH0ZLoSsGSUDFHJu0sIemyjBHMnvMthg9Fh1PQlF3eToHJWmWFrYyPHgpPJNUgQeneEOESL010JzDGbDo3dMo8kQ5dugqH/1x85ouePKRXOQqruOSxlunv6QLtKWg6zNkr5Iwo7uejCxINRfRX16e2nwC4sA2sUushtie3hdImkFIyWm7NYMZw2KOYhUKTAMZTwn22RjgGsij3e9w5GwMZve8NThv8wjfDZUomKIT2OvTRFU7JUEK1AZrCEg30yeu7vs8BOKZDm0alsnRqndSaZYPUt9hzYJWZJW60Z8EXzFA== X-YMail-OSG: lGMCIYsVM1kQIXqZ8pRxR_ldKm5mGJEVyl9huDai2XYxoM7laIhznsKPy79GBqT dB7TGhhZUHCv9L0068mGysFagKbMPs1F8o9eo8heU6P1WBm4pyEdPDTeMl7RsZUYfT_zLuiPDvfi .fcjOzz41yBUdP5cNizix2A68de5Dvg_DwPagXp9cKeEJ70T5jslmkz1fu9hkGH12x2QpLCNNeIF ZST9IY73TkTku4UweuJs.NSSpKGkG8Q6PiwNAQ1XHBW1tApcfhWG_EH_uHLfV1mSGA8sOgAzPwS2 DX6bkNcHTdwR59V7iIVAS2ws2LITTXqj6QKydIVqlLiQ3YjEseSwzlzt.aGj2bmCVatKKtL298pr 8xqceTp103qKXpLJ2ntjhnsq4POwIiGlNkexPXCAA1Ewrx8iEhE6My3.TFXlOxL5rcrzrP_oDPO3 KX5Yqz9UHS238RdfCdWBfdhiqYzE6cwtwELiWx3rWw0oUQI2zkKlnwqYuJlkaBHoZmLNaab7UHqm g_yNu27pbE9N46fEat68lRV4_pOdVLfzMVSjjIzaBftwHyj4roz.bUBNGQQrwhWjrVbHFTQPdsdw rQAwtmfQH3ipFIxOPXAUCiIjc3yTKioCYEXTbqu3IpdEB9MxqFk6IzWvQ.eI3ipFKP_0Ce0spCQt kbFeEVpbKtSW08TXqZ.l66a8FreRgI4i6WASRNXRfwR133nck5OEOxEVbLBqai1aKYADz8HsyPFo lAzv3RU_YkhN33siDVpSC2Sj8J0rDhGAV5MaY8WIwqPW7up.wiycE8VHuYWrxSjuKCzn49HhGSgl nHzyqUhAbK_SbzigFbn0r1pA4P4gp5LW3Q95JQisqN6uQAMWykJwZp83H4nRZ_2woQtGWqUTyIVv 0B2QJnoZ5oy1xoi8uh.LOJ9p5ml3X0rEcwQ1fLFgL1wpidu6mi5dsJt_uuex_uFOYUCld6KqnWzU 2vV0nErsn3MUSqretzhperNTfsVpIdPP3cEx.miIGvzAXKTaw.7UHSYK28aA1KUC81v_Av4rtd5I ivHOaze1lUk5ks_tT8GRawjZ3zeHGLzaiBjj824BNpz6uUTovmU742QON04.jZAi8DOiZNXrEVqa OTQr.o7sd5JaUl3MACQTePihGB_E8VMCfHd5BxxG9ZIRaVwUyycTMLGs_7GSq5rexiU6ZG1bu3_K d1GgYDjRMHk0bF01llWnL69qNYl2sh0rL0z3xWoJFATPd.45s0.QylewtB7veAHtCbSlnfI7Lq_M OB.Ce2s7EO14BruWgllvcW8nNjPkec6E_.gXRYlltsGHC8LuBPicPwW7xHy8KdeGkSzSLCTUsPof k.Tjg3t4GxVqfjsdTjAcdDuV_CqNs7SyfMKkL4uchFTvtqmJZVGkuYU1S8K9eeJUzjmaht0zDTSg NMa3BPfehOdiUHLkoMJNXgBvxRpRwIwzx2Q.YQMLLswHd74jfqF.qRnfQLCzjgll6zGqr3y2E1Iy 6zI_sYBWaw8uwu.EO_1dRsAHQg8nmfjOw.QBBTfFikNYuXbx4vodDjs2An.CWVAp5WGC2e3z1jLi kbZJX2X_rJHdeaNVbzzyiSuOBkNyeZAndNfKdj.czAvadti01lIDzNyRNxgSYairkVb8XFpVvcom _j2oPriDhfvHfcRt88saEGm5.okxYAu0XyBL3fHZtB9Y3zL4Hso_YcE379yW7IMDdLYY9Vr2yE5F wh0djQr1YupN4hP7sNmsga1acAr18DwifOl93Oqd.43dRnfLW9WJ9zJh9H9aX9CWfaXJoupQgLzm cEsC62Hk.U3UmqIhpDbdMDO3qE16DeaY3dfLAOPh_9wEJfKvFWuH5orqbbU6IZ0IdlcdVHM7tDU_ UFWYiWBKy64IjxGGugyLVaxM3tpgu_5hf.cnx98zfUNHp_0jpmpD8mD8qruFp4NVEIOd7Zpvfihu X4VGbNid4MDwosu6GX0EL6cBATnzbgZhHwZPNxWLUTlliZOeog8aX_jIwKK7O6fTwSocWRzdTvEg IF1kzPUlR87GxvFlQpVW4SwhExXx.QCD3kAXWU1k9W6odIihZkVZwqYNX9epqhb6uKoRTDjj1wmU P2xnoHz_0Kuh.NSfLhobbhrwMtQhffC1HhKPEfkx.QdVVFISISxGnlkTOoy6ss6LF7IfmmM3Ou4M 8dTU7ELoE5rkoyWFnh4H0IqdB5pgVGJAsZPFblVKF4zpAH_lwc9X9hVD3GM7PU31N9vzn3NuWGEt 9n.078_PgC30Clx9BY6xwFPQHe9hqdR3dLFYdQN0_L8vV9zSlP52PAD.TlXidSNElDEO1qFgna3j 19PiUFgDUTLcLrMbYYKh95iEUyritYhFm_DExomB1.dTAPLx7dBHMuFy1Qf7PalJpkmocT26oBcs eKngfwHJbzPRQ0pUQWI3xuhYmLsV87PT.d0Bmmm98FDBiYJ4X_OcFnXc.t76n6rwsyz3vnVuNtYE 6ucPsf1__nozt0hLx3rwY4m7QRQWvLV99tXB0sdsh56EozevhhIL_PrKP9hPmbnTe66CZ3in9sMp Rq4byqlLx8WBrzOdcErX1DAQQ6va3VpkLk7uWs2ozqRZw0eOKu0ms0q7SYrmWgybC04LChtgDqEX HuHTADmgpgeFMIMeTlOpZnMTl.p5xfRHfm51H3Nuyx1j_ETwyoCsGyoqFmRDwDoeVKN6vHo6T6IU IJo8VBTnHSzuhCb5ETfH0lHcGAxk.8S_j5VE0yz.8cVMkTdWvvfA- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 18:14:11 +0000 Received: by kubenode544.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID d3ba890bf511f0744d19eba011966c03; Tue, 04 May 2021 18:14:07 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: diffoscope's odd UnicodeDecodeError error message: reason found Message-Id: <27291038-3538-4A09-A09F-A2202A2D1965@yahoo.com> Date: Tue, 4 May 2021 11:14:02 -0700 Cc: freebsd-current , FreeBSD-STABLE Mailing List To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) References: <27291038-3538-4A09-A09F-A2202A2D1965.ref@yahoo.com> X-Rspamd-Queue-Id: 4FZSfG174Bz3rZc X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 18:14:14 -0000 I had reported in the reproducable build list messages: > # diffoscope /.zfs/snapshot/2021-04-*-01:40:48-0/bin/sh > [...] > $<3/>2021-05-04 08:49:21 W: diffoscope.main: Fuzzy-matching is = currently disabled as the "tlsh" module is unavailable. > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position = 18: invalid start byte Well, it turns out that the file name pattern was incorrect and only matched one file. By contrast: # diffoscope /.zfs/snapshot/2021-04-*/bin/sh $<3/>2021-05-04 11:05:25 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. worked fine. And making the "one file" status obvious: # diffoscope c_tests/a.out $<3/>2021-05-04 11:11:45 W: diffoscope.main: Fuzzy-matching is currently = disabled as the "tlsh" module is unavailable. $<3/>Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 745, in main sys.exit(run_diffoscope(parsed_args)) File "/usr/local/lib/python3.7/site-packages/diffoscope/main.py", line = 677, in run_diffoscope difference =3D load_diff_from_path(path1) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 31, in load_diff_from_path return load_diff(codecs.getreader("utf-8")(fp), path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/__init__.py", = line 35, in load_diff return JSONReaderV1().load(fp, path) File = "/usr/local/lib/python3.7/site-packages/diffoscope/readers/json.py", = line 33, in load raw =3D json.load(fp) File "/usr/local/lib/python3.7/json/__init__.py", line 293, in load return loads(fp.read(), File "/usr/local/lib/python3.7/codecs.py", line 504, in read newchars, decodedbytes =3D self.decode(data, self.errors) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb7 in position 18: = invalid start byte Not exactly an obvious error message for the issue. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 19:22:38 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E54045FF435 for ; Tue, 4 May 2021 19:22:38 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZV9B00Nnz3w6p for ; Tue, 4 May 2021 19:22:37 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 8EE285C0145 for ; Tue, 4 May 2021 15:22:36 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Tue, 04 May 2021 15:22:36 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:mime-version:content-type; s= fm2; bh=b7L74jlA+/91W9ueHWC1Ms04AzYJ8mnCx6s46iryfUk=; b=WNKzTFZW 1sjMoFPeSShEDsJcw4c700S13eWRq9S4UCTsoza2Q7kYYcFxTruAY6Dc0E9ZAXbJ Jm0UyIdcNxDRKaOHliRGDijdfqdy7c30Q1VKA+fxGAi1HNXzcT1MsJL5LZaSuqxF FY4F5kjPx4/2xZn1m3bE0P/FMtW6V5T/j7xaHDn7E/Z5aVE94rZaTK2EqNrqSg7r kH0hkre3MoMom+qvtZZSf2rGZh6UcMj5GDOYZe5+Ep8G7U/ONuNYWxPrNKvuGiKV jAV0CGFcMuC8ZJo0831Sqq9tMVoIcVZJJC+4CS9uDIHD8ZLH9lqGcxSClpVsJNv6 +fmXRv/yUhlYZQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; bh=b7L74jlA+/91W9ueHWC1Ms04AzYJ8 mnCx6s46iryfUk=; b=ZD7rrsx/TJNku8HAn/WjuubXbl+IUWviYrcasHZ9tJP3j fhDm/MQaECtaQcH9jxOIBsIv4ONsbO7VSw9Ux7YfUpSsGExOJ91m6tGJjVvVO1Lb wSdJHxh4USr8bSQ1MY2LtyPe0uer8oEwfw0Ec3PYazzqVy0TD9jkv36WorRNvEYV gtY+ETR4zeWSFOIP4IrzWGZNttL+6Amu580QxJqV+Y5z9rguU6BQi2I+EDXN+wBe UfVAkpBT/SYfi0ti0vZhv/YZJJyhX73wnfBO/SdyV09ieQ3e6ezNxI/FNtHvUBau En+ml1IlGX4CgiL1jFaYEcvb/iqPL+Z7DpRL99YBQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefiedgudefjecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfggtggusehgtderre dttddvnecuhfhrohhmpehtvggthhdqlhhishhtshcuoehtvggthhdqlhhishhtshesiiih gihsthdrnhgvtheqnecuggftrfgrthhtvghrnhepvefghffftdefkeelleehtdejledvhf dvgeeijeevfffguddvhfetgeejueejueeinecukfhppeekledrudeghedruddttddrudef leenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehtvg gthhdqlhhishhtshesiiihgihsthdrnhgvth X-ME-Proxy: Received: from cloud.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 4 May 2021 15:22:35 -0400 (EDT) Date: Tue, 4 May 2021 20:22:35 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="KR0Lz6JPD+qkVK7H" Content-Disposition: inline X-Rspamd-Queue-Id: 4FZV9B00Nnz3w6p X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=WNKzTFZW; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=ZD7rrsx/; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.25:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.997]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.25:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.25:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 19:22:39 -0000 --KR0Lz6JPD+qkVK7H Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, I've been trying to set up a boot-from-usb3 raspberry pi 4. I thought i'd be able to do this by booting into latest current snapshot image for arm64 rpi (written to microsd), and then running bsdinstall as root. I can select the auto-zfs option then select the usb3 disk as installation destination. The bsdinstall selects the sets and downloads them, but then get the error: "error while fetching file://usr/freebsd-dist/MANIFEST : No such file or directory" also tried via release/13 image, same error. Looks like it's downloading the files but then the installer can't see them, something like that. the downloaded files are there: root@generic:~ # ls -lah /mnt/usr/freebsd-dist/ total 187454 drwxr-xr-x 2 root wheel 4B Apr 9 06:51 . drwxr-xr-x 6 root wheel 6B Apr 9 06:50 .. -rw-r--r-- 1 root wheel 158M Apr 9 06:51 base.txz -rw-r--r-- 1 root wheel 25M Apr 9 06:51 kernel.txz root@generic:~ #=20 worth submitting a PR? or is bsdinstall legacy and I need to use some other method. I've not tried releng/12.2 yet. thanks, --=20 J. --KR0Lz6JPD+qkVK7H Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCRnvEACgkQs8o7QhFz NAWv5A/9FCC8MKdTXIhWuldsG/W5T924J82T/3muFvvjQTU8B+cKKaaBL8sufkjh iMwK7Y6cquTA0Z2QO8DAkdpN9y8f9IqVjfKHXNBwx2qOkdnxMgFr8hTJWOYr5kwe BGf3E+3gr9mW/QWvpxObTPEpyqYnD0n8ay+VY3yaNV4ui65hxRJOX/4OWUULBfZv ywyjd4HilcMF2vCCbtF3khZapHWBXQihtlscaAaQ0lVX7bod6ubvLkhrHjvkBcw6 PTfTEltqL8XxyIptt1brsMOiGxT2phP/1yVxJmv3i+ZyJuCHZh/lRLjKt9y/xkRy MbEiZn9dkZ27zDhD9x/eZ+6UJgJHeUqBmbr2Wq76jakKlQXZKG/W2ZkL+ZISJD4w xzNMNe598K44n2YRltEogNRuz9wQGaBSOWZfMTCNkME1w/fyHWyUoWNkZyQJL84v YbYt1Ctopdjsgk/7Ef/rTrv/DrajdLSy/VNFDI7XtY/9Df22xK1svYtQ4Ote3JGn W3SPYl+6NDqbvlJBqLiQLBqtQ4F02g3UfkK9Q2N4AxbTufnKlwFwY2fjKwqbxC7u TKm5EcI1THwT9Hh6oSgRReb8JDOw64vRCdUcgxwmf5atwlJpg2NMr+30qaN8Kjze 0oRk8VGj2l7dOX1JHBGHNK2uchXd85bYGd5TTf0ctJJIvCTshSM= =J2lH -----END PGP SIGNATURE----- --KR0Lz6JPD+qkVK7H-- From owner-freebsd-current@freebsd.org Tue May 4 20:35:18 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 83BC5622582 for ; Tue, 4 May 2021 20:35:18 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZWn23S3rz4TZC for ; Tue, 4 May 2021 20:35:18 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from comporellon.tachypleus.net (unknown [IPv6:2601:405:4a00:acd:4491:83d2:e2d6:4cc8]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: nwhitehorn/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 518206C62 for ; Tue, 4 May 2021 20:35:18 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Subject: Re: should bsdinstall work? To: freebsd-current@freebsd.org References: From: Nathan Whitehorn Message-ID: Date: Tue, 4 May 2021 16:35:17 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 20:35:18 -0000 Yes, it should work just fine; however, we don't provision the microsd images for the installer, especially for -CURRENT. The actual OS is fetched in plaintext to allow caching and the MANIFEST files are what provides authentication -- they provide the checksums of the files that get fetched so that they can be verified against corruption and tampering. For snapshots, the current version changes all the time and that doesn't work; it also means that network-install media have to be set up with those checksums in advance. Where are you trying to install to? Usually the assumption is that the microsd images *are* the installed system rather than a tool you use to install a system. -Nathan On 5/4/21 3:22 PM, tech-lists wrote: > Hi, > > I've been trying to set up a boot-from-usb3 raspberry pi 4. I thought > i'd be able to do this by booting into latest current snapshot image for > arm64 rpi (written to microsd), and then running bsdinstall as root. > > I can select the auto-zfs option then select the usb3 disk as > installation destination. The bsdinstall selects the sets and downloads > them, but then get the error: > > "error while fetching file://usr/freebsd-dist/MANIFEST : No such file or > directory" > > also tried via release/13 image, same error. Looks like it's downloading > the files but then the installer can't see them, something like that. > > the downloaded files are there: > > root@generic:~ # ls -lah /mnt/usr/freebsd-dist/ > total 187454 > drwxr-xr-x  2 root  wheel     4B Apr  9 06:51 . > drwxr-xr-x  6 root  wheel     6B Apr  9 06:50 .. > -rw-r--r--  1 root  wheel   158M Apr  9 06:51 base.txz > -rw-r--r--  1 root  wheel    25M Apr  9 06:51 kernel.txz > root@generic:~ # > worth submitting a PR? or is bsdinstall legacy and I need to use some > other method. I've not tried releng/12.2 yet. > > thanks, From owner-freebsd-current@freebsd.org Tue May 4 20:38:32 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 173186226AC for ; Tue, 4 May 2021 20:38:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZWrl0xw2z4TbY for ; Tue, 4 May 2021 20:38:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620160709; bh=jdk0Xc4yTYdBCBygFrt4DQvYa3zbnB4pXHkJK5/52AC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=sku3nEYEPhUT08y7Jv6SlIxyV5T48xpPne62eBM9YmIzyg0KFyvMc9ljj7XCJ2OWtlzNcRSETPTCNEtNOeKx81acfxSzM95yOfbeHcIm6Po6G7Y8qoL2z210H9v9Y+kiIp7xTqMpvQbHfDBSKOgLHBy0u286dpiPpJ0b/PygxAHDsJUMliLoaNFpikPErz8MgISVFhoc4HXs9Mmj7YfphOy6sPkohofz2UF3l1GhAVwxmHAne41vL+WrzDYJuELRVFzkQkyyoHF1vkk3ItPYbsYgsYSS68mvUqEYZe39QF6i47ZJGOtyYqAD3ACgbVNCHEAeEQ3feKSi8stOL8mRoQ== X-YMail-OSG: Yw783QUVM1kAtTfsW8jqy.RUd4B6hCrgxp48NoukvA16gWYKTgPeLH9GsCVtIxU _zu_NRRkjh5DEbrf9iECdjZX7N0Z_dKK1yy6SEuPJ2enERyszlJMl2I1ncEP.LUnsoCJlQAd9LRS YfeazartpzyYAg2ZCC92fOfxmvwMzFUtUz3ey9CSyqEZ5ttrZ.AUUnla3HI9FN1q5VQwygstd2tX 3U8IXSkN6oi5FrJdUiPRNCf9ssmARFRSBVJFaH2C1lz9HgF_dmWI0vFsKnHjR3TqyJnqoLA79XTe zCMAyMtuQxIl.5DbdcBORu9tnUQjVlfj8OUHsP61tlwMD6.k2QXWPJKbEBcbO8OJ.PRcLNTzT0Tf b_4FEVoXFOhTnaU53h17jC1tcddfPXqe_NYYzg_Y4qMRyVAv2Celu57Gsi2qyakJoqxLe0nN76Bd L1PVT5W_pwXuUiTdoXAH83aeW7mDFJy6UD33oG3wer8GOcZGh_vw75BzFbKL4iR_7sa2LGbY3qra ww7iuNaquTmFjgRzkG0wsGNslAjqH_EOclh89Is2AI1.JTw8vNE6P7BlRMT4HnVFQRNgPs241ceh O53RRVG6BMn2r2ChxrRgZwNskvjm7qaPxW2LRXtcRDSobZd9N2efocWZs8Lh8.0qTniB0iUScy8V 2C3bFJGKEjFNQaS2zyM9_5upxeBrXoDgS3Y0XfZDAm.D9SXNwnf2_YkXq73Q_YzfLM3jspncJnfp eEYGZwf8Zm4RYD3dJMhZ8yhYL1AlO9zam6SdzG4juFACXB0Gi1jxEiR59ZAwhUDB26SrJvBV4HUB _ZnKeXuwyUpbHD4o1wKjoKnuORVUKd8brn6_PT4pGQG0UXau8H9W9ZIVcu72fg1syxwuT0BMekf1 fqfXghyhpwhIiuLgTXQasaMNL0j_FPC8UdVYP5SAlu69Omw9.wkQU4b3nKlvwhdzWKdTy1o65FmX U2_MgPwe1T_egeXapakshczAccoc9x7jSfFiUjbCXOVA93vY_ndMELbqLoYS7yeS5I6uLe4gIquZ 6Ap3TmXr1Xnuj16Q50yGgn1dt0FVwO_wpe11C34P54UE8WJBC442iHSAYLq8hprrPcjF2CcksAdp L8fyEqHckLE9vPOTIVjlVV5bqyKHsjehx5TmDSBfGZSrskEh7EjSuICciYvJF0fiUhasOBG93GYM TodGBc39STFjUHQ7CEIjE8KXWhXjcNTyZvjqQR_53VzaN7crltkx.rGfBiXfkzv0LkYCm4x2wt1I Ihd5fLZyHtvT9eJMly12a6RXrwdasVIHrHvhHJ_YXL1S9HjHas5wg5eQlR3.S35_xnTm7y.vTe0T 8bNXb29F9HDA6J1_tU.4C4zh0l.zqSqqoNQ3HSkX_4YiiNVlTLlmkOMSvxHjVw_plV6lbDBAl_ra zYDPNMmCGXWvXT.qFcJ7p1nsZ.My21HX_t6eikN7NW_8BfUmqv9sosCSvxTbA5D0g37bFBg1omsK 8xKdsU2MQjR.dcL.5fl0tLDxtn6pk2BF0c9v86dEwjD7L0GPJgwDKlxGcaxcDReKREDd50Wcuaf7 id5FNvZrWRz_P4cHCmS5jq8HpV4WtBNJoyBfS2_7Hvib4e3dUSs1hy7mn_TKYGL37qe31rg8EWHZ F2YvnumP_w94V0Ot4Vkck3OZ8oCfiMjlVo9cN9jV58V6LPTWXZxZ1tmhax6L75hHiibAzmIB0s0f 28v4_MqNJ6DzKrPABGyzV350100giD9pqZUMgIooeP2bdG6T5mrBsM8VZBB_6VhnDZvEfwSMLdnW lS_iSFtiObYCRbWrcFUyzzHdXoufglTFmffFKzQB.ay7mGgG6TTu.syUU0ZqIw9IjaSrY3P5aDEn 3ywRRTJCH1LqvYmHv2498u5d371gIItXoLvCjYoktgl_UMHBSSOZrNPL6WYVsUvAb5cX78GKqEvk EF93qY1Nj2Id6cKPgHpL1i50Y_2avVsT4sFTgtoTPOTguMcBio0opOrBs1zU97KhWeQ4MMY3V9AP hmfeIOALTzYJVm7cxxXEdS9EgO5WVhWddBoZgtimmMdRsP_qh7Sk.KUwnGOGx7LQjweuAjmXmk2s _nCAmntNIDCOhwU5xTg1y_j2Z3kMzsjO2eiLgl3Hdo0f6E0M.suhKUxC0KKuxcBqAQ_eU.ytSABW n_bTfnamUrGT_RbcaRQYcLi5yr_uMlW2vHutbh77htmZ3Tfj58IkX6L_46eJdKZAPNPA3XIMaoja tElCgALvWrs0yGl97uB3ryBaTgwidA5e2XtWbwpkiDggnAESEFknw6W.vod7STd8jbjmucAZzjy3 iAIk2kk2IfZZT_t0791kyE4d2k8EtEqJH5Lfihckbe7WZ7Jm_ndld9uZYc.cNWWb6WG7M_ADjPTU OKXNxjlAWk5f4xWl3oo_aUCf63.VI58i62_P38xA37QM5USw_d0.ZoS4XND42rS7yQhM.lP1YzAR KBuXCBCT2fkqU7xTx5YrdDf7EnklcSxmcEh7kjVcr_sDWA.vVsEJ20d9TC3o9XL0CCO3sRlvHxO2 zQ9UkhG8WeDPZbmQMth6lnAGSS2sDD84LH4N8cmYYzfp.L2E_vPhg0iNOIpV5UnriWOGI3VrpX45 AV6dcjMKU9Ms.1MLNy4GqCoFkMLgMjLQuEa5uN3befBs6MdvZbhN63ZuoT6w_q68NEX2UbqJ4cEU x_UV_ZTaaEhww4x888S7N2biuSK3I_JFdVCSrcskgM0v29lMcif7zIvDqdvOQzTiqIw-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 20:38:29 +0000 Received: by kubenode562.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1558a91f3260afdf8c8e457506c5aa6d; Tue, 04 May 2021 20:38:24 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [Ignore recent test: -dirty vs. checked-in usage difference] From: Mark Millard In-Reply-To: <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> Date: Tue, 4 May 2021 13:38:23 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZWrl0xw2z4TbY X-Spamd-Bar: - X-Spamd-Result: default: False [-1.53 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.31:from]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.97)[0.975]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SUBJECT_HAS_QUESTION(0.00)[]; SPAMHAUS_ZRD(0.00)[98.137.64.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 20:38:32 -0000 [The first buidlworld is still in process. So while waiting . . .] On 2021-May-4, at 10:31, Mark Millard wrote: > I probably know why the huge count of differences this time > unlike the original report . . . >=20 > Previously I built based on a checked-in branch as part of > my experimenting. This time it was in a -dirty form (not > checked in), again as part of my experimental exploration. >=20 > WITH_REPRODUCIBLE_BUILD=3D makes a distinction between these > if I remember right: (partially?) disabling itself for > -dirty style. >=20 > To reproduce the original style of test I need to create > a branch with my few patches checked in and do the > buildworlds from that branch. >=20 > This will, of course, take a while. >=20 > Sorry for the noise. >=20 I've confirmed some of the details of the large number of files with difference while waiting for the 1st buildworld : The 4 bytes at the end of the .gnu_debuglink section that are ending up different are the checksum for the .debug file. The .debug files have differences such as: =E2=94=82 - <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/usr/13_0R-src/arm64.aarch64/lib= /csu/aarch64 =E2=94=82 + <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/lib/csu= /aarch64 So I need to build, snapshot (in case need to reference), install, clean-out, build, install elsewhere, compare. (Or analogous that uses the same build base-path for both installs despite separate buildworld's.) This is separate from any potential -dirty vs. checked-in handling variation by WITH_REPRODUCIBLE_BUILD=3D . My process that produced the original armv7 report happened to do that before I accidentally discovered the presence of the few files with differences. My new experiments were different and I'd not though of needing to vary the procedure to get you the right evidence. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 21:37:41 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 694BA624172 for ; Tue, 4 May 2021 21:37:41 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZY903Ylvz4XKd for ; Tue, 4 May 2021 21:37:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620164258; bh=/CQJQQlLJXv5yTAN/T1bRluVv23SJIjFq/XBim01XON=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=oL2qPQnZO2YOrKBHhD1mcQha7a23Y55YoEVYkCfHx7QDVRm/q1Qy+8hpWaDCw0gwXXcyq8sgfr/LV6P4bQokn/MWR1bVFMKr2qlTvLWcdKnml4JkohOG2836urMrqmkRn1CpgqWCfRdLXZhM3YrATRU67Gryp8+1vDn21Bot5909EIX7jEKqVSxed/qILgAw334e63GmejySAgsXCX/jZsCVopABVOCKUjdsLj6YhYjb/ffIxiZQgpw5KQsN1mFClfSteS9hzGH8fr+nEhrPv9gUA9GBbeMV37YbnWJ4wk5tCDxWPlw4fibg24i/fy2kcoayO2BfWqgE9pqffdZ+xA== X-YMail-OSG: upoRRm0VM1mFyyYHZiFY0cntPwvnKPDBmDBoI3_OpyjVFhdEnCMyS9PLYjdz4wc AgW4Rz9H_GGVbFNYKzWlKu3_ZJ3vOJKJsKOvIuDQn.WBeBnosJhDNplUMjlXy4lrfQ4ddSlkwG1y Wq63C8nAF6bm_EducBiG2R9E3nYJtCwlbwzyZIHAOJwMTgR6t11vYLvdolQaTsbvQQV.5Bu4Wbzs KBo8xBRL00N88GBiRWFNyP3HYw3SNQ62hPdDE8xzInjPeibGjKGAgk7jPFzGL3y3w3hX8v6pVSqL fxvewZCgdae07CGLsr1jrV5O9oAe50Z3gcjhClnTQyYcooDcKPOXXPB1Pmdxt85Ll9U3Srvcw3Ky nJVto3H.SJkRfWg6u9MUBT5BjqmpPy5.H.iW9q44P58rHEJLQoePiXevvOwIBMAAEeeOhLJ0z12M GCh5s_4rZWm1DcyQzWGFyDqn7EDq4.ZFVclJk5q7SnZyp7P1ignDe_6GOC21LzMimBJvQ.tWGo0b DapRagYndQLlOlXIqo5tEXS6_EHl.nmcFDkA37T12xveDrpxsIQ9B.gyFBwBI4Yw4nlXcW_OxM9z PEG.Hyp9VO6FlJuZpU5HIZW5suzKssyBujG4fBNr1v3riDABMxcp7QdPR.5PAUxOt5wuP3YOED3Q Ojldgoqk.HE7kaWuZcHAOBCSHv.53pwrrimU1m6xG4wLyTLAtbQl4vQWPOfHPITinduHdi1jFVzP YhCanyR6jI36djcynMPM6mTj4kMSpmsWbw377KJy0bPta1d0tVdqkKVSB9L8wCvmEoaHcB6sEs3m 47QMSR5ayo1LQnNXh7ImVcr8t4kOM.FaT26CSe3h69JkGX0aCry00CbKc0FZDG9604_rvlJclzRZ v75wKV25NuSsemdlgGHPiVCvBdzkQhkvU3.BBy.44oW.CpNtTEUDzcoee0d8CvWqGGs4KaMIbJGn CdqGLZqIcTze3Y39VDmjKlHWnxgBYcTjGuUD8AUofarY71OnC4GQZKt2551dJaxfaxt1P_6_ZkSC 84qBkhU6OX7.AALACfxDLJgFjrDvBhTB04.TnBhjjZas.tqysFmSKa3mfhiaSjyR_jDoJ5Z652.4 gCguNVurCErvcK3c0VOBDJVcnCSh0Pwe7HyL0mzfb7HQ2PZiVHeIQnaxtYGRJrBRt8pfJTpbvBoZ nUHNd8KuP8fJevzAwWSvYvVm2wh48cyZk0eHsn48_Luc8b1HbWLACAd7cgLjpLqw1wl7Yj_coE6P YvUh2zKQmegMwvlJQiy.5i2ETpRI1kNjf1XvjtYSHumUqL9L31ROptrmd4VxZWQmls2fg74VEdwI kbNvq2o.RWWLTuRLAMQI2lFHUhzV6w38s__ebfJJbmZ4f4RH1yCLxshvnva_XWs8wnjx1eYJBFKx i9bKrYV3iWngGFojuedC4NBgIriiK3tri_L1qq6lphutqasTb44mFv.mRsVCBFT.Sg1MDKf2RSdy NcO4ODMyY4RlEvV2vzhRd4otA9A.XbD6lLzVQMdZqY1rQorIH3vkAPKb_0qSgxMCFNu44Fd1VQcV 1XtPM.BfpGrEk.4lhTjWLuDuQLBa0ti9A76S6XOl0YLTYCZqVvmye3Eqj26xMOeUc6SEDP73Wpca ILjrCah1.rN4rbvQ2R6Ci17NK_fd7rrE.1aWdIzLwsT6Kd6xlNqsop1dzzKNhdKEL1_ikTAVT.IB AtBt1lbffQIqkCNh8AIrGQgO0WdOQZXO01qCWFS48V12V3ZrohLtvcsztR4aLtqETGVfQPz2M.eX Xw.c47GbsruorQYixqBE1TiWVABPes.ayXoPe0mYYOuIYhHcRTEdUsnd8TPRMKOGEIVrXqEg3gXC Qx4Znst_foADG_FV2oUIgaf_Ef_11jh6sVdgvUj1eaYjV8.5Ma55HI49Aaay.6sVlQwvc6cOROd0 rDp_XBFkiyItmo8eJaW4LjmAxltd2gakFtGRS5oJDMOHGQRFmP.tgsyWvJ3Mua8blMzcU44ZQRhv hhEpflAFKzx5guQUjhuUxsJcL.hcC07DRa2kzkBzNlOfSfIFcZFu.SJjiVo9v_LH7vQJN8wfelSa XYjbGoiikAMI2kv7EoPymP9Jl9.Uy7bzi8cixYKKnXr5w1PtTQGXmNwYNzeU_LXAyS97vIH9D_v4 ytJD33LGP_YuldqE_gAr.aj5je43e96X7ElhM6GTSA9DDnXhVRH.Z.i_piyfzseL60oh4bBeD9NZ kGbDgO0mNDYCzju9r_5zoYWQOKqFOYm1BBXtWV8Pr9APYN5tRst9pLGc5NmGN88ngcsg.W2wUZGW Rd2aK8YVl8kJfnqZklKcMPt5N_4Uws3itWlXDFplSTOXPVXycI2v1TBcTnT2PSogpV.ihpoYvQZa QSzuNrWeBQwMjPD16szWlqV.sMBP54XgiwsT8wbuljS0kjrZRrRRqGpOifxK9mHFxHA2HFnfArri JbRwMHpRVSwsbZb8o3Tm2NKimtGlL.D1XR8n0TUEwBRg- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 21:37:38 +0000 Received: by kubenode512.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID bde6a5c52663df75e016ba2a4b8652e3; Tue, 04 May 2021 21:37:33 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: should bsdinstall work? Message-Id: Date: Tue, 4 May 2021 14:37:30 -0700 To: tech-lists , freebsd-current X-Mailer: Apple Mail (2.3654.60.0.2.21) References: X-Rspamd-Queue-Id: 4FZY903Ylvz4XKd X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.206:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 21:37:41 -0000 tech-lists tech-lists at zyxst.net wrote on Tue May 4 19:22:39 UTC 2021 : > I've been trying to set up a boot-from-usb3 raspberry pi 4. I thought > i'd be able to do this by booting into latest current snapshot image = for > arm64 rpi (written to microsd), and then running bsdinstall as root. I've done something similar, deliberately making the root file system ZFS based to experiment with bectl usage and to have GPT instead of MBR, for example. Even when other things work, do not expect bsdinstall to deal with the RPi firmware or u-boot in the msdos file system partition. I copied those over separately. > I can select the auto-zfs option then select the usb3 disk as > installation destination. The bsdinstall selects the sets and = downloads > them, but then get the error: >=20 > "error while fetching=20 > file://usr/freebsd-dist/MANIFEST > : No such file or > directory" As I remember, I had to use bsdinstall's DISTRIBUTIONS environment variable to pick what to download in order to get MANIFEST to download. Otherwise I got just the 2 files (base.txz and kernel.txz) and the complaint that you report. Ultimately I picked to get more than just base.txz and kernel.txz as well. I'll note that: http://ftp3.freebsd.org/pub/FreeBSD/releases/arm64/13.0-RELEASE/ has the MANIFIEST file available. As does: http://ftp3.freebsd.org/pub/FreeBSD/snapshots/arm64/14.0-CURRENT/ Unfortrunately, there has not been a successful snapshot build for arm64/aarch64 or arm/armv7 recently. So there are no .../13.0-STABLE/ examples yet. Another place to stable-13 materials is paths matching: https://artifact.ci.freebsd.org/snapshot/stable-13/*/arm64/aarch64/ that have MANIFEST and *.txz files. For example, = https://artifact.ci.freebsd.org/snapshot/stable-13/d6d039ea74a26357173d126= 3682d4f5119037434/arm64/aarch64/ has a snapshot as of one of today's commits. When looking in such folders, be sure to check the dates on the files: they might be older than the parent directory dates suggest. Sometimes one finds the directory is empty despite the arm64/aarch64/ level being created.) There is also: https://artifact.ci.freebsd.org/snapshot/stable-11/ https://artifact.ci.freebsd.org/snapshot/stable-12/ https://artifact.ci.freebsd.org/snapshot/main/ and aliases based on names like 13.0-STABLE and head . > also tried via release/13 image, same error. Looks like it's = downloading > the files but then the installer can't see them, something like that. >=20 > the downloaded files are there: >=20 >=20 > root at generic > :~ # ls -lah /mnt/usr/freebsd-dist/ > total 187454 > drwxr-xr-x 2 root wheel 4B Apr 9 06:51 . > drwxr-xr-x 6 root wheel 6B Apr 9 06:50 .. > -rw-r--r-- 1 root wheel 158M Apr 9 06:51 base.txz > -rw-r--r-- 1 root wheel 25M Apr 9 06:51 kernel.txz Yea, without DISTRIBUTIONS it seemed to grab just the 2 files without also getting MANIFEST. Or at least that is my memory of how it went. I used DISTRIBUTIONS to get more files and so also got MANIFEST. You can also put the files in place separately and tell bsdinstall to look in a file:///path that you type as I remember. file:///usr/freebsd-dist could be an example. > root at generic > :~ #=20 >=20 > worth submitting a PR? or is bsdinstall legacy and I need to use some > other method. I've not tried releng/12.2 yet. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Tue May 4 22:59:18 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AAC756264D7 for ; Tue, 4 May 2021 22:59:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-8.consmr.mail.gq1.yahoo.com (sonic307-8.consmr.mail.gq1.yahoo.com [98.137.64.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZZz95Y1Kz4bkQ for ; Tue, 4 May 2021 22:59:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620169155; bh=88eTLRIICdiwDZq+5RahK8UZqp7o5N2iGr97rbHF/aO=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=jsJ8CXsHROdwyGrgOLlJpojoQtaUSsoKTtGYFfm6ZVBOPiHty/Bqk+vpczrMwSR0hG//UTLx7NCZnqdLGfYZSJfAyLF+hNRKNpoD5Sa+RzWrTMkMBL+ltmCaCdQHHSJ4qc2SxuUaimqSFRDG2p2p4wIV21LLWNwnVimeezvUrz/6bj3Kmvdp4MukeBYeFHmSa/m657A7aunepqhMa4heS0L+VEoFCbFeXEryP3Ft79xr0PBNpy0gfEfflfKBDtj59akfFbybE8eC4hoJ5/FSaj5rBCnmaw6vISfcBe/QGqBxGK4GxqG2C/wFxft6wgG+q3Y9Z2hcTxkeVITyc1+tKg== X-YMail-OSG: HEu8NroVM1nIB711qg6TmAM6CReMB7K6t67Z0GAG17B54.fBtYBcnDIBNfBt6yc 9sZ_eDEm9KSHf9EPwi650f4HnHArdiEEd926pV1uf2bTk1eV8ShkP_HQ0PeP4awEY.byje..oM5P hnpj1BQSiL2Shsr_8gJhl2xNeLO3lDpwyHsHpMUOne6aqi62028H_LvDKuEcbNdaUnuBv6.T1eR. ikfkRQNX4l6YibGwJHTbB0EJkuKzYff_N0w0FrqqSaeR0ZZzu6HM62FnuCfYyt1zXzVZUwp0_f08 Gvey61dyNvA13sQgHH8BYGuubDpdYGbuftOn72X0O.dc5.PiUGbCW0bFeJRQ5KjfLLt76j7A1vKH KFu3OkCuTa257p7KfsnSvlF0S1QdMXJRwpGIO2j9WM4BNLgd8cCLqUW62pP1HHsSgKjNcmQpAPlg Tl_0ZqO9vJ9kjLFKYglkREQg95Cfc6XHkGWEO4A7LERXUdd4xZd3mjcsrpO0ywQPT2u9ZKrclY8E En5.LxkJkBawev6.sDbc.RLiWe1gHKr4lRHCxQcSaw9vNnHDmWqUmxHa2xS_.zd1tCL76b_uPtJB Bur2xxGqWKscFEvDxjIIZBaL_EI9a_QhKBstJr.DIBsDYMtANo.E4NTMCW7w8R4GnruhKc.8r5jF QUH8OiuF0T3xRh6GKI4CtIkO.5RMKHx5w44Kiyjt7K97c7veu5hgadzHrFJIQcPd.a3UPgo.Cqxw O3Rme4wqY0nLL0D4TVOTEbsA8QblzpOCe6A_WCtcdiZDmy8mNhL2voYb2rL1PipNEH_DYD3PIStR 4EyoAzGLx5QP_DJK7WQRBFGhcqTJcWU45qShgJuxiL42vePP9MCXYrA7nJIQkZcemzGT5hf6FsrE RssGuL35GIEw4UvQrIgwq2kLqaya4.wbhG.Dm5wUinz5N0.lYph.H8AZA5fIr7ZTO4gzFfk_ireK TQulM.L5HZ3_pUWnciFQ4jhKvHX0o7XQgOFz2reGsEA.TiXmLdpnPUbM6EWECY_tV9SKYCGnHJrY gsr19uevoB3ZJc6Q0trHk7AzcmniTb1fJq_J0wSvrePpE6scOhBVWP1p6I4KthcCQzDP1pBpyK2E NvmffEkI6m.Bng.PkmjQ5_Ne9sd4zsLMdcOhZYtu2uUPsO7nFx2N7BP2bu6w5subHM3c7z.sXs6L wl6Dky4WihpbI9LyLZDQ63fYJbwvac5RgbKPpzhly1hVIjTmsjgoXSqYanW5jcKBp59.SoA6LsCZ PG7njearvSbYOjHrmsWLn6VBnjr02Nj5Bmeb4sf3NJ9eY6BAUzAY9RlpseqEeZcQLvM54tCZTfZK w8mbT8aEcX4W8Iyh.pDs_ACG2NeFp1jTQm4cimNQ_oO1YPX9hNd_WLcqH2XZMlxVcfJ8pvd26oxN 11n_A1DSPsfVXXvDsHjd3xc59HB_WG4Fx4n1o7cBkj8M8wlpQoFgZ0f4A9g9RGRRVK8CGedb75xG 6wM.67ifm2JIQe277LM.43PJ74ibvc7cGmaOGAqNnvQp.aP5oMX4Ey6pGWEWH3N0tfPkOIJk8rW_ oLYjsEeMIN11zzdNU.TEW_ouR2JWNBds_nT4r6tBI5z5kd3P3FYOZYxGGbDiw8e5qsctWzPQv53l 6.PgvIUo569xwnIOovvpt8fxXxKU7OyD534Ht2jH7ls4JG9vu02ag8vvANzbYTArmYlBdCr7nwOK b.CEmZwJWdXCSQSDVJfws7nMVCp7p6oCJ2WwsUtQM7z_YJpn72jQxQYfHatGpgo4cWopagENcIY1 vE6PYHsh1EVz6L5xLMKzcPUFOpdlzw7_TpB_G4YUS0F66ch_stk_1sbzz0ahqIpNcdJt.eyVEzDT HiQkouLGEyR985UOflB7zV.6eOn6FRFogY2vdynnI01QlZyKQmx3dHR7iM5.EaxFlkQXcau9iXzw IIR5Now3OFKtwJKMz2xmTrTKOc2KP9Km5ZOjFO1tfRXBO1EmO6eHakoU5pGi8KW_4G8Gizo4fn9O iRViAXReBD5CPrX6L8esBcD6n0zzjzUVf6s._UJTIaARmhT2xPcHFlXKRr2v4iWk8TeCvBV6yoS9 DDoS96.xKK4faa5GkwxFxI_dZ1qS5BS0leLpPSq9YtpSjZ6.Ddn4yecaBhhJ0MIrzvT9GduAdl4K uy.1h_6hyeU3FfT5jQ89zS6Pbg9sPV5INq9BxUMu6EhZG0T8As2k5ZuVhPNoqxsk0_RGsGXfYor5 qzoTaqYXBhlRSC9_t0LNuTAySficEZ2NXy3W6n2YlH1rDrCKEIqMkQfaWzZNraQ13BVQqtnH8BO9 bzW7zpfCxfKmEN.ybdg61WW_5loy57jz2T8Mn.KMr8qhlTLoBhJjq2Uy5j.UYTXp1WqgxQw8kmuc HN.K25estKSW.fcKM5v3xMA39x7FRUxF74m2AKS4oFt2xY4ql_nQgDBQPVYasVySkC6DGtT9JAV1 A59V.BIRz1gTeHFnLI0xylFC7NwsaKNnTbv4S96bzESILM7p1vzbav_AGR5YAwBI6GHogth8c86D VMw1GR_SAsuQGJwQlwhn07.sZRXJCipNIcusZ1U3y4qGFQpy9hymDSmga8X4bKM4ffb2oGebkfi2 _Ss33I6deAfrMegu3NKso4w-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Tue, 4 May 2021 22:59:15 +0000 Received: by kubenode557.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 062cf227df73c11c7a8abcdfc5cffd03; Tue, 04 May 2021 22:59:14 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: ZFS rename with associated snapshot present: odd error message Message-Id: <8335C81D-B83C-42BC-B296-C05FAEAE538A@yahoo.com> Date: Tue, 4 May 2021 15:59:13 -0700 Cc: freebsd-current To: FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3654.60.0.2.21) References: <8335C81D-B83C-42BC-B296-C05FAEAE538A.ref@yahoo.com> X-Rspamd-Queue-Id: 4FZZz95Y1Kz4bkQ X-Spamd-Bar: - X-Spamd-Result: default: False [-1.59 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.32:from]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.905]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.32:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.32:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.32:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2021 22:59:18 -0000 I had a: # zfs list -tall NAME USED AVAIL REFER = MOUNTPOINT . . . zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 117G = 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style 1.44G - = 1.44G -. . . . . . (copied/pasted from somewhat earlier) and then attempted: # zfs rename zroot/DESTDIRs/13_0R-CA72-instwrld-norm = zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 cannot open 'zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style': = snapshot delimiter '@' is not expected here Despite the "cannot open" message, the result looks like: # zfs list -tall NAME USED AVAIL = REFER MOUNTPOINT . . . zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 1.44G 114G = 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt-0 zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0@dirty-style 1.44G - = 1.44G - . . . Still, it leaves me wondering if everything is okay given that internal attempt to use the old name with @dirty-style when it was apparently no longer available under that naming. For reference: # uname -apKU FreeBSD CA72_4c8G_ZFS 13.0-RELEASE FreeBSD 13.0-RELEASE #0 = releng/13.0-n244733-ea31abc261ff-dirty: Thu Apr 29 21:53:20 PDT 2021 = root@CA72_4c8G_ZFS:/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/ar= m64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1300139 1300139 =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 01:58:58 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4629262AF8E for ; Wed, 5 May 2021 01:58:58 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZfyS5tZNz4kVD for ; Wed, 5 May 2021 01:58:56 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 897335C0101 for ; Tue, 4 May 2021 21:58:55 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Tue, 04 May 2021 21:58:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=hmVemulcIZb2a6UaTCIOkmzlW5m cjuS7/PxVWUiu4Ss=; b=VoUV6EOcMXfkDguv4RTANw0LQnCrQXCnM6YC1UKs3TH SYqXIVynxs1hwuGL3pWqve6mDq+KquuD532dYO49Q9No1Yi14S4q8EIQLWYRfSFJ Fz8NI/rJ9FE2nEpjWoU+yW7vgOe1c611jQ7K4u/AYcdMWKo5P6WxzFz4FwiXPFUX tgD4QEXw2JBqgvHAocL/M09MpsRjGHpZqIq5QtQ684N7sm67hkgKkFMrYNyArV6s JPozK4kbbknzZQF9mf/uDPi88scqCgCJKf251L9hW7fN9H+xyH/xGLkd4TY+aQ/4 tpqF1gqB+u4efSPJJZcdlqjOz5/rNFEe/quVBJkLXmQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=hmVemu lcIZb2a6UaTCIOkmzlW5mcjuS7/PxVWUiu4Ss=; b=os9SUKYenqGlWgduLJR9Yk u+fqdg5YxktY5nlg0w/IT0Q/QYO0PgAIdZV4yHJ5h/8LXjwEkYbdd7VjoIB1kkKM pD1cGbBdWFU1RFhoDZJS4J/QHU0GflFSwEHYuXOjA/5YCXyHOfA2yy+m1bxQ2DGN 4skkY7CPogHjDyv5kFaVvaphGdkKveVcwERZ0Qdyhhg4oiFLzMqEeZkZKVmPEBtC K8eRXWIzaH5UywGkf0bVs+NoZj3Sd5W4VumGHZ5s2bWGf1kuWV0Qv3eQc9nmVsQi DGQzV+xCST4v4qvs6dxgjAA7OEni7oY/h0+Qj+mxkfXm+Vm++coX93N/j/ISFVfw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefjedggeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucfkphepkeelrddugeehrddutddtrddu feelnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepth gvtghhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from cloud.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 4 May 2021 21:58:55 -0400 (EDT) Date: Wed, 5 May 2021 02:58:54 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="po1/6EmIxkZ+oXMn" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZfyS5tZNz4kVD X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=VoUV6EOc; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=os9SUKYe; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.69 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-0.99)[-0.990]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 01:58:58 -0000 --po1/6EmIxkZ+oXMn Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Tue, May 04, 2021 at 04:35:17PM -0400, Nathan Whitehorn wrote: >Where are you trying to install >to? Usually the assumption is that the microsd images *are* the >installed system rather than a tool you use to install a system. I'm trying to install -current (or stable/13 or releng/13.0) to a bootable usb3-connected external hd on raspberry pi 4 hardware. The goal is to have this pi booting without microsd to a root-on-zfs system. I have used raspios 64-bit to update its firmware and configured it so it tries to boot the microsd card and if this fails, boots to usb3. Took out that card, wrote FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20210415-14d0cd7225e-246078.img to another and booted it, then ran bsdinstall and selected the external hd. The install fails to progress beyond the point I mentioned. Maybe another wau of doing it would be to just write FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20210415-14d0cd7225e-246078.img to the hd from my freebsd desktop. Would that method be expected to work? The thing is, I want root-on-zfs *and* booting with no microsd. Just writing the .img to the hd would mean i'd have to abandon zfs. --=20 J. --po1/6EmIxkZ+oXMn Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCR+9QACgkQs8o7QhFz NAUQHhAAjq2/tXEfkLtzxqrM3Xld9eQ9f9BANNx1TD1k31jO0j7Ne0Smwx62BuDE WIdldxVwBhBunvOjQeXpdIhSZcai6QSpbdqPWF8Qb9tPTgBAS27+7qnxwMUGi+JO mF/G9v92DJOoHaI/MYzNfMv1HB+1zxf/BoxYM4oz5ioLREEq2ENq2nKqwXyHWYEq PbdUPTfn671fL7xE9NpVyh0yROc1wAJ+zu4gtlzQArt/ehEPAeRzXYGCnGsPlUGe d5Z4vCjNe+7aYBDIBZe1zvvoBScYzy1p2SViNUA1kPSIk7IT0O2qmf09Al+j0P/0 sh1d0x1O+a2hjC/KiwYrT05hic05QLYgd0VDYmdwlE0L/obFig8NIc3dYduDq6So n/bPaYLzJRfp2V3tD0i/4iqPc7mzwO7p6fgTqEN0XQjhA5g82Sj7PyzdznimUsWy yQOd7laBjELVtWVOGQy2GxKzcMXr9uOd3OjbLQ4mozCeBcYZ3UVz3OeDeH3c5+/6 8NXcDDJ/WFMpGd/wX6xD1OugW76QCGw+BYdqOZ0K0fsjik8CPuKbHD/DEwWXf6gt WIqwPwGZ1+4BZwvodUKXD5q4eC3TTIEErypiCKHpHELY4oaIGrcVMzQqPNzbTAS/ RK/H+iICx7OZVv4X/yiiQBK6faJPVB7+pQJd4HXtC8v4cljHaeQ= =i6AP -----END PGP SIGNATURE----- --po1/6EmIxkZ+oXMn-- From owner-freebsd-current@freebsd.org Wed May 5 02:33:37 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 02C1762C796 for ; Wed, 5 May 2021 02:33:37 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (static-24-113-41-81.wavecable.com [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZgkS4FKQz4lvf for ; Wed, 5 May 2021 02:33:36 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 1452XehW098690 for ; Tue, 4 May 2021 19:33:46 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) MIME-Version: 1.0 Date: Tue, 04 May 2021 19:33:40 -0700 From: Chris To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? In-Reply-To: References: User-Agent: UDNSMS/17.0 Message-ID: X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FZgkS4FKQz4lvf X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US]; local_wl_ip(0.00)[24.113.41.81] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 02:33:37 -0000 On 2021-05-04 18:58, tech-lists wrote: > Hi, > > On Tue, May 04, 2021 at 04:35:17PM -0400, Nathan Whitehorn wrote: > >> Where are you trying to install >> to? Usually the assumption is that the microsd images *are* the >> installed system rather than a tool you use to install a system. > > I'm trying to install -current (or stable/13 or releng/13.0) to a > bootable usb3-connected external hd on raspberry pi 4 hardware. The goal > is to have this pi booting without microsd to a root-on-zfs system. > > I have used raspios 64-bit to update its firmware and configured it so > it tries to boot the microsd card and if this fails, boots to usb3. Took > out that card, wrote > FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20210415-14d0cd7225e-246078.img > to another and booted it, then ran bsdinstall and selected the external > hd. The install fails to progress beyond the point I mentioned. > > Maybe another wau of doing it would be to just write > FreeBSD-14.0-CURRENT-arm64-aarch64-RPI-20210415-14d0cd7225e-246078.img > to the hd from my freebsd desktop. Would that method be expected to > work? The thing is, I want root-on-zfs *and* booting with no microsd. > Just writing the .img to the hd would mean i'd have to abandon zfs. Doesn't bsdinstall allow choosing different means of fetching the dist files? Last I remember using it, I was able to choose ftp http(s), etc... Making, or using an already matched MANIFEST is fairly trivial. You could obtain your desired base files and create or use the one with it. Then point bsdinstall to somewhere to get them. If you need a remote. I could give you one to use. HTH --Chris From owner-freebsd-current@freebsd.org Wed May 5 03:26:41 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B29B562E10A for ; Wed, 5 May 2021 03:26:41 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZhvh1Hpzz4pW6 for ; Wed, 5 May 2021 03:26:39 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620185198; bh=KQNG3JV0dMKY6IlgMNeyhPsyT3OGDupsYVUdbcGKpbC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=hMKOuvoqBzM9C/+TqZKFUOD4rVxr4Xc8qXEMkl2oxvDuoFS9OQ0EBDeNTUSTtd+dIAV8WQSMSHiiTy167fQbeN2r2J3Pm7lDjP1rmFHn+tu194yoVYr4+p7g7Jv8DoHe816SiqQF+BAUVcHtMGoTSN3GyBziMibrQBIz4Dya5w73x8hjZ6GCPFuEJWPliQoECmdM+JYgP2YvGceaiS95dkuPSgO38EJahnTtTZ9YYrScqYICqoaOg6CYoyf5bpN2UYNPkHdlT3EFuK4sfXFhOK9PKcDbZCDkGzLiwk3jINdngOHUv9E30QiT0CRFQS02zyr0deo7MMgUG5KlNiXJEw== X-YMail-OSG: XAoIB1wVM1kf.LFZAQr8RhvlmGyFdMXNZhw2SuFLKEEKDhiVeq_j_gDbk.H1UsE zlHuxURHrn4hDqx7DFzKS6pDa9WZ09mGVvwWXsJcM4E17Ey.IKNs299MfmV0_8ZrJjpbItEMOw1I jE6LN_CVbR4F2gmWGbX1ozU6UrzDj5WBiyG9TkZFkK57TvF8D2yBlbnd5FS9KILrSThk38Zuk.RH nzzYbkH22HMXvR.te_GTuADkmyvaSD3nAWc9e4h3rhzywsB6g8hvM7rjueWOxlYAstmGEi.8AcQ1 MnhDji7mvTwDna60K_j.P.KJ.dnlQIe8KlhuMClbO7eQ4PJzFBOmobFJdznsyLqBDqMN83euLgTw Tq63SS3_Zy5Zla5USTjllgsRt2IMdbCftedzGlrTUqCq8nswE3P7KJ9yoHG0XYSoRNlZ195I7K4s SEEJVEjYU_vUwO6GFGY.lPnZXmDYa8jy8lAKW8VyTVhgNxi7yFX.o9Uc4j40sy7GC4btLTzzucw. UDQERTCQwDhd2cKMXBhE2GpheVC3lmldJEpUdJMib5FHLnnOVcJFs87Hcy_WCQL592hauJU0lxwU BfATXY_VutjbdO4EGdWLTONQDS5ZTmL99CtfO6eG7wz3q8xW2_rxgTUyg1w8bnDvGuwC4BW4xU4E Qg1BLfl8N5y9ljEZNKGQ_42BR1yHeIlmFKqNhkcHqq3mjvaePlPD099Z55t36inzvlGcLaSGn26M wzJz_oJQJGPbiRIJoCkZA7.p8TwMBNOeyEK9qsMbUvBTBmYLjGz4HWItQhDb1WdHY5ba8LCYpaDd 1FDOKq0_ibeL_6Z3T0pxMZ_EIQgIFPG01A_GZ4IybSyjf8sKPLSjRl30ev2HaBgnNB5QGgW.ISa5 yQKfE4tYGzQz64VmRMuZ1l1dDkXvFqj0vAWhLLHhGRTr206Qep17_xufE_C2jGRpHvfZIqzlnL5k DrC2C9ck8PYkJTiKZDOHmZCfZ69kTDQc1btoeDWNnm2V_5pu9y7q7ZFl6CcCX3zWJMrwKeujh1mc mRgkMdwtmEktoi8AQY7Y409gwPAj4IWNBIa8cNgWaidS2pqjvtJfO3ECWJ.LOUGySVmsTlKHXELP Mia4u5Dk5QNvaGTHcgQ.ODBUcwnDB0LCNtAryrHGDvOQSb2sjRnp5r1x2oKeYNGwt.6lUw9YSUyg zzGD9pkT2GusoXMRbeO5d8xcAXtPdkYeC2B_tYlKkXEmM1U3i.NzZsUvoAWMLZ48sc8BwcgGXkp6 Z17pfM6Ys0eoC_HkhhWVv0n9IgZ8u3BQEAL4s7jfAQsF9VO4GBAsUxCm4CJqsJBbp4mPGuLO006o KtTK3.3YJt7L6A9WbfhAvmFWVaFb1FTwwPzvLrFs9AB5smE4an_lyVvxNqbtnORVJLp.mZqLfHkn VA_86pe9JDxRq21ehSy5xspCU0m969Das3qxYoAHarCemPNidbJchhPBHicFLvWC0X3u0iZ80_iJ Wrqy3iFs_2jbBQHIWob5BLxHFdLiFqzJB13choQpM5hrJx.lFq_PaeyPU5EnYn1MDn7M6Izj9W6s W4K9KpA44SOYLTsn1NvIgDGGRl0Bh7uQVJkl_6VpgEYBoO5V3CpU5BsgcP66Fl4K3fX6uVOImhRo YWUsGvd2fxnZrpM.D.By5uD2_pfz65f9p4CBfFgRueqVoqW6BsAt41nDtaTZpiG1TgMbOxoUcf33 y9SO487bC0dwL8kq4W04qn2y4.WSgxNws4HaRQ0_rotJcU3laMT3DrA2G21j104Y0AUzUFKamSe2 QrKR2J3F8VmwdbZpdik2O5v5fdYRxteEXnQ1j_eI9OiMDbuJrC4UDBDdbdnf3e8JhiKzZl9tCSTs vAS7ZYo4MLJWuy8ielWlqJ45W.3dnKpvEvYuiveiKVuU7boDy8hbTRJeAjWelPxIMrL4Z5MKT8zX DxDms7vM9Nib.t6GuEn7zyDZmAnTa2oGkodrK1v_JhmP6ShH6Sl_xhmSjugbnCoAF5y0EVhDawcs FtAPXIDyx3EFTtWFfTHSVA0HrSNPStV59AUL.INWk6CxFvnckeMyLb75vZUknLfuVfqpqZadtDv0 HuJT3XfHsR_ZwGroxYj7DGdCmt_ZlPUpZ.evgushnTMemcQgKCv4F2ieLGB7quFJBSpeD37gkV8k tvJ_1UlkYh24R8GdpQy6oR0Z9yYg_JSjhavqLgS_oC41uq1bhTLsxmrUU8jZaMuFgL0mGs7IiOYb PXlqqVBIbZTdZOWHgphgl.qnv8COHcHp4.ARpzC3I0hx7hzpkMYPclJeKI4sH3Mtmxpx.TsVue6k Y_Nr7OQ2kWIcrkaYFiKONx.oF5R_qV9t0YTlyN3OV2AXKn3KXqUuWJQTkS3_b.2aWlGF3AnMVGUY 7wZzFEjCwU7SoBHw4YRuQEvTnoo8oXIuQ5Ku_YnyfTeadHUmwEoiiDGonDJd60yDCnU8mKh4x460 ltu48oAK5_KPhX8rLPIAtXlIgyzOgBPiVNWUwm1q9C4tolfnV_6inNav86mcIJ4oGAY5.9VnIWIN jpZJ_mD_QS06b743cdZaIASU5JHOU5rLZ1R3By5NnXef_BGGlU4t_YIFlVAXLEUZcwzHzcRnyAoo PJ2yb5xfX5e15pf7XZV6MN2P6pbD61__ZIugTxjr4fm8AcndD_RThubAxLvWeJYZg0foy_xKl4XY g2g5ye4Y_HSgSmVuDpNiSPnaQMmlDMQDSnEHcVPMjYvkPFXh01_.lhjPIBtQRd5dCgjqPMBrvx6. JPIVaHAOXu6f_Y3uCw4YZovgD1ZclCYZF1LixwJdHrg-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 03:26:38 +0000 Received: by kubenode548.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b01a7d29a0fa63ba3f53d2a3e60d14b1; Wed, 05 May 2021 03:26:32 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [aarch64 test did not reproduce the issue] From: Mark Millard In-Reply-To: Date: Tue, 4 May 2021 20:26:30 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZhvh1Hpzz4pW6 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 03:26:41 -0000 On 2021-May-4, at 13:38, Mark Millard wrote: > [The first buidlworld is still in process. So while waiting . . .] >=20 > On 2021-May-4, at 10:31, Mark Millard wrote: >=20 >> I probably know why the huge count of differences this time >> unlike the original report . . . >>=20 >> Previously I built based on a checked-in branch as part of >> my experimenting. This time it was in a -dirty form (not >> checked in), again as part of my experimental exploration. >>=20 >> WITH_REPRODUCIBLE_BUILD=3D makes a distinction between these >> if I remember right: (partially?) disabling itself for >> -dirty style. >>=20 >> To reproduce the original style of test I need to create >> a branch with my few patches checked in and do the >> buildworlds from that branch. >>=20 >> This will, of course, take a while. >>=20 >> Sorry for the noise. >>=20 >=20 > I've confirmed some of the details of the large number of > files with difference while waiting for the 1st buildworld : >=20 > The 4 bytes at the end of the .gnu_debuglink section > that are ending up different are the checksum for the > .debug file. The .debug files have differences such as: >=20 > =E2=94=82 - <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/usr/13_0R-src/arm64.aarch64/lib= /csu/aarch64 > =E2=94=82 + <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/lib/csu= /aarch64 >=20 > So I need to build, snapshot (in case need > to reference), install, clean-out, build, > install elsewhere, compare. (Or analogous > that uses the same build base-path for both > installs despite separate buildworld's.) > This is separate from any potential -dirty > vs. checked-in handling variation by > WITH_REPRODUCIBLE_BUILD=3D . >=20 > My process that produced the original armv7 > report happened to do that before I accidentally > discovered the presence of the few files with > differences. My new experiments were different > and I'd not though of needing to vary the > procedure to get you the right evidence. >=20 The two aarch64 test installs did not show any differences in a "diff -rq" . Ignoring *.meta files generated during the builds, the build directory tree snapshots showed just the differences: # diff -rq = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr | grep -v '\.meta' | more Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c differ Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk differ # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 13:45:14.463351000 -0700 +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 19:04:32.338203000 -0700 @@ -4,7 +4,7 @@ ** Words from CORE set written in FICL ** Author: John Sadler (john_sadler@alum.mit.edu) ** Created: 27 December 1997 -** Last update: Tue May 4 13:45:14 PDT 2021 +** Last update: Tue May 4 19:04:32 PDT 2021 *******************************************************************/ /* ** DO NOT EDIT THIS FILE -- it is generated by softwords/softcore.awk # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 10:55:26.030179000 -0700 +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 16:14:24.513346000 -0700 @@ -1,4 +1,4 @@ -.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 10:55:26 PDT 2021 +.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 16:14:24 PDT 2021 _LOADED_TOOLCHAIN_METADATA=3Dt COMPILER_VERSION=3D110001 X_COMPILER_VERSION=3D110001 I may run a 'target cortex-a7 (so: armv7) from aarch64' test next. That was the context for the original discovery and report. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 03:48:17 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A3CA662E86A for ; Wed, 5 May 2021 03:48:17 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZjNc5XKyz4qPL for ; Wed, 5 May 2021 03:48:16 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 2A6505C00B8 for ; Tue, 4 May 2021 23:48:16 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Tue, 04 May 2021 23:48:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=IhAJJx5e/u73i2lgrgDorIEwJBj Hm8Mwm2gUqtRKxzw=; b=nG/EnfDWSjGcffT3Beje0BGrzGdNHgCtMP4VihUB+B1 XlOV0O3UlLSXajA2g8h+ZWMsu3dgJLbh5ehFkCwQa2eP8LRKY+NXIZy0wuF5cj8P s4+nFnRoyiWwP7QmXzgtXBSK2QN8Znz1mIqXXKXkWxIiyOTIU/90rU3KmY/nc0gp avliWBRdBMl67l2MpEwa24ev7Q8OQKTWkSU94Q5IoaqTUr2/V1LlaJXCVbI6oha2 P2RT4zf9TLpQ9ax//B39m56e6UUGgBhPHtDUQsyY+KMrBgLDRvIQ6wocDl7aHdgE /WPytXY2h7C+KJb8adVhrp0o+8fL6ydk5EZ4KRH/OAA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=IhAJJx 5e/u73i2lgrgDorIEwJBjHm8Mwm2gUqtRKxzw=; b=Embn1NKNP97tEqpuNDPoRF 1w61VX6nsZByoVS5lEsU6m3ghW1Ci+4IxxDoayyo0GFW+MqWz8tu7qaEuEzwRysA 5rtMWS3Xm6cxx7i+DuLnfY+FxFIblLwyQPQdqkiE8w6HDnPf9n5JKRAo6tJr8gTU Uk9pXH5L3ok0kbzwQRiXOGLoeozHCL3dZ6yOl0ZbnqWxYKuEeam89YRQFgVxq0rS nlCVTEWjRB4GzLgjlujN6rszNLmgNcsPqHMQfuG91iG+FdkCd6e3WKe7gEV2lSnZ 22rbrMApIsXS9JlVAqkZcUaJmdUog/f0Hvlk9UI/FvPpsLA5qASbGFyKC9SiPMnA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefjedgjedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtro ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpeekgeehveeuledvgfevudegheekgf eiteekueejjeegtdelgfdugfdutdeikedugfenucffohhmrghinhepfhhrvggvsghsugdr ohhrghenucfkphepkedvrdejtddrledurddutddtnecuvehluhhsthgvrhfuihiivgeptd enucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhn vght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 4 May 2021 23:48:15 -0400 (EDT) Date: Wed, 5 May 2021 04:48:13 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="rfNN+P85Fpy+m5IM" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZjNc5XKyz4qPL X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=nG/EnfDW; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=Embn1NKN; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.26 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.26:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.26:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.26:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 03:48:17 -0000 --rfNN+P85Fpy+m5IM Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, May 04, 2021 at 07:33:40PM -0700, Chris wrote: >Doesn't bsdinstall allow choosing different means of fetching the >dist files?=20 iirc it gives an ftp list. I tried with ftp.uk and ftp.de.freebsd.org. >Last I remember using it, I was able to choose ftp http(s), >etc... Making, or using an already matched MANIFEST is fairly trivial. i'll try downloading a matched manifest by hand, next. Thanks for the tip. --=20 J. --rfNN+P85Fpy+m5IM Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCSFWkACgkQs8o7QhFz NAXpbg//Q50Tt1f9Ba/SweU2jx3ltvbK1PK779yGiq8HXq7d6zmzlv1wgKVpuvb3 HFqkeOKMggV0Yr6mt0Sq/aFpbpLfFkqe8L3rOVnQxdWM5HF24eX39PQo/vp/Y5Kk PEM0PQq4BGvtkpCa8453oj4J7OVeXpsnhNtIHuXgOJk/n2w4nzHdjqSe7kcJ5Zrc VXDvslZFLvST2z2mDl6JpZUbaHP9IorY/ITCFgTlWZxQkQ2uZCXpoAe7LGrUi4t6 eaUcxNlcQuEt4ByGSAHAIPn5CoItsmGVTDPfH1f7FtCHI+ncMzW2CBJCaKVVPQPX 8tq+liqkhIs1FMkexyO+XIcfXnLlfL3Fxp0c3G82AnGZvuNYL/C1CJ6fGLxaR+Y8 XWpdomNPNd0MutpLj6CRG+n07r0jNmDkytI3XmUG/wOoy/l6J42KH7mWDjXPHeiT vkrgZGXa2V9RCb/fHbHQNba2zQBfI09TbtmWnK/nygLNLYgMZQRrJlVBaH70Vdod To0hNx88U2XZqSwzTrR4hFgG0uteXQLMLMMDhEYjZrf6u1hYTcTyXsq7KbKi802v TA5cjDIGKGal6Y51RH9jOkvL8CDvJtuTSXZPEBbBoU26oinDvzHvcwg/O1fjazU+ IftVA6OpVa7WOHsxnL+BkNYEXtPV5ILXkSkQc0s1O2a3TbKbJlU= =9o4d -----END PGP SIGNATURE----- --rfNN+P85Fpy+m5IM-- From owner-freebsd-current@freebsd.org Wed May 5 09:35:14 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DCFFB637A5C for ; Wed, 5 May 2021 09:35:14 +0000 (UTC) (envelope-from roberthuff@rcn.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZs4y4vbgz3PJv for ; Wed, 5 May 2021 09:35:14 +0000 (UTC) (envelope-from roberthuff@rcn.com) Received: by mailman.nyi.freebsd.org (Postfix) id A854F637A5A; Wed, 5 May 2021 09:35:14 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A819C637B24 for ; Wed, 5 May 2021 09:35:14 +0000 (UTC) (envelope-from roberthuff@rcn.com) Received: from smtp.rcn.com (smtp.rcn.com [69.168.97.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZs4x6NRNz3Nwq for ; Wed, 5 May 2021 09:35:13 +0000 (UTC) (envelope-from roberthuff@rcn.com) DKIM-Signature: v=1; a=rsa-sha1; d=rcn.com; s=20180516; c=relaxed/simple; q=dns/txt; i=@rcn.com; t=1620207312; h=From:Subject:Date:To:MIME-Version:Content-Type; bh=VWxem2A1SUuxAhXEnjtcBjGz8Fk=; b=FscbHin8WtxQ0QHY/4X0q7/42Eu73WRdOb5qbSQDbkAekk6bELS+Gk/euctN4L+V +kea5DnPBY3LqfUNRdtzIqVDgpWyOXvJK04tKoCQqsvu64Qej6CF15EtXJSRHoiM tQrkvjjLtvDFIhAloasHvhgU1MwBBLI0MQvkOck2wl5TM7tfzE7srmFaOM6N6yHq NY/Fif72OgwB3sttlp8hHWwyLRo5ZOUwdrgxAE/iAEraGzkBEKRrCjsnvxDys7fe zrZbDfmacJtcIPFTSZCAgMiceWnUue2nFp/6aCTf1W4ps+bUClk/LjaX8++BT8mb wn/KzDviC81GAj4EJ4BwRQ==; X-Authed-Username: cm9iZXJ0aHVmZkByY24uY29t Received: from [209.6.230.48] ([209.6.230.48:46352] helo=jerusalem.litteratus.org.litteratus.org) by smtp.rcn.com (envelope-from ) (ecelerity 3.6.25.56547 r(Core:3.6.25.0)) with ESMTPSA (cipher=AES256-GCM-SHA384) id 03/FE-64052-0D662906; Wed, 05 May 2021 05:35:12 -0400 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <24722.26319.449992.105920@jerusalem.litteratus.org> Date: Wed, 5 May 2021 05:35:11 -0400 From: Robert Huff To: current@freebsd.org Subject: Re: Problem compiling harfbuzz In-Reply-To: <87pmy6ahy6.wl-herbert@gojira.at> References: <87pmy6ahy6.wl-herbert@gojira.at> X-Mailer: VM 8.2.0b under 27.2 (amd64-portbld-freebsd14.0) X-Vade-Verdict: clean X-Vade-Analysis: gggruggvucftvghtrhhoucdtuddrgeduledrvdefkedguddvucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuufgjpfetvefqtfdptfevpfdpqfgfvfenuceurghilhhouhhtmecufedtudenucenucfjughrpeggtgfgkfffhffvufgjfhfosehtjeertdertddvnecuhfhrohhmpeftohgsvghrthcujfhufhhfuceorhhosggvrhhthhhufhhfsehrtghnrdgtohhmqeenucggtffrrghtthgvrhhnpedttdelkeethfeggefgveelueegvdeludehueeuvdegjeeivdffiefffeethffgueenucfkphepvddtledriedrvdeftddrgeeknecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepvddtledriedrvdeftddrgeekpdhhvghlohepjhgvrhhushgrlhgvmhdrlhhithhtvghrrghtuhhsrdhorhhgrdhlihhtthgvrhgrthhushdrohhrghdpmhgrihhlfhhrohhmpehrohgsvghrthhhuhhffhesrhgtnhdrtghomhdprhgtphhtthhopegtuhhrrhgvnhhtsehfrhgvvggsshgurdhorhhgpdhhohhsthepshhmthhprdhrtghnrdgtmhhhrdhshihnrggtohhrrdgtohhmpdhsphhfpehsohhfthhfrghilhdpughkihhmpe X-Vade-Client: RCN X-Rspamd-Queue-Id: 4FZs4x6NRNz3Nwq X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rcn.com header.s=20180516 header.b=FscbHin8; dmarc=pass (policy=none) header.from=rcn.com; spf=pass (mx1.freebsd.org: domain of roberthuff@rcn.com designates 69.168.97.78 as permitted sender) smtp.mailfrom=roberthuff@rcn.com X-Spamd-Result: default: False [-3.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:69.168.97.0/24]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[rcn.com:+]; DMARC_POLICY_ALLOW(-0.50)[rcn.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[69.168.97.78:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[69.168.97.78:from]; INTRODUCTION(2.00)[]; ASN(0.00)[asn:36271, ipnet:69.168.97.0/24, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[rcn.com:s=20180516]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[rcn.com:dkim]; SPAMHAUS_ZRD(0.00)[69.168.97.78:from:127.0.2.255]; RWL_MAILSPIKE_POSSIBLE(0.00)[69.168.97.78:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 09:35:14 -0000 "Herbert J. Skuhra" writes: > Have you tried to (re)build devel/gobject-introspection? I think > ports list is more appropriate. Indeed. See the thread "looking for port origin for executable". That answer worked for me, and provided additional useful information. Respectfully, Robert Huff -- Hello ... my name is SARS-CoV-2. You are not wearing a mask? Prepare to die! From owner-freebsd-current@freebsd.org Wed May 5 09:47:40 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2D63B638028; Wed, 5 May 2021 09:47:40 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from relay11.mail.gandi.net (relay11.mail.gandi.net [217.70.178.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZsMH4pt7z3Q2Z; Wed, 5 May 2021 09:47:39 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from [192.168.0.88] (unknown [195.64.148.76]) (Authenticated sender: andriy.gapon@uabsd.com) by relay11.mail.gandi.net (Postfix) with ESMTPSA id DF356100012; Wed, 5 May 2021 09:47:36 +0000 (UTC) Subject: Re: ZFS rename with associated snapshot present: odd error message To: Mark Millard , FreeBSD-STABLE Mailing List Cc: freebsd-current References: <8335C81D-B83C-42BC-B296-C05FAEAE538A.ref@yahoo.com> <8335C81D-B83C-42BC-B296-C05FAEAE538A@yahoo.com> From: Andriy Gapon Message-ID: <4ddf96da-e7f7-663d-8539-04f91297389a@FreeBSD.org> Date: Wed, 5 May 2021 12:47:35 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Firefox/78.0 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <8335C81D-B83C-42BC-B296-C05FAEAE538A@yahoo.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FZsMH4pt7z3Q2Z X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:29169, ipnet:217.70.176.0/20, country:FR] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 09:47:40 -0000 On 05/05/2021 01:59, Mark Millard via freebsd-current wrote: > I had a: > > # zfs list -tall > NAME USED AVAIL REFER MOUNTPOINT > . . . > zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 117G 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm > zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style 1.44G - 1.44G -. . . > . . . > > (copied/pasted from somewhat earlier) and then attempted: > > # zfs rename zroot/DESTDIRs/13_0R-CA72-instwrld-norm zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 > cannot open 'zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style': snapshot delimiter '@' is not expected here > > Despite the "cannot open" message, the result looks like: > > # zfs list -tall > NAME USED AVAIL REFER MOUNTPOINT > . . . > zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 1.44G 114G 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt-0 > zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0@dirty-style 1.44G - 1.44G - > . . . > > Still, it leaves me wondering if everything is okay > given that internal attempt to use the old name with > @dirty-style when it was apparently no longer > available under that naming. > > For reference: > > # uname -apKU > FreeBSD CA72_4c8G_ZFS 13.0-RELEASE FreeBSD 13.0-RELEASE #0 releng/13.0-n244733-ea31abc261ff-dirty: Thu Apr 29 21:53:20 PDT 2021 root@CA72_4c8G_ZFS:/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1300139 1300139 Cannot reproduce here (but with much simpler names and on stable/13): zfs create testz/test zfs snapshot testz/test@snap1 zfs rename testz/test testz/test2 All worked. -- Andriy Gapon From owner-freebsd-current@freebsd.org Wed May 5 12:01:09 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DFF2C63C44F for ; Wed, 5 May 2021 12:01:09 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZwKD2nZnz3n59 for ; Wed, 5 May 2021 12:01:04 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 6DF165C0145 for ; Wed, 5 May 2021 08:01:03 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Wed, 05 May 2021 08:01:03 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=qN/bM6Xqa9/JKIihgb74Ai991X4 TQnO6EwtAgBA4RBI=; b=VO+IrD3ApsuPHxsi06gvzMqUd0MMmLLxveJ+keAmgn8 0RqBXZbQod/tgqkkFAtpf4FA9Ax3CjIxbEP/GS/LumLrl6VHuqPnnCFJXW0Fp0jM 0MC1Cp8/RGs2r1hMXlZ57bHJofC+fRukbtXPXUx32K94+0OoiCDQEFW5tPjHa017 zBDuvU6W+WO6ZaR0GHY+FjpDIV6dQvAx2s3SlKZOD1fEZeq1KW8NBZ5a00C8zyTN KJvdl4hfj/BtHBtsyLARdMPVvnCAw8YRi+Bc9bec3OsxDAmuhlHwZL5styvSlfI0 I/2KuWu6HhdUKenFIs+/xTxyH1dpXOg02qWnXI45kUg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=qN/bM6 Xqa9/JKIihgb74Ai991X4TQnO6EwtAgBA4RBI=; b=ts3+cjx98ALu0X38BCPAvG FWMBe/OLro90ey+blNgJp9Ddq/W9EK6Eo0HVVm7YBBOqyTP12DgulRkRQwuHv3yz umk2bZ1Ccw58GEUk9yODHcfvotOF1AZWwQmfL2x1eQzENlcQCRAXjrxDq4fvStbM 3M5f+X++ixI/j1M/XGW9FYHfQwEzBeuWs25l2iIwqpG4V9fQLPrHysS1ijbwcCEP I5NL9Af/eQfxULcYd4pdANTs7jc+TygCB/FA0XFhfQwWYw76iAUUV+ZfdBaeZ+gN 6YI8wR6YcJuVe57onzOjPAS4b7+Bqrl2W11cD3da7zavLNcZ8wG7wYxFAPfxmHSw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefkedggeefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpeettddtudeugfeggefhkeekteekje elfeffleehjeffgffftdeffedtjeegueeiffenucffohhmrghinhepfhhrvggvsghsugdr ohhrghenucfkphepkeelrddugeehrddutddtrddufeelnecuvehluhhsthgvrhfuihiivg eptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshht rdhnvght X-ME-Proxy: Received: from cloud.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 5 May 2021 08:01:02 -0400 (EDT) Date: Wed, 5 May 2021 13:01:01 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="yXS/49pfLj9JiexD" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZwKD2nZnz3n59 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=VO+IrD3A; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=ts3+cjx9; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.25:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.25:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.25:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; BLOCKLISTDE_FAIL(0.00)[89.145.100.139:query timed out,66.111.4.25:query timed out]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 12:01:10 -0000 --yXS/49pfLj9JiexD Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, May 05, 2021 at 04:48:13AM +0100, tech-lists wrote: >On Tue, May 04, 2021 at 07:33:40PM -0700, Chris wrote: >>Doesn't bsdinstall allow choosing different means of fetching the >>dist files? > >iirc it gives an ftp list. I tried with ftp.uk and ftp.de.freebsd.org. > >>Last I remember using it, I was able to choose ftp http(s), >>etc... Making, or using an already matched MANIFEST is fairly trivial. > >i'll try downloading a matched manifest by hand, next. Thanks for the >tip. Clarified there's no http/https in the download list, just ftp urls I tried running bsdinstall in one console and fetch in another root@generic:/mnt/usr/freebsd-dist # fetch ftp://ftp.uk.freebsd.org/pub/FreeBSD/snapshots/arm64/14.0-CURRENT/MANIFEST MANIFEST 782 B 2145 kBps 00s root@generic:/mnt/usr/freebsd-dist # fetch ftp://ftp.uk.freebsd.org/pub/FreeBSD/snapshots/arm64/14.0-CURRENT/MANIFEST fetch: MANIFEST: stat() root@generic:/mnt/usr/freebsd-dist # fetch ftp://ftp.uk.freebsd.org/pub/FreeBSD/snapshots/arm64/14.0-CURRENT/MANIFEST fetch: MANIFEST: stat() root@generic:/mnt/usr/freebsd-dist #=20 bsdinstall bails with the error. then:=20 root@generic:/mnt/usr/freebsd-dist # ls -lah ls: .: Not a directory root@generic:/mnt/usr/freebsd-dist #=20 clearly theres an issue with the bsdinstaller unmounting the chroot at=20 /mnt at the wrong point. If bsdinstall *should* work, I'll raise a PR looking at man 8 bsdinstall, theres loads of parameters I can set, and there's also logging. will read all this before making a PR. --=20 J. --yXS/49pfLj9JiexD Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCSiPQACgkQs8o7QhFz NAWXgg/+MuhAwVEtSTbp3V93x46hRKOMAlnDVwpmNugzaqxUk1DXL+rQdXPSbBKE y2hb7bQVyQosUzvm1TL2FmiNr+OW8qPl3lWuJmjmlpGO1GREYJBLTnvu9KXmU/B+ qYJqO/1diUnYvvhQg1GuSDlusjJNFOYlfho6vn4ayXvHa/pqVn0qlFxKjciMhuIf uxWXTNonosxXfytGRaEJ7m405PcSlKUv/6/VSOKgakwD5m24AhB+hbH5vwyiPNnQ MvT4EBZRUHZQusg9/8ZqID/XJo2av4yfvB/jBM8x3hcrfovzoe7+qDBuUi7vysSc skMC5KPMvLLZH1xjhc+cZQ3CekklgQ7cRTq7FvwP+Sq+GdMO4ljH5M/67dKhFuQ8 OEgFlCuh6qK8U6MOHrmm9O94tyw4aLNtIWtxgyWAEvyP9ZDIInKnYjHVne7UFs47 6lMD9bSyLgjZ2hDVgCC5vpVDkFOLXgNPdLap/5VUMiaf3liWiNOfpgefteOpV7R5 4FBs+JvnrvvsD7kr3ebLcP+0o/LSihLROi40Nch/pJHKbsIWRnCE8s4CllaQf/dF aHNqjn5ZqtNNzuN7XTwFI1D2fHZnEHulLgxR2jaKKXBG1PvpnPEj134bILYCpsrH xMQ0fv8FGamrhqSjQu3gtIxquWowb/RpyjiaTZw2d++JWOAdrNo= =V5i4 -----END PGP SIGNATURE----- --yXS/49pfLj9JiexD-- From owner-freebsd-current@freebsd.org Wed May 5 12:28:33 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 06EF563D5B8 for ; Wed, 5 May 2021 12:28:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-54.consmr.mail.gq1.yahoo.com (sonic307-54.consmr.mail.gq1.yahoo.com [98.137.64.30]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZwwv4qmXz3pHh for ; Wed, 5 May 2021 12:28:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620217709; bh=zAok200WkYcdxN0AwMzElDUPvx2fpciESsD8wyu0vTZ=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=goqSdl49ojPfuq6l+qNdrKZZasDG4ZnEjdTFSXpwmRHUCHyJN1DEoId1fvQSuVGGTD19KudnWgyz4qeInEXbN7vgGGmr3b8fJI2eVRxTx6VyMBHbmVNDbr9rotTS5DGE9n+feJ1zbBWfbvllgW+E3aTMeSrdMOn4gJDO2DWSOf4YcqCMxWr7RGaSebdUGBpnkwijqtXpTjYGRWp+TtCWvwck4rETQn1amFi7s0nw/Jkb8W/xF8KMJ47X8lZueDk0gXT4cEsiuCWYAb95PhURszXU4EywArv8T6PeHDYBH4z2tCN+yNkDSoWS2vmArUaG+ma23z5QTh9c9/935jEVTA== X-YMail-OSG: j6dyDwwVM1lFU_GO6px.6lLqJ5_CRH.grP_yyUy9c.a65XDUJPWfsr4D4X6Otpr uWpAQ06fDNGrb1jhNm7dtj476_b_AX0dudgDk1UcMYGj_x9YJAAWR2QeyLWh7cTcHR2n5OgpPTil _qF_nzXAg1wIWdS7TeQtBcDRFe_rGO4aMwQcb0zJ0_8VuIh098Hm5VLOxx1qUpTKpyb8jUW9Pu2u Eo1vR0kZu4jvTUvlSmVFr__fg9m5V_MQIfygjvGbMN_WeIWIF0pXQw0_ExYYt7lkF7G46y3H6Mas QgQPrucZbf8Jf4voDvSxIc2eY8Zx2uAifgXghUZTCsHykWEpcQ2Y8YO2MLYVSOcV8GVknereNZ_j Vfb8U3DY7ZhojgybeeWeWwilyTNvUX8wkIT9xkx9NLQ75vqDR.XIYmpABA4dXsZhsfEDBCbWX099 oQU5rv4WF8taxj0i3DVpZI2Ay264S2YjzwT2aQwhRkXCjn3gHXSfVAPJl5hjpWa5OMJLQJ.yFCCk dNW67vGjbU03PsUVz7TSQbYXfjna.EokZtYTC7BjK1Cgaaur2pX44XGXYaBWCUgZfX5DWBmVCLcD p1311fj51yr38RLSfp.tSHpTtkpk47nrt1dx7W.St7_ij6_5jOn06uXjNbSJCSsRaibdnb7LsvPS nktP1WABKm1_0ZdazjPflBU351uAs89olrc7UmBeUW.UYrZ9OLT4YFbeOZ.ONcCGHO4WZwhxVNDs D4vOdRBvCaO_w2Z1HoX622jN6kLxGD3se1cnKtW5gydSdbbGiHdaZBE6oRt5YZkjY.JaZ4hi8Fzt Hq7kQYhTELbRrt_yo72QYCCVT96gYlGWFqby80oQhFKpKn4eHPd42aiwYVSZIiUNxBgFVHqNGN9D tvWbexbEKkohl0hAdFsjgcUw39rbKFkGysMBS2qvWSaSOwU6Qrwn.Og5AHSGkjoH7zYh8aW6JYjK Qvt4SXXNUj1CQJgJOB0jI0.ZsV5gog7IkhebxLffUNPnXNyeBuHD.S5iUrfGc2OpFeIArLNQdcCv sOfiZehhbO6VHaYed4rXwFi7xvxYqMfGQD4Em.GUJtakVVs1hArmhvV0nLtzuFScX8BFn37m7mvm G3ZiyOllZsK7IQFqy8VZtzD.5dOxwfiyCYgtJtbQx2AGabuSSHubb8fnRP8bqIe3lljrRKicnfG_ MUQRiyFMUxA0hDjc8Xh6xPn89HgZENwM5IsrEfF_lZFnevHufy79AZHCy9OVtCfUs9zc3Oz6q82B hTT15QdHAUiw7glblddIaZafGAgBtV4KQW2nh0SMtEtD211k8xz87JP4jZPvfUHDpdNCjcJ7B05e WzUKzWWnDFnpNsNX_Gdp3cTX.wuFLvvYnUcMeq93lW89J7BLXaxwb7trBGZTtcKVUdyFdLAoDnTG F.6UoBGmX80myXfAOAhx.r0vnDLARhVpwggXpBRi.R5JAPnFrTL87SrY3g5o8H03S88cq0_LpSVk czhNJbKz.g0dIUE9E2wkqk11wK6LiskoDBFNUH6ApFgaBelrsUlc1KcZPIqQ509Z9tyrnGpXMURo ntvIA.CE.I6VHTuU0Jf23009kOKNqVs5K3WI09w.1dunROhbmSVUHMk4QO3ziid8hF._bAo5zuN1 dEKbHe4cnWOV0IS5ecZL45mzyAiqrvvVAL0tqISh0NI7atQdEaWFmttVX9lj.a8UTpOF8XUrMXa9 IEiPnayqvEqO0bPG1ZRsFM0_5yUmwv5vEvAqL8a7r6TTc30sbTNdkZdKNlKyC1gu85PlfI.vWLi0 YVrZPipFnQUf2uCJT_CidNDBR6tJqpnV..Wl10amGpnAIp0sFv73fRPfilZfc2hSJRsKQ4VG6Sqb BkPSm29o1az5O.wS0QGujb8GBD3E9WA810_AXZC0UR2hfGCnjmD3otoYOjs9CnHcA8Kk8ngt5Pmf yfjqiDa9_nXB4wThFk3RWLsbh0M.i7EiYh0JaJAZMLdAXVIoHN2mODxMQVaOQeUkdSbBzo1zdsGd e3a7J4d1_C02xwTA7yOapTPy64c1.F3B2PIbVoW0qixXrHNmk3_uuY93zgKcNiW37JZj3A0VoLoO yZ6DjM6F8LPyJVedeOrZehefpOZsws.FLs2OccIVhcx7M1w6H3nGZ0MLRZpm0tyqQyaAnI127YtY 0YDgXofkOBsxlZEwWmjj_4_tzeGmdmoGuNBRDyfIx8bLBj_Mfprtn7RGNMCs2b1wssLkQbx7pL67 zk5OzXvULXNrCwGCTmajZZCxL0o_oYlPj9aQR3GQ8krUVVjeopW80aCLBLNjxpeLMzah0TLYGwT7 3mdkwnVe4IE9DK7_GqZwYlTqZ8a43SuR5R4Yjjmwm2F8RP8r3j7w_NLf7B7.sJJy4aCvn6t5iiWe tWkhy2CqXVOnGhGjsmh1EYA2vyAS.dUR4TC5lLITH40KOFdAxzECznOc1PtjAj3e5R2hUoIMnZYW G4wRmwPmpswPXr9ezQpm.ALlG2u9a2rrep6Cc5KejtqhlMmnCkFi7.nRM044IV9EvA2QrMZ_Z6Qb OWAJ0Ubt8cefX3jMPVDN2PrLi1c_PN9U8NwK5e5iB0tbBb4sQx7CBwyOuRPyDTEVz4sgKYj4eUZU Do5p4YYxJ4PW2nJK1dOyMuP9KKeOcEAinqRFT9M7XQqY24tRPqcDZcDjM8ITvBVOcqYK7WQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 12:28:29 +0000 Received: by kubenode572.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 5db36cac940f6273fa794232fbf1f177; Wed, 05 May 2021 12:28:27 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: ZFS rename with associated snapshot present: odd error message From: Mark Millard In-Reply-To: <4ddf96da-e7f7-663d-8539-04f91297389a@FreeBSD.org> Date: Wed, 5 May 2021 05:28:27 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <5294FCAA-14C8-45CB-B34A-B4D76F70AA8B@yahoo.com> References: <8335C81D-B83C-42BC-B296-C05FAEAE538A.ref@yahoo.com> <8335C81D-B83C-42BC-B296-C05FAEAE538A@yahoo.com> <4ddf96da-e7f7-663d-8539-04f91297389a@FreeBSD.org> To: Andriy Gapon X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZwwv4qmXz3pHh X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.30:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.30:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.30:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 12:28:33 -0000 On 2021-May-5, at 02:47, Andriy Gapon wrote: > On 05/05/2021 01:59, Mark Millard via freebsd-current wrote: >> I had a: >> # zfs list -tall >> NAME USED AVAIL REFER = MOUNTPOINT >> . . . >> zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 117G = 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm >> zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style 1.44G - = 1.44G -. . . >> . . . >> (copied/pasted from somewhat earlier) and then attempted: >> # zfs rename zroot/DESTDIRs/13_0R-CA72-instwrld-norm = zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 >> cannot open 'zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style': = snapshot delimiter '@' is not expected here >> Despite the "cannot open" message, the result looks like: >> # zfs list -tall >> NAME USED = AVAIL REFER MOUNTPOINT >> . . . >> zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 1.44G = 114G 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt-0 >> zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0@dirty-style 1.44G = - 1.44G - >> . . . >> Still, it leaves me wondering if everything is okay >> given that internal attempt to use the old name with >> @dirty-style when it was apparently no longer >> available under that naming. >> For reference: >> # uname -apKU >> FreeBSD CA72_4c8G_ZFS 13.0-RELEASE FreeBSD 13.0-RELEASE #0 = releng/13.0-n244733-ea31abc261ff-dirty: Thu Apr 29 21:53:20 PDT 2021 = root@CA72_4c8G_ZFS:/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/ar= m64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1300139 1300139 >=20 > Cannot reproduce here (but with much simpler names and on stable/13): > zfs create testz/test > zfs snapshot testz/test@snap1 > zfs rename testz/test testz/test2 >=20 > All worked. >=20 I've noticed that sometimes in my explorations it has been silent instead of complaining. I've no clue at this point what prior activity (or lack of activity) makes the difference for if a message will be generated vs. not. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 13:10:09 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1FE8363E690 for ; Wed, 5 May 2021 13:10:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-54.consmr.mail.gq1.yahoo.com (sonic307-54.consmr.mail.gq1.yahoo.com [98.137.64.30]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZxrw0QX8z3qsW for ; Wed, 5 May 2021 13:10:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620220206; bh=ZY4QfGsU7CN9D8nTDPfhWWR8AaL/9Ku86a5h9wMdbEg=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Zpg79N+CUa7AQ1cGxoJ4VRbkC7mNtajVB/v2w9oTw1rhV8LABrmhktF4UvHDA88yFMt/kacFCIDzlGVhPH/bBhBJL6bBDuFbASbCkvCvt79vuqZ5GlI3SZXDFiN2wgjk5AdHPHI3oeI4Ohg4cJo+YPY0xoIkWH0wUl8zUaEwE4gjQ8+46L6EMY4Ka3FvXIq5FZgrBTdPtRo8OaUvxRn1ITGqhl8b7na+x7kC8uRWXL2QzQBil0xUp24SS5854cDxTtq5HHYXW+34qgQ0HSx/FvnuAqqIkTsONs5rDwIUm/igMColJQiDtKWOEYbcWuRcFhF+flTAXDO4KCHN8X+dHA== X-YMail-OSG: nBUbTQIVM1li.Vc0XIIHhwVFOncw9SNALRSm9eqBkzX_Pu5EcPkhZ65sq9ANjGT M23mejif7C4v4fyBEec.lhIdj3.qm0J5lRH2u3WFJPS3dqANLSrsuvYm6EAZBDJHaI.iA1HozSPY WMW1E9.ulwEWxR_Ai4UVZJcDy0nNhIs49F6L25US0NPP80PigExay2sYw1VR0XDLCphd21h37FvJ R4u8upAp59EB56O1hyF0uTFJfdmT.xXIo.g5DT_NoOiVmQ2hY.4MGCL7xfs_dTCZsivnqduvcsia QGFD10_x97pMbmxP96rvf_3LxrEa.Hi4gulD.XqWlR6nKndr6f6ePiTl25B0MkovGVgmPSA2ZzQb VHSyAfNkuaSJi9vrinYCWbjLBAyySbZfYGQp4Bi_nN.eia6I3Q66ZA6nRXZsuQ2CuPIKAUqjNRaH TWvy1y.TlkYqUgd07Hlg2MhSdM_YgUaZTs51S5DwsKFdTYOl9J.KwNUHXXgr5k1mQlCxyfP5gqJ0 Rh0mibccmXgIzXM.XKHhrK1sP9pOyZNcLsaMJ5k.Ba2jgdzcLna_naaFak8ZgpwiHKGPr5A6jNIs h4dbTXuhI3cYZoHMhAzbNy5no9L6pK3uY_onRm616s4jbrhrRJU6nCzd7S37WbxYj.reXv_huR_Q pkMh6IxoYoEwTAXM2ssfrxbuRgvbcAe96OueIGnTYqwlctPEHv9sES1SZ4m.WkE00G7FyZluJNlH MRysEkL.XMv63xD.dgPQvDj8aCJIt8qCEvgeFmA1NuJdEj8UKB9ehdz9BoVmkJ1Mueqyv0p0.h7t svyro55QLDGlk4cYEl002t5svvleA35.7V4DEzrpFqqkxyMMZu5jXUuaRHmsnE5UeDCz.UDa5Px0 A94Ywj1ZRZG2X3TfzkUwK5AkGLE1gdoQJWMXwdRGtaesfX7my8bndGheyB5j4yLY.DCZj6mLogW9 M_h0ca3zzjx5R_vDvevpELy9embNIMyqlxlSI5S9kvVQdI6s.Y4doEl0FT2VQHO_J_7ccIFy74iE qjNCM52GftmOoukVJjfccXkSArjEqTL4cFDMOkDOmoKJmfInDrdHt7S..aSp1Huywaw9rA1GX3zp mS_EujRvdVhESoiycZO7xyVRhHNU3545hTykvFTdTntZP5In7s7PGioRslOkdKXAfuglx0RMNdbG vApOISsAAieCg13riciSC8Dc2L88Mv3RQR7qisB2eN4OfvANTO.7h9wQjAp91rKniVx5M_CUeH36 bQG61DzNdE80aFWISFy3nidhasp2gG1vCEOtfPZIhT7oGmdaz_p43AtkbOX7XA20q3uO5sgNlrKd p1u0saqiPXWCN5AFHkH9pjujaPOucHZUtR5ScIqIn7lA6AfR7mjNsfT30bHqz5kY9U6YnS6Y8466 QiPuarI4UgmtydzNdjz7CBlQ5hODv8PRh7IqJb4l_6pexN7Wf5jlnUQkPsZSulbY2dI5olv8s8xG 1fa3o1K2WRLqI2sosCJ694pRCqYLZQxNtxhECSuiYq1RuhFEAe3iNNMRpKhlgvGKFKZmDeXBB8Qj PgVfuDmrhj3BpYGLvugqcFnuyjq.vgt07XEQn4dR4AgmJQsE2ehIPVQZhSm0JzlGneDpFEeCKMD5 1MatkIWT1JjMV2AXwHCuif3jYA1P.HiMKKhdkLOVHe5GhAt9VpX7rX_T92x6hHXZ1i6n8.9BsFb4 yjcNMGSlIyg9y9Kma4Ny1PIIYasjdJ.9IET5qi79JNIwEwmvhi7GjVgGb5LX8uL0DpfGlnpvCX4c HlSYTDSss2En3EnI4DUyhNGIand_kPnocDiEhnIsld523RVvQ_qv5tVDkYavtIVkXhmjqXwWoQ1v KojQA3mUQAw0CzSg0ygJzsPGhlu_8MhaTiH8O_ndmejfigOGaPjI2q_Bm7XseKilu3ux_glrTHG7 vEJmlUqMt2l5LKnwpd_ntUbFTbRvxpZ5S3hV4p1GvA5O3P0wzNfBeER3yemzteq9cvyQLxEi5x9j j_YPOtWnrPYWhtRZ8T5CiMVFuRGPMIUKIYDGl6faQItsiJg4hy5jvynMzScL_4woAEN72mcWwyUU _83DdGLbVSAQ5f1OxBX1kqIhRI2rqN5..zRbnooZcC3HuE_V.wFcqiOpN_Y6sP_Bc.rN25aWnITY Y.RaoGF0HXZsjXkTESIbljwHhliamKkrphKMpQkej6WFAbCTkZalQtJPzx.hmAqy6cVbOJleoZfg ZgiUQYsk2iiStt96U5xAXXob1Cb99Nv0vXvqpaxRvae3vbM0GkxTDOAEZ6_X8kff3DXLNFZTMZ2F j0FtiVPpb42PJXaNvC4a2J3F1nscDKz.zcuTD5uaTck06Q0Vyp32ECF9uFp9rCVmXJblN2Fv0rfD Y91xC1UAcMQ2fJIk3V7SuofLPZB.T7XQIDwcpWASWzdlHkhlvoD1Z3Xdd8YKejhpNdiH4tnpF.TL DoWgNAq5Dx4RqpZI.muoW2wX_5rqP99JnntM2hndKCyJrjAQ2C.SSIW74VFshpfs_yPBqfUsuLY6 kg7lnd1AAfkUOshFpA9ZHyl8D.W58rxEmfLZjEFELZqbM03mBHeNyV_Ml3OimYD416EbmDWfujIX cqvF6udbi9cdkhvRsXlzG50Sm.7OaMlbwS_zMt1tQEx6Ip.wTSNZVFYS9vDcd6COw0evr1N2ttn3 As98hZGu7gRq9tZeRrLY6PSRfSvD17wYkryNZkehXel0LySW5nl04JqjkTfXj7NZjKa56ZVLk_sp hE9YGTuzuSplC8loTUoYpmhOZAZuwhq9KUHfNY.7eHQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 13:10:06 +0000 Received: by kubenode512.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 8f9d596d715241f5175657af5d33c051; Wed, 05 May 2021 13:10:02 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [aarch64 test did not reproduce the issue] From: Mark Millard In-Reply-To: Date: Wed, 5 May 2021 06:09:59 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> To: Ed Maste X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FZxrw0QX8z3qsW X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.11 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.61)[-0.606]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.30:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.30:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.30:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 13:10:09 -0000 On 2021-May-4, at 20:26, Mark Millard wrote: > On 2021-May-4, at 13:38, Mark Millard wrote: >=20 >> [The first buidlworld is still in process. So while waiting . . .] >>=20 >> On 2021-May-4, at 10:31, Mark Millard wrote: >>=20 >>> I probably know why the huge count of differences this time >>> unlike the original report . . . >>>=20 >>> Previously I built based on a checked-in branch as part of >>> my experimenting. This time it was in a -dirty form (not >>> checked in), again as part of my experimental exploration. >>>=20 >>> WITH_REPRODUCIBLE_BUILD=3D makes a distinction between these >>> if I remember right: (partially?) disabling itself for >>> -dirty style. >>>=20 >>> To reproduce the original style of test I need to create >>> a branch with my few patches checked in and do the >>> buildworlds from that branch. >>>=20 >>> This will, of course, take a while. >>>=20 >>> Sorry for the noise. >>>=20 >>=20 >> I've confirmed some of the details of the large number of >> files with difference while waiting for the 1st buildworld : >>=20 >> The 4 bytes at the end of the .gnu_debuglink section >> that are ending up different are the checksum for the >> .debug file. The .debug files have differences such as: >>=20 >> =E2=94=82 - <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/usr/13_0R-src/arm64.aarch64/lib= /csu/aarch64 >> =E2=94=82 + <1a> DW_AT_comp_dir : (indirect string) = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/lib/csu= /aarch64 >>=20 >> So I need to build, snapshot (in case need >> to reference), install, clean-out, build, >> install elsewhere, compare. (Or analogous >> that uses the same build base-path for both >> installs despite separate buildworld's.) >> This is separate from any potential -dirty >> vs. checked-in handling variation by >> WITH_REPRODUCIBLE_BUILD=3D . >>=20 >> My process that produced the original armv7 >> report happened to do that before I accidentally >> discovered the presence of the few files with >> differences. My new experiments were different >> and I'd not though of needing to vary the >> procedure to get you the right evidence. >>=20 >=20 > The two aarch64 test installs did not show any > differences in a "diff -rq" . Ignoring *.meta > files generated during the builds, the build > directory tree snapshots showed just the > differences: >=20 > # diff -rq = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr | grep -v '\.meta' | more > Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c differ > Files = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk and = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk differ >=20 > # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c > --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 13:45:14.463351000 -0700 > +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 = 19:04:32.338203000 -0700 > @@ -4,7 +4,7 @@ > ** Words from CORE set written in FICL > ** Author: John Sadler (john_sadler@alum.mit.edu) > ** Created: 27 December 1997 > -** Last update: Tue May 4 13:45:14 PDT 2021 > +** Last update: Tue May 4 19:04:32 PDT 2021 > *******************************************************************/ > /* > ** DO NOT EDIT THIS FILE -- it is generated by softwords/softcore.awk >=20 > # diff -u = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk > --- = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 10:55:26.030179000 -0700 > +++ = /usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/= usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 = 16:14:24.513346000 -0700 > @@ -1,4 +1,4 @@ > -.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 10:55:26 PDT 2021 > +.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on = Tue May 4 16:14:24 PDT 2021 > _LOADED_TOOLCHAIN_METADATA=3Dt > COMPILER_VERSION=3D110001 > X_COMPILER_VERSION=3D110001 >=20 >=20 >=20 > I may run a 'target cortex-a7 (so: armv7) from aarch64' test > next. That was the context for the original discovery and > report. >=20 >=20 The armv7 builds and installs get the same sort of diff results as the aarch64 ones. So it does not look like I can readily reproduce the problem files that had differences. Given the time it takes to run the experiments, I would not expect to reproduce the problem on any given timescale. I'll stop the reporting as I go along in my activities --unless I end up with a repetition of the problem. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 14:11:39 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2293263FBF0 for ; Wed, 5 May 2021 14:11:39 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZzCt07Fqz3tlX for ; Wed, 5 May 2021 14:11:37 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 654B05C006E for ; Wed, 5 May 2021 10:11:37 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Wed, 05 May 2021 10:11:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=xCfZvW7oceeJZOuVUHnxepPZR8D X+qEXIz2E7OWzViI=; b=UBIDo/kT0NnyDg4r+Wiohtan3QfwFoosqgqrtIZW0f+ GJmeVmIXJy+r1SZEzaVmQb4LGankfx+FXaVrgAFfuAr133EWIgKBtoZoNZRzpGPI ozLpSyNvmTASYYtaYyMwCUx2WIbAcIYlLmQYxsJ1H4BoISmjFMqTaR/OukYkjGmU 1wVaypogaMmN21Bz4duH+RcT+2mFUFb32sVDjS5ZtOK1dTwwVKA5OywzB4XYGVfO bjxdFyTAsAUevRh+8kzob07jntKO4Vnc85c/vPUgTbo1gyIeXPnSHTbwXNmyTn1m z3kyxcEDGjLjO6RRS1b26XzfgReh49g7uLPnvHOlxBQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=xCfZvW 7oceeJZOuVUHnxepPZR8DX+qEXIz2E7OWzViI=; b=jLQjUyoaCuwyYTNjulx7sy yJKCoNThRAlcb2ZYRSZNEiGNCXgnZ7+75Ho1PaQaXEsjBfGfnlhcEGfdsLDjGDB2 CPgBT5IvicStXlcLFBVVLu8qKVYfCEPT52InSCVB5/fjLsNmb3Tr4X01ywxq+dMz aLOdMRdvPjBARgVBm5HtKC7LJISD780QLgFMGM1Oz14KZ4VmmRUaXZKGJ05lOM7E UVZySw2ztmiiX2+DoUx4blfApPXiDItdHtpGky/FlJ2ggHSJkuR1odyAyAWlsstM F9tJiE1GegAmExEu395Q9816gviq+q6ajPhZJuuViAL2An8+BbFW4jg4KsHdlytA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefkedgieelucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucfkphepkeelrddugeehrddutddtrddu feelnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepth gvtghhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from cloud.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 5 May 2021 10:11:36 -0400 (EDT) Date: Wed, 5 May 2021 15:11:35 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="qwQu+c41Nk2cVHyv" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FZzCt07Fqz3tlX X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=UBIDo/kT; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=jLQjUyoa; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.27 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[66.111.4.27:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 14:11:39 -0000 --qwQu+c41Nk2cVHyv Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, May 04, 2021 at 02:37:30PM -0700, Mark Millard via freebsd-current = wrote: >As I remember, I had to use bsdinstall's DISTRIBUTIONS >environment variable to pick what to download in order >to get MANIFEST to download. Otherwise I got just the 2 >files (base.txz and kernel.txz) and the complaint that >you report. Thanks Mark, setting DISTRIBUTIONS env var is next on the list --=20 J. --qwQu+c41Nk2cVHyv Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCSp48ACgkQs8o7QhFz NAVicxAArmeqqo1VSk2nHj65IHzBHs/T6CQ9AxdCassskHoEFk+WRTWE81IRYMsi sOwfNhxYAwSQb27do+obvNRQAMpPgg2W7EosQEJQou+4IlaEIqF5NViPHyqrgzip YJmj4nE0FGYw0CZbPdSX+2QF7Y4mEkO7n1FByLuYIPznolPLpu90162y/vC3tU1w pixfAgbMZ7m326EVmad9KtcX9Np/QPQAfNiDau5+Ww+e5r8QeWIS93rsLxUSpbaX uUPqZ+x4KEb2tq+cjfXNytAxv5Vyg0iUbuzDr+xrZB562qbLWnybGTbZHKSX8RBp SuUrptlglAFmgxjMYiAGoCGdxHcVrhoRosfqRkkmIOTRwdgBfWH/iIbfis88kyEp 5atOJRGT70+lMoapELrEvGd91U78SRLIUKz0yNZnz8WwcjrNOZf409+Vf+t2pwlZ dqS955OlaArpA79XVUt1ip/ZZ26izLL03BTEt66xPWRoxq78sYAHguu72uU/iui4 g/8HUSzS7hUHRuIma7pgf+Aha/7yBpY8hXsVcxVLVl/YIU3VXhqVxFFjJ+mPUxCj 45diIFGa6rUnNtRrRp2QNd0r8AiPuzpmvPN9fP7aVgVFVxivMDYN4KipvU8bpg/b yoUuxnVABr3CU6a4zBnljwiQU5JOk2ImayDkaT6fjELR7unFNlU= =R7rJ -----END PGP SIGNATURE----- --qwQu+c41Nk2cVHyv-- From owner-freebsd-current@freebsd.org Wed May 5 14:37:22 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 08C765F89F6 for ; Wed, 5 May 2021 14:37:22 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) Received: from www442.your-server.de (www442.your-server.de [78.47.106.34]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZznX6CsMz3vjR for ; Wed, 5 May 2021 14:37:20 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=daemonbytes.net; s=default2011; h=Content-Transfer-Encoding:Content-Type: Mime-Version:References:In-Reply-To:Message-Id:Subject:To:From:Date:Sender: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID; bh=blDxxTbPBLGBBS18I5r9WdnwOy8rCx3omrmpmWbslxc=; b=MmOLjaygMUpWmSDi6y9j5o1MBH wFrKxIbC3RoEhKNgZd6IrdYtvfIJ3oOXzn9CG6ug12K5tmhR/4rHBo9FdOBYfC60eGxB1YUckY358 h0Q6zsb5xLtzlX5ef6cWZA6/NTT9TrnKf3zRtSHB7ynqXbinDhSrnIi2EVKkzFzqM2egJEQr6niCO AgTSBX+3HLKovQIcjsVbkJietF7kT/KxV9Z/A/I1giCltnQMa1db2iQVPdTjYa3bdw79xtQiTk8Fk qUOn267QCW3lbP67Z/FiUNdrtwO5gQ3xyDTZMfP7cQDVTY5+pG49PAxL3v76ro+Pee43fWQ7JwsyZ 0DlLtImQ==; Received: from sslproxy01.your-server.de ([78.46.139.224]) by www442.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92.3) (envelope-from ) id 1leIeM-000AF8-HU for freebsd-current@freebsd.org; Wed, 05 May 2021 16:37:18 +0200 Received: from [2003:df:9f4c:9400:c188:7d6a:9c5d:c3d7] (helo=beastie) by sslproxy01.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1leIeM-0007g3-Dg for freebsd-current@freebsd.org; Wed, 05 May 2021 16:37:18 +0200 Date: Wed, 5 May 2021 16:37:12 +0200 From: Daniel Dowse To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-Id: <20210505163712.934be4dca1e309ab2d094598@daemonbytes.net> In-Reply-To: References: X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Authenticated-Sender: freebsd-ml@daemonbytes.net X-Virus-Scanned: Clear (ClamAV 0.103.2/26161/Wed May 5 13:06:38 2021) X-Rspamd-Queue-Id: 4FZznX6CsMz3vjR X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=daemonbytes.net header.s=default2011 header.b=MmOLjayg; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-ml@daemonbytes.net designates 78.47.106.34 as permitted sender) smtp.mailfrom=freebsd-ml@daemonbytes.net X-Spamd-Result: default: False [-1.79 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[daemonbytes.net:~]; NEURAL_HAM_SHORT(-0.99)[-0.994]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.47.106.34:from]; ASN(0.00)[asn:24940, ipnet:78.46.0.0/15, country:DE]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; HAS_X_AS(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[daemonbytes.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[78.47.106.34:from:127.0.2.255]; R_DKIM_PERMFAIL(0.00)[daemonbytes.net:s=default2011]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 14:37:22 -0000 On Tue, 4 May 2021 20:22:35 +0100 tech-lists wrote: > "error while fetching file://usr/freebsd-dist/MANIFEST : No such file or > directory" > Hello J. you can try to run bsdinstall with script option. Create a file name it e.g rpi.bsdinstall and put export DISTRIBUTIONS="kernel.txz base.txz" export BSDINSTALL_DISTSITE="https://download.freebsd.org/ftp/releases/arm64/13.0-RELEASE/" bsdinstall zfsboot inside. Then run bsdinstall script rpi.bsdinstall and follow the dialog. This to be said, i haven't used it with ZFS but with UFS to create VM Images (amd64) successfully this way. Daniel -- Daniel Dowse From owner-freebsd-current@freebsd.org Wed May 5 17:10:21 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E82165FD1B2 for ; Wed, 5 May 2021 17:10:21 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fb3B51yFTz4YFp for ; Wed, 5 May 2021 17:10:21 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id DAD795C00E3 for ; Wed, 5 May 2021 13:10:20 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Wed, 05 May 2021 13:10:20 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=lwE03+IQXgn0YUbON0t5hhrMIAP IOSTHt9Y9Ou9F6Os=; b=a8ofRs5kLVFEPOY2Q7oapb3rkfN9uLo9bpLFnoHJ25D rXbHPIvJTrq3Gdb6Hn2uwDD67jCDBn2UJfYAtVWiOWWJFvJrnceVgo+s3mn+P1FX bZeEFm4Z7KGCa9O9Po2LYt1wCxu8CxMDUWnjx64XQSZZ7kQE82G4Q5L4tS7hlaNK 8Y8hfBgxb/i1IVc8rDpPK/MJJfnzlFINBRZwtLUVkNWTsOqujfRf4Llea+xbLQMK EGU/SA0FvD8MKk/X5iKeYts0hcVa6/R5+5afboEBBqQxFvBPtSE0jhvj1qnfcFlL 4CLPZ9tvaTumm6WhSgq+RNyY8K84eGjuiBeonpb46aQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=lwE03+ IQXgn0YUbON0t5hhrMIAPIOSTHt9Y9Ou9F6Os=; b=hTZ7pV/Ovlhr4C9FGX2p3G J+v3ffI3ZRVNRwZPGuDqcJ1a33NXdJMWADy5Wgqx0FatILQyPmG4bcrXD4zEYnaA QZPl5XAdDRG+jiIHpNN4RiJxA1oe/K8JZ6LerpFF/jwciZvbyWfobHQL93plN69p rCyMB+U3+W0e7ML2QCXzo2PTzNgN4GmsxXEGGPbJcavN5rLmnx5/OkkSz0SfaVF2 qKpoVNHGYVnJzAVm0enmWNy6MgN76ipPxcbEwBzxpmo+WknAvp1mPYGG9yhvo6k6 oyDT88uWEIYVOWu/V2NPrF3iwlyhsCWGRpxG9gK3kokLv2E16ZZELGtr0HraGr5w == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdefkedguddtiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehgtd orredttddvnecuhfhrohhmpehtvggthhdqlhhishhtshcuoehtvggthhdqlhhishhtshes iiihgihsthdrnhgvtheqnecuggftrfgrthhtvghrnhepkeegheevueelvdfgvedugeehke fgieetkeeujeejgedtlefgudfguddtieekudfgnecuffhomhgrihhnpehfrhgvvggsshgu rdhorhhgnecukfhppeekvddrjedtrdeluddruddttdenucevlhhushhtvghrufhiiigvpe dtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdr nhgvth X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 5 May 2021 13:10:20 -0400 (EDT) Date: Wed, 5 May 2021 18:10:18 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: should bsdinstall work? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20210505163712.934be4dca1e309ab2d094598@daemonbytes.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="Rcj9uFKNK802tSTm" Content-Disposition: inline In-Reply-To: <20210505163712.934be4dca1e309ab2d094598@daemonbytes.net> X-Rspamd-Queue-Id: 4Fb3B51yFTz4YFp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=a8ofRs5k; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=hTZ7pV/O; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 17:10:22 -0000 --Rcj9uFKNK802tSTm Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, May 05, 2021 at 04:37:12PM +0200, Daniel Dowse wrote: >Hello J. > >you can try to run bsdinstall with script option. >Create a file name it e.g rpi.bsdinstall and put > > >export DISTRIBUTIONS=3D"kernel.txz base.txz" >export >BSDINSTALL_DISTSITE=3D"https://download.freebsd.org/ftp/releases/arm64/13.= 0-RELEASE/" > >bsdinstall zfsboot > > >inside. Then run > >bsdinstall script rpi.bsdinstall > >and follow the dialog. > >This to be said, i haven't used it with ZFS but with UFS to create VM Imag= es >(amd64) successfully this way. Hi Daniel, thanks for yr input. Managed to get a little further with your instructions, but now the error i= s=20 "no root partition found. The root FreeBSD partition must have a mountpoint= of '/'". This happens after the disk is selected to install zfs-on-root If I remove the zfs element from the script, re-run it then select auto ufs, it gets a little further then fails at the point where it wants to alter the MBR, with the same error message. Maybe I'm going about this the wrong way. What I really need is an installer. As far as I can tell, the only things available for arm64.aarch64 for the rpi4 are bootable images - ie without installer. --=20 J. --Rcj9uFKNK802tSTm Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCS0XIACgkQs8o7QhFz NAUTNBAAqG+MrmH1jAHmVLDrxE6jmhxE2tgCp6vtpXAygOOoInJDyVTQfqc1nj32 J5oCS4NS7cdtGKwHDjOKxYw4uXV87ulV/ZxCYWKxJHA7ybpkXIGgNyQE9ejQRQDv DdFtVs9LfbM0JwzNZUiitfUffLO0DgTo9qQdBVePYC7i+gpyzOk1lN6lggy7WemQ 1tSWrm4Ef/9IgEceISMFSQi2aLCou2TuoUaZ22EhEgAfjzXYx3vhR81Lh7lWH+gT VzrN0ee9nSjWcZegAqtkt7ZkwKf6SsOS336xE0Z77sJJjTm1cR3E5cdBJ8UBCOQ7 CiQjrFXY/yl+sryhGHIAAb6qIqTQQQvSHxi7YVIXWqboQcbYO0+PxSqOoJNPnAGy p6DtRQknoj6KzhU+swKbRBdA99FevkV4Edef5ACV4uR+cc+t3dIVIY8voXHOPFwJ kEyWZiuKv9ZDety5zQjcBnbpcm77UgIT3ZmsSzXEItogRJzlkmQH3wNNdms0XE7S 4hJI3t1KJBaqm2LY8wQGLBVtdyl0G0en1Go+TndycowSGllQY4XprQb3HX2WbvEj SLUEX2yGMoaV+Q9tnG2LIStlPOiT63mcjDfpRGIZvxyVe5kBG+2bDgw+t54ouka1 AKO5tzhgSaz4CjKLfBxVxDx/9OVcz0HRqDfUMnf29n+BGMzdfAs= =sWjW -----END PGP SIGNATURE----- --Rcj9uFKNK802tSTm-- From owner-freebsd-current@freebsd.org Wed May 5 22:53:52 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 287B9625B24 for ; Wed, 5 May 2021 22:53:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbBpR1Mbbz4pky for ; Wed, 5 May 2021 22:53:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620255228; bh=CFPeakQxkhhc43r4iHuYAJdyvxoWmMBxR74Dm+NLCPD=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=UlhrWHjQznMUWDz3O7wtbEwv4LtGBWRN0YZ8QyLzSSw5fg5hX55d00RzcSUbUMHFjfey+UTQNrFA9r1SSWc3JVS/TXIvsOYgecpSrAL2vU6Jlgz0NCrKpXhbrIK1zUQxCYCcRgsDmpOch0yc/kjSCd02sl/7tgmnI2rvekynNEe93a+9jMPOIETC4chp5IJ3rUwvvRqcs0Sjz9lfEDQPUA+Dc+JC4nP3uVjyAfqr3wEQwIpRWmMLnnRfQvzEtdBqQTVpqgOMcm9wYTfBXtUQ6Hl0eaFqTljcJnLMjzQG7qq70tso9+RHzQXT1gBsXt7LRJ+fO7tVO0piCY3QWLt4tw== X-YMail-OSG: hF4mTBgVM1ksfidG9AovH.pRaTzRhg4yhsWu81L_B6ySGHtZXr4wtt8gtTPBACv Cq88SdvEd.vg1qG1GW5ih7BNY9KMR2ttv56q7lOaESuSjHlK_BX9iom._bbUM0JbeJWVcSafR2Gz 28fcJn9Auq6o87GmWTtcZNxjTx0_rJMlkNYicO7NcTc23gATEB9DSHb7X4loifAZ8IClnc8gjKI0 r41OMAkL7Cjbz2K2l74pjQL5NwEaJzRIz1ID1PdxN86krFo3O7jO5qBQ6zzqDr2IsYF9D5nb8Pgf z8mIYctADdNtoWMkksuFo.o2uXcTWLQYhCxb1SDcSalPB2BQI9Gy88zfodfRJL4CyhAPLzcBU7kE HMNVL9zIls4AMESZG2clloHUXajWqTtGoSLV5Rhv0gr7Q5STvd6fGcC6elgZUA_j3iNiX63587c8 OCuKXUxU39_bBYsc2LfKO4MHuQsQjLB6nZq1CBEmNawNJ0w2l02klBwY6wjIvh631s9JdRlvOqhF Oc7JQJY7MjKhMfSgvi3d9iEAxlt70RFY6qSmcxva2qJ4MGQGg5l4vxbgBio5qgifn4ccBKdIHsRs Bij4sghDXtxtwyb3B3NOtxn0dQZBCbVrLF4hEf72jOUu0T2e7y5xcUxeIjfh4CkVghQoNqZ4Yjw4 00oZbaUNKDegUxMA4OiQSRLqopjIZszmp8aKelhW7BUoEuN.Gp0iQ2Ia2yFWz4L7wdcSww2gheXt ZQpFaq7ORrOoPbKi_w59OSe0_S.BW95BlBen8F7L3OxUZW4.BZXPj4w.njjIydXvouIh.qWO4DfY iJQePzM.Kp2JpvzLnquq1z5Pd6OtH2veFwW3h5rFnukoJZkChXbMNrXal3Gznnkj0mAopA1c4bDq KxjifQvYODT3NUGyeg_gvCqnllIhOEAPiH80VxbAt.EddNW4huciKaKpvR.RyLs6.nnF6zZ9t8kE v54u876C4XidT44aRbfP8JOS39qa3GnFULfx.nN3O9YQhA4eHQ2L7IMv7BR6Ki3Bkn7wBKPX2SL0 1CLKl07_IVtuhU9YodWwbtbZMpiiV2SgxP2K8UZiKVZ27IygNM5qn_PWNOdlmDsIva5VcCmcfL1M c0TyBvY87r4d2jYpjiMZ8cHkS1jrEGThJlWfZFJVvnYvq4JH4oL2Fz1GcghUWUJUMrPd9H40HJzO DrGcAkhKezCaiSDQ71STQvt4zI2yEWXWh5GxkcPeUVioJM0QyhGzliH3FLIzJ5tdhgN9_KM8nzYM wed24Ch9tS0DIsHCfCQYg5I6gqJyy9vzJAHJM7fgMLu6tkw7W0dUEoCR2see73XQIRzm5Iz_fF3M WQ5v8VJT8HQMUf7Tseu9.qXbZUQhQl3vYyoRrEyKK4wBeX_fofjA8nZtgoO.pn3IerK1eZW1pcVu SIkMw8n1jhTzJZf7B5SndknMBUNFr4Sf6U3I9xLtPCZCK3kGTqoPrz3mp3kckYtRR1ZAMgeplPys R4yPZnnCMmgzFTcNWolTola8EDg.8OxECPsNRxnJOvSb2aBTcXcgzmThzx0I5yB8QU475IfMIlVE IVjfUrElJN_WP6r3kxF_WiekTYzf0lptGMjrBeUvH5RN5S6867RyltAbaLDb7RSs1V8Z7L4oZcK2 7MIDfQTLVanzmc3IkFPRkoaFTzCaMAQj8qps6Rr48x5nmDL4U7w.yJlWhJ3OQGEe2JdDk7hFC7uN GcrSjfVrPUNfZXrmVSdbFyigZbs8AF0ZbuaiuOd8ePSr8pOB0WAXvBTViLXRHv9WDPVcdKpkJ4nT inKA_VU0t6nAx0b8hCc5a.LfaKSLZFqOo_LI9nF.9tKVqVrTykOWARRPy2gwrViMQYXF5CK4BI1d AYYEwGYmD.hh3VSxyLQlYWc8Zug.Cv9kpvdMOKeYnLw3CIgo2WSFRa92UrR5wv2t3iQU14HC2tEy i5kRcfBR.vKcD0MSbcPnIph3Ln2PZZlcDbE4A3KeQTLDQuRVigj2v46VUuEyNj5kcaJ4U8L4eijo 0gbCEEJDXjWgcvpoBKOy.2i0Nhefj5X6ajpwV4kZuFuQEpJnwlpBwPgGIsfAiYb8p_nooxJVeXUY M2eEczZ.8k4mVFJ5S97P9k2uD_pit2CmuNqx_DPeKLGLoKf5OYuakHxhgpN0eEC4grCYAJm7Rong WK6GKYvCORtIWTmr5kddB2PhpUblzM.mdNSO0X8hBS_MeMAQWorMN0T5bJXpyRTSAru6iXVybn1w J9EBjUXJtsZb6tTEvM9biugvCoun2_ehAXnB7ePhcUv_5mWUt_yHTmNTziHAL9IF6Cy1vrM3Ttld GRyIfQPMwDS2LfNP7HkO1c934qpU6COTIRjcpx71aFZEmYvO3ksT.iH4P4YBuXjdZNT1Axz_3f2p F0Bpm6wVKWNPq6HW0_v8ubTQ14wr0t93Qb6uXT4c.ygAwjlOE5tWlwHmbOS0Kob2Qmcq4CK7dnCY Rv_6Z4zG3IN99TqUrku93sxwq4lL2gCjx6ztfa4wKYaWKMZigvojlPHrkEOsza1dF6MiWy_rO1Up y.lOlBeTOtVQDfQdUM56XOSr7urqdPogHE0_i_efqV31Hluf_4HwNjblK2TlA3h6C7gxdIleM97I qkwCyJlLupq5EiZ9Pr3Zvfevwf4tkKGy9yJGYOhV23PWMQolnyg5Bp7zVYtfiYOKxP5lBeFDF X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 22:53:48 +0000 Received: by kubenode513.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 6f17629e21a7be59e78048d241fe079b; Wed, 05 May 2021 22:53:44 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: ZFS rename with associated snapshot present: odd error message From: Mark Millard In-Reply-To: <5294FCAA-14C8-45CB-B34A-B4D76F70AA8B@yahoo.com> Date: Wed, 5 May 2021 15:53:41 -0700 Cc: FreeBSD-STABLE Mailing List , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <3B6DD415-0352-4D5C-88A4-F3D07B082FBE@yahoo.com> References: <8335C81D-B83C-42BC-B296-C05FAEAE538A.ref@yahoo.com> <8335C81D-B83C-42BC-B296-C05FAEAE538A@yahoo.com> <4ddf96da-e7f7-663d-8539-04f91297389a@FreeBSD.org> <5294FCAA-14C8-45CB-B34A-B4D76F70AA8B@yahoo.com> To: Andriy Gapon X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FbBpR1Mbbz4pky X-Spamd-Bar: - X-Spamd-Result: default: False [-1.92 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.83:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.58)[0.584]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.83:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.83:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 22:53:52 -0000 On 2021-May-5, at 05:28, Mark Millard wrote: > On 2021-May-5, at 02:47, Andriy Gapon wrote: >=20 >> On 05/05/2021 01:59, Mark Millard via freebsd-current wrote: >>> I had a: >>> # zfs list -tall >>> NAME USED AVAIL REFER = MOUNTPOINT >>> . . . >>> zroot/DESTDIRs/13_0R-CA72-instwrld-norm 1.44G 117G = 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-norm >>> zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style 1.44G - = 1.44G -. . . >>> . . . >>> (copied/pasted from somewhat earlier) and then attempted: >>> # zfs rename zroot/DESTDIRs/13_0R-CA72-instwrld-norm = zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 >>> cannot open 'zroot/DESTDIRs/13_0R-CA72-instwrld-norm@dirty-style': = snapshot delimiter '@' is not expected here >>> Despite the "cannot open" message, the result looks like: >>> # zfs list -tall >>> NAME USED = AVAIL REFER MOUNTPOINT >>> . . . >>> zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0 1.44G = 114G 96K /usr/obj/DESTDIRs/13_0R-CA72-instwrld-alt-0 >>> zroot/DESTDIRs/13_0R-CA72-instwrld-alt-0@dirty-style 1.44G = - 1.44G - >>> . . . >>> Still, it leaves me wondering if everything is okay >>> given that internal attempt to use the old name with >>> @dirty-style when it was apparently no longer >>> available under that naming. >>> For reference: >>> # uname -apKU >>> FreeBSD CA72_4c8G_ZFS 13.0-RELEASE FreeBSD 13.0-RELEASE #0 = releng/13.0-n244733-ea31abc261ff-dirty: Thu Apr 29 21:53:20 PDT 2021 = root@CA72_4c8G_ZFS:/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/ar= m64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1300139 1300139 >>=20 >> Cannot reproduce here (but with much simpler names and on stable/13): >> zfs create testz/test >> zfs snapshot testz/test@snap1 >> zfs rename testz/test testz/test2 >>=20 >> All worked. >>=20 >=20 > I've noticed that sometimes in my explorations it has been > silent instead of complaining. I've no clue at this point > what prior activity (or lack of activity) makes the > difference for if a message will be generated vs. not. One difference in context is that your above sort of sequence generates the after-snapshot context (using some things I have around now): zroot/DESTDIRs/13_0R-CA53-poud 1.45G 127G = 1.45G /usr/obj/DESTDIRs/13_0R-CA53-poud zroot/DESTDIRs/13_0R-CA53-poud@test 0B - = 1.45G - where my example had something more like (hand edited the above just for illustration): zroot/DESTDIRs/13_0R-CA53-poud 1.45G 125G = 96K /usr/obj/DESTDIRs/13_0R-CA53-poud zroot/DESTDIRs/13_0R-CA53-poud@test 1.45G - = 1.45G - before the rename. In other words, I'd updated the original (almost?) completely after the snapshot (as a side effect of my overall activity). It was only later that I tried the rename to track a new purpose/context that I was going to switch to. I'm not claiming that such is sufficient to (always? ever?) reproduce the message. I'm just pointing out that I'd had some significant activity on the writable file system before the rename. Some of my activity has been more like your test and I'd not seen the problems from such. But it is not a very good comparison/contrast context so I'd not infer much. I still can not at-will set up a context to produce the messages. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 23:40:11 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9410F626A94 for ; Wed, 5 May 2021 23:40:11 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbCqt4Slmz4r2n for ; Wed, 5 May 2021 23:40:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620258008; bh=ZQlwMm+Af+F4MpjpjGpxtAMFZy+B+23qYFBrabkqJFU=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=oEPR03QVjQhCuBdydInQ2yxCw290IkgNj5IHcBaLWAJrhv+X1UGMuFsu/yKcZimHTtCDeJ88vmY5N5In65E0TGSrgjnw2JoX4/Ac37dPKe6nfmLc+5d89w7ThZWp3GIAIk5HtsTOlRblgoFuBjV3JcvW/8ZUPgIJJgyX2CrM50KQ3RzxbOG6WF6nI4Pk73eTO9v9gmTs05kw8nqfCHeYSTOEfh3XQpe36vjHJS30K2BHGq5irw4/prn3+22QVar/if6KOowIvv+Ber/wge5w1hyXX6/wr/XjoC6wRpFmjlgpAInaqIxQg9Le+ud1Yr8AEjKRvfz9qoPgnLAuiyPilA== X-YMail-OSG: WSQIWQUVM1k1Jsg8IOwpWz4IcJThgPJz.PDI8VPYtETUlZf3pDtyona_v38ptMy n9EDt6J3Z7VgJWLlkieuq7_HwsIUvDrtgjFinAtAZ7e0nmra5tFSUbzYF95ENG2ABzlTO47Xq.cc foloxLU9vM5oKvUXhUOn_QSa9I5U5xdKGk5jTknpmAboqDUyeyQQforXEJFrMmIMaoj3b40NQLct NotibOdkeJusoL3IqtLNXFxC5aHuTxFVneEF1ySscIr3nrNlS6eK6XsFYTo2qnu_I_Pzic9vrtDm 73.9_kOkgpcVZqYWRsHnzhfLPAAraVjZ1SOJZt1XewzoOLmf11VlSUSx1LVV3vOlBUiDu5BTIZhL gh7ok13EeQvZcjvrAPpPtH.gC0d_a4teiL6ZVczE6tvjsEHeTc3Na1jg0Hp_BPRK11aAHCmqSBay k.pNRUNrAFJDZTbTSo8r.OIYOvnEo4Q.KRonEn6m0eC21pSxGBb6dsBSLk9dYWZZHST9WeG_ResD .ZSuVmPD5W5YxkJloaZF.82NqmE59Mj.U1v1wVl5XT2Xsw15bWTdj8_s5722U4rl_r9_qigacSCr KaBzz9IFCx.DaKLG1deCDDw1wJ79Zq6xdJ6OEBN_P8okXs723zLGk0kxeJBqM0x4bWfRk060oEvv sbKEcqlfkCofXaX0Rqz33qQQpCnIHSXwgXf_MldURe78FsFa_p06IkJ12YRaaUo4G26hOFb3BgSW 9e8uo8KgBUV86GpY_.JwtSbb8fcpbeLNkMEYI64mDoSlpoDJJh7F29IdFDwETo.AjscJhCrc9q.1 9db44sFQ1AJr02JHB_fkaufgPnx0dtdbR7Yl98ye74J1N4cDXVqz7.Pz9YuAG1KYyXws7s3jWMhe zQFTduAMhMdWoBt7x.NRy7SlYCQ05zMvPsPn6t9H19sjX_nMC1jp7G8M_eaUpgCLuRCR4.uGBemy 3yD0.73GqRdtzrNfaQHsWBtrNhv.5L._E40ZGzCoPozsIcuH5r_e3fe2oV3rNNAiuEW3pNYdBr.b IvYgQRlHPLHoJ..enpO.ZU8tcoXGRLBfX1zcJe4T_.Nulii.VkDJuA3J.Yb1II6cc7Ud77arHHDf hvtaUx4CfnaTprg1ESGOglFeLkMZ.XBU7HMUw9BH1hBhTUg_xXZ8drLyoZ9x7iSHGkQUaMrjgUs6 EvwD8d3Tn0R3qYwkCXPX3_o5X7L4xpu8HhZnUN7QUpACyKGOWUguRxQMDAjfjCzJUqn_wgKv.jc9 hyT1x_87uZOhet5Aclub8fDrOVW74Bq0ff06EYXuY8g99y5.ikF5Zcx8x.1XOAt9wsKglOEZCWVi T..RMf.eOS.CFWfRDoEXouuYQs0hSCmyl4U6YGDdb4CeKfiIOx1MohNT66e00Fv6Ua1htU2Bf4ti 4iG7fy5hE0su0ADOEF0GbPpFE_D6pkMUUGuCQMDVA2f6HAOejaVKvilPke5sAlAzkl6ZfByMnrNH feyGrDFy.vuUP_Hb_6.Z27Gmciw.D5jvgsVd0zuVLdDHKDdcVmP2obf8Hv5LiekqcEREu37jj3HW 5MgmDKk2uL0ZqwAwmTFk8j.qnPvu5FfYM6hs1cxWG5_dVKHcGCDxKD_SVANRi0bsBjPMW3AnlNt5 Tcml5NT25Mxzim3ned.x0obMgWPxSU30IkfEohh84Hpvj_pOL3MMm4knqEcB2nI.ZUpdjVesYHCb ifLAC1kHhdZypY6O4dEHOMKScTgUEwxJayRLpHFtConYLNGE6erddB2B_P6gPgRpZZWgM0GT6XmL 3E7Vb9xBPwo5WrzTEG8c2KcBN_yppSG19r1v1VMu170dJrjMo8xJMjWG.S_qcCHEDGKllhRRR8Vn u_CmCghQykI5QnkKm_DqqodGr7UUfmkT6xorCqlm5mc19Yfmd2suRAi_5ZjX7bC.aMsIiWTQJes_ Zfc.geurwpldWlKggw1TRzXlj5jDt6jVB5dsfhvOQGaQME4rmzqu1UDHOOVBPcSzN3WHKqoUt_p_ b4tgdalqrKeXXbh4VfNGvNK37sT5WW7mI_y4mILH9Z6MNx9vrbxd5070KhB1MQc6zXuDMFHjk9u9 Zzv18QeTSjK8d.LUgSGciVKonyirki54OBfx3lC6pqlf.vKUmFqYq2FXMsuhb237xbipKhR0._qk fJMcoLfnTZ9C3aTmuMK838aeGuGU3rmJIjrHtct3U3MLvQAosl2Siz8DanbtTpWcZ2pt9vpw0aWa FBYQ9kEpZwq7w86BplAGW5V6E1juernCT9o1_TnqIvf.D.7byADFPn6p05DNsdNQ_RwRrC.Wd4Os CajCl6l0a9JaVfWoxC6eE5n.XpZWcGyhG7xcXuc28xK8Yj9MKsvKJsp4orWKVb_b.xfjnOMVjTmU FL1c83rpLijCxYLxRxffgLPyt9S1FdU.MXTpHldX8IHIhNnALh4hEnlF1snRTF9X6d.CbfVXmB6p 1hWKXv6hcNeBjjkH60BF0W21brxP23zLffEKr6U..Y3MH8F09XD2nVcZdeAp1IH_NDwND0aZLbof hUh7N27BZdlnGUepPauyJYw-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Wed, 5 May 2021 23:40:08 +0000 Received: by kubenode502.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b4a0212dbefdb6c1e62a35d42010be7c; Wed, 05 May 2021 23:40:03 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: zpool list -p 's FREE vs. zfs list -p's AVAIL ? FREE-AVAIL == 6_675_374_080 (199G zroot pool) Message-Id: Date: Wed, 5 May 2021 16:40:01 -0700 To: freebsd-current , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3654.60.0.2.21) References: X-Rspamd-Queue-Id: 4FbCqt4Slmz4r2n X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.84:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.84:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 23:40:11 -0000 Context: # gpart show -pl da0 =3D> 40 468862048 da0 GPT (224G) 40 532480 da0p1 efiboot0 (260M) 532520 2008 - free - (1.0M) 534528 25165824 da0p2 swp12a (12G) 25700352 25165824 da0p4 swp12b (12G) 50866176 417994752 da0p3 zfs0 (199G) 468860928 1160 - free - (580K) There is just one pool: zroot and it is on zfs0 above. # zpool list -p NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG = CAP DEDUP HEALTH ALTROOT zroot 213674622976 71075655680 142598967296 - - 28 = 33 1.00 ONLINE - So FREE: 142_598_967_296 (using _ to make it more readable) # zfs list -p zroot=20 NAME USED AVAIL REFER MOUNTPOINT zroot 71073697792 135923593216 98304 /zroot So AVAIL: 135_923_593_216 FREE-AVAIL =3D=3D 6_675_374_080 The questions: Is this sort of unavailable pool-free-space normal? Is this some sort of expected overhead that just is not explicitly reported? Possibly a "FRAG" consequence? For reference: # zpool status pool: zroot state: ONLINE scan: scrub repaired 0B in 00:31:48 with 0 errors on Sun May 2 = 19:52:14 2021 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 da0p3 ONLINE 0 0 0 errors: No known data errors =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Wed May 5 23:45:56 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C692662707A for ; Wed, 5 May 2021 23:45:56 +0000 (UTC) (envelope-from debdrup@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbCyX0Bs7z4s0V for ; Wed, 5 May 2021 23:45:56 +0000 (UTC) (envelope-from debdrup@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 049F0627592; Wed, 5 May 2021 23:45:56 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 041F162734B; Wed, 5 May 2021 23:45:56 +0000 (UTC) (envelope-from debdrup@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbCyW48Z3z4rtV; Wed, 5 May 2021 23:45:55 +0000 (UTC) (envelope-from debdrup@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1620258355; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=rrJ/C5LwQHzaG3LJF6uvUhFGPQ0tjX/3ofQaTQ3CVqs=; b=hb018o/V/uv/88ed98JfF8ar9h5kUbT0P3VpYvg6su6YyuHTnieLVL76rlO5qGWAZI0gqM gUGBdA/jR7AkjixU55f2qzHdUpfF3GarX3VrCkSt/2QckWS4RL+azwYf72x4g8gvkUHcZt 951Vk3YQaXqPIIwHyGiJj2vKmH0iA18Z23uGZYx9+wJ137/BaeksWKmYpX45l/8GRxNkTH 7MJMvZKns+6oQKGiG2s4iOODV9VwLGcG6spVvqaV4A6oNVYneB85zj6GMjIrZ3T+pZa8KM BFfr7IT1sJqHjfT+V4ongiBYArKz/UmsWi0ns1rKs3kAtRX7CkzbG8rhIah0SA== Received: by freefall.freebsd.org (Postfix, from userid 1471) id 827D01C061; Wed, 5 May 2021 23:45:55 +0000 (UTC) Date: Thu, 6 May 2021 01:45:53 +0200 From: Daniel Ebdrup Jensen To: hackers@FreeBSD.org Cc: current@FreeBSD.org, stable@FreeBSD.org Subject: FreeBSD Quarterly Status Report - First Quarter 2021 Message-ID: <20210505234553.br4gjrtkrjewezzs@nerd-thinkpad.local> Mail-Followup-To: Daniel Ebdrup Jensen , hackers@FreeBSD.org, current@FreeBSD.org, stable@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="p2qii6v5xswo6umh" Content-Disposition: inline ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1620258355; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=rrJ/C5LwQHzaG3LJF6uvUhFGPQ0tjX/3ofQaTQ3CVqs=; b=MU47EcyRiUfXLP90bn8A1Wfo7iWT/gxmlkuro27nq8ykDc4XMSFiHkiGrqBe6ItUQMRD60 Pbz5FWTjhrxaC+sLH21G0yznXX3g9+2GWF+L85oWbqEgncM+3zd9tr/hlDd7+h0OSqwgtS x6FISe651Wx6e/6Vl+/ks/t+NqFcmVayujsFPWIcNhLu6gnNm80iWai7Ku372RUFbk3apO x6H4A8gCzBD/tSUWPymU7Axcc4VtFqhBGPE2X6F8glqsC0YWfqKIz4lze1oB1tUREqknJk 7FbPfdSG9nQKEHWhzUGOI7zc8kDgA1Vo9d6eZKGtOrlFRgZA16s/6WcZaHRpDA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1620258355; a=rsa-sha256; cv=none; b=cdwLTE2n5BsWtXU3jDegFsKpakkriJrc8FUrNLh9wDfdx8OYZx0Q2Ew8qi681I9xw8u3Iq 1yD37EEfCd/5BqMyA94hupckDIefHF3vNsZ2jhm10HTd1mXU8qrBX2SVClYDk5lbNGbdzS aZb6tPuG5PiOKoC+jWmsPmqkDRlBakj89C5tG49bkWqKE+E2xPf1iwp64FJD7oennHidxO 8L92Ud+mwCAS2aeQpnxxIexKSVrxt5efA4HzTwDEGJJwjKXyO1ksTqzANZ2yctPn3hZk+L FusqV2V7fRWtqxdJ07jiX3xbaA8SIIZ92xE3ZE39f0xc0luNykX+jAbxAujxUA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 23:45:56 -0000 --p2qii6v5xswo6umh Content-Type: text/plain; charset=utf-8 Content-Description: FreeBSD status report, 2020q1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Introduction This report covers FreeBSD related projects for the period between January = and March, and is the first of four planned reports for 2021. The first quarter of 2021 has been very active in both FreeBSD-CURRENT and -STABLE, with 13.0-RELEASE work starting in January and finishing up mid-Ap= ril. It provides lots of new features, and there=E2=80=99s even a good chance th= at some workloads will experience performance improvements. The number of entries is slightly down, and this is probably due to a combination of factors like code slush as well as the ongoing issues with COVID-19, but we naturally hope that things will look up next quarter. This combined with a switch-over to AsciiDoctor and a decision to make full use = of the status report work schedule to avoid stress, means that the report can = now be expected to come out at the end of the first month after the quarter has finished, rather than in the middle. This report in particular includes a number of interesting entries, covering everything from the linuxulator, various mitigation work, long-awaited work= on OpenBSM, work on kernel sanitizers, and many more things that it is hoped y= ou will enjoy reading about. Yours, Daniel Ebdrup Jensen, with a status hat on. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Table of Contents =E2=80=A2 FreeBSD Team Reports =E2=96=A1 FreeBSD Foundation =E2=96=A1 FreeBSD Release Engineering Team =E2=96=A1 Cluster Administration Team =E2=96=A1 Continuous Integration =E2=96=A1 Ports Collection =E2=80=A2 Projects =E2=96=A1 Git Migration Working Group =E2=96=A1 LLDB Debugger Improvements =E2=96=A1 Linux compatibility layer update =E2=96=A1 Vulnerability Mitigations =E2=96=A1 OpenBSM Synchronisation =E2=80=A2 Kernel =E2=96=A1 ENA FreeBSD Driver Update =E2=96=A1 Intel wireless update =E2=96=A1 Kernel Sanitizers =E2=96=A1 Marvell ARM64 SoCs support =E2=96=A1 nv(9)-based audio device enumeration =E2=80=A2 Ports =E2=96=A1 KDE on FreeBSD =E2=96=A1 FreeBSD Office team 2021Q1 status report =E2=96=A1 VirtualBox FreeBSD port =E2=80=A2 Documentation =E2=96=A1 DOCNG on FreeBSD =E2=96=A1 FreeBSD Translations on Weblate =E2=96=A1 WebApps working group =E2=80=A2 Miscellaneous =E2=96=A1 Discord Server & Community Growth =E2=80=A2 Third-Party Projects =E2=96=A1 CBSD Project =E2=96=A1 helloSystem =E2=96=A1 PkgBase.live =E2=96=A1 Potluck & Potman =E2=96=A1 sysctl improvements =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 FreeBSD Team Reports Entries from the various official and semi-official teams, as found in the Administration Page. FreeBSD Foundation Contact: Deb Goodkin The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting and promoting the FreeBSD Project and community worldwide. Fundi= ng comes from individual and corporate donations and is used to fund and manage software development projects, conferences and developer summits, and provi= de travel grants to FreeBSD contributors. The Foundation purchases and supports hardware to improve and maintain FreeBSD infrastructure and provides resour= ces to improve security, quality assurance, and release engineering efforts; publishes marketing material to promote, educate, and advocate for the Free= BSD Project; facilitates collaboration between commercial vendors and FreeBSD developers; and finally, represents the FreeBSD Project in executing contra= cts, license agreements, and other legal arrangements that require a recognized legal entity. Here are some highlights of what we did to help FreeBSD last quarter: COVID-19 Impact to the Foundation Like most organizations, our team continued to work from home. Our temporary ban on travel for staff members remains in effect, but continues to not aff= ect our output too much, since most conferences are still virtual. We continued supporting the community and Project, even though some of our work and responses may have been delayed because of changes in some of our priorities and the impact of limited childcare for a few of our staff members. Partnerships and Commercial User Support We help facilitate collaboration between commercial users and FreeBSD developers. We also meet with companies to discuss their needs and bring th= at information back to the Project. Not surprisingly, the stay at home orders, combined with our company ban on travel during Q1 made in-person meetings non-existent. However, the team was able to continue meeting with our partn= ers and commercial users virtually. These meetings help us understand some of t= he applications where FreeBSD is used. We were thrilled for the opportunity to work with AMD early on to ensure FreeBSD worked on their recently released third generation EPYC series. You= can read more about that here: https://freebsdfoundation.org/news-and-events/ latest-news/freebsd-well-prepared-for-amd-epyc-7003-series-processors/. Fundraising Efforts First, we=E2=80=99d like to say thank you to everyone who has given us a fi= nancial contribution this year! Last quarter we raised $88,237, which includes donations from organizations like Facebook and Tarsnap, as well as many individuals. We also have a few donation commitments for this quarter. Going forward this quarter, we will be reaching out to FreeBSD commercial u= sers to help support our growing efforts. At the beginning of 2021, we opened two job positions in our software development team, to increase the amount of support we are able to provide in this area. That includes increasing the amount of code reviews and bug fixes we do and adding some major features to FreeBSD, to help keep FreeBSD the innovative, secure, and reliable operating system you rely on. You=E2=80=99ll find out how we used your donations for Q1 in our report, as= well as individual reports throughout this status report. We are excited about our plans for 2021, which include more FreeBSD online advocacy and training, operating system course content, and the software development work mentioned above. While we are still in this pandemic, we= =E2=80=99re working hard to help connect folks within the community with more virtual opportunities. Please consider making a donation to help us continue and increase our supp= ort for FreeBSD in 2021: https://www.freebsdfoundation.org/donate/. We also have the Partnership Program, to provide more benefits for our larg= er commercial donors. Find out more information and share with your companies! https://www.freebsdfoundation.org/FreeBSD-foundation-partnership-program/ OS Improvements Over the quarter a total of 264 base system commits, 63 ports commits, and = 10 doc tree commits were tagged as sponsored by the FreeBSD Foundation. The Foundation also sponsored work that was committed to third-party repositori= es, including 26 commits to LLDB (the LLVM project debugger). This includes work =66rom staff members, interns, and grant recipients. In other quarterly rep= ort entries you can read more about some of these sponsored projects, such as L= LDB and other kernel debugging improvements, and kernel sanitizers. As usual, staff members committed numerous bug fixes, minor improvements, a= nd security patches. Focus areas in the kernel included virtual memory, x86 pm= ap, uma, tmpfs, nullfs, ffs and ufs, and job control improvements. User space work included changes to the libc, libcasper, and libthr librari= es, the run-time linker, as well as the ldd, cmp, diff, makefs, elfctl, growfs,= and bhyve utilities. Foundation staff also participated in many Phabricator code reviews, suppor= ted bug triage, integrated a number of submissions from third parties, and supported the Git transition working group. Foundation staff also supported the promotion of the AArch64 (arm64) architecture to Tier-1 status. Work included additions to freebsd-update, integration of various bug fixes, and test run issue triage. Continuous Integration and Quality Assurance The Foundation provides a full-time staff member and funds projects on improving continuous integration, automated testing, and overall quality assurance efforts for the FreeBSD Project. During the first quarter of 2021, the work was focused on pre-commit tests = and building release artifacts in the CI staging environment. The other main working item is following the VCS migration to change the src source from Subversion to Git and doc changed to AsciiDoc format. See the FreeBSD CI section of this report for completed work items and deta= iled information. Supporting FreeBSD Infrastructure The Foundation provides hardware and support to improve the FreeBSD infrastructure. Last quarter, we continued supporting FreeBSD hardware loca= ted around the world. We coordinated efforts between the new NYI Chicago facili= ty and clusteradm to start working on getting the facility prepared for some of the new FreeBSD hardware we are planning on purchasing. NYI generously prov= ides this for free to the Project. We also worked on connecting with the new own= ers of the NYI Bridgewater site, where most of the FreeBSD infrastructure is located. FreeBSD Advocacy and Education A large part of our efforts are dedicated to advocating for the Project. Th= is includes promoting work being done by others with FreeBSD; producing advoca= cy literature to teach people about FreeBSD and help make the path to starting using FreeBSD or contributing to the Project easier; and attending and gett= ing other FreeBSD contributors to volunteer to run FreeBSD events, staff FreeBSD tables, and give FreeBSD presentations. The FreeBSD Foundation sponsors many conferences, events, and summits around the globe. These events can be BSD-related, open source, or technology even= ts geared towards underrepresented groups. We support the FreeBSD-focused even= ts to help provide a venue for sharing knowledge, to work together on projects, and to facilitate collaboration between developers and commercial users. Th= is all helps provide a healthy ecosystem. We support the non-FreeBSD events to promote and raise awareness of FreeBSD, to increase the use of FreeBSD in different applications, and to recruit more contributors to the Project. Wh= ile we were still unable to attend in-person meetings due to covid-19, we were = able to attend virtual events and began planning for the online Spring FreeBSD Developer Summit. In addition to attending and planning virtual events, we = are continually working on new training initiatives and updating our selection = of how-to guides to facilitate getting more folks to try out FreeBSD. https:// www.freebsdfoundation.org/freebsd/how-to-guides/ Check out some of the advocacy and education work we did last quarter: =E2=80=A2 Presented a workshop at Apricot 2021 =E2=80=A2 Staffed a virtual stand at FOSDEM 2021 and created a what=E2=80= =99s new in 13.0 video to accompany the stand =E2=80=A2 Staffed a virtual booth and was a community sponsor for FOSSASI= A 2021 =E2=80=A2 Participated as an Industry Partner for USENIX FAST =E2=80=9821 =E2=80=A2 Committed to be an Industry Partner for USENIX Annual Tech, USE= NIX OSDI, USENIX Security and USENIX LISA =E2=80=A2 Continued to promote the FreeBSD Office Hours series Videos fro= m the one hour sessions can be found on the Project=E2=80=99s YouTube Channel: ht= tps:// www.youtube.com/c/FreeBSDProject. See the Office Hours section of this report for more information. =E2=80=A2 Worked with the organizing committee to begin planning the Spri= ng FreeBSD Developers Summit. =E2=80=A2 Continued recruiting for the FreeBSD Fridays series. The series= will return in May. =E2=80=A2 Participated in an interview with The Register about FreeBSD 13= =2E0 highlights. https://www.theregister.com/2021/03/10/the_state_of_freebsd/ Keep up to date with our latest work in our newsletters: https:// freebsdfoundation.org/our-work/latest-updates/?filter=3Dnewsletter We help educate the world about FreeBSD by publishing the professionally produced FreeBSD Journal. As we mentioned previously, the FreeBSD Journal is now a free publication. Find out more and access the latest issues at https= :// www.freebsdfoundation.org/journal/. You can find out more about events we attended and upcoming events at https= :// www.freebsdfoundation.org/news-and-events/. Legal/FreeBSD IP The Foundation owns the FreeBSD trademarks, and it is our responsibility to protect them. We also provide legal support for the core team to investigate questions that arise. Go to http://www.freebsdfoundation.org to find out how we support FreeBSD a= nd how we can help you! =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 FreeBSD Release Engineering Team Links: FreeBSD 13.0-RELEASE schedule URL: https://www.freebsd.org/releases/13.0R/ schedule.html FreeBSD development snapshots URL: https://download.freebsd.org/ftp/snapsho= ts/ ISO-IMAGES/ Contact: FreeBSD Release Engineering Team, The FreeBSD Release Engineering Team is responsible for setting and publish= ing release schedules for official project releases of FreeBSD, announcing code freezes and maintaining the respective branches, among other things. During the first quarter of 2021, the Release Engineering Team started work= on the 13.0-RELEASE cycle, the first release from the stable/13 branch. As of = this writing, the release is progressing smoothly, with one additional BETA build and two additional RC builds added to the schedule. The schedule has been updated on the FreeBSD Project website to reflect the updates. Additionally throughout the quarter, several development snapshots builds w= ere released for the head, stable/12, and stable/11 branches. Development snaps= hot builds for stable/13 will be available after the 13.0 release. Thank you to all that have helped test the 13.0 builds up until this point = and have reported issues. As always, we strive for quality over quantity. Sponsor: Rubicon Communications, LLC ("Netgate") Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Cluster Administration Team Contact: Cluster Administration Team Links: Cluster Administration Team members URL: https://www.freebsd.org/administra= tion /#t-clusteradm The FreeBSD Cluster Administration Team consists of the people responsible = for administering the machines that the Project relies on for its distributed w= ork and communications to be synchronised. In this quarter, the team has worked= on the following: =E2=80=A2 Installed a new package builder =E2=80=A2 Added Git support to cluster management scripts =E2=80=A2 Put local Git mirrors on the universe machines =E2=80=A2 Replaced disks in the UK mirror =E2=80=A2 Replaced a disk in pointyhat (https://pkg-status.freebsd.org) =E2=80=A2 Recycled some old dead-weight servers eating up rackspace and p= ower at our primary cluster site =E2=80=A2 Upgraded developer reference platforms =E2=96=A1 ref{11,12,13,14}-{amd64,i386} =E2=96=A1 universe* =E2=80=A2 Installed two new aarch64 machines =E2=96=A1 ref12-aarch64, ref13-aarch64, ref14-aarch64 =E2=96=A1 security-officer aarch64 freebsd-update builder =E2=80=A2 Worked with asciidoc project to update https://www.freebsd.org = and https:// docs.freebsd.org =E2=80=A2 Installed a new mirror server in Brazil, sponsored by nic.br =E2=96=A1 gdns points everyone from South America to this mirror =E2=96=A1 complete {download,ftp,pkg}.freebsd.org mirror =E2=80=A2 Helped rmacklem@ participate in this year=E2=80=99s NFS Bakeath= on interoperability testing event by providing a cluster machine to the testing VPN =E2=80=A2 Ongoing day to day cluster management activity =E2=96=A1 Putting out fires =E2=96=A1 Babysitting pkgsync Work in progress: =E2=80=A2 Move pkg-master.nyi to new hardware =E2=80=A2 Fix git fallouts =E2=80=A2 Upgrade cluster hardware =E2=80=A2 Upgrade developer-facing machines to 14-CURRENT =E2=96=A1 Install ref14* machines =E2=80=A2 Improve to the package building infrastructure =E2=80=A2 Research and test migration away from mailman2 =E2=80=A2 Work with Git migration working group for ports tree migration =E2=80=A2 Review the service jails and service administrators operation =E2=80=A2 Improve the web service architecture =E2=80=A2 Improve the cluster backup plan =E2=80=A2 Setup powerpc pkgbuilder/ref/universal machines =E2=80=A2 Prepare for a new mirror site in Australia, to be hosted by IX = Australia =E2=80=A2 Search for more providers that can fit the requirements for a g= eneric mirrored layout or a tiny mirror =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Continuous Integration Links: FreeBSD Jenkins Instance URL: https://ci.FreeBSD.org FreeBSD Hardware Testing Lab URL: https://ci.FreeBSD.org/hwlab FreeBSD CI artifact archive URL: https://artifact.ci.FreeBSD.org FreeBSD CI weekly report URL: https://hackmd.io/@FreeBSD-CI FreeBSD Jenkins wiki URL: https://wiki.freebsd.org/Jenkins Hosted CI wiki URL: https://wiki.freebsd.org/HostedCI 3rd Party Software CI URL: https://wiki.freebsd.org/3rdPartySoftwareCI Tickets related to freebsd-testing@ URL: https://preview.tinyurl.com/y9maau= wg FreeBSD CI Repository URL: https://github.com/freebsd/freebsd-ci Contact: Jenkins Admin Contact: Li-Wen Hsu Contact: freebsd-testing Mailing List Contact: IRC #freebsd-ci channel on EFNet The FreeBSD CI team maintains the continuous integration system of the Free= BSD project. The CI system firstly checks the committed changes can be successf= ully built, then performs various tests and analysis over the newly built result= s. The artifacts from those builds are archived in the artifact server for fur= ther testing and debugging needs. The CI team members examine the failing builds= and unstable tests and work with the experts in that area to fix the code or ad= just test infrastructure. The details of these efforts are available in the week= ly CI reports. During the first quarter of 2021, we continued working with the contributors and developers in the project to fulfil their testing needs and also keep collaborating with external projects and companies to improve their products and FreeBSD. Important changes: =E2=80=A2 All src jobs were changed to use git to follow VCS migration. T= hanks Brandon Bergren (bdragon@) again. =E2=80=A2 Doc job was updated for following the AsciiDoc migration. New jobs added: =E2=80=A2 TCP test suite for main on amd64 =E2=80=A2 GCC 9 build for main on amd64 Work in progress and open tasks: =E2=80=A2 Designing and implementing pre-commit CI building and testing =E2=80=A2 Designing and implementing use of CI cluster to build release a= rtifacts as release engineering does =E2=80=A2 Collecting and sorting CI tasks and ideas here =E2=80=A2 Testing and merging pull requests in the FreeBSD-ci repo =E2=80=A2 Reducing the procedures of CI/test environment setting up for c= ontributors and developers =E2=80=A2 Setting up the CI stage environment and putting the experimenta= l jobs on it =E2=80=A2 Setting up public network access for the VM guest running tests =E2=80=A2 Implementing automatic tests on bare metal hardware =E2=80=A2 Adding drm ports building tests against -CURRENT =E2=80=A2 Planning to run ztest and network stack tests =E2=80=A2 Adding more external toolchain related jobs =E2=80=A2 Improving the hardware lab to be more mature and adding more ha= rdware =E2=80=A2 Helping more software get FreeBSD support in their CI pipeline = Wiki pages: 3rdPartySoftwareCI, HostedCI =E2=80=A2 Working with hosted CI providers to have better FreeBSD support =E2=80=A2 The build and test results will be sent to the dev-ci mailing l= ist soon. Feedback and help with analysis is very appreciated! Please see freebsd-testing@ related tickets for more WIP information, and d= on=E2=80=99t hesitate to join the effort! Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Ports Collection Links: About FreeBSD Ports URL: https://www.FreeBSD.org/ports/ Contributing to Ports URL: https://docs.freebsd.org/en/articles/contributin= g/ ports-contributing/ FreeBSD Ports Monitoring URL: http://portsmon.freebsd.org/ Ports Management Team URL: https://www.freebsd.org/portmgr/ Ports Tarball URL: http://ftp.freebsd.org/pub/FreeBSD/ports/ports/ Contact: Ren=C3=A9 Ladan Contact: FreeBSD Ports Management Team The Ports Management Team is responsible for overseeing the overall directi= on of the Ports Tree, building packages, and personnel matters. Below is what happened in the last quarter. As always, first the quarterly dashboard: * we currently have around 43,800 ports (including flavors). * the open PR count for ports is currently 2477,= of which 532 are unassigned. * during the last quarter, 9481 commits were made= by 168 committers on the main branch, and 620 commits by 64 committers on the 2021Q1 branch. Compared to 2020Q4, the number of ports again grew by five percent, the number of open PRs dropped a bit, and the number of commits on= the main branch grew with almost nine percent. During the last quarter, we welcomed Neel Chauhan (nc@), Lewis Cook (lcook@= ), and Nuno Teixeira (eduardo@). Adrian Chadd (adrian@) who is already a src committer got a ports commit bit extension. Tobias Berner (tcberner@) asked= if he could join the portmgr-lurker program and was shortly added afterwards. We sent another mail to the ports@ mailing list outlining further plans for removing Python 2.7 from the Ports Tree. Currently all ports recursively depending on Python 2.7 are marked to expire on 2021-06-23, which unfortuna= tely includes a lot of KDE ports due to the qt5-webengine port. We are evaluating various mitigation strategies. portmgr has been collaborating with the Git Working Group over the last yea= r to prepare the Ports Tree to be converted to Git. Tasks included: * converting various scripts and tools to support Git * attending Git Working Group meet= ings * updating documentation * updating various internal and public third-party services * evaluating numerous test conversion (git-beta) results Regarding the Ports Tree itself, two new USES were introduced: * kodi to ea= se porting of Kodi add-ons * mpi for dependencies of MPICH and OpenMPI A new default version for ImageMagick was added and the default version for Julia= was removed as no Julia port currently exists. pkg was updated to 1.16.3, Firef= ox to 87.0, and Chromium to 89.0.4389.114 The Cluster Administration Team assisted with getting three new package building machines running in the build cluster. Two are for arm64 builds and one is a general builder. antoine@ was again busy with exp-runs, 28 this time, to: * test various por= ts updates * update the clang/LLVM version from 6 to 10 in USES=3Dcompiler * r= educe includes in /usr/include/crypto =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Projects Projects that span multiple categories, from the kernel and userspace to the Ports Collection or external projects. Git Migration Working Group Links: Git transition wiki URL: https://wiki.freebsd.org/git doc git repo URL: https://cgit.FreeBSD.org/doc ports git repo URL: https://cgit.FreeBSD.org/ports src (base system) git repo URL: https://cgit.FreeBSD.org/src Committers guide Git primer URL: https://docs.freebsd.org/en/articles/ committers-guide/#git-primer Handbook Using Git appendix URL: https://docs.freebsd.org/en/books/handbook/ mirrors/#git Game of Trees URL: http://gameoftrees.org/ gitup URL: https://github.com/johnmehr/gitup Contact: Li-Wen Hsu Contact: Warner Losh Contact: Ed Maste Contact: Ulrich Sp=C3=B6rlein Contact: FreeBSD-git mailing list Contact IRC #gitcvt channel on EFnet The doc and src trees were migrated from Subversion to Git at the end of 20= 20, with some additional work extending into the first quarter of 2021. The Git Working Group implemented or updated commit hooks, and prepared for FreeBSD= 13 to be built from Git. We converted draft documentation from Markdown to AsciiDoc and merged it into the committer=E2=80=99s guide and handbook. The ports repository migration to Git started at the end of the quarter, beginning with a final Subversion commit on March 31st to indicate that the conversion started. We are working on portsnap and other ports infrastructu= re and they will be finished before or soon after the migration. The Git Working Group continues to track progress on two permissively-licen= sed git compatible tools: Gitup and Game of Trees. Gitup is a small, dependency-free tool to clone and update git repositories. It is used only = to keep a local tree up-to-date, and has no support for local commits. Game of Trees is a version control client that is compatible with Git repositories. It provides a user interface and workflow that is distinct fr= om that of Git. It is in no way intended to be a drop-in replacement for git, = but can be used to develop software maintained in a Git repository. Gitup and Game of Trees are currently available as ports and packages. Futu= re work will evaluate them as candidates for the base system. In the second quarter of 2021 we expect to complete some minor remaining migration tasks. This will complete the initial phase of the Git migration,= and the working group will wind down. The core team will then begin a new effor= t to investigate and evaluate new workflow changes. Sponsor: The FreeBSD Foundation (in part) =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 LLDB Debugger Improvements Links: Moritz Systems Project Description URL: https://www.moritz.systems/blog/ lldb-freebsd-cpu-target-support-and-userland-debugging-improvements/ Progress Report 1 URL: https://www.moritz.systems/blog/ freebsd-remote-process-plugin-on-non-x86-architectures/ Progress Report 2 URL: https://www.moritz.systems/blog/ freebsd-legacy-process-plugin-removed/ Progress Report 3 URL: https://www.moritz.systems/blog/ lldb-support-for-fork-and-vfork/ Git Repository URL: https://github.com/moritz-systems/llvm-project Contact: Kamil Rytarowski Contact: Micha=C5=82 G=C3=B3rny The LLDB project builds on libraries provided by LLVM and Clang to provide a great modern debugger. It uses the Clang ASTs and the expression parser, LL= VM JIT, LLVM disassembler, etc so that it provides an experience that =E2=80= =9Cjust works=E2=80=9D. It is also blazingly fast and more permissively licensed th= an GDB, the GNU Debugger. FreeBSD includes LLDB in the base system. At present, it has some limitatio= ns in comparison with the GNU GDB debugger, and does not yet provide a complete replacement. This project aimed to finish porting the FreeBSD platform supp= ort in LLDB to the modern client-server model on all architectures originally supported by LLDB on FreeBSD and removing the obsolete plugin. After switching to the new process model, the project focused on implementi= ng support for tracing fork(2) and vfork(2) syscalls. The proposed model is compatible with the follow-fork-mode setting from GDB. On fork, the debugger can either continuing tracing the parent and detach the child, or switch to tracing the child and detach the parent. The new code makes it possible to debug child processes. It also prevents software breakpoints from leaking to child processes and causing them to crash. The introduced changes are expected to be shipped with LLDB 13.0. The overall experience of FreeBSD/LLDB developers and advanced users on this rock solid Operating System reached the state known from other environments. Furthermore, the FreeBSD-focused work also resulted in generic improvements, enhancing the LLDB support for Linux and NetBSD. TODO: we are currently working on adding a ptrace(2) request to create a co= re dump of the stopped program without crashing it. Afterwards, we are plannin= g to improve LLDB test coverage for core dump support and work on any issues we might hit. Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Linux compatibility layer update Contact: Edward Tomasz Napierala, Linuxulator improvements have been ongoing for the last two years, with sup= port =66rom the FreeBSD Foundation over a few distinct project grants as well as contributions from the community. The goal of this project is to improve FreeBSD=E2=80=99s ability to execute unmodified Linux binaries. Current sup= port status of specific Linux applications is being tracked at the Linux app status Wiki page. The work this quarter focused on making sure the 13.0-RELEASE ships with Linuxulator in a good shape, and fixing problems reported by users. There a= re some new directories provided by linsysfs(5), the lack of which, through a curious chain of events, broke installation of make(1) in Ubuntu Focal. The getcwd(2) syscall was fixed to no longer return the wrong error value for certain conditions, which was breaking Mono. The getsockopt(2) syscall now supports SO_PEERSEC and SO_PEERGROUPS, which are being used by su(8) and su= do (8). Other fixes include flag handling for 32-bit send(2) syscall, and seve= ral ptrace(2) problems, which were affecting Steam games. The kernel version was bumped to 3.17.0 to unbreak Qt applications from Focal. The sysutils/ debootstrap port, and its corresponding debootstrap package, now correctly handle Ubuntu=E2=80=99s GPG keys. The debootstrap utility now installs the = mremap(2) workaround for apt(8). This reduces the number of steps required to set up Linux chroot or jail. Finally there have been some improvements to the star= tup scripts. Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Vulnerability Mitigations Contact: Ed Maste Contact: Konstantin Belousov Contact: Marcin Wojtas Contact: Dawid G=C3=B3recki We added support for enforcing a write XOR execute mapping policy. It is enabled by setting the kern.elf64.allow_wx and/or kern.elf32.allow_wx sysct= ls to 0 (for 64-bit and 32-bit binaries, respectively). Binaries can indicate = that they requre writeable and executable mappings by setting the NT_FREEBSD_FCTL_WXNEEDED ELF feature bit, set via elfctl. In addition, elfctl received a few usability improvements to support use by ports, targeting different FreeBSD base system versions. We added a -i flag= to ignore unknown flags (so that the same elfctl invocation could be used on o= lder FreeBSD versions) as well as the ability to specify features by value. Flags that request opt-out of a mitigation now have a no prefix to make the sense clearer. For example, the flag to indicate that the binary is not compatible with ASLR is now named noaslr. Unprefixed flag names are still supported, for backwards compatibility, but will emit a warning and will be removed in a later version. The next step is to introduce ports infrastructure to support tagging binar= ies in ports that require special flags. Details can be found in PR252629. Another update is that the base system binaries are now built as position-independent executable (PIE) by default, for 64-bit architectures.= PIE executables are used in conjunction with address randomization (ASLR) as a mitigation for certain types of security vulnerabilities. The ASLR feature still remains opt-in, however the described change allows enabling it using only sysctl knobs, without a need to rebuild the image. Enabling PIE result= s in no material performance impact for most workloads. It is also worth mentioning that a certain number of ports inherit the base systems /usr/share/mk infrastructure, and some initially failed to build af= ter toggling the PIE setting. All issues detected by executing the exp-run were addressed. The details can be found in PR253275. The next step is to try enabling ASLR by default for 64-bit architectures. = The patch is under discussion. Sponsor: The FreeBSD Foundation Sponsor: Stormshield =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 OpenBSM Synchronisation Links: TrustedBSD / OpenBSM URL: http://www.trustedbsd.org/openbsm.html OpenBSM Github Sources URL: https://github.com/openbsm/openbsm Synchronisation with macOS Catalina URL: https://github.com/openbsm/openbsm/ commit/54a0c07cf8bac71554130e8f6760ca68e5f36c7f Apple OpenSource URL: https://opensource.apple.com Contact: Gordon Bergling OpenBSM is a crucial part of FreeBSD, which provides auditing features for = the operating system. OpenBSM is incorporated into FreeBSD and macOS. Both Apple and FreeBSD have currently made changes to the OpenBSM framework, which wer= en=E2=80=99t upstreamed. This small project aims to consolidate these changes and upstre= am them to the OpenBSM github repository, so that both development efforts can= be merged to FreeBSD later on. There is currently a pull request pending that synchronizes the FreeBSD sou= rces with OpenBSM. A comparison was made to incorporate Apple=E2=80=99s Catalina= changes. A few weeks ago Apple has also made the source code of Big Sur available. In = the latest comparison against OpenBSM Apple has made overlapping ID changes, wh= ich are making a simple import of the changes impossible. I am currently trying= to work around that issue by making OpenBSM a little vendor specific. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Kernel Updates to kernel subsystems/features, driver support, filesystems, and mor= e. ENA FreeBSD Driver Update Links: ENA README URL: https://github.com/amzn/amzn-drivers/blob/master/kernel/fbs= d/ ena/README Contact: Michal Krawczyk Contact: Artur Rojek Contact: Marcin Wojtas ENA (Elastic Network Adapter) is the smart NIC available in the virtualized environment of Amazon Web Services (AWS). The ENA driver supports multiple transmit and receive queues and can handle up to 100 Gb/s of network traffi= c, depending on the instance type on which it is used. Completed since the last update: =E2=80=A2 Update ENA driver to v2.3.1 =E2=80=A2 Determine location of the MSIx vector table on the device and a= llocate it dynamically - this enables driver usage on instances like c5gn. =E2=80=A2 MFC of the ENA v2.3.1 driver to the FreeBSD 11/12/13-STABLE bra= nches =E2=80=A2 ENA v2.3.1 will be a part of the FreeBSD 13.0-RELEASE Work in progress: =E2=80=A2 Internal review ongoing: =E2=80=A2 Introduce full kernel RSS API support =E2=80=A2 Allow reconfiguration of the RSS indirection table and hash key =E2=80=A2 Adjust iflib framework for the ENA requirements =E2=80=A2 Add DMA width configuration field commit 6dd69f0064f1 =E2=80=A2 Add support for admin completion queues commit 09c3f04ff3be =E2=80=A2 Prototype the driver port to the iflib framework Sponsor: Amazon.com Inc =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Intel wireless update Links: The freebsd-wireless mailing list URL: https://lists.freebsd.org/mailman/ listinfo/freebsd-wireless Contact: Bjoern A. Zeeb Newer Intel Wireless device support The Intel Wireless driver update project aims to bring support for newer chipsets. During the first quarter the driver and firmware were synched from upstream= so that we will have support for all modern cards currently supported in Linux. Some iwlwifi driver changes were also submitted back upstream. Several conflicts with the original implementation of LinuxKPI were or are being resolved and more LinuxKPI code was upstreamed to FreeBSD HEAD. LinuxKPI 802.11 compat code was improved and as of the day of writing we ha= ve data packets going over 11a. The plan for the next weeks is to clean things up, land as much as possible= in HEAD, provide the code for testing and work on stability based on feedback before filling gaps in the LinuxKPI 802.11 compat code to enhance support f= or more standards and features. Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Kernel Sanitizers Contact: Mark Johnston Work has been ongoing to port a pair of kernel sanitizers from NetBSD to FreeBSD. Sanitizers are debugging tools which make use of compiler instrumentation to validate memory accesses. They can automatically detect = many classes of C programming bugs, such as use-after-frees and loads of uninitialized variables. When combined with syzkaller or other testing tool= s, they are effective at detecting kernel bugs that may otherwise require a gr= eat deal of manual effort to identify. Two sanitizers are being ported, KASAN (AddressSanitizer) and KMSAN ( MemorySanitizer). KASAN checks the validity of all memory accesses within t= he kernel map and triggers a panic upon an out-of-bounds access or a use-after-free. Various kernel memory allocators annotate regions of memory= to denote whether corresponding accesses are valid. The initial port of KASAN = is complete and is planned to appear in the FreeBSD development branch in mid-April. KMSAN detects uses of uninitialized memory and can detect bugs t= hat result in the contents of kernel memory being leaked to userspace. Both sanitizers incur considerable memory and CPU overhead. They are intended to= be used mainly in conjunction with test frameworks, though it is certainly possible to boot and run sanitizer-enabled kernels in a desktop or laptop environment. Currently this work is amd64-only. It should be possible to po= rt it to arm64 and riscv with relatively little effort. Future work in this area consists of finishing the KMSAN port, fixing bugs found by the combination of KASAN and syzkaller, and making sure that sanitizers can validate accesses to the direct map. This may consist of an option to disable usage of the direct map, or introducing a shadow for the direct map. Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Marvell ARM64 SoCs support Contact: Zyta Szpak Contact: Kornel Dul=C4=99ba Contact: Marcin Wojtas The Semihalf team is working on improving the FreeBSD support for the Marve= ll Octeon TX2 CN913x and Armada 7k/8k SoC families. Marvell Armada 7k8k and Octeon TX2 CN913x SoC families are quad-core 64-bit ARMv8 Cortex-A72 processors with high speed peripherals including 10 Gb Ethernet, PCIe 3.0, SATA 3.0 and USB 3.0 for a wide range of networking, storage, security and industrial applications. Although the mentioned SoCs are mostly supported in FreeBSD HEAD, some piec= es required improvements. Applied changes: =E2=80=A2 Add missing frequency modes in ap806_clock driver (commit a86b0= 839d7bf) =E2=80=A2 Multiple fixes in mvebu_gpio driver - in cooperation with mmel = (commit a5dce53b75d8) =E2=80=A2 Fix device tree data parsing in mv\_ap806\_gicp interrupt contr= oller driver (commit 622d17da46eb) =E2=80=A2 Rework the ICU interrupt controller (mv\_cp110\_icu) and its pa= rent (mv\ _ap806\_gicp), so that they no longer rely on the data provided by firmware, which fixes booting the OS from the newer U-Boot/TF-A revisio= ns ( D28803) =E2=80=A2 PCIE Designware driver (pci_dw) fixes: =E2=96=A1 Correct setting of outbound I/O ATU window. =E2=96=A1 Allow mapping ATU windows bigger than 4GB. =E2=80=A2 Generic improvements that enable proper user-space mapping and = access of the PCI BARs TODO: =E2=80=A2 Upstream PCIE improvements. =E2=80=A2 Improve and merge ICU support rework. Sponsor: Marvell =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 nv(9)-based audio device enumeration Links: D26884 Implement sndstat nvlist-based enumeration ioctls. URL: https:// reviews.freebsd.org/D26884 commit c96151d33509655efb7fb26768cb56a041c176f1 URL: https://cgit.freebsd.o= rg/ src/commit/?id=3Dc96151d33509655efb7fb26768cb56a041c176f1 Contact: Ka Ho Ng This work presents a number of ioctl commands on /dev/sndstat using nv(9) to expose all available audio device nodes. nv(9) is used to generate a serial= ized binary stream representation of the information of audio device nodes prese= nted in the running system. The documented nvlist structure in sndstat(4) manual page is stable for programming use. For a long time, enumerating the audio device node interface required parsi= ng content of /dev/sndstat. It is tedious to write such a parser and handle different hw.snd.verbose levels correctly. Using nv(9) eliminates the need = to write a text parser to do audio device nodes enumeration. This work has been committed and is available in FreeBSD 14-CURRENT. Sponsor: The FreeBSD Foundation =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Ports Changes affecting the Ports Collection, whether sweeping changes that touch most of the tree, or individual ports themselves. KDE on FreeBSD Links: KDE FreeBSD URL: https://freebsd.kde.org/ KDE Community FreeBSD URL: https://community.kde.org/FreeBSD Contact: Adriaan de Groot The KDE on FreeBSD project aims to package all of the software produced by = the KDE Community for the FreeBSD ports tree. The software includes a full desk= top environment called KDE Plasma, graphics applications, instant-messengers, a video-editing suite, as well as a tea timer and hundreds of other applicati= ons that can be used on any FreeBSD machine. The KDE team (kde@) is part of desktop@ and x11@ as well, building the soft= ware stack to make FreeBSD beautiful and usable as a daily-driver graphics-based desktop machine. The KDE Frameworks have a monthly release cycle; KDE Plasma and the rest of= KDE software run on a quarterly cycle plus monthly bugfixes. All of those relea= ses landed in ports in a timely manner. Around KDE there are several hundred ot= her applications with their own releases, of which notable or new ones are: =E2=80=A2 deskutils/calindori, deskutils/kongress, net-im/kaidan, deskuti= ls/semantik and graphics/kgeotag =E2=80=A2 net-im/ruqola and net-im/neochat for Rocket and Matrix instant-= messaging, respectively =E2=80=A2 audio/amarok, the one-time favorite KDE music player Infrastructure work improved the way Qt5 ports install- and un-install chan= ges to the global header qconfig-modules.h. CMake releases landed with distress= ing regularity, and various low-level things like devel/libphonenumber and grap= hics /poppler were updated as needed. The big issue in the Qt stack on FreeBSD is Qt5-WebEngine, which is based on Chromium. Like Chromium itself (upstream), it has a tangled mess of a build system based on Python 2.7. The scheduled removal of Python 2.7 and ports t= hat depend on it is a sword looming over a large chunk of the Qt and KDE stack. Some resolution may be forthcoming in the form of WebEngine-less ports, but= the real effort is in trying to get WebEngine to build with Python3. More detailed descriptions of the updates in this quarter are available here (part 1) and here (part 2). =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 FreeBSD Office team 2021Q1 status report Links: The FreeBSD Office project URL: https://wiki.freebsd.org/Office Contact: FreeBSD Office team ML Contact: Dima Panov Contact: Li-Wen Hsu The FreeBSD Office team works on a number of office-related software suites= and tools such as OpenOffice and LibreOffice. Work during this quarter was focused on providing the latest stable release= of LibreOffice suite and companion apps to all FreeBSD users. Latest and quarterly ports branches got a new branch (7.1) of the LibreOffi= ce suite and updated to 7.1.1 release. Meanwhile, our WIP repository got back a working CI instance again, thanks = to Li-Wen Hsu. We are looking for people to help with the open tasks: =E2=80=A2 The open bugs list contains all filed issues which need some at= tention =E2=80=A2 Upstream local patches in ports Patches, comments and objections are always welcome in the mailing list and bugzilla. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 VirtualBox FreeBSD port Links: VirtualBox home page URL: https://www.virtualbox.org/ VirtualBox OSE port on FreshPorts URL: https://www.freshports.org/emulators/ virtualbox-ose Contact: VirtualBox port team The VirtualBox ports have been updated to the upstream 6.1.18 release. This is a new major release with new features and better support, especially for graphics output. This new release has support only for recent amd64 CPUs providing virtualization support in hardware (VT-x, AMD-V bits). The previous versions of the VirtualBox ports have been preserved as the -legacy versions to allow people unable to use the new version to have a virtualization solution. The new additions port at present fails to build on i386 but the old additi= ons do provide basic functionality for that emulation. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Documentation Noteworthy changes in the documentation tree, in manpages, or in external b= ooks /documents. DOCNG on FreeBSD Contact: Sergio Carlavilla The Doc New Generation project is finished. The switch-over date was Saturd= ay, January 23rd. But there=E2=80=99s a list of remaining tasks: =E2=80=A2 Convert the Python scripts to Ruby using the AsciiDoctor API =E2=80=A2 Convert from releases from 4.4 to 9.0 to AsciiDoctor =E2=80=A2 Use rouge in the source sections instead of the CSS hack =E2=80=A2 Split the news page to reduce the total size of the page =E2=80=A2 Split the books =E2=80=A2 Improve the FDP book If you want to reduce the TODO list, give me a ping :) =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 FreeBSD Translations on Weblate Links: Translate FreeBSD on Weblate wiki URL: https://wiki.freebsd.org/ DocTranslationOnWeblate FreeBSD Weblate Instance URL: https://translate-dev.freebsd.org/ Contact: Danilo G. Baio After the doc migration to Hugo/AsciiDoctor the Weblate tool it=E2=80=99s o= pened again. There are three projects on our Weblate: =E2=80=A2 Documentation (Books and Articles) - open =E2=80=A2 FreeBSD Doc (Archived) - former project =E2=80=A2 Website - pending Language teams that were using Weblate before the migration to Hugo/ AsciiDoctor, please see our Translation based on Automatic Suggestions Wiki article for more details. We=E2=80=99ve just started a project for converting the old method of autom= atically translating strings, using the Machine Translation feature, to a new system that will work for the new documentation. This will save time for our translators. There are still pending items: you can check the Status Page; any help is v= ery welcome. The next step for the new quarter is to prepare and release the Website translations through Weblate as well. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 WebApps working group Contact: Sergio Carlavilla The purpose of this working group is to redesign the Website and the Documentation Portal. The work will be divided into 4 phases. Phase 1: =E2=80=A2 Redesign the documentation portal: new design, responsive and g= lobal search. Phase 2: =E2=80=A2 Redesign the manual pages scripts to generate the HTML using ma= ndoc. Phase 3: =E2=80=A2 Redesign the ports scripts to create an applications portal. Phase 4: =E2=80=A2 Redesign the main website: new design, responsive and dark them= e. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Miscellaneous Objects that defy categorization. Discord Server & Community Growth Links: Discord Wiki Page URL: https://wiki.freebsd.org/Discord Discord Invitation Link URL: https://discord.gg/RHprKbvWJN Contact: Lewis Cook Contact: Vincent Milum Jr Contact: Kubilay Kocak The FreeBSD project and community continues to grow, and in the last 2 quarters, we established an official FreeBSD server on the popular Discord platform, as a complementary means for out-reach, support, collaboration and social connection for and between members of the FreeBSD community, new and old. Discord boasts broad accessibility and unique features that the the communi= ty can enjoy without the steeper learning curves associated with other support= and social mediums, that can often deter or overwhelm newcomers. It also provid= es an opportunity to broaden FreeBSD=E2=80=99s reach outside traditional space= s and audiences. We currently have a respectable 480 members, with that number growing daily, and have established baseline community guidelines and moderation processes consistent with and complementary to other support channels and the FreeBSD Code of Conduct. While it=E2=80=99s early days, events have already been successfully hosted= on the platform. In January, Tom Jones (thj@) announced and ran an online Bugathon focusing on issues related to the branching of FreeBSD 13. We=E2=80=99ve al= so created dedicated text and voice channels to facilitate more of these kinds of even= ts in the future. We hope to see more events like these run as examples of how= we can utilize Discord constructively and in ways we haven=E2=80=99t as a comm= unity or project before. With the future in mind, we have plans to: =E2=80=A2 Automatically announce news, updates and advisories in Discord. =E2=80=A2 Verify and enable additional Discord features designed for large communities. =E2=80=A2 Set up bots with unique features, including moderation and inte= ractive features for members. We welcome ideas in this regard. We are keen on project and community members to reach out to talk about how= we can best leverage Discord. Some ideas we=E2=80=99d love people to get invol= ved with include: =E2=80=A2 Brainstorm/Suggest unique and creative ideas or features. =E2=80=A2 Provide bug reports and user experience feedback and suggestion= s. =E2=80=A2 Actively promote Discord in other social media spaces, particul= arly those that maybe new or curious to learn more about FreeBSD. =E2=80=A2 Contribute to the Wiki page and its content. =E2=80=A2 Participate and support other members on Discord. =E2=80=A2 Run a live stream on a FreeBSD-related topic. =E2=80=A2 Hang out in our live audio and video channels if you=E2=80=99re= comfortable doing so. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Third-Party Projects Many projects build upon FreeBSD or incorporate components of FreeBSD into their project. As these projects may be of interest to the broader FreeBSD community, we sometimes include brief updates submitted by these projects in our quarterly report. The FreeBSD project makes no representation as to the accuracy or veracity of any claims in these submissions. CBSD Project Links: CBSD API module URL: https://www.bsdstore.ru/en/cbsd_api_ssi.html Contact: Oleg Ginzburg What is CBSD? CBSD is a management layer written for the FreeBSD jail(8) subsystem, bhyve= (8) and xen(4). CBSD allows users to manage jail/bhyve/xen environments at different levels of abstraction by providing a varied number of unified methods: vagrant-like CBSDfiles, CLI and via dialog(1). CBSD 2021Q1 Status Report A RestAPI service layer was added during last quarter, enabling creation of programmable cloud solutions. In addition, work has been done to support RestAPI through a CBSDfile, allowing for private cloud environments deploym= ent. In such cases the local CBSD layer acts as a thin client. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 helloSystem Links: Documentation URL: https://hellosystem.github.io/docs/ Contact: Simon Peter Contact: #helloSystem on irc.freenode.net, mirrored to #helloSystem:matrix.= org on Matrix What is helloSystem? helloSystem is FreeBSD preconfigured as a desktop operating system with a f= ocus on simplicity, elegance, and usability. Its design follows the =E2=80=9CLes= s, but better=E2=80=9D philosophy. Q1 2021 Status =E2=80=A2 helloSystem and some of the motivations and core ideas behind i= t were presented at the FOSDEM 2021 BSD Devroom in the talk "hello=E2=80=A6=E2= =80=8B again? Simplicity, elegance, and usability for the desktop". Video recordings = of the talk and Q&A session are available WebM/VP9, mp4 =E2=80=A2 Version 0.4.0 of helloSystem was published. Installable Live IS= O images are available. =E2=80=A2 Work has started towards 0.5.0. We are beginning to see contrib= uted features and bugfixes =E2=96=A1 System menu reflects changes made in Applications immediate= ly =E2=96=A1 Filer file manager brings already-open windows to the front= rather than opening multiple windows for the same folder =E2=96=A1 Initial spatial mode option (each folder opens in its own w= indow in the file manager that remembers its on-screen location) Experimental and release builds of the Live ISO are available at https:// github.com/helloSystem/ISO/releases. Contributing Help is wanted in a number of areas, especially in the areas of the FreeBSD core OS and kernel, and Qt/C++. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 PkgBase.live Links: Website URL: https://alpha.pkgbase.live/ Contact: Mina Gali=C4=87 PkgBase.live is an unofficial repository for the FreeBSD PkgBase project. PkgBase packages the FreeBSD base system as ca 330 packages. The PkgBase project gives users the choice of which parts of the system to install. Users can choose which parts of the base system to install, without building their system from source and optionally choose to install -dbg packages when they need them. PkgBase is built with default options. There= =E2=80=99s no need to build WITHOUT_SENDMAIL, when users can just chose not to install it= ! In addition, PkgBase.live builds every usable kernel! This is especially impor= tant for architectures like armv7. As a service, PkgBase.live was inspired by up.bsd.live, which provides freebsd-update(8) for STABLE and CURRENT branches. Despite this inspiration, freebsd-update has been a constant point of frustrations for me, so I was looking for alternatives. PkgBase is not ready for prime time yet, or else the FreeBSD project would = be providing this service. With the call for testing open since 2016, I though= t it was time to offer a public service, so a broader part of the community can = take part in testing, without having to do all the work for themselves. A lot of things already work fine, but more work needs to be done, as can be seen from the TODO list, as well as the "Pending Changes" on the website. Perhaps the most important thing would be to provide ISOs which lets people setup a fresh system with PkgBase from the get-go. Hardware for PkgBase is kindly sponsored by a member of the FreeBSD communi= ty. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 Potluck & Potman Links: Potluck Repository & Project URL: https://potluck.honeyguide.net/ Potluck on github URL: https://github.com/hny-gd/potluck Potman on github URL: https://github.com/grembo/potman Pot Project URL https://pot.pizzamig.dev Contact: Stephan Lichtenauer (Potluck) Contact: Michael Gmelin (Potman) Pot is a jail management tool that also supports orchestration through Noma= d. Potluck aims to be to FreeBSD and Pot what Dockerhub is to Linux and Docker= : A repository of Pot flavours and complete images for usage with Pot and in ma= ny cases Nomad. The new Potman project aims to simplify building Pot images with Vagrant and VirtualBox based on the Potluck approach, e.g. as part of a DevOps workflow= for software development and testing. That way, Pot images can more easily be created as part of a Jenkins workflow to be deployed with Nomad and Consul. In the last two quarters, FreeBSD 12.2 Potluck images have been built and t= he 11.4 images have been upgraded with the new packages. Furthermore, new imag= es like Wordpress and an improved flavour script (which squashes a nasty netwo= rk problem) have been created. Future plans include further Potman workflow features, new and improved Pot= luck images and publishing FreeBSD 13-based images. As always, feedback and patches are welcome. =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81 sysctl improvements Links: sysctlinfo URL: https://gitlab.com/alfix/sysctlinfo sysctlbyname-improved URL: https://gitlab.com/alfix/sysctlbyname-improved BSDCan 2020 - sysctlinfo questions URL: https://git.io/Jm9x7 sysctl-libnv URL:https://gitlab.com/alfix/sysctl-libnv[https://gitlab.com/a= lfix /sysctl-libnv] sysctlmibinfo2 URL:https://gitlab.com/alfix/sysctlmibinfo2[https://gitlab.c= om/ alfix/sysctlmibinfo2] sysctlview URL: https://gitlab.com/alfix/sysctlview nsysctl URL: https://gitlab.com/alfix/nsysctl Contact: Alfonso Sabato Siciliano The sysctl system call and the wrapper sysctl utility can get and set the system state at runtime; the kernel exposes the available parameters as obj= ects of a Management Information Base. After a recent system update with a CURRENT-GENERIC configuration, the MIB has exceeded ten thousand objects (b= oth internal nodes and leaves, most in the vm.uma subtree) on my laptop with a Desktop environment without ZFS. Furthermore I received tips, ideas, PRs and issues about sysctl so some improvement has been fulfilled; finally the suggestions received during BSDCan 2020 have been accomplished. Kernel space sysutils/sysctlinfo has been updated to 20210222 and is an interface to vis= it the MIB and to retrieve info about an object (description, type, format, fl= ags, and so on). It has been refactored so the new version is almost 100% more efficient to explore the MIB and to pass all info about an object to userla= nd. Moreover new features have been implemented: to get more info about an obje= ct, to avoid extra computation in userland, and to improve the compatibilty with the current undocumented interface. sysutils/sysctlbyname-improved has been updated to 20210223 and is an exten= sion of sysctlinfo to handle an object name with some empty string level or exte= nded to pass an input to the handler of a CTLTYPE_NODE; it has been updated to t= ake advantage of the improvements (mainly efficiency) of sysctlinfo. sysctl-libnv is a project that provides an implementation and an example of= how to build a sysctl object with an nvlist value - to learn more about nvlist,= see the libnv(9) manual page. Properly a new sysctl handler has been defined: i= t is enough to create a nvlist and to pass it to a macro; then the system call u= ses the new handler to pass the nvlist to the userland and the nsysctl utility = can manage the object value. The following tools are been updated to give advantages from new kernel features and improvements. Library devel/libsysctlmibinfo2 has been updated to 2.0.1; primarily the sysctlmibi= nfo2 library wraps the low-level interfaces described above; moreover it defines= a struct sysctlmif_object with the properties of an object and provides a convenient API to build data structures of sysctlmif_object (for example: a subtree, a list of a list of a Depth First Traversal, and so on); therefore= it is useful for handling an object correctly and/or for building a sysctl-like utility. Obviously sysctlmibinfo2 benefits from the features of sysctlinfo: handles = OIDs up to CTL_MAXNAME levels, supports the Capability Mode, can seek an object matching its name (avoiding having to explore the MIB just to find the corresponding OID), gets all info about an object at a time, and manages a special name via sysctlbyname-improved. Version 2.0.1 takes advantage from the kernel improvements: improved effici= ency to build a sysctlmif_object and new features to get info about an object: "handler" and "nextbyname". The new functions are: sysctlmif_hashandler() a= nd sysctlmif_hashandlerbyname() to know if an object has a defined kernel hand= ler, sysctlmif_nextnodebyname() and sysctlmif_nextleafbyname() to explore the MI= B, sysctlmif_leaves() and sysctlmif_leavesbyname() to build only-leaf data structures. Documentation The APIs described above (both kernel and userspace) are really easy: "sysc= tl -aN", "sysctl -d kern.ostype", etc., can be implemented in a few lines of c= ode. Nevertheless each project provides a README with Introduction, Getting star= ted, Features, API, Real-world use cases, FAQ, and examples in the Public Domain= to build new projects. Of course the manuals and examples have recently been updated. Utilities deskutils/sysctlview has been updated to 2.1; the first version of sysctlvi= ew was just a graphical representation of the MIB, now it could be considered a GUI version of sysctl. This utility exploits the object serialization of sysctlinfo; indeed it is not feasible to have the kernel to find the same object many times to retrieve all its properties, considering the current M= IB size. Thanks to user feedbacks the new version provides a better UI, for example clicking a column title to sort the entries, moreover the "Handler" entry is been added in the "Object" window, it is useful to know if an obje= ct has a value or if the OID of a CTLTYPE_NODE can be extended. sysutils/nsysctl has been updated to 2.0 and is the CLI version of sysctlvi= ew; the output is explicitly indicated by the options and is printed via libxo = in human- and machine-readable formats; moreover some string value is parsed to display structured output. The options are not mutually exclusive and allow showing the properties of a parameter so nsysctl is useful to know the info= to handle an object without finding its implementation, for example: Is Multiprocessor safe? Is Capability mode available? Is the OID extensible? D= oes the integer represent a kelvin? Does it have a value? What is the label? An= d so on. The new version supports libnv; it is useful to manage a non-primitive = data type and could avoid hardcoding a generic opaque type in the future. Finally the new features of sysctlinfo allow using nsysctl to debug the MIB without= a kernel recompilation with SYSCTL_DEBUG. Note: the project provides a tutori= al to describe every feature. --p2qii6v5xswo6umh Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAABCgB9FiEEDonNJPbg/JLIMoS6Ps5hSHzN87oFAmCTLjFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDBF ODlDRDI0RjZFMEZDOTJDODMyODRCQTNFQ0U2MTQ4N0NDREYzQkEACgkQPs5hSHzN 87oD7QgAslUF+YnxoSqDL8wJt7RzRfEaw75npm8glTp9I5Jbd9+n4mlxbueFH7KW KsARVZOrtdYW2X/M2VGZvl2Zd9vqPbelThpfquLvYrfwr/EajrjtElbLpFi/JVEY j+XuCTIEgNM+8KA2wLjKIKhxbs2q2bngPLGW6HbYxbkSBTdPCV8QNbRpvCFrz8cy QqbdjdybyptvzzLARO03RkV7y/wUoxErkcnBdRwkz0iSEX9a71DWzAllmLTsM3nQ RoswtfaLOwb7qt9DwNjFcSGmZx2io6/qbGmVy4QEiVLgjwtF+YT1xbnvQQTCM+eY 2T6L0/W6SVFiMjbqIOex17O0Q5iMmg== =tIS8 -----END PGP SIGNATURE----- --p2qii6v5xswo6umh-- From owner-freebsd-current@freebsd.org Thu May 6 00:01:25 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A174C628911; Thu, 6 May 2021 00:01:25 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbDJP4HQCz4tLf; Thu, 6 May 2021 00:01:25 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: from [192.168.1.12] (unknown [91.240.124.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: yuripv) by smtp.freebsd.org (Postfix) with ESMTPSA id E4CCD23539; Thu, 6 May 2021 00:01:24 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Subject: Re: zpool list -p 's FREE vs. zfs list -p's AVAIL ? FREE-AVAIL == 6_675_374_080 (199G zroot pool) To: Mark Millard , freebsd-current , FreeBSD-STABLE Mailing List References: From: Yuri Pankov Message-ID: <34521f0b-a7a1-1743-244a-4149e72911a0@FreeBSD.org> Date: Thu, 6 May 2021 03:01:07 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 00:01:25 -0000 Mark Millard via freebsd-current wrote: > Context: > > # gpart show -pl da0 > => 40 468862048 da0 GPT (224G) > 40 532480 da0p1 efiboot0 (260M) > 532520 2008 - free - (1.0M) > 534528 25165824 da0p2 swp12a (12G) > 25700352 25165824 da0p4 swp12b (12G) > 50866176 417994752 da0p3 zfs0 (199G) > 468860928 1160 - free - (580K) > > There is just one pool: zroot and it is on zfs0 above. > > # zpool list -p > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT > zroot 213674622976 71075655680 142598967296 - - 28 33 1.00 ONLINE - > > So FREE: 142_598_967_296 > (using _ to make it more readable) > > # zfs list -p zroot > NAME USED AVAIL REFER MOUNTPOINT > zroot 71073697792 135923593216 98304 /zroot > > So AVAIL: 135_923_593_216 > > FREE-AVAIL == 6_675_374_080 > > > > The questions: > > Is this sort of unavailable pool-free-space normal? > Is this some sort of expected overhead that just is > not explicitly reported? Possibly a "FRAG" > consequence? >From zpoolprops(8): free The amount of free space available in the pool. By contrast, the zfs(8) available property describes how much new data can be written to ZFS filesystems/volumes. The zpool free property is not generally useful for this purpose, and can be substantially more than the zfs available space. This discrepancy is due to several factors, including raidz parity; zfs reservation, quota, refreservation, and refquota properties; and space set aside by spa_slop_shift (see zfs-module-parameters(5) for more information). From owner-freebsd-current@freebsd.org Thu May 6 00:18:43 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 73F02629D1F for ; Thu, 6 May 2021 00:18:43 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-8.consmr.mail.gq1.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbDhM1CD1z4vWr for ; Thu, 6 May 2021 00:18:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620260320; bh=ZiDWzzUQ5JGaPQAwFI67YRJQ8dSeiC9IuLkpSr3tsF7=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jOKd7lSuWgi1VnBFjaATg4lI9oi9EQrYz4YNvc40H1vbBw1tVTqVCyNZsD8OplVHI5zzTDZi1TPArQ/zjrV3c89EhCjZ9iVJakzW2cT+UtrYiVvi4ei3NImHCGAkzYFfrlCfUqSDHPQMN5lKMveUYcSvMj+ibIt7Yc+x1GHdZi51dwCmFaLBgbuiDXw74hFDSEzLAKgEILDdk/iEY4GFCL8v/NNJW9ynJCTIWtsUUMJHDnQZPujlSX2Rdfx1XCjTMPXTr+bKAN93mrLz/s+/C3IEavc/KhlLACapYV+MtGl4CnTjcpTHi++oQDKSc4YShRqn5izt7dvoCde2Fskodg== X-YMail-OSG: wbPMNm4VM1kqLZSwpu4yohf_wMm5XPskZkQs5nb24C0Z0998yjaf9GMIzjUWRvs 54RnZcq_RVE0CrUYRMF3otKLO7m7e7imUAQ_MePtZPQOgxHwWI0nLG1H8mNj3eBQ2n4PI0z5tUG. RXCLOCC52YK5ACpVAtJCwEonEIhLbGkvOjQiNZD5E3vXnHZ9l28oo4LhvzR9sSkVXO0IqREaUbu6 dQDvSY9P1wigs8LY62BDiEVE8z5w.UT4pp1Jadv7jegpiropYb0MOAlGP6yU2fvEui7n_lJ21cFI dsm4ERoRn_tu.W2gODeGvikbulWbOCce0EqJTMXtqUtKdHZyam3GE5eUDtG6e2NW1muvmiqq7H7P Ns0_MdzRFmyXp_NSsbpvRz0Qdw_uektYay98Y5jRHqoHRnPeWm7F6YCatolUUAMHnjKp_3EyTAza YQYUxzApPsRdnQoIiUh24HkYK2DpsU9sM6CRtCk1ERLvcwQ5oHcAIa9QewcVNZnSJvBzDobtiwI5 Xk4R.W4dDPwRrmklAokSeDoqFFxTAj0vNiG7ljuVm94wD75XUvj42Bg_PVwO1vkbHQNfkbm9k8ig ARYxzZ8V8nuKCNinWCVuePOvP10KEnBkFCe6mC5FrDycD8NTIReFsx9qM1UnqZ_ZHCHM197jozr7 aSc84zRouj9snZxFiXSA7_EN9dS0N5TSZlOGzjhxSCbxRvkCLwZ5XEv1Kf6ZRjRIdSFVsD0MbZ.5 Vohf3vS11TrtF3ouqMzgJirXdpQkiRfyD30H0BN0LS_py3Vrdt4bWjipS2qUXSNM_O2.uN4OOKyx Aba9g0XQs0Fugccpeqj43lAigEa_MQNpimO2yPtfy0XeziT_CYF2Wh8vj2w5A9E8GYAXWDFxa6ql jALtHokjtjIEr1ivbCqQlH7gH7v3.BAfU4Y6prWvQYpll7ZDmiJUpxo.XxuxN_Ed8bpr1Sc5Z_lZ JGWH0rxuTJ0W5u9LP.98fBIVt4GJLzGSo8K7Pqb3fh3B5qF.V_.KQh2pAvmocsoK4vo0.ciGp8nV 47NfYwx_IpzZlI7va4sHQPBa4e3kHjQQ7RLs3fQGw5sNZ6LM3BpSEh8QsK_uCbc2PXYbs_gqSYGx 5LA0YCY2MnjW9i5_WO91lVCkS1LuH3Fb3i9krQI0GgIHr6Q_0.bhPMmoASip_4YGNLFwPSFbmOds 3.qS5.sGeODuFDSdwzsX7PA43gxAXBmRgGA3.SxB2CdCW97YMcM.TqwWWjLsvb6FBJH2vyzNnxCx dpqQ3EyS15jwqvx.6uhtlT7MPTenNQdlIVGXVIKcNpdDKHmGZkUlcfnoo_KCNxPiUFzOko_5Ot45 O68a_ePUu61kjHVpwxRDOHM7G_VyBg.R6C72OT9WxWK.NBQXoH.bAe4mjWSqnv6RyVgUUAQINQeA j_zm9X.8NUOm0mn0lUDGC0caTPrCLtnPLeM0uJWJyAC0MA3XHJZzVtKLBtuyeuarZCeHmncg35QJ pDZakK44PRYeIDZHq9MeS05D8dReIPIDtOMtcU9zGGPnfzV23ZYp_gpAeYmOQ71V.bbTxDrwTPg9 ZnxlLQ9SbXTGVzfqlOdxo5OsZarfX2L1cwe7bXQxRV2pmvt2CSesRc97KoIC7Lfk1tD4MogbDgb4 teTNheZm9KPyw2oaXegUyFcpG5RRBiZnD7h9GY6_WR_ilsa2bCiZERU9XsiZj7LzIKpvwJVpxcgm KugXpdiZHSseMxILt.5dIi9S3KOFdWRWIV.lR5z3blrGA4yIxrJxHOA0fQajxzLM.0QDPxBPCUdZ xqPu077pccKWKUyRuExFX0rO1VorqfsxbOFJqAWBOv.CfsOvGr8sVMI8XD3C_wxooiy89cNGfD5w V3U0iub2kbn94bEZdTZxkECl9K6MAgxh2LwjAvcbWcqlw2y6jpud2FZvDXB3v2_3E_Zepn91Ppph vRT1i44RIT.Mh0dZ61SiZOs78AmV4bg5F5pOCMfaqya05fLxYFvMwtuKdNhNB.m4M_thBeZBvRJP 8W04yP5y9z49cZRoC4ivQlVo9NEdZN7JO9y4E40qYJ6Z92DgrkiWsCJxtaVsUYzYkBKDmgfDZJdC um1Av24DoY4R4alXUZ82U8Iz31XnzhKKsAi4V3ht9h1jB2rhu25M0e09Vc6JQtITYkU2eBoQG5Xq SfZQPGAPivulETGl1B5WpZT7VAJpwPsPZYqE7m.YQP4J6kj6Lyj9EHP.K7hglWzBKmIxUBYZqRWF hiNvST962t235PEawNTaKlg1pmKytZetNUqj4IspPj0nF3TuGd_38eB1z1Nr7dLOOUvugjMnqHir 7gQQhm54wtJ9ES6mlDICz0RYbdoyFYioQ0w4lWctcE17Nv92xpJq1hCUe19p1M9S.soTJl2gHURj zT_C8yuFK1.vTxvowk0IOx5330bxd8uD0hzCGvw3qgf2Ahq.pDCRZuJfRzGbMxXjLMOLBfrReb6h IW0nfYdpQwvIlwtNtcyuSDC3LJ2JGoof6jv24CeiSrU_A07mim9smprUS8.oCF6Rfxgw1k6JMeZo Yhu.R1sSG1a8BRs9Xus3CrZ5juYKvQfzUJV5vPgW4q_cd1tRHSW63xi.h1jq4MXGXgY34NK4.Zpv 8fMix69_eel9oMx6Dbc5drR7NIX2WJGzd2rTnKcPbIVH82yAcI4fnING1Oapo.i7lvkd_Sjf0b8m y1JF1eATroiT24sDQP5zgS5kCM049QpiXnqshmjUDemnF2Z3G8oAp.59sZW6iD1MkO2at609olR2 mIj3xAgXEkLt34VMiYA-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Thu, 6 May 2021 00:18:40 +0000 Received: by kubenode544.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID ae539ec798e8ac8d2e9120c77e83a682; Thu, 06 May 2021 00:18:36 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: zpool list -p 's FREE vs. zfs list -p's AVAIL ? FREE-AVAIL == 6_675_374_080 (199G zroot pool) From: Mark Millard In-Reply-To: <34521f0b-a7a1-1743-244a-4149e72911a0@FreeBSD.org> Date: Wed, 5 May 2021 17:18:34 -0700 Cc: freebsd-current , FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <164F9986-FB9C-43A9-ABC0-0D091D2CFF3D@yahoo.com> References: <34521f0b-a7a1-1743-244a-4149e72911a0@FreeBSD.org> To: Yuri Pankov X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FbDhM1CD1z4vWr X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 00:18:43 -0000 On 2021-May-5, at 17:01, Yuri Pankov wrote: > Mark Millard via freebsd-current wrote: >> Context: >>=20 >> # gpart show -pl da0 >> =3D> 40 468862048 da0 GPT (224G) >> 40 532480 da0p1 efiboot0 (260M) >> 532520 2008 - free - (1.0M) >> 534528 25165824 da0p2 swp12a (12G) >> 25700352 25165824 da0p4 swp12b (12G) >> 50866176 417994752 da0p3 zfs0 (199G) >> 468860928 1160 - free - (580K) >>=20 >> There is just one pool: zroot and it is on zfs0 above. >>=20 >> # zpool list -p >> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ = FRAG CAP DEDUP HEALTH ALTROOT >> zroot 213674622976 71075655680 142598967296 - - = 28 33 1.00 ONLINE - >>=20 >> So FREE: 142_598_967_296 >> (using _ to make it more readable) >>=20 >> # zfs list -p zroot=20 >> NAME USED AVAIL REFER MOUNTPOINT >> zroot 71073697792 135923593216 98304 /zroot >>=20 >> So AVAIL: 135_923_593_216 >>=20 >> FREE-AVAIL =3D=3D 6_675_374_080 >>=20 >>=20 >>=20 >> The questions: >>=20 >> Is this sort of unavailable pool-free-space normal? >> Is this some sort of expected overhead that just is >> not explicitly reported? Possibly a "FRAG" >> consequence? >=20 > =46rom zpoolprops(8): >=20 > free The amount of free space available in the pool. By contrast, > the zfs(8) available property describes how much new data can = be > written to ZFS filesystems/volumes. The zpool free property is > not generally useful for this purpose, and can be substantially > more than the zfs available space. This discrepancy is due to > several factors, including raidz parity; zfs reservation, = quota, > refreservation, and refquota properties; and space set aside by > spa_slop_shift (see zfs-module-parameters(5) for more > information). Thanks for pointing to the reference material. 6_675_374_080/213_674_622_976 =3Dapprox=3D 0.03124 =3Dapprox=3D 1.0/32.0 and spa_slop_shift's description reports: QUOTE spa_slop_shift (int) Normally, we don't allow the last 3.2% (1/(2^spa_slop_shift)) of space in the pool to be = consumed. This ensures that we don't run the pool completely = out of space, due to unaccounted changes (e.g. to the MOS). = It also limits the worst-case time to allocate space. = If we have less than this amount of free space, most ZPL operations (e.g. write, create) will return ENOSPC. Default value: 5. END QUOTE So in my simple context, apparently not much else contributes and the figures are basically as expected. Thanks again. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-current@freebsd.org Thu May 6 10:07:04 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 927DA5FA0CC for ; Thu, 6 May 2021 10:07:04 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbTlD3hZ7z4WBG for ; Thu, 6 May 2021 10:07:04 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7E9175FA061; Thu, 6 May 2021 10:07:04 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7B43E5FA2A5 for ; Thu, 6 May 2021 10:07:04 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbTlD35zhz4WDl; Thu, 6 May 2021 10:07:04 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Received: from [192.168.1.12] (unknown [91.240.124.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: yuripv) by smtp.freebsd.org (Postfix) with ESMTPSA id 889CA28789; Thu, 6 May 2021 10:07:03 +0000 (UTC) (envelope-from yuripv@FreeBSD.org) Subject: Re: linking to git revisions in bugzilla To: Oleksandr Tymoshenko , Kubilay Kocak Cc: current@freebsd.org, Bugmeister References: <134b5580-360a-43c9-8c8f-2a50c2524e7e@www.fastmail.com> <36286647-e005-d289-45d6-9630d39d6430@FreeBSD.org> <20210502050310.GA4428@bluezbox.com> From: Yuri Pankov Message-ID: <267d6951-570f-43c7-ddf2-fa794362bfef@FreeBSD.org> Date: Thu, 6 May 2021 13:07:01 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <20210502050310.GA4428@bluezbox.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 10:07:04 -0000 Oleksandr Tymoshenko wrote: > Kubilay Kocak (koobs@FreeBSD.org) wrote: >> On 12/04/2021 9:02 am, Yuri Pankov wrote: >>> While filing a bug, I noticed that the help only mentions svn revision numbers, and "Preview" tab had no output when I tried putting "base ", so I'm wondering how do you link to git revisions? >> >> We'll (bugmeister) be adding parsing support for it (along with a few >> other related auto-linking things) >> >> I'd encourage people to use " " (repo = src|doc|ports) >> where short hash is at least 8 chars in the meantime. Once parsing is >> added all previous references will be linked. > > Links to git hashes should work now, please test and let us > know if feature works as expected. As Michael mentioned - preview > is a different matter, I'll try to look into it later. Hi Oleksandr, It seems to work except when the git hash starts with a digit, it then tries to link to subversion revision using all available digits at the start of the hash. Or, at least, that's what I'm seeing in preview tab, not sure if it has been fixed yet? From owner-freebsd-current@freebsd.org Thu May 6 15:17:43 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C385A624DB5 for ; Thu, 6 May 2021 15:17:43 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f45.google.com (mail-ot1-f45.google.com [209.85.210.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbcdg0qglz4mWb for ; Thu, 6 May 2021 15:17:43 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f45.google.com with SMTP id u25-20020a0568302319b02902ac3d54c25eso5194805ote.1 for ; Thu, 06 May 2021 08:17:43 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=sWBD0t8mLH386MA0vYgGstAwTxQfeKnBVEOOK8ufuow=; b=KAufBeAylJizN2rNpMkjwxVvTgn4yVueGZzkhP2v5A4/zpWWM2pjx5R+8ja5HJfhpa 7lRq0VRIlcSbDw5H6O6dYO44KY2i+aBZF1Z4iQldwYkowfGPr4LWOwUL1NlnwDFTPe7D Du4i3Nhx+R+KQXGhKdf06CoAQhr2QHwcgeCemE7MVSECa1WlBMdAXPZMyZC5WV596mN+ 2qLS12/YzZzuFc4Pz6raBCKdXjE4qPWLqZUmb/12EqF9HjEk01Bzck0sYuEnVCKYNwra aypK/UYDNPxcwvgKWCIIeIdE51RGtfryOiROm70OqXLER8+GqQ4Q66BTMVUNaGbOMQDB ULjw== X-Gm-Message-State: AOAM533tfWl/mp+oiYTZM2ta0Z5a86Ap6Zb5WdQlAqhngeCzc4gGtn1b ESLzilWEyRpE+OuLYNd9eAYWdSlgfhDptNJ87vKKR8Bc X-Google-Smtp-Source: ABdhPJzyNQXGaJasPyOCoZxwUlOEbZiz4JOftUd7XhcAZlvEa4chsF4kWrTAWoh7XWQVqKvQSGiIIQWYN20y8YfSByo= X-Received: by 2002:a9d:470c:: with SMTP id a12mr3972087otf.291.1620314261622; Thu, 06 May 2021 08:17:41 -0700 (PDT) MIME-Version: 1.0 From: Alan Somers Date: Thu, 6 May 2021 09:17:30 -0600 Message-ID: Subject: Building ZFS-based VM images To: FreeBSD CURRENT X-Rspamd-Queue-Id: 4Fbcdg0qglz4mWb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.45 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.45:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.210.45:from]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DOM_EQ_FROM_DOM(0.00)[]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[209.85.210.45:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.45:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 15:17:43 -0000 It's easy to build a UFS-based VM image just by setting WITH_VMIMAGES in release.conf and running release.sh. But what about ZFS-based images? What's the easiest way to build a ZFS-based VM image, using a pool layout similar to what the interactive installer uses? -Alan From owner-freebsd-current@freebsd.org Thu May 6 17:05:26 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 08D556280B1 for ; Thu, 6 May 2021 17:05:26 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fbg1x6pQyz4sPB for ; Thu, 6 May 2021 17:05:25 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id D5AED2BCB0 for ; Thu, 6 May 2021 17:05:25 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from [192.168.1.227] (host86-137-90-14.range86-137.btcentralplus.com [86.137.90.14]) by smtp.theravensnest.org (Postfix) with ESMTPSA id D50007BC1 for ; Thu, 6 May 2021 10:57:17 +0100 (BST) Subject: Re: WSLg update on 1-5-2021 - BSD / WSL To: freebsd-current@freebsd.org References: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> From: David Chisnall Message-ID: <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> Date: Thu, 6 May 2021 10:57:16 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 17:05:26 -0000 On 03/05/2021 22:37, Pete Wright via freebsd-current wrote: > On 5/1/21 12:42 PM, Chargen wrote: >> Dear all >> >> please note that I hope this message will be discussed to get this on the >> roadmap for FreeBSD. Perhaps there is already talk about &&  work done on >> that. >> I would like to suggest having a BSD side for Microsoft FOSS ambitions >> and >> get to know the BSD license. I hope the tech people here, know which nuts >> and bolts would be ready to boot a *BSD subsystem kernel and make that >> available on Windows 10 installations. > > I believe most of the effort make this happen lies with Microsoft - it > is their product after all. > > WSL under the covers is Hyper-V which supports FreeBSD pretty well. I > believe most of the work would be on the Windows side to get the > plumbing in place to spin up a FreeBSD VM.  There are open discussions > on the WSL github system where people have asked for this but it has not > gained much traction by Microsoft. [ Disclaimer: I work for Microsoft, but not on WSL and this is my own opinion ] WSL is actually two things. WSL1 is similar to the FreeBSD Linuxulator: it is a Linux syscall ABI in the NT kernel that implements *NIX abstractions that are not present in NT and forwards other things to corresponding NT subsystems. Like the Linuxulator, it lacks a bunch of features (e.g. seccomp-bpf support, which is required for things like Docker and Chrome) and is always playing catch-up with Linux. I'd personally love to see a FreeBSD version of this (though I'd be 90% happy if ^T did the *BSD thing), but it's something that only Microsoft can do and is currently quite difficult because the picoprocess abstraction in the NT kernel only allows one kind of picoprocess and so it would need to add a new abstraction layer to support both. WSL2 is a lightweight Hyper-V VM that is set up to integrate tightly with the host. This includes: - Aggressively using the memory ballooning driver so that a VM can start with a very small amount of committed memory and grow as needed. - Using Hyper-V sockets to forward things between the guest and the host. - Using 9p-over-VMBus (which, I hope, will eventually become VirtIO-over-VMBus, but I don't know of any concrete plans for this) to expose filesystems from the host to the fuest) - Starting using the LCOW infrastructure, which loads the kernel directly rather than going via an emulated UEFI boot process. FreeBSD is currently missing the balloon driver, I believe, has a Hyper-V socket implementation contributed by Microsoft (Wei Hu), and has a 9p-over-VirtIO implementation that could probably be tweaked fairly easily to do 9p-over-VMBus. The WSL2 infrastructure is designed to make it possible to bring your own kernel. I think FreeBSD would need to support the Linux boot protocol (initial memory layout, mechanism for passing kernel arguments in memory) to fit into this infrastructure, but that wouldn't require any changes to any closed-source components. Whether Microsoft or the FreeBSD project should do the work really comes down to who has more to gain. Windows 10 is installed on around a 1.3 billion devices and any of these users can run Ubuntu with a single click in the Microsoft Store, so it feels as if the FreeBSD project has a lot to gain from being able to reach them. If you believe that FreeBSD provides a better experience (I certainly believe it provides a better developer experience) than Ubuntu, then making it easy to reach every Windows users is of huge value to the FreeBSD project and community. Microsoft, in contrast, is driven by requests from customers who spend money on our products and services. Around a hundred people commented on the WSL issue to add FreeBSD support. If you assume that 1% of people who want the feature commented, then this gives around 10,000 folks who really want a FreeBSD equivalent of WSL. It's pretty hard to justify a feature in Windows that only 0.001% of Windows users will use. If you want to change that arithmetic, then next time your organisation is renewing M365 or Azure service subscriptions, tell your sales rep that FreeBSD support is important to your company. If, for example, a large company is spending a lot with a different cloud provider because they have better FreeBSD support than Azure, then that's the kind of thing that can be used to justify investing in FreeBSD. Currently, from what I know of FreeBSD deployments in Azure, Microsoft is already investing a disproportionate amount in FreeBSD relative to the number of users. WSL makes it easy for folks to develop on Windows and deploy in Azure. A lot of people are running Linux in Azure and so there's a big incentive to make this seamless. If a load of people are deploying FreeBSD on Azure and can't develop on Windows as easily, that's an incentive for Microsoft to improve the FreeBSD client-side integration. David From owner-freebsd-current@freebsd.org Thu May 6 18:09:19 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 62B2162A080 for ; Thu, 6 May 2021 18:09:19 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbhRd6wfhz4w9D for ; Thu, 6 May 2021 18:09:17 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 5B88F5C010F for ; Thu, 6 May 2021 14:09:17 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Thu, 06 May 2021 14:09:17 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=6WmfRuELXACeyGQtKo/LI6ltYUB 04GNPNQ55thdD7yE=; b=H05kmG9gOlP7XTvf8EnQN9eTgJtTDRFa5Trq5lwjC9h tqj/Ub+OAvYPKwVJDlZwTIaD9kNoN61h9+rEit8hsVzfobuC/+FKdvgy57ggUznm KzlU4tmf8gUH8mvQDIISbQzsTrCKUTfjI2xa2+ttXf/MkUFdCFmN343r+zH/n6wh oS1sBN3VEfUsTgXlEaw072HkYPjHC3KFs4+TbmSd0cFhhpWZMIwsHJXyof5YQr16 1JWYg2I88uIOo74rXLtkFifCLDlQuU5mMffc5reKldcxzlIBfLypRlE4zIMHjoP8 4ObHeXijMHKFiZQqxaEKoNFJOY8Escj6Co7bYebS1zQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=6WmfRu ELXACeyGQtKo/LI6ltYUB04GNPNQ55thdD7yE=; b=B0nFytGxxbv8/jjFiQ2R48 EGhHf39/93+RIwsDgJ72ee7eftK5Ipd6Qmd2dIfswwwtkfSqEOYGf0L886fnBQ7F BeYCD0O0MH3gAMuPS9JqrWHjMcqQ8mjG6h1VHGWhKcGzQPzSf964e4zwBAxlB04G 49IT+oMlUGOFsNmLEgfZGuxix4whk9udL3xJ/k3yrDNWr1GQJhSFJCIYJUWlN4uu f8Cr3c9IqdJkZlwqYXeZ8y+NV6S9y5OC87BFjKvbLjCrr32MmwygC1mpRBC/gYg4 rDQqTTVFuOgzFu0wq9oIwIEgZ6EBZac4i3K+GmQrIxLPY40Wx327R0dTNw93EGvA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdegtddguddvvdcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehgtd erredttddvnecuhfhrohhmpehtvggthhdqlhhishhtshcuoehtvggthhdqlhhishhtshes iiihgihsthdrnhgvtheqnecuggftrfgrthhtvghrnheptdehiefgvddufeekkedvtdefvd ettddtkeduvdegveelffdtkeffudejvdfhudetnecukfhppeekledrudeghedruddttddr udefleenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpe htvggthhdqlhhishhtshesiiihgihsthdrnhgvth X-ME-Proxy: Received: from cloud.zyxst.net (v007.zyxst.net [89.145.100.139]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 6 May 2021 14:09:16 -0400 (EDT) Date: Thu, 6 May 2021 19:09:15 +0100 From: tech-lists To: freebsd-current@freebsd.org Subject: Re: Building ZFS-based VM images Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="1TVpywHtPl66k54C" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FbhRd6wfhz4w9D X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=H05kmG9g; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=B0nFytGx; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.25:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.25:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.25:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 18:09:19 -0000 --1TVpywHtPl66k54C Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, May 06, 2021 at 09:17:30AM -0600, Alan Somers wrote: >It's easy to build a UFS-based VM image just by setting WITH_VMIMAGES in >release.conf and running release.sh. But what about ZFS-based images? >What's the easiest way to build a ZFS-based VM image, using a pool layout >similar to what the interactive installer uses? >-Alan Hi,=20 I don't know of a way with make release Briefly, the way I do zfs on amd64 vm is (given you're already set up on bh= yve): a: truncate -s 64G filename.img b: sh vmrun.sh -c 4 -m 32768M -t tap1 -d filename.img -i -I freebsd-installer.iso vmname c: run through the installer, selecting auto-zfs on the way. d: stop the reboot, run the vmrun.sh again and omit the -i -I=20 freebsd-installer.iso bit (in my context, vmrun.sh is a symlink to /usr/share/examples/bhyve/vmrun.sh in the dir i'm working in) [section 22.7 FreeBSD as a Host with bhyve] --=20 J. --1TVpywHtPl66k54C Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCUMMIACgkQs8o7QhFz NAWSHg//QX6gBWmp27ChfZm4KmW84rNPqT/lvm2kyESQ9rt2E4NghrwU5mY2dHa2 8ziNFn6zorOVhAP4CUXPxZvcF8P/7QMtITGheG3/qEnFFnh1Mx3sPn8Hcb4FPAjc vrYWkTWqYEaEaP+ktdtxDVgaDBW8cpiSgRI/mrHzszxRk9wodECbafQ288IPchyj ThOu9SHmM2WFh9t/xwRnWMhuS5MEMV9c2Iyw3kF6OdLdRuxpcdd+ao+qw+ZCIRmf ZXXX8VmDbAigwdOj9i5nJb/1Bph/fUTZdp4crGm/HGW/5aoiu05BmO6U9Hpjdlh0 CphqlU9Bt8wphV/6C4cDuszYIxDPj9EX0jtk1ZOMq2xupi/6fFPjKd3+b+plsZPy V7PaVvVXy5Qy8MR1zcr1vhe7otkg4HbVYkJ/x+7oMVaSpBbwmiyh4mGy3nuRacHU 0FqC8Lfv4JtGXMSxUN/NEMJgK7OxwFe3qQSN8/DEM9sFOmSS4yJNqUcBUR1TDEBX PLjjymfJSDhgKFUUqA7XQCN77XmiOwh5mpjxbPMfZuXHSULu8u7HdGhwacXhHIEt jQdGhjMVfKZwNDqE6zwL9ByHVGcCa+X+TLEChSnitohTdvs7B+JCBqwVDTbCONJU /0Wt0IW3jmomw5aVe7LNW6bFpVW0GsibCiuA3UdI6rQTokPBEN8= =GY53 -----END PGP SIGNATURE----- --1TVpywHtPl66k54C-- From owner-freebsd-current@freebsd.org Thu May 6 21:25:04 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F96962E475 for ; Thu, 6 May 2021 21:25:04 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbmnX3jZGz55Ky for ; Thu, 6 May 2021 21:25:04 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7DABF62E474; Thu, 6 May 2021 21:25:04 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7D78062E6B8 for ; Thu, 6 May 2021 21:25:04 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbmnX3Bsvz54s9 for ; Thu, 6 May 2021 21:25:04 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: from aniel.nours.eu (ns393929.ip-176-31-115.eu [176.31.115.77]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: bapt) by smtp.freebsd.org (Postfix) with ESMTPSA id 4876D2CEF1 for ; Thu, 6 May 2021 21:25:04 +0000 (UTC) (envelope-from bapt@FreeBSD.org) Received: by aniel.nours.eu (Postfix, from userid 1001) id DF3C14065A; Thu, 6 May 2021 23:25:01 +0200 (CEST) Date: Thu, 6 May 2021 23:25:01 +0200 From: Baptiste Daroussin To: current@freebsd.org Subject: Incoming changes in the sh(1) default behaviour Message-ID: <20210506212501.sm33y4on3pbattjj@aniel.nours.eu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 21:25:04 -0000 Hello everyone We have been working implementing the persistent history storage in sh(1). It will now respect POSIX: - by default the history will be saved and loaded from ~/.sh_history - if HISTFILE is set it will use histfile instead of ~/.sh_history - if HISTFILE is set but empty it will not load or save anything - if HISTSIZE is set to 0 it will also not load or save anything The change will be pushed very soon to head and probably not be MFC except if someone manage to convince me otherwise. https://reviews.freebsd.org/D29493 Best regards, Bapt From owner-freebsd-current@freebsd.org Fri May 7 10:17:45 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0A1C55FFA0C for ; Fri, 7 May 2021 10:17:45 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc5x46fZgz4Qt2; Fri, 7 May 2021 10:17:44 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: by mail-wr1-x433.google.com with SMTP id h4so8611167wrt.12; Fri, 07 May 2021 03:17:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:date:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=AXP9ewQWEaxy7FOxthv1PkbrmzYl9j6nUhGrb4yurt0=; b=l2iMPDbZ2B82xZJL9D/NxJObDVnYzrE91IznWjIueRjZb6Knua/4qXNXMEo4EnuBoB UWFUNSzFgTm/cL2Nl4aYnD41OOHnUq4WDU9HtSFdbl7E85dHHI2kum0qzzjt/Cjs95vT SnW34DF3Ulj1qUYlXEVuEN3KO4nLKyFwOdNNxzI/Ad4CW18fKyrUfUd3Csb2VJKZ6j2j A4ZFcQ2W5QgVzj4tLAX4lGvCsHdXVRv4kuVUJNE+MdVTGiwfMRIC29IX3RfLXDsmFr1b 1NzKrM19o/F/w7LjeXkMAPtJr78woZ8lHgFD+UkhZczIK3tp9ee+Ed48obPaKCSIhMM1 Xppw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:date:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=AXP9ewQWEaxy7FOxthv1PkbrmzYl9j6nUhGrb4yurt0=; b=Kcp8PHTwU2aIbVa+L7Y2Dn1+AhkqzXGXmyw5BXVjxxgIuZUCsK4Unz9/HbDQw6Mcb3 7mRKZEvDN13co6zFtbmHgrKgayuq7ruKbhPPWBPBQw5yDcHfTCEO/6CxxEz1K1kNi5jr mul17Ty7A52No+cvDBmCA9Hcx9Os8+3hCwBxwQeWzPEpFrtGhylwiK5nCT8j+d9rxtiW N2XqPe0UCGOmxcCMfy3cDa4arDXJ1Sy1Q2JJY9Jxb0Q3awaQIx1Kq6nOB5EjizZ3hV28 lBdrIiHa8+zooUlFMCdEeE9fjfezgiF/yk5qEPLWCw3j8tJ4jdQc5+we8S5lHMiFTtWq euqA== X-Gm-Message-State: AOAM530BTst8H5QAS5nm2U3GBHfflFTwvmhyXssGkyA1PUiAxCTQAg39 VMrKPEenRkgeO2BC4yb88ADlloWDqKM7y2C4 X-Google-Smtp-Source: ABdhPJwqFcBgwzw0SF3tJwnCw19RlcLEGsY/vU2gk8WRx1NTQ6lmZYzB++UZeTzBPsrTgNTHUlS4Rw== X-Received: by 2002:a05:6000:1a85:: with SMTP id f5mr11186086wry.213.1620382663244; Fri, 07 May 2021 03:17:43 -0700 (PDT) Received: from rimwks.local ([2001:470:1f15:3d8:7285:c2ff:fe37:5722]) by smtp.gmail.com with ESMTPSA id j13sm7844254wrw.93.2021.05.07.03.17.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 May 2021 03:17:42 -0700 (PDT) From: Rozhuk Ivan X-Google-Original-From: Rozhuk Ivan Date: Fri, 7 May 2021 13:17:41 +0300 To: David Chisnall Cc: freebsd-current@freebsd.org Subject: Re: WSLg update on 1-5-2021 - BSD / WSL Message-ID: <20210507131741.47f3aab9@rimwks.local> In-Reply-To: <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> References: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Fc5x46fZgz4Qt2 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 10:17:45 -0000 On Thu, 6 May 2021 10:57:16 +0100 David Chisnall wrote: > Whether Microsoft or the FreeBSD project should do the work really > comes down to who has more to gain. Windows 10 is installed on > around a 1.3 billion devices and any of these users can run Ubuntu > with a single click in the Microsoft Store, so it feels as if the > FreeBSD project has a lot to gain from being able to reach them. Make job for free - make more money for MS. Make win10 to support more features to increase windows value... > If you believe that FreeBSD provides a better experience (I certainly > believe it provides a better developer experience) than Ubuntu, then > making it easy to reach every Windows users is of huge value to the > FreeBSD project and community. Manipulation detected. > Microsoft, in contrast, is driven by requests from customers who > spend money on our products and services. > Around a hundred people > commented on the WSL issue to add FreeBSD support. Ok, do you job and add FBSD support to WSL. > If you assume > that 1% of people who want the feature commented, then this gives > around 10,000 folks who really want a FreeBSD equivalent of WSL. They give money to MS, they ask MS to do job for money. > It's pretty hard to justify a feature in Windows that only 0.001% of > Windows users will use. If you want to change that arithmetic, then > next time your organisation is renewing M365 or Azure service > subscriptions, tell your sales rep that FreeBSD support is important > to your company. There is many other hosting services that have FBSD support. So this is MS/azure problem. From owner-freebsd-current@freebsd.org Fri May 7 11:33:32 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 16440629C0D for ; Fri, 7 May 2021 11:33:32 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fc7cX06nzz4VBj for ; Fri, 7 May 2021 11:33:32 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 041E4629DA0; Fri, 7 May 2021 11:33:32 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 03EAD629D9F for ; Fri, 7 May 2021 11:33:32 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc7cW6mxSz4VH6 for ; Fri, 7 May 2021 11:33:31 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id C0C874AAA for ; Fri, 7 May 2021 11:33:31 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 2D84B3D3F for ; Fri, 7 May 2021 14:33:28 +0300 (MSK) To: current@freebsd.org Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame Organization: FreeBSD Message-ID: Date: Fri, 7 May 2021 14:33:27 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 11:33:32 -0000 Several versions of 14-CURRENT (including FreeBSD-14.0-CURRENT-amd64-20210506-49c894ddced-246502-memstick.img) can not boot on Lenovo T540p 19 times out of 20. It crashes on device detection, after detecting sound subsystem, with traps 9 and 12 (9 is more often) and mostly with this stacktrace (9 out of 10 crashes have this stacktrace: -- trap run_interrupt_driven_config_hooks() boot_run_interrupt_driven_config_hooks() mi_startup() btext() But twice I've got more interesting stacktraces: -- trap strlen() kvprintf() vsnprintf() vpanic() panic() __mtx_lock_flags() _sleep() mmc_wait_for_request() mmc_wait_for_cmd() mmc_go_discovery() mmc_delayed_attach() run_interrupt_driven_config_hooks() boot_run_interrupt_driven_config_hooks() mi_startup() btext() --- trap __mtx_lock_sleep() __mtx_lock_flags() mmc_wakeup() rtsx_intr() ithread_loop() fork_exit() fork_trampoline() Looks like there is problem with rtsx driver! I've checked memory with memtest86+ for 24 hours (4.5 passes) without any problems. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 11:36:48 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BE4DF629DDB for ; Fri, 7 May 2021 11:36:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fc7hJ5036z4VSy for ; Fri, 7 May 2021 11:36:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id A963F629F21; Fri, 7 May 2021 11:36:48 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A92B1629C3F for ; Fri, 7 May 2021 11:36:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc7hJ4RN2z4Vcp for ; Fri, 7 May 2021 11:36:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 717153ADB for ; Fri, 7 May 2021 11:36:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 0288F3D41 for ; Fri, 7 May 2021 14:36:46 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame From: Lev Serebryakov To: current@freebsd.org References: Organization: FreeBSD Message-ID: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> Date: Fri, 7 May 2021 14:36:46 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 11:36:48 -0000 On 07.05.2021 14:33, Lev Serebryakov wrote: >   Looks like there is problem with rtsx driver! Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! And console on these crashes is totally dead, and disks are not detected yet, so I can not look at structures in memory and/or dump core. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 12:01:15 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DC73662AFA3 for ; Fri, 7 May 2021 12:01:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fc8DW5khBz4WpB for ; Fri, 7 May 2021 12:01:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id C2B7B62AF5A; Fri, 7 May 2021 12:01:15 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C276D62ACCE for ; Fri, 7 May 2021 12:01:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc8DW5C6bz4WfV; Fri, 7 May 2021 12:01:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 901D14D3D; Fri, 7 May 2021 12:01:15 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 0D3F33D4E; Fri, 7 May 2021 15:01:13 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! From: Lev Serebryakov To: current@freebsd.org, jsm@FreeBSD.org, gj@freebsd.org, hlh@restart.be References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> Organization: FreeBSD Message-ID: <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> Date: Fri, 7 May 2021 15:01:13 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 12:01:15 -0000 On 07.05.2021 14:36, Lev Serebryakov wrote: >>    Looks like there is problem with rtsx driver! >  Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! > >  And console on these crashes is totally dead, and disks are not detected yet, so I can not look at structures in memory and/or dump core. 13.0-RELEASE installation media crashes in same way if SD reader is enabled in BIOS. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 13:07:54 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C6B7D62CB93 for ; Fri, 7 May 2021 13:07:54 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Fc9jQ4d9cz4ZSs for ; Fri, 7 May 2021 13:07:54 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: by mailman.nyi.freebsd.org (Postfix) id 9ED7E62CB92; Fri, 7 May 2021 13:07:54 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9EA0D62CA50 for ; Fri, 7 May 2021 13:07:54 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc9jQ2BY6z4Zh1; Fri, 7 May 2021 13:07:53 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 147D7kJX049140; Fri, 7 May 2021 06:07:46 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 147D7jRc049139; Fri, 7 May 2021 06:07:45 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202105071307.147D7jRc049139@gndrsh.dnsmgr.net> Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! In-Reply-To: <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> To: lev@freebsd.org Date: Fri, 7 May 2021 06:07:45 -0700 (PDT) CC: current@freebsd.org, jsm@freebsd.org, gj@freebsd.org, hlh@restart.be X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4Fc9jQ2BY6z4Zh1 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:07:54 -0000 > On 07.05.2021 14:36, Lev Serebryakov wrote: > > >> ?? Looks like there is problem with rtsx driver! > > ?Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! > > > > ?And console on these crashes is totally dead, and disks are not detected yet, so I can not look at structures in memory and/or dump core. > > 13.0-RELEASE installation media crashes in same way if SD reader is enabled in BIOS. Is this with or without media in the SD reader? I have issues with rtsx on a Dell 5740 in that if the media in in the drive during boot it times out the rtsx probe, but after the system is up if I eject and re-insert the media it comes on line and works fine. Also if I try to boot from that media it gets all the way to mountroot, which then fails cause the device did not pass probe, but if I eject, and reinsert and then type in the path to root it does continue to boot and properly start up. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Fri May 7 13:22:20 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1B6D462D13B for ; Fri, 7 May 2021 13:22:20 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcB236LTZz4bL3 for ; Fri, 7 May 2021 13:22:19 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id D9C6B62CD58; Fri, 7 May 2021 13:22:19 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D98F462CDE7 for ; Fri, 7 May 2021 13:22:19 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mail-wr1-x429.google.com (mail-wr1-x429.google.com [IPv6:2a00:1450:4864:20::429]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcB235XjLz4bV9; Fri, 7 May 2021 13:22:19 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mail-wr1-x429.google.com with SMTP id h4so9229675wrt.12; Fri, 07 May 2021 06:22:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :mime-version:content-transfer-encoding; bh=7O34Pe6J08Me5j3mCMN8iv84d3xMBVy6nQ+i4mE2it4=; b=dZHc57ON97D6mq0b1UD0Mnc5DzRF0qIu2mGL6EJP0x1E154LmJgnioADFfHjQ1tFZX ilVWuuygimHBAb925PKyWsyFqDuQCMsPOBm3w9yTxxqc75Qui4CClgBYHDG1g59yNQ1w REcQh3nZ+lyBK8DcLI7wQf1t/uadXoulWmBxXCzOfKh/VR/R4dE52PJu1ln6oQ/ToUPH B083zVZUPwVB1lwB2O2biVQd+gHEQQG/y3RKDRAHBAdbJEvUGhwlQB3AQnhyJV0K8Rt4 4H6ga1ym41wsWQgq0EsigrvTI4iEVjxX2Nr6nRCobIwlSYVLqw4Ac0o6bbX2xa9ye8HC Te0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:reply-to:mime-version:content-transfer-encoding; bh=7O34Pe6J08Me5j3mCMN8iv84d3xMBVy6nQ+i4mE2it4=; b=Sja3IcHwa2WVYPfFqt7JXlJ2vxuTt9GN5v4QC+DphVopEM5CZ0lrB0vgq8lgCR5m1o DSuibYVxTaOZLaaG7ylkhDJYSYX7Xz1C3ko+5NP15mYZej9htZiA3oeu5h7FR8GZV5i/ Bfpu/uyEuYAWY91ZXPSA0FjYJxj3lYqVAj1smHgKiRuCqyVhzHYt+SFsNBpF20lfVygM MnK9GI9hWYOS/T0j1CkR7SbKSRApgFG1+YUy0f9T1SDS2bck0fc/zG5pv4eB0YW7/svB O8aJxJP68YS9TSKqIencn6BU7C+iMjVgqk3WG+PspviXz+cZEb/61CsN4eefFaxbzj4u Wgag== X-Gm-Message-State: AOAM5300973onUFn3sCUNHPs1Ccbx37+Sv1lEko3wRd3vPWuVJ02kEeD VxmnD8UtKYAMoOrqEjFrmyC3J+hxsgk= X-Google-Smtp-Source: ABdhPJz5Kw6e1aXMO2kaNNaMTY3JqzcU9OwhYdRvQ834c5AJ/Bdynxo+CLorQi+H5aUIJtNqLkjANg== X-Received: by 2002:a5d:64e5:: with SMTP id g5mr12578991wri.30.1620393737540; Fri, 07 May 2021 06:22:17 -0700 (PDT) Received: from ernst.home (pd9e23d76.dip0.t-ipconnect.de. [217.226.61.118]) by smtp.gmail.com with ESMTPSA id z6sm6676108wmf.9.2021.05.07.06.22.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 May 2021 06:22:17 -0700 (PDT) Date: Fri, 7 May 2021 15:22:15 +0200 From: Gary Jennejohn To: Lev Serebryakov Cc: current@freebsd.org, jsm@FreeBSD.org, hlh@restart.be Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! Message-ID: <20210507132215.2469c296@ernst.home> In-Reply-To: <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> Reply-To: gljennjohn@gmail.com X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcB235XjLz4bV9 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:22:20 -0000 On Fri, 7 May 2021 15:01:13 +0300 Lev Serebryakov wrote: > On 07.05.2021 14:36, Lev Serebryakov wrote: > > >> Looks like there is problem with rtsx driver! > > Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! > > > > And console on these crashes is totally dead, and disks are not > > detected yet, so I can not look at structures in memory and/or > > dump core. > > 13.0-RELEASE installation media crashes in same way if SD reader is > enabled in BIOS. > I see that rtsx was added to GENERIC. Might have been premature. The only thing I can recommend is to install with the SD card reader disabled in the BIOS. It may be the case that rtsx still works even if the card reader is disabled in the BIOS. That's the first thing I would try out. If that fails then generate a kernel with rtsx as a module rather than it being hard coded into the kernel. You could then re-enable the SD card reader in the BIOS and load the module to check whether the SD card reader works or causes a panic when the moduke is loaded. This approach might make it possible to get a crash dump if a problem occurs. -- Gary Jennejohn (gj@freebsd.org) From owner-freebsd-current@freebsd.org Fri May 7 13:31:42 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F1B362DB13 for ; Fri, 7 May 2021 13:31:42 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcBDt04mcz4c8p for ; Fri, 7 May 2021 13:31:42 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id D8FFF5C68 for ; Fri, 7 May 2021 13:31:41 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from [192.168.1.227] (host86-137-90-14.range86-137.btcentralplus.com [86.137.90.14]) by smtp.theravensnest.org (Postfix) with ESMTPSA id EE3D07C05 for ; Fri, 7 May 2021 14:31:40 +0100 (BST) Subject: Re: WSLg update on 1-5-2021 - BSD / WSL To: freebsd-current@freebsd.org References: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> <20210507131741.47f3aab9@rimwks.local> From: David Chisnall Message-ID: Date: Fri, 7 May 2021 14:31:39 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <20210507131741.47f3aab9@rimwks.local> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:31:42 -0000 On 07/05/2021 11:17, Rozhuk Ivan wrote: > On Thu, 6 May 2021 10:57:16 +0100 > David Chisnall wrote: > > >> Whether Microsoft or the FreeBSD project should do the work really >> comes down to who has more to gain. Windows 10 is installed on >> around a 1.3 billion devices and any of these users can run Ubuntu >> with a single click in the Microsoft Store, so it feels as if the >> FreeBSD project has a lot to gain from being able to reach them. > > Make job for free - make more money for MS. > Make win10 to support more features to increase windows value... How much money? 'Making money' doesn't just mean money coming in, it means more money coming in than is going out. Adding features to a product costs money. How many people will buy Windows 10 if it has a good FreeBSD compatibility layer who wouldn't buy it without one? I very much doubt that this is a sufficient number to cover the cost of the engineering work. >> Microsoft, in contrast, is driven by requests from customers who >> spend money on our products and services. >> Around a hundred people >> commented on the WSL issue to add FreeBSD support. > > Ok, do you job and add FBSD support to WSL. First, this is nowhere near even related to my job. I don't work on Windows, let alone WSL. Second, I have already explained why this is not a sufficiently large market to impact engineering decisions. >> If you assume >> that 1% of people who want the feature commented, then this gives >> around 10,000 folks who really want a FreeBSD equivalent of WSL. > > They give money to MS, they ask MS to do job for money. They give money to MS, they get a Windows 10 license in return. They are happy to buy Windows without a FreeBSD compat layer. They are buying Windows on the basis of some subset of a large number of features. The lack of a FreeBSD compat layer is not preventing them from buying Windows, they have not shown that this is the deal-breaker feature. Microsoft, like any other POTS software vendor, will prioritise features that impact the most customers. There are things on User Voice with tens or hundreds of thousands of votes and these tend to be prioritised. Something with under a hundred votes is so niche that it's only going to be a target of investment if it impacts another product or service. >> It's pretty hard to justify a feature in Windows that only 0.001% of >> Windows users will use. If you want to change that arithmetic, then >> next time your organisation is renewing M365 or Azure service >> subscriptions, tell your sales rep that FreeBSD support is important >> to your company. > > There is many other hosting services that have FBSD support. > So this is MS/azure problem. Azure already officially supports FreeBSD and we have contributed a load of code to improve that support over the years. From the numbers I've seen, I strongly suspect that we've spent more on it than we've gained in revenue. You are asking Microsoft to throw money at a thing that will definitely cost time and money (and comes with the associated opportunity cost, because developer time spent on this features is developer time not spent on other features) but with no clear indication that it will increase revenue. Effectively, you are asking us to do work for free and you're also doing so quite rudely. Personally, I'd love to have a FreeBSD compat layer. The license would even make it possible to embed the FreeBSD kernel in Windows and so get the best aspects of WSL1 and WSL2. From a business perspective; however, I can't argue that this would be a great use of engineer time. There are a load of features that would positively impact a lot more users that would be higher priority. If you want this to happen and you want Microsoft to do it, then you need to help people inside the company provide this business case. Things that don't help include: - I want it. - You suck for not doing it. - It would make you money in unspecified ways. Things that do help include: - We are a FreeBSD shop with 1,000 workstations, we would switch to Windows on the desktop with this feature. - We are a large cloud customer with 10,000 VMs deployed, we would switch to Azure with this feature. - We are a Windows shop with a load of desktops but are planning to switch to Macs because we want a BSD-style userland. If you just want it to happen, then you don't need Microsoft to do anything. All of the code required to build a Linux system that integrates with WSL2 is open source and you can implement something compatible for FreeBSD. You can probably even skip a bunch of the boot requirements by using Linux as a bootloader and having a tiny Linux image that just kexecs a FreeBSD kernel. David From owner-freebsd-current@freebsd.org Fri May 7 13:37:57 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 19A6462DCC2 for ; Fri, 7 May 2021 13:37:57 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcBN50G6Rz4cS7 for ; Fri, 7 May 2021 13:37:57 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id E9EFB58AC for ; Fri, 7 May 2021 13:37:56 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from [192.168.1.227] (host86-137-90-14.range86-137.btcentralplus.com [86.137.90.14]) by smtp.theravensnest.org (Postfix) with ESMTPSA id 74A3B7C06 for ; Fri, 7 May 2021 14:37:56 +0100 (BST) Subject: Re: Building ZFS-based VM images To: freebsd-current@freebsd.org References: From: David Chisnall Message-ID: <44ec6a39-82bc-82a9-4e16-431feeafcd38@FreeBSD.org> Date: Fri, 7 May 2021 14:37:55 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:37:57 -0000 On 06/05/2021 16:17, Alan Somers wrote: > It's easy to build a UFS-based VM image just by setting WITH_VMIMAGES in > release.conf and running release.sh. But what about ZFS-based images? > What's the easiest way to build a ZFS-based VM image, using a pool layout > similar to what the interactive installer uses? The only way that I've deployed FreeBSD VMs in Azure has been to run the installer in Hyper-V locally and then upload it as a template. You need to be *really* careful with this mode though, because ZFS gets really confused if two pools or two VDEVs have the same UUIDs. This means that you can't just attach one VM's disk to another for recovery (I also have a UFS image that I use for recovery). It would be great if it were possible to set a flag somewhere telling the storage subsystem to regenerate the UUIDs of everything (including GPT partitions) on first boot. David From owner-freebsd-current@freebsd.org Fri May 7 13:50:21 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 96F3162E3C4 for ; Fri, 7 May 2021 13:50:21 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcBfN2z6Jz4d3g for ; Fri, 7 May 2021 13:50:20 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 61B132600FB for ; Fri, 7 May 2021 15:50:17 +0200 (CEST) To: FreeBSD Current From: Hans Petter Selasky Subject: Patch for patch, but not foreach :-) Message-ID: Date: Fri, 7 May 2021 15:49:00 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcBfN2z6Jz4d3g X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-3.30 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:4f8:c17:6c4b::2:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a01:4f8:c17:6c4b::2:from:127.0.2.255]; DMARC_NA(0.00)[selasky.org]; TO_DN_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:50:21 -0000 Time has come that I make a patch for the most central patching tool in FreeBSD, patch :-) https://reviews.freebsd.org/D30160 --HPS From owner-freebsd-current@freebsd.org Fri May 7 13:54:03 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 64EAE62E89E for ; Fri, 7 May 2021 13:54:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcBkg2Lfpz4dGR for ; Fri, 7 May 2021 13:54:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 4EC6562E7C8; Fri, 7 May 2021 13:54:03 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E8E462E7C7 for ; Fri, 7 May 2021 13:54:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcBkg1lR8z4dd9; Fri, 7 May 2021 13:54:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 18E915B54; Fri, 7 May 2021 13:54:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 40ADE3D7C; Fri, 7 May 2021 16:54:01 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! To: "Rodney W. Grimes" Cc: current@freebsd.org, jsm@freebsd.org, gj@freebsd.org, hlh@restart.be References: <202105071307.147D7jRc049139@gndrsh.dnsmgr.net> From: Lev Serebryakov Organization: FreeBSD Message-ID: Date: Fri, 7 May 2021 16:54:00 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <202105071307.147D7jRc049139@gndrsh.dnsmgr.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:54:03 -0000 On 07.05.2021 16:07, Rodney W. Grimes wrote: >>>> ?? Looks like there is problem with rtsx driver! >>> ?Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! >>> >>> ?And console on these crashes is totally dead, and disks are not detected yet, so I can not look at structures in memory and/or dump core. >> >> 13.0-RELEASE installation media crashes in same way if SD reader is enabled in BIOS. > > Is this with or without media in the SD reader? It is without media in reader. I'll try with media later, as now I'm rebuilding kernel to latest CURRENT. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 13:59:39 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3A28762EC35 for ; Fri, 7 May 2021 13:59:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcBs715nbz4dfT for ; Fri, 7 May 2021 13:59:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2400062EC34; Fri, 7 May 2021 13:59:39 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 23CAC62EB3E for ; Fri, 7 May 2021 13:59:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcBs70XrSz4dTG; Fri, 7 May 2021 13:59:39 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id DEF8A5C74; Fri, 7 May 2021 13:59:38 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 253163D7F; Fri, 7 May 2021 16:59:36 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! To: gljennjohn@gmail.com Cc: current@freebsd.org, jsm@FreeBSD.org, hlh@restart.be References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> <20210507132215.2469c296@ernst.home> From: Lev Serebryakov Organization: FreeBSD Message-ID: <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> Date: Fri, 7 May 2021 16:59:35 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <20210507132215.2469c296@ernst.home> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 13:59:39 -0000 On 07.05.2021 16:22, Gary Jennejohn wrote: >>>> Looks like there is problem with rtsx driver! >>> Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! >>> >>> And console on these crashes is totally dead, and disks are not >>> detected yet, so I can not look at structures in memory and/or >>> dump core. >> >> 13.0-RELEASE installation media crashes in same way if SD reader is >> enabled in BIOS. >> > > I see that rtsx was added to GENERIC. Might have been premature. > > The only thing I can recommend is to install with the SD card reader > disabled in the BIOS. Yep, it works. Not only install, but booting of installed system too — any GENERIC kernel panics, even new, built by hands from latest sources. > It may be the case that rtsx still works even if the card reader is > disabled in the BIOS. That's the first thing I would try out. Nope, it doesn't work (and I don't need it on this Laptop, to be honest). If SD reader is disabled in BIOS, it isn't detected at all. > If that fails then generate a kernel with rtsx as a module rather than > it being hard coded into the kernel. > > You could then re-enable the SD card reader in the BIOS and load the > module to check whether the SD card reader works or causes a panic > when the moduke is loaded. This approach might make it possible to > get a crash dump if a problem occurs. Ok, I'll try this, good idea. BTW, I've got hints that it it rtsx-related only after ~40 crashes, as most of stack traces don't have rtsx in them and are very generic. Looks like rtsx mangle kernel memory and it crashes in other places/kernel threads. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 14:08:34 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0AEBD62F2AB for ; Fri, 7 May 2021 14:08:34 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcC3P1mZTz4fQq for ; Fri, 7 May 2021 14:08:33 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 3A8F062ED3B; Fri, 7 May 2021 14:08:33 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3A0CC62ED3A for ; Fri, 7 May 2021 14:08:33 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcC3N4PKZz4f45; Fri, 7 May 2021 14:08:32 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mail-ed1-x52d.google.com with SMTP id s6so10345393edu.10; Fri, 07 May 2021 07:08:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :mime-version:content-transfer-encoding; bh=W5N61Cz7UihzHsoF80sPZb8Ps0MC1zZyh61f3FHeFj8=; b=nCDMIIh3v0Aoq54C5CLUCXdafL3c9CIaajdU9x8xhuzvgGU0dNdqC8DOElE76/xFsd YrwV7zS/m8HcSUP6TQHc2nLqtEXSP63jyZre9OATC5DD1WBI2cnzkPpbgEdFFmuRXxyF NH4/iIWwR2UbMtzL0ViD+5c9h3xc/J7TziS/WWUZy2Mw6buGPmyLmYvHDR/TYcjVrf3d 1QdDYPWxkqaS5lbFjNXCpk0FoUuy2itQnkEdu6Hv53vcIjKb44EcBrLeMYwfPPunLJcY yHTjBu+l9gh88HjW3czWEAKClogUbJK7OtRqyQ7gyX0CCbfOJ0MtBVDnF0EfEbOhm/yh cuzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:reply-to:mime-version:content-transfer-encoding; bh=W5N61Cz7UihzHsoF80sPZb8Ps0MC1zZyh61f3FHeFj8=; b=LuAtpF9ekbmwL8rpDcX15sTLKKu5UuM+F7yaEKTKr8MOlTP+NcDfhSwSNPJM50jFIO 9EN5FFEJ3Ezar5a4P5U2ORWNzstrBZuHd0cM8gn5e+gj5khOq6JIIOTSg/ZewwuBDK0Y qu4sLmhrO2hoSBa62twOXdqr+GlgTPvN4nLCingcvdJ6YTp7mRJPogjp3eCLD8MprNYu h4yvTRAPqrq6s21DOzpd9hFafKgBOnFgVi4fo5t8fDl6Ow+HKMiyzPPRWH388+612mY6 lKLdvkOK7oj5UX5BWcQILrnR6ruh0RzSSW/rVv+OUR0KENDgQiizoj1E8v3DpxUE+Szp g/BQ== X-Gm-Message-State: AOAM532IAAtugtx3kw9lKnnl9N+nDXbfrzl8E5+SMbS9oGJ12Xwl8vhO tLSphK1aK13YoIZJExke0sR81vrHICw= X-Google-Smtp-Source: ABdhPJw8WCnnpItIJBm2vDlfA+eZu0M11tQElcPJE7rpbBB/W2IUOTqqL/1aqMfTc4nbmDwNC3r9pQ== X-Received: by 2002:a05:6402:c98:: with SMTP id cm24mr11764307edb.18.1620396510495; Fri, 07 May 2021 07:08:30 -0700 (PDT) Received: from ernst.home (pd9e23d76.dip0.t-ipconnect.de. [217.226.61.118]) by smtp.gmail.com with ESMTPSA id v26sm3748633ejk.66.2021.05.07.07.08.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 May 2021 07:08:30 -0700 (PDT) Date: Fri, 7 May 2021 16:08:29 +0200 From: Gary Jennejohn To: Lev Serebryakov Cc: current@freebsd.org, jsm@FreeBSD.org, hlh@restart.be Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! Message-ID: <20210507140829.20acbf73@ernst.home> In-Reply-To: <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> <20210507132215.2469c296@ernst.home> <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> Reply-To: gljennjohn@gmail.com X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcC3N4PKZz4f45 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 14:08:34 -0000 On Fri, 7 May 2021 16:59:35 +0300 Lev Serebryakov wrote: > On 07.05.2021 16:22, Gary Jennejohn wrote: > > >>>> Looks like there is problem with rtsx driver! > >>> Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! > >>> > >>> And console on these crashes is totally dead, and disks are not > >>> detected yet, so I can not look at structures in memory and/or > >>> dump core. > >> > >> 13.0-RELEASE installation media crashes in same way if SD reader is > >> enabled in BIOS. > >> > > > > I see that rtsx was added to GENERIC. Might have been premature. > > > > The only thing I can recommend is to install with the SD card reader > > disabled in the BIOS. > Yep, it works. Not only install, but booting of installed system too ___ any GENERIC kernel panics, even new, built by hands from latest sources. > > > It may be the case that rtsx still works even if the card reader is > > disabled in the BIOS. That's the first thing I would try out. > Nope, it doesn't work (and I don't need it on this Laptop, to be honest). If SD reader is disabled in BIOS, it isn't detected at all. > > > If that fails then generate a kernel with rtsx as a module rather than > > it being hard coded into the kernel. > > > > You could then re-enable the SD card reader in the BIOS and load the > > module to check whether the SD card reader works or causes a panic > > when the moduke is loaded. This approach might make it possible to > > get a crash dump if a problem occurs. > Ok, I'll try this, good idea. > > BTW, I've got hints that it it rtsx-related only after ~40 crashes, as most of stack traces don't have rtsx in them and are very generic. Looks like rtsx mangle kernel memory and it crashes in other places/kernel threads. > Good luck. I don't have a device with rtsx, the work I did on the driver was done with a loaner laptop. So, all I can offer is moral support :) -- Gary Jennejohn (gj@freebsd.org) From owner-freebsd-current@freebsd.org Fri May 7 15:53:31 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7CEA063336A for ; Fri, 7 May 2021 15:53:31 +0000 (UTC) (envelope-from 6yearold@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcFNW2qKyz4myM for ; Fri, 7 May 2021 15:53:31 +0000 (UTC) (envelope-from 6yearold@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 60D8A6337CC; Fri, 7 May 2021 15:53:31 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 609DD633367 for ; Fri, 7 May 2021 15:53:31 +0000 (UTC) (envelope-from 6yearold@gmail.com) Received: from mail-lf1-f50.google.com (mail-lf1-f50.google.com [209.85.167.50]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcFNW2BQSz4n93; Fri, 7 May 2021 15:53:31 +0000 (UTC) (envelope-from 6yearold@gmail.com) Received: by mail-lf1-f50.google.com with SMTP id i9so6835473lfe.13; Fri, 07 May 2021 08:53:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=OAmG8gbidqbkQsn0UVDBhQ0jh7IhOGqsOzM1EFpV/Nc=; b=YbQozsG7SFueY29AKpYl4knfAGcbHb7ZWd837prUHKpR+4yCJVAUbMVC5baHtZWfTg s+eD3fXNoelggkftVY8KW7rHdLCa6Qxz0zIQQ/1jBDN8qrfYHFRp9ElLhAF5QRJbhEPz 6rZJVmkMwwUqEgJa+QMHZMpjx1L1pjNX6Qrgx9ei2ulYnl5EbPzjkihxnOyU/GdOgDGN IYzhRxxv05eGFo6gwd9HW6sRv1ScrDrSMn3aeMPUi1745T/3u5/iX/qXyrFr2UP2GA4o Cv1O+7wYQskm9DTZ+TyZRgbpWA/0Bep+k9GZyQzeElIlRkbRnGZsAle2KQR3P9yhKhs1 pdsw== X-Gm-Message-State: AOAM5327iV7MaYTjcHerC392YW3hlfyqFClvjgPa8Cnq68/rm+vXsPal Bw8xjpWHCoB5A44s/5VjXfbUkpR6ZhA2nw== X-Google-Smtp-Source: ABdhPJyRx7KmqhyhdjLfRlL1fNGLjJWcWLeTaWWlk888lSDqnSt+6kdQ13Y60jwWyLAfSHcuYuGoBA== X-Received: by 2002:a05:6512:219:: with SMTP id a25mr6714381lfo.504.1620402809466; Fri, 07 May 2021 08:53:29 -0700 (PDT) Received: from mail-lf1-f54.google.com (mail-lf1-f54.google.com. [209.85.167.54]) by smtp.gmail.com with ESMTPSA id q127sm1956542ljq.88.2021.05.07.08.53.29 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 07 May 2021 08:53:29 -0700 (PDT) Received: by mail-lf1-f54.google.com with SMTP id x20so13421916lfu.6; Fri, 07 May 2021 08:53:29 -0700 (PDT) X-Received: by 2002:a19:c104:: with SMTP id r4mr7026549lff.555.1620402808855; Fri, 07 May 2021 08:53:28 -0700 (PDT) MIME-Version: 1.0 References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> In-Reply-To: <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> From: Gleb Popov Date: Fri, 7 May 2021 18:53:03 +0300 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! To: lev@freebsd.org Cc: current@freebsd.org X-Rspamd-Queue-Id: 4FcFNW2BQSz4n93 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 15:53:31 -0000 Just to add to this thread: I'm running CURRENT with rtsx device and driver and it works fine for me. From owner-freebsd-current@freebsd.org Fri May 7 16:09:30 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 68E2A6338FE for ; Fri, 7 May 2021 16:09:30 +0000 (UTC) (envelope-from jsm@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcFky2Xbyz4nhV for ; Fri, 7 May 2021 16:09:30 +0000 (UTC) (envelope-from jsm@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 57215633878; Fri, 7 May 2021 16:09:30 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 56EDF633B65 for ; Fri, 7 May 2021 16:09:30 +0000 (UTC) (envelope-from jsm@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcFky22pSz4nZs; Fri, 7 May 2021 16:09:30 +0000 (UTC) (envelope-from jsm@FreeBSD.org) Received: from freebsd2.freebsd.lan (mail.northatlanticmusicsupplies.com [212.237.182.202]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: jsm) by smtp.freebsd.org (Postfix) with ESMTPSA id DC50369BA; Fri, 7 May 2021 16:09:29 +0000 (UTC) (envelope-from jsm@FreeBSD.org) Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame To: lev@FreeBSD.org, current@freebsd.org References: From: Jesper Schmitz Mouridsen Message-ID: <479cb9d3-a759-eaed-45f7-003965075e6b@FreeBSD.org> Date: Fri, 7 May 2021 18:09:25 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 16:09:30 -0000 On 07.05.2021 13.33, Lev Serebryakov wrote: > > Several versions of 14-CURRENT (including > FreeBSD-14.0-CURRENT-amd64-20210506-49c894ddced-246502-memstick.img) > can not boot on Lenovo T540p 19 times out of 20. > > It crashes on device detection, after detecting sound subsystem, with > traps 9 and 12 (9 is more often) and mostly with this stacktrace (9 > out of 10 crashes have this stacktrace: > Perhaps similar to bug reported here https://forums.freebsd.org/threads/boot-timeout-error-on-rtsx-freebsd-13-0-hp-840-g3.80031/#post-508072 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=255130 Do you happen to have an empty adapter (sd->micro sd) inserted in the slot. That causes a card-inserted interrupt, on all the realtek sd-card readers I have touched. Regards > -- trap > run_interrupt_driven_config_hooks() > boot_run_interrupt_driven_config_hooks() > mi_startup() > btext() > > > But twice I've got more interesting stacktraces: > > -- trap > strlen() > kvprintf() > vsnprintf() > vpanic() > panic() > __mtx_lock_flags() > _sleep() > mmc_wait_for_request() > mmc_wait_for_cmd() > mmc_go_discovery() > mmc_delayed_attach() > run_interrupt_driven_config_hooks() > boot_run_interrupt_driven_config_hooks() > mi_startup() > btext() > > --- trap > __mtx_lock_sleep() > __mtx_lock_flags() > mmc_wakeup() > rtsx_intr() > ithread_loop() > fork_exit() > fork_trampoline() > >  Looks like there is problem with rtsx driver! > >  I've checked memory with memtest86+ for 24 hours (4.5 passes) without > any problems. > From owner-freebsd-current@freebsd.org Fri May 7 16:34:57 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C12A634569 for ; Fri, 7 May 2021 16:34:57 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcGJJ746Jz4q32; Fri, 7 May 2021 16:34:56 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from kalamity.joker.local (115-38-180-10.area1c.commufa.jp [115.38.180.10]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 147GYkxJ096252; Sat, 8 May 2021 01:34:47 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sat, 8 May 2021 01:34:45 +0900 From: Tomoaki AOKI To: freebsd-current@freebsd.org Cc: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! Message-Id: <20210508013445.d4391b5591f21aaa791d6aae@dec.sakura.ne.jp> In-Reply-To: <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> <20210507132215.2469c296@ernst.home> <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> Reply-To: junchoon@dec.sakura.ne.jp Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-2022-JP Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcGJJ746Jz4q32 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 16:34:57 -0000 On Fri, 7 May 2021 16:59:35 +0300 Lev Serebryakov wrote: > On 07.05.2021 16:22, Gary Jennejohn wrote: > > >>>> Looks like there is problem with rtsx driver! > >>> Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! > >>> > >>> And console on these crashes is totally dead, and disks are not > >>> detected yet, so I can not look at structures in memory and/or > >>> dump core. > >> > >> 13.0-RELEASE installation media crashes in same way if SD reader is > >> enabled in BIOS. > >> > > > > I see that rtsx was added to GENERIC. Might have been premature. > > > > The only thing I can recommend is to install with the SD card reader > > disabled in the BIOS. > Yep, it works. Not only install, but booting of installed system too $B".(B any GENERIC kernel panics, even new, built by hands from latest sources. > > > It may be the case that rtsx still works even if the card reader is > > disabled in the BIOS. That's the first thing I would try out. > Nope, it doesn't work (and I don't need it on this Laptop, to be honest). If SD reader is disabled in BIOS, it isn't detected at all. > > > If that fails then generate a kernel with rtsx as a module rather than > > it being hard coded into the kernel. > > > > You could then re-enable the SD card reader in the BIOS and load the > > module to check whether the SD card reader works or causes a panic > > when the moduke is loaded. This approach might make it possible to > > get a crash dump if a problem occurs. > Ok, I'll try this, good idea. > > BTW, I've got hints that it it rtsx-related only after ~40 crashes, as most of stack traces don't have rtsx in them and are very generic. Looks like rtsx mangle kernel memory and it crashes in other places/kernel threads. Have you try dev.rtsx.0.inversion=1 in /boot/loader.conf with the device enabled on BIOS? If not yet, it would be worth trying. In rtsx(4) manpage, > $B".(B RTS522A on Lenovo P50s and Lenovo T470p, card detection and read-only > switch are reversed. This is sovled by adding in loader.conf(5): > > dev.rtsx.0.inversion=1 If it works for you, possibly no one had tested on T540p yet. And there can be much, much more PCs/chips which need it, but no one has tested yet. My rtsx driver on ThinkPad P52 works fine without it, but IIRC, paniced with it (I did it just a test purpose when it landed). And one more. If you insert write-protected card and then mount it as writable, it SHOULD certainly crash the system. It's not a rtsx driver issue, but promised to happen. I've encountered the problem on USB card readers, too. > > -- > // Lev Serebryakov > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > -- Tomoaki AOKI From owner-freebsd-current@freebsd.org Fri May 7 16:47:59 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 01BD6634E65 for ; Fri, 7 May 2021 16:47:59 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from tor1-11.mx.scaleengine.net (tor1-11.mx.scaleengine.net [IPv6:2001:470:1:474::25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcGbL57s2z4qg6 for ; Fri, 7 May 2021 16:47:58 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.3] (senat1-01.HML3.ScaleEngine.net [209.51.186.5]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by tor1-11.mx.scaleengine.net (Postfix) with ESMTPSA id 7D2EB24BDA for ; Fri, 7 May 2021 16:47:52 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.10.3 tor1-11.mx.scaleengine.net 7D2EB24BDA Subject: Re: Building ZFS-based VM images To: freebsd-current@freebsd.org References: From: Allan Jude Message-ID: <5f5f9d31-29b7-1520-55fa-216e24e6132a@freebsd.org> Date: Fri, 7 May 2021 12:47:51 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcGbL57s2z4qg6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 16:47:59 -0000 On 5/6/2021 11:17 AM, Alan Somers wrote: > It's easy to build a UFS-based VM image just by setting WITH_VMIMAGES in > release.conf and running release.sh. But what about ZFS-based images? > What's the easiest way to build a ZFS-based VM image, using a pool layout > similar to what the interactive installer uses? > -Alan > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > With the new scripting support, it is fairly easy with poudriere-image It also has the advantage of being able to build the images from poudriere jails you already have (or can build from FTP without compiling). The pre/post build script stuff is merged already, although my example scripts are in a different pull request that I need to rebase around some restructuring first. Anyway, you can use poudriere-image with the pre/post scripts included here: https://github.com/freebsd/poudriere/pull/731/files#diff-6607907a033a4e5e5e21da56960ed7ccbfb6dd4a85d66615553d2221d75c0998 and it will make a VM image with the same layout as if you had used the installer (or you can customize it as you see fit) I'm currently using this to build images for AWS and bhyve, but also to generate installer ISOs that run a script to format the drives and create the zpool, then 'fetch -o - url | zfs recv -F zroot' to install a replication stream of an entire pool. For upgrades, we do the same but only replace the boot environment. -- Allan Jude From owner-freebsd-current@freebsd.org Fri May 7 17:07:33 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ABDEA635959 for ; Fri, 7 May 2021 17:07:33 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcH1x3TWvz4rtk for ; Fri, 7 May 2021 17:07:33 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) Received: by mailman.nyi.freebsd.org (Postfix) id 776DF635958; Fri, 7 May 2021 17:07:33 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 77373635AFE for ; Fri, 7 May 2021 17:07:33 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) Received: from www442.your-server.de (www442.your-server.de [78.47.106.34]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcH1w3nk9z4rZl for ; Fri, 7 May 2021 17:07:31 +0000 (UTC) (envelope-from freebsd-ml@daemonbytes.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=daemonbytes.net; s=default2011; h=Content-Transfer-Encoding:Content-Type: Mime-Version:References:In-Reply-To:Message-Id:Subject:To:From:Date:Sender: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID; bh=NQOzRS7ASkt4AJX+aXYm6irI4QaXatRz4kQzb3t7osA=; b=em5cs1uT6d/VNJOqCGUF0agdMu 1YsKD38Qglis52Ug5JvPyaSNBMFIPq6Ul/x/k4STfKgXvIZ9dMjXuytxjTxPS7i1tQbLbUmfCx55x FTpcvKDW2uMSTKVD6Zap/r53Nn3ZaFm0kQhqAp3f/ws6nbgzDfNbbv7L5QLzyhaAh5W5gmT0azora CPFwc6XLsOZq7Ubr0LkViDfGVwk9GwJfEicOoyHis24Q0JC6JHBBaMDbE8qAUkNzGizOQVX/FyxG9 KX3RiRp5zVN2eKUfbvNgvX0b9Lvk6FWJX9t0S5Ws+mc3j6d21a+S9Y9DWFF8SisqA6hbto8AC7hhZ VPHn+BSw==; Received: from sslproxy06.your-server.de ([78.46.172.3]) by www442.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92.3) (envelope-from ) id 1lf3wh-0002GE-Tk for current@freebsd.org; Fri, 07 May 2021 19:07:23 +0200 Received: from [2003:df:9f4c:9400:dd1:db3:4751:c5f0] (helo=beastie) by sslproxy06.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lf3wh-000KKt-Q5 for current@freebsd.org; Fri, 07 May 2021 19:07:23 +0200 Date: Fri, 7 May 2021 19:06:59 +0200 From: Daniel Dowse To: current@freebsd.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame Message-Id: <20210507190659.881379da22347223e79c4da6@daemonbytes.net> In-Reply-To: References: X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Authenticated-Sender: freebsd-ml@daemonbytes.net X-Virus-Scanned: Clear (ClamAV 0.103.2/26163/Fri May 7 13:05:07 2021) X-Rspamd-Queue-Id: 4FcH1w3nk9z4rZl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=daemonbytes.net header.s=default2011 header.b=em5cs1uT; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-ml@daemonbytes.net designates 78.47.106.34 as permitted sender) smtp.mailfrom=freebsd-ml@daemonbytes.net X-Spamd-Result: default: False [-2.80 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[daemonbytes.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[78.47.106.34:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+a]; DKIM_TRACE(0.00)[daemonbytes.net:~]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_DKIM_PERMFAIL(0.00)[daemonbytes.net:s=default2011]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[78.47.106.34:from]; ASN(0.00)[asn:24940, ipnet:78.46.0.0/15, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[current]; HAS_X_AS(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 17:07:33 -0000 On Fri, 7 May 2021 14:33:27 +0300 Lev Serebryakov wrote: > > Several versions of 14-CURRENT (including > FreeBSD-14.0-CURRENT-amd64-20210506-49c894ddced-246502-memstick.img) can not > boot on Lenovo T540p 19 times out of 20. > > It crashes on device detection, after detecting sound subsystem, ...[snip] Hi Lev, Just my story with SDCARD Reader. I own a HP Elitebook 2170p. It crashed also with any Release i had used on it. Adding hw.sdhci.quirk_set="1" hw.sdhci.quirk_clear="1" hw.sdhci.enable_msi="0" to /boot/device.hints solved the problem and the reader is usable, with GENERIC Kernel. -cheers -- Daniel Dowse From owner-freebsd-current@freebsd.org Fri May 7 17:11:36 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9D8C1636307 for ; Fri, 7 May 2021 17:11:36 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-qk1-x72f.google.com (mail-qk1-x72f.google.com [IPv6:2607:f8b0:4864:20::72f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcH6b4HYqz4sBp for ; Fri, 7 May 2021 17:11:35 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-qk1-x72f.google.com with SMTP id i17so9173921qki.3 for ; Fri, 07 May 2021 10:11:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=UFd7FCLSj3MbHVZDVy9G2882BHvwBrXr+kOVh8UcPlQ=; b=Zo9cTkt9Dzt+OemwyV5dSvxQOv5d/5GATX/WdO6Fm/MzeqgcTpAVemNw/nFST/MXRo XyYm9r1i9AQppXXfNkByKlFZqetJZNEghtPusA8d3XGmAphbQw8duUxmhHpv4QPVAPUF XzT3re4UPMzabvxZGRY0i0y9xqazne56kAGSD0nOHCFtCxQZIj0FC4uTGB5+S02fsWhY vCsGkriW2XymDsy8dFgNN/9FS5d1BNovC8TkEZf239lCebZNpUoE88JZT9A9xMZNHB3h mqE3t+73m5XVQeRNOpsCdX5XCiAD4LBN8v0F8/sMQecLqiCSAnOz8U+zR5SzYJeXdMj7 P58Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=UFd7FCLSj3MbHVZDVy9G2882BHvwBrXr+kOVh8UcPlQ=; b=uT7wzUV537zyGzZJk1jCSoZJnrBYodyyRaPeWVCrYxG4070na3KVxhCJSRkmF8vsak bC5ezVgUD5yDJWR94nwEIaU3+lf7f79ptfPs8ZbRcobNJdil8OQW5/vL8B15OE6YeoGt FYJVMPP8d1dJsFhvcJGPNVxiIzygYKQDcPJN38f9LTi2dPkxsVsscw3D1fdqMGq2eM/U QbuK8xEkeBsE3uZLxDBsP1505rjqaLjb+W2GtaXiAgse5fYXAaU5mW/cJg/0uw4uMEcW AW4ViOMRh/xJ3mWb+Ro0b8hwUcHllyeJxyI7brb27v0FISP5TWJUEPoxI2fFlvyJov2C ZVrw== X-Gm-Message-State: AOAM530btQIneJ+PbLP4UpcepRIlWgT2wq9307gb7P+iCv/CYXDFzPyS gtt4KvIJcWjvdmPRipoAokykoDT8bYeYsKGrLVs= X-Google-Smtp-Source: ABdhPJzn7CjGxp6h0LphdtwIo/nZ6nWOFj9cg//3xM7boocwUx8tyUyz5DWR2ld2mIffH3xScRgz3w== X-Received: by 2002:a37:7ec1:: with SMTP id z184mr1874883qkc.149.1620407494645; Fri, 07 May 2021 10:11:34 -0700 (PDT) Received: from mutt-hbsd (pool-100-16-222-53.bltmmd.fios.verizon.net. [100.16.222.53]) by smtp.gmail.com with ESMTPSA id m190sm5173303qke.107.2021.05.07.10.11.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 May 2021 10:11:34 -0700 (PDT) Date: Fri, 7 May 2021 13:11:33 -0400 From: Shawn Webb To: Hans Petter Selasky Cc: FreeBSD Current Subject: Re: Patch for patch, but not foreach :-) Message-ID: <20210507171133.tiw3jecnbqe4tmmg@mutt-hbsd> X-Operating-System: FreeBSD mutt-hbsd 14.0-CURRENT-HBSD FreeBSD 14.0-CURRENT-HBSD X-PGP-Key: https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/blob/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="ihl3iq7aaazz7uog" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4FcH6b4HYqz4sBp X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hardenedbsd.org header.s=google header.b=Zo9cTkt9; dmarc=none; spf=pass (mx1.freebsd.org: domain of shawn.webb@hardenedbsd.org designates 2607:f8b0:4864:20::72f as permitted sender) smtp.mailfrom=shawn.webb@hardenedbsd.org X-Spamd-Result: default: False [-5.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[hardenedbsd.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72f:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RECEIVED_SPAMHAUS_PBL(0.00)[100.16.222.53:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org:s=google]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[hardenedbsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72f:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72f:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 17:11:36 -0000 --ihl3iq7aaazz7uog Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, May 07, 2021 at 03:49:00PM +0200, Hans Petter Selasky wrote: > Time has come that I make a patch for the most central patching tool in > FreeBSD, patch :-) >=20 > https://reviews.freebsd.org/D30160 As stupid as it sounds, '*' is a valid filename. --=20 Shawn Webb Cofounder / Security Engineer HardenedBSD https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A= 4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc --ihl3iq7aaazz7uog Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEA6TL67gupaZ9nzhT/y5nonf44foFAmCVdMIACgkQ/y5nonf4 4frlTxAAidsJMsnDmIcyqaJm1h8DVgZMFjEo26FqnSm8Zw6bStCLGNG2A9j6djwg 2wrY3kTN6k8P1QtEmVlnSGftIKOBk4OwODu37LZO8UVi18YfJvFFGmoVCgSB8WLM fiU5Zi7A6LgeuqwG0sdlHbn7uMAwy1NcSj0nZ9YaOcKHtL4fzGmJCrBFcZFRLJD1 gZqAzkW0asN0OpTE8YmleqXTF6vvMGi8O9YEreHyyK5VVhhE4M+YBmfM8fx52tdf GK5QrAtTeGaqow9+ofWEyJp77yZg9wro3xT2lrWsYcSWy9yLhOTJhMl+0KcJu/Z6 3uoHFW/YRnLCPR9okjTKcodO4ggwfy+tLKV6N2nft8bzF8IYWy+LmqcHtS7qYRZK /YSJGakOsbhoi1bMcam0m/d7pM9Lijld4lwAHCOTbrwNldo5ReXYPOlcGHN9XuRX pJzCP3NMt72dtisNwqHUQHyOFpJvLxAtr0qnYm7Yc/6FdHOTaXdvF7oNiCvi6XVi 0d0tlvZyw5o7qTmTRVjthPIKZdoin5/NRZh31p0q1UpW+xZBq8xjUhl6SbvlIEMI vgPeRZ+zWvpAkg87VMgwCcVZZ+f5D7swyxcxEskauy3AtS3r2vt8Pu4++RQxjCZA ZCoknMjVjlnaB9OWGSYDJ57bW0XtKAnfZzKIdNiu9Fpe0Y33kQM= =ZuJC -----END PGP SIGNATURE----- --ihl3iq7aaazz7uog-- From owner-freebsd-current@freebsd.org Fri May 7 17:45:55 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4517A636DC5 for ; Fri, 7 May 2021 17:45:55 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcHtC1Gcvz4tmG; Fri, 7 May 2021 17:45:54 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: by mail-wm1-x336.google.com with SMTP id y124-20020a1c32820000b029010c93864955so7616019wmy.5; Fri, 07 May 2021 10:45:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:date:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=i2UD9OV6HIdbuM2Y0RqdycBvWeUeuA2Aoqn1E+VRSIk=; b=qX5Zam+WDdPxBJLaZOIAKhjPqkjAsOdxBEu+I5uQ+CCfcnHv3Sh5N5C9DqvTcYufKn 4LcJ5nlbxqiI/iIEKqeRTZY0jMfFAwnm+bQzLDC+4kElbJpJWRx14Em14Ip/WldF5rlh 6RmAa27ZsAqbRaPb1VRGPxOUUJSVI9rEw1BLN+/sLeGdlX/eZJge/LcJmselNL+23Gyv Q4nhZCZD04cta1F9d95yRv5510gb6oGhaDy+n7tZKdD8T89TXB5gT7nQjTYZHW4uQLvR dbuOs/ThPm+YRA807TN4X70AMoXJlAQhVVRfOchgIFOW9VYjUMAlIjBm+BNgNKE7ntAg rAVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:date:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=i2UD9OV6HIdbuM2Y0RqdycBvWeUeuA2Aoqn1E+VRSIk=; b=rBHOS9MTkavZA96/LmBnGdnB4448vaoosJSsfL/8YropCDjVzGSrcrstUdD5HPxhvl L241Hk8WlSCZ5RjcfdYXXyGcVyPPs41lZvyG8ay0Yz1fQey7eGL0Axz3WpelFop9D4uj pMiDrYlYl2IJ4QCJft/OxlkWuv63bEMFOvqBVJifmTBsLKU4T1LizNaQ6cNkZmd/oEdf 26XQcw9AnNlnWJ+uWqf26RetqWECKW7uo50IKMFo50iBF2oQ3zorlS2W7/JRT/91rSRM iT5UuxNc4NFJW+1FV+bl0NVB4bsytxD8w5+LLex6KR39LcuECPlS68VmOli5/7N8CYj5 Mx5g== X-Gm-Message-State: AOAM532+YyvBzsSjTyuvPAJI/9JO8WzUnb9VfxfmVzfSRmlf97jk0BxY ZTg8CkgX6bveIqMT2DWc/UPZSmxdjAdwhQ== X-Google-Smtp-Source: ABdhPJw3+6iXjewLqvmWKAbWTJMLt23Cr8luvysAvMJHesjRnx1sRQQoifZi09SrqD4kF0HzO6tSIA== X-Received: by 2002:a05:600c:896:: with SMTP id l22mr11260559wmp.164.1620409553353; Fri, 07 May 2021 10:45:53 -0700 (PDT) Received: from rimwks.local ([2001:470:1f15:3d8:7285:c2ff:fe37:5722]) by smtp.gmail.com with ESMTPSA id h13sm7999498wml.26.2021.05.07.10.45.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 May 2021 10:45:52 -0700 (PDT) From: Rozhuk Ivan X-Google-Original-From: Rozhuk Ivan Date: Fri, 7 May 2021 20:45:47 +0300 To: David Chisnall Cc: freebsd-current@freebsd.org Subject: Re: WSLg update on 1-5-2021 - BSD / WSL Message-ID: <20210507204547.7fe35dcb@rimwks.local> In-Reply-To: References: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> <20210507131741.47f3aab9@rimwks.local> X-Mailer: Claws Mail 3.17.8 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4FcHtC1Gcvz4tmG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 17:45:55 -0000 On Fri, 7 May 2021 14:31:39 +0100 David Chisnall wrote: > >> Whether Microsoft or the FreeBSD project should do the work really > >> comes down to who has more to gain. Windows 10 is installed on > >> around a 1.3 billion devices and any of these users can run Ubuntu > >> with a single click in the Microsoft Store, so it feels as if the > >> FreeBSD project has a lot to gain from being able to reach them. =20 > >=20 > > Make job for free - make more money for MS. > > Make win10 to support more features to increase windows value... =20 >=20 > How much money? 'Making money' doesn't just mean money coming in, it=20 > means more money coming in than is going out. Adding features to a=20 > product costs money. How many people will buy Windows 10 if it has a=20 > good FreeBSD compatibility layer who wouldn't buy it without one? I=20 > very much doubt that this is a sufficient number to cover the cost of=20 > the engineering work. This is MS management problems. Adding support WSL code will not make FBSD users happy, there is mush more actual issues that require attention. IMHO. > >> If you assume > >> that 1% of people who want the feature commented, then this gives > >> around 10,000 folks who really want a FreeBSD equivalent of WSL. =20 > >=20 > > They give money to MS, they ask MS to do job for money. =20 >=20 > They give money to MS, they get a Windows 10 license in return. They=20 > are happy to buy Windows without a FreeBSD compat layer. They are=20 > buying Windows on the basis of some subset of a large number of=20 > features. The lack of a FreeBSD compat layer is not preventing them=20 > from buying Windows, they have not shown that this is the > deal-breaker feature. Because MS is monopoly on OS market. For most peolpes there is no other way to buy PC/notebook without windows, and no other way to use some software that was written for windows only. > Microsoft, like any other POTS software vendor, will prioritise > features that impact the most customers. There are things on User > Voice with tens or hundreds of thousands of votes and these tend to > be prioritised. Something with under a hundred votes is so niche that > it's only going to be a target of investment if it impacts another > product or service. =46rom mine experience MS listen only custommers from big b2b and b2gov. Millions of users hate post win7 gui - see no reaction from ms. =20 > >> It's pretty hard to justify a feature in Windows that only 0.001% > >> of Windows users will use. If you want to change that arithmetic, > >> then next time your organisation is renewing M365 or Azure service > >> subscriptions, tell your sales rep that FreeBSD support is > >> important to your company. =20 > >=20 > > There is many other hosting services that have FBSD support. > > So this is MS/azure problem. =20 >=20 > Azure already officially supports FreeBSD and we have contributed a > load of code to improve that support over the years. From the > numbers I've seen, I strongly suspect that we've spent more on it > than we've gained in revenue. Ok, thanks! > You are asking Microsoft to throw money at a thing that will > definitely cost time and money (and comes with the associated > opportunity cost, because developer time spent on this features is > developer time not spent on other features) but with no clear > indication that it will increase revenue. Effectively, you are > asking us to do work for free and you're also doing so quite rudely. No, I do not ask MS for anything. If MS want something - patches/pull requests/sponsoring are welcome! > Personally, I'd love to have a FreeBSD compat layer. The license > would even make it possible to embed the FreeBSD kernel in Windows > and so get the best aspects of WSL1 and WSL2. From a business > perspective; however, I can't argue that this would be a great use of > engineer time. There are a load of features that would positively > impact a lot more users that would be higher priority. Same for FBSD. FBSD have very limited peoples power and more prioritized tasks, at least from my point of view. May be you luck to find some one who can, have time and motivation to do th= is. > If you want this to happen and you want Microsoft to do it, then you=20 > need to help people inside the company provide this business case.=20 > Things that don't help include: >=20 > - I want it. > - You suck for not doing it. > - It would make you money in unspecified ways. >=20 > Things that do help include: >=20 > - We are a FreeBSD shop with 1,000 workstations, we would switch to=20 > Windows on the desktop with this feature. > - We are a large cloud customer with 10,000 VMs deployed, we would=20 > switch to Azure with this feature. > - We are a Windows shop with a load of desktops but are planning to=20 > switch to Macs because we want a BSD-style userland. This is examples of negative motivation for this community. :) From owner-freebsd-current@freebsd.org Fri May 7 18:01:48 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 537F16376BC for ; Fri, 7 May 2021 18:01:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcJDX1tlRz4vWw for ; Fri, 7 May 2021 18:01:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 40C6663732E; Fri, 7 May 2021 18:01:48 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 409286374D1 for ; Fri, 7 May 2021 18:01:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcJDX1RK6z4v5y; Fri, 7 May 2021 18:01:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 0A8317C0C; Fri, 7 May 2021 18:01:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 8405B3DC5; Fri, 7 May 2021 21:01:44 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame To: Jesper Schmitz Mouridsen , current@freebsd.org References: <479cb9d3-a759-eaed-45f7-003965075e6b@FreeBSD.org> From: Lev Serebryakov Organization: FreeBSD Message-ID: <2546f4e8-6b24-e933-399c-89ad10d6b42e@FreeBSD.org> Date: Fri, 7 May 2021 21:01:44 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <479cb9d3-a759-eaed-45f7-003965075e6b@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 18:01:48 -0000 On 07.05.2021 19:09, Jesper Schmitz Mouridsen wrote: > On 07.05.2021 13.33, Lev Serebryakov wrote: >> >> Several versions of 14-CURRENT (including FreeBSD-14.0-CURRENT-amd64-20210506-49c894ddced-246502-memstick.img) can not boot on Lenovo T540p 19 times out of 20. >> >> It crashes on device detection, after detecting sound subsystem, with traps 9 and 12 (9 is more often) and mostly with this stacktrace (9 out of 10 crashes have this stacktrace: >> > Perhaps similar to bug reported here https://forums.freebsd.org/threads/boot-timeout-error-on-rtsx-freebsd-13-0-hp-840-g3.80031/#post-508072 > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=255130 Maybe, it is same bug, maybe there are two bugs. Looks like on my hardware rtsx corrupts kernel memory: most crashes are in another place. > Do you happen to have an empty adapter (sd->micro sd) inserted in the slot. That causes a card-inserted interrupt, on all the realtek sd-card readers I have touched. Nope, slot is empty. I'll try this combination too :). -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 18:04:44 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CB3276379B5 for ; Fri, 7 May 2021 18:04:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcJHw5M3Xz4vcd; Fri, 7 May 2021 18:04:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 8E2C774B3; Fri, 7 May 2021 18:04:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.134.16] (unknown [94.19.224.8]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 5F6B33DC7; Fri, 7 May 2021 21:04:43 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! To: junchoon@dec.sakura.ne.jp, freebsd-current@freebsd.org References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> <20210507132215.2469c296@ernst.home> <755d0029-bea6-3a43-c0c2-184349d88054@FreeBSD.org> <20210508013445.d4391b5591f21aaa791d6aae@dec.sakura.ne.jp> From: Lev Serebryakov Organization: FreeBSD Message-ID: <4afdd70f-ab27-6d87-e2c1-36ed1ccc03bf@FreeBSD.org> Date: Fri, 7 May 2021 21:04:43 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: <20210508013445.d4391b5591f21aaa791d6aae@dec.sakura.ne.jp> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 18:04:44 -0000 On 07.05.2021 19:34, Tomoaki AOKI wrote: > Have you try > > dev.rtsx.0.inversion=1 > > in /boot/loader.conf with the device enabled on BIOS? Not yet :-) I'll try. > If not yet, it would be worth trying. > > In rtsx(4) manpage, > >> 〓 RTS522A on Lenovo P50s and Lenovo T470p, card detection and read-only >> switch are reversed. This is sovled by adding in loader.conf(5): >> >> dev.rtsx.0.inversion=1 > > If it works for you, possibly no one had tested on T540p yet. > And there can be much, much more PCs/chips which need it, but no one has > tested yet. > > My rtsx driver on ThinkPad P52 works fine without it, but IIRC, > paniced with it (I did it just a test purpose when it landed). > > And one more. > If you insert write-protected card and then mount it as writable, > it SHOULD certainly crash the system. > It's not a rtsx driver issue, but promised to happen. > I've encountered the problem on USB card readers, too. My slot is empty, no card, no adapters, no plastic pseudo-card, nothing. -- // Lev Serebryakov From owner-freebsd-current@freebsd.org Fri May 7 19:07:07 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 04F736393B0 for ; Fri, 7 May 2021 19:07:07 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from id.bluezbox.com (id.bluezbox.com [45.55.20.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcKgt28tmz3FTX; Fri, 7 May 2021 19:07:06 +0000 (UTC) (envelope-from gonzo@bluezbox.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=bluezbox.com; s=mail; h=In-Reply-To:Content-Transfer-Encoding:Content-Type: MIME-Version:References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=wvSRWl6lw0F0px+g9mCsPXSfMFYBhyoWi+qtASLvc9o=; b=YU/un1L058URqcnN4dY3gYrCuU wfHLvp+AumwCxGa7Wj1rCgzps+lohlDrpELuTWJVyJYod1Koc0Oepwy2+Prz/LqvdKt3Sjm8DR0M/ 4RIVsmwRuB2N7EV9HESIPWBq+GTZNSnsyjxJ6HrGUdSdp8RrUHe1OivSBfc2bGT566gA=; Received: from localhost ([127.0.0.1] helo=id.bluezbox.com) by id.bluezbox.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lf5oR-000GTJ-1N; Fri, 07 May 2021 12:06:59 -0700 Received: (from gonzo@localhost) by id.bluezbox.com (8.15.2/8.15.2/Submit) id 147J6wh1063320; Fri, 7 May 2021 12:06:58 -0700 (PDT) (envelope-from gonzo@bluezbox.com) X-Authentication-Warning: id.bluezbox.com: gonzo set sender to gonzo@bluezbox.com using -f Date: Fri, 7 May 2021 12:06:58 -0700 From: Oleksandr Tymoshenko To: David Chisnall Cc: freebsd-current@freebsd.org Subject: Re: WSLg update on 1-5-2021 - BSD / WSL Message-ID: <20210507190658.GA63309@bluezbox.com> References: <0b3d6049-f6eb-f9d4-5f20-f09ac666e949@nomadlogic.org> <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <92a81582-7bd4-b9f1-04b6-cbcd5eb77893@FreeBSD.org> X-Operating-System: FreeBSD/11.2-RELEASE-p10 (amd64) X-Spam-Level: -- X-Spam-Report: Spam detection software, running on the system "id.bluezbox.com", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: David Chisnall (theraven@FreeBSD.org) wrote: > On 03/05/2021 22:37, Pete Wright via freebsd-current wrote: > > On 5/1/21 12:42 PM, Chargen wrote: > >> Dear all > >> > >> please note that I hope this m [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Rspamd-Queue-Id: 4FcKgt28tmz3FTX X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bluezbox.com header.s=mail header.b=YU/un1L0; dmarc=none; spf=pass (mx1.freebsd.org: domain of gonzo@bluezbox.com designates 45.55.20.155 as permitted sender) smtp.mailfrom=gonzo@bluezbox.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bluezbox.com:s=mail]; FREEFALL_USER(0.00)[gonzo]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[bluezbox.com]; R_SPF_ALLOW(-0.20)[+mx]; SPAMHAUS_ZRD(0.00)[45.55.20.155:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[bluezbox.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[45.55.20.155:from]; ASN(0.00)[asn:14061, ipnet:45.55.0.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 19:07:07 -0000 David Chisnall (theraven@FreeBSD.org) wrote: > On 03/05/2021 22:37, Pete Wright via freebsd-current wrote: > > On 5/1/21 12:42 PM, Chargen wrote: > >> Dear all > >> > >> please note that I hope this message will be discussed to get this on the > >> roadmap for FreeBSD. Perhaps there is already talk about &&  work done on > >> that. > >> I would like to suggest having a BSD side for Microsoft FOSS ambitions > >> and > >> get to know the BSD license. I hope the tech people here, know which nuts > >> and bolts would be ready to boot a *BSD subsystem kernel and make that > >> available on Windows 10 installations. > > > > I believe most of the effort make this happen lies with Microsoft - it > > is their product after all. > > > > WSL under the covers is Hyper-V which supports FreeBSD pretty well. I > > believe most of the work would be on the Windows side to get the > > plumbing in place to spin up a FreeBSD VM.  There are open discussions > > on the WSL github system where people have asked for this but it has not > > gained much traction by Microsoft. > > [ Disclaimer: I work for Microsoft, but not on WSL and this is my own > opinion ] > > WSL is actually two things. WSL1 is similar to the FreeBSD Linuxulator: > it is a Linux syscall ABI in the NT kernel that implements *NIX > abstractions that are not present in NT and forwards other things to > corresponding NT subsystems. Like the Linuxulator, it lacks a bunch of > features (e.g. seccomp-bpf support, which is required for things like > Docker and Chrome) and is always playing catch-up with Linux. I'd > personally love to see a FreeBSD version of this (though I'd be 90% > happy if ^T did the *BSD thing), but it's something that only Microsoft > can do and is currently quite difficult because the picoprocess > abstraction in the NT kernel only allows one kind of picoprocess and so > it would need to add a new abstraction layer to support both. > > WSL2 is a lightweight Hyper-V VM that is set up to integrate tightly > with the host. This includes: > > - Aggressively using the memory ballooning driver so that a VM can > start with a very small amount of committed memory and grow as needed. > > - Using Hyper-V sockets to forward things between the guest and the host. > > - Using 9p-over-VMBus (which, I hope, will eventually become > VirtIO-over-VMBus, but I don't know of any concrete plans for this) to > expose filesystems from the host to the fuest) > > - Starting using the LCOW infrastructure, which loads the kernel > directly rather than going via an emulated UEFI boot process. > > FreeBSD is currently missing the balloon driver, I believe, has a > Hyper-V socket implementation contributed by Microsoft (Wei Hu), and has > a 9p-over-VirtIO implementation that could probably be tweaked fairly > easily to do 9p-over-VMBus. > > The WSL2 infrastructure is designed to make it possible to bring your > own kernel. I think FreeBSD would need to support the Linux boot > protocol (initial memory layout, mechanism for passing kernel arguments > in memory) to fit into this infrastructure, but that wouldn't require > any changes to any closed-source components. Hi David, Do you have links to the documentation on how to replace the kernel and the boot protocols? Or any documentation for WSL2 internals? Thanks -- gonzo From owner-freebsd-current@freebsd.org Fri May 7 19:43:53 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 20F57639DE7 for ; Fri, 7 May 2021 19:43:53 +0000 (UTC) (envelope-from hlh@restart.be) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcLVJ6XD1z3HFf for ; Fri, 7 May 2021 19:43:52 +0000 (UTC) (envelope-from hlh@restart.be) Received: by mailman.nyi.freebsd.org (Postfix) id DE4FC639DE6; Fri, 7 May 2021 19:43:52 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE1A1639E6A for ; Fri, 7 May 2021 19:43:52 +0000 (UTC) (envelope-from hlh@restart.be) Received: from tignes.restart.be (tignes.restart.be [37.187.123.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "tignes.restart.be", Issuer "CA master" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcLVJ4z1Sz3HTc; Fri, 7 May 2021 19:43:52 +0000 (UTC) (envelope-from hlh@restart.be) X-Comment: SPF check N/A for local connections - client-ip=192.168.25.127; helo=restart.be; envelope-from=hlh@restart.be; receiver= DKIM-Filter: OpenDKIM Filter v2.10.3 tignes.restart.be 4FcLVG6LP9zCq Received: from restart.be (norquay.tunnel.bel [192.168.25.127]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.restart.be", Issuer "CA master" (verified OK)) by tignes.restart.be (Postfix) with ESMTPS id 4FcLVG6LP9zCq; Fri, 7 May 2021 21:43:50 +0200 (CEST) Received: from morzine.restart.bel (morzine.restart.be [IPv6:2001:41d0:a:f40b:1:1:0:1]) (authenticated bits=0) by restart.be (8.16.1/8.16.1) with ESMTPSA id 147E61VH055843 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=OK); Fri, 7 May 2021 16:06:02 +0200 (CEST) (envelope-from hlh@restart.be) X-Authentication-Warning: norquay.restart.bel: Host morzine.restart.be [IPv6:2001:41d0:a:f40b:1:1:0:1] claimed to be morzine.restart.bel Subject: Re: CURRENT crashes at early boot on Lenovo T540p: rtsx to blame - 13.0-RELEASE crashes same way! To: lev@FreeBSD.org, current@freebsd.org, jsm@FreeBSD.org, gj@freebsd.org References: <740cd7a0-3faf-7a56-80f7-dbb9bdacb55b@FreeBSD.org> <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> From: Henri Hennebert Message-ID: <2f4aa735-06f7-0665-1930-17d83f7ebbf4@restart.be> Date: Fri, 7 May 2021 16:06:01 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.9.1 MIME-Version: 1.0 In-Reply-To: <37122994-8172-b943-2602-fd1b4e9af78a@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4FcLVJ4z1Sz3HTc X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 19:43:53 -0000 On 5/7/21 2:01 PM, Lev Serebryakov wrote: > On 07.05.2021 14:36, Lev Serebryakov wrote: > >>>    Looks like there is problem with rtsx driver! >>   Oh, I forgot to add: disabling SD Card Reader in BIOS solves problem! >> >>   And console on these crashes is totally dead, and disks are not detected >> yet, so I can not look at structures in memory and/or dump core. > > 13.0-RELEASE installation media crashes in same way if SD reader is enabled in > BIOS. > During kernel boot hit space. At prompt try set hint.rtsx.0.disabled="1" boot show if it save your boot to 13.0 Henri From owner-freebsd-current@freebsd.org Fri May 7 21:05:11 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4E4263C765 for ; Fri, 7 May 2021 21:05:11 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail-ed1-f46.google.com (mail-ed1-f46.google.com [209.85.208.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcNJ63THHz3MMg for ; Fri, 7 May 2021 21:05:10 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by mail-ed1-f46.google.com with SMTP id b17so11780122ede.0 for ; Fri, 07 May 2021 14:05:10 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=hiMXy/9HmbGuH59J5xIkA/1eNYsnScylvobFwUmpkTE=; b=c+EIpG+kDLhMZ/JczdVzSfhNzkb7IMs0Cf81ByvNyLz8YmysDZk48x0BEiToah8j+E o6UFMQjt3QGfN/Y8lvyhvZ330uhpgTjoghGj+Z03PhtnetW/dWzbgC2nsDD8l+svjhcm 26/rBt6ksFILKYsdEhk/Z8enuzq1QKTcUiVJcpcEGn++Qc6YRQQ0kJ9nmm8n84npARuT M9ujU4GTCLWQqQ1NMncDFO0Dtm7vONCLahs5NlEkTQcdA8UgDgb84F1JsRI3YbBCcVvJ EsjZqAErIHZwr/e8diX856mvcDz2JrNgz8Dere+lvyxNOa9XSuFaPSWwcVHFOxpjkQp2 TqDQ== X-Gm-Message-State: AOAM53218S2M2VIFWBMh5Cqzo5yt80OLWS92yyX7ps0WMpUbWWbc+r6E C5MVzBwNoMug8kHFgpDiQ7Od0eiKs6C4qN3tEQj8Bw== X-Google-Smtp-Source: ABdhPJyoCc8GzvKchIAUwdwBkQlvz+/7+dPSRVCy0RLiQ3JSROU7CP3Uhhd3bGSYaKYyAS9XMs+0AsxW14Qu+7pzoso= X-Received: by 2002:a50:dac4:: with SMTP id s4mr14024461edj.353.1620421508374; Fri, 07 May 2021 14:05:08 -0700 (PDT) MIME-Version: 1.0 References: <20210507171133.tiw3jecnbqe4tmmg@mutt-hbsd> In-Reply-To: <20210507171133.tiw3jecnbqe4tmmg@mutt-hbsd> From: Maxim Sobolev Date: Fri, 7 May 2021 14:04:57 -0700 Message-ID: Subject: Re: Patch for patch, but not foreach :-) To: Shawn Webb Cc: Hans Petter Selasky , FreeBSD Current X-Rspamd-Queue-Id: 4FcNJ63THHz3MMg X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sobomax@sippysoft.com designates 209.85.208.46 as permitted sender) smtp.mailfrom=sobomax@sippysoft.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[sobomax]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.208.46:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.208.46:from]; RCVD_IN_DNSWL_NONE(0.00)[209.85.208.46:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FORGED_SENDER(0.30)[sobomax@freebsd.org,sobomax@sippysoft.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.208.46:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[sobomax@freebsd.org,sobomax@sippysoft.com]; MAILMAN_DEST(0.00)[freebsd-current]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 21:05:12 -0000 Replace '*' with ^T perhaps and catch SIGINFO? =F0=9F=A4=94 -Max On Fri., May 7, 2021, 10:11 a.m. Shawn Webb, wrote: > On Fri, May 07, 2021 at 03:49:00PM +0200, Hans Petter Selasky wrote: > > Time has come that I make a patch for the most central patching tool in > > FreeBSD, patch :-) > > > > https://reviews.freebsd.org/D30160 > > As stupid as it sounds, '*' is a valid filename. > > -- > Shawn Webb > Cofounder / Security Engineer > HardenedBSD > > > https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/0= 3A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc > From owner-freebsd-current@freebsd.org Fri May 7 21:10:49 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0955563CC9E for ; Fri, 7 May 2021 21:10:49 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_CHACHA20_POLY1305_SHA256 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcNQb6DFMz3N4n; Fri, 7 May 2021 21:10:47 +0000 (UTC) (envelope-from freebsd@grem.de) Received: by mail.evolve.de (OpenSMTPD) with ESMTP id ed3d5b2e; Fri, 7 May 2021 21:10:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; s=20180501; bh=+UM1Lgghu4XYHT M6cHvleCnNlTI=; b=s+R9ikwqmue0WuRSSUfhAlr4zn2XJK31JE4AsqRSWbOCVw ZcqyG16tta4vdCuwF0GcW5gNSBOtvj4armg0BnNUgg+W8toQVv/4UO7cJEaEsTay G67XyD78kA3yK3vMnyZe1RHN+B+8etocFUmpcGJmLap6caK/+YiyGAIsG5cG7hMC qWrFuzXyfPp4i4m92rQCitO5IbsFyxINkD+wMIGjd3QBF0KJsrJr0DyR8fyxrvXX ApOIXgY0ZGIMO4F1mbdsqj6HZlZwnZQ8PqbpIgl2U78HITD/zXBF/li+zmO2XNa7 gPBCB6iQrN3gsCvg2SkV8gN55DGAMH6RYZeAaCkA== DomainKey-Signature: a=rsa-sha1; c=nofws; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; q=dns; s=20180501; b=CdT1g654 +oR2TDahPWXaYySzN7mUgZzrEUIfkvdfTzXo+Dnn6327BfYRzx74wFGO+mCFIOEQ Eu9vL5kIzQ2OoDeGAe785gr99/xNeR34lrD9KWdv8y2NMat6J8UExOTPmT9ZouLJ QO7jDBi2VOVbHIYFElD0/J4X3/bbSBYOwD6a4ERpt3y/JLGjiDhFjBFuM8yNl68m dF09dJdsYh5KuUPXvV+wf1L93e5eIy2HHRwrly4qX1/6fU+CPvYGHjmsSa6ep1Bl c/rGOLXf86CKDH7S5nm8W+hoxcWrHIQg3s8Urw/JeT1uV49Kd0X435Y7Os0hUNje 3j4mP38CF9cPcw== Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id a0381b12 (TLSv1.3:AEAD-CHACHA20-POLY1305-SHA256:256:NO); Fri, 7 May 2021 21:10:41 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Subject: Re: Patch for patch, but not foreach :-) From: Michael Gmelin In-Reply-To: Date: Fri, 7 May 2021 23:10:40 +0200 Cc: Shawn Webb , Hans Petter Selasky , FreeBSD Current Message-Id: <12082107-B6CE-4EB3-935A-812FC1966CFA@grem.de> References: To: Maxim Sobolev X-Mailer: iPhone Mail (18E212) X-Rspamd-Queue-Id: 4FcNQb6DFMz3N4n X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=grem.de header.s=20180501 header.b=s+R9ikwq; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@grem.de designates 213.239.217.29 as permitted sender) smtp.mailfrom=freebsd@grem.de X-Spamd-Result: default: False [-0.96 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[grem.de:s=20180501]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:213.239.217.29/32]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grem.de]; NEURAL_HAM_LONG(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[213.239.217.29:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[grem.de:+]; NEURAL_HAM_SHORT(-0.96)[-0.961]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[213.239.217.29:from]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current]; FORGED_RECIPIENTS(2.00)[m:shawn.webb@hardenedbsd.org, m:hps@selasky.org, s:grembo@freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 21:10:49 -0000 What about using "."? Or "/" (which would match the muscle memory of "search= " in less/more/vi/some browsers)? -m > On 7. May 2021, at 23:05, Maxim Sobolev wrote: >=20 > =EF=BB=BFReplace '*' with ^T perhaps and catch SIGINFO? =F0=9F=A4=94 >=20 > -Max >=20 >> On Fri., May 7, 2021, 10:11 a.m. Shawn Webb, = >> wrote: >>=20 >>> On Fri, May 07, 2021 at 03:49:00PM +0200, Hans Petter Selasky wrote: >>> Time has come that I make a patch for the most central patching tool in >>> FreeBSD, patch :-) >>>=20 >>> https://reviews.freebsd.org/D30160 >>=20 >> As stupid as it sounds, '*' is a valid filename. >>=20 >> -- >> Shawn Webb >> Cofounder / Security Engineer >> HardenedBSD >>=20 >>=20 >> https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/0= 3A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc >>=20 > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"= From owner-freebsd-current@freebsd.org Fri May 7 21:58:44 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 492E963E439 for ; Fri, 7 May 2021 21:58:44 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (static-24-113-41-81.wavecable.com [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcPTv66cCz3QTZ; Fri, 7 May 2021 21:58:43 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 147LwnVD078765; Fri, 7 May 2021 14:58:58 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) MIME-Version: 1.0 Date: Fri, 07 May 2021 14:58:49 -0700 From: Chris To: Michael Gmelin Cc: Maxim Sobolev , Shawn Webb , Hans Petter Selasky , FreeBSD Current Subject: Re: Patch for patch, but not foreach :-) In-Reply-To: <12082107-B6CE-4EB3-935A-812FC1966CFA@grem.de> References: <12082107-B6CE-4EB3-935A-812FC1966CFA@grem.de> User-Agent: UDNSMS/17.0 Message-ID: <36f77d67cb2673caf8ce72ec45ce8881@bsdforge.com> X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4FcPTv66cCz3QTZ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US]; local_wl_ip(0.00)[24.113.41.81] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 21:58:44 -0000 On 2021-05-07 14:10, Michael Gmelin wrote: > What about using "."? Or "/" (which would match the muscle memory of > "search" in > less/more/vi/some browsers)? +1 I really like that idea. --Chris > > -m > >> On 7. May 2021, at 23:05, Maxim Sobolev wrote: >> >> Replace '*' with ^T perhaps and catch SIGINFO? 🤔 >> >> -Max >> >>> On Fri., May 7, 2021, 10:11 a.m. Shawn Webb, >>> wrote: >>> >>>> On Fri, May 07, 2021 at 03:49:00PM +0200, Hans Petter Selasky wrote: >>>> Time has come that I make a patch for the most central patching tool in >>>> FreeBSD, patch :-) >>>> >>>> https://reviews.freebsd.org/D30160 >>> >>> As stupid as it sounds, '*' is a valid filename. >>> >>> -- >>> Shawn Webb >>> Cofounder / Security Engineer >>> HardenedBSD >>> >>> >>> https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc >>> >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Fri May 7 22:32:43 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 92A2663EBAF; Fri, 7 May 2021 22:32:43 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from maybe.home.utahime.org (gate.home.utahime.org [183.180.29.210]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcQF60y1fz3hY6; Fri, 7 May 2021 22:32:41 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from eastasia.home.utahime.org (eastasia.home.utahime.org [192.168.174.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384) (No client certificate requested) by maybe.home.utahime.org (Postfix) with ESMTPS id D405028881; Sat, 8 May 2021 07:32:37 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=utahime.org; s=maybe2019112701; t=1620426757; bh=oojlDhKEB8WVuD/nOFc+isqS81ruoi1a5JrMO6yhmq4=; h=Date:To:Subject:From:In-Reply-To:References; b=gl1kdsThXC5nA0g9NQkXzSSQJpkhUSKMZnFHz9oxH7XpikxG4d9muf0hUtPmSlW+h rVTp5o++RbK6UOQB40IwKehRcwZHoWBtjTvrIyv0CBDPvyPRwKt3uIapFRDya9EDeU /bbHRD5g3iI7pv3/824sVxNd4IVe+ZDadFgAkFGEyp2VHEXNNNAmZURDYA5KTomqsy TB13EYlRfpB9LaBdvozBANvadEZfEeszaVs33RB6GV14McU6PZcBJkgqHdFjJ9cKjT DDIRnJl5xEAGYf0LHtmd86qn309dPh2JOojfB/RvBk8nqTam25Nook1s0SeWTQkkRj RxQQ+RHS0pFQw== Received: from localhost (rolling.home.utahime.org [192.168.174.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384) (No client certificate requested) by eastasia.home.utahime.org (Postfix) with ESMTPSA id C66A021870; Sat, 8 May 2021 07:32:36 +0900 (JST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.2 at eastasia.home.utahime.org Date: Sat, 08 May 2021 07:31:47 +0900 (JST) Message-Id: <20210508.073147.1934590966598603586.yasu@utahime.org> To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Loading zfs module results in hangup on i386 (Re: Install of 13.0-RELEASE i386 with ZFS root hangs up) From: Yasuhiro Kimura In-Reply-To: <20210507.214759.1825935389016318351.yasu@utahime.org> References: <20210507.214759.1825935389016318351.yasu@utahime.org> X-Mailer: Mew version 6.8 on Emacs 27.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcQF60y1fz3hY6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=utahime.org header.s=maybe2019112701 header.b=gl1kdsTh; dmarc=none; spf=pass (mx1.freebsd.org: domain of yasu@utahime.org designates 183.180.29.210 as permitted sender) smtp.mailfrom=yasu@utahime.org X-Spamd-Result: default: False [0.23 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:spf-authorized.utahime.org]; TO_DN_NONE(0.00)[]; HFILTER_HELO_IP_A(1.00)[maybe.home.utahime.org]; HFILTER_HELO_NORES_A_OR_MX(0.30)[maybe.home.utahime.org]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[utahime.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.07)[-0.067]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[183.180.29.210:from]; ASN(0.00)[asn:2519, ipnet:183.180.0.0/16, country:JP]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[utahime.org:s=maybe2019112701]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[utahime.org]; SPAMHAUS_ZRD(0.00)[183.180.29.210:from:127.0.2.255]; MID_CONTAINS_FROM(1.00)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-stable] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 22:32:43 -0000 From: Yasuhiro Kimura Subject: Install of 13.0-RELEASE i386 with ZFS root hangs up Date: Fri, 07 May 2021 21:47:59 +0900 (JST) > Hello, > > Does anyone succeed to install 13.0-RELEASE i386 with ZFS root? > > I tried this with VirtualBox and VMware Player on Windows with > following VM condition. > > * 4 CPUs > * 8GB memory > * 100GB disk > * Bridge mode NIC > > But in both cases, VM gets high CPU load and hangs up after I moved > to 'YES' at 'ZFS Configuration' menu and type return key. > > If I select UFS root installation completes successfully. So the > problem is specific to ZFS root. Now I think I know what is the source of problem. After all, on 13.0-RELEASE i386 system simply loading zfs module results in system hang up. The steps to reproduce it are, 1. Boot with install media of 13.0-RELEASE i386 2. At the first menu of FreeBSD installer, select 'Shell'. 3. At the shell prompt, type `kldload zfs` and return key. I confirmed hangup happens with VirtualBox, VMware Player and my bare metal PC environement. So the problem doesn't depend on hardware. And hangup also happens with 13-STABLE and 14-CURRENT. --- Yasuhiro Kimura From owner-freebsd-current@freebsd.org Fri May 7 22:45:04 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6500163F21E; Fri, 7 May 2021 22:45:04 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from maybe.home.utahime.org (gate.home.utahime.org [183.180.29.210]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcQWM3ygWz3hsH; Fri, 7 May 2021 22:45:03 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from eastasia.home.utahime.org (eastasia.home.utahime.org [192.168.174.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384) (No client certificate requested) by maybe.home.utahime.org (Postfix) with ESMTPS id CEE5028882; Sat, 8 May 2021 07:44:59 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=utahime.org; s=maybe2019112701; t=1620427499; bh=s50A3uNf+CRwNVo9l5w3AwJLgRO9xlx7MeesvluQQ+s=; h=Date:To:Subject:From:In-Reply-To:References; b=idVHz58dBd38puEI5dpVIa+j9Bokl0pvS4y+12tnK7NIXHvKqOQz5i7hBtkX93Jva 2fEQE3X4YylsV5+eP50qjUCAtLmhumEmRP1JJOXGuEGPkqcgd8fyzBKYJ56tNdldIK xVdu54lsYsv/VVnXalgIQdSKJH/oJmCemTaY90sqYx3AJPdg4uspmuxsxoqfeWU1sK 8/Z3kN8hIKktvl/LVtMbaMWZAlZHo9gcIIOaXJSgeLX63wt+h2wWIcNGxtEOl2RWYP scn0i6Jc5tz+t0CatoLEd/UfSQzHUMFdAdJ9AbD7jWPBz75zPyeVeFQedKt8qI2tF0 jjAZC1p875HJg== Received: from localhost (rolling.home.utahime.org [192.168.174.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384)) (No client certificate requested) by eastasia.home.utahime.org (Postfix) with ESMTPSA id 76ED721913; Sat, 8 May 2021 07:44:58 +0900 (JST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.2 at eastasia.home.utahime.org Date: Sat, 08 May 2021 07:44:15 +0900 (JST) Message-Id: <20210508.074415.2261369884561178196.yasu@utahime.org> To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Loading zfs module results in hangup on i386 From: Yasuhiro Kimura In-Reply-To: <20210508.073147.1934590966598603586.yasu@utahime.org> References: <20210507.214759.1825935389016318351.yasu@utahime.org> <20210508.073147.1934590966598603586.yasu@utahime.org> X-Mailer: Mew version 6.8 on Emacs 27.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FcQWM3ygWz3hsH X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=utahime.org header.s=maybe2019112701 header.b=idVHz58d; dmarc=none; spf=pass (mx1.freebsd.org: domain of yasu@utahime.org designates 183.180.29.210 as permitted sender) smtp.mailfrom=yasu@utahime.org X-Spamd-Result: default: False [-0.41 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+a:spf-authorized.utahime.org:c]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; HFILTER_HELO_IP_A(1.00)[maybe.home.utahime.org]; HFILTER_HELO_NORES_A_OR_MX(0.30)[maybe.home.utahime.org]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[utahime.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.71)[-0.705]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[183.180.29.210:from]; ASN(0.00)[asn:2519, ipnet:183.180.0.0/16, country:JP]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[utahime.org:s=maybe2019112701]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[utahime.org]; SPAMHAUS_ZRD(0.00)[183.180.29.210:from:127.0.2.255]; MID_CONTAINS_FROM(1.00)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-stable] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 22:45:04 -0000 From: Yasuhiro Kimura Subject: Loading zfs module results in hangup on i386 (Re: Install of 13.0-RELEASE i386 with ZFS root hangs up) Date: Sat, 08 May 2021 07:31:47 +0900 (JST) > Now I think I know what is the source of problem. After all, on > 13.0-RELEASE i386 system simply loading zfs module results in system > hang up. > > The steps to reproduce it are, > > 1. Boot with install media of 13.0-RELEASE i386 > 2. At the first menu of FreeBSD installer, select 'Shell'. > 3. At the shell prompt, type `kldload zfs` and return key. > > I confirmed hangup happens with VirtualBox, VMware Player and my bare > metal PC environement. So the problem doesn't depend on hardware. > > And hangup also happens with 13-STABLE and 14-CURRENT. This problem is already reported to Bugzilla. Bug 254177 When ZFS is recognized, An i386 machine with a lot of memory hangs. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=254177 --- Yasuhiro Kimura From owner-freebsd-current@freebsd.org Sat May 8 01:27:23 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C0083643456 for ; Sat, 8 May 2021 01:27:23 +0000 (UTC) (envelope-from smtpfox-unwez@jimmiehalemission.com) Received: from server.pmgstagingserver.com (server.pmgstagingserver.com [142.93.7.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcV6f5Hy6z3qfj for ; Sat, 8 May 2021 01:27:22 +0000 (UTC) (envelope-from smtpfox-unwez@jimmiehalemission.com) Received: from [192.3.141.135] (port=63818 helo=jimmiehalemission.com) by server.pmgstagingserver.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1lfBkU-0005D7-Aq for freebsd-current@freebsd.org; Sat, 08 May 2021 01:27:16 +0000 From: Sponsored Ads To: freebsd-current@freebsd.org Subject: Contact message from Wealth Creation - visit www.wealthcreationpoint.com Date: 07 May 2021 18:27:16 -0700 Message-ID: <20210507182716.D75E511CF9D1F5EC@freebsd.org> MIME-Version: 1.0 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - server.pmgstagingserver.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - jimmiehalemission.com X-Get-Message-Sender-Via: server.pmgstagingserver.com: authenticated_id: smtpfox-unwez@jimmiehalemission.com X-Authenticated-Sender: server.pmgstagingserver.com: smtpfox-unwez@jimmiehalemission.com X-Source: X-Source-Args: X-Source-Dir: X-Rspamd-Queue-Id: 4FcV6f5Hy6z3qfj X-Spamd-Bar: +++++++++++++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=fail (mx1.freebsd.org: domain of smtpfox-unwez@jimmiehalemission.com does not designate 142.93.7.66 as permitted sender) smtp.mailfrom=smtpfox-unwez@jimmiehalemission.com X-Spamd-Result: default: False [13.68 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; SEM_URIBL_FRESH15(0.00)[wealthcreationpoint.com:url]; HAS_X_SOURCE(0.00)[]; TO_DN_NONE(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[freebsd-current@freebsd.org,smtpfox-unwez@jimmiehalemission.com]; HAS_X_ANTIABUSE(0.00)[]; TO_EQ_FROM(0.00)[]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[142.93.7.66:from]; ASN(0.00)[asn:14061, ipnet:142.93.0.0/20, country:US]; FROM_NEQ_ENVFROM(0.00)[freebsd-current@freebsd.org,smtpfox-unwez@jimmiehalemission.com]; HAS_X_AS(0.00)[smtpfox-unwez@jimmiehalemission.com]; R_PARTS_DIFFER(0.31)[65.6%]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ABUSE_SURBL(5.50)[wealthcreationpoint.com:url]; URL_IN_SUBJECT(0.40)[www.wealthcreationpoint.com]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_FAIL(1.00)[-all]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; NEURAL_SPAM_MEDIUM(0.27)[0.267]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[142.93.7.66:from:127.0.2.255]; NEURAL_HAM_LONG(-1.00)[-0.997]; HAS_X_GMSV(0.00)[smtpfox-unwez@jimmiehalemission.com]; URIBL_BLACK(7.00)[wealthcreationpoint.com:url]; FROM_NAME_EXCESS_SPACE(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current] X-Spam: Yes Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 01:27:23 -0000 You wanna make money why at home simply trade in bitcoin visit=20=20 www.wealthcreationpoint.com to learn how bitcoin can make life=20 better Thanks Support From owner-freebsd-current@freebsd.org Sat May 8 02:36:43 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0313B64664D for ; Sat, 8 May 2021 02:36:43 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcWff5QsBz3txg for ; Sat, 8 May 2021 02:36:42 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: by mailman.nyi.freebsd.org (Postfix) id BA0FA6464CD; Sat, 8 May 2021 02:36:42 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B9D736465BD for ; Sat, 8 May 2021 02:36:42 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from id.bluezbox.com (id.bluezbox.com [45.55.20.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcWfd4X1Bz3vHN; Sat, 8 May 2021 02:36:41 +0000 (UTC) (envelope-from gonzo@bluezbox.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=bluezbox.com; s=mail; h=In-Reply-To:Content-Type:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=Lv6i/StcZbfYQECzEkV/CCDYUjkUrgVUJo2q1LgzcB4=; b=UDrJW4fv6STHNXs596XtTBscFO o+sVSczDqnTQkgx6i3LtrRWtrqVmf873dSVg+UeHpS2sZbMcqRk4xo3WpJ+rBHredBvBGICNdPj09 wV21mdoKG0SUegjgvTz6FL4DwiwbSDUVagMgVwxo6UcSXS5TWMisA1NcQBW317nF8Ez4=; Received: from localhost ([127.0.0.1] helo=id.bluezbox.com) by id.bluezbox.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lfCpb-000HCq-UY; Fri, 07 May 2021 19:36:40 -0700 Received: (from gonzo@localhost) by id.bluezbox.com (8.15.2/8.15.2/Submit) id 1482adwN066143; Fri, 7 May 2021 19:36:39 -0700 (PDT) (envelope-from gonzo@bluezbox.com) X-Authentication-Warning: id.bluezbox.com: gonzo set sender to gonzo@bluezbox.com using -f Date: Fri, 7 May 2021 19:36:39 -0700 From: Oleksandr Tymoshenko To: Yuri Pankov Cc: Kubilay Kocak , current@freebsd.org, Bugmeister Subject: Re: linking to git revisions in bugzilla Message-ID: <20210508023639.GA66088@bluezbox.com> References: <134b5580-360a-43c9-8c8f-2a50c2524e7e@www.fastmail.com> <36286647-e005-d289-45d6-9630d39d6430@FreeBSD.org> <20210502050310.GA4428@bluezbox.com> <267d6951-570f-43c7-ddf2-fa794362bfef@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <267d6951-570f-43c7-ddf2-fa794362bfef@FreeBSD.org> X-Operating-System: FreeBSD/11.2-RELEASE-p10 (amd64) X-Spam-Level: -- X-Spam-Report: Spam detection software, running on the system "id.bluezbox.com", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Yuri Pankov (yuripv@FreeBSD.org) wrote: > Oleksandr Tymoshenko wrote: > > Kubilay Kocak (koobs@FreeBSD.org) wrote: > >> On 12/04/2021 9:02 am, Yuri Pankov wrote: > >>> While filing a bug, I noticed th [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Rspamd-Queue-Id: 4FcWfd4X1Bz3vHN X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bluezbox.com header.s=mail header.b=UDrJW4fv; dmarc=none; spf=pass (mx1.freebsd.org: domain of gonzo@bluezbox.com designates 45.55.20.155 as permitted sender) smtp.mailfrom=gonzo@bluezbox.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bluezbox.com:s=mail]; FREEFALL_USER(0.00)[gonzo]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[bluezbox.com]; MID_RHS_MATCH_FROM(0.00)[]; SPAMHAUS_ZRD(0.00)[45.55.20.155:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+mx]; DKIM_TRACE(0.00)[bluezbox.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[45.55.20.155:from]; ASN(0.00)[asn:14061, ipnet:45.55.0.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 02:36:43 -0000 Yuri Pankov (yuripv@FreeBSD.org) wrote: > Oleksandr Tymoshenko wrote: > > Kubilay Kocak (koobs@FreeBSD.org) wrote: > >> On 12/04/2021 9:02 am, Yuri Pankov wrote: > >>> While filing a bug, I noticed that the help only mentions svn revision numbers, and "Preview" tab had no output when I tried putting "base ", so I'm wondering how do you link to git revisions? > >> > >> We'll (bugmeister) be adding parsing support for it (along with a few > >> other related auto-linking things) > >> > >> I'd encourage people to use " " (repo = src|doc|ports) > >> where short hash is at least 8 chars in the meantime. Once parsing is > >> added all previous references will be linked. > > > > Links to git hashes should work now, please test and let us > > know if feature works as expected. As Michael mentioned - preview > > is a different matter, I'll try to look into it later. > > Hi Oleksandr, > > It seems to work except when the git hash starts with a digit, it then > tries to link to subversion revision using all available digits at the > start of the hash. Or, at least, that's what I'm seeing in preview tab, > not sure if it has been fixed yet? This should be fixed now. If there is an example where it doesn't work please post it to this PR: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=255682 Thank you -- gonzo From owner-freebsd-current@freebsd.org Sat May 8 12:00:41 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 132A46335CB; Sat, 8 May 2021 12:00:41 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from maybe.home.utahime.org (gate.home.utahime.org [183.180.29.210]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fcm9M2mxvz4pVM; Sat, 8 May 2021 12:00:38 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from eastasia.home.utahime.org (eastasia.home.utahime.org [192.168.174.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384) (No client certificate requested) by maybe.home.utahime.org (Postfix) with ESMTPS id 4BDDF28859; Sat, 8 May 2021 21:00:29 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=utahime.org; s=maybe2019112701; t=1620475229; bh=IF6Zyh5fS4MnuUV0ma9/ENb+iV6619cs6s+3v4LPb1k=; h=Date:To:Subject:From:In-Reply-To:References; b=LyBJUiby5OQMu4mCVvpczfonSV3KCdsK3mmoiqInUet4QmaIRMh+t/rU6KFMeRkyr YxULNcbC00l+LKXhLb9+hqYdejHtreSkTNKwVsigvDYa9Aqk18EE7GCrs+pnhzSI+k /OrZj4ehcEtYNEHxQCAzvP0lz/zQ2RgpbXRnTWPn0CyHjeuZMOvFWig4CEuoskmWnJ FOxbeBM66tFvQg9dE62R/qhu7i/koG74f9z0amFEKQ/qy7TrY3QHzA033cfkVWm/DU t9lT68H3EjOhKqzyFVbse7Pi/VW4b+K28aVLF4rTNa7UVR4+z2FD7dLBSnypugLlNW aWytHoZauk64w== Received: from localhost (rolling-vm-freebsd5.home.utahime.org [192.168.174.55]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384)) (No client certificate requested) by eastasia.home.utahime.org (Postfix) with ESMTPSA id 92C9121D62; Sat, 8 May 2021 21:00:26 +0900 (JST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.2 at eastasia.home.utahime.org Date: Sat, 08 May 2021 20:59:40 +0900 (JST) Message-Id: <20210508.205940.216790454.yasu@utahime.org> To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Loading zfs module results in hangup on i386 From: Yasuhiro Kimura In-Reply-To: <20210508.074415.2261369884561178196.yasu@utahime.org> References: <20210507.214759.1825935389016318351.yasu@utahime.org> <20210508.073147.1934590966598603586.yasu@utahime.org> <20210508.074415.2261369884561178196.yasu@utahime.org> X-Mailer: Mew version 6.8 on Emacs 27.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Fcm9M2mxvz4pVM X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=utahime.org header.s=maybe2019112701 header.b=LyBJUiby; dmarc=none; spf=pass (mx1.freebsd.org: domain of yasu@utahime.org designates 183.180.29.210 as permitted sender) smtp.mailfrom=yasu@utahime.org X-Spamd-Result: default: False [-0.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:spf-authorized.utahime.org]; TO_DN_NONE(0.00)[]; HFILTER_HELO_IP_A(1.00)[maybe.home.utahime.org]; HFILTER_HELO_NORES_A_OR_MX(0.30)[maybe.home.utahime.org]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[utahime.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[183.180.29.210:from]; ASN(0.00)[asn:2519, ipnet:183.180.0.0/16, country:JP]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[utahime.org:s=maybe2019112701]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[utahime.org]; SPAMHAUS_ZRD(0.00)[183.180.29.210:from:127.0.2.255]; MID_CONTAINS_FROM(1.00)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-stable] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 12:00:41 -0000 From: Yasuhiro Kimura Subject: Re: Loading zfs module results in hangup on i386 Date: Sat, 08 May 2021 07:44:15 +0900 (JST) >> Now I think I know what is the source of problem. After all, on >> 13.0-RELEASE i386 system simply loading zfs module results in system >> hang up. >> >> The steps to reproduce it are, >> >> 1. Boot with install media of 13.0-RELEASE i386 >> 2. At the first menu of FreeBSD installer, select 'Shell'. >> 3. At the shell prompt, type `kldload zfs` and return key. >> >> I confirmed hangup happens with VirtualBox, VMware Player and my bare >> metal PC environement. So the problem doesn't depend on hardware. >> >> And hangup also happens with 13-STABLE and 14-CURRENT. > > This problem is already reported to Bugzilla. > > Bug 254177 When ZFS is recognized, An i386 machine with a lot of memory hangs. > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=254177 Referencing the bug report, I applied attached patch to d474440ab33 of main (14-CURRENT). built install image and tried install of ZFS root i386 system with it. Then it completed successfully with 8GB memory. Additionally GENERIC kernel recognizes 8GB of memory. And ZFS root system works fine without any tuning. ---------------------------------------------------------------------- diff --git a/sys/contrib/openzfs/module/zfs/dbuf.c b/sys/contrib/openzfs/module/zfs/dbuf.c index d48dc7943a2..c85500453fb 100644 --- a/sys/contrib/openzfs/module/zfs/dbuf.c +++ b/sys/contrib/openzfs/module/zfs/dbuf.c @@ -796,7 +796,7 @@ dbuf_init(void) * By default, the table will take up * totalmem * sizeof(void*) / 8K (1MB per GB with 8-byte pointers). */ - while (hsize * zfs_arc_average_blocksize < physmem * PAGESIZE) + while (hsize * zfs_arc_average_blocksize < (uint64_t)physmem * PAGESIZE) hsize <<= 1; retry: ---------------------------------------------------------------------- --- Yasuhiro Kimura