From nobody Mon Jun 7 07:42:22 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 097AFE5ED41 for ; Mon, 7 Jun 2021 07:42:26 +0000 (UTC) (envelope-from SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fz51X6xrTz3wM6 for ; Mon, 7 Jun 2021 07:42:24 +0000 (UTC) (envelope-from SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl) Date: Mon, 7 Jun 2021 09:42:22 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1623051742; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=QWf9ZuHspFYgNi6cyyz7Ezuip/NgLTHgeeJs6TEOrkg=; b=TGTuZ1wOTx4bQADrGoIY/kYxvopm5LasSZPZRwlOWzZYITU3IfL7eTmxuls77qNtl2QF75 4Eab0mj59OwtcucURvgAzEREG8yQgCZTIs7bs/e+win0vajs+d/y8QVWPZjyhZX8BQDrnZ EVd/Vva32LYBbzR7KoAFh/V9M06gpUl8ldFzJPhIaoicm7A8UVxbnGwDCQIht/eB/yhKlR oCzVNlrKYpW6tlhEoM4LAyLysJwYtVI4sjrd5C7Lfh2t6Dh5jhiBEA9GwRzqZFDpuV4wwW TkygYE2JvEiI+xdms17F8uRAvCafZ7vSPoWQ5lVqWOhHjJDZC8TB89Er8iCCUg== From: Ronald Klop To: freebsd-stable@freebsd.org Message-ID: <50183224.330.1623051742099@localhost> In-Reply-To: <20210606165738.f944a3649687a4ae09bb3cf6@getmail.no> References: <0d9ed5fb-7b98-8fa5-2429-a00c615afc69@klop.ws> <20210606165738.f944a3649687a4ae09bb3cf6@getmail.no> Subject: Re: cron line continuation? List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_329_1222429098.1623051742094" X-Mailer: Realworks (563.279.642d63713bf) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 4Fz51X6xrTz3wM6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=TGTuZ1wO; dmarc=pass (policy=none) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl designates 194.109.157.24 as permitted sender) smtp.mailfrom=SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl X-Spamd-Result: default: False [-2.20 / 15.00]; MID_RHS_NOT_FQDN(0.50)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[194.109.157.24:from]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DKIM_TRACE(0.00)[klop.ws:+]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,none]; HAS_X_PRIO_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[194.109.157.24:from]; FORGED_SENDER(0.30)[ronald-lists@klop.ws,SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; FROM_NEQ_ENVFROM(0.00)[ronald-lists@klop.ws,SRS0=lh/3=LB=klop.ws=ronald-lists@realworks.nl]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: Y ------=_Part_329_1222429098.1623051742094 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: Torfinn Ingolfsen Datum: zondag, 6 juni 2021 16:57 Aan: freebsd-stable@freebsd.org Onderwerp: Re: cron line continuation? > > On Sun, 6 Jun 2021 13:56:18 +0200 > Ronald Klop wrote: > > > Hi, > > > > I'm trying to create a cron entry with line continuation. This document mentions the \ character: > > https://docs.freebsd.org/doc/13.0-RELEASE/usr/local/share/doc/freebsd/en_US.ISO8859-1/books/handbook/configtuning-cron.html > > > > The manual pages do not mention this and I can't get it to work. > > > > Is this possible? > > 'man 5 crontab' has this section > The ``sixth'' field (the rest of the line) specifies the command to be > run. One or more command options may precede the command to modify > processing behavior. The entire command portion of the line, up to a > newline or % character, will be executed by /bin/sh or by the shell > specified in the SHELL variable of the cronfile. Percent-signs (%) in > the command, unless escaped with backslash (\), will be changed into > newline characters, and all data after the first % will be sent to the > command as standard input. > > HTH > -- > Torfinn Ingolfsen > > > > Thank you for your answer. I read that part of the manual page. It says that everything after % is used as standard input. That is not what I'm looking for. I would like to rewrite this: @daily freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) cron && freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) updatesready > /dev/null && freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) install to this: @daily freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) cron \ && freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) updatesready > /dev/null \ && freebsd-update -b /data/jails/freebsd13 -d /data/jails/freebsd13/var/db/freebsd-update/ -f /data/jails/freebsd13/etc/freebsd-update.conf --currently-running $( /data/jails/freebsd13/bin/freebsd-version -u) install which is much better readable. I can't get this to work so the documentation might be inconsistent. Regards, Ronald. ------=_Part_329_1222429098.1623051742094-- From nobody Mon Jun 7 07:51:41 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 58C6D13C822D for ; Mon, 7 Jun 2021 07:51:49 +0000 (UTC) (envelope-from ask@develooper.com) Received: from mx-out1.ewr1.develooper.com (mx-out1.ewr1.develooper.com [139.178.64.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fz5DP24ZYz4RxW for ; Mon, 7 Jun 2021 07:51:49 +0000 (UTC) (envelope-from ask@develooper.com) Received: from mail.develooper.com (kw1 [147.75.38.195]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx-out1.ewr1.develooper.com (Postfix) with ESMTPS id 545326E007A; Mon, 7 Jun 2021 07:51:48 +0000 (UTC) X-Virus-Scanned: Yes Content-Type: multipart/alternative; boundary="Apple-Mail=_A83D529E-C52D-4500-A5AE-FAFB1DDE2243" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=develooper.com; s=mail; t=1623052303; bh=0duc2pjLqf3fn9BpXILETwtgmcljdrzY2OQxxv1semM=; h=Subject:From:In-Reply-To:Cc:References:To; b=hygz1UFQYpRupKb2m6Bv7wbdkFjmo2pJNmYFY3+pgOU2W6H9fXVh74/UxIH0P7TQ7 qHrE/W1F9V6YFcKB/Cr8iJVrKLiQ4z7K2WXCsIngCQMueEoQlkCjt8eUEmbnGe1Oqu rZhzUK2syx+dxm717uJEmMawVAXgQzKteE442eBEX+KbvRi26KpkjcaA75DFdKQh/q fHbNZ1GmRbW3Q0ebCH7Bg7HzqDRVpWiY8YC9YimMK/JjDUPYhXPQMFi40qOSGx49pn 8hUwxWEvn51P2BgsZ2w3wMsQE7/gwvEWsaHQNkNjojsJhc8pvg7GJRploIy6NNXPxq u7qLXXhqcMpgw== List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Subject: Re: cron line continuation? From: =?utf-8?Q?Ask_Bj=C3=B8rn_Hansen?= X-Priority: 3 (Normal) In-Reply-To: <50183224.330.1623051742099@localhost> Date: Mon, 7 Jun 2021 00:51:41 -0700 Cc: freebsd-stable@freebsd.org Message-Id: <8C2E306D-032F-4224-B03F-194C30E13D43@develooper.com> References: <0d9ed5fb-7b98-8fa5-2429-a00c615afc69@klop.ws> <20210606165738.f944a3649687a4ae09bb3cf6@getmail.no> <50183224.330.1623051742099@localhost> To: Ronald Klop X-Rspamd-Queue-Id: 4Fz5DP24ZYz4RxW X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --Apple-Mail=_A83D529E-C52D-4500-A5AE-FAFB1DDE2243 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jun 7, 2021, at 00:42, Ronald Klop wrote: >=20 > which is much better readable. I can't get this to work so the = documentation might be inconsistent. I don=E2=80=99t think cron supports escaping newline. You can escape % = as described, but (as you know) that=E2=80=99s something else. The standard solution to this is not to write programs in the cron = config. Write a script or program elsewhere and have cron execute it. Ask= --Apple-Mail=_A83D529E-C52D-4500-A5AE-FAFB1DDE2243-- From nobody Mon Jun 7 08:58:43 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EFB0F13CB196 for ; Mon, 7 Jun 2021 08:58:47 +0000 (UTC) (envelope-from tom@samplonius.org) Received: from mail-pl1-x62d.google.com (mail-pl1-x62d.google.com [IPv6:2607:f8b0:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fz6jf6ShNz4Wqt for ; Mon, 7 Jun 2021 08:58:46 +0000 (UTC) (envelope-from tom@samplonius.org) Received: by mail-pl1-x62d.google.com with SMTP id b12so2287869plg.11 for ; Mon, 07 Jun 2021 01:58:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samplonius-org.20150623.gappssmtp.com; s=20150623; h=from:mime-version:subject:date:references:to:in-reply-to:message-id; bh=zdB0zBd7liKumshNi5F02Ue8yndVAp6Ca7/BSEztY48=; b=JwLv15zjTiRfFRv1UGbmfDika7ZsdU9qPi/e/eIS/EdZXyMYhI50ThieG7dIGq66e/ dPVcLIHmQBX67JW3FphOEFo7TF036lAqOWbnuAnyQiBw9Ea5ZGUInhBguhF7LdpDkAHs jEju9YFEyXf6BsRmLU4vvprW6WYK4of7KBaIrqIkvtHigltgbcZH3nKA5WYfXv35q7nR 94CYXQnVXe9UbqVUDm49SpLf23JNMk2X1T14vcvjEt+A2DP9fxaJqMjjPoS+f62qAaV9 e54Vghr767l4sv3xVrtiUqn/w4xTzES7LHvWlpKLncTfL/Wd8AGqEZDa1xvw7N19QhMt 3ueg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:date:references:to :in-reply-to:message-id; bh=zdB0zBd7liKumshNi5F02Ue8yndVAp6Ca7/BSEztY48=; b=GWUCLkygfYZuaWBGpOlfZhbA3b5PL/Iq3LLeeXGxHUg8Xu/DKmejO2U14jzMORvg2J 8pfQYRA4xBTSVZ5ypLnQTTDh+osWHHR0QaoDXExafAxUDkLiukrjx2u6zwJm1mP6+juC 8IsRSx0dtOgUuy8AAHNZ4vL4lUX3EUe+L6jl6PQU/9+dB4ON2hoZQWbmtpCeGbpQa3Ez 3pHEb7c2JKuAF9YVILLd4ck2xWavHdUR79BlLMeU5JaiSHlO92pTHPUPhxh1JnrWoKY1 t3WoDpy8CD10KbzEuzM9mlpwU+DfMbnSztqFlx3F9IDV+iN2CO6qjIj8pH1pAk+NRN/0 Nccg== X-Gm-Message-State: AOAM5303xLOKUylhlxCo1IyxmAeF8KqszrD88N9Dp4+6j1b34eO3NUDv FJpz5kc6HvCfLSYYzCtIq7NyEfHfkt4jFz9b6jE= X-Google-Smtp-Source: ABdhPJyFdx71/lCEe9U/FfaFa8ShuBhmPz11cjDOQvKk2ykp+F0EgYa5P6FXuuGbsJyLQCi49und6w== X-Received: by 2002:a17:90a:520f:: with SMTP id v15mr18953144pjh.23.1623056324954; Mon, 07 Jun 2021 01:58:44 -0700 (PDT) Received: from smtpclient.apple (S0106e48d8c53b080.vc.shawcable.net. [24.80.47.133]) by smtp.gmail.com with ESMTPSA id 190sm8610776pgd.1.2021.06.07.01.58.44 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Jun 2021 01:58:44 -0700 (PDT) From: Tom Samplonius List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.100.0.2.22\)) Content-Type: multipart/alternative; boundary="Apple-Mail=_3A184214-ADF6-4941-B308-545123C1419C" X-Priority: 3 (Normal) Subject: Re: cron line continuation? Date: Mon, 7 Jun 2021 01:58:43 -0700 References: <0d9ed5fb-7b98-8fa5-2429-a00c615afc69@klop.ws> <20210606165738.f944a3649687a4ae09bb3cf6@getmail.no> <50183224.330.1623051742099@localhost> <8C2E306D-032F-4224-B03F-194C30E13D43@develooper.com> To: freebsd-stable@freebsd.org In-Reply-To: <8C2E306D-032F-4224-B03F-194C30E13D43@develooper.com> Message-Id: <536D5FEC-DA23-4502-A161-D910D6805E16@samplonius.org> X-Mailer: Apple Mail (2.3654.100.0.2.22) X-Rspamd-Queue-Id: 4Fz6jf6ShNz4Wqt X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=samplonius-org.20150623.gappssmtp.com header.s=20150623 header.b=JwLv15zj; dmarc=none; spf=none (mx1.freebsd.org: domain of tom@samplonius.org has no SPF policy when checking 2607:f8b0:4864:20::62d) smtp.mailfrom=tom@samplonius.org X-Spamd-Result: default: False [-1.80 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[samplonius-org.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.999]; HAS_X_PRIO_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::62d:from]; RECEIVED_SPAMHAUS_PBL(0.00)[24.80.47.133:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[samplonius-org.20150623.gappssmtp.com:s=20150623]; FREEFALL_USER(0.00)[tom]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[samplonius.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::62d:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62d:from]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: Y --Apple-Mail=_3A184214-ADF6-4941-B308-545123C1419C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jun 7, 2021, at 12:51 AM, Ask Bj=C3=B8rn Hansen = wrote: >=20 >=20 >=20 >> On Jun 7, 2021, at 00:42, Ronald Klop wrote: >>=20 >> which is much better readable. I can't get this to work so the = documentation might be inconsistent. >=20 > I don=E2=80=99t think cron supports escaping newline. You can escape % = as described, but (as you know) that=E2=80=99s something else. >=20 > The standard solution to this is not to write programs in the cron = config. Write a script or program elsewhere and have cron execute it. >=20 Yes, =E2=80=9C\=E2=80=9D as a continuation character is not supported. = The cron manpage is correct (no mention of using \ for anything but an = escape character). The = https://docs.freebsd.org/doc/13.0-RELEASE/usr/local/share/doc/freebsd/en_U= S.ISO8859-1/books/handbook/configtuning-cron.html = page is incorrect. I=E2=80=99ve also checked the source at = https://github.com/freebsd/freebsd-src/blob/373ffc62c158e52cde86a5b934ab4a= 51307f9f2e/usr.sbin/cron/lib/entry.c There is no code to merge lines = ending with a \ into a single command. And I agree, for a large number of sequential commands, a shell is = going to superior is every way. You could also add error recovery, etc. > Ask --Apple-Mail=_3A184214-ADF6-4941-B308-545123C1419C-- From nobody Mon Jun 7 18:53:34 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BFC72E5AB14 for ; Mon, 7 Jun 2021 18:53:37 +0000 (UTC) (envelope-from dave@jetcafe.org) Received: from fedex2.jetcafe.org (fedex2.jetcafe.org [205.147.26.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "fedex2.jetcafe.org", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzMw04dh3z3rPC for ; Mon, 7 Jun 2021 18:53:36 +0000 (UTC) (envelope-from dave@jetcafe.org) X-Envelope-To: Received: from bigus.dream-tech.com (bigus.jetcafe.org [205.147.26.7]) by fedex2.jetcafe.org (8.16.1/8.15.2) with ESMTPS id 157IrYsH099594 (version=TLSv1.3 cipher=AEAD-AES256-GCM-SHA384 bits=256 verify=NO) for ; Mon, 7 Jun 2021 11:53:34 -0700 (PDT) (envelope-from dave@jetcafe.org) Date: Mon, 7 Jun 2021 11:53:34 -0700 From: Dave Hayes To: freebsd-stable@freebsd.org Subject: Re: Where might memory be reported? Message-ID: <20210607115334.6e9d1178@bigus.dream-tech.com> In-Reply-To: <20210606160913.167e6c0a@bigus.dream-tech.com> References: <20210606160913.167e6c0a@bigus.dream-tech.com> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -1 ( out of 6) ALL_TRUSTED,SHORTCIRCUIT X-Spam-Checker-Version: SpamAssassin version 3.4.4-jetcafeglobal X-Scanned-By: MIMEDefang 2.83 X-Rspamd-Queue-Id: 4FzMw04dh3z3rPC X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of dave@jetcafe.org designates 205.147.26.23 as permitted sender) smtp.mailfrom=dave@jetcafe.org X-Spamd-Result: default: False [-2.26 / 15.00]; RCVD_TLS_ALL(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[205.147.26.23:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[205.147.26.23:from:127.0.2.255]; DMARC_NA(0.00)[jetcafe.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.965]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7397, ipnet:205.147.0.0/18, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On Sun, 6 Jun 2021 16:09:13 -0700 Dave Hayes wrote: > Consider this output from a 12.2-STABLE box (r368820) on amd64: > > # sysctl vm.stats.vm | grep count > vm.stats.vm.v_cache_count: 0 > vm.stats.vm.v_user_wire_count: 0 > vm.stats.vm.v_laundry_count: 0 > vm.stats.vm.v_inactive_count: 121191 > vm.stats.vm.v_active_count: 20836 > vm.stats.vm.v_wire_count: 754310 > vm.stats.vm.v_free_count: 254711 > vm.stats.vm.v_page_count: 3993253 > > It should be pretty clear that there are missing pages. Where might they be > and how might I find out? Replying to myself here to make the situation clearer. :) So I've noticed on random machines with various different and uncommon services, there's an issue where the reported in-use memory (that I know about, see above) continues to drop until and unless the machine is rebooted. If I do not reboot, the machine will continue up until it runs out of swap space, at which point a reboot is apparently mandatory. Naturally I am trying to monitor the situation, but I can't seem to find what is using the extra memory. I would like to file a bug about this, but first I would like to ensure that I am not missing something obvious (or even non-obvious). As a related addendum, I used to know some of how FreeBSD virtual memory worked but it would appear from 11->12 that this has changed. Thus, I am completely open to be pointed to any documentation or reading about how the virtual memory system has changed (other than source code) between 11 and 12. Thanks in advance for cogent replies. -- Dave Hayes - Consultant - LA CA, USA - dave@dream-tech.com >>>> *The opinions expressed above are entirely my own* <<<< A person is deficient in understanding until they perceive that there is a whole cycle of evolution possible within themselves: repeating endlessly, offering opportunities for personal development. From nobody Mon Jun 7 19:11:44 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 439F5E5C468 for ; Mon, 7 Jun 2021 19:10:58 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (static-24-113-41-81.wavecable.com [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzNJ20NJRz3tXm for ; Mon, 7 Jun 2021 19:10:57 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 157JBiut004396; Mon, 7 Jun 2021 12:11:50 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Date: Mon, 07 Jun 2021 12:11:44 -0700 From: Chris To: Dave Hayes Cc: freebsd-stable@freebsd.org Subject: Re: Where might memory be reported? In-Reply-To: <20210607115334.6e9d1178@bigus.dream-tech.com> References: <20210606160913.167e6c0a@bigus.dream-tech.com> <20210607115334.6e9d1178@bigus.dream-tech.com> User-Agent: UDNSMS/17.0 Message-ID: <6c174c830019d133fbb4daefe442fb40@bsdforge.com> X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FzNJ20NJRz3tXm X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 2021-06-07 11:53, Dave Hayes wrote: > On Sun, 6 Jun 2021 16:09:13 -0700 > Dave Hayes wrote: >> Consider this output from a 12.2-STABLE box (r368820) on amd64: >> >> # sysctl vm.stats.vm | grep count >> vm.stats.vm.v_cache_count: 0 >> vm.stats.vm.v_user_wire_count: 0 >> vm.stats.vm.v_laundry_count: 0 >> vm.stats.vm.v_inactive_count: 121191 >> vm.stats.vm.v_active_count: 20836 >> vm.stats.vm.v_wire_count: 754310 >> vm.stats.vm.v_free_count: 254711 >> vm.stats.vm.v_page_count: 3993253 >> >> It should be pretty clear that there are missing pages. Where might they be >> and how might I find out? > > Replying to myself here to make the situation clearer. :) > > So I've noticed on random machines with various different and uncommon > services, > there's an issue where the reported in-use memory (that I know about, see > above) > continues to drop until and unless the machine is rebooted. If I do not > reboot, > the machine will continue up until it runs out of swap space, at which point > a > reboot is apparently mandatory. FWIW I'm experiencing this same situation on one of my 12 servers. I've been carefully monitoring it in hopes that 1) the swap was eventually sufficiently purged 2) that I could discover what was preventing 1) from occurring Nice to know I'm not a _too_ isolated situation. Thanks for bringing it up, Dave. :-) --Chris > > Naturally I am trying to monitor the situation, but I can't seem to find > what > is using the extra memory. > > I would like to file a bug about this, but first I would like to ensure that > I > am not missing something obvious (or even non-obvious). > > As a related addendum, I used to know some of how FreeBSD virtual memory > worked but it would appear from 11->12 that this has changed. Thus, > I am completely open to be pointed to any documentation or reading about how > the > virtual memory system has changed (other than source code) between 11 and > 12. > > Thanks in advance for cogent replies. From nobody Tue Jun 8 05:58:37 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BC6AE5D563A for ; Tue, 8 Jun 2021 06:00:04 +0000 (UTC) (envelope-from dewayne@heuristicsystems.com.au) Received: from heuristicsystems.com.au (hermes.heuristicsystems.com.au [203.41.22.115]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2560 bits) client-digest SHA256) (Client CN "hermes.heuristicsystems.com.au", Issuer "Heuristic Systems Type 4 Host CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fzfj01zThz5952 for ; Tue, 8 Jun 2021 06:00:03 +0000 (UTC) (envelope-from dewayne@heuristicsystems.com.au) Received: from [10.0.5.3] (noddy.hs [10.0.5.3]) (authenticated bits=0) by heuristicsystems.com.au (8.15.2/8.15.2) with ESMTPSA id 1585wb4E071910 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Tue, 8 Jun 2021 15:58:38 +1000 (AEST) (envelope-from dewayne@heuristicsystems.com.au) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=heuristicsystems.com.au; s=hsa; t=1623131918; x=1623736719; bh=8c70tNdnlPte9bl+6i+AnnOWEFx4K/NncfbAUN8MCy4=; h=Subject:To:Cc:From:Message-ID:Date; b=OPZR0jCWkxSV/YFIjiLIzBsScKXKZzVBchM7g+XcSKA72uEmlZhE0FOdNHPxDxq3M YvQzYC5zYiSxL8VYx2JqDl0UcBmYUht0mn4emULNsbgUDYr7AhZ72NxFKcWfP2r7aW g5NJkNpIkyD3+53ASDodacMeX4S4IR4Tp7TglCHriGVgRnpG2wIqs X-Authentication-Warning: b3.hs: Host noddy.hs [10.0.5.3] claimed to be [10.0.5.3] Subject: Re: Where might memory be reported? To: Chris , Dave Hayes Cc: freebsd-stable@freebsd.org References: <20210606160913.167e6c0a@bigus.dream-tech.com> <20210607115334.6e9d1178@bigus.dream-tech.com> <6c174c830019d133fbb4daefe442fb40@bsdforge.com> From: Dewayne Geraghty Message-ID: Date: Tue, 8 Jun 2021 15:58:37 +1000 User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <6c174c830019d133fbb4daefe442fb40@bsdforge.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Fzfj01zThz5952 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N This issue was raised in April '21 by Andriy Gapon title "stable/13, vm page counts do not add up". This was mentioned https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253281 though its probably more of an affirmation of a symptom. (reminder to adjust status) More relevant is https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234559 where Mark Johnson advised (in Feb '19) "I've thought about this some more and decided to close this bug WONTFIX for now. Basically, we started lazily dequeuing wired pages to avoid the page queue synchronization cost incurred by frequent wirings. The result is that wired pages may temporarily be counted as active/inactive/laundry despite not being reclaimable. Maintaining the previous behaviour wrt statistics would introduce synchronization overhead that we've been trying to avoid in past and future work. I don't plan to change the current behaviour and there doesn't seem to be a compelling reason to do so, at least based on this report. If you or anyone else would like to discuss this further or describe a use-case that depends on the old behaviour, please feel free to re-open the bug." I hope I've shed some light on the current situation, unfortunately not in its resolution. Regards, Dewayne. From nobody Tue Jun 8 07:39:55 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2CB997CC2A5 for ; Tue, 8 Jun 2021 07:39:10 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (static-24-113-41-81.wavecable.com [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzhvK6mSFz3KJG for ; Tue, 8 Jun 2021 07:39:09 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 1587dtZZ054538; Tue, 8 Jun 2021 00:40:02 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Date: Tue, 08 Jun 2021 00:39:55 -0700 From: Chris To: Dewayne Geraghty Cc: Dave Hayes , freebsd-stable@freebsd.org Subject: Re: Where might memory be reported? In-Reply-To: References: <20210606160913.167e6c0a@bigus.dream-tech.com> <20210607115334.6e9d1178@bigus.dream-tech.com> <6c174c830019d133fbb4daefe442fb40@bsdforge.com> User-Agent: UDNSMS/17.0 Message-ID: <7a70082c6e7e8f948e5c6f92c70174fc@bsdforge.com> X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4FzhvK6mSFz3KJG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 2021-06-07 22:58, Dewayne Geraghty wrote: > This issue was raised in April '21 by Andriy Gapon title "stable/13, vm > page counts do not add up". > > This was mentioned > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253281 > though its probably more of an affirmation of a symptom. (reminder to > adjust status) > > More relevant is > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234559 > where Mark Johnson advised (in Feb '19) > "I've thought about this some more and decided to close this bug WONTFIX > for now. Basically, we started lazily dequeuing wired pages to avoid > the page queue synchronization cost incurred by frequent wirings. The > result is that wired pages may temporarily be counted as > active/inactive/laundry despite not being reclaimable. Maintaining the > previous behaviour wrt statistics would introduce synchronization > overhead that we've been trying to avoid in past and future work. I > don't plan to change the current behaviour and there doesn't seem to be > a compelling reason to do so, at least based on this report. If you or > anyone else would like to discuss this further or describe a use-case > that depends on the old behaviour, please feel free to re-open the bug." tl;dr I recognize this needs work. But it's a GREAT DEAL of work, and I currently have much shinier things on my to-do list. ;-) No offense to Mark. He's doing a tremendous job. I just couldn't resist. :-) --Chris > > I hope I've shed some light on the current situation, unfortunately not > in its resolution. > Regards, Dewayne. From nobody Tue Jun 8 09:26:45 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 527517EC0F1 for ; Tue, 8 Jun 2021 09:26:49 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzlHY1wjlz3mYc; Tue, 8 Jun 2021 09:26:49 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 942AA5BD0; Tue, 8 Jun 2021 09:26:48 +0000 (UTC) (envelope-from avg@FreeBSD.org) Subject: Re: Where might memory be reported? To: Chris , Dewayne Geraghty Cc: Dave Hayes , freebsd-stable@freebsd.org References: <20210606160913.167e6c0a@bigus.dream-tech.com> <20210607115334.6e9d1178@bigus.dream-tech.com> <6c174c830019d133fbb4daefe442fb40@bsdforge.com> <7a70082c6e7e8f948e5c6f92c70174fc@bsdforge.com> From: Andriy Gapon Message-ID: Date: Tue, 8 Jun 2021 12:26:45 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Firefox/78.0 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: <7a70082c6e7e8f948e5c6f92c70174fc@bsdforge.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N On 08/06/2021 10:39, Chris wrote: > On 2021-06-07 22:58, Dewayne Geraghty wrote: >> This issue was raised in April '21 by Andriy Gapon title "stable/13, vm >> page counts do not add up". >> >> This was mentioned >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=253281 >> though its probably more of an affirmation of a symptom. (reminder to >> adjust status) >> >> More relevant is >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234559 >> where Mark Johnson advised (in Feb '19) >> "I've thought about this some more and decided to close this bug WONTFIX >> for now.  Basically, we started lazily dequeuing wired pages to avoid >> the page queue synchronization cost incurred by frequent wirings.  The >> result is that wired pages may temporarily be counted as >> active/inactive/laundry despite not being reclaimable.  Maintaining the >> previous behaviour wrt statistics would introduce synchronization >> overhead that we've been trying to avoid in past and future work.  I >> don't plan to change the current behaviour and there doesn't seem to be >> a compelling reason to do so, at least based on this report.  If you or >> anyone else would like to discuss this further or describe a use-case >> that depends on the old behaviour, please feel free to re-open the bug." > tl;dr > I recognize this needs work. But it's a GREAT DEAL of work, and I currently > have much shinier things on my to-do list. ;-) > > No offense to Mark. He's doing a tremendous job. I just couldn't resist. :-) Just to clarify, Mark was commenting on small discrepancies (deviations, fluctuations) that can happen because of lazy statistics. The large and persistent (and growing) mismatch seems like a different problem. -- Andriy Gapon From nobody Tue Jun 8 09:00:52 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 11C98F7973D for ; Tue, 8 Jun 2021 10:42:23 +0000 (UTC) (envelope-from freebsd@oldach.net) Received: from nuc.oldach.net (hmo.in-vpn.de [IPv6:2001:67c:1407:60::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "nuc.oldach.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fzmyk10zlz3vD8 for ; Tue, 8 Jun 2021 10:42:21 +0000 (UTC) (envelope-from freebsd@oldach.net) Received: from nuc.oldach.net (localhost [127.0.0.1]) by nuc.oldach.net (8.16.1/8.16.1/hmo17dec20) with ESMTPS id 158AgIFU099676 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Tue, 8 Jun 2021 12:42:18 +0200 (CEST) (envelope-from freebsd@oldach.net) Received: (from hmo@localhost) by nuc.oldach.net (8.16.1/8.16.1/Submit) id 158AgIEZ099674 for freebsd-stable@freebsd.org; Tue, 8 Jun 2021 12:42:18 +0200 (CEST) (envelope-from freebsd@oldach.net) Message-Id: <202106081042.158AgIEZ099674@nuc.oldach.net> Subject: Re: Where might memory be reported? In-Reply-To: from Dewayne Geraghty at "8 Jun 2021 15:58:37" To: freebsd-stable@freebsd.org Date: Tue, 8 Jun 2021 11:00:52 +0200 (CEST) From: freebsd@oldach.net (Helge Oldach) X-No-Archive: Yes List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Greylist: inspected by milter-greylist-4.6.4 (nuc.oldach.net [0.0.0.0]); Tue, 08 Jun 2021 12:42:18 +0200 (CEST) for IP:127.0.0.1 DOMAIN:localhost HELO:nuc.oldach.net FROM:freebsd@oldach.net RCPT: X-Rspamd-Queue-Id: 4Fzmyk10zlz3vD8 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@oldach.net designates 2001:67c:1407:60::1 as permitted sender) smtp.mailfrom=freebsd@oldach.net X-Spamd-Result: default: False [-0.30 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:67c:1407:60::1:from]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:67c:1407:60::1:from:127.0.2.255]; ARC_NA(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_NO_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_NA(0.00)[oldach.net]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:29670, ipnet:2001:67c:1400::/45, country:DE]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: N Dewayne Geraghty wrote on Tue, 08 Jun 2021 07:58:37 +0200 (CEST): > More relevant is > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234559 > where Mark Johnson advised (in Feb '19) > "I've thought about this some more and decided to close this bug WONTFIX > for now. Basically, we started lazily dequeuing wired pages to avoid > the page queue synchronization cost incurred by frequent wirings. The > result is that wired pages may temporarily be counted as > active/inactive/laundry despite not being reclaimable. Maintaining the > previous behaviour wrt statistics would introduce synchronization > overhead that we've been trying to avoid in past and future work. I > don't plan to change the current behaviour and there doesn't seem to be > a compelling reason to do so, at least based on this report. If you or > anyone else would like to discuss this further or describe a use-case > that depends on the old behaviour, please feel free to re-open the bug." Not sure if it applies here. The situation in that ticket (which was, coincidentally, raised by me) was that the sum of all specific page counts was *higher* than the total page count. The explanation is, briefly, double counting some pages. The situation here is different: > Consider this output from a 12.2-STABLE box (r368820) on amd64: > > # sysctl vm.stats.vm | grep count > vm.stats.vm.v_cache_count: 0 > vm.stats.vm.v_user_wire_count: 0 > vm.stats.vm.v_laundry_count: 0 > vm.stats.vm.v_inactive_count: 121191 > vm.stats.vm.v_active_count: 20836 > vm.stats.vm.v_wire_count: 754310 > vm.stats.vm.v_free_count: 254711 > vm.stats.vm.v_page_count: 3993253 > > It should be pretty clear that there are missing pages. Where might they be and > how might I find out? The sum of all specific page counts here is much *lower* than the total v_page_count. We are *missing* pages. Did I misunderstand the case perhaps? Kind regards Helge From nobody Tue Jun 8 14:00:19 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 49E657CC2E7 for ; Tue, 8 Jun 2021 14:00:31 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzsMM1bbTz4sCC for ; Tue, 8 Jun 2021 14:00:31 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from mail-yb1-f179.google.com (mail-yb1-f179.google.com [209.85.219.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: lwhsu/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 1A8B78912 for ; Tue, 8 Jun 2021 14:00:31 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: by mail-yb1-f179.google.com with SMTP id g38so30279391ybi.12 for ; Tue, 08 Jun 2021 07:00:31 -0700 (PDT) X-Gm-Message-State: AOAM530BNcQoBRVj1SktpF7+z4vdKIOXlRAqw1WcieWvwRTZF75+gkQj dXkxJcNbIUSqAROY6NQ5IQRMlr5p7xV+8tOSR0c= X-Google-Smtp-Source: ABdhPJxZJg+yWVMzRm9SYCgaIh3DFwRE5jrQ9MO2ilPoWYtCmrtAlKYVYKnx2w4juTOn9RP3Yg5vKdNrDeEUs1L0wAw= X-Received: by 2002:a25:cc97:: with SMTP id l145mr27232951ybf.176.1623160830663; Tue, 08 Jun 2021 07:00:30 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Li-Wen Hsu Date: Tue, 8 Jun 2021 22:00:19 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Fwd: [HEADS UP] Rename of the vendor/openzfs branch To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-ThisMailContainsUnwantedMimeParts: N Also notify the -stable list. I think this could also affect some people who track the stable branches. ---------- Forwarded message --------- From: Li-Wen Hsu Date: Tue, Jun 8, 2021 at 9:21 PM Subject: Re: [HEADS UP] Rename of the vendor/openzfs branch To: freebsd-git Cc: freebsd-current On Tue, Jun 8, 2021 at 7:45 PM Li-Wen Hsu wrote: > > Hello, > > As mentioned in the "OpenZFS imports, status update": > > https://lists.freebsd.org/archives/freebsd-git/2021-June/000013.html > > We're going to rename the current openzfs vendor branch, > vendor/openzfs, to vendor/openzfs/legacy The renaming has been done: https://cgit.freebsd.org/src/log/?h=vendor/openzfs/legacy If you have a local branch tracking vendor/openzfs, please refer to the previous mail for migration. https://lists.freebsd.org/archives/freebsd-git/2021-June/000015.html Best, Li-Wen From nobody Tue Jun 8 17:22:17 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 20680F7E716 for ; Tue, 8 Jun 2021 17:22:26 +0000 (UTC) (envelope-from dave@jetcafe.org) Received: from fedex2.jetcafe.org (fedex2.jetcafe.org [205.147.26.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "fedex2.jetcafe.org", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FzxrK6Xlvz3r7w for ; Tue, 8 Jun 2021 17:22:25 +0000 (UTC) (envelope-from dave@jetcafe.org) X-Envelope-To: freebsd-stable@freebsd.org Received: from bigus.dream-tech.com (bigus.jetcafe.org [205.147.26.7]) by fedex2.jetcafe.org (8.16.1/8.15.2) with ESMTPS id 158HMHja027945 (version=TLSv1.3 cipher=AEAD-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 8 Jun 2021 10:22:17 -0700 (PDT) (envelope-from dave@jetcafe.org) Date: Tue, 8 Jun 2021 10:22:17 -0700 From: Dave Hayes To: freebsd@oldach.net (Helge Oldach) Cc: freebsd-stable@freebsd.org Subject: Re: Where might memory be reported? Message-ID: <20210608102217.26c9067c@bigus.dream-tech.com> In-Reply-To: <202106081042.158AgIEZ099674@nuc.oldach.net> References: <202106081042.158AgIEZ099674@nuc.oldach.net> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -1 ( out of 6) ALL_TRUSTED,SHORTCIRCUIT X-Spam-Checker-Version: SpamAssassin version 3.4.4-jetcafeglobal X-Scanned-By: MIMEDefang 2.83 X-Rspamd-Queue-Id: 4FzxrK6Xlvz3r7w X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Tue, 8 Jun 2021 11:00:52 +0200 (CEST) freebsd@oldach.net (Helge Oldach) wrote: > The sum of all specific page counts here is much *lower* than the total > v_page_count. We are *missing* pages. > > Did I misunderstand the case perhaps? You did not! This is exactly the case. :D Also I feel the need to point out that this: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234559 seems more like a accuracy issue, which only affects monitoring software. My observed issue eventually results in having to reboot. -- Dave Hayes - Consultant - LA CA, USA - dave@dream-tech.com >>>> *The opinions expressed above are entirely my own* <<<< There are a lot of people who cannot stand waiting. These are the ones who have two alternatives: either to stand waiting or to be harmed by it. From nobody Tue Jun 8 22:09:54 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 248E67CC1D4 for ; Tue, 8 Jun 2021 22:10:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic302-22.consmr.mail.gq1.yahoo.com (sonic302-22.consmr.mail.gq1.yahoo.com [98.137.68.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4G04D75RHFz4tJ8 for ; Tue, 8 Jun 2021 22:09:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1623190198; bh=X3IxrDALxbLxBlou6C1bImp+k4GR1KUfRWd7fA/o8r0=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=Rk9MoIYOnZCkbZjDRVy/8myz3wvRJv2rBDNOsXtA612Z4jqIhpXHtV3Dg7o6JEAM/XH8B7t1bOkJ/TQ6//lGjUeHkJAo5iJF/Y1UsZZOkz4N9ArpX6R2RjTqUoOb5IyB2ZRxxks5KeS9bBhFmF8TndnQA0/gnKP/rCj1TQ5q7XIiqiZISeK/9timkDJfbfylAE8Z1V/4oe7bk1qBkP/Wc3KxR6/87wyIwuJPnCPf3Vukq8D5eFZJEQ5wAAtCWD2MOJzT1FbKBrW+PGazmoqMmv/9nAswW5qtB32K9ZuAzA/7JG0Ia4w15R4IseKl4fd8p14p/p8/O9JEIs1ND0H/hw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1623190198; bh=4NM090f+WQe3sE2SSqErar22NjiI0mHi3qrFZ325V/R=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=pOPR+UF49wEwbSKMQvfoQTdemStVnEqaBR1YxI3bjovJ4fxxMRi3+r0VuWw29VNqhE6qnk3WXNZCkGRAMnQz0cXBzp2dUfdoXzdOz+8U6fWolf0uIfYPOLLkHFvfb+JiVPP+jr/oed6UDJ5BG+a/D3jrdTwQU6l7yuMmd7fDib8MFzqLCxheve7DR6UtZoR2KVxoDUvMGn+Z4d836DUb3apuKIpSRYZMU+mjPZGT0g8IVVr0tT8iOQCAQg7VnCnl6Mj8BVQNh7lPyKSwcfg57KaB4Ufr0ufPPA+9bkrWxEq46GErz3AoJl5M0T2VThlaD7TPevR8cBcDmyDI4k/j4A== X-YMail-OSG: 0WMxzcoVM1k5QGqnBdk1P36nZlbi9gSGZxhkJg0IpFI4kSI3azKEPanwOtV_LYg CpJ56J0IkiQ6eL0HSMT2.BKGgAA2bjf0j1J6OUYajLLXxnXg6BFETAzNZWxj8Emh6SmLsrWJz6aF FiFKi8Cb89L5ZnGoTNDH_n227C7gScrgldLY9whPtxFzV_EePT7q1E.zjXSUStOQrGXXN5ahVtjn Dhg9wWEu2uZI3pH1QEjKAb.nYUC_t0k.rYr6cEBdS6L6b2ct7gPHk3mauxQ7XbZ69uqc3sCANENd iAsQeU8OBy00eSoDIrM3qrQQ3racJMjW77DkMvts9_q1eMWvOvxEA2ESu4AZjqduEJZ2FiJjy3jc UHOidiQFZsae5oc1kvwYZNCryV.rktDYdwEUoRZlnms51M0iFrOZI_dgtkHW94Bvq7aR7npz.HSP i8Yd0F10csYb3Qerv8wJD6HZjzwg8UwAwuY03Ryl2x_2WqXTi7QA4Zfc2JHl4CNqeE5yFLB5vHiC hEqrFZ6HJY9CF3VKSATIkDZpllRu.keZNJrcIQBDVLcvrFFrQpQyQ0_IkwcONMQrSUTBBqNgM.tB lR5XSa1UVUlxoUO1pnAANSl94fpZ_lk2ABCw1m43xvuEwIhF1Coa8dlvOa1z6EBgKMaLafiYxGIi Hp9B.BgIUYUXxlyEqMQM0RcJ278DiJmGDn1tq4AHr9Ra8ACi5E6IaJY7TWQm8iszl7don7XZl8ga opdV31EZcmcza5STJNqPUes0q8UskWfQ.dFZ5QU50Xid0EjlPua4R9Nyz0NEhNM1V7zKuJwJwyJB _mlRwQ0.tSVnxKrtngNun7JSJoR7cHd.IFi7zI8ITM1XhrqWEZmMwk5R43NTScRm4awOlicT3FG0 SXnmmb58A_Jd9hEx056MwRLeSVQTO_XGpNQeQVjqy6_IQesexICsAIwFziQ3TBcfRo4w6FGGNG.R c1RcTzn49oz.LvBvuQ68JmUSzK8rb9_B_FcO8_l9q9gs47988ZRdTIqbupNobsKMti3ZTq1PklHz Nk8saagF6IM8ERj2gelNmhusaHKMX7e16KK11BoGPWYpZeKUdWgsFtSG_BeTlnFIW4X80h5dHtbk K7F.POpUyNNvCOqmGATz0SzT0MiUTceWLns3QpBFqQgqgU_h3HFKr6nJ9CzHqVbFstm28awwIJmG g4SKaBEjrdTCaI2Wr86JwUAbTnkTX0VKlsXVXDqqVIOlBJ3skrt6D4safvHLPCcJNXxR3SGJiXxE r_58qsl.QKYmzt.WcHew0cuRlFk3J8oZiKWMpHLbQaSN3fwEF7mUyDZPr5q74f6.W6K0531YTKQQ s1pAJJaVqLWVMZ2RZ0Hy4i3TDgL8bjdYGcg1FBz6bVdxxoyjmGNOKfLdPmBNnU2tbhXgkZ_sn6WQ 1jeU1zVu2IIgk8qNOILeo4.x6E_h2WWTF6cW2JZ6J46MX0wYckKC3eqGR3hIrPkO0bnYZmx.WDDA ZmF4Ha0GAmooLXoyF7WEfJ7dFd9vmzcAQe7qGH4zvKZ2XWM4gqZcuiKfd6aejHmiH0do1fN_hleO yvX4k5OEXenD_m2srqOmOHc4GTH8bqLLFVoudCViDsigHTFmSMt65PS9rC6k8KSGWtgwS9FyklaP CzQwfBHgQBmRo2awD8sW_pg8jdpVNlO31YV3RziNlLCSkwRE4TQ3svLVjSJEjcnsl4jI5avzL_p3 55cO_fhQ3wClpFoixHTHdv8Lgiu.QpX8569EEJqnzVK6gNSrh9t0p4ngreek9qVQUSXqhJ.jOY.9 DRwxect7ildTcG4jIBR8GbkT.9qYwEH_tq.y564X2GR_0sr3n_J1E_CTSrpeWNyn03YSbWhxLID0 6p8YoqXQxzCpXIcRHDi_jDIg0HRNoVWTfSMdYfqBhK5WtEPANdt.3221tXKaQ6jW.Uf.mQ1qQNi8 yHoCoX6CQtjTk.ARSIngLxygJlCVyqhcAno1Rm5957jvcbvyYXkyych0cIWG7aw.8Exno1G1lu.h GJuG_bgMadsuz7y_RIFDH82jFEn.WSD4DEPCeYrA8_oody4PzAQ2R.hw3eeXtjsibegmpP7NBJK2 aBEeJWxfly3gJL4TybUfcchVPDV3opkABWVykY3HyzfznE2plf0iNIj5Go7f1buRjFW5_HM9FQYi tcf6eE5JoeQUNMddLvKTsd6.VxypA9_U8b09fJt2BHbJn0CWeZvutG9h3_Taw4XTONck6Fxh8cAi lbrCE6CXnsWDZN3Cae26nWZ0A_Pcr7.lXWsiz2uKCH.vReb.DswhRdSr4nMCEMLk0qKaGu7C4hZY XZE.aWMTzFaOTUNTzGSUW1GXTEXsE0pQcsty6YjNI3UXgM_SFXcgiHhw043dsNr0Ljlwlckg4b5L N8OmNuYHlmnEI9VWXUgpK.Z4rbeBLDGOantffuCBaNV9M5K5G3fGOX1AuOIugaqVSxHy_.1ufE5f 9fav_ZhU0QMv2pT2hJb79X0QBWrvPiRzKiuxP3Ps7w.NOn__NYhLi5vLtd1P0Y9RNZsWmAUZfLJl Zxi28uV9vhRoARFIbsI5pSkLSoGAizSAZ8XzNNXixeRAzTZjGRzfMuOcmudGiQdRtih4fPr5i0eo N_N5jTsG5bHijYjo6S1N3pm3u6DhY3u5NUiljhIAZtOmZ28ck6.mgyO61I1ynklAYO3TkMxvimPj HiIIQXJNrVaZ7CKttVWzmhqd7mAtFHrDkzjsZi0g- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic302.consmr.mail.gq1.yahoo.com with HTTP; Tue, 8 Jun 2021 22:09:58 +0000 Received: by kubenode548.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID f3ad74d6ed73ab097f4220e2a5120456; Tue, 08 Jun 2021 22:09:56 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.100.0.2.22\)) Subject: Re: OpenZFS imports, status update Message-Id: <94FF271E-1397-42C5-8A9C-26E423D72701@yahoo.com> Date: Tue, 8 Jun 2021 15:09:54 -0700 Cc: freebsd-git , freebsd-current , FreeBSD-STABLE Mailing List To: Li-Wen Hsu X-Mailer: Apple Mail (2.3654.100.0.2.22) References: <94FF271E-1397-42C5-8A9C-26E423D72701.ref@yahoo.com> X-Rspamd-Queue-Id: 4G04D75RHFz4tJ8 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Rk9MoIYO; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.148:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.148:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.148:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.148:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-git X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N Li-Wen Hsu wrote (in part) on Date: Tue, 8 Jun 2021 06:29:51 +0800 : > The people have local branch tracking the original vendor/openzfs will > encounter issues like this whey doing `git pull`: >=20 > error: cannot lock ref > 'refs/remotes/freebsd/vendor/openzfs/legacy': > 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > 'refs/remotes/freebsd/vendor/openzfs/legacy' >=20 > The solution is update the upstream of the tracking branch: >=20 > (change "freebsd" to "origin" if you use default remote name) > git update-ref -d refs/remotes/freebsd/vendor/openzfs > git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy I guess I misunderstood the meaning of the wording. I've never explicitly created a branch of or checked out anything from vendor/ or below. So I was not expecting anything. I do use main and stable/13 and releng/13.0 explicitly in worktrees, no local commits involved for the context that this is from. Looks like some implicit initial configuration defaults mean "local branch tracking" of vendor/openzfs was implicitly/automatically in use in a way that fits the actual intent of the wording: # git fetch remote: Enumerating objects: 21551, done. remote: Counting objects: 100% (21551/21551), done. remote: Compressing objects: 100% (152/152), done. remote: Total 75711 (delta 21460), reused 21399 (delta 21399), = pack-reused 54160 Receiving objects: 100% (75711/75711), 46.02 MiB | 4.74 MiB/s, done. Resolving deltas: 100% (59104/59104), completed with 2449 local objects. =46rom https://git.FreeBSD.org/src e5f5b6a75c0a..f20893853e8e main -> = freebsd/main a4deddc0de32..53de482ad419 releng/11.4 -> = freebsd/releng/11.4 f5ddeabc08e7..6e927d10c587 releng/12.2 -> = freebsd/releng/12.2 8023e729a521..b74cdf1eceae releng/13.0 -> = freebsd/releng/13.0 dbb3df26a8a3..90e161ec6d11 stable/11 -> = freebsd/stable/11 f146c0338c6c..0a41a2899eb2 stable/12 -> = freebsd/stable/12 ddd0a8bffe35..04c4bd7f7b52 stable/13 -> = freebsd/stable/13 1e02e5b0ba86..395770967c36 vendor/acpica -> = freebsd/vendor/acpica error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/legacy': = 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create = 'refs/remotes/freebsd/vendor/openzfs/legacy' ! [new branch] vendor/openzfs/legacy -> = freebsd/vendor/openzfs/legacy (unable to update local ref) error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/master': = 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create = 'refs/remotes/freebsd/vendor/openzfs/master' ! [new branch] vendor/openzfs/master -> = freebsd/vendor/openzfs/master (unable to update local ref) error: cannot lock ref = 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release': = 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create = 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release' ! [new branch] vendor/openzfs/zfs-2.1-release -> = freebsd/vendor/openzfs/zfs-2.1-release (unable to update local ref) efec8223892b..40c7ff83e74e vendor/wpa -> = freebsd/vendor/wpa * [new tag] vendor/acpica/20210604 -> = vendor/acpica/20210604 So, for now, I then did: # git update-ref -d refs/remotes/freebsd/vendor/openzfs # git fetch =46rom https://git.FreeBSD.org/src * [new branch] vendor/openzfs/legacy -> = freebsd/vendor/openzfs/legacy * [new branch] vendor/openzfs/master -> = freebsd/vendor/openzfs/master * [new branch] vendor/openzfs/zfs-2.1-release -> = freebsd/vendor/openzfs/zfs-2.1-release This order was apparently a mistake in some way because after it I then tried the other of the pair of commands and got: # git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy fatal: branch 'vendor/openzfs/legacy' does not exist Yet what I see is: # git remote show freebsd * remote freebsd Fetch URL: https://git.FreeBSD.org/src.git Push URL: https://git.FreeBSD.org/src.git HEAD branch: main Remote branches: main tracked refs/notes/commits tracked . . . releng/13.0 tracked . . . stable/13 tracked . . . vendor/openzfs/legacy tracked vendor/openzfs/master tracked vendor/openzfs/zfs-2.1-release tracked . . . Local branches configured for 'git pull': main merges with remote main releng/13.0 merges with remote releng/13.0 stable/13 merges with remote stable/13 So I'm not sure if I have anything that is messed up or not. Nothing looks odd to me, other than the one command's output. Overall it seems that most people not doing something special with an initial git configuration for FreeBSD so have to deal with the issue at hand explicitly in some way. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Tue Jun 8 22:52:43 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 785BE7EAE0F for ; Tue, 8 Jun 2021 22:52:55 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lf1-x131.google.com (mail-lf1-x131.google.com [IPv6:2a00:1450:4864:20::131]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G059g2jCKz3K9X for ; Tue, 8 Jun 2021 22:52:55 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-lf1-x131.google.com with SMTP id r198so31370728lff.11 for ; Tue, 08 Jun 2021 15:52:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=NsRgF49iycAhCuzwHxRpKplmDVIhRHYX7aWH7WPjpQ8=; b=j5HQ3KXztJ8pJeftcOCEE7poQDORPA44jUDu6ApmUVTDjWL3yMkRJbo+C+Q/oezDyk IttAHsiCOIfyWfmWH+CV/A3nDRy5Rs73dcbyKpUCd/xClO8aVVesR3fxL0MHZGPs7VTv v8cbYLPp17Y4+F8EtNCkSGPuRgdF86OvaxJHTdr7M4P8Tv0D2MS/nYGhk/A1cPTYMaGl Aztnt34AYOwKcPZUB4aOon+7gaXkcO39+ki0lMn4r4d+XehbvHIVldjc55n0dAW15m1k BDQKfbtzL2fkSWUz67AHvdhD8fekh49az1knfLiMe8s5hpANGpfXlmhLzfMB7Jtcz6QR dMrg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=NsRgF49iycAhCuzwHxRpKplmDVIhRHYX7aWH7WPjpQ8=; b=qW6QjDpyS6VAveZ5wcp7Apf8skV8xSAB1lBElcPK2y8wficQay4NjfGtq5aMwOaaaF jk11qN7wKn7e8G/gm9uBhTQ7Jztds63tBCsOWADPaXdtnvDtjmv/NH3XT6exkBp3w70b SLOrJhV9VbbJTE99n4kI+xbaHtxBaJG0tEI/wGxGkI7gk/UMb3AIRtqxQcdL8fg3QtHC d8Q02W0zeyg960pn9bYC/Ys66NfqwECqd8Ctyq8xWScOZ6NpIsaQAwS0+5C+7F1Gq1LP 3SlGIBQU9j2LTogTMqGGTS1Q7Z7r0w5yQGgq0TLdqkotNrAzYm+y4vb6i8xV3+741nbX sF9w== X-Gm-Message-State: AOAM533neewu4qZLTF710Ft3C5FF0CyuPoSdz/hWo5/Dtx5iYwu9G83n Bj0VfIFZpEPLYtD1zWW3mZEMoRnrJWHJH25gI/AIFg== X-Google-Smtp-Source: ABdhPJw36E2cxtdKAqa8x+8/48EOk6gj9caFXdn1KndjIbMs1bs5wa7ra5lRRnlrZf7cvvTOejoOQJc1DLntsFXbe7Q= X-Received: by 2002:a05:6512:3891:: with SMTP id n17mr17161378lft.333.1623192773707; Tue, 08 Jun 2021 15:52:53 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <94FF271E-1397-42C5-8A9C-26E423D72701.ref@yahoo.com> <94FF271E-1397-42C5-8A9C-26E423D72701@yahoo.com> In-Reply-To: <94FF271E-1397-42C5-8A9C-26E423D72701@yahoo.com> From: Warner Losh Date: Tue, 8 Jun 2021 16:52:43 -0600 Message-ID: Subject: Re: OpenZFS imports, status update To: Mark Millard Cc: Li-Wen Hsu , freebsd-git , freebsd-current , FreeBSD-STABLE Mailing List Content-Type: multipart/alternative; boundary="000000000000adde8905c4490473" X-Rspamd-Queue-Id: 4G059g2jCKz3K9X X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --000000000000adde8905c4490473 Content-Type: text/plain; charset="UTF-8" Top posting... You can do a 'git remote purge freebsd' to reset the branch names, then you'll be able to do a normal pull. Thanks for the feedback Warner On Tue, Jun 8, 2021 at 4:10 PM Mark Millard via freebsd-git < freebsd-git@freebsd.org> wrote: > Li-Wen Hsu wrote (in part) on > Date: Tue, 8 Jun 2021 06:29:51 +0800 : > > > The people have local branch tracking the original vendor/openzfs will > > encounter issues like this whey doing `git pull`: > > > > error: cannot lock ref > > 'refs/remotes/freebsd/vendor/openzfs/legacy': > > 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > > 'refs/remotes/freebsd/vendor/openzfs/legacy' > > > > The solution is update the upstream of the tracking branch: > > > > (change "freebsd" to "origin" if you use default remote name) > > git update-ref -d refs/remotes/freebsd/vendor/openzfs > > git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy > > I guess I misunderstood the meaning of the wording. > I've never explicitly created a branch of or checked out > anything from vendor/ or below. So I was not expecting > anything. I do use main and stable/13 and releng/13.0 > explicitly in worktrees, no local commits involved for > the context that this is from. > > Looks like some implicit initial configuration defaults > mean "local branch tracking" of vendor/openzfs was > implicitly/automatically in use in a way that fits > the actual intent of the wording: > > # git fetch > remote: Enumerating objects: 21551, done. > remote: Counting objects: 100% (21551/21551), done. > remote: Compressing objects: 100% (152/152), done. > remote: Total 75711 (delta 21460), reused 21399 (delta 21399), pack-reused > 54160 > Receiving objects: 100% (75711/75711), 46.02 MiB | 4.74 MiB/s, done. > Resolving deltas: 100% (59104/59104), completed with 2449 local objects. > From https://git.FreeBSD.org/src > e5f5b6a75c0a..f20893853e8e main -> > freebsd/main > a4deddc0de32..53de482ad419 releng/11.4 -> > freebsd/releng/11.4 > f5ddeabc08e7..6e927d10c587 releng/12.2 -> > freebsd/releng/12.2 > 8023e729a521..b74cdf1eceae releng/13.0 -> > freebsd/releng/13.0 > dbb3df26a8a3..90e161ec6d11 stable/11 -> > freebsd/stable/11 > f146c0338c6c..0a41a2899eb2 stable/12 -> > freebsd/stable/12 > ddd0a8bffe35..04c4bd7f7b52 stable/13 -> > freebsd/stable/13 > 1e02e5b0ba86..395770967c36 vendor/acpica -> > freebsd/vendor/acpica > error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/legacy': > 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > 'refs/remotes/freebsd/vendor/openzfs/legacy' > ! [new branch] vendor/openzfs/legacy -> > freebsd/vendor/openzfs/legacy (unable to update local ref) > error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/master': > 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > 'refs/remotes/freebsd/vendor/openzfs/master' > ! [new branch] vendor/openzfs/master -> > freebsd/vendor/openzfs/master (unable to update local ref) > error: cannot lock ref > 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release': > 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release' > ! [new branch] vendor/openzfs/zfs-2.1-release -> > freebsd/vendor/openzfs/zfs-2.1-release (unable to update local ref) > efec8223892b..40c7ff83e74e vendor/wpa -> > freebsd/vendor/wpa > * [new tag] vendor/acpica/20210604 -> > vendor/acpica/20210604 > > So, for now, I then did: > > # git update-ref -d refs/remotes/freebsd/vendor/openzfs > # git fetch > From https://git.FreeBSD.org/src > * [new branch] vendor/openzfs/legacy -> > freebsd/vendor/openzfs/legacy > * [new branch] vendor/openzfs/master -> > freebsd/vendor/openzfs/master > * [new branch] vendor/openzfs/zfs-2.1-release -> > freebsd/vendor/openzfs/zfs-2.1-release > > This order was apparently a mistake in some way because > after it I then tried the other of the pair of commands > and got: > > # git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy > fatal: branch 'vendor/openzfs/legacy' does not exist > > Yet what I see is: > > # git remote show freebsd > * remote freebsd > Fetch URL: https://git.FreeBSD.org/src.git > Push URL: https://git.FreeBSD.org/src.git > HEAD branch: main > Remote branches: > main tracked > refs/notes/commits tracked > . . . > releng/13.0 tracked > . . . > stable/13 tracked > . . . > vendor/openzfs/legacy tracked > vendor/openzfs/master tracked > vendor/openzfs/zfs-2.1-release tracked > . . . > Local branches configured for 'git pull': > main merges with remote main > releng/13.0 merges with remote releng/13.0 > stable/13 merges with remote stable/13 > > So I'm not sure if I have anything that is messed up > or not. Nothing looks odd to me, other than the one > command's output. > > > Overall it seems that most people not doing something > special with an initial git configuration for FreeBSD > so have to deal with the issue at hand explicitly in > some way. > > === > Mark Millard > marklmi at yahoo.com > ( dsl-only.net went > away in early 2018-Mar) > > > --000000000000adde8905c4490473-- From nobody Tue Jun 8 23:02:15 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B1FD17ECFD1 for ; Tue, 8 Jun 2021 23:02:29 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lf1-x12b.google.com (mail-lf1-x12b.google.com [IPv6:2a00:1450:4864:20::12b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G05Nh5sTVz3NBf for ; Tue, 8 Jun 2021 23:02:28 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-lf1-x12b.google.com with SMTP id i10so34740492lfj.2 for ; Tue, 08 Jun 2021 16:02:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=swr9tCtNpFKGguoSi4WNQs2i9/brwG6AHkDLhkChnjI=; b=zZ/s29WvK28UwnfKBIVn1sOrrySEB5lquBMQmvVJIXB+tSebAf1ROC8Ve1iVLrwvGz aJ/3Bqz2FxXdu0MQXHTWMPrDQx4ZT4Ae0hsgZ/5z8X9KBOYBSlIxUoEkWDet45CND3nD zst2R8GtgYlP8PtIldEtFX2lR6ER8i9cQLZdad4hP62uiRvicUddQm9CWxBiYE2Sc5gH hsonfAYvvVdNyfBRfSqhVnlJoUv6PkvTfQJgM+hTedJwyVqVu4zdX1zjagNb0ot44rzK Te9/h6Cj8M6hB5c1Ses4JFT7zwwvULtyy/e2uJXnQulgMRCCPfCmBryiicDUIktZ72OE ug/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=swr9tCtNpFKGguoSi4WNQs2i9/brwG6AHkDLhkChnjI=; b=Zc1Sj292khbXZHSPyTUMqzeqe/F1oJGISMIod/+ZSIXh1ffuuw2eP0d5b1B2g2wKfY d3F9tK/eqPXOalxqEooSwSUndCPL8gDjzH5ENFL3/l8HMp6NmOge7xBNF8HDzPOHZnZL Sa/ozVVJXTz2BZfmzzeR61wB4x7DTxDMDsMObAYxJEUffOu/1Qhs6TllvD/N23PjZCsM ruom4gJdesFa/drLa07KP2l8tLh8T9UkacJ6HkOewLvcYBc9xZnjo/evaiC/PMTXm4Kt Z9ubAz+G763AiJLs+N3Bs/mX0+HPwHUyAnMQlJRxDm6rkRdDEESdbaKypBdbw0gwHps7 izIg== X-Gm-Message-State: AOAM531WoU8Bt99hllgtdF7cMYtYPlks+m6XgC9SN6QajLbOSEbQwv2L L8OIajcAEv60hO9uFKP6RzetWv9lbs9AlOzZtFPlIw== X-Google-Smtp-Source: ABdhPJz9qWSFB2lRUvMIxmztOHdFnJTgxqmZN/4eANXTCLIDjAN7bZrR1/CcU3xZGJqGZGlIK56KExFXBU+WKT0/aNw= X-Received: by 2002:a05:6512:2249:: with SMTP id i9mr17494592lfu.592.1623193346383; Tue, 08 Jun 2021 16:02:26 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <94FF271E-1397-42C5-8A9C-26E423D72701.ref@yahoo.com> <94FF271E-1397-42C5-8A9C-26E423D72701@yahoo.com> In-Reply-To: From: Warner Losh Date: Tue, 8 Jun 2021 17:02:15 -0600 Message-ID: Subject: Re: OpenZFS imports, status update To: Michael Tuexen Cc: Mark Millard , Li-Wen Hsu , freebsd-git , freebsd-current , FreeBSD-STABLE Mailing List Content-Type: multipart/alternative; boundary="000000000000d03b2605c44926e6" X-Rspamd-Queue-Id: 4G05Nh5sTVz3NBf X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=zZ/s29Wv; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::12b) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCPT_COUNT_FIVE(0.00)[6]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::12b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-0.998]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12b:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::12b:from]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-stable]; FREEMAIL_CC(0.00)[yahoo.com,freebsd.org] X-ThisMailContainsUnwantedMimeParts: Y --000000000000d03b2605c44926e6 Content-Type: text/plain; charset="UTF-8" On Tue, Jun 8, 2021 at 4:58 PM Michael Tuexen < michael.tuexen@macmic.franken.de> wrote: > > On 9. Jun 2021, at 00:52, Warner Losh wrote: > > > > Top posting... > > > > You can do a 'git remote purge freebsd' to reset the branch names, then > > you'll be able to do a normal pull. > Do you mean 'git remote prune freebsd'? > Yes. Should have cut and paste instead of retyping it :( Warner > Best regards > Michael > > > > Thanks for the feedback > > > > Warner > > > > On Tue, Jun 8, 2021 at 4:10 PM Mark Millard via freebsd-git < > > freebsd-git@freebsd.org> wrote: > > > >> Li-Wen Hsu wrote (in part) on > >> Date: Tue, 8 Jun 2021 06:29:51 +0800 : > >> > >>> The people have local branch tracking the original vendor/openzfs will > >>> encounter issues like this whey doing `git pull`: > >>> > >>> error: cannot lock ref > >>> 'refs/remotes/freebsd/vendor/openzfs/legacy': > >>> 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > >>> 'refs/remotes/freebsd/vendor/openzfs/legacy' > >>> > >>> The solution is update the upstream of the tracking branch: > >>> > >>> (change "freebsd" to "origin" if you use default remote name) > >>> git update-ref -d refs/remotes/freebsd/vendor/openzfs > >>> git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy > >> > >> I guess I misunderstood the meaning of the wording. > >> I've never explicitly created a branch of or checked out > >> anything from vendor/ or below. So I was not expecting > >> anything. I do use main and stable/13 and releng/13.0 > >> explicitly in worktrees, no local commits involved for > >> the context that this is from. > >> > >> Looks like some implicit initial configuration defaults > >> mean "local branch tracking" of vendor/openzfs was > >> implicitly/automatically in use in a way that fits > >> the actual intent of the wording: > >> > >> # git fetch > >> remote: Enumerating objects: 21551, done. > >> remote: Counting objects: 100% (21551/21551), done. > >> remote: Compressing objects: 100% (152/152), done. > >> remote: Total 75711 (delta 21460), reused 21399 (delta 21399), > pack-reused > >> 54160 > >> Receiving objects: 100% (75711/75711), 46.02 MiB | 4.74 MiB/s, done. > >> Resolving deltas: 100% (59104/59104), completed with 2449 local objects. > >> From https://git.FreeBSD.org/src > >> e5f5b6a75c0a..f20893853e8e main -> > >> freebsd/main > >> a4deddc0de32..53de482ad419 releng/11.4 -> > >> freebsd/releng/11.4 > >> f5ddeabc08e7..6e927d10c587 releng/12.2 -> > >> freebsd/releng/12.2 > >> 8023e729a521..b74cdf1eceae releng/13.0 -> > >> freebsd/releng/13.0 > >> dbb3df26a8a3..90e161ec6d11 stable/11 -> > >> freebsd/stable/11 > >> f146c0338c6c..0a41a2899eb2 stable/12 -> > >> freebsd/stable/12 > >> ddd0a8bffe35..04c4bd7f7b52 stable/13 -> > >> freebsd/stable/13 > >> 1e02e5b0ba86..395770967c36 vendor/acpica -> > >> freebsd/vendor/acpica > >> error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/legacy': > >> 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > >> 'refs/remotes/freebsd/vendor/openzfs/legacy' > >> ! [new branch] vendor/openzfs/legacy -> > >> freebsd/vendor/openzfs/legacy (unable to update local ref) > >> error: cannot lock ref 'refs/remotes/freebsd/vendor/openzfs/master': > >> 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > >> 'refs/remotes/freebsd/vendor/openzfs/master' > >> ! [new branch] vendor/openzfs/master -> > >> freebsd/vendor/openzfs/master (unable to update local ref) > >> error: cannot lock ref > >> 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release': > >> 'refs/remotes/freebsd/vendor/openzfs' exists; cannot create > >> 'refs/remotes/freebsd/vendor/openzfs/zfs-2.1-release' > >> ! [new branch] vendor/openzfs/zfs-2.1-release -> > >> freebsd/vendor/openzfs/zfs-2.1-release (unable to update local ref) > >> efec8223892b..40c7ff83e74e vendor/wpa -> > >> freebsd/vendor/wpa > >> * [new tag] vendor/acpica/20210604 -> > >> vendor/acpica/20210604 > >> > >> So, for now, I then did: > >> > >> # git update-ref -d refs/remotes/freebsd/vendor/openzfs > >> # git fetch > >> From https://git.FreeBSD.org/src > >> * [new branch] vendor/openzfs/legacy -> > >> freebsd/vendor/openzfs/legacy > >> * [new branch] vendor/openzfs/master -> > >> freebsd/vendor/openzfs/master > >> * [new branch] vendor/openzfs/zfs-2.1-release -> > >> freebsd/vendor/openzfs/zfs-2.1-release > >> > >> This order was apparently a mistake in some way because > >> after it I then tried the other of the pair of commands > >> and got: > >> > >> # git branch -u freebsd/vendor/openzfs/legacy vendor/openzfs/legacy > >> fatal: branch 'vendor/openzfs/legacy' does not exist > >> > >> Yet what I see is: > >> > >> # git remote show freebsd > >> * remote freebsd > >> Fetch URL: https://git.FreeBSD.org/src.git > >> Push URL: https://git.FreeBSD.org/src.git > >> HEAD branch: main > >> Remote branches: > >> main tracked > >> refs/notes/commits tracked > >> . . . > >> releng/13.0 tracked > >> . . . > >> stable/13 tracked > >> . . . > >> vendor/openzfs/legacy tracked > >> vendor/openzfs/master tracked > >> vendor/openzfs/zfs-2.1-release tracked > >> . . . > >> Local branches configured for 'git pull': > >> main merges with remote main > >> releng/13.0 merges with remote releng/13.0 > >> stable/13 merges with remote stable/13 > >> > >> So I'm not sure if I have anything that is messed up > >> or not. Nothing looks odd to me, other than the one > >> command's output. > >> > >> > >> Overall it seems that most people not doing something > >> special with an initial git configuration for FreeBSD > >> so have to deal with the issue at hand explicitly in > >> some way. > >> > >> === > >> Mark Millard > >> marklmi at yahoo.com > >> ( dsl-only.net went > >> away in early 2018-Mar) > >> > >> > >> > > --000000000000d03b2605c44926e6-- From nobody Wed Jun 9 02:40:45 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E96405D7C83 for ; Wed, 9 Jun 2021 02:40:49 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-ed1-x533.google.com (mail-ed1-x533.google.com [IPv6:2a00:1450:4864:20::533]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G0BDd1gqdz4bMX for ; Wed, 9 Jun 2021 02:40:48 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: by mail-ed1-x533.google.com with SMTP id d13so13358720edt.5 for ; Tue, 08 Jun 2021 19:40:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-transfer-encoding; bh=XMz/ctFFOslYKSagDhvbOyZMath3L+jPylUq1Q8or7I=; b=tNhwFul8h6yXa/ZpDcEV/oNerRChUvXw4pRJfZtm/CvattoEKBddxRf3uKbUgugMpa XDTZRqqJcbJ2Ty0zPlQRaunKVbWw9NPWwlUQ5h2VeZiMEoMAcRev/VhUPCivF8M5leyJ +oQeroQOvD5F4FZego1a4TEiCCLc8UEoXmnbo2CgbaSsbhBjbF+aXtmGkFoV5a55tQ8r m6fDHE9w6Oj+x4AvaFkmo4DODpMAnPcpdtwAycOVdhqNdxRbCT+gb9Zw2HtSlkINX5C+ zgZBfLfjy3uqZh0Ns+w4TK5bpp5k0EwG/4cHDG5IryqzBh2Advsb0XjJUr+mWkuP3hjw Gh4w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-transfer-encoding; bh=XMz/ctFFOslYKSagDhvbOyZMath3L+jPylUq1Q8or7I=; b=Cw9BQeke6l8JsrrpxDx+XRGasCzLM7zRn0/FT1R5UROuX+pAKuFP7JcD1JaixdrQ5G qPbyCcjyYHGJV2d3F8/KV/zRBl7HRmxj3Sij0TWyf81pCvcy4N/BxWeapvgoYLv9C8bI NmCKAeUfFIW5e2SBBNFUZo4cHOdhe0vhwUpfpvcyWBH/aqE7OYB/WOLW/vruM1uIyL5z jUh9U1XupUxDaC8Vgk95nhTs2RYjnUXZRLt5GyLf1fyLgqwlxrK6BonoUoXiH5FCntkK /LC4iwwkm4of7zXQ3DY9auO8DQvTfeNVzaOHnjDctdkBXbzHomCCMBrqHRf1Yrfc/45I lEMg== X-Gm-Message-State: AOAM533Tnv6UEkXtDIlsKbwMAM79q2FHIajbhAL/7+DtnUwp7sBOXgje 5ebXPenh2OZA1d0VoguoJ3ydCMTIOg1z/xMDChVJRkx4chAhmjf8 X-Google-Smtp-Source: ABdhPJyKd+ORPB2hagWcEIcv6fS+LsR/Yiu+IGCSjuV9NCwDB3OcZgvW5kUVsS2HbI86TbwD2Jn9lu8va8EedF/gLBc= X-Received: by 2002:aa7:ca1a:: with SMTP id y26mr28292186eds.314.1623206446267; Tue, 08 Jun 2021 19:40:46 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Received: by 2002:ab4:a201:0:0:0:0:0 with HTTP; Tue, 8 Jun 2021 19:40:45 -0700 (PDT) In-Reply-To: References: From: grarpamp Date: Tue, 8 Jun 2021 22:40:45 -0400 Message-ID: Subject: OpenZFS Encryption: Docs, and re Metadata Leaks To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4G0BDd1gqdz4bMX X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=tNhwFul8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2a00:1450:4864:20::533 as permitted sender) smtp.mailfrom=grarpamp@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::533:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::533:from:127.0.2.255]; NEURAL_SPAM_SHORT(1.00)[1.000]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::533:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: N [Leaving a copy here for people seeking doc links from April. Rest of thread may go elsewhere, perhaps fs, don't know. Cheers.] On 4/17/20, Ryan Moeller wrote: > >> On Apr 17, 2020, at 4:56 PM, Pete Wright wrote: >> >> On 4/17/20 11:35 AM, Ryan Moeller wrote: >>> OpenZFS brings many exciting features to FreeBSD, including: >>> * native encryption >> Is there a good doc reference on available for using this? I believe th= is >> is zfs filesystem level encryption and not a replacement for our existin= g >> full-disk-encryption scheme that currently works? > > I=E2=80=99m not aware of a good current doc for this. If anyone finds/wri= tes > something, please post it! > There are some old resources you can find with a quick search that do a > pretty good job of covering the basic ideas, but I think the exact syntax= of > commands may be slightly changed in the final implementation. > > The encryption is performed at a filesystem level (per-dataset). You could find some initial doc and video about zfs encryption on openzfs.org and youtube, and in some commit logs. Therein was mentioned... People are needed to volunteer to expand documentation on the zfs crypto subject further in some document committed to openzfs repo since users and orgs will want to know it when considering use. Volunteers are also sought by openzfs to review the crypto itself. Maybe there was already some central place made with further current documentation about the zfs encryption topics since then? https://www.youtube.com/watch?v=3DfrnLiXclAMo openzfs encryption https://drive.google.com/file/d/0B5hUzsxe4cdmU3ZTRXNxa2JIaDQ/view https://www.youtube.com/watch?v=3DkFuo5bDj8C0 openzfs encryption cloud https://drive.google.com/file/d/14uIZmJ48AfaQU4q69tED6MJf-RJhgwQR/view It's dataset level, so GELI or GBDE etc are needed for full coverage, perhaps even those two may not have yet received much or formal review either, so there is always good volunteer opportunity there to start with review of a potentially simpler cryptosystem like those. zfs list, dataset snapshot names properties etc not covered. zfs history not covered, many sensitive strings will end up in there, including cutpaste password typos into commandline, usernames, timestamps, etc... and no tool exist to scrub overwrite history extents with random data, and no option exists to turn keeping of 'user initiated events' or 'long format' off, and ultimately no option exists to tell zpool create to disable history keeping from the very start entirely. So maybe users have to zero disks and pools along with it just to scrub that. zfs also exposes these variety of path and device names, timestamps, etc in cleartext on disk structures in various places, including configuration cachefile... Some of those could could be NULLed or dummied with new zpool create options for more security restricted use cases. There are other meta things and tools left exposed such as potentially any plaintext meta in send/recv. Another big metadata leak for environments and users that ship, sell, embed, clone, distribute, fileshare, and backup, their raw disks pools and usbs around to untrusted third parties... is that zfs also puts hostnames and UUID type of unique static meta and identifying things in cleartext on disk. zfs thus needs options to allow users to set and use a NULL, or generic dummy default, or random string, or chosen, "hostname" for those from the very first zpool create command. Most applications users use, including zfs, can today consider ways in which metadata leaks could be removed entirely, or at least optioned out for use under high security restricted environments modes. That could even involve considering trading off some extra features not actually required for a basic mode of functionality of the app. (cc's for fyi inclusion about leaks, and as lists still haven't been configured to support discreet bcc for that purpose, which would also maintain nice headers for thread following. Gmail breaks threads. zfsonlinux topicbox peole can't subscribe without javabloatbroken website, so someone could forward this there. Drop non-relevant cc's from further replies. Parent thread from freebsd current and stable lists was Subject: OpenZFS port updated) From nobody Wed Jun 9 18:35:51 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CE08DCFC503 for ; Wed, 9 Jun 2021 18:36:00 +0000 (UTC) (envelope-from dave@jetcafe.org) Received: from fedex2.jetcafe.org (fedex2.jetcafe.org [205.147.26.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "fedex2.jetcafe.org", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G0bQl3nLgz3KBW for ; Wed, 9 Jun 2021 18:35:59 +0000 (UTC) (envelope-from dave@jetcafe.org) X-Envelope-To: Received: from bigus.dream-tech.com (bigus.jetcafe.org [205.147.26.7]) by fedex2.jetcafe.org (8.16.1/8.15.2) with ESMTPS id 159IZq3S071466 (version=TLSv1.3 cipher=AEAD-AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 9 Jun 2021 11:35:52 -0700 (PDT) (envelope-from dave@jetcafe.org) Date: Wed, 9 Jun 2021 11:35:51 -0700 From: Dave Hayes To: freebsd-stable@freebsd.org Subject: Re: Where might memory be reported? Message-ID: <20210609113551.504f786e@bigus.dream-tech.com> In-Reply-To: <20210608102217.26c9067c@bigus.dream-tech.com> References: <202106081042.158AgIEZ099674@nuc.oldach.net> <20210608102217.26c9067c@bigus.dream-tech.com> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -1 ( out of 5.1) ALL_TRUSTED,SHORTCIRCUIT X-Spam-Checker-Version: SpamAssassin version 3.4.4-jetcafeglobal X-Scanned-By: MIMEDefang 2.83 X-Rspamd-Queue-Id: 4G0bQl3nLgz3KBW X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of dave@jetcafe.org designates 205.147.26.23 as permitted sender) smtp.mailfrom=dave@jetcafe.org X-Spamd-Result: default: False [1.70 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[205.147.26.23:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[205.147.26.23:from:127.0.2.255]; DMARC_NA(0.00)[jetcafe.org]; NEURAL_SPAM_SHORT(1.00)[0.998]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:7397, ipnet:205.147.0.0/18, country:US]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: N Bug filed: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=256507 :D -- Dave Hayes - Consultant - LA CA, USA - dave@dream-tech.com >>>> *The opinions expressed above are entirely my own* <<<< Optimism - The cheerful frame of mind that enables a teapot to sing even though it's in hot water up to it's nose. From nobody Fri Jun 11 00:37:18 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B6EFA5D24D9 for ; Fri, 11 Jun 2021 00:37:31 +0000 (UTC) (envelope-from freebsd-stable@m.gmane-mx.org) Received: from ciao.gmane.io (ciao.gmane.io [116.202.254.214]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4G1MPQ608Gz3DH6 for ; Fri, 11 Jun 2021 00:37:30 +0000 (UTC) (envelope-from freebsd-stable@m.gmane-mx.org) Received: from list by ciao.gmane.io with local (Exim 4.92) (envelope-from ) id 1lrVAp-0002MV-2P for freebsd-stable@freebsd.org; Fri, 11 Jun 2021 02:37:23 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Johannes Totz Subject: rctl -u jail:0 Date: Fri, 11 Jun 2021 01:37:18 +0100 Message-ID: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 X-Mozilla-News-Host: news://news.gmame.org:119 Content-Language: en-GB X-Rspamd-Queue-Id: 4G1MPQ608Gz3DH6 X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=jo-t.de (policy=none); spf=pass (mx1.freebsd.org: domain of freebsd-stable@m.gmane-mx.org designates 116.202.254.214 as permitted sender) smtp.mailfrom=freebsd-stable@m.gmane-mx.org X-Spamd-Result: default: False [2.17 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[116.202.254.214:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[116.202.254.214:from:127.0.2.255]; DMARC_POLICY_SOFTFAIL(0.10)[jo-t.de : SPF not aligned (relaxed), No valid DKIM,none]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_SHORT(-0.93)[-0.934]; FORGED_SENDER(0.30)[johannes@jo-t.de,freebsd-stable@m.gmane-mx.org]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:116.202.0.0/16, country:DE]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; FROM_NEQ_ENVFROM(0.00)[johannes@jo-t.de,freebsd-stable@m.gmane-mx.org]; MAILMAN_DEST(0.00)[freebsd-stable] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N Hi there, what does $ rctl -u jail:0 report? Is that supposed to work? Output looks like: cputime=10507 datasize=6946816 stacksize=520495104 coredumpsize=0 memoryuse=403210240 memorylocked=0 maxproc=87 openfiles=6992 vmemoryuse=1918025728 pseudoterminals=1 swapuse=37552128 nthr=95 msgqqueued=0 msgqsize=0 nmsgq=0 nsem=0 nsemop=0 nshm=0 shmsize=0 wallclock=443440 pcpu=0 readbps=512 writebps=0 readiops=1 writeiops=0 maxproc looks alright but the rest seems to be all over the place... I don't have a jail called "0". For an actually existing jail the output looks fine. I checked the source and looks like code that parses the jail name is just a string comparison, no check for jail id. Side note: I was trying to get stats for all processes not in a jail. Any suggestions for that? I'm still on 12-stable. thanks, Johannes From nobody Fri Jun 11 12:13:19 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 108D111D766A for ; Fri, 11 Jun 2021 12:13:39 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from new4-smtp.messagingengine.com (new4-smtp.messagingengine.com [66.111.4.230]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4G1frf2PYkz4pF0 for ; Fri, 11 Jun 2021 12:13:38 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailnew.nyi.internal (Postfix) with ESMTP id 8AE325805E8 for ; Fri, 11 Jun 2021 08:13:31 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Jun 2021 08:13:31 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:mime-version:content-type; s= fm2; bh=PUje/noqNqRvK004rrLG4+sSA+b84Jrk2lXCo/PwPoM=; b=dpLIUO0G 0KJFy7wIA1tCV227nCxKnj2QYVqQaWnNSEZa7kip/BvCfyxqnvhXtlC803Axnytv NJU74OF/v19N9LgbRXPtfZnEC/xL3P271hKAsSCiw7KOpPiNkGBpwzAbNSZrrK+Z +2mnxDWIhwjHfGEVu28q4bcSCG3LaW9aV+aS7N85xZalevUIloqjVeJCaiP8U9gp V4ztA4yA6+xReBKmALd/VKZIeg2DIlTdqYSFXwHkOv5VgzhMBZMjz3XL91TUifqa L1lwlUL0F28Utw24dyR+wpEJ3srMQVEStKbwUnhRaUn8djWCivcy+1nGPShQ6hO+ xG5KoZUe4TIeJQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=PUje/noqNqRvK004rrLG4+sSA+b84 Jrk2lXCo/PwPoM=; b=vVGgQokGVo5zrwsuWtmrPiA/jldeG0+Jq3vV5cBJPPw6Y 6sSkA4+ED7b+0qnlCuzEELCGAFMFrmCsw232D3esK15wNsrEGXt28jQgDRFyn8Ck Xhi1Y0sPFP4XTJOUqata2rG3XQheo5zmJVfFLGJ0+d0sZ3box4FleFI6YkGvHL+/ qdqOh+pmZSX3q625gEKrREYJ73hvjfna7lP4wGiqFo+aDy1/W1FH9Ew50Zm7gCyF kiz4i5YlwITDcBQyMDL7pSiy+Dh1j+P6TQhNXPZe6jmb/HXW4/z5FFJgADva+VSN h7odRdWK9Epif9daHpklRH1sNtzT1BQ6jXUAZjmQQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrfedujedggeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesghdtreertd dtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseiihiig shhtrdhnvghtqeenucggtffrrghtthgvrhhnpeevgffhffdtfeekleelhedtjeelvdfhvd egieejveffgfduvdfhteegjeeujeeuieenucevlhhushhtvghrufhiiigvpedtnecurfgr rhgrmhepmhgrihhlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdrnhgvth X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 11 Jun 2021 08:13:21 -0400 (EDT) Date: Fri, 11 Jun 2021 13:13:19 +0100 From: tech-lists To: freebsd-stable@freebsd.org Subject: upgrading 12.2-p7 to 13.0-p1 on Azure Message-ID: Mail-Followup-To: freebsd-stable@freebsd.org List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="g9HHFB04CHNlN/dx" Content-Disposition: inline X-Rspamd-Queue-Id: 4G1frf2PYkz4pF0 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=dpLIUO0G; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=vVGgQokG; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.230 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm3]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.230:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.230]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.230:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.0.0/20, country:US]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.230:from] X-ThisMailContainsUnwantedMimeParts: N --g9HHFB04CHNlN/dx Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, Has anyone upgraded a 12.2-p7 azure vm to 13.0-p1 via freebsd-update? Any issues/problems? thanks, --=20 J. --g9HHFB04CHNlN/dx Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmDDU1YACgkQs8o7QhFz NAWxAg//QpdbQ6rsthND/ztNgvxEBDyn2L2NDGscT/wepw2zXeSPZQ1tpJjdfTu+ hXMbZSbUHVedpcHk8WfeonX0J6fmmmmdpuu71OjWupLXrT99ZJFPMFerScXQLIHx jS1M+LWbvjbHar7ITnM2Ch/EtbNPW3C9c83K5DPo2AjkyaKt24i2OowRaD+VPTGx nVeAPxadGVhXomvGUTUVpWEhxG9I88R+J1mqAOtmLBJfSfGSoWFVtKJ5+hSdHzrx MIAAU/DBHHySapiocTWwIqkc0ASG7a8qwafRzSGpGYo1H+6xwBSbVOq+4g4AIHf7 sLJfTMC5Pd7DIAGHQKPTg3Bl4elZP4i+XfhEBn6tcI0balZiAnnbv8B1LaXeOQTy 3BnM0wLPbkcAyx3tD8jISFsZFStCrBPtrpJNdomHQoRIKKtHR5s9I1GDYADU1czP QWlXgMaZ72iV3V16uAPOEe3zQElX5064w6szN/DftAiJUXKl6IfF4dNdAcNYW3E7 DFAC9s+WRf4fwUn81lgzwwRYgvXqA0zacnm6yMUO++lY+9WwaEN6kAheix91lgp2 Ji5FTp1ZdksOyTyu+WpwDZpse5G9iaCEksM/cZmJl0vcc6yD2uvwEv4xfDWuxzV4 4JZBQmr2uO0KKSPfYa3Xr5BHDwi+/NDhgGJb9tfp5dY+Az5aoUk= =1LIJ -----END PGP SIGNATURE----- --g9HHFB04CHNlN/dx-- From nobody Fri Jun 11 14:54:52 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1B8BB7CD99D for ; Fri, 11 Jun 2021 14:55:05 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G1kQx0Hb9z3Q9f for ; Fri, 11 Jun 2021 14:55:05 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from mail-yb1-f171.google.com (mail-yb1-f171.google.com [209.85.219.171]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: lwhsu/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id E6D00B731 for ; Fri, 11 Jun 2021 14:55:04 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: by mail-yb1-f171.google.com with SMTP id g142so4690318ybf.9 for ; Fri, 11 Jun 2021 07:55:04 -0700 (PDT) X-Gm-Message-State: AOAM530zRd3ZN/M7+7Z4YScoEsxL/UHffUNhVlSqFgLAFXBbYBnz6UsQ 5+r3+FBA3e0TmQaR59qUuotn5sx/Hy8LWSQfu50= X-Google-Smtp-Source: ABdhPJx+q5/2AukPTrqUMo8nukCcU0GaIV/22b+VPErdwhBPf7kCptVefTUmZKNVvwT1P/NZdP9FjMbita/9JNhp284= X-Received: by 2002:a25:8191:: with SMTP id p17mr6389153ybk.405.1623423304380; Fri, 11 Jun 2021 07:55:04 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Li-Wen Hsu Date: Fri, 11 Jun 2021 22:54:52 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: upgrading 12.2-p7 to 13.0-p1 on Azure To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-ThisMailContainsUnwantedMimeParts: N On Fri, Jun 11, 2021 at 8:14 PM tech-lists wrote: > > Hi, > > Has anyone upgraded a 12.2-p7 azure vm to 13.0-p1 via freebsd-update? > Any issues/problems? I did this for building 13.0 image for Azure (still WIP for publishing to the marketplace because of other issues) but the upgrading is smooth. Best, Li-Wen From nobody Fri Jun 11 17:00:46 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 913ED7EEC9A for ; Fri, 11 Jun 2021 17:00:54 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org (gritton.org [199.192.165.131]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4G1nD630xTz3tNk for ; Fri, 11 Jun 2021 17:00:54 +0000 (UTC) (envelope-from jamie@freebsd.org) Received: from gritton.org ([127.0.0.131]) (authenticated bits=0) by gritton.org (8.15.2/8.15.2) with ESMTPA id 15BH0kO3031280; Fri, 11 Jun 2021 10:00:46 -0700 (PDT) (envelope-from jamie@freebsd.org) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 11 Jun 2021 10:00:46 -0700 From: James Gritton To: freebsd-stable@freebsd.org Cc: Johannes Totz Subject: Re: rctl -u jail:0 In-Reply-To: References: User-Agent: Roundcube Webmail/1.4.1 Message-ID: X-Sender: jamie@freebsd.org X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (gritton.org [127.0.0.131]); Fri, 11 Jun 2021 10:00:46 -0700 (PDT) X-Rspamd-Queue-Id: 4G1nD630xTz3tNk X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 2021-06-10 17:37, Johannes Totz wrote: > what does > > $ rctl -u jail:0 > > report? Is that supposed to work? Output looks like: > > cputime=10507 > datasize=6946816 > stacksize=520495104 > coredumpsize=0 > memoryuse=403210240 > memorylocked=0 > maxproc=87 > openfiles=6992 > vmemoryuse=1918025728 > pseudoterminals=1 > swapuse=37552128 > nthr=95 > msgqqueued=0 > msgqsize=0 > nmsgq=0 > nsem=0 > nsemop=0 > nshm=0 > shmsize=0 > wallclock=443440 > pcpu=0 > readbps=512 > writebps=0 > readiops=1 > writeiops=0 > > > maxproc looks alright but the rest seems to be all over the place... > I don't have a jail called "0". For an actually existing jail the > output looks fine. > I checked the source and looks like code that parses the jail name is > just a string comparison, no check for jail id. > > Side note: I was trying to get stats for all processes not in a jail. > Any suggestions for that? > > I'm still on 12-stable. In many utilities, jail 0 is shorthand for the non-jailed system itself. Or if you're running withing a jail, it means the jail you're currently running in (as the system itself is inaccessible). Not all utilities support this notation; notably jail(8) itself only deals with visible jails and not the containing system. - Jamie From nobody Fri Jun 11 15:14:33 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6CDA711CB64F for ; Fri, 11 Jun 2021 18:41:14 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4G1qRs5gwTz4VRl for ; Fri, 11 Jun 2021 18:41:13 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 7B0AE5C010B for ; Fri, 11 Jun 2021 11:14:42 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute6.internal (MEProxy); Fri, 11 Jun 2021 11:14:42 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=5QHKf0Qyw8WWBWGt2F3/16hW4Ov 28G+aVtjmSqbGw9Q=; b=LLetP0w+4Hq5s/Irs13LCJTpZtBnoDVWjlX42VeidBI u2Un2p/fth0DVngU2+QvVyDYr/AQmn3YOsmkcw9KpdAvPujzEPCIAtdE0VClM+pb GRrTpsa4IpcrRgOYa3Z0y/cPXh25mRtLMtqndQPZ6Ip6zxxuUAo1QF6E8K8l3Tl/ XZzPTzfqe/DXfNWPBm8R6laaZRbzrHfK+FU4JR8sfEbpw0TaRi8moLLUDAw5+ZKs qopEyPmEVD6D8NDXafNV6V8WoQBJly6Wh5tws7KjZGm0Vb9SZbHd0NrDWE+KM2p3 oyKDwgkKvuLbhMgXsXBRWVGrseBCeHX7eMg5eewRFuA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=5QHKf0 Qyw8WWBWGt2F3/16hW4Ov28G+aVtjmSqbGw9Q=; b=YJbJTGi0z0lfe5E0+4Guij PaqasjtFrJ/hxC+wd2pRm2jTHzG/NG3kwjqmmRZNMdz+ukIKNaetxOBr4vjFI/eN Q2fkBEjvIU/eeKuc0YEs6kgUNxuG4uqxzopdjG4jjixarxfqS1v3+9xIVjaYlEtT 7G0MXT0JKKPa/HF4bx6PXkWl7B1F9jvSM2zZcfug8U/qlfQSIpsiCmYGdqhcsK/s fp00lwUIHbsh3IbB7hBozcGDuCOti+3AeniX7Y90tDF3vXWS0o20Di0ovip9Q6Hp B9oh6K9JEP7oxRPJ7RWKp6zQl0aeTz4j+UT/abm+8miUIWu/8t9bPtf3kV1sqygg == X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrfedujedgkeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucevlhhushhtvghrufhiiigvpedtnecu rfgrrhgrmhepmhgrihhlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdrnhgvth X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 11 Jun 2021 11:14:36 -0400 (EDT) Date: Fri, 11 Jun 2021 16:14:33 +0100 From: tech-lists To: freebsd-stable@freebsd.org Subject: Re: upgrading 12.2-p7 to 13.0-p1 on Azure Message-ID: Mail-Followup-To: freebsd-stable@freebsd.org References: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="H015Ywr8g6T9t4cf" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4G1qRs5gwTz4VRl X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=LLetP0w+; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=YJbJTGi0; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.29 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm3]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.0.0/20, country:US]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from] X-ThisMailContainsUnwantedMimeParts: N --H015Ywr8g6T9t4cf Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 11, 2021 at 10:54:52PM +0800, Li-Wen Hsu wrote: >On Fri, Jun 11, 2021 at 8:14 PM tech-lists wrote: >> >> Hi, >> >> Has anyone upgraded a 12.2-p7 azure vm to 13.0-p1 via freebsd-update? >> Any issues/problems? > >I did this for building 13.0 image for Azure (still WIP for publishing >to the marketplace because of other issues) but the upgrading is >smooth. Thank you, that's good news. I'm using zfs there but not zfs-on-root --=20 J. --H015Ywr8g6T9t4cf Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmDDfc4ACgkQs8o7QhFz NAW2ERAAj20IDFuUTBL4ySy/TRU6W5e2ffqcsRKKxcq1p3j5hurJ3H5dvoiz6mXf OfYDFKMyzsCv+6shni+CjBjXCWYZBNhxhBCuTH1wDGeGd7wef2pwPbTOErgldWnW 6LF+H0sP5zP18u8e9TW7huxREji7uZVT+ZFlUb98oxb9THqVh336v+0oAwZwhxai RnvqXi+FDRpEntNDvs5/TvG5nFZU0YHGzj6hDYDJtZ6n6qN7y+LeWukPpNfqx7ir 4OP1Jvmwaa6AjjnzXeAnHQ30thbfBt4yv0jMbbTcbeaf5/tjBXxmpatNegFB9TGI sQ4NkFclJ+X692Vdk0wl0RdU+NRTyc+aEktqvIHoZqNdj26jv9BruS91czZQyNAM V1vj7A10ja5lc+5u4AHfwNqQWneJIM9RtAF1MKc4E3hvyfBICDAX8pcvdYIKUxov Mz7mFCfdJAvMXzFPga3yjOEnduPB4vZX8HDmglbQ0l/iP4UWqkeyb9HqjxJKuk1l aGYW5nceuH8NSPlehmFsq+yxl6Mx9+ZZzam6v1K95tA5MB7nlU1nbU8kOlT6kSwR 9YAmwxcGSIA4Y5a6BdPPcuy5ADJsbU2HWqGwdgsw+RHA5k9bpJP+TJA/TDV+5Dot dXl0V2D7/06iWbY/ZLVe4i/skn4vof+f24bs1S4CR4tq80bnaeo= =T5X/ -----END PGP SIGNATURE----- --H015Ywr8g6T9t4cf-- From nobody Sat Jun 12 20:35:32 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5C0D55D389A for ; Sat, 12 Jun 2021 20:35:50 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: from mail-ot1-x32f.google.com (mail-ot1-x32f.google.com [IPv6:2607:f8b0:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G2Txd4K2dz3rSt for ; Sat, 12 Jun 2021 20:35:49 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: by mail-ot1-x32f.google.com with SMTP id 66-20020a9d02c80000b02903615edf7c1aso6752641otl.13 for ; Sat, 12 Jun 2021 13:35:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chen-org-nz.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to :content-transfer-encoding; bh=aieeYe+DmAZkGJf4y8Y1cVbyM6RbmBViEm+IiWJianA=; b=eITgaxsNxORiDv48KNNB1uE6Yk2/G1HQU9Ye4jSSWI6gQFGG5uIHeeXbplX1os7Y2c eTrtAGA6iYYP2rT9R7xqh6M+6PwbgD8GzOLvQHgX+RRLmxH4fqg+bn5QsNjKh6DFK62i 7PGGb3OqcW/3K9+YJiZgWi7XqwEJYHetgQhfsN2y5LfHVCWYAgv+sEyLDq4hbbv4Rpry njfyqdGKH3sVbpUbntRcw7l2ZbS8sdSUx4ihJCj4rq0SKFf1NGJ189EKeN9XwprV9xGI nluXx39r/uolV+TE1Mc4kIglS7BzSnNQjrkIYJ8lMn76h3//hyWxbc76dUkkJV8mWtlx 54tQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-transfer-encoding; bh=aieeYe+DmAZkGJf4y8Y1cVbyM6RbmBViEm+IiWJianA=; b=IfE0mMxwEOPHdKSknFfivZFcm10oLndV3OLfzKP7YNNtWaI9+m7JghQdPTUqgC2rEi NjCPkS9sWUCeKhm9lZWtgsTaEtuJ1k+E+5yTADA/iN9RQoCWxF1OZ4zp16TNhEjHJFdX X+LaJrN1qdmf5p0ZMfq7Ddmbq9Ph9p+HwXN06ThvY14o63A1Wi5XZCJu65dEV+iaVjQD xCxINDWxHx8O7ePFZyzH2hNLAl5xKEN3cCXiPTBu/HWcci3pHmnkt6y12qRof56aER3/ y4hkTKSV6+1siMOqz/L6t2HEpZImtjCeZUCSFtQnN2f3gFLjl7jLXHC0lc5YoQRfPTKL wG5A== X-Gm-Message-State: AOAM530NIqFIHrB4WYLYRdJvsgukiUMuWNJZuiAbOS648OMOTr2oqviQ K7p//Yc8HLceCkOq/lnM5q9gP7RGqwTDQRLLtFWEIS9b3bVkcS7h X-Google-Smtp-Source: ABdhPJwztG5P56V5Gt2tp3rcDAfHq7ayd7Kmd4FGmaeHymlCpC133lpmSv4IC66nTa9LXvwFvpzNqy8UwMfwzlvcmY8= X-Received: by 2002:a05:6830:245c:: with SMTP id x28mr8177945otr.169.1623530148490; Sat, 12 Jun 2021 13:35:48 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 From: Jonathan Chen Date: Sun, 13 Jun 2021 08:35:32 +1200 Message-ID: Subject: Creating a 13/STABLE chroot from source To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4G2Txd4K2dz3rSt X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=chen-org-nz.20150623.gappssmtp.com header.s=20150623 header.b=eITgaxsN; dmarc=none; spf=softfail (mx1.freebsd.org: 2607:f8b0:4864:20::32f is neither permitted nor denied by domain of jonc@chen.org.nz) smtp.mailfrom=jonc@chen.org.nz X-Spamd-Result: default: False [-1.39 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[chen-org-nz.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.96)[-0.961]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::32f:from:127.0.2.255]; DMARC_NA(0.00)[chen.org.nz]; NEURAL_SPAM_SHORT(0.87)[0.873]; DKIM_TRACE(0.00)[chen-org-nz.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::32f:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::32f:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N Hi, I'm trying installkernel/installworld to create a chroot'd system, using the output from a pre-built source tree. The following command used to work with 12/STABLE, but it's now failing on 13/STABLE: src,8:27am# make DESTDIR=3D/tmp/t installkernel installworld .... make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jade.inside.chen.org.nz on Sun 30 May 2021 11:27:02 NZST -------------------------------------------------------------- >>> Install check world -------------------------------------------------------------- mkdir -p /tmp/install.kZJR36et progs=3D$(for prog in [ awk cap_mkdb cat chflags chmod chown cmp cp date echo egrep find grep id install ln make mkdir mtree mv pwd_mkdb rm sed services_mkdb sh sort strip sysctl test true uname wc zic tzsetup makewhatis; do if progpath=3D`env PATH=3D/usr/obj/usr/src/amd64.amd64/tmp/bin:/usr/obj/usr/src/amd64.amd64/tm= p/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/usr/bin:/usr/obj/usr/src/amd64.= amd64/tmp/legacy/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/bin:/= usr/obj/usr/src/amd64.amd64/tmp/legacy/bin:/usr/obj/usr/src/amd64.amd64/tmp= /legacy/usr/libexec::/sbin:/bin:/usr/sbin:/usr/bin which $prog`; then echo $progpath; else echo "Required tool $prog not found in PATH ($PATH)." >&2; exit 1; fi; done); if [ -z "" ] ; then libs=3D$(ldd -f "%o %p\n" -f "%o %p\n" $progs 2>/dev/null | sort -u | while read line; do set -- $line; if [ "$2 $3" !=3D "not found" ]; then echo $2; else echo "Required library $1 not found." >&2; exit 1; fi; done); fi; cp $libs $progs /tmp/install.kZJR36et Required library libdialog.so.8 not found. *** Error code 1 Stop. make[1]: stopped in /usr/src *** Error code 1 Stop. make: stopped in /usr/src Is there a new way to do this? Cheers. --=20 Jonathan Chen From nobody Sat Jun 12 21:17:53 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1795E5D5FED for ; Sat, 12 Jun 2021 21:18:13 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: from mail-oi1-x232.google.com (mail-oi1-x232.google.com [IPv6:2607:f8b0:4864:20::232]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4G2VtW29CTz3vL0 for ; Sat, 12 Jun 2021 21:18:10 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: by mail-oi1-x232.google.com with SMTP id t40so9930344oiw.8 for ; Sat, 12 Jun 2021 14:18:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chen-org-nz.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=LSXx+gIzbKzc3qP4i4BWTqXhhD9vSpAgneKp3+/spYU=; b=xtQHL+IDTlED1FZTiRYzSt+sl4BaHsqlaHaMqEoUfsJEhNymnX3xEl5bZVxD2i9MVA asY05uXZX0y14ifXyKsRpb9c+wN3qApJGFaQ/JFSSdT70EJNStSWuuanFzcEnLKHMldg u4sctdKcT1b8jlBckgpOFzOC2bjf6VdZ01oQFbXrmh2N+/rTL5J2OKnamfxlE3cHPA9r 3Tth2dFIb+E48OwfsF+63fBBYTZjQF+pIuPbC60WfSaqD3LG9I22p5AkIPMoMVsF1/Ab OHx8dFYVGeqCJoefuv78ou2Eg67daf84C8lEWPs9t3bwer4rfZPniM08zSGlcmLcNVbS S5kg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=LSXx+gIzbKzc3qP4i4BWTqXhhD9vSpAgneKp3+/spYU=; b=mF3GJiRwpG6tHmuXK/GiIS5kSe1AcZHNMbBLdlRiTZax07TPeGGsZN27hderoWN3nv qHOGW2N7o4N8AxyaMD4YDBSllyfofBoVAWZY7Xymzp/a8+wYVnT1RKI94hf2u75Nmsoz lIUJ8uTDkJqzuPHkIo40YApikvn9hniUQDDjNgeoCQupVhoMUXV807Sv3TlngLXpRLas D+hPXt1JDdvmTq435KnP84hwB8bZPX/GqkuA/8iAw+dYs6gxsUmn2uKtBR6GBdpfDNfu GBEgdfGrhEa2uh8OCx9RdUpdtvzU7Y0mgaNsp6S1e9vry5kVgldw+uKviYH4RgyyUTsQ lukw== X-Gm-Message-State: AOAM530r4WV/xIH6XxyZdNH5Yps1HA29uxPOix2F5A9Fv3a0X7hh49IT K9FcnDwlbb0ZDFsn4nHudsAneO//TSZthvRmO3S+md8prQNDNA== X-Google-Smtp-Source: ABdhPJytbdO6NF0cGatytNaNd0o/Ec2ATkAwNafAWjTBcEXb87Mq0ZzRiPJk4FxBnUuuKzN3RDK1WpADPX6xqpDRGBs= X-Received: by 2002:a05:6808:1415:: with SMTP id w21mr6455889oiv.150.1623532689020; Sat, 12 Jun 2021 14:18:09 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Jonathan Chen Date: Sun, 13 Jun 2021 09:17:53 +1200 Message-ID: Subject: Re: Creating a 13/STABLE chroot from source To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4G2VtW29CTz3vL0 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=chen-org-nz.20150623.gappssmtp.com header.s=20150623 header.b=xtQHL+ID; dmarc=none; spf=softfail (mx1.freebsd.org: 2607:f8b0:4864:20::232 is neither permitted nor denied by domain of jonc@chen.org.nz) smtp.mailfrom=jonc@chen.org.nz X-Spamd-Result: default: False [-1.39 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[chen-org-nz.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.96)[-0.962]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; R_SPF_SOFTFAIL(0.00)[~all]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::232:from:127.0.2.255]; DMARC_NA(0.00)[chen.org.nz]; NEURAL_SPAM_SHORT(0.87)[0.874]; DKIM_TRACE(0.00)[chen-org-nz.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::232:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::232:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-ThisMailContainsUnwantedMimeParts: N Oops, On Sun, 13 Jun 2021 at 08:35, Jonathan Chen wrote: ... > src,8:27am# make DESTDIR=3D/tmp/t installkernel installworld > .... > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: > Using cached toolchain metadata from build at jade.inside.chen.org.nz > on Sun 30 May 2021 11:27:02 NZST > -------------------------------------------------------------- > >>> Install check world > -------------------------------------------------------------- > mkdir -p /tmp/install.kZJR36et > progs=3D$(for prog in [ awk cap_mkdb cat chflags chmod chown cmp cp > date echo egrep find grep id install ln make mkdir mtree mv pwd_mkdb > rm sed services_mkdb sh sort strip sysctl test true uname wc zic > tzsetup makewhatis; do if progpath=3D`env > PATH=3D/usr/obj/usr/src/amd64.amd64/tmp/bin:/usr/obj/usr/src/amd64.amd64/= tmp/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/usr/bin:/usr/obj/usr/src/amd6= 4.amd64/tmp/legacy/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/bin= :/usr/obj/usr/src/amd64.amd64/tmp/legacy/bin:/usr/obj/usr/src/amd64.amd64/t= mp/legacy/usr/libexec::/sbin:/bin:/usr/sbin:/usr/bin > which $prog`; then echo $progpath; else echo "Required tool $prog > not found in PATH ($PATH)." >&2; exit 1; fi; done); if [ -z "" ] ; > then libs=3D$(ldd -f "%o %p\n" -f "%o %p\n" $progs 2>/dev/null | sort > -u | while read line; do set -- $line; if [ "$2 $3" !=3D "not found" > ]; then echo $2; else echo "Required library $1 not found." >&2; > exit 1; fi; done); fi; cp $libs $progs /tmp/install.kZJR36et > Required library libdialog.so.8 not found. > *** Error code 1 Sigh. Operator error. Sorry for the noise, I've somehow managed to corrupt my build. Cheers. --=20 Jonathan Chen