From nobody Sat Sep 2 17:31:44 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdMQV2RYLz4sPsH for ; Sat, 2 Sep 2023 17:31:46 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc33.google.com (mail-oo1-xc33.google.com [IPv6:2607:f8b0:4864:20::c33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdMQT4qhMz3CD4 for ; Sat, 2 Sep 2023 17:31:45 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=pZ+0jlNl; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2607:f8b0:4864:20::c33 as permitted sender) smtp.mailfrom=mjguzik@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-oo1-xc33.google.com with SMTP id 006d021491bc7-57128297bd7so69192eaf.0 for ; Sat, 02 Sep 2023 10:31:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693675904; x=1694280704; darn=freebsd.org; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=5PXO54TSdO/ve/VXiIjHsLTN7siusJIvGf2XBXi4kiI=; b=pZ+0jlNltv/RF1NIDwocLiTvM0CwKWHudxinQ5M9QvMMJd9OTfY3PvDRBu8VqWM0oW WkMk0aasvTEGdn27OtUr3GRdCbygY/WCZZRDdzwhudGLd3E3R7P+5hhd4wkAzlb7TLO6 B5milFWazuzE9txI/iq7L4HXYr0qlAjVLqSTUcF3li+7I6LhNUYKd74MvhIyScFBkl57 lpU8Evo3do7JlMAbwk5pdfhwuCxm/WIPke5XbqMUB8wb8XKz6TvPwVX3keR5mHwIe/TH 3f43lBklil4TySgxpwLo9w/T5otW6/wFQ4661wP/kIYviol/5pCxIMgVixZZO82+vHoN JIjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693675904; x=1694280704; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=5PXO54TSdO/ve/VXiIjHsLTN7siusJIvGf2XBXi4kiI=; b=LTpqy2kloDsydSO1aMy2Dsr1MZs/WLpyl9qkl/QtPXPi3Hu9/IS7sypJKQ23/MViok 9pJBRthJLWUs0v2mzGPWXcRtoVf4x21TxkmFAQagjWIwTEvCKZqd779P/bqVhpO6erzD fZB0xBgBi6rK2QsSEVJi4ZdXqM5ClTXvBAd2p2P+LOBaxw2gc9bRyr2PJS+3V33+QbrK AH0+s+eaRM4E4OzU84JYPJ6+vCqHWCOZH1xoX0PirKgtE3wKIFWI7cvZF+EcsbmAEltD AKeKY3oUjYD73S6Kn05smsRX64G7v4Fg5iLV2QLz/kYHHszNvzj5qj+eohWXe8eV3JTD CkBw== X-Gm-Message-State: AOJu0Yw3KXMIOu2kuosg2fiXY5ej3KgAlu7DDnuEDQ7eUn4rEj7JinyB bOJU3/i8CT10BPOxCB2YE5LdSETaMqAIHO67ihY= X-Google-Smtp-Source: AGHT+IFs2YjiEFcqOtParfQEmYs6W0ugqw/cfKrLa2syv94SSiMNl1N2YnMhE/KerXtAez6Dw8uy61ics2WaMHS2CSo= X-Received: by 2002:a4a:9b88:0:b0:571:1c44:c9b8 with SMTP id x8-20020a4a9b88000000b005711c44c9b8mr4769043ooj.3.1693675904559; Sat, 02 Sep 2023 10:31:44 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:60c:0:b0:4f0:1250:dd51 with HTTP; Sat, 2 Sep 2023 10:31:44 -0700 (PDT) In-Reply-To: References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> From: Mateusz Guzik Date: Sat, 2 Sep 2023 19:31:44 +0200 Message-ID: Subject: Re: kernel 100% CPU, and ports-mgmt/poudriere-devel 'Inspecting ports tree for modifications to git checkout...' for an extraordinarily long time To: Graham Perrin Cc: FreeBSD-CURRENT Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c33:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdMQT4qhMz3CD4 On 9/2/23, Graham Perrin wrote: > On 02/09/2023 10:17, Mateusz Guzik wrote: >> On 9/2/23, Graham Perrin wrote: >>> Some inspections are extraordinarily time-consuming. Others complete >>> very quickly, as they should. >>> >>> One recent inspection took more than half an hour. >>> >>> Anyone else? >>> >>> A screenshot: >>> >>> % pkg iinfo poudriere-devel >>> poudriere-devel-3.3.99.20220831 >>> % uname -aKU >>> FreeBSD mowa219-gjp4-8570p-freebsd 15.0-CURRENT FreeBSD 15.0-CURRENT >>> amd64 1500000 #10 main-n265053-315ee00fa961-dirty: Mon Aug 28 06:22:31 >>> BST 2023 >>> grahamperrin@mowa219-gjp4-8570p-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG >>> >>> amd64 1500000 1500000 >>> % >> get a flamegraph with dtrace >> >> https://github.com/brendangregg/FlameGraph > > Thanks! TIL, it's ported. > > Graph attached, as a PNG, although I don't know whether it'll be useful, > because I began the trace /after/ the issue became observable. > > Will it be more meaningful to begin a trace and then reproduce the issue > (before the trace ends)? > > ---- > > root@mowa219-gjp4-8570p-freebsd:/tmp # dtrace -x stackframes=100 -n > 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o > out.kern_stacks > dtrace: description 'profile-997 ' matched 2 probes > root@mowa219-gjp4-8570p-freebsd:/tmp # stackcollapse.pl out.kern_stacks > > out.kern_folded > root@mowa219-gjp4-8570p-freebsd:/tmp # flamegraph.pl out.kern_folded > > kernel.svg > root@mowa219-gjp4-8570p-freebsd:/tmp # > Looks like you have a lot of unrelated traffic in there. Run this script: #pragma D option dynvarsize=32m profile:::profile-997 /execname == "find"/ { @oncpu[stack(), "oncpu"] = count(); } /* * The p_flag & 0x4 test filters out kernel threads. */ sched:::off-cpu /execname == "find"/ { self->ts = timestamp; } sched:::on-cpu /self->ts/ { @offcpu[stack(30), "offcpu"] = sum(timestamp - self->ts); self->ts = 0; } dtrace:::END { normalize(@offcpu, 1000000); printa("%k\n%s\n%@d\n\n", @offcpu); printa("%k\n%s\n%@d\n\n", @oncpu); } dtrace -s script.d -o out this can be fed to generate a flamegraph the same way; upload it to freefall -- Mateusz Guzik From nobody Sun Sep 3 02:00:01 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdZjJ5RD7z4rX0C for ; Sun, 3 Sep 2023 02:00:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdZjH0DW8z3MYq for ; Sun, 3 Sep 2023 02:00:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=cskGKiuZ; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693706416; bh=GOgupRw7AgIfgN+zq1LXbnX6xDtFnrvAuD+M7RdhOeQ=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=cskGKiuZHcRO5NCtogQsgMaMwWksaio5mYO8Xpc9m9J0onlT4lq6hOtO4aj9krjjqFo7AKc9HN3nPI3QxZngw8jnVDnRiork0HEH/fsZS21us7rnSIK9TYTE6q1UCs13EScbWXB9MfbSMwdaGIrfvFSeDpCzj+YrsiT0VTM7sed17TYnLiB4Is+QZ5/OgpYIvNzn4NXK7wj20lyL3q3lXl6mu93vfyuj1uY8RAX7tEb2VWFNBQmcPSeiNh+ZWiWi7oxkj2RYUaxwcKwfVeXcmt2o4o9HYRBuUpfszVrqM6ys49Nw1UWHHVg1juHCJ+gMdUfX5tsjFGBpxoqfEz1qDQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693706416; bh=Frp2HCw2E4T3/9Yv/hFIHWOh32xN81SBEXwgaP+0V36=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=OQAtYabDqFT7G0vZXqNautJ2rqy6jMTH0G1MnhmQFzC0OM/Hr/mz4w5vuT6Gnjqk8U+IN0ysQoENiPU2ALxcmiBRZLgKtq9alQXonXy/IMkpy6282kMvjpa5smw+LYYrgkwv5SY2OoSWCHHvYY+lKjaV9Rz6jMEzXMny+cefBXgOYS88frUQZzyyISM6E7LZOqPweqjYkHDdyGChVFWRKjOLenxBPlxYm+5a+DYDLTtdUT2Oa7e2flE2dn0KhioxESzMZUUklG9GbuFTKCtAF3Blya3Exm3Zu4Ovo6ZMTVdDQ+p8FZfMRXOOu4qXGz+/l7w663IX6fS1MAlgOYIRnA== X-YMail-OSG: tRevNfUVM1mqnywTqqZGUejINODog5Tnbwyd2NvddBC6D8AFY1ekqlqjwP0W4id Jm_RZWmgqyZJyQ3Jb_A_zFiKiIkTwMa6fvqzOpaH5ISjcK_YBEl8bc6vpcj6XMtzpxTzK4MF3ah3 JPHy6oORF_X7IRm9QDzNOeDtuXajbNypQr_nrSGpTWtqImTFOIfWVPMEo6yO1xZa3O_pTGHsMi_m n3gX.nN4E_u0k7GywX0qy6KoiPqjYgs3Y07HT92W1x8qosM0kWqdXX_O7CJbXVULxP.xlyKhtmnp dhg48hnas3LjjulEVOHJeyP3hgvfNEK1scMBjmiMoRROjt_tBk1Oq7DAcGvuBlBliymPn8lhMCSf l9jbCTE1E6uax.XeTHvIdeRCOmsn7SVmKxrkuCZzHht26LHcfebzNWA..MGe6RXzMnQnY.CZ0t6P rLOIwJ9CAE6vtBrPxkpMPxjoh3g0F7Itjs_.8KSRoW9jF5AtzVjV2y8V9kucyz4jbl7FhANn3Soo oxvE4BTRycssmVPLZf5ZbJXJExn4HrFxCVaZ623ITngsJ6CUqPbu.w2K5Bsbnp7dBSnBOgIRfpm7 ZBiiCahu8BEtKWEKe4Hvw62oi9ifPz_dnfwjA.nxT1gvY4E1Duo3yxtfmNeBIg5krxu4RZsJivRD ZsXsM8T6rzZ0mcgF3OiB2KRY3NPrGLFVbujeqfKGarxZWJvU.g4lhiUO556YHCo.dv493owk05Rq Dh2aVpD6DELoi6k3y9ivQg1i0.FBBBtzxor8A6VZPADyMWxV2WiM7NVdtf9rA_y5QcY5YKCx5aMz J1D7tnJGSudEjOtkHa6qy90lrFOhSs4QvLZueb78WE0UCZTMPegVoZFT8TiQxsJAGoS_0dw5hIjY HPWPqK_odJJbV4NP.vpvdO3sEj7eEztD9xODMs7M9eBsSvuiOMGGj4KG6UhugkrHGKuzWr8koLjU nTl.uaiWhapCzkORtReLb_.fBEKMZemD13zdmb03COa67lXMAUrzsvYbplJF.mZoZvyOcxFH431h cQH0CLWyZ8eoOt_RDJbn_vRAL2qNAVVf.HhrXouwmPf4r.imU5cHT4tG3TtFUkY1CYkF.h6MSHIY hB5yZNB6pellu2_H21BjHY_htUhF9XNaalERBOSQoSsGSPHj433ZDozc5ZDXTit1bvKGJERun9mJ qtJK7XqKr1MnbAuN.HJzC.9xuCnP72qUuf.wmc50IggfBrLZhI8mPB5I4HpD7dpz2ceGrqHwMSJs nQm_JSMrdeF1FB3bPx2oGStO4xUIao88rHlZHz1eQCjLMzm3R45goH03TxbjOOLX8..XB3KSck34 ot.u9oZ0VRXi.230.TqljOi2n8IDWFQoy3G5x4pL3hyYEI2vj1LkYyvMa_8t7hSANyPXY5RRotWC JljGae7EqzIqE0hru3yVDcSn6bOzjiIIrgWArSmkzo.xdjD44oMAnu_KQWR0JwEpzINpIT.Zf.EG zu3nf7sEYfr0BjeeLEe45vfFvH2drP3g.mPnLMxgynqE2nXAQRLSXaftFCJ2hXj_4J2I5JG4Lisv luPalN8AaE10XFRXVRWwbJ4tzkOC1AZg5hB2L6hmqF3x.1pyr9TdOvhIcLF6vBny8fP_yt621ABD uiZbn6Jzwu5WXEGRx6Sg_L6JVvinGvs7ZGlCbbXnqmAlsVvOzdV0CvPae00cRiq5T.C9MzLtkBtE GsQMAxBPIAYShsEQInaL_WRNiby_2pnNH8K_THc.cyL5kVwMYNQ9QsVJjuip6wdwOvx41FOKBUAR eMa1oDA.BuR3BXP4DB5dD7oqHzzkki5xpVoCQ5hAndwR.Wvvov.PNPaV.zQrsYH2iny7ZJTGSGwP XQAoUevB3ITosH.e3Rvrkx5QFCessgVRudbd5Q3tLtkaYp2Jspl1GweWArFh7YgnefHiChNP7hK7 nWGSHVT.LpAyEKjN_LGKgqLbpOFa0C4iyUbisCyCRmsHiwNZvRWjrFJB5L5TvZivja8BSF83w83F ikNTjXwt2FfOrUHcaXankRedoNlSH9dFiY5mzaF5O.9dI..m3sKm0BR.fMGPdlvwQ1OrfnBi5HxC cdKoqwG582YG_qIme9WTCibI51gc5.xOXXF7A4TZL0MBSPKefcHSSoc.rbaWcII2H6kfDc.B.h8v n5uAR79yP.L1QiZ_1md4FjswAOfVNLqIpT3RR3xMa_2BVmWtCfRMZO525hQ7gwFsyITa_dpEpu6C rTrTebYshJGKINLDwEEnduFXGW8PBOBdYDAVnFopz_HvKN3_r3S7kC2fubp6iKLBqKtBpiGsQHJU - X-Sonic-MF: X-Sonic-ID: e5821fcf-7d69-44a2-9ace-8f9fdf70182d Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sun, 3 Sep 2023 02:00:16 +0000 Received: by hermes--production-gq1-6b7c87dcf5-rj56s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID dd6a013517d11c7245095b72928ac780; Sun, 03 Sep 2023 02:00:11 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: [Bug 273506] main [so: 15] aarch64 kyua python use fails with: . . . and dlerror is reporting "/usr/lib/ossl-modules/legacy.so: Undefined symbol \"MD4_Update\"", '\000' [crude patch] Date: Sat, 2 Sep 2023 19:00:01 -0700 References: <721EBF15-6905-437E-9B23-A4E3D1129658@yahoo.com> To: freebsd-arm , Current FreeBSD In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: - X-Spamd-Result: default: False [-1.98 / 15.00]; LONG_SUBJ(1.52)[202]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; BLOCKLISTDE_FAIL(0.00)[98.137.69.31:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdZjH0DW8z3MYq On Sep 2, 2023, at 09:37, Mark Millard wrote: > On Sep 2, 2023, at 00:35, Mark Millard wrote: >=20 >> For: >>=20 >>> Date: Sat, 02 Sep 2023 00:58:29 UTC=20 >>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273506 >>>=20 >>> Bug ID: 273506 >>> Summary: main [so: 15] aarch64 kyua python use fails with: >>> "RuntimeError: OpenSSL 3.0's legacy provider failed to >>> load" >>> Product: Base System >>> Version: CURRENT >>> Hardware: Any >>> OS: Any >>> Status: New >>> Severity: Affects Only Me >>> Priority: --- >>> Component: arm >>> Assignee: freebsd-arm@FreeBSD.org >>> Reporter: marklmi26-fbsd@yahoo.com >>=20 >> Turns out that internally dlerror is reporting: >>=20 >> "/usr/lib/ossl-modules/legacy.so: Undefined symbol \"MD4_Update\"", = '\000' >>=20 >> (as shown via a gdb session printing the string). >>=20 >> See: >>=20 >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273506#c3 >>=20 >> where I finally got to that information. >=20 > amd64 did not have: >=20 > devel/py-pytest-twisted > devel/py-twisted > net/py-dpkt > security/nist-kat > security/openvpn >=20 > installed and so was not doing the same sequence of dlopen > calls. >=20 > After adding those, the amd64 run fails like aarch64: It then starts = to try > to use .../cryptography/hazmat/bindings/_rust.abi3.so leads to the = problem. >=20 > [Detaching after fork from child process 98729] >=20 > Breakpoint 1.1, dlopen (name=3Dname@entry=3D0x803239710 "libc.so.7", = mode=3D2) at /usr/main-src/libexec/rtld-elf/rtld.c:3662 > 3662 return (rtld_dlopen(name, -1, mode)); > (gdb) c > Continuing. >=20 > Breakpoint 1.1, dlopen (name=3Dname@entry=3D0x8032c80d0 = "/usr/local/lib/python3.9/site-packages/cryptography/hazmat/bindings/_rust= .abi3.so", mode=3D2) at /usr/main-src/libexec/rtld-elf/rtld.c:3662 > 3662 return (rtld_dlopen(name, -1, mode)); > (gdb) c > Continuing. >=20 > Breakpoint 1.1, dlopen (name=3Dname@entry=3D0x8032c7440 = "/usr/local/lib/python3.9/site-packages/_cffi_backend.cpython-39.so", = mode=3D2) at /usr/main-src/libexec/rtld-elf/rtld.c:3662 > 3662 return (rtld_dlopen(name, -1, mode)); > (gdb) c > Continuing. >=20 > Breakpoint 1.1, dlopen (name=3Dname@entry=3D0x80219d080 = "/usr/lib/ossl-modules/legacy.so", mode=3D2) at = /usr/main-src/libexec/rtld-elf/rtld.c:3662 > 3662 return (rtld_dlopen(name, -1, mode)); > (gdb) c > Continuing. > INTERNALERROR> Traceback (most recent call last): > . . . >=20 > This appears to be tied to devel/py-twisted and/or = devel/py-pytest-twisted > but like anything leading to loading > .../cryptography/hazmat/bindings/_rust.abi3.so is going to get the > problem. >=20 The following crude patch leads to kyua's python use working for examples/test_examples.py with devel/py-pytest-twisted and devel/py-twisted and the like installed. The below might not end up with leading whitespace preserved: # git -C /usr/main-src/ diff crypto/openssl/crypto/init.c diff --git a/crypto/openssl/crypto/init.c b/crypto/openssl/crypto/init.c index cacf637c89f8..77f693fcfa05 100644 --- a/crypto/openssl/crypto/init.c +++ b/crypto/openssl/crypto/init.c @@ -159,7 +159,7 @@ = DEFINE_RUN_ONCE_STATIC(ossl_init_load_crypto_nodelete) if (!err_shelve_state(&err)) return 0; =20 - dso =3D DSO_dsobyaddr(&base_inited, = DSO_FLAG_NO_UNLOAD_ON_FREE); + dso =3D DSO_dsobyaddr(&base_inited, = DSO_FLAG_NO_UNLOAD_ON_FREE|DSO_FLAG_GLOBAL_SYMBOLS); /* * In case of No!, it is uncertain our exit()-handlers can = still be * called. After dlclose() the whole library might have been = unloaded (A variant of the above note is also in my separate bugzilla.) For reference: # /usr/bin/kyua test -k /usr/tests/Kyuafile examples/test_examples.py examples/test_examples.py:TestExampleSimple::test_get_properties -> = skipped: comment me to run the test [0.582s] examples/test_examples.py:TestExampleSimple::test_one -> skipped: = comment me to run the test [0.589s] examples/test_examples.py:TestExampleSimple::test_parametrize[AF_INET6] = -> skipped: comment me to run the test [0.582s] examples/test_examples.py:TestExampleSimple::test_parametrize[AF_INET] = -> skipped: comment me to run the test [0.595s] examples/test_examples.py:TestExampleSimple::test_parametrize[FAMILY_39] = -> skipped: comment me to run the test [0.589s] examples/test_examples.py:TestExampleSimple::test_syscall_failure -> = skipped: comment me to run the test [0.590s] examples/test_examples.py:TestExampleSimple::test_two -> skipped: = Required file '/path/file1' not found [0.001s] examples/test_examples.py:TestExampleSimple::test_with_cleanup -> passed = [0.583s] examples/test_examples.py:TestExampleSimplest::test_one -> skipped: = comment me to run the test [0.583s] examples/test_examples.py:TestVnetDual1::test_ifstat -> skipped: comment = me to run the test [0.593s] examples/test_examples.py:TestVnetSimple::test_ping -> skipped: comment = me to run the test [0.589s] examples/test_examples.py:TestVnetSimple::test_topology -> skipped: = comment me to run the test [0.588s] Results file id is usr_tests.20230903-014520-255324 Results saved to = /usr/home/root/.kyua/store/results.usr_tests.20230903-014520-255324.db 12/12 passed (0 failed) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Sep 3 07:07:36 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdjX058RCz4rlvy for ; Sun, 3 Sep 2023 07:07:44 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ed1-x531.google.com (mail-ed1-x531.google.com [IPv6:2a00:1450:4864:20::531]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdjWy670Qz3Mhd for ; Sun, 3 Sep 2023 07:07:42 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=rcVg1uaG; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::531 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ed1-x531.google.com with SMTP id 4fb4d7f45d1cf-52bcb8b199aso461692a12.3 for ; Sun, 03 Sep 2023 00:07:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693724858; x=1694329658; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:content-language :references:to:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=Tae6XjHdy2SX9YX41TnxKgOQaVU8jQI3rVi8JEroihg=; b=rcVg1uaG9BU1s8As4Foe0+s9TJHKbWyQp5DrNQsM9LVk7K6dF88mAKAgyiECpFE6Gv mDN56FPjrE8EFajSddtk7DgjiIehtj+CbW6xvMWwuwX3AZ+eiiCLcUtdWXei5dtDa1bZ NmP5RCzzbndI2GkJIsw+Gx161J5fN0eOpo6dmq2PuGLJbYci66AGyRuLtmsv9AG5tnUn +TjowQICjFTuAdDtBL+C1wfeMZSDdp9KHtf61MHw4X2NWqw/153NEoxbuhp9wDHbwQdD /Qs02nh36X1kSoKhGxPfY/lC5Qi1NeflLQ85INc811JQF/oRrf8LUs1b0sw89lZjlZ7e hD3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693724858; x=1694329658; h=content-transfer-encoding:in-reply-to:subject:from:content-language :references:to:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Tae6XjHdy2SX9YX41TnxKgOQaVU8jQI3rVi8JEroihg=; b=PfP5FARph1uLUOsI5Vx7nSEpZ5OFlC479U27Rfd+O8X9wKPNjIsUNPx3bWroDZQB8K QmKt/zBwZ5rmcCA0eByUSerpF+0qXcdJpGpRTMktaf5xMIe7DWdZKEV6ZlNaBg+YHY3H My41uxJL4Q72qC4Zvyrsa1wZkhn/cbiDGr9YxONyjNJNFc2TJrdVb16RBx45ucC2+D7O levrQigFRwE87lba/rj4GQ4OaIdgQ2Gs8dG6ZCP/R31XjAu3oWZaN2sn3/2pLPfJDGUy qMcjOpx2jQOyAuUxIqqPpXehuIRARKh+b5ttIdqK8tTGBtuID44FxIWzOgjQph1vf1Y0 Kf+Q== X-Gm-Message-State: AOJu0YwRfGI3BkXAoyJar3Bq7WXiOJ6Nl9AIZubJj7iLXJwJ7DCQBvQS L8pOkYNXGleEj/pVLYbkonTJgxLECEQ= X-Google-Smtp-Source: AGHT+IFyM6QKZh5RwysYGNh1JwuWpdV/PI3673B9LbNRMmE26TKAm6K0iyBJqE0znEBIBj0718UvsA== X-Received: by 2002:aa7:d9c7:0:b0:523:3631:876c with SMTP id v7-20020aa7d9c7000000b005233631876cmr4901755eds.18.1693724857868; Sun, 03 Sep 2023 00:07:37 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id t3-20020aa7d4c3000000b0051bed21a635sm4216768edr.74.2023.09.03.00.07.37 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 00:07:37 -0700 (PDT) Message-ID: Date: Sun, 3 Sep 2023 08:07:36 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 To: FreeBSD-CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> Content-Language: en-US From: Graham Perrin Subject: =?UTF-8?B?UmU6IGtlcm5lbCAxMDAlIENQVSDigKY=?= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.990]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::531:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdjWy670Qz3Mhd On 02/09/2023 18:31, Mateusz Guzik wrote: > … upload it to freefall … Sorry, that's no longer possible. Do people have a preferred FreeBSD-oriented location/service for FreeBSD-specific files? TIA In the meantime: I find the symptom reproducible, quite frequently, without using poudriere. Currently: % uname -aKU FreeBSD mowa219-gjp4-8570p-freebsd 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #11 main-n265135-07bc20e4740d-dirty: Sat Sep  2 19:40:08 BST 2023 grahamperrin@mowa219-gjp4-8570p-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG amd64 1500000 1500000 % From nobody Sun Sep 3 07:56:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdkcN30d5z4s0md for ; Sun, 3 Sep 2023 07:56:36 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdkcN0C48z3WFy for ; Sun, 3 Sep 2023 07:56:36 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x536.google.com with SMTP id 4fb4d7f45d1cf-52a4818db4aso485510a12.2 for ; Sun, 03 Sep 2023 00:56:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693727794; x=1694332594; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=ay0dfh6gBydbdCJDDoAajhlDEXG6RHAHcekZaXdbLxI=; b=nm+tyX+B8ubftqz0rNreRlegbfAg2f11XbiTHMNZn2dBO+eg3xtKa2Xbve6z5Ydr+B +FvCQvLrWLMqiiAdBLsLV91JVKNpGiLZXgyDDZToXMQ+CEdAHuJrSOvVarlq1X2VCTVY NhOZVVG+j1EigtddG/hkMtX5AZfr7mav4YSdb2B3UCGQMDDIcr3XHi8c1k52U+Lyzcyb eSYKM3GBY2RLHa7n05y5AvcE+wRN5HDp0QJQlc3Xfkhu5B2eHfT5HzpSqx1u0ga3BltR SAOKiPBt8eUA9Eo6WPIGk3YgAKnZR9OefqUCoRuX9K3qpeb7RVLK/Zu8kr3GlE93qHra NtkA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693727794; x=1694332594; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=ay0dfh6gBydbdCJDDoAajhlDEXG6RHAHcekZaXdbLxI=; b=bVqJba2kgJ0STJTp0sBnAGmuv6d0bOE9AURK3ZPETxqcftbO3Rt8DeykJWlWFQGvWp G6CjiVgRsjNZ9fbN3DJ+qrXSebC2A6J+eMPQ7OngVmAUOy8/sYxuY6IUqTeQoa8+QnR1 e+Y2I149wnATOGcE8Xz7hZdolQ4DabkKt5TU0Tnk/l62VLn/5VZ2KTDRzTJSwzcDSBre nRZbqCMJfBD8Kru/EjCRwZdojOY8yZD/7J+IpwN9+A6BPC3oH+CtOusgWsbxLJTUke7k whLaWthznfFJ5FVzMsNYEjl6Xs6pzkJWpFHnzFKywyABwGndRFYxQcRUtcplyLnauImg W1gw== X-Gm-Message-State: AOJu0Yx+SAWBJNcW2s9/P22WC+6Pwjcpk73H06gRKtatp7U6kEyFz6rG r3j5ojQzM/zgZIFTmPlcecwY5SeV1WsH9w== X-Google-Smtp-Source: AGHT+IEgovVYBbjiwE7q+Mx7qTLbb2NP6d6AJ6mI5mvdnxdNXITfaN4ZIUTXMlAWDqoxnm7WIncQeQ== X-Received: by 2002:a17:906:3147:b0:9a5:b876:b1e3 with SMTP id e7-20020a170906314700b009a5b876b1e3mr5235965eje.20.1693727793696; Sun, 03 Sep 2023 00:56:33 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id gf16-20020a170906e21000b0098669cc16b2sm4451596ejb.83.2023.09.03.00.56.32 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 00:56:33 -0700 (PDT) Message-ID: <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> Date: Sun, 3 Sep 2023 08:56:32 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: kernel 100% CPU Content-Language: en-US To: Mateusz Guzik Cc: FreeBSD-CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> From: Graham Perrin In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RdkcN0C48z3WFy On 02/09/2023 18:31, Mateusz Guzik wrote: > Looks like you have a lot of unrelated traffic in there. > > Run this script: > #pragma D option dynvarsize=32m > > profile:::profile-997 > /execname == "find"/ > { > @oncpu[stack(), "oncpu"] = count(); > } > > /* > * The p_flag & 0x4 test filters out kernel threads. > */ > > sched:::off-cpu > /execname == "find"/ > { > self->ts = timestamp; > } > > sched:::on-cpu > /self->ts/ > { > @offcpu[stack(30), "offcpu"] = sum(timestamp - self->ts); > self->ts = 0; > } > > dtrace:::END > { > normalize(@offcpu, 1000000); > printa("%k\n%s\n%@d\n\n", @offcpu); > printa("%k\n%s\n%@d\n\n", @oncpu); > } > > dtrace -s script.d -o out # pwd /home/grahamperrin/Documents/IT/BSD/FreeBSD/kernel-cpu # ./2023-09-02-18-31.sh ./2023-09-02-18-31.sh: profile:::profile-997: not found ./2023-09-02-18-31.sh: /execname: not found ./2023-09-02-18-31.sh: 6: Syntax error: "(" unexpected (expecting "}") # whoami root # echo $ $ # echo $0 sh # echo $SHELL /bin/csh # exit root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeBSD/kernel-cpu # From nobody Sun Sep 3 08:01:03 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdkjv0G3dz4s27Q for ; Sun, 3 Sep 2023 08:01:23 +0000 (UTC) (envelope-from otis@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdkjt6WdYz3XbC; Sun, 3 Sep 2023 08:01:22 +0000 (UTC) (envelope-from otis@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693728082; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zPcJyHJegOyzmX0Gfk/+E6jvmfI4MG0xdUKTvjfPtUs=; b=whrfP7mItM0UlH13aZquVfhuY28L2Gbyoz0tddmp945smlq6eW/5xV9q0vOCDYLSTA8TIX JEcSAR+6fb5CMlSEEgn+hA+2KRdmhgQSoEmGMEyXbp8OQZlEjIU8FTTUSoRkl1q8OOxtP0 Z0vYbdQQ8n5cXcgv4+3ZP+a0VgzAHWlBDdx8RG3yAfhwYxHaTAJFanhA25t4OLFxAuLpPp EfBEYjhS4PBoRePBQ6EcqPBxaUwxsE2dinB6kEcVco/fEVhF/2gUglmOYDiwZ2rA/8B/tU NGA2hhWr6sLNp0Ij0sKfW45m4lDVmF4LhudUsrQY4OymqHqSw+RetIBBgHKSWg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1693728082; a=rsa-sha256; cv=none; b=xvxHfTLPvwMIZBkQvK9IFpXhrxID2z+pjPLrYunvqj/wg9GhbreD8z9DYFx31fXgJUOwa3 2OGCdyqd3Eh4R9zZRzYJ8XyHdBEXFtLSKOerrSbxNKEmn/3pASovc2Ygw5GTLW6ix1udev AS9Nr8P4sfjsuqH7+lY6kCP1/buXFQgzqIKEu/TytzFgH3l64LDU3RVRwSVgL//dZKzsYq 4qwDpUnqC4HGfuNQ4O/jwshJfkyTDxilKd+WPqNiGCrlPvOpayyhqQ7gYiyE/vTavbCrZd LQ7sacWX5fKgWg9AMt9ijm3R+PqeCgDCLsF4DUIqaM+vWClMlHgiUfWsQDKohg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1693728082; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zPcJyHJegOyzmX0Gfk/+E6jvmfI4MG0xdUKTvjfPtUs=; b=fpmJBldXr/05g49XV24cG0mgoO3Fn5CBr398AgyeGh8VzNM0yLd7MT77deOmm9R9dBsiwv 7Ll9JqHt55rZaDqqKW0odTJyFQQndexPr9zI/pp3kIHqTBKoMkOY6oNRVIWYxiomwLqs81 cKIVVEziCaZMI+/WkBVICwADH/1KtzCx4fv4V6JIFIxdvYdnC6ma5YFQJQIHSIs7rzSx9J EKh+AQrwDB0y6LWCc5ZfFArv/q1q3DwotvnPReql/cuxiCr8GVArs1PSut8F6d41pZE8+D JirpHwK6D5RAA019xJpplzpTFQN9SA0DPlaDNC9FXp0E6LAYG1/9fXKRll1Lcw== Received: from ns2.wilbury.net (ns2.wilbury.net [IPv6:2a01:b200:0:1:f816:3eff:fecd:13e6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "svc.wilbury.net", Issuer "R3" (verified OK)) (Authenticated sender: otis) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rdkjt4wCxz1FCd; Sun, 3 Sep 2023 08:01:22 +0000 (UTC) (envelope-from otis@FreeBSD.org) Received: from smtpclient.apple (218.244.freebone.cz [88.83.244.218]) (Authenticated sender: juraj@lutter.sk) by svc.wilbury.net (Postfix) with ESMTPSA id B00E161F84; Sun, 3 Sep 2023 10:01:14 +0200 (CEST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: kernel 100% CPU From: Juraj Lutter In-Reply-To: <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> Date: Sun, 3 Sep 2023 10:01:03 +0200 Cc: Mateusz Guzik , FreeBSD-CURRENT Content-Transfer-Encoding: quoted-printable Message-Id: <79A8D994-65F0-4E5C-9713-8A1B6122DB00@FreeBSD.org> References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> To: Graham Perrin X-Mailer: Apple Mail (2.3731.700.6) > On 3 Sep 2023, at 09:56, Graham Perrin wrote: >>=20 >> dtrace -s script.d -o out This is the actual command. The script mjg@ provided is not a shell script. The script filename is =E2=80=9Cscript.d=E2=80=9D where you should put = the above-mentioned DTrace script (without the "dtrace -s script.d -o out=E2=80= =9D line). =E2=80=94 Juraj Lutter otis@FreeBSD.org From nobody Sun Sep 3 09:26:23 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdmcJ3qHdz4sQtk for ; Sun, 3 Sep 2023 09:26:40 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdmcH2bz4z4JpR for ; Sun, 3 Sep 2023 09:26:39 +0000 (UTC) (envelope-from grembo@freebsd.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=softfail (mx1.freebsd.org: 213.239.217.29 is neither permitted nor denied by domain of grembo@freebsd.org) smtp.mailfrom=grembo@freebsd.org; dmarc=none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 282b0a20; Sun, 3 Sep 2023 09:26:38 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 07656152 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sun, 3 Sep 2023 09:26:38 +0000 (UTC) Date: Sun, 3 Sep 2023 11:26:23 +0200 From: Michael Gmelin To: Graham Perrin Cc: FreeBSD-CURRENT Subject: Re: kernel 100% CPU, and ports-mgmt/poudriere-devel 'Inspecting ports tree for modifications to git checkout...' for an extraordinarily long time Message-ID: <20230903112623.2ed751a5.grembo@freebsd.org> In-Reply-To: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.06 / 15.00]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.963]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; FREEFALL_USER(0.00)[grembo]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdmcH2bz4z4JpR On Sat, 2 Sep 2023 09:53:38 +0100 Graham Perrin wrote: > Some inspections are extraordinarily time-consuming. Others complete > very quickly, as they should. > > One recent inspection took more than half an hour. > > Anyone else? > Does `git clone https://git.freebsd.org/ports.git` work for you? (currently it's not working from where I am). Maybe related. Best Michael -- Michael Gmelin From nobody Sun Sep 3 13:17:36 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdskq64WFz4rQHL for ; Sun, 3 Sep 2023 13:17:39 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdskq4CNqz3X56 for ; Sun, 3 Sep 2023 13:17:39 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; none Date: Sun, 03 Sep 2023 15:17:36 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1693747057; bh=D8cHDwwFshzahb6Jwh2e1MGPv43OIhVus3vO8cHGrbY=; h=Date:Message-ID:From:To:Cc:Subject:MIME-Version:Content-Type; b=otcmKuCgxMn5KUDDWatR/DThgoGxR1PHFG2UiKxhmGSlh6M6AmP8g+3SdcORBDa9Q PqYsPabv6T+H+P5HiTlUh69rpmllJlzpvDbt0cqqgghLsPMMHP9NK1Gw+QNcno7bKr KbG/7ybUpE3Ll61bhXYit85IgKlCnfYQfDpZyHw+blGnkpME2p3EB1WdfHFNw1H/5t rr7WH+qPh4PwhHEFiH+wahJYAtYQ4/TPkOgnMaEA/TJoThf+3bYKVkZ7qgc1Udp4qo lZm4pQ6Gv4kEre0qEZ/mdfAPpXRo0mTHld+2AJDcP+zBdic0hWOLwPK3mOPIFMv7dx Y6QqYKdrVXYtw== Message-ID: <87h6obtmz3.wl-herbert@gojira.at> From: "Herbert J. Skuhra" To: garyj@gmx.de Cc: current@freebsd.org Subject: Re: FreeBSD-15 kernel panic when the amdtemp device is in the kernel In-Reply-To: <20230902180203.58f1a729@ernst.home> References: <20230901130314.460f91bf@ernst.home> <20230901162336.542a1b91@ernst.home> <20230901164321.3259afd9@ernst.home> <20230901180534.0f3f3f6b@ernst.home> <87v8cshf2z.wl-herbert@gojira.at> <20230902180203.58f1a729@ernst.home> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/30.0 Mule/6.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=US-ASCII X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE] X-Rspamd-Queue-Id: 4Rdskq4CNqz3X56 On Sat, 02 Sep 2023 18:02:03 +0200, Gary Jennejohn wrote: > > On Sat, 02 Sep 2023 15:36:36 +0200 > "Herbert J. Skuhra" wrote: > > > On Fri, 01 Sep 2023 18:05:34 +0200, Gary Jennejohn wrote: > > > > > > On Fri, 1 Sep 2023 14:43:21 +0000 > > > Gary Jennejohn wrote: > > > > > > > A git-bisect is probably required. > > > > > > > > > > I did a bisect and the result was commit > > > 9a7add6d01f3c5f7eba811e794cf860d2bce131d. > > > > > > However, that can't be correct because this commit was made on > > > Mon Jul 17 19:29:20 2023 and my FBSD-14 kernel from August 13th > > > boots successfully :( > > > > Commit date is August 19th, 2023(!): > > > > commit 9a7add6d01f3c5f7eba811e794cf860d2bce131d > > Author: Colin Percival > > AuthorDate: Mon Jul 17 19:29:20 2023 -0700 > > Commit: Colin Percival > > CommitDate: Sat Aug 19 22:04:56 2023 -0700 > > > > > > Reverting this commit seems to resolve the issue for me: > > > > FreeBSD 15.0-CURRENT amd64 1500000 #0 main-n265137-2ad756a6bbb3 > > > > $ git status > > On branch main > > Your branch is up to date with 'freebsd/main'. > > > > You are currently reverting commit 9a7add6d01f3. > > (all conflicts fixed: run "git revert --continue") > > (use "git revert --skip" to skip this patch) > > (use "git revert --abort" to cancel the revert operation) > > > > Changes to be committed: > > (use "git restore --staged ..." to unstage) > > modified: sys/kern/init_main.c > > > > # dmesg |egrep "(amdsmn|amdtemp)" > > amdsmn0: on hostb0 > > amdtemp0: on hostb0 > > > > $ sysctl kern.conftxt |grep amdt > > device amdtemp > > > > Really? I did a git log and July 17 is what pops out for this commit. > > Ah, I see that git log doesn't show the commit date. > > So I guess that the git bisect really did find the commit which caused > all our problems. > > If reverting it fixes things then this requires some action from Colin > Percival. > > This would also explain why my FBSD-14 kernel from August 13 was > OK. Probably best to file a PR: https://bugs.freebsd.org/bugzilla/ -- Herbert From nobody Sun Sep 3 13:50:57 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdtTM6FtJz4rbgX for ; Sun, 3 Sep 2023 13:51:03 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdtTM0r7Tz3fVy; Sun, 3 Sep 2023 13:51:03 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-99bf1f632b8so98588866b.1; Sun, 03 Sep 2023 06:51:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693749060; x=1694353860; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=yIiH7TWstI3FA8hJirGKCUFvbBfKOKCQsJ66pm4U/ts=; b=ZsXTRifeEKY8lj7kwnEKExh2LMNZFqjVMjEk1m0Lkpv+ySX0rIQufQzkIt+6wvCRgI TNqQVrDxxmLRssPN5dV7v5S8xYKgqEoQfzjJ4FqePKPxMW+t/brsUbJDdCfNmKVSQPHX 49KMKl56VB/ixQujR9OIR25jAvAdkpaxnkh4eTsKQMlOU8Z8t7PJMlK0md5jy4KorX10 smEvOLahzUGHDt6DDe1b5HW+dptxljpmWS/P4+OgEjvsLFx3H+0OtU0f5T5RbXmOHXvX hy9tz82qKBgeqMJ0aAN1Jy4rWIKn1Rj4lZvOScqfr5NuJTGq7sXQD5sM3UaaJJDGcHKa mkSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693749060; x=1694353860; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=yIiH7TWstI3FA8hJirGKCUFvbBfKOKCQsJ66pm4U/ts=; b=LZOT1GZxWiTc47eh+ScRBtQUFLGIaB31O+fcuAwXCs+iD3vH+kGfF9mM5n7SROdCnD W21iLJK4kgCtAY3wpDCjRmGdU9pqR5kskE+XdjDHVL/7D3e6ifQzGxj7egGImW4X8YW7 g2RpSaqC3AajLBLepEHDiB4Wd9lJPLLm3wc/DUiUasgpK9V0nIavylP66nEQr3N8EKt5 hYu+yzFTeI78BGeZpC1CTC1JDOej/j38PpQMv3+8NpbQvlE1e0VMm6NswFc+0k8+ITYY Jv4GuwTVbo7RO1/nmVgtLmvwjxYDS7ZeoPF7moWEkFejW5WEChJhEicUwE53ymbjBbs6 oljA== X-Gm-Message-State: AOJu0Yw+gIIT++yVnkZoAzx9qsgJAG0Ft/nJ/35b1DrMvQrq/AsxrsIV YPWBo99MJ4GjCgQbk14icWQCHGjSPUkG6g== X-Google-Smtp-Source: AGHT+IGeB8fXkHObZc121eYsFukRARylr9NTIvfjknKRIfgTbyDUgl380bRvnJ9UZGR/nF+1F2PD0g== X-Received: by 2002:a17:906:27c8:b0:9a5:bd92:48f with SMTP id k8-20020a17090627c800b009a5bd92048fmr4826267ejc.77.1693749059876; Sun, 03 Sep 2023 06:50:59 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id e7-20020a170906248700b0099cc15f09a0sm4777949ejb.55.2023.09.03.06.50.58 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 06:50:58 -0700 (PDT) Message-ID: Date: Sun, 3 Sep 2023 14:50:57 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: kernel 100% CPU Content-Language: en-US To: Juraj Lutter , Mateusz Guzik Cc: FreeBSD-CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> <79A8D994-65F0-4E5C-9713-8A1B6122DB00@FreeBSD.org> From: Graham Perrin In-Reply-To: <79A8D994-65F0-4E5C-9713-8A1B6122DB00@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RdtTM0r7Tz3fVy On 03/09/2023 09:01, Juraj Lutter wrote: > … The script mjg@ provided is not a shell script. > > The script filename is “script.d” where you should put the > above-mentioned DTrace script (without the "dtrace -s script.d -o out” line). Thanks, I guess that I'm still doing something wrong: root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeBSD/kernel-cpu # time dtrace -s script.d -o /tmp/out dtrace: script 'script.d' matched 4 probes ^C0.246u 4.049s 27:25.70 0.2%   14+91k 261+0io 274pf+0w root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeBSD/kernel-cpu # cat /tmp/out CPU     ID                    FUNCTION:NAME   3      2                             :END root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeBSD/kernel-cpu # From nobody Sun Sep 3 14:02:56 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdtl54fHFz4rg3v for ; Sun, 3 Sep 2023 14:02:57 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc31.google.com (mail-oo1-xc31.google.com [IPv6:2607:f8b0:4864:20::c31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdtl54DTtz4FwT; Sun, 3 Sep 2023 14:02:57 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oo1-xc31.google.com with SMTP id 006d021491bc7-57361de8878so406646eaf.0; Sun, 03 Sep 2023 07:02:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693749776; x=1694354576; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=G/sPjHh2pZ0tF7yhUEKlFmiWS5gJlgxP5ZWTg89e+jo=; b=KdguBHzbAjsIuoEEzzfuF9CJW6LnrNq3gmARU5K8CJoErARWmNy6Td80/NXfMnXLnq OgK/MuyblhAE05so6AdjvUv9T1RAYGePaYk+Ok4+oACuNQEau9P5MhW8raMTQvQ2Xn9W D1GddDX83ONXGu9SiJqH1Musog8cFnKVnq+gNA3vddjZFi50bCcCcll42OgpsUJ0M/3o 4Kvr4jVUtMTWH1NndzS83yODUZg+/8cukCDQ1NHXGCWhrNDha8+UeVoxgNmJyRkvopxU kw8HDaMp00xgYhFaVT1G3e6T1P5MupoYa075BKmiTG8nyRI/B9vqAUYso6J/mBbPWZfU Teuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693749776; x=1694354576; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=G/sPjHh2pZ0tF7yhUEKlFmiWS5gJlgxP5ZWTg89e+jo=; b=KAdQ+NPQaex6SmpPfwpjtNNP092EbWMn9JCBfJaBqi6oXXBVcenalVWljq0Vnc3hWX R+uFupU1nBIUWe+cB28rkzyr6ngDAOeLRynrvLCdljE7vlTw9u1nRT3R6SnWcPoPwUTY Zj0Lt7VeWDrxLXhCA8wxO2IyQByBQD1mCdFrUpsUC0ILg51HA2SvvJ1x1hMWZnBLy4cO BPMYXJDEyYr3FjsCBkclzI3ABYmjhfBx+oEjS7EfNB1pLsnMLUJk8WXMfhn7vVjMK8mx CiOgqMFHvgSWhIFSkoaHrd+DbO/nV0DT4+KOqYwQrwzMpiqzfUjaqMUGsAR0nJNGif+m MMWw== X-Gm-Message-State: AOJu0YyzfG/C/47vYZbLjSE/Fd6q45IN6canhV30ysH7xa9Fbw2w1Nq5 57OFMQg15dbrHpmXKjpg6Y/hkXNUc1H0m8ZEIRHxljUjkdY= X-Google-Smtp-Source: AGHT+IFsXjBSjio3IVrcHYBhTNV20fsofCkPG4y70N5x3fDQmzCO40HjTVinhOTlsjerQg/E8grLzuicB1hiHulOBdE= X-Received: by 2002:a4a:3906:0:b0:573:2ac5:43b4 with SMTP id m6-20020a4a3906000000b005732ac543b4mr6182762ooa.5.1693749776561; Sun, 03 Sep 2023 07:02:56 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:60c:0:b0:4f0:1250:dd51 with HTTP; Sun, 3 Sep 2023 07:02:56 -0700 (PDT) In-Reply-To: References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> <79A8D994-65F0-4E5C-9713-8A1B6122DB00@FreeBSD.org> From: Mateusz Guzik Date: Sun, 3 Sep 2023 16:02:56 +0200 Message-ID: Subject: Re: kernel 100% CPU To: Graham Perrin Cc: Juraj Lutter , FreeBSD-CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rdtl54DTtz4FwT On 9/3/23, Graham Perrin wrote: > On 03/09/2023 09:01, Juraj Lutter wrote: >> =E2=80=A6 The script mjg@ provided is not a shell script. >> >> The script filename is =E2=80=9Cscript.d=E2=80=9D where you should put t= he >> above-mentioned DTrace script (without the "dtrace -s script.d -o out=E2= =80=9D >> line). > > > Thanks, I guess that I'm still doing something wrong: > > > root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeB= SD/kernel-cpu > > # time dtrace -s script.d -o /tmp/out > dtrace: script 'script.d' matched 4 probes > ^C0.246u 4.049s 27:25.70 0.2% 14+91k 261+0io 274pf+0w > root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeB= SD/kernel-cpu > > # cat /tmp/out > > CPU ID FUNCTION:NAME > 3 2 :END > > root@mowa219-gjp4-8570p-freebsd:/home/grahamperrin/Documents/IT/BSD/FreeB= SD/kernel-cpu > The script is intended to run when you have git executing for a long time. --=20 Mateusz Guzik From nobody Sun Sep 3 14:21:56 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdv9G4g2hz4rm8T for ; Sun, 3 Sep 2023 14:22:10 +0000 (UTC) (envelope-from garyj@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdv9G16gfz4KsS for ; Sun, 3 Sep 2023 14:22:10 +0000 (UTC) (envelope-from garyj@gmx.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1693750916; x=1694355716; i=garyj@gmx.de; bh=0ZQpV5UxsZiMZJNcjw3Ydsu3U7T8dO3l5eljxNnpp98=; h=X-UI-Sender-Class:Date:From:To:Cc:Subject:In-Reply-To:References:Reply- To; b=ol+lYipJvDUPPqOiuZiMHitPtRtSpTI9c7L6+f5D6oO5/GPOKYzp2ZWnde2chUWXQgRCGDs BxFsEWl5XDzIzJBSve1lVFGFc4/bM3WkLW10BX//YsFOK0PUoQKPgMpaCkfL/cUuyCzlO7vQk kxX0/dBxaL7ieQZakfExqlORslZqkmSY3ZduwuQzVxzZoxB8XowcLfUE+rD3fNvBOAYT5u32P RtC0vCx1Xe8AbRAxlfg+XF5+n3/5S3cSEq/1JQXwcoT/ES67P4opTc9TgNzKvnkvxFpVXMHt9 HxzH753V3WcCcDbQDrd//Fr9kGKzs31ZIKCghSa/uCJzXwZ07WRQ== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from ernst.home ([91.59.229.79]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N4z6k-1pc4Qa1fHg-010qam; Sun, 03 Sep 2023 16:21:56 +0200 Date: Sun, 3 Sep 2023 14:21:56 +0000 From: Gary Jennejohn To: "Herbert J. Skuhra" Cc: current@freebsd.org Subject: Re: FreeBSD-15 kernel panic when the amdtemp device is in the kernel Message-ID: <20230903162156.1dc3e99b@ernst.home> In-Reply-To: <87h6obtmz3.wl-herbert@gojira.at> References: <20230901130314.460f91bf@ernst.home> <20230901162336.542a1b91@ernst.home> <20230901164321.3259afd9@ernst.home> <20230901180534.0f3f3f6b@ernst.home> <87v8cshf2z.wl-herbert@gojira.at> <20230902180203.58f1a729@ernst.home> <87h6obtmz3.wl-herbert@gojira.at> Reply-To: garyj@gmx.de X-Mailer: Claws Mail 3.19.1 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:NZQy3F1a8pazkOikrCUUwjpxoxj8UkQPGj3rhPn1EgLdaQ0DSH4 EI9O3ZNSibHdwePBpWOuSycPVn5TAvRowdrJN+K2h8Rd1zfon/E3D1cLFaynSht81mXFmXE 3NnnpAbXokzcuhA2hnhijx7Btd4vIYOANy+hoaSFnp7rOEiCS4HvsYzwpxp4/bAWsD+6AuZ W64ze2pnE0Xlzz1W0oO5g== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:XIhf9KbhXLA=;97f6AvZHe2GhiWVuHYtOFnbsiJl vsnacdJSNI5qjBzWpz8W03fpS52nh/20NCwJBeE0h/L6wN4Kj/i9scjAVREOO4g6uRYdz99VJ tUri+KMyfniRyIrCx/KH+wfjYM01Kwm/q91fn0fsBQmpQmBD+sHnGZSjiQP+Lecm3jVraE2Xi g30f6Hgp7fI39gFYUV2AKh1cumPz+ABpjBsEh/5b8LcxZXemoBeUH6DC/QS6mVUmQVzealHci fblFVen9Reyzy7WmAKf/DbbqYETxhyN3kcIkGyg9nN3PqUrRoC7M6xcd0EJuaNTUZAbi33jXT E2AWPllIrYK6NCZb7iLvWoaF1ZU1bbIDEPwFv1HNN6hvo964GzOK5gYja8yxO8VnR9rtinwdB gsjhB5LVnVRh+vfvRY2AlhtvKN8XTqRXGg50qfq+7KlN2gkR3SEdo0qG9/UiwP8CL6rH+0gbX 0fXAOiPA4cj5CmRq9Af4J1awiVtNghXGEbcTpu9AlkGQjqzk/u4N39w2wESqadbNtxfCIisHJ wIYoHcn9K9H/ZPpqFnNLwpVMyUyIzGaj/aUe7EoG3OM4tWuHtiHE6EgJiwra6lY37FvcduS9l CEPTCPlRPYBp2wXn3P/HA25tt2XFdZsXc/sqUNCkHA0g99zVERLHRGZOIBwacHpEIO8c6n9L6 O9wZQu2xAltFtO5xz/lPUMJNcNAiVSS5NBvPsv37eYsT3IUuDzPDfVeWk/TLPHz0W1YgmjkUy gkGAMBd3V8EsWoAnJKzCwjXQxTwmH8JhR2O+jxRhpfilLHFgd8VGtP9PAq01D85VioJE8fNh2 VHNnzhcDYQ5bK/yWcoguPAMa0WClD/dY79n5CBRnoSG6l8WDHxdgldbiDFppAOYzYWW3HqBgL XNH9OfVcfbhwt+MiOchm5BNW3aDmNWDmq9SBWYRaJ9HjW+VOaUCAGwp+DDM8fwveA1ICUThmO ZNdIejjlOclwpLpSAa5oFcprCLs= X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Queue-Id: 4Rdv9G16gfz4KsS On Sun, 03 Sep 2023 15:17:36 +0200 "Herbert J. Skuhra" wrote: [SNIP] > Probably best to file a PR: https://bugs.freebsd.org/bugzilla/ > Bugzilla 273543 =2D- Gary Jennejohn From nobody Sun Sep 3 15:27:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rdwcb5cdWz4s5bW for ; Sun, 3 Sep 2023 15:27:27 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rdwcb3FVPz4VMP for ; Sun, 3 Sep 2023 15:27:27 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x529.google.com with SMTP id 4fb4d7f45d1cf-52683da3f5cso813461a12.3 for ; Sun, 03 Sep 2023 08:27:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693754844; x=1694359644; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=TPwQ0S6WjXKLlSTBlsRjE6VFSbDNluqYsb/GDRar74M=; b=hfXsQIF8BNisC70dxXgSu970REutmSF3pSrfr77vrtNCWKul4FhIMMNzC0T79jR7ao g2X/2JrE10Jecba/Ql1igA/nle9cidDII+K/KIHur7KtHtMbf71bwX1eQs83rzJnpA+P pcWAd0qBiJPg3L2DSxZjCEQB3vKkhjpqRpq1SsGyA/1f5ZNzQ5is9trCBcagD+9qRoSE UyZgOL+aaKLwe1xR+aHQw4+zAT5YAiHAm0Ct7z65kSlsY3nwKTeWaM6zEFo5BmOUBfna P+s6TGjLWErqffZ7ui24VzDwFm3sYYFBOrj0cskt/FqtIekAni/7A1u9i5/rY8m09Fp+ yOBQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693754844; x=1694359644; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=TPwQ0S6WjXKLlSTBlsRjE6VFSbDNluqYsb/GDRar74M=; b=O9CWLI+S6QL3/NOeb+d4cHqkIqb5nX46xQLKd+BLAzqWJJj6ZrgthTXq3nlitR3Ivj 3D1am5vYSOGYSikp0/E+8p0RSLiADMGH6iKkS9u4lAAz4Ln2cYcK2sDvbUw3QXxI6r0D oix6e9fc8TBpBkO0fl4taTidMpSDk98X0/eML8BIHYn9XrYeGGHn05aZe2mjekdiVvYZ /pKS4WeUJh+CFEW9l8LltYbF/b6l1oK0/QNUU3jeiL+ZiGBpA0KDvLICkcQhTbGGyq9Z 9B5xMt1hZyoPm6WkiNc5At/M72atOny52LFfaH32++dOCtHsDuFhuc8LDwwXBUAW78Nh IhMw== X-Gm-Message-State: AOJu0YxCy0l8RuCN+o93YPn6OygLk0jhrcwNrSzQItZN3o1FAf80gKUm 0EfC4++L0w9f9+1OvqDN41M= X-Google-Smtp-Source: AGHT+IE1vuWeDjMoHwmUx/BzanbmVAjQS+gp/O0tmFTzC3YpXV9qAVXJBafL04ZQDJYF3HbCRe21Ew== X-Received: by 2002:a05:6402:1515:b0:52a:1d6c:3127 with SMTP id f21-20020a056402151500b0052a1d6c3127mr4955187edw.17.1693754844053; Sun, 03 Sep 2023 08:27:24 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id w11-20020aa7d28b000000b0052565298bedsm4621037edq.34.2023.09.03.08.27.23 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 08:27:23 -0700 (PDT) Message-ID: Date: Sun, 3 Sep 2023 16:27:22 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US To: Mateusz Guzik Cc: FreeBSD-CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <79114b6f-9fe1-2e76-55be-a27cf8c178bf@gmail.com> <79A8D994-65F0-4E5C-9713-8A1B6122DB00@FreeBSD.org> From: Graham Perrin Subject: Re: kernel 100% CPU In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rdwcb3FVPz4VMP On 03/09/2023 15:02, Mateusz Guzik wrote: > On 9/3/23, Graham Perrin wrote: >> … > The script is intended to run when you have git executing for a long time. > Ah, sorry for my poor understanding. Re: , I ran it at a time when the symptom (kernel 100% CPU) was observable without a recent run of poudriere-bulk(8). From nobody Sun Sep 3 16:02:56 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdxPg3s33z4sGmP for ; Sun, 3 Sep 2023 16:03:03 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdxPf2L9Cz4dBx for ; Sun, 3 Sep 2023 16:03:02 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=Q+wBY0aS; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::52b as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-5298e43bb67so1455842a12.1 for ; Sun, 03 Sep 2023 09:03:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693756979; x=1694361779; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:content-language:references :to:subject:from:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=D1MN0W6E8sWoFxEaWOTwl+UJarN9TOaETOVmY3N0zNI=; b=Q+wBY0aSwLUndN8qZ1RfQUgbpKDDYzRWfQ+ZoYrR5UcEt81R4XKZbS6nQvb4U3Qdsz KpQkjEXyAOqTtrSCgYB/2g+5SSfETxol3Poo4aD75bkuqDyA5xXto/fPN+IvMqV/j6BR jhJnUvLP7USLqlI72VK/rM0WioaMWyNY1WZluFS8MUFzxzxC+duakFF3JdZiqdKwAy+7 hJ5RrhVFp/7HZR5iTY+yYOd/5x0kImiRpYbfA4ECrdicWUmGa/ZhhyTVp1I7psfU/MR4 eGkNjv3H7IgsdsVD9eItugh0rV4Ql/epv19UUuBqSp8sObP+wtQrfTE4KUHSOuuCZJuM d7Qg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693756979; x=1694361779; h=content-transfer-encoding:in-reply-to:content-language:references :to:subject:from:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=D1MN0W6E8sWoFxEaWOTwl+UJarN9TOaETOVmY3N0zNI=; b=Vz04pZN69cQYBCILAH2nQt6F8zIMceVWfIFuOI7jIdHiqngn2FKXsZBG0QG1drdsLo hhUN7sEhit0ML9WX1qcKsb4y65AYQW2XCWlu7aGcdVyk9w5E3UkzD9wA0FnhpzUbQjCE Kn3MGs4DAna7XwfpiTgFeyuy5GG+OHBiLZIqrJLrZ+F5crVbANGkLxDP6BQ56sxnyACI AhhZT4cg7PL02UfyXt/GTgunC5h+5tvalfR8T317wky2eSY7+wGZHd5/p2VmBQ9xxGTT leVkYSonkjcZhje2UF53ddYVufow4ZtmssyrlGqf2UcFlbBQ+6aMeVC/pKvJQ8VYSBdm xVJg== X-Gm-Message-State: AOJu0YxlqDaEsbyT4nhuyEm4v8lIUDNzsNT7JLAP1GCfUbhJsTFZcVe4 h8C9ZWzmMIeYHu/nyT2xAOHBawpb4pw= X-Google-Smtp-Source: AGHT+IFtAOO/o1Ja9Q+Lq1ebpNIOQEqsZjb/bntBgmyOBWpddcIw0pSL1FK7S9zCySL0oaova0pVXA== X-Received: by 2002:a05:6402:120c:b0:521:ad49:8493 with SMTP id c12-20020a056402120c00b00521ad498493mr8322208edw.6.1693756978939; Sun, 03 Sep 2023 09:02:58 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id f6-20020a056402160600b0052544bca116sm4650471edv.13.2023.09.03.09.02.57 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 09:02:57 -0700 (PDT) Message-ID: <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> Date: Sun, 3 Sep 2023 17:02:56 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 From: Graham Perrin Subject: Re: kernel 100% CPU To: FreeBSD CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52b:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdxPf2L9Cz4dBx On 02/09/2023 18:31, Mateusz Guzik wrote: > On 9/2/23, Graham Perrin wrote: >> … I began the trace /after/ the issue became observable. >> Will it be more meaningful to begin a trace and then reproduce the issue >> (before the trace ends)? >> >> … > Looks like you have a lot of unrelated traffic in there. > > … Instead, the two files from 09:21 this morning. Are these useful? Before this run of DTrace, I quit Firefox and other applications that might be causing noise (and the OS has been restarted since my last run of poudriere-bulk(8)). dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks From nobody Sun Sep 3 16:55:41 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdyZT2gQ1z4rHDZ for ; Sun, 3 Sep 2023 16:55:45 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oa1-x31.google.com (mail-oa1-x31.google.com [IPv6:2001:4860:4864:20::31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdyZT0nsBz3KV9 for ; Sun, 3 Sep 2023 16:55:45 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oa1-x31.google.com with SMTP id 586e51a60fabf-1bba7717d3bso570679fac.1 for ; Sun, 03 Sep 2023 09:55:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693760142; x=1694364942; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=m0G+CPYInGt4m7TP37HT/bCs2gQg+0PGUFP5wEx077k=; b=cdbjlx2B7QTr3m9Z+cDfcIG9iutP/EqxButCfQhTSgYsdrw5Pj1sIWmmExPJzUX9v4 0RYo5Z7FQS1EFeV2EBKRVEhp2V3QegHftCKuUZAhiIK6B2wo1oOwOKghccJciw5Q9ibS Yb8LXW3QoImZgp+uPxARzIzOdR6PUKlomgC7EsXN/RzW0Ve/gCnUXprs+Y5vdewp+lPd fFagYzcAc0PS8VSNqVSXLb7mNgeFJlCelOBWrBbXzsGU5ELV+OixPVo2izzk8+XkJkkr CyeSUnzoyg+dV7WTWDzO7SimtWB7qDUvWlfYAQFgXf2iqNpKM/PvUBxlQyA4cuoLOn2m 7bag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693760142; x=1694364942; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=m0G+CPYInGt4m7TP37HT/bCs2gQg+0PGUFP5wEx077k=; b=Fl9U7Zfummv7SHykQNUuMbkKlYKOJrgcHdbb54VTAmtvQ8DMUipV8yOEt1w+OIBLyy a/n/usqWEnyWL+G3teMeXYxYoNCRMT5Gu1U40AJG8zFSjHuqpMhRvKRFAy6g1ILio3uQ hukKwCyGIZ83+2+FFXlhRF36vCBgCmnDPL6gK5fu52Xu6y1O+6b089XTTAveTyKHIsUr GzAejc5nbfVQv/w78WfH4SRFHu3o82Ex+8bZnKNJFQrARW4nENWA9mEP6oJaa/iaHnL8 3ZJCRGziffm83jndy4mI94ZkePyk3WXyVW38ZR5cUxtS8iEHBCXtNYFRVwzuCEBZYwsA HUwA== X-Gm-Message-State: AOJu0Yxc/K2ApWy1YPv+WDZWfKPvZuHtJ0TZlRsHzi7L5JqXBnvqivim xK9CyHs+eKn0elaSHaVX5KMTV+G9HOOIeHP5eGA= X-Google-Smtp-Source: AGHT+IGiH7N42AUTSMANtnZ8FTlcrxFca1x7giIDnZk3yHo6X5Idle9cbDBDPqgOk+EVwzwjtLWNgPllLqxWC2FTAyw= X-Received: by 2002:a05:6870:658d:b0:1b0:2203:2bed with SMTP id fp13-20020a056870658d00b001b022032bedmr8775499oab.59.1693760142315; Sun, 03 Sep 2023 09:55:42 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:60c:0:b0:4f0:1250:dd51 with HTTP; Sun, 3 Sep 2023 09:55:41 -0700 (PDT) In-Reply-To: <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> From: Mateusz Guzik Date: Sun, 3 Sep 2023 18:55:41 +0200 Message-ID: Subject: Re: kernel 100% CPU To: Graham Perrin Cc: FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2001:4860:4864::/48, country:US] X-Rspamd-Queue-Id: 4RdyZT0nsBz3KV9 On 9/3/23, Graham Perrin wrote: > On 02/09/2023 18:31, Mateusz Guzik wrote: >> On 9/2/23, Graham Perrin wrote: >>> =E2=80=A6 I began the trace /after/ the issue became observable. >>> Will it be more meaningful to begin a trace and then reproduce the issu= e >>> (before the trace ends)? >>> >>> =E2=80=A6 >> Looks like you have a lot of unrelated traffic in there. >> >> =E2=80=A6 > > Instead, the > two files from 09:21 this morning. Are these useful? > > Before this run of DTrace, I quit Firefox and other applications that > might be causing noise (and the OS has been restarted since my last run > of poudriere-bulk(8)). > > dtrace -x stackframes=3D100 -n 'profile-997 /arg0/ { @[stack()] =3D count= (); > } tick-60s { exit(0); }' -o out.kern_stacks > Post your "sysctl -a" somewhere. --=20 Mateusz Guzik From nobody Sun Sep 3 17:37:57 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RdzWK548lz4rV5R for ; Sun, 3 Sep 2023 17:38:05 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-lj1-x233.google.com (mail-lj1-x233.google.com [IPv6:2a00:1450:4864:20::233]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RdzWH4cF8z3RTZ for ; Sun, 3 Sep 2023 17:38:03 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="n41qig/d"; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::233 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lj1-x233.google.com with SMTP id 38308e7fff4ca-2bcb89b476bso9992211fa.1 for ; Sun, 03 Sep 2023 10:38:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693762679; x=1694367479; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=lAXl/Pkg4FidyAzqid0sX1BXnonHs6eGeI0NMdk/5Eg=; b=n41qig/dIPZmlHauLuHoRSvrM/PfZ78anH97xyKgXzaWbCx1YvwL7mcxdrHub6bwMG C7eVDSv0GaeGB188roW8VPJ6r9iQOKqggyfTcNtNBlW6NDJiCi27pe4dbWRy8LdfWFAw x/bLXQ3EX1NxSOXudU2e1QFsO8FPR0c4h8cFp1skTJ10oWCH+Ufymkde0Qt6pPhXDQjG MTcLEqC+VAkIYJbLPZYxBGds6sojVVHHuKtojSqzqyKSSmXnNettZ4JVdAOzp8FCKOV0 ARK98Jua8IUo2TlVe0CGjbs77P3BiY/OP0kaSEtjm7iVXIULkHmBYxCb8PpBxMXMyeXX klSw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693762679; x=1694367479; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=lAXl/Pkg4FidyAzqid0sX1BXnonHs6eGeI0NMdk/5Eg=; b=cfoa15goRoeCqCBXMf5arM/4fOlyzoSnDKFCebc9jSfGQVDaxTrke+quc3lkqN/xjG GxnVvZ0Zj22WMTYlbz32p4DkiCko+VdAf7cwq18E8mW6J2DLV2FIQhTUEAlMu44y8h/z jLm3UFB3gLhl+sgsZOGT0KaYy1XuumMzcFFMPVcgTC1SyoAyDRjfAUI1cgfe+vvReTmO IJNVnwRDBD/qW+UtkY0a+u4OaF9TQc0PY0BUbzN62qfp77oWT3wOBJRojKvbasPGhlZ7 iGJtUHQ8ydyGPa7jYOvx7wyD20Y/wDRdOxiUu8L+x2zUrwJW9NDKas5Y+LPU06j2vwPi MJuA== X-Gm-Message-State: AOJu0YzjJRlxzqjOca4q7VKFLOV98E+ordkB+slM+H8xgVMr4D9uWayu cv+ZBOsHUmYFo2TufsUyTupNR65nFjE= X-Google-Smtp-Source: AGHT+IEfIXCTZNe4ifyr7MqkTrq9l+qYnfiIoX5cc+F0tUTodU8q+uvN7+Sq2NS8uh7CIIv0iQ3TDw== X-Received: by 2002:a2e:9d45:0:b0:2bc:ffe5:54a1 with SMTP id y5-20020a2e9d45000000b002bcffe554a1mr5590527ljj.32.1693762679434; Sun, 03 Sep 2023 10:37:59 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id q6-20020a170906940600b0098e78ff1a87sm4990672ejx.120.2023.09.03.10.37.58 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 10:37:58 -0700 (PDT) Message-ID: <5528e510-2d79-ebc9-b3f4-79d5fb80f38f@gmail.com> Date: Sun, 3 Sep 2023 18:37:57 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: kernel 100% CPU Content-Language: en-US To: FreeBSD CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> From: Graham Perrin In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FREEFALL_USER(0.00)[grahamperrin]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[80.42.66.93:server fail,2a00:1450:4864:20::233:server fail]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::233:from]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RdzWH4cF8z3RTZ On 03/09/2023 17:55, Mateusz Guzik wrote: > On 9/3/23, Graham Perrin wrote: >> On 02/09/2023 18:31, Mateusz Guzik wrote: >>> On 9/2/23, Graham Perrin wrote: >>>> … I began the trace /after/ the issue became observable. >>>> Will it be more meaningful to begin a trace and then reproduce the issue >>>> (before the trace ends)? >>>> >>>> … >>> Looks like you have a lot of unrelated traffic in there. >>> >>> … >> Instead, the >> two files from 09:21 this morning. Are these useful? >> >> Before this run of DTrace, I quit Firefox and other applications that >> might be causing noise (and the OS has been restarted since my last run >> of poudriere-bulk(8)). >> >> dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); >> } tick-60s { exit(0); }' -o out.kern_stacks >> > Post your "sysctl -a" somewhere. > sysctl-a-2023-09-03-18-22.txt added to the MEGA folder is complete, including TSLOG-related lines. Alternatively, tslog under is automatically pruned to exclude such lines. Hopefully not excessively pruned. TSLOG is one of three things in a Git stash that I apply before most builds, . From nobody Sun Sep 3 19:22:29 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rf1rl1Z5jz4s4Fq for ; Sun, 3 Sep 2023 19:23:19 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rf1rk22PBz4Gqb for ; Sun, 3 Sep 2023 19:23:18 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=TJxVsT35; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 2a00:1828:2000:313::1:5 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net Received: from webmail2.leidinger.net (roundcube.Leidinger.net [192.168.1.123]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: Alexander@Leidinger.net) by outgoing.leidinger.net (Postfix) with ESMTPSA id DB6D1408D; Sun, 3 Sep 2023 21:22:29 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1693768983; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+pSJzOpvLA78NvvXJ50dTU4M1HrpOS/jaKTJar+mOpA=; b=TJxVsT35DHorPVa0feHzK36xW/FeJDqZxXWLUf2UtamFfIkw+/rlmHAIUMya87Q2yFsdRK ibxaowTbr5xETFPLBFK0+dnRPVgNvLHHtsyAI3+HVIomSYzAobxBEZbfVD2wYxc/9ul2+L vu54ZUPyfME16KzmYdkciA314p3VgdWkoNVTrRTSuuKA9YMxzDs2qliQiw2QLBaXbN3d0Q /HRdmlsJI+6QErN3WvvP0CuQbYQ/UAxNxXm7RvHAk+ky2a2GIxiiwU3pQQ9P1RUO1ZB13+ EiN9jt7Ry74zIXzMWwFKdEo8MPv7RLo5puKUbJvu/EpZgHg2Q267u7n4yKz8rQ== List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Date: Sun, 03 Sep 2023 21:22:29 +0200 From: Alexander Leidinger To: Mateusz Guzik Cc: current@freebsd.org Subject: Re: 100% CPU time for sysctl command, not killable In-Reply-To: References: <67616bb5b074851832053a0286c3c2fa@Leidinger.net> Message-ID: X-Sender: Alexander@Leidinger.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; RCVD_TLS_ALL(0.00)[]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rf1rk22PBz4Gqb Am 2023-09-02 16:56, schrieb Mateusz Guzik: > On 8/20/23, Alexander Leidinger wrote: >> Hi, >> >> sysctl kern.maxvnodes=1048576000 results in 100% CPU and a >> non-killable >> sysctl program. This is somewhat unexpected... >> > > fixed here > https://cgit.freebsd.org/src/commit/?id=32988c1499f8698b41e15ed40a46d271e757bba3 I confirm. Thanks! Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF From nobody Sun Sep 3 19:25:19 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rf1v502Jsz4s4q9 for ; Sun, 3 Sep 2023 19:25:21 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc29.google.com (mail-oo1-xc29.google.com [IPv6:2607:f8b0:4864:20::c29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rf1v45Hv0z4Hl1 for ; Sun, 3 Sep 2023 19:25:20 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oo1-xc29.google.com with SMTP id 006d021491bc7-573921661a6so511202eaf.1 for ; Sun, 03 Sep 2023 12:25:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693769119; x=1694373919; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=7sDDqkgg+i1u3ScTDpSb9m1/WWVKiBBZT+/nRsFgZPA=; b=arG7+ezofVQlu1vqpES0KzsdnGNSKCp0qep/TSOx94xWFSKjsCkbBFqiFcTbQuf72+ meM5yXYA4hTm2H/yu57IliE6XCLLjOnuFTIFiSteKzGBAhtu4YzLMr+vDxN3v7FQim1r gWLa9CrasjbSxyDeTBAN7JNrOSRTtDjuTlfREH7YRNf/zxzrj1vhd5CyEYVytRpctbps wDiq+rakx9DJdg8lt06yJguhohHmoBQME7Le/UkooIoBYAtFClbp2Nd/rOQyE7t59OiT n2ZGJ/qMmu0vgdpGDBaPMqMO8RzXCprV2cGt1Hke1KGo0IjbeQFdZ3hAsoD6Vx8vdBfN CHmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693769119; x=1694373919; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=7sDDqkgg+i1u3ScTDpSb9m1/WWVKiBBZT+/nRsFgZPA=; b=BySKNr+YtuDrXVFxZ/IX3dT6I1MvIF7S1mss0lahwn4UJmIaVxPKEvzkE3kS/DBFIv SpaZUHgsgmhIvVmbvO5XLrRD9ACL82SMzqZO3mK7XNl+owdqjszBwQ2GnM3ZfMH4XMz2 LNzXmo6LBR1uKaKiLDnykbKXz40w1+VUixpCQPAkxhzFqRQT7ixX7EVPnh4dwTrWaryP fySWJJektfPH4ZrshaYFhx33c4jbux3UvAEaNm7syptmttTMXlzZUEW+3trrIGNyOzJY b14sQj2T6lEUo834oa4o0jsNAkvv7IVmm+7F6i62BpD1oc2tzDliAjxANRezNqzzBFzF Py9w== X-Gm-Message-State: AOJu0Yx2LIEPAsFLhYLPv8QRqJbLd9qMFAPJrzTmM3YCXdXqwroeFfM0 cy8H1EClYL3YPnxurwhyINS6ceaouR2a2yzgmyA= X-Google-Smtp-Source: AGHT+IGvgDuPjUW80W8im1KF6/NMEcGx0L91F3SdZUcPvTPzrkLtlgssN58KeAwX6ksJSpvPvW0/8syAp2hxN7J/Aak= X-Received: by 2002:a4a:275c:0:b0:571:1fad:ebe2 with SMTP id w28-20020a4a275c000000b005711fadebe2mr5395027oow.7.1693769119670; Sun, 03 Sep 2023 12:25:19 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:60c:0:b0:4f0:1250:dd51 with HTTP; Sun, 3 Sep 2023 12:25:19 -0700 (PDT) In-Reply-To: <5528e510-2d79-ebc9-b3f4-79d5fb80f38f@gmail.com> References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> <5528e510-2d79-ebc9-b3f4-79d5fb80f38f@gmail.com> From: Mateusz Guzik Date: Sun, 3 Sep 2023 21:25:19 +0200 Message-ID: Subject: Re: kernel 100% CPU To: Graham Perrin Cc: FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rf1v45Hv0z4Hl1 On 9/3/23, Graham Perrin wrote: > On 03/09/2023 17:55, Mateusz Guzik wrote: >> On 9/3/23, Graham Perrin wrote: >>> On 02/09/2023 18:31, Mateusz Guzik wrote: >>>> On 9/2/23, Graham Perrin wrote: >>>>> =E2=80=A6 I began the trace /after/ the issue became observable. >>>>> Will it be more meaningful to begin a trace and then reproduce the >>>>> issue >>>>> (before the trace ends)? >>>>> >>>>> =E2=80=A6 >>>> Looks like you have a lot of unrelated traffic in there. >>>> >>>> =E2=80=A6 >>> Instead, the >>> two files from 09:21 this morning. Are these useful? >>> >>> Before this run of DTrace, I quit Firefox and other applications that >>> might be causing noise (and the OS has been restarted since my last run >>> of poudriere-bulk(8)). >>> >>> dtrace -x stackframes=3D100 -n 'profile-997 /arg0/ { @[stack()] =3D cou= nt(); >>> } tick-60s { exit(0); }' -o out.kern_stacks >>> >> Post your "sysctl -a" somewhere. >> > sysctl-a-2023-09-03-18-22.txt added to the MEGA folder is complete, > including TSLOG-related lines. > > Alternatively, tslog under > is automatically > pruned to exclude such lines. Hopefully not excessively pruned. > > TSLOG is one of three things in a Git stash that I apply before most > builds, . > Sorry mate, neglected to specify: collect sysctl -a once you run into the problem. Once I look at that I'm probably going to ship some debug patches to narrow it down. --=20 Mateusz Guzik From nobody Mon Sep 4 02:54:05 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfCsG3jtYz4s33d for ; Mon, 4 Sep 2023 02:54:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-21.consmr.mail.gq1.yahoo.com (sonic317-21.consmr.mail.gq1.yahoo.com [98.137.66.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfCsF2xYwz4Yv7 for ; Mon, 4 Sep 2023 02:54:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=PkW5Tkud; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.66.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693796063; bh=FBi+sagkiLrDYCRxnDMG7OVrvlPWEK3CGsS4k1wrEAg=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=PkW5TkudUBMeFcl9gx90AYOW3BEkjxxt2ykXcse6LzA+GSyVi1GSrPQRSMNIb21ZE1s62Ry/bhQR1bqfudgsaa/Gn5Mqlq7brBKs2OoqTr1l6fVZ5YlDMWNcyGWRIxKiQeI7R2c1lOXWYfPvMzJ2zCC5+Zg2crNDPfcy/c2/jQpK0PeXm1SGijlmxl/g7ykY8kggEeIk2ymHguKRaiDA7JUNfgiDT/4N8YWRolnEO4wFS2ZlR92Ge9eLP3wJHsTs8coEQ0xqPtwTzt0d+ssxPsvxwsL6BQZRGgltu6gvBhxdcW3csQhfGITUHith2Q5PViF9Ct269FR0UKB9Yn3i/A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693796063; bh=snKPMo7KCKLKHW0oxz7iZ/kXy9mpzaJgfBuLyAKPNq1=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=XWWRIJ6rDHPIQIXeWVts6P3/a0LdlTQrOanbO2cpp4/zbCv90DWDGYut5K3ZeJXnf4L7wSRxqEkL+Zn5eIu6Ek+BJtvZ1q4QkbX9zPkO0ygfpWWQh3BJib/tt3Mjp/4dJvCqUc8JJHinwUVeCs8Bol0/j3BL37u98BOQC8eeVNjhpqcGjcr0gSo0vy91asUBv4p/JUy9G62NZSFt2dSg8gk2KYoZ2tQXfq3IXM3jS1y4LWMIu1vTeluU9wgyYh8vp0qfaos54ccMOZSEfCLTRuCswN8p5/HRxk4Upmos0Gia5ArgjwxDJEseYal0lLUTR83DxvW9RLCynzDhMebg4w== X-YMail-OSG: RG38Y2kVM1n4vwBAirdHwtn_BtAWomD5bBVn5dLNHcgjm58Pc7ixDOPSgzpedaB pKDvjtGgtczssn0C2SaPCNk_O.oMC6ELquzVY8U9_.sk2nUORZ7aIEXUckr.ney5yJgzjoelqmtR HiSY4XH_GStmsoA3nENFtvI5E4A.7XkYK12ynh7cmhqcp5cJ4KDJnqaNqbOFZebO0f5f6Lo4JTIO clqzd.uicGOBOJeHGlmLEKIBIg4OKetx91YUOfkp.St7Ja5EHvDc0lJlG5JSFzBQ5S.S73nzD.Xu iWifH0RPOUamt9QnFyNRTbZ_bKrcYheXmoc4homdlqlKvOker8y7u9PodUuls7OdUuIdhjQIb.Sw hkPi1n.zc4MrDGaqmwC9IDhKqz4_tseerC8I1R78YzpHj70ngAQzJAXu15yxv6z.P1dqQn42wWlX UdqtiuIHKyi1QWA4epq8xk.AuvqvIDSVN2lngxw7OL.NQLxD9L.ZEzmJbFU04GeU93DZwaXNKX3z nmRTNwB7PZUveuNuUmDT2Jf9kqQMthln0VlijyuXgiAuwGthTV.ykOon9VvtVDVvN8sdgpCIACgb 8CCMkDUY2kt7.0IWBNqD3HSgrVk9NHwH0gV9A6pPNcy1QBE4AaKxTsvCtrBXqVxTzkJhnGMiieU7 nU8QXA.eYaaGRa0GewivQWsdC.NCdxYhteREXkPlJjfI5Z9usfSm3z.OvhbYVpfHv6AlIyaJmJYd YYfABw5ZT433u4Sr7i0ZvVYRnr09sNJbI1p3xGcZWfZ3HVHEqUoPm0.og9hie.Z4urAVdEGntH9C fE5nnj9RXV4vbN.fzqrdZ_ccdY3P3NTOj2XWDmXvA5.ZB1jb9yyzFW9YEKuna.MnQk54qijQaz9k AFhtLbuuQqIHoZfpf7q7_GZXbDeV440o2Rs_yVLdYlKlA2yv6PKjIxzMxgA.EpCgX507oMAAKs3J .IpNNosoC5wIeht_RKriGS3mrNHgz_648LvLCw0DvrpHehLOmV_GuPO7xs1Mhg1qp6LKACXkj0gK pHtp9Pce5Pn7EvTVg05fB9Uqembr006gA7Us_dpC90zKHEuI18.auTZFD1HqV_R5f7NOR8jRMqZD HhywoPfnfggOOxLa_o0B510OOUFClk5S7SWiWxItwn8O72dfGMlBFLRd8aTtz2JRQjO42m7EGoqS XT8v1kNq2nSS0dvUwxdP9DIapb4YjrcsqMlfVGiJrw_Gdb2z4_Gh9xviW7p.8ymvWPzusUskekWX geEjtSbzp12IcaTv0GaToqrn3qNJ.ME.NoiuXNebUaoMh0nlbH5YmlLj3hljHDkookKjPW2VbpDK R89p43uDmiHkOTVrkedfPbUGqGeiz81EItRDRHng85C2t4JJeRdc3nLIXhYbvwOUfsnleFmwaKMz rltEJz2YPihgughBC65uNPyycriyQvhbJD03fsdfJzGRPnx2zRIwvsvpfmdm0mKXJiQ.Aqzme7gq 9tyNcqEAimdu_ceFGZ555izatr4c0uO_wgkypQyTWZsJC8DTPQvKTq6oOjjaR.X50zS5usI4spp5 eNAkNNgq3Kem8x5ixTXeF48n_5pFBPgamHD3ZV5PiCXkLOQvkf3Q5KEwUftLr99wrwSerA7LCb_0 GAp2zScBzKGhIHkqKfNVdCR6fjkFeNVofvYWLjVrKCNTU7tt8VUq1ORK6KB3HkjNHTtc2wnFp3cc d1leWsvdH6T1.ha6RcwxvI8IKsCYMRkhlPcV.7M6b4BrBBR4IhfDIMW.32tUNM9Q._BC_b3zaZ5Q ex..Pc1xYiS9h0zfVJnn0pZtiyM291Fhfdnce3Lda6r0jvFXiRBDQERVTfPOG4gqLXqGjfBYSQyY aRV4uE_SA8dBWQKHc2d8U6pw.DP5rqG5iUkOcM8qe0vAie9a9sGMxvZopQ4cl43iS91A8WDG4maH h0iKvQ9WYfR0mNQHN3GmfL6QwdD6OpLSyccissH4.be.pw9EkD99AfeaTeEzxIopJ7tssvDskSEC g2TYcD8VeJY205y3msbTI26eQ2LNiW20saXuWgxdfVKPf1.1THqO.QhrbFd3FEd9D6gsxBzCRMpI dsViqc6M5121QoVrHew1Yh9kfZcwhBdrQovkZ3cRtz4GpvWuZSMm07NS1Xzawp9favirQ.vjNORf FQbUYMFdyOVueqqRac7zDCB3.4kCM_eWKE3REZENS15NVtDBRyw5dUnev_49JrPDvO_ntvVFpUhW C0aair0OLokPW71Ue5l2cldw93pjxtCB.JRpTemPaQhQvT5ML9X9LSUtBlRdMs246RJLHYxxf1AH Cgg-- X-Sonic-MF: X-Sonic-ID: 4c7d09dc-6a88-4746-b093-562acf119da2 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 02:54:23 +0000 Received: by hermes--production-bf1-865889d799-scr2n (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 49b8180b7d8a89330959be58be1b41d6; Mon, 04 Sep 2023 02:54:18 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned Message-Id: Date: Sun, 3 Sep 2023 19:54:05 -0700 To: dev-commits-src-main@freebsd.org, Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.147:from]; BLOCKLISTDE_FAIL(0.00)[98.137.66.147:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.147:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfCsF2xYwz4Yv7 ThreadRipper 1950X (32 hardware threads) doing bulk -J128 with USE_TMPFS=3Dno , no ALLOW_MAKE_JOBS , no ALLOW_MAKE_JOBS_PACKAGES , USB3 NVMe SSD storage/ZFS-boot-media, debug system build in use : [00:03:44] Building 34214 packages using up to 128 builders [00:03:44] Hit CTRL+t at any time to see build progress and stats [00:03:44] [01] [00:00:00] Builder starting [00:04:37] [01] [00:00:53] Builder started [00:04:37] [01] [00:00:00] Building ports-mgmt/pkg | pkg-1.20.6 [00:05:53] [01] [00:01:16] Finished ports-mgmt/pkg | pkg-1.20.6: Success [00:06:15] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 [00:06:15] [02] [00:00:00] Builder starting . . . [00:06:18] [128] [00:00:00] Builder starting [00:07:42] [01] [00:01:27] Finished print/indexinfo | indexinfo-0.3.1: = Success [00:07:45] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 [00:18:45] [01] [00:11:00] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success [00:19:06] [01] [00:00:00] Building devel/gmake | gmake-4.3_2 [00:24:13] [01] [00:05:07] Finished devel/gmake | gmake-4.3_2: Success [00:24:39] [01] [00:00:00] Building devel/libtextstyle | = libtextstyle-0.22 [00:31:08] [125] [00:24:50] Builder started [00:31:08] [125] [00:00:00] Building print/t1utils | t1utils-1.32 [00:31:15] [33] [00:25:00] Builder started [00:31:15] [81] [00:24:59] Builder started [00:31:15] [33] [00:00:00] Building databases/xapian-core | = xapian-core-1.4.23,1 [00:31:15] [13] [00:25:00] Builder started [00:31:15] [81] [00:00:00] Building devel/bmake | bmake-20230723 [00:31:15] [13] [00:00:00] Building devel/evdev-proto | evdev-proto-5.8 [00:31:16] [41] [00:25:00] Builder started [00:31:16] [41] [00:00:00] Building devel/pcre | pcre-8.45_3 . . . (Looks like lang/go120 ignores the lack of ALLOW_MAKE_JOBS . There may be others that still have signficant parallel activity.) [main-amd64-bulk_a-default] [2023-09-03_13h48m45s] [parallel_build:] = Queued: 34588 Built: 727 Failed: 1 Skipped: 40 Ignored: 335 = Fetched: 0 Tobuild: 33485 Time: 01:36:51 (So about 1 hr after the last "Builder starting" it had built 727.) The vast majority of the time: lots of cpdup's with tx->tx showing most of the time for STATE but showing having some CPU time. ^T commonly showed various Builders in starting PHASE for 3min..6min. Around 66% mean Idle time (guess from watching top). After ^C "gstat -spod" reports it is almost always writing 2200 to 2500 writes per second or so for *hours* (still going on). ztop reports 1500 to 3200 d/s or so almost always for Dataset zamd64/poudriere/data/.m instead (also still going on). Normally no other Dataset is shown. With all the disk I/O activity, this is definitely "live" in some sense. But I've no clue if it is just repeating itself over and over vs. if it making some sort of progress. For reference for the ^C and after: ^C[01:39:00] [20] [00:00:03] Building sysutils/linux-c7-dosfstools | = linux-c7-dosfstools-3.0.20 [01:39:00] [93] [00:07:12] Finished science/dimod | dimod-0.12.11: = Success [01:39:00] Error: Signal SIGINT caught, cleaning up and exiting [01:39:02] [63] [00:06:34] Finished archivers/unarj | unarj-2.65_2: = Success [01:39:03] [128] [00:07:47] Finished sysutils/shuf | shuf-3.0: Success [01:39:04] [113] [00:07:06] Finished devel/bsddialog | bsddialog-0.4.1: = Success [main-amd64-bulk_a-default] [2023-09-03_13h48m45s] [sigint:] Queued: = 34588 Built: 752 Failed: 1 Skipped: 40 Ignored: 335 Fetched: = 0 Tobuild: 33460 Time: 01:38:56 [01:39:06] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-03_1= 3h48m45s [01:39:14] [12] [00:09:07] Finished archivers/rzip | rzip-2.1_1: Success [01:39:14] Cleaning up exit: cannot open ./var/run/49_nohang.pid: No such file or directory exit: cannot open ./var/run/87_nohang.pid: No such file or directory After that ^t produced the likes of: load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k #0 0xffffffff80b6f103 at mi_switch+0x173 #1 0xffffffff80bc0f24 at sleepq_switch+0x104 #2 0xffffffff80aec4c5 at _cv_wait+0x165 #3 0xffffffff82aba365 at txg_wait_open+0xf5 #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 #5 0xffffffff829a87d2 at zfs_rmnode+0x72 #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 #8 0xffffffff80c5a7d9 at vgonel+0x3a9 #9 0xffffffff80c5af7f at vrecycle+0x3f #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e #11 0xffffffff80c598cf at vinactivef+0xbf #12 0xffffffff80c590da at vput_final+0x2aa #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 #14 0xffffffff80c68588 at sys_unlink+0x28 #15 0xffffffff8106323f at amd64_syscall+0x14f #16 0xffffffff8103512b at fast_syscall_common+0xf8 The console/logs do report "witness exhausted": . . . Sep 3 13:41:08 amd64-ZFS login[1751]: ROOT LOGIN (root) ON ttyv0 Sep 3 13:51:35 amd64-ZFS kernel: witness_lock_list_get: witness = exhausted Sep 3 14:26:38 amd64-ZFS kernel: pid 27418 (conftest), jid 245, uid 0: = exited on signal 11 (core dumped) . . . So it did not take long for the "witness exhausted" to happen. # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #74 = main-n265143-525bc87f54f2-dirty: Sun Sep 3 13:35:04 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 Looks like I'll be forcing the machine to reboot or to power off. The media was deliberately set up for doing risky tests. It is not my normal environment. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 05:06:46 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfGp12rx2z4rMWk; Mon, 4 Sep 2023 05:06:49 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x1132.google.com (mail-yw1-x1132.google.com [IPv6:2607:f8b0:4864:20::1132]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfGp06dNNz4s4f; Mon, 4 Sep 2023 05:06:48 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1132.google.com with SMTP id 00721157ae682-58e6c05f529so10175947b3.3; Sun, 03 Sep 2023 22:06:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693804008; x=1694408808; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=XBjPJraRZjbNo81Dg7oGngWW7szayA/9F2dZbfHQfdQ=; b=T7BbM1ZfxjtrcmU33eHqdhiYjvxJhy5MBKWSG6P6FOzOp+7CqklEVGQCTdpjeGFTdf pQyJXOI4sqnhBMMXEFpMlzMfJq6zGaancnJY/vl0xtKuqONwDyQL90MWHGPTVRqb0EKl TFc34VVzI7uZWP4DaJhlbTivyg44C2YCVpzaeRZhqMF4ExFYNsS2eDTT4MR0R7q9L8tM YS9wKpYqr5ahabO6gpabSXjFakUQM+duJV6fweH/acv87KBUF3IGm3v4l2VKJJHWh/In FeYp+eggTDZMcWwjz0ZhTny50VJ/fELvNu8DEI8c2hzTDMoFzDy26V162ZFLNIv65VZY AOTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693804008; x=1694408808; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=XBjPJraRZjbNo81Dg7oGngWW7szayA/9F2dZbfHQfdQ=; b=d3ja6pe3sgfQZBP7Jle1tWi2T3PUgtzOuWiIno5PCYE9mRazqPl5DfioCuFgCZXcZ+ buir0WeFqRm6ZtmCWyOMSNwTAG051xXbIFlBHFbiuKZlI/E8hcdHeLq/M/ywA5OmK+fo cBe7LZydNOfF82Cn/eoVx79JNZFRFATjzf0TVAQJAqSJQQuzAoYeTFQSVkPjwseFfJVi XW1YtvkD4ooY5GVFo+A3mmu1tY7BTpizQWSYDrsvlPiqubgAd3eqHwhV7Ql8QKtWScfl V1xO/sNNpjhC9zGG31iAGL3/OuBcU8ipPsQ7za7/B5JfNTuscAf1vMjup4I1VDs9t5aD KK9Q== X-Gm-Message-State: AOJu0YzHBlVN9444aTYCE8LvlIKFg81WWDqtC+IBBF1zoov7wxnF+52A 3CrQq2lZPRZCRXi22nAHxwC6wxL/kiR3nw== X-Google-Smtp-Source: AGHT+IEURq5mJx6dliGO6vrnZDnrj+D/zboaXVPr2Zc9JF4R8HfFa+oxn30QDQ7pjGoull77rG68gg== X-Received: by 2002:a0d:eacf:0:b0:586:a689:d28a with SMTP id t198-20020a0deacf000000b00586a689d28amr10943997ywe.34.1693804007907; Sun, 03 Sep 2023 22:06:47 -0700 (PDT) Received: from [192.168.1.66] (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id g185-20020a0dc4c2000000b00594e355aa78sm2455855ywd.143.2023.09.03.22.06.46 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 03 Sep 2023 22:06:47 -0700 (PDT) Message-ID: Date: Mon, 4 Sep 2023 01:06:46 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned Content-Language: en-US To: Mark Millard , dev-commits-src-main@freebsd.org, Current FreeBSD References: From: Alexander Motin In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RfGp06dNNz4s4f Mark, On 03.09.2023 22:54, Mark Millard wrote: > After that ^t produced the likes of: > > load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u 121.32s 1% 13004k So the full state is not "tx->tx", but is actually a "tx->tx_quiesce_done_cv", which means the thread is waiting for new transaction to be opened, which means some previous to be quiesced and then synced. > #0 0xffffffff80b6f103 at mi_switch+0x173 > #1 0xffffffff80bc0f24 at sleepq_switch+0x104 > #2 0xffffffff80aec4c5 at _cv_wait+0x165 > #3 0xffffffff82aba365 at txg_wait_open+0xf5 > #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 Here it seems like transaction commit is waited due to large amount of delete operations, which ZFS tries to spread between separate TXGs. You should probably see some large and growing number in sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . > #5 0xffffffff829a87d2 at zfs_rmnode+0x72 > #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d > #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 > #8 0xffffffff80c5a7d9 at vgonel+0x3a9 > #9 0xffffffff80c5af7f at vrecycle+0x3f > #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e > #11 0xffffffff80c598cf at vinactivef+0xbf > #12 0xffffffff80c590da at vput_final+0x2aa > #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 > #14 0xffffffff80c68588 at sys_unlink+0x28 > #15 0xffffffff8106323f at amd64_syscall+0x14f > #16 0xffffffff8103512b at fast_syscall_common+0xf8 What we don't see here is what quiesce and sync threads of the pool are actually doing. Sync thread has plenty of different jobs, including async write, async destroy, scrub and others, that all may delay each other. Before you rebooted the system, depending how alive it is, could you save a number of outputs of `procstat -akk`, or at least specifically `procstat -akk | grep txg_thread_enter` if the full is hard? Or somehow else observe what they are doing. `zpool status`, `zpool get all` and `sysctl -a` would also not harm. PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me shiver. Make sure there is no storage problems, like some huge delays, timeouts, etc, that can be seen, for example, as busy percents regularly spiking far above 100% in your `gstat -spod`. -- Alexander Motin From nobody Mon Sep 4 05:58:08 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfHxJ1cTMz4rWcW for ; Mon, 4 Sep 2023 05:58:12 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfHxH2g1Qz3Gty for ; Mon, 4 Sep 2023 05:58:11 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de; dmarc=none Received: from [188.174.51.238] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qd2bB-001mxm-6s for freebsd-current@freebsd.org; Mon, 04 Sep 2023 07:58:09 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 3845w8V4008325 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 4 Sep 2023 07:58:08 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 3845w8Vt008324 for freebsd-current@freebsd.org; Mon, 4 Sep 2023 07:58:08 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Mon, 4 Sep 2023 07:58:08 +0200 From: Matthias Apitz To: freebsd-current@freebsd.org Subject: Re: make-memstick.sh creates in 14.0-CURRENT run-away processes Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.51.238 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.46 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.66)[-0.655]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:178.254.4.101]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[unixarea.de]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; HAS_XOIP(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_LAST(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_XAW(0.00)[]; HAS_REPLYTO(0.00)[guru@unixarea.de] X-Rspamd-Queue-Id: 4RfHxH2g1Qz3Gty El día Freitag, August 18, 2023 a las 06:17:42 +0200, Matthias Apitz escribió: > > I was used to use in 13.0-CURRENT the script "make-memstick.sh" to > create memstick immages to install the system on smaller devices where > the OS can't build from the sources, and it always worked fine for many > years. Now I'm ready to do so with my fresh compiled system (sources > from git August, 5: > > $ uname -a > FreeBSD jet 14.0-CURRENT FreeBSD 14.0-CURRENT amd64 1400094 #0 main-n264568-1d7ffb373c9d: Sat Aug 5 17:22:47 CEST 2023 guru@jet:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 > > but the image is not produces and some processes create temp > files of 800++ GByte. Here are the details: > > root@jet:/usr/src/release/amd64 # ./make-memstick.sh /home/guru/140.root ~guru/memstick.img > Calculated size of `/home/guru/memstick.img.part': 23795073024 bytes, 263113 inodes > Extent size set to 32768 > /home/guru/memstick.img.part: 22692.8MB (46474752 sectors) block size 32768, fragment size 4096 > using 27 cylinder groups of 869.44MB, 27822 blks, 10240 inodes. > super-block backups (for fsck -b #) at: > 192, 1780800, 3561408, 5342016, 7122624, 8903232, 10683840, > 12464448, 14245056, 16025664, 17806272, 19586880, 21367488, 23148096, > 24928704, 26709312, 28489920, 30270528, 32051136, 33831744, 35612352, > 37392960, 39173568, 40954176, 42734784, 44515392, 46296000 > Populating `/home/guru/memstick.img.part' > Image `/home/guru/memstick.img.part' complete > Creating `/tmp/efiboot.iFachZ' > /tmp/efiboot.iFachZ: 65528 sectors in 65528 FAT32 clusters (512 bytes/cluster) > BytesPerSec=512 SecPerClust=1 ResSectors=32 FATs=2 Media=0xf0 SecPerTrack=63 Heads=255 HiddenSecs=0 HugeSectors=66584 FATsecs=512 RootCluster=2 FSInfo=1 Backup=2 > Populating `/tmp/efiboot.iFachZ' > Image `/tmp/efiboot.iFachZ' complete > > It says 'complete' but never ends growing the file /tmp/mkimg-oGNnFb: > > root@jet:/usr/home/guru # ls -ltrah /tmp | tail -6 > drwx------ 2 guru wheel 512B Aug 18 15:43 tmux-1001 > -rw------- 1 root wheel 33M Aug 18 17:18 efiboot.iFachZ > -rw------- 1 root wheel 0B Aug 18 17:18 mkimg-4eMWKW > drwxrwxrwt 21 root wheel 1.0K Aug 18 17:18 . > drwxr-xr-x 22 root wheel 1.0K Aug 18 17:43 .. > -rw------- 1 root wheel 850G Aug 18 17:53 mkimg-oGNnFb > > root@jet:/usr/home/guru # ls -ltrh mem* > -rw-r--r-- 1 root wheel 22G Aug 18 17:18 memstick.img.part > -rw-r--r-- 1 root wheel 0B Aug 18 17:18 memstick.img > > Only a hard reset and reboot helps. > (Sorry for the delay, I was out for vacation) The last part of the script ./make-memstick.sh which should produce the final image, but the processes mkimg never end, is: ... # Make an ESP in a file. espfilename=$(mktemp /tmp/efiboot.XXXXXX) make_esp_file ${espfilename} ${fat32min} ${BASEBITSDIR}/boot/loader.efi mkimg -s mbr \ -b ${BASEBITSDIR}/boot/mbr \ -p efi:=${espfilename} \ -p freebsd:-"mkimg -s bsd -b ${BASEBITSDIR}/boot/boot -p freebsd-ufs:=${2}.part" \ -a 2 \ -o ${2} ... I've split the two processes, connected my the pipe, and run them one after the other as: #!/bin/sh # set -x BASEBITSDIR=/home/guru/140.root img=/home/guru/zdata/memstick.img espfilename=/home/guru/zdata/efiboot.7S9yjL mkimg -s bsd -b ${BASEBITSDIR}/boot/boot \ -p freebsd-ufs:=${img}.part > ${img}.part.mkimg mkimg -s mbr \ -b ${BASEBITSDIR}/boot/mbr \ -p efi:=${espfilename} \ -p freebsd:=${img}.part.mkimg \ -a 2 \ -o ${img} # ls -l /home/guru/zdata # -rw-r--r-- 1 root wheel 23795073024 Sep 3 17:12 memstick.img.part # -rw------- 1 root wheel 34091008 Sep 3 17:12 efiboot.7S9yjL # -rw-r--r-- 1 root wheel 23795081216 Sep 3 18:25 memstick.img.part.mkimg # -rw-r--r-- 1 root wheel 23829172736 Sep 3 18:34 memstick.img The resulting file 'memstick.img' (copied with dd to an USB key) boots fine. Now I'm clueless about why the pipe between mkimg ... -p freebsd:-"mkimg -s bsd ..." ... does not work as it should. matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Sep 4 06:19:47 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfJQY1kN5z4rc5v for ; Mon, 4 Sep 2023 06:20:05 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfJQX0q86z3Kq7 for ; Mon, 4 Sep 2023 06:20:04 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=P6JL3Efr; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 89.238.82.207 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net Received: from webmail2.leidinger.net (roundcube.Leidinger.net [192.168.1.123]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: Alexander@Leidinger.net) by outgoing.leidinger.net (Postfix) with ESMTPSA id 0313F5BCA; Mon, 4 Sep 2023 08:19:47 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1693808391; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=rZOtwYh4cvys9Ia+1x3htx8mNOAYye1ecY9rMwg4u+M=; b=P6JL3Efrlu38GP5UMoIbMZ8LsFd1U8UXSfcOd2quf0nbSRO0bZfarjd53NjYqnFX6gM9A8 g93pQU49Ndvi/oztp/Lq7SGaPlTjKWBHvxPVUreOiD3cRsZ0tw6FaZGr6f5+8iusPRieox M3QQu9gTYgbj8IDDcrUy3m5ByehMJgFDSYYrCTZUyYeT//9gEJI9nitgtuS9SH2jHd399A 4+iWPtOxoObfBXyXubmF479K+to7zPkAZoEpDdm/RYAPPn1bEk+oy8Fo6tdWwcDChpXbQY 1ThRgZePqat6l+vExDOiVe/RbXTFyXQQpln3E3oHsdlwtG3Xq7SZthSvczLZpw== List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Date: Mon, 04 Sep 2023 08:19:47 +0200 From: Alexander Leidinger To: Mateusz Guzik Cc: Konstantin Belousov , current@freebsd.org Subject: Re: Speed improvements in ZFS In-Reply-To: <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> References: <88e837aeb5a65c1f001de2077fb7bcbd@Leidinger.net> <4d60bd12b482e020fd4b186a9ec1a250@Leidinger.net> <73f7c9d3db8f117deb077fb17b1e352a@Leidinger.net> <58493b568dbe9fb52cc55de86e01f5e2@Leidinger.net> <58ac6211235c52d744666e8ae2ec7568@Leidinger.net> <444770b977b02b98985928bea450e4ce@Leidinger.net> <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> Message-ID: <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> X-Sender: Alexander@Leidinger.net Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.90 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; RCVD_COUNT_ONE(0.00)[1]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; MLMMJ_DEST(0.00)[current@freebsd.org]; MIME_TRACE(0.00)[0:+]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; RCPT_COUNT_THREE(0.00)[3]; RCVD_VIA_SMTP_AUTH(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4RfJQX0q86z3Kq7 Am 2023-08-28 22:33, schrieb Alexander Leidinger: > Am 2023-08-22 18:59, schrieb Mateusz Guzik: >> On 8/22/23, Alexander Leidinger wrote: >>> Am 2023-08-21 10:53, schrieb Konstantin Belousov: >>>> On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: >>>>> Am 2023-08-20 23:17, schrieb Konstantin Belousov: >>>>> > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: >>>>> > > On 8/20/23, Alexander Leidinger wrote: >>>>> > > > Am 2023-08-20 22:02, schrieb Mateusz Guzik: >>>>> > > >> On 8/20/23, Alexander Leidinger wrote: >>>>> > > >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: >>>>> > > >>>> On 8/18/23, Alexander Leidinger >>>>> > > >>>> wrote: >>>>> > > >>> >>>>> > > >>>>> I have a 51MB text file, compressed to about 1MB. Are you >>>>> > > >>>>> interested >>>>> > > >>>>> to >>>>> > > >>>>> get it? >>>>> > > >>>>> >>>>> > > >>>> >>>>> > > >>>> Your problem is not the vnode limit, but nullfs. >>>>> > > >>>> >>>>> > > >>>> https://people.freebsd.org/~mjg/netchild-periodic-find.svg >>>>> > > >>> >>>>> > > >>> 122 nullfs mounts on this system. And every jail I setup has >>>>> > > >>> several >>>>> > > >>> null mounts. One basesystem mounted into every jail, and then >>>>> > > >>> shared >>>>> > > >>> ports (packages/distfiles/ccache) across all of them. >>>>> > > >>> >>>>> > > >>>> First, some of the contention is notorious VI_LOCK in order to >>>>> > > >>>> do >>>>> > > >>>> anything. >>>>> > > >>>> >>>>> > > >>>> But more importantly the mind-boggling off-cpu time comes from >>>>> > > >>>> exclusive locking which should not be there to begin with -- as >>>>> > > >>>> in >>>>> > > >>>> that xlock in stat should be a slock. >>>>> > > >>>> >>>>> > > >>>> Maybe I'm going to look into it later. >>>>> > > >>> >>>>> > > >>> That would be fantastic. >>>>> > > >>> >>>>> > > >> >>>>> > > >> I did a quick test, things are shared locked as expected. >>>>> > > >> >>>>> > > >> However, I found the following: >>>>> > > >> if ((xmp->nullm_flags & NULLM_CACHE) != 0) { >>>>> > > >> mp->mnt_kern_flag |= >>>>> > > >> lowerrootvp->v_mount->mnt_kern_flag & >>>>> > > >> (MNTK_SHARED_WRITES | MNTK_LOOKUP_SHARED | >>>>> > > >> MNTK_EXTENDED_SHARED); >>>>> > > >> } >>>>> > > >> >>>>> > > >> are you using the "nocache" option? it has a side effect of >>>>> > > >> xlocking >>>>> > > > >>>>> > > > I use noatime, noexec, nosuid, nfsv4acls. I do NOT use nocache. >>>>> > > > >>>>> > > >>>>> > > If you don't have "nocache" on null mounts, then I don't see how >>>>> > > this >>>>> > > could happen. >>>>> > >>>>> > There is also MNTK_NULL_NOCACHE on lower fs, which is currently set >>>>> > for >>>>> > fuse and nfs at least. >>>>> >>>>> 11 of those 122 nullfs mounts are ZFS datasets which are also NFS >>>>> exported. >>>>> 6 of those nullfs mounts are also exported via Samba. The NFS >>>>> exports >>>>> shouldn't be needed anymore, I will remove them. >>>> By nfs I meant nfs client, not nfs exports. >>> >>> No NFS client mounts anywhere on this system. So where is this >>> exclusive >>> lock coming from then... >>> This is a ZFS system. 2 pools: one for the root, one for anything I >>> need >>> space for. Both pools reside on the same disks. The root pool is a >>> 3-way >>> mirror, the "space-pool" is a 5-disk raidz2. All jails are on the >>> space-pool. The jails are all basejail-style jails. >>> >> >> While I don't see why xlocking happens, you should be able to dtrace >> or printf your way into finding out. > > dtrace looks to me like a faster approach to get to the root than > printf... my first naive try is to detect exclusive locks. I'm not 100% > sure I got it right, but at least dtrace doesn't complain about it: > ---snip--- > #pragma D option dynvarsize=32m > > fbt:nullfs:null_lock:entry > /args[0]->a_flags & 0x080000 != 0/ > { > stack(); > } > ---snip--- > > In which direction should I look with dtrace if this works in tonights > run of periodic? I don't have enough knowledge about VFS to come up > with some immediate ideas. After your sysctl fix for maxvnodes I increased the amount of vnodes 10 times compared to the initial report. This has increased the speed of the operation, the find runs in all those jails finished today after ~5h (@~8am) instead of in the afternoon as before. Could this suggest that in parallel some null_reclaim() is running which does the exclusive locks and slows down the entire operation? Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF From nobody Mon Sep 4 06:35:52 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfJn85kKdz4rh0W for ; Mon, 4 Sep 2023 06:36:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfJn82fRQz3NyW for ; Mon, 4 Sep 2023 06:36:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693809370; bh=VNkvZ/r0lhw93jplQBvi/VH0Q23hejTNK+T2EGth9e8=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=OI0M4nb5ooeqo25153D60q3U9gU275GV32nzBk+GW5xigdvkRDQV/NK43oI4ErTY1H+TZWmfq3X6x0L0jk+e9u4W+6vP+rIfHf+hywOb58VYKS5vlIG9QNrCRI5t889Yl6Nlc2PIQMkLwP6ZU1U9T+hpPGRjnWXfYgN/Ggkr8ik5SfqzNZZzhNCv+phaQWhTRRHiXqd7fSvoxXoFNx0AzuT8VQK3OH8Nk+mB8cri0LX8dCXMn027Be0C5vo5aOR7m35EZXFSiPHS9lNZsyKZL9Wy8rjy3qFxdPDDkT7DVxr0lNP+SBze3neJ2N+i5530EeUPmznGrJtFHYlil69Q+A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693809370; bh=235MDa8io5pUS8+XrjDPgLvr4Mdkv/pPy960EFPPYUn=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=M0J3VsqdCs2BSEJqKC/VleQteBKPlctQRICLcpLnsf/FDM0jwLPVWKc23OcKE4TWPi7myUAZYIXn1MHb9+3DEF+RKvsPm5lKJu4nXWUvzkf32qabU2yd1RlGCP7/TGxazy5rBpUoIMYnTRcrTnk0nRrzOQTKvWX/SCNFM34JnCw+BbuAWVyZygqAc6FUOo7s71T1V9I07kf0pshZB6F08ZpQQphqw5wU2ulgYJzkctB+EkwurZM7lSkdQMOvlqpEhc0TTsIsoPKjWeipOMIUpmGwbW2jqXXYPrQOz0t8NE56wvHsYBq/oM0EtGY77bsizjEZ83UP4DCQfJm0+clt0A== X-YMail-OSG: 3i9CIN8VM1lr6m7n74XvFTosvZoV5.9ZEXLNtOxJMk4RrZR9Mdc7Nsx0oCjZdoF Bn9v8f6itXpJ5dgmxNOts_lJ_hhbCUm6JvR.tvi.ga_dS86fOiKKxxNf0vSHWZrYoH5BfkdnDb3t 26IlXfFvJ6jLbbRPuekqw7G55FH5hc5e30lqDY3Ekgd8658pGWCFD.PCO5jE9ptPwggAzLxCv_a4 USVt93hgqZvLzz7bB315Nl4tpfyhKOFC.LY1wt38WhQwa9TesBmc4LW3npGwxQdy3TywShWunwQ7 fdzI93eQ1ZOO0K97rSEUItOtTalHSm4aI4DNtsVoC8QMIIykF2j185HfqNNHlt9.hh7F_ihWgdhK 8Ry7hvzLrUziRP0rVfKTNBEyKlwYOUnRFRHc0ljbk4FXAOQ7qqbH9cd_SC9.NH19wtf.bg6nAceL eewOsYf9mG4WnALkmEvUsVsY.d4_OLE2gyxbV296P4HdroUdO6y_6lawRuhOu4ys7DjqDstm8aFQ bNzWrqXDKOTAXVHrhAW5xeaXYNh9FztZp8y3b9_RHIvvROhjfce3sQjyA6fKMvEXkQBVO1zUBHos mG1MaEOiFMoyCtkeVZO3Bdq_5HRg6dT0.lepPwm3_wLkUyv0JdRznpn2_cUJ9al3qIR_L1lE74FQ 3vCUPb4tH2S2kAk4rgPhjAY075BafRy7GbTXWSM_2e0vM1YD_PchpszCs9pSP5D8IYCj_gFW6CH2 Ylb35tk6KZfJV5hw1igf0PZWh876df40RFEgs4FW1eqFRr8dIRAMjJkW9OkwxOMzHpf5b1bXxhIS MbYFdcFsBKoLuUWHHDESqpwypHXJl05zR3Vn1sTmI.5S0nULQRbTL1sHmIwKYpfXkQUp3.Xr51ij JGzK3UCKfdP6Rg6mmTIlCWIjJWkxfczVKBRqxMsHt3HCFDEObd1LVLJFbrsgpySUPRWPfNN8hQyE 7r32RIEuKGAD8Ib8lRdCzme_jjJsIA53FrdE91wZvuQuyf5gOuqSE23.CBuIsvuIrsC1C07qYCaH sjp67aUotrV4dN0vsY02aIUcVXWlDXfpoFg.z_OBWsL0PoJG_BzMIjI8TlXSr9vKaDrqtm9Np2gW 0xLhjoY2H0o5moBMSSBHBJRFN1lR4Y0vXYt9wp8cNICfI3e6o08Nvsm7DPv9seBR.KVNEzCbqp_T mN_93OpHDLkvOtMDt.1jewqWbttxNGcBa7kX6Z5RnfXF6MBr0RdiScC5DrtHU6bDa5C5Fwva7oan 8pzYBmTNwCx3QjUf6x1dF2oL7OYg58DUmosKl.TSLoFMN_1.QdeNtuKDqJtnPefapmaKY7DXDQ.a QSPXgIVpOBeF.X_H8FCzERQq.rk2q8T5XbFBHfTQjnOgUWGj3mWT7lorq3pMX6_9EMdRP4cbp5t6 N2B5K4dS_LDPHVsJRiGD2IXECeGpEZXXLbjRAw1WALthsCkYm_OJZAPenQUiaZ783dRCEdtSzMZH jOzQASBdKc__CY4_wneKZeo_0Hzy_0_pSijLS_JXZ4tufvZgNQGr6TMqfKiNGiTkho3oMsJd9Lns 1Bh5ZoKBJe2_oodNxMr4bXR.spvTWPsvlKnjvsvlNPtdiHD1JaYevVtJkaMu9atVNlKDug594YoW M8R0HtEeB7O1UXLP4_KfyoWF8wWupnYyEBi2lycMUEt6Brret9tJjOq5NO8l7P2wuEwN48edrEkr Pes1VYrbNfqjkH6vZuWJk4c_9mSUs.ioWe0xct_AeBhyUlA762zahY.W5UReDLl8kje_LYw.5_IZ PuEpUKA1yW1G4yp4B_rqmJSoaVKmS8cdYPHGvI_4shbv7XaLulrgD0qqNVEnmlK8oPtXDgKxkiD. sf4W2iNrmbCyH5a.C.rqwcia9_TxkBMI.4MVUhxwU_HFnlNz267fCMRD6SFxHBZ0mBoes3bG7E0O ggQySyTFDtSdFfvqoGdj0foXE4SDiToZFuZxlxE5fEp36CJp8asHAbzow.SUqjRQoGC4nQawUeLc RUiKAqFdtDhbCsHelEQBCfJ3Fi2zlRkEUJpSqZbqmFKAjitB82YN5SNP.C9DkRsPnsuE0u.U5t_p IQ5RABrC2AeCfaFmyhRntPeXyYU.nog_3xLL01v.IpqID7hCBUEm88nI7q4aI8QKpV7R9I7.IorR t9yrfoZhSx2sguOjxmTqquTRAJkLJmLPgA2MCF2zRBoynGGZhtAr5ypU6kw9Ssjn1PaOF1iB3TLS GW72II1NIBvnGDfEO9GRULhsFbTvoPfvlBZvHB6WueXfbEO7kyXlipPua4RUuujmo2OxlvpiqC1h P X-Sonic-MF: X-Sonic-ID: aaa3356b-021a-40f4-adaa-dc309dc9fd3c Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 06:36:10 +0000 Received: by hermes--production-bf1-865889d799-sjjww (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 627bc217dc55385fbff2203bcadfcee0; Mon, 04 Sep 2023 06:36:04 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: Date: Sun, 3 Sep 2023 23:35:52 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> References: To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RfJn82fRQz3NyW On Sep 3, 2023, at 22:06, Alexander Motin wrote: >=20 > On 03.09.2023 22:54, Mark Millard wrote: >> After that ^t produced the likes of: >> load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k >=20 > So the full state is not "tx->tx", but is actually a = "tx->tx_quiesce_done_cv", which means the thread is waiting for new = transaction to be opened, which means some previous to be quiesced and = then synced. >=20 >> #0 0xffffffff80b6f103 at mi_switch+0x173 >> #1 0xffffffff80bc0f24 at sleepq_switch+0x104 >> #2 0xffffffff80aec4c5 at _cv_wait+0x165 >> #3 0xffffffff82aba365 at txg_wait_open+0xf5 >> #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 >=20 > Here it seems like transaction commit is waited due to large amount of = delete operations, which ZFS tries to spread between separate TXGs. That fit the context: cleaning out /usr/local/poudriere/data/.m/ > You should probably see some large and growing number in sysctl = kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . After the reboot I started a -J64 example. It has avoided the early "witness exhausted". Again I ^C'd after about an hours after the 2nd builder had started. So: again cleaning out /usr/local/poudriere/data/.m/ Only seconds between: # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276042 # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276427 # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 277323 # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 278027 I have found a measure of progress: zfs list's USED for /usr/local/poudriere/data/.m is decreasing. So ztop's d/s was a good classification: deletes. >> #5 0xffffffff829a87d2 at zfs_rmnode+0x72 >> #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d >> #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 >> #8 0xffffffff80c5a7d9 at vgonel+0x3a9 >> #9 0xffffffff80c5af7f at vrecycle+0x3f >> #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e >> #11 0xffffffff80c598cf at vinactivef+0xbf >> #12 0xffffffff80c590da at vput_final+0x2aa >> #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 >> #14 0xffffffff80c68588 at sys_unlink+0x28 >> #15 0xffffffff8106323f at amd64_syscall+0x14f >> #16 0xffffffff8103512b at fast_syscall_common+0xf8 >=20 > What we don't see here is what quiesce and sync threads of the pool = are actually doing. Sync thread has plenty of different jobs, including = async write, async destroy, scrub and others, that all may delay each = other. >=20 > Before you rebooted the system, depending how alive it is, could you = save a number of outputs of `procstat -akk`, or at least specifically = `procstat -akk | grep txg_thread_enter` if the full is hard? Or somehow = else observe what they are doing. # procstat -akk > ~/mmjnk00.txt # procstat -akk > ~/mmjnk01.txt # procstat -akk > ~/mmjnk02.txt # procstat -akk > ~/mmjnk03.txt # procstat -akk > ~/mmjnk04.txt # procstat -akk > ~/mmjnk05.txt # grep txg_thread_enter ~/mmjnk0[0-5].txt /usr/home/root/mmjnk00.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk00.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk01.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk01.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk02.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk02.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk03.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk03.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk04.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk04.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk05.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 /usr/home/root/mmjnk05.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 (Hopefully that will be a sufficiently useful start.) > `zpool status`, `zpool get all` and `sysctl -a` would also not harm. It is a very simple zpool configuration: one partition. I only use it for bectl BE reasons, not the general range of reasons for using zfs. I created the media with my normal content, then checkpointed before doing the git fetch to start to set up the experiment. # zpool status pool: zamd64 state: ONLINE status: Some supported and requested features are not enabled on the = pool. The pool can still be used, but some features are unavailable. action: Enable all features using 'zpool upgrade'. Once this is done, the pool may no longer be accessible by software that does not = support the features. See zpool-features(7) for details. checkpoint: created Sun Sep 3 11:46:54 2023, consumes 2.17M config: NAME STATE READ WRITE CKSUM zamd64 ONLINE 0 0 0 gpt/amd64zfs ONLINE 0 0 0 errors: No known data errors There was also a snapshot in place before I did the checkpoint operation. I deliberately did not use my typical openzfs-2.1-freebsd=20 for compatibility but used defaults when creating the pool: # zpool get all NAME PROPERTY VALUE = SOURCE zamd64 size 872G - zamd64 capacity 21% - zamd64 altroot - = default zamd64 health ONLINE - zamd64 guid 4817074778276814820 - zamd64 version - = default zamd64 bootfs zamd64/ROOT/main-amd64 = local zamd64 delegation on = default zamd64 autoreplace off = default zamd64 cachefile - = default zamd64 failmode wait = default zamd64 listsnapshots off = default zamd64 autoexpand off = default zamd64 dedupratio 1.00x - zamd64 free 688G - zamd64 allocated 184G - zamd64 readonly off - zamd64 ashift 0 = default zamd64 comment - = default zamd64 expandsize - - zamd64 freeing 0 - zamd64 fragmentation 17% - zamd64 leaked 0 - zamd64 multihost off = default zamd64 checkpoint 2.17M - zamd64 load_guid 17719601284614388220 - zamd64 autotrim off = default zamd64 compatibility off = default zamd64 bcloneused 0 - zamd64 bclonesaved 0 - zamd64 bcloneratio 1.00x - zamd64 feature@async_destroy enabled = local zamd64 feature@empty_bpobj active = local zamd64 feature@lz4_compress active = local zamd64 feature@multi_vdev_crash_dump enabled = local zamd64 feature@spacemap_histogram active = local zamd64 feature@enabled_txg active = local zamd64 feature@hole_birth active = local zamd64 feature@extensible_dataset active = local zamd64 feature@embedded_data active = local zamd64 feature@bookmarks enabled = local zamd64 feature@filesystem_limits enabled = local zamd64 feature@large_blocks enabled = local zamd64 feature@large_dnode enabled = local zamd64 feature@sha512 enabled = local zamd64 feature@skein enabled = local zamd64 feature@edonr enabled = local zamd64 feature@userobj_accounting active = local zamd64 feature@encryption enabled = local zamd64 feature@project_quota active = local zamd64 feature@device_removal enabled = local zamd64 feature@obsolete_counts enabled = local zamd64 feature@zpool_checkpoint active = local zamd64 feature@spacemap_v2 active = local zamd64 feature@allocation_classes enabled = local zamd64 feature@resilver_defer enabled = local zamd64 feature@bookmark_v2 enabled = local zamd64 feature@redaction_bookmarks enabled = local zamd64 feature@redacted_datasets enabled = local zamd64 feature@bookmark_written enabled = local zamd64 feature@log_spacemap active = local zamd64 feature@livelist enabled = local zamd64 feature@device_rebuild enabled = local zamd64 feature@zstd_compress enabled = local zamd64 feature@draid enabled = local zamd64 feature@zilsaxattr active = local zamd64 feature@head_errlog active = local zamd64 feature@blake3 enabled = local zamd64 feature@block_cloning enabled = local zamd64 feature@vdev_zaps_v2 active = local zamd64 feature@redaction_list_spill disabled = local /etc/sysctl.conf does have: vfs.zfs.min_auto_ashift=3D12 vfs.zfs.per_txg_dirty_frees_percent=3D5 The vfs.zfs.per_txg_dirty_frees_percent is from prior Mateusz Guzik help, where after testing the change I reported: Result summary: Seems to have avoided the sustained periods of low load average activity. Much better for the context. But it was for a different machine (aarch64, 8 cores). But it was for poudriere bulk use. Turns out the default of 30 was causing sort of like what is seen here: I could have presented some of the information via the small load average figures here. (Note: 5 is the old default, 30 is newer. Other contexts have other problems with 5: no single right setting and no automated configuration.) Other than those 2 items, zfs is untuned (defaults). sysctl -a is a lot more output (864930 Bytes) so I'll skip it for now. > PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me = shiver. Make sure there is no storage problems, like some huge delays, = timeouts, etc, that can be seen, for example, as busy percents regularly = spiking far above 100% in your `gstat -spod`. >=20 The "gstat -spod" output showed (and shows): around 0.8ms/w to 3ms/w, mostly at the lower end of the range. < 98%busy, no spikes to > 100%. It is a previously unused Samsung PSSD T7 Touch. I was not prepared to replace the content of a PCIe slot's media or M.2 connection's media for the temporary purpose. No spare supply for those so no simple swapping for those. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 07:13:51 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfKd10nnXz4rslP for ; Mon, 4 Sep 2023 07:14:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfKcz61hCz3WZS for ; Mon, 4 Sep 2023 07:14:11 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=DiZi4vA3; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693811649; bh=rf4e2rs8lNvnhpUs3YXXW+YGU1zniG0RhEOgLu8cXiE=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=DiZi4vA3Mji52ejuvuAek/9RGC2GfyfPNx64pc9n9urYWev3Y2wzRqwosvvg1PxjDP4XFfpvwh9oJXnbX8gB6ljNg5CLhS0rSLbzpFyXOmiN2ccIL0hKkIfQZ4p/OYZoU+t7bnQvPpd5pGaIMfyqHMk9OKKpVDs19oYxdGGvpvr+X8FZLMb3b4vQ/FlADB31i1JgaFSPfUKbPXLISHBeQ64EgR6nQKHsm12dEIxEf/5VO2dq+cYyKDS++fM3Oo5QENL6q81r7f62EgIpPBF3qJkwh2lpow6ywYMPuTnnZ/OFjhzmSKcwqr2aNv4W/jRbKlVzaMkIJM3+88Jx6rc0qA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693811649; bh=l2T8Wox99ShM5TpMbDYO+Gfg3mmSF49bPvryTsOYvig=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=hbWL/5wZllzQCAKhyl/SXYsPNuQAnwD46BGt80JcDwmwRakGsfr5JYdKotg63VY8TGMqSCkMlr9IISidrL8+8zQpCqN0SNM93xFWMwk9kjScq9bOlSy1VWNfV/FBcxk0HtjDAxTsdE6+FoKLBc6Nmr/ro/PzhpvdgqLM2KWva3iaHpgbJD6pn7RBWh24O7WyYHnFw3Pv2JoYGjqmzt/jycTs0tiWTG02egaSPFnCBEj6bybIs54Mg2LyJlOYmp3dTJ57ShLxHdYmiWV8L8ewBmP9mmI+q6xgbRs1/UdUN07Q9cNCkU8r8AXh6/uKdW1J9Jc9Vc9Nj9oHpgKs8pNxLw== X-YMail-OSG: t9JWtlkVM1kKrzmoUONXvk_vr3QaNXZXapLpEzCgmJ08Eli5OBmomhrPpN.qIHG Ua9KPrNMXkYQY35KpC383dmchffXt6gUnyvAAyDXBLqEiTh2FTD_Ja.ZzqDF13sbH1vLF5ywaTG. XFPo4c4P8gfQ715OZp14s1Ht0WVqPGhZxK_NDZN6C_hmtpxX49jdSS_zsiD6o.D9aeetJs_feQmM A3UEzCbZgyqAbsp0pf9eaHboRIjW2cf8ULhHrX3k4Ir6fbSOitkp0Fdw4RbCRIzr21bcUZHgFwTk r8YuPOY7659pFfdktFghCu9158I44ob9h7T1MZN5XUIAJiudJoc_NEB5tmG5wrpyyzZ.QmgoOWgE LGk30iwYFXZD8_rYRUuQqNX3I.A8MF9RAXwq4ruScHiwXgLlTujPeEfL.SOoyMhRPbQWfYo8QhU4 kz4JQV6EHxDzY1gC5Z6VIEBc8cw0D9p2jef7JeyLUnRFVvyPur.wGSGBUGXbNWAb0kEEbvUy.d3y 1V82fNHV12868Oh7JxpUvaDregz0E8sfXHOwDGAIyMG8EX6HKfLshX8GWx_Ls2Sf5ZJH4i95VbPP 6qGFX3kXKnMb7cr4xfx_xmzhaHtYf10nXISkrh4eHvirg9tX36N1Pghlb6QgpWB6AH1IdlQy8Ahb IuxT0H3hrWtugpDC3hbJpAdAXich3UohW7GOQE4O5SqjVRnGd0_uitGE9CIsAyUDg2BUhoJoH_ER FXjaWw7ZoMwLiEpGqoGU2SSw4w_5R0qDvR8iTxwXzZ4J6LNuom.2uhRkC948u6hqcIFM3r5yCsUj KLktqg9XDWiBW3_sm_DJyAKKsPdCiglCEkvq.09VyQoz4VdXyAkbwqOKsWLJLm3F8IDA6I1TvaWO ByrDjqqyy4gxQcp1AWmlaqbiNtfgpZab5LRgxPwPHV1V775LEF29RVAUUJYl7CwOkEp3w9TrYHy3 .QgKHFMQP2PvoXcYDuM1C9eHCE0vvasE2LLGhXgzrUEgIsh9n7334ES79yx2aLwCqQk_KH5lg3SC 9wPlStNSHV109z59accdoYw7DYqBJurjWulN91_IdDk1aUxchw86yAMv.9npT3Glex0T27xQEaeJ bgZ0xyAVLa81YhOrNJIOk79j9ny_FjYC8oubTYc8ToOHW4PJkkt29Qr55wIrNSCBP27wiRpJygnF fdj.od6qKEkzB8pbzwXS1N_OM.9MYPbDgVl3dzjvOeyqsxXL_Umm73RyzuKg._sqWX80H7_SvXZ7 0T98sT9xQZ_GSIVFXUfZqyM6EoVCN3G84UZ4gnlsyuB85BytWE_c3U0LwA.y0avaIv0FRgj4nMde 1g8RkU5fbgC29NIxsjV24_G1HdXQVtGjTTb6pq4fXhaj_qjf4LN28cPv5vdqhTPfwbssAiaYY6Sy RUuNzqmqV7n7oqljrPCsjWW09w3Vj9dSkryFh8fGNiqsKahtQHEAmmd4OwQAk1gGiEonRZ9Aak.S 7L4RhpuCARqr2nynlorn0xIQ6twJ9s6jZx3.nbCULu1ZelwUvIpsgwWT9L2P4ir2MZ5byU5uJKd2 WsH4XZu0VjPiRR.Edvj.XKsYDyExovh1_UVAvOq59OAaWsuXkFhW02zAkXg9W8oCMoCQe3Ur56lJ 5YGmEqEJF3fm8QkaqaUAC.K.vyUc0f6kdGWwIsHSRyoIJlVC35F81vkRbdZ2pA2bwsE5FTI2nAzA wBWuoqgOZluWPVSWJn9_mpJSwJI8wtelX6i.hGP7X97GBIy.O.R1Mn9SmSBtLFzXZ.aslnZWxsIt jjy_X2v3ERCLoIiGsMn_K1EKZar1fljxGQXROipqJg.uDZ3ivtafkMP34Z1geJH8E9smgTGYjxxB JC6z8lKhiFeClxh1YVmOt3Eqrbfkldn1xLul0GtvquADeArUE6zY.CSv3EUOlcsoycTkskphx9vP XKfuMFqKN0egMQP5BIyYNHKjuqNXcnveLg8dHMlw3z4NuLiUK3GULFR1wm2wwY_uNnEu2wH4nGGP UygJmKorm.1gbrd2BXLM.TCBvUa2rRKgzhF7s5pq5Ib8Cru_33Je04CqVnjLzp.JhQhTFdrLQT6A cOX1M2ASsXJPACRCJWScF9mqgHlWk880d0vis0tEG.t9kkCAgkw4d_aXRPgINZLI8SvDKgFevbhF 1X_1.1KU_Ckk8133ew9mlJ0S9xIx7M1nBJqhdfE_pghUz_DDjl.RXE1sNeO1V9XYMPo5yjUIUqtx awUenwFVwcqDYWi1ME2mBVxXM4UkXr2uKLhjXs84OqEZ_sXawEXMvU_rvgG.mD3dBHKtLorCq88c Zvw-- X-Sonic-MF: X-Sonic-ID: 349e7a22-7c61-4f01-8be8-89f64fd0ff2b Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 07:14:09 +0000 Received: by hermes--production-bf1-865889d799-cgv22 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 55f82fecaa0818bcdc051b884e959c45; Mon, 04 Sep 2023 07:14:03 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned Date: Mon, 4 Sep 2023 00:13:51 -0700 References: To: dev-commits-src-main@freebsd.org, Current FreeBSD In-Reply-To: Message-Id: <8346B473-C75E-44DC-8EB9-7F71E37828E0@yahoo.com> X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.146:from]; BLOCKLISTDE_FAIL(0.00)[98.137.64.146:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.146:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfKcz61hCz3WZS On Sep 3, 2023, at 19:54, Mark Millard wrote: > ThreadRipper 1950X (32 hardware threads) doing bulk -J128 > with USE_TMPFS=3Dno , no ALLOW_MAKE_JOBS , no > ALLOW_MAKE_JOBS_PACKAGES , USB3 NVMe SSD storage/ZFS-boot-media, > debug system build in use : >=20 > [00:03:44] Building 34214 packages using up to 128 builders > [00:03:44] Hit CTRL+t at any time to see build progress and stats > [00:03:44] [01] [00:00:00] Builder starting > [00:04:37] [01] [00:00:53] Builder started > [00:04:37] [01] [00:00:00] Building ports-mgmt/pkg | pkg-1.20.6 > [00:05:53] [01] [00:01:16] Finished ports-mgmt/pkg | pkg-1.20.6: = Success > [00:06:15] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 > [00:06:15] [02] [00:00:00] Builder starting > . . . > [00:06:18] [128] [00:00:00] Builder starting > [00:07:42] [01] [00:01:27] Finished print/indexinfo | indexinfo-0.3.1: = Success > [00:07:45] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 > [00:18:45] [01] [00:11:00] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success > [00:19:06] [01] [00:00:00] Building devel/gmake | gmake-4.3_2 > [00:24:13] [01] [00:05:07] Finished devel/gmake | gmake-4.3_2: Success > [00:24:39] [01] [00:00:00] Building devel/libtextstyle | = libtextstyle-0.22 > [00:31:08] [125] [00:24:50] Builder started > [00:31:08] [125] [00:00:00] Building print/t1utils | t1utils-1.32 > [00:31:15] [33] [00:25:00] Builder started > [00:31:15] [81] [00:24:59] Builder started > [00:31:15] [33] [00:00:00] Building databases/xapian-core | = xapian-core-1.4.23,1 > [00:31:15] [13] [00:25:00] Builder started > [00:31:15] [81] [00:00:00] Building devel/bmake | bmake-20230723 > [00:31:15] [13] [00:00:00] Building devel/evdev-proto | = evdev-proto-5.8 > [00:31:16] [41] [00:25:00] Builder started > [00:31:16] [41] [00:00:00] Building devel/pcre | pcre-8.45_3 > . . . >=20 > (Looks like lang/go120 ignores the lack of ALLOW_MAKE_JOBS . > There may be others that still have signficant parallel > activity.) >=20 > [main-amd64-bulk_a-default] [2023-09-03_13h48m45s] [parallel_build:] = Queued: 34588 Built: 727 Failed: 1 Skipped: 40 Ignored: 335 = Fetched: 0 Tobuild: 33485 Time: 01:36:51 >=20 > (So about 1 hr after the last "Builder starting" it had > built 727.) >=20 > The vast majority of the time: lots of cpdup's with tx->tx > showing most of the time for STATE but showing having some > CPU time. >=20 > ^T commonly showed various Builders in starting PHASE for > 3min..6min. >=20 > Around 66% mean Idle time (guess from watching top). >=20 > After ^C "gstat -spod" reports it is almost always writing > 2200 to 2500 writes per second or so for *hours* (still > going on). >=20 > ztop reports 1500 to 3200 d/s or so almost always for > Dataset zamd64/poudriere/data/.m instead (also still going > on). Normally no other Dataset is shown. >=20 > With all the disk I/O activity, this is definitely "live" > in some sense. But I've no clue if it is just repeating > itself over and over vs. if it making some sort of progress. >=20 > For reference for the ^C and after: >=20 > ^C[01:39:00] [20] [00:00:03] Building sysutils/linux-c7-dosfstools | = linux-c7-dosfstools-3.0.20 > [01:39:00] [93] [00:07:12] Finished science/dimod | dimod-0.12.11: = Success > [01:39:00] Error: Signal SIGINT caught, cleaning up and exiting > [01:39:02] [63] [00:06:34] Finished archivers/unarj | unarj-2.65_2: = Success > [01:39:03] [128] [00:07:47] Finished sysutils/shuf | shuf-3.0: Success > [01:39:04] [113] [00:07:06] Finished devel/bsddialog | = bsddialog-0.4.1: Success > [main-amd64-bulk_a-default] [2023-09-03_13h48m45s] [sigint:] Queued: = 34588 Built: 752 Failed: 1 Skipped: 40 Ignored: 335 Fetched: = 0 Tobuild: 33460 Time: 01:38:56 > [01:39:06] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-03_1= 3h48m45s > [01:39:14] [12] [00:09:07] Finished archivers/rzip | rzip-2.1_1: = Success > [01:39:14] Cleaning up > exit: cannot open ./var/run/49_nohang.pid: No such file or directory > exit: cannot open ./var/run/87_nohang.pid: No such file or directory >=20 > After that ^t produced the likes of: >=20 > load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k > #0 0xffffffff80b6f103 at mi_switch+0x173 > #1 0xffffffff80bc0f24 at sleepq_switch+0x104 > #2 0xffffffff80aec4c5 at _cv_wait+0x165 > #3 0xffffffff82aba365 at txg_wait_open+0xf5 > #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 > #5 0xffffffff829a87d2 at zfs_rmnode+0x72 > #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d > #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 > #8 0xffffffff80c5a7d9 at vgonel+0x3a9 > #9 0xffffffff80c5af7f at vrecycle+0x3f > #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e > #11 0xffffffff80c598cf at vinactivef+0xbf > #12 0xffffffff80c590da at vput_final+0x2aa > #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 > #14 0xffffffff80c68588 at sys_unlink+0x28 > #15 0xffffffff8106323f at amd64_syscall+0x14f > #16 0xffffffff8103512b at fast_syscall_common+0xf8 >=20 > The console/logs do report "witness exhausted": >=20 > . . . > Sep 3 13:41:08 amd64-ZFS login[1751]: ROOT LOGIN (root) ON ttyv0 > Sep 3 13:51:35 amd64-ZFS kernel: witness_lock_list_get: witness = exhausted > Sep 3 14:26:38 amd64-ZFS kernel: pid 27418 (conftest), jid 245, uid = 0: exited on signal 11 (core dumped) > . . . >=20 > So it did not take long for the "witness exhausted" to > happen. >=20 > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #74 = main-n265143-525bc87f54f2-dirty: Sun Sep 3 13:35:04 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >=20 >=20 > Looks like I'll be forcing the machine to reboot or > to power off. The media was deliberately set up for > doing risky tests. It is not my normal environment. >=20 Using -J64 instead of -J128. It does avoid "witness exhausted" for at least the 1st hour. [00:03:51] Building 34214 packages using up to 64 builders [00:03:51] Hit CTRL+t at any time to see build progress and stats [00:03:51] [01] [00:00:00] Builder starting [00:04:49] [01] [00:00:58] Builder started [00:04:49] [01] [00:00:00] Building ports-mgmt/pkg | pkg-1.20.6 [00:06:07] [01] [00:01:18] Finished ports-mgmt/pkg | pkg-1.20.6: Success [00:06:31] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 [00:06:31] [02] [00:00:00] Builder starting . . . [00:06:33] [64] [00:00:00] Builder starting [00:09:06] [01] [00:02:35] Finished print/indexinfo | indexinfo-0.3.1: = Success [00:09:08] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 [00:21:49] [16] [00:15:18] Builder started [00:21:49] [16] [00:00:00] Building devel/libdaemon | libdaemon-0.14_1 [00:21:49] [29] [00:15:17] Builder started [00:21:49] [20] [00:15:18] Builder started [00:21:49] [41] [00:15:17] Builder started [00:21:49] [29] [00:00:00] Building textproc/libunibreak | = libunibreak-5.1,1 [00:21:49] [20] [00:00:00] Building graphics/poppler-data | = poppler-data-0.4.12 [00:21:49] [35] [00:15:17] Builder started [00:21:49] [41] [00:00:00] Building archivers/libmspack | = libmspack-0.11alpha . . . [main-amd64-bulk_a-default] [2023-09-03_20h48m38s] [parallel_build:] = Queued: 34588 Built: 438 Failed: 1 Skipped: 50 Ignored: 335 = Fetched: 0 Tobuild: 33764 Time: 01:21:30 . . . ^C[01:21:57] [32] [00:07:04] Finished devel/p5-Test-Deep | = p5-Test-Deep-1.204: Success [01:21:57] Error: Signal SIGINT caught, cleaning up and exiting [01:22:03] [39] [00:06:01] Finished textproc/p5-Lingua-Stem-Ru | = p5-Lingua-Stem-Ru-0.04: Success [01:22:04] [35] [00:06:09] Finished devel/p5-ExtUtils-InstallPaths | = p5-ExtUtils-InstallPaths-0.012: Success [main-amd64-bulk_a-default] [2023-09-03_20h48m38s] [sigint:] Queued: = 34588 Built: 442 Failed: 1 Skipped: 50 Ignored: 335 Fetched: = 0 Tobuild: 33760 Time: 01:21:50 [01:22:04] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-03_2= 0h48m38s [01:22:11] Cleaning up (So only around 438 built in similar time frame relationship used for the -J128 test that got to more like 752. But -J128 had the "witness exhausted" status as well.) Turns out a measure of progress is the USED listed by zfs list for /usr/local/poudriere/data/.m/ . It spends lots of time waiting in various processes during its deletion activity. Previously I'd been told to use vfs.zfs.per_txg_dirty_frees_percent=3D5 instead of the default (30) in order to avoid ending up with sustained very small load averages in my poudiere bulk runs for my kind of context. (5 is the older default, as it turns out.) This may be somewhat of a deletion/cleanup stage variant of that sort of issue. It may be that trying a factor of 2+ for 32 hardware threads just does not scale the same as a factor of 2 did for folks using 4 hardware thread machines where testing for the deadlock issue. May be -J36 (so: 32+4) would be more reasonable for deadlock testing for this context, possibly avoiding running into these other issues so strongly. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 09:00:43 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfN0D5pS1z4sPFF for ; Mon, 4 Sep 2023 09:01:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfN0B4qgdz4NfD for ; Mon, 4 Sep 2023 09:00:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=KNopLBbI; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693818056; bh=CHX9AuXEC0SsIR9QLqT3UWvm/eN/3krrWUOM4Vd8kRY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=KNopLBbIW/D4Y9Y4hSvuyb9S0BRxMyidSIbzjumqIG9jdUTZ1R6gvpC0WQkGohOLfB0jMD11kY+Q5on9ZsTbf7tavqi/EoeDOTCXo+5IM3Q3xS5txEXHMFQ0tX6JReoH6rMBQmzKu0oQR2jFrPm1dFZbEr/tZJvtnvGC8YdoOhroKbWBiQzYTB1Z54mWakp86HTrjLt46RNrmMJKQMI0TIPrUr0gegfpkbpzILJZlbqcekroRYNz/ElWwL8R7VBHkfhy3fB30ywLRg7zhOlthmBIuuWDhKGfpoeS3uPOk2WSdE2jlioj54I3BU4XfaN/hMF22eJEeaJRGsb8rIG9Xg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693818056; bh=XYtExZGqLnqk4UfLE/l+r+fAZH41bSRiu0ony9SSQBH=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=IDh/eqZ3HmsnZZtkBSCbgVZjVYjRnDScXTvJ23OXrEIOCrGKCHyzoLJ+YtmWux1fBwoq65TIB/sV6uEU4sSfdwl+v2FB+p28KLxkDGVkQ5Qux04lCyeqNkgyQzlWNIeoLOr/ZImF1xrx9r/GDE7LiHxg1CwB5/542pzoVdtUHRNUpre0BbQGtoc0ljb6OcSm4xk1SxWE4tSqr2nbO1e+l+7+6/9oqv0jBlbscrGAJUzG0A5gRXGxKZcNCKgsSqTKNarD3yP0GeHGOhY0aZ0Bj4cYEEje6Npe7xbV1EOiGhFeMuyAhAbN8D3uw6Lvk5zcuD4ZJfNfvm8qBAba7h6qxg== X-YMail-OSG: WtZQID4VM1lIr2uGozkTwOMbhoQmidL3uRk08lps8aCnhx_qi2hzEw0YS83SVga SgnB1P88ZiwsDDINQEurokl374n._TWaQa_qsS0ZsQgby6FTycNVXjCItX19vuFPN6ccyzgTcCWM ftP2lAWLgG4JRE9QoZIgXG6yzmZq7p7jslhvWyhJlgFZd7l.xRyjZtdp15GZlJN0zQSVg2O.qL.C qUvVuymJX8YehbahPxWL8vYgKssx3p2jQs_BbRGLhBAgPZGuIi95BZibUOZwWguj5_ghkj2KLRkP Ggsvp5h7BrvJ_9A_bldCW9IDboSLkdY7zQT0BZuI8mFhfWNqDUVFztLDYK92C5r6E2hwwj4H7.lX BBD2ubTOHY2KaZbZZUnh0JZu_A2FDN4JDukuI3nrzMsurPqaGbYi2405VY_pKOLN7uQFrsHpRVkS i.83rHfrqNbVa.H3yyt5aecuZxCJsa0L5PjAgzqAelnIGwJJmxBuOvMtA_N3nL_9IjcmTYL9Pykf s8XXgTSrkWRwbYitU.syIGv.otgsQHBF6abtxmhy7mn84Y01OSMf89nUMyoLh2ISjzI8.QZrxk.9 t_JfiuWk5xPnVol2NO4uDL6PSrOrsfgcj4Wu6lC_cfVZAz08kJHbaiBJgp3pu12Jzygn_F3mbtKe fIXjIwrSSgLrckArVmXQwn3K7NKe_rd6qPFzCy.UhvAgvwyTy9gG.TIuuANVCqQ8os7bNpDTZsQ6 g1wrHEs97VTtE1G6yJ29EPSud4aa5sypFNxq8biEO1QJ9R9JXL6WZjfC9kSeAmPsolAwoEUd3icI VtFIAKRqDchhTT7lLMAIUzdl8i_smf7NBMRl2yhYYGYu5dCeVImMPwu1fgRRU.tYDHCDAyWsJ031 JrPEtHX2ta8l4IA3Dti8_YD6BgII96t3uYLOAalLBlXE54CLZWjgmnbRMkOXAttE9Cjg14DWLlXk KLHpI7elZ.bY6WVP17Rvhhgj3.03.CG5k2E6y46xe_2TJUAOdWLWErMP_k7N1sxosT2vYMIlW8Sq oIPpnlCK.JrBzq5rTAgpQT2jCOJJ1wUk.7PXZ6PpQdlk0lzTgXS0VPUReE7rTMe6UiQ02EztN9Pz gAePBoEAtufOPHfA39Z8c271Ajz6YorYC6e6seNSW3gP5s.AienwAzy7NbOw1AMcg.hBUAENKz_Q 1YB5j3rWHdw1GsAanP7nqiLalif0v1BzRJoOTpweqAaK94HDcJB4gBD7MwZLeUrUmwaOApSoO9kG 5eX3Z2fRh2qKJDNmvl6DqM_V_3PVIk3Cjdu8ch8fqvxHeUQg5J6_4YYcvZLdI_WkttRg__VAIHPR 6VH7fGC.9axtZ_zzzRsm9_RUpgYA1tq56o7Xq0ykpSV98fcMtBPMin9uqA2DEgpz0xUSG4CUwWmx 4SDTJx81dItkasrBk.IIxmpjfu1E0mqZIR.lv85dh3KUdjCTGKqVnNO6s9Srat1x8GtRuZNp.GD7 ObVYuaSN2FBNZUifAbeAiD6y1RE7FZNEvLLj7xMsbQlD3z01B36.XtLiV9r.1lUM2S8.KPKGN6hS 4_Kl7l.iijAPXhdTDeGvTY.9oGggmKBuqlZuoi98bnZyqkIis9ReYknbBLlXph5Ibcz0RT4kxB7R 0N4nPNstXD4AkGcR1RnTJu22qSPdKVuDcxX5MkTZZIAb5oh7npdzM3mYgup5gKhogUdgVBm5R6V4 I6UKOUMzkmtEeDuZCY0mhONgbwF1gjapzMurbPGapLPDeBB_8.PDAmsYcfY3rO17Xiq9YnmrL1n6 8NetUIc9KWJPJ9PzhxMHqeNcP0Ijj3Yl.Dnvp4SW52ly_CHpWKSl1Mf.GFL1nyjqFEveIDYG7q0P 5UNzsk.ZobIQ1naBJsWzOkz3aIY5wfwHZVagJIzBZeNIkPr5C0oqKNn1FMJz2EhhQHXLnaVbylqb 4UIxwjHMUu5y8EVnQmBul.vkS3MovYq43z_39mEUqMWg9F2BPnpHV.Q6A3CPNMd61a31Npxrwy9T uqkl2WCjW59L80.83f_G7_Xgz0rvTfgaZikFM8rqheT6IWh2cCY7dka8YN_XChyBj4P8T_Tr5SEs n4C9adM5Z67yGl_WnKE3gH_0OBB9f8afEaalDd2QKKn1IIoNgvOTSXNoWIGBj4iQzp6xpbDifXbk 9UjwlfkFfW8VtCIIo5FglZt0DqPZSastJqJrpNOqMqHRLj366JcfxFmcUIYnloFWz6JTCIc7vh7L hZMB5YHObJQUDOZllhPDjuZyuMqOGfXfe_4vo0pv.TZvwvXsbaSrft8yXXdQm5.kFL3Ob7dzwDIi 6Tfo- X-Sonic-MF: X-Sonic-ID: 3b2439b6-fad8-4bac-ad76-261dc8c6f2d7 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 09:00:56 +0000 Received: by hermes--production-gq1-6b7c87dcf5-m4lb7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 791c618462618c3e19592c232153a7e3; Mon, 04 Sep 2023 09:00:54 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> Date: Mon, 4 Sep 2023 02:00:43 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.82:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.82:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfN0B4qgdz4NfD On Sep 3, 2023, at 23:35, Mark Millard wrote: > On Sep 3, 2023, at 22:06, Alexander Motin wrote: >=20 >>=20 >> On 03.09.2023 22:54, Mark Millard wrote: >>> After that ^t produced the likes of: >>> load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k >>=20 >> So the full state is not "tx->tx", but is actually a = "tx->tx_quiesce_done_cv", which means the thread is waiting for new = transaction to be opened, which means some previous to be quiesced and = then synced. >>=20 >>> #0 0xffffffff80b6f103 at mi_switch+0x173 >>> #1 0xffffffff80bc0f24 at sleepq_switch+0x104 >>> #2 0xffffffff80aec4c5 at _cv_wait+0x165 >>> #3 0xffffffff82aba365 at txg_wait_open+0xf5 >>> #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 >>=20 >> Here it seems like transaction commit is waited due to large amount = of delete operations, which ZFS tries to spread between separate TXGs. >=20 > That fit the context: cleaning out /usr/local/poudriere/data/.m/ >=20 >> You should probably see some large and growing number in sysctl = kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . >=20 > After the reboot I started a -J64 example. It has avoided the > early "witness exhausted". Again I ^C'd after about an hours > after the 2nd builder had started. So: again cleaning out > /usr/local/poudriere/data/.m/ Only seconds between: >=20 > # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay > kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276042 >=20 > # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay > kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276427 >=20 > # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay > kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 277323 >=20 > # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay > kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 278027 >=20 > I have found a measure of progress: zfs list's USED > for /usr/local/poudriere/data/.m is decreasing. So > ztop's d/s was a good classification: deletes. >=20 >>> #5 0xffffffff829a87d2 at zfs_rmnode+0x72 >>> #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d >>> #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 >>> #8 0xffffffff80c5a7d9 at vgonel+0x3a9 >>> #9 0xffffffff80c5af7f at vrecycle+0x3f >>> #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e >>> #11 0xffffffff80c598cf at vinactivef+0xbf >>> #12 0xffffffff80c590da at vput_final+0x2aa >>> #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 >>> #14 0xffffffff80c68588 at sys_unlink+0x28 >>> #15 0xffffffff8106323f at amd64_syscall+0x14f >>> #16 0xffffffff8103512b at fast_syscall_common+0xf8 >>=20 >> What we don't see here is what quiesce and sync threads of the pool = are actually doing. Sync thread has plenty of different jobs, including = async write, async destroy, scrub and others, that all may delay each = other. >>=20 >> Before you rebooted the system, depending how alive it is, could you = save a number of outputs of `procstat -akk`, or at least specifically = `procstat -akk | grep txg_thread_enter` if the full is hard? Or somehow = else observe what they are doing. >=20 > # procstat -akk > ~/mmjnk00.txt > # procstat -akk > ~/mmjnk01.txt > # procstat -akk > ~/mmjnk02.txt > # procstat -akk > ~/mmjnk03.txt > # procstat -akk > ~/mmjnk04.txt > # procstat -akk > ~/mmjnk05.txt > # grep txg_thread_enter ~/mmjnk0[0-5].txt > /usr/home/root/mmjnk00.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk00.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk01.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk01.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk02.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk02.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk03.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk03.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk04.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk04.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk05.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 > /usr/home/root/mmjnk05.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >=20 > (Hopefully that will be a sufficiently useful start.) >=20 >> `zpool status`, `zpool get all` and `sysctl -a` would also not harm. >=20 > It is a very simple zpool configuration: one partition. > I only use it for bectl BE reasons, not the general > range of reasons for using zfs. I created the media with > my normal content, then checkpointed before doing the > git fetch to start to set up the experiment. >=20 > # zpool status > pool: zamd64 > state: ONLINE > status: Some supported and requested features are not enabled on the = pool. > The pool can still be used, but some features are unavailable. > action: Enable all features using 'zpool upgrade'. Once this is done, > the pool may no longer be accessible by software that does not support > the features. See zpool-features(7) for details. > checkpoint: created Sun Sep 3 11:46:54 2023, consumes 2.17M > config: >=20 > NAME STATE READ WRITE CKSUM > zamd64 ONLINE 0 0 0 > gpt/amd64zfs ONLINE 0 0 0 >=20 > errors: No known data errors >=20 > There was also a snapshot in place before I did the > checkpoint operation. >=20 > I deliberately did not use my typical openzfs-2.1-freebsd=20 > for compatibility but used defaults when creating the pool: >=20 > # zpool get all > NAME PROPERTY VALUE = SOURCE > zamd64 size 872G = - > zamd64 capacity 21% = - > zamd64 altroot - = default > zamd64 health ONLINE = - > zamd64 guid 4817074778276814820 = - > zamd64 version - = default > zamd64 bootfs zamd64/ROOT/main-amd64 = local > zamd64 delegation on = default > zamd64 autoreplace off = default > zamd64 cachefile - = default > zamd64 failmode wait = default > zamd64 listsnapshots off = default > zamd64 autoexpand off = default > zamd64 dedupratio 1.00x = - > zamd64 free 688G = - > zamd64 allocated 184G = - > zamd64 readonly off = - > zamd64 ashift 0 = default > zamd64 comment - = default > zamd64 expandsize - = - > zamd64 freeing 0 = - > zamd64 fragmentation 17% = - > zamd64 leaked 0 = - > zamd64 multihost off = default > zamd64 checkpoint 2.17M = - > zamd64 load_guid 17719601284614388220 = - > zamd64 autotrim off = default > zamd64 compatibility off = default > zamd64 bcloneused 0 = - > zamd64 bclonesaved 0 = - > zamd64 bcloneratio 1.00x = - > zamd64 feature@async_destroy enabled = local > zamd64 feature@empty_bpobj active = local > zamd64 feature@lz4_compress active = local > zamd64 feature@multi_vdev_crash_dump enabled = local > zamd64 feature@spacemap_histogram active = local > zamd64 feature@enabled_txg active = local > zamd64 feature@hole_birth active = local > zamd64 feature@extensible_dataset active = local > zamd64 feature@embedded_data active = local > zamd64 feature@bookmarks enabled = local > zamd64 feature@filesystem_limits enabled = local > zamd64 feature@large_blocks enabled = local > zamd64 feature@large_dnode enabled = local > zamd64 feature@sha512 enabled = local > zamd64 feature@skein enabled = local > zamd64 feature@edonr enabled = local > zamd64 feature@userobj_accounting active = local > zamd64 feature@encryption enabled = local > zamd64 feature@project_quota active = local > zamd64 feature@device_removal enabled = local > zamd64 feature@obsolete_counts enabled = local > zamd64 feature@zpool_checkpoint active = local > zamd64 feature@spacemap_v2 active = local > zamd64 feature@allocation_classes enabled = local > zamd64 feature@resilver_defer enabled = local > zamd64 feature@bookmark_v2 enabled = local > zamd64 feature@redaction_bookmarks enabled = local > zamd64 feature@redacted_datasets enabled = local > zamd64 feature@bookmark_written enabled = local > zamd64 feature@log_spacemap active = local > zamd64 feature@livelist enabled = local > zamd64 feature@device_rebuild enabled = local > zamd64 feature@zstd_compress enabled = local > zamd64 feature@draid enabled = local > zamd64 feature@zilsaxattr active = local > zamd64 feature@head_errlog active = local > zamd64 feature@blake3 enabled = local > zamd64 feature@block_cloning enabled = local > zamd64 feature@vdev_zaps_v2 active = local > zamd64 feature@redaction_list_spill disabled = local >=20 > /etc/sysctl.conf does have: >=20 > vfs.zfs.min_auto_ashift=3D12 > vfs.zfs.per_txg_dirty_frees_percent=3D5 >=20 > The vfs.zfs.per_txg_dirty_frees_percent is from prior > Mateusz Guzik help, where after testing the change I > reported: >=20 > Result summary: Seems to have avoided the sustained periods > of low load average activity. Much better for the context. >=20 > But it was for a different machine (aarch64, 8 cores). But > it was for poudriere bulk use. >=20 > Turns out the default of 30 was causing sort of like > what is seen here: I could have presented some of the > information via the small load average figures here. >=20 > (Note: 5 is the old default, 30 is newer. Other contexts > have other problems with 5: no single right setting and > no automated configuration.) >=20 > Other than those 2 items, zfs is untuned (defaults). >=20 > sysctl -a is a lot more output (864930 Bytes) so I'll skip > it for now. >=20 >> PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me = shiver. Make sure there is no storage problems, like some huge delays, = timeouts, etc, that can be seen, for example, as busy percents regularly = spiking far above 100% in your `gstat -spod`. >>=20 >=20 > The "gstat -spod" output showed (and shows): around 0.8ms/w to 3ms/w, > mostly at the lower end of the range. < 98%busy, no spikes to > 100%. > It is a previously unused Samsung PSSD T7 Touch. A little more context here: that is for the "kB" figures seen during the cleanup/delete activity. During port builds into packages larger "kB" figures are seen and the ms/w figures will tend to be larger as well. The larger sizes can also lead to reaching somewhat above 100 %busy some of the time. I'll also note that I've ended up doing a lot more write activity exploring than I'd expected. > I was not prepared to replace the content of a PCIe slot's media > or M.2 connection's media for the temporary purpose. No spare > supply for those so no simple swapping for those. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 09:56:53 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfPF42957z4rRwr for ; Mon, 4 Sep 2023 09:57:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-23.consmr.mail.gq1.yahoo.com (sonic303-23.consmr.mail.gq1.yahoo.com [98.137.64.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfPF23Qhnz3Cqw for ; Mon, 4 Sep 2023 09:57:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=iHWcXbE1; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693821428; bh=NFiWHdIsJzWn1ErCVl7kd+aBOElqxl6VmMbadABmM2A=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=iHWcXbE1IYKP3w9qHrOluJ2V8DIPPoxmOecipf4ePMzqh29oe2ukQtJlQkLt9AgMZMPKq5oautSZC+vBN+EiUt+89uTB6wE78rokkB2LCPfLF0IeiY1Zc+5HJ52FrlcLGnXEzTd4Fg7UAqY5Q+SrWp/FQcNa0VaVgS22tkVz/Egp4+2Gkufs4No3RqpT+Cb50dN8e9GzheS4XOPypOQOt/SuOsQchjOfVAWSnkswpHQWVcr0fBlnJNLoTO+srmSA6082OfuKooyMTQsewu5rbW2lh5Mdvk2ZuQhb+vSxCICZy6HBeBs5D60zg71tiU4eLPos+baQYn6lXH9BX2UjfA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693821428; bh=CJUNwyW7sprvM9gODyQOUN09iHl+6NOb8BYGg3YnCMz=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=RvFV9lYXdDqaw2HaIZAgHCaVXaUF2fcDYcXaZGNMYxdOOaUa1XfZiXWRy37rqgFrxlQGd/ZUdKy5C3kuMoBdntIGsufYffvWi/oEEgPxYpXVy0nban3pXY89fum3Pjt/hNSyrrghNU7+eoaiBCPDADcoPtua5SkEu96D8fFKlG4vWYwQBbGscMT4sncdMolEM+t53gdDskj9ytR8VQMvlGMagkM9j0pZXyo9KbPPshluXptK1haSHYiSAHegNXb1/IMf1/bPrYv6H49BYR3jhRNPmn8hniKSut/D9b4P4rJS13ispCW3uMUNBBRms+Z6cJcjjZXi0J7LQ6Nn3t5OUQ== X-YMail-OSG: uvJb7sMVM1kJ1TvOKlB5RVRP9iq0mP97tuWMBlnnQWZtFcCsKp.eCDr6fsV6otc V0hlc5GonkH.p1EnKA8zGKLCaPtMMJ4c1OHziuHv9R53SNFgb2BskSYduDRK6Of8NBnGxkbaAl.W K.WGsfMsT_vGE1I1_qftf8jXYms_Yba3C7k_kmaFIEaLYcIshq3fQcrbt_HRwfYZ39D1OOjXJ87N DIP15rehie3Qy.oInzGVNYwxTr_iVpMAZomk1rEmwZu3Jub7vR2v235d09QTpm7SFHQDT51hIpVT 8d2FTB2lh0r6OAjGiZd9ubG5On4LOcf0FgE7qHikqkPYKHHZdbxixRtcpLMrjPtQJU4FScad0DE7 eVe1rKfl002AzlteQwa3FReENIA0.mDkobjcjnnwFKOvHOi9Wvy5eWkeRF6.IH2gIaZKg3jt18ii IUFKNv9gSXKXqPrYtB9hZ2qTauY2n5TfPw5KgqKxk60HvRqVHBfqLohk4hLrz3WruofMObOMF5kf na.NyY3CTPAq.Ah6Jg8LIO38Wjy9xSlFtQiS6pxESuRE3QphOyJZQuUUR2g2HqPRhC6hY8BY.eu9 ZAWS3Pb3RX6yC7cqXSh__Zf4jFch6ABl_aiNHyjnnVNc9NvSStVAyYnUInUDxyn4nr5Rr_kpaSWe CvmKUlAjM4NBRizlwJgSjP085uhNHGEndgXG93lSINVqoZkXY2GMWZAu3P1t.BHcsuGSL7eMCf7Y mw050NgSx.0mVQUKYMdu5_eWQmQfEKTrzHB9uoByOPIOhHoCNu3Ru0caP97vCDYmQmDyDGLi3GpO KBE7xUzhgI6ZmDYoS0NM.3L4XmwAopR2U0sHdeOuTmDJLE8d.ZT8QldLVG0PO5VH.9mVDNIeLJWA f_ublXf851eHrVv6POInhx5Mw.tvBSj4k1kek_hFQ857bjEqEj9PemmQcDXmhOPbL9PSGZoVditM yzD03j4d0am0iJS.WqI7lb6NCpZuhDSFkwWyU2s0N96EsPdP7ptvYUzfRcunmAR5txtwdnmbsnKY M8ePcvlP5GU2mPicVJdkIVKMMocWnfOkfTI6PyY0JKlbLTUTt3ty4bpSS3F.5_uNVi_e7sH7H6SU EeZXVLVLT4DO5iCgwmOOPkkw7qODSvQH2ItI3vF7A9_Qt.UBtELjf5aNW_ECjEfd0v0uYYPNaVBa UIFFlHYf9H0FqBifEUeYBUwzHJgbNuSTnP59PzMSsuIbGG0JIcyqTxivY3nNg4Nh6nVGl9l2HL84 76T3GV3qx3EwHvG2Z5tBtjwTHWG7PsMWIeVszPgglfAmWH7RJEDsKx.HIJglY5YcGUpBS31_j1In iBFA7uH.qrAcDlI43ozjzxym1eLgG.ncd24uF_GgsKmMHDTG7IHE_BapSgcpmgc7gohH2aJF7c81 grMYFw7CWpr5dL9k9PhkyCg6V3JP2GrQA0nrfU5Xo_1Jqqytposg3cR15XIO5mBfDcKgp9MExRIu gJ5DWh2MdKYLXbgdqIq3oiU0X1plai17RnFonIMS4T.xw_c3q7_4N9UVFV912GnNkHOS33VNRZ9c 50pfaIwK3_t6PKc6yEdS2rucdb8r2VXZ9Qe9dQEZCbWl339FOOakeYrJ8ndEsuqZusItF7gFS3lY yOcg4qh9rzY9ttG46KByzLr6pB2APsEd52_y4uonNLfF1EG14HrVLeSPeFwRwmnbKPEjC2QsO5gK h.dD5n1FSaaU_hmI8Y4tuy0T.wPT4UjPw7Lx1moNu6_LN3DD1QG7EABiTq.HOtzXO0yUkk6BSHx2 otRG6x9MidALbbH0yro.ZSn4Dsklo9CBx5uK4XLHqJ9_qBOwo95wwFadim.oDqa3dY8JVgKAAQSa h5IvgJUdk2kENZJ9B8GEK0iHNq0QPPZLOHZnvbFpAwIziyKtjDstjYaVjt349vP0JEAUQXmzylzd O_RKnlmV.qko7WageZ3WNFstisXg4g8YfUi3SgBnaLjItI_1XATbxVZvPXqPU8TR5a89c013ws.y aYTSe0my8YZGMU9p14fWQ.oECju748C1lxDE3ThY.IxoASy44nIe1kDdVN2TqSNjPWEO39.UfZ_H JQ1luF7gNcBhgKts786fJwjevbczJh68nU.alQhvlwy4ZG.JBTOrr99Qis986FnJsDSIUotiK7XB ybyg.QQRDSDepqCCnynmg7asfsFqM9okaidpHlVVEgcc2cfVx_aYJXJRmgIsmmBlYyKynn_bcXRV 6oxmdHJngbQY6kFtpZYN3m9_HEuJvWgxw_oVzNm5qJsNAcGtyB74mJR8aSQhFK.ZBiCaDhHhJxTk TVlw- X-Sonic-MF: X-Sonic-ID: 564e4d60-190f-4343-8ab5-678944ecda5e Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 09:57:08 +0000 Received: by hermes--production-gq1-6b7c87dcf5-rj56s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID bd7e704fa70995972c77a0f07d2f2e73; Mon, 04 Sep 2023 09:57:03 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> Date: Mon, 4 Sep 2023 02:56:53 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.48 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.983]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.64.204:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.204:from]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfPF23Qhnz3Cqw On Sep 4, 2023, at 02:00, Mark Millard wrote: > On Sep 3, 2023, at 23:35, Mark Millard wrote: >=20 >> On Sep 3, 2023, at 22:06, Alexander Motin wrote: >>=20 >>>=20 >>> On 03.09.2023 22:54, Mark Millard wrote: >>>> After that ^t produced the likes of: >>>> load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k >>>=20 >>> So the full state is not "tx->tx", but is actually a = "tx->tx_quiesce_done_cv", which means the thread is waiting for new = transaction to be opened, which means some previous to be quiesced and = then synced. >>>=20 >>>> #0 0xffffffff80b6f103 at mi_switch+0x173 >>>> #1 0xffffffff80bc0f24 at sleepq_switch+0x104 >>>> #2 0xffffffff80aec4c5 at _cv_wait+0x165 >>>> #3 0xffffffff82aba365 at txg_wait_open+0xf5 >>>> #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 >>>=20 >>> Here it seems like transaction commit is waited due to large amount = of delete operations, which ZFS tries to spread between separate TXGs. >>=20 >> That fit the context: cleaning out /usr/local/poudriere/data/.m/ >>=20 >>> You should probably see some large and growing number in sysctl = kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . >>=20 >> After the reboot I started a -J64 example. It has avoided the >> early "witness exhausted". Again I ^C'd after about an hours >> after the 2nd builder had started. So: again cleaning out >> /usr/local/poudriere/data/.m/ Only seconds between: >>=20 >> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276042 >>=20 >> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276427 >>=20 >> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 277323 >>=20 >> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 278027 >>=20 >> I have found a measure of progress: zfs list's USED >> for /usr/local/poudriere/data/.m is decreasing. So >> ztop's d/s was a good classification: deletes. >>=20 >>>> #5 0xffffffff829a87d2 at zfs_rmnode+0x72 >>>> #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d >>>> #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 >>>> #8 0xffffffff80c5a7d9 at vgonel+0x3a9 >>>> #9 0xffffffff80c5af7f at vrecycle+0x3f >>>> #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e >>>> #11 0xffffffff80c598cf at vinactivef+0xbf >>>> #12 0xffffffff80c590da at vput_final+0x2aa >>>> #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 >>>> #14 0xffffffff80c68588 at sys_unlink+0x28 >>>> #15 0xffffffff8106323f at amd64_syscall+0x14f >>>> #16 0xffffffff8103512b at fast_syscall_common+0xf8 >>>=20 >>> What we don't see here is what quiesce and sync threads of the pool = are actually doing. Sync thread has plenty of different jobs, including = async write, async destroy, scrub and others, that all may delay each = other. >>>=20 >>> Before you rebooted the system, depending how alive it is, could you = save a number of outputs of `procstat -akk`, or at least specifically = `procstat -akk | grep txg_thread_enter` if the full is hard? Or somehow = else observe what they are doing. >>=20 >> # procstat -akk > ~/mmjnk00.txt >> # procstat -akk > ~/mmjnk01.txt >> # procstat -akk > ~/mmjnk02.txt >> # procstat -akk > ~/mmjnk03.txt >> # procstat -akk > ~/mmjnk04.txt >> # procstat -akk > ~/mmjnk05.txt >> # grep txg_thread_enter ~/mmjnk0[0-5].txt >> /usr/home/root/mmjnk00.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk00.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk01.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk01.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk02.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk02.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk03.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk03.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk04.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk04.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk05.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe=20 >> /usr/home/root/mmjnk05.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe=20 >>=20 >> (Hopefully that will be a sufficiently useful start.) >>=20 >>> `zpool status`, `zpool get all` and `sysctl -a` would also not harm. >>=20 >> It is a very simple zpool configuration: one partition. >> I only use it for bectl BE reasons, not the general >> range of reasons for using zfs. I created the media with >> my normal content, then checkpointed before doing the >> git fetch to start to set up the experiment. >>=20 >> # zpool status >> pool: zamd64 >> state: ONLINE >> status: Some supported and requested features are not enabled on the = pool. >> The pool can still be used, but some features are unavailable. >> action: Enable all features using 'zpool upgrade'. Once this is done, >> the pool may no longer be accessible by software that does not = support >> the features. See zpool-features(7) for details. >> checkpoint: created Sun Sep 3 11:46:54 2023, consumes 2.17M >> config: >>=20 >> NAME STATE READ WRITE CKSUM >> zamd64 ONLINE 0 0 0 >> gpt/amd64zfs ONLINE 0 0 0 >>=20 >> errors: No known data errors >>=20 >> There was also a snapshot in place before I did the >> checkpoint operation. >>=20 >> I deliberately did not use my typical openzfs-2.1-freebsd=20 >> for compatibility but used defaults when creating the pool: >>=20 >> # zpool get all >> NAME PROPERTY VALUE = SOURCE >> zamd64 size 872G = - >> zamd64 capacity 21% = - >> zamd64 altroot - = default >> zamd64 health ONLINE = - >> zamd64 guid 4817074778276814820 = - >> zamd64 version - = default >> zamd64 bootfs zamd64/ROOT/main-amd64 = local >> zamd64 delegation on = default >> zamd64 autoreplace off = default >> zamd64 cachefile - = default >> zamd64 failmode wait = default >> zamd64 listsnapshots off = default >> zamd64 autoexpand off = default >> zamd64 dedupratio 1.00x = - >> zamd64 free 688G = - >> zamd64 allocated 184G = - >> zamd64 readonly off = - >> zamd64 ashift 0 = default >> zamd64 comment - = default >> zamd64 expandsize - = - >> zamd64 freeing 0 = - >> zamd64 fragmentation 17% = - >> zamd64 leaked 0 = - >> zamd64 multihost off = default >> zamd64 checkpoint 2.17M = - >> zamd64 load_guid 17719601284614388220 = - >> zamd64 autotrim off = default >> zamd64 compatibility off = default >> zamd64 bcloneused 0 = - >> zamd64 bclonesaved 0 = - >> zamd64 bcloneratio 1.00x = - >> zamd64 feature@async_destroy enabled = local >> zamd64 feature@empty_bpobj active = local >> zamd64 feature@lz4_compress active = local >> zamd64 feature@multi_vdev_crash_dump enabled = local >> zamd64 feature@spacemap_histogram active = local >> zamd64 feature@enabled_txg active = local >> zamd64 feature@hole_birth active = local >> zamd64 feature@extensible_dataset active = local >> zamd64 feature@embedded_data active = local >> zamd64 feature@bookmarks enabled = local >> zamd64 feature@filesystem_limits enabled = local >> zamd64 feature@large_blocks enabled = local >> zamd64 feature@large_dnode enabled = local >> zamd64 feature@sha512 enabled = local >> zamd64 feature@skein enabled = local >> zamd64 feature@edonr enabled = local >> zamd64 feature@userobj_accounting active = local >> zamd64 feature@encryption enabled = local >> zamd64 feature@project_quota active = local >> zamd64 feature@device_removal enabled = local >> zamd64 feature@obsolete_counts enabled = local >> zamd64 feature@zpool_checkpoint active = local >> zamd64 feature@spacemap_v2 active = local >> zamd64 feature@allocation_classes enabled = local >> zamd64 feature@resilver_defer enabled = local >> zamd64 feature@bookmark_v2 enabled = local >> zamd64 feature@redaction_bookmarks enabled = local >> zamd64 feature@redacted_datasets enabled = local >> zamd64 feature@bookmark_written enabled = local >> zamd64 feature@log_spacemap active = local >> zamd64 feature@livelist enabled = local >> zamd64 feature@device_rebuild enabled = local >> zamd64 feature@zstd_compress enabled = local >> zamd64 feature@draid enabled = local >> zamd64 feature@zilsaxattr active = local >> zamd64 feature@head_errlog active = local >> zamd64 feature@blake3 enabled = local >> zamd64 feature@block_cloning enabled = local >> zamd64 feature@vdev_zaps_v2 active = local >> zamd64 feature@redaction_list_spill disabled = local >>=20 >> /etc/sysctl.conf does have: >>=20 >> vfs.zfs.min_auto_ashift=3D12 >> vfs.zfs.per_txg_dirty_frees_percent=3D5 >>=20 >> The vfs.zfs.per_txg_dirty_frees_percent is from prior >> Mateusz Guzik help, where after testing the change I >> reported: >>=20 >> Result summary: Seems to have avoided the sustained periods >> of low load average activity. Much better for the context. >>=20 >> But it was for a different machine (aarch64, 8 cores). But >> it was for poudriere bulk use. >>=20 >> Turns out the default of 30 was causing sort of like >> what is seen here: I could have presented some of the >> information via the small load average figures here. >>=20 >> (Note: 5 is the old default, 30 is newer. Other contexts >> have other problems with 5: no single right setting and >> no automated configuration.) >>=20 >> Other than those 2 items, zfs is untuned (defaults). >>=20 >> sysctl -a is a lot more output (864930 Bytes) so I'll skip >> it for now. >>=20 >>> PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me = shiver. Make sure there is no storage problems, like some huge delays, = timeouts, etc, that can be seen, for example, as busy percents regularly = spiking far above 100% in your `gstat -spod`. >>>=20 >>=20 >> The "gstat -spod" output showed (and shows): around 0.8ms/w to 3ms/w, >> mostly at the lower end of the range. < 98%busy, no spikes to > 100%. >> It is a previously unused Samsung PSSD T7 Touch. >=20 > A little more context here: that is for the "kB" figures seen > during the cleanup/delete activity. During port builds into > packages larger "kB" figures are seen and the ms/w figures > will tend to be larger as well. The larger sizes can also > lead to reaching somewhat above 100 %busy some of the time. >=20 > I'll also note that I've ended up doing a lot more write > activity exploring than I'd expected. >=20 >> I was not prepared to replace the content of a PCIe slot's media >> or M.2 connection's media for the temporary purpose. No spare >> supply for those so no simple swapping for those. >=20 >=20 Trying -J36 (so: 32+4) got to 470 built in about an hour after [02] reached "Builder started". /usr/local/poudriere/data/.m used a little under 40 GiBytes at that point. (I do not have a file count.) The cleanup seems to have gone somewhat faster after my ^C for this context: ^C[01:20:20] Error: Signal SIGINT caught, cleaning up and exiting [01:20:20] [27] [00:02:54] Finished math/p5-Data-Float | = p5-Data-Float-0.013: Success [main-amd64-bulk_a-default] [2023-09-04_00h30m42s] [sigint:] Queued: = 34588 Built: 502 Failed: 1 Skipped: 50 Ignored: 335 Fetched: = 0 Tobuild: 33700 Time: 01:20:12 [01:20:22] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-04_0= 0h30m42s [01:20:23] [25] [00:04:46] Finished www/p5-HTML-TreeBuilder-XPath | = p5-HTML-TreeBuilder-XPath-0.14_1: Success [01:20:24] Cleaning up [02:17:01] Unmounting file systems Exiting with status 1 So it took about an hour to cleanup after 502 port builds into packages (not published, though). ( gstat -spod showed a fairly general, sustained lack of read activity, instead of the comparitively small sustained amount I'd not mentioned for the previous explorations. May be that helped. ) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 12:26:05 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfSXw1DnPz4sSHq for ; Mon, 4 Sep 2023 12:26:08 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc2c.google.com (mail-oo1-xc2c.google.com [IPv6:2607:f8b0:4864:20::c2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfSXv6kdGz4Cnp for ; Mon, 4 Sep 2023 12:26:07 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oo1-xc2c.google.com with SMTP id 006d021491bc7-57325fcd970so895491eaf.1 for ; Mon, 04 Sep 2023 05:26:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693830366; x=1694435166; darn=freebsd.org; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=xK3NAf01nk+yuFFKrzJLlLVQeM8QbCiKpkH8czocnl0=; b=SSNlSI5PNWAKtkDrYsCDt1ZL5DAu2jhTj2SS6e2hlWXXy1xdH3NGMDPHkt9LJrDjr7 s8uzal+0MD4wSZIQ4atwq4cD4KvcDrzGrVhU6mX7i1oZt2y0K+5BpNPSf8IHUKoerSlI qeNXcIowt7KOvJzL4TckQQdf+ygCxZYklGO+9fipp7hlIhdBjPVBblo+fPKA24w2Koct 3BbWW/W5kF+BDS0wDr23ReKaqJu8Lp+2gdDwZdn7Yj90jltvPyi/P+ggyku3ixDZK/Yh 4MAPGuI1Q/HEwVEpsKYkRYqv/UjwZcbxLgekdbUDElfoxERtND97L1pPDMhKwM+adWhP 4gyg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693830366; x=1694435166; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=xK3NAf01nk+yuFFKrzJLlLVQeM8QbCiKpkH8czocnl0=; b=SVnal+/OqjHXSbCaA8lSJQlnd4BRXEhJJbNyDcXS4KR4DCZCjUYYMNM/JJ1SxVV5cP jEoQUTWA/LCy7bKfQkAAB0F/mlUWIodKvQhWXcF2psuQhN4FOwTP58iNSTX9t/t4OQRW ONZ4q26m63n/GZdBv2xZqBpfIYk39BpQnh8XMaTVszhquqGbg1Hw+NJueo5jEcTEB+bM un89+2a4DhdWwofTTEPy+8zyFk+SdVA6j/wTEOymx8kyKUHEreldXstlHBfdWfIdJIFw uxASxVN/3aSG9NjYQKFAGW5yEFkZHVj0Tj5pYO/rCLvCq8DbmDf1YAaeMJ06KdoaieDS exeg== X-Gm-Message-State: AOJu0YxGGldMoABzzckfyp/V8tn1R4wlA65WZ6gRI1tpbA+A8fBvjYOv QnH5nC9o7v0vORUg8Vx4/oyWOiyCoZqjzw5iHNg= X-Google-Smtp-Source: AGHT+IGoNvENWDjGaZYdkdFD2DeBsZnbvo6CGLWRlwAPunk6bwLrGMYZUC/eqGO68mdMvPYFBQm5cymHmKbRycd08+4= X-Received: by 2002:a4a:9c01:0:b0:570:be00:5e14 with SMTP id y1-20020a4a9c01000000b00570be005e14mr8306141ooj.8.1693830366458; Mon, 04 Sep 2023 05:26:06 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a8a:60c:0:b0:4f0:1250:dd51 with HTTP; Mon, 4 Sep 2023 05:26:05 -0700 (PDT) In-Reply-To: <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> References: <88e837aeb5a65c1f001de2077fb7bcbd@Leidinger.net> <4d60bd12b482e020fd4b186a9ec1a250@Leidinger.net> <73f7c9d3db8f117deb077fb17b1e352a@Leidinger.net> <58493b568dbe9fb52cc55de86e01f5e2@Leidinger.net> <58ac6211235c52d744666e8ae2ec7568@Leidinger.net> <444770b977b02b98985928bea450e4ce@Leidinger.net> <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> From: Mateusz Guzik Date: Mon, 4 Sep 2023 14:26:05 +0200 Message-ID: Subject: Re: Speed improvements in ZFS To: Alexander Leidinger Cc: Konstantin Belousov , current@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RfSXv6kdGz4Cnp On 9/4/23, Alexander Leidinger wrote: > Am 2023-08-28 22:33, schrieb Alexander Leidinger: >> Am 2023-08-22 18:59, schrieb Mateusz Guzik: >>> On 8/22/23, Alexander Leidinger wrote: >>>> Am 2023-08-21 10:53, schrieb Konstantin Belousov: >>>>> On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: >>>>>> Am 2023-08-20 23:17, schrieb Konstantin Belousov: >>>>>> > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: >>>>>> > > On 8/20/23, Alexander Leidinger wrote: >>>>>> > > > Am 2023-08-20 22:02, schrieb Mateusz Guzik: >>>>>> > > >> On 8/20/23, Alexander Leidinger >>>>>> > > >> wrote: >>>>>> > > >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: >>>>>> > > >>>> On 8/18/23, Alexander Leidinger >>>>>> > > >>>> wrote: >>>>>> > > >>> >>>>>> > > >>>>> I have a 51MB text file, compressed to about 1MB. Are you >>>>>> > > >>>>> interested >>>>>> > > >>>>> to >>>>>> > > >>>>> get it? >>>>>> > > >>>>> >>>>>> > > >>>> >>>>>> > > >>>> Your problem is not the vnode limit, but nullfs. >>>>>> > > >>>> >>>>>> > > >>>> https://people.freebsd.org/~mjg/netchild-periodic-find.svg >>>>>> > > >>> >>>>>> > > >>> 122 nullfs mounts on this system. And every jail I setup has >>>>>> > > >>> several >>>>>> > > >>> null mounts. One basesystem mounted into every jail, and then >>>>>> > > >>> shared >>>>>> > > >>> ports (packages/distfiles/ccache) across all of them. >>>>>> > > >>> >>>>>> > > >>>> First, some of the contention is notorious VI_LOCK in order >>>>>> > > >>>> to >>>>>> > > >>>> do >>>>>> > > >>>> anything. >>>>>> > > >>>> >>>>>> > > >>>> But more importantly the mind-boggling off-cpu time comes >>>>>> > > >>>> from >>>>>> > > >>>> exclusive locking which should not be there to begin with -- >>>>>> > > >>>> as >>>>>> > > >>>> in >>>>>> > > >>>> that xlock in stat should be a slock. >>>>>> > > >>>> >>>>>> > > >>>> Maybe I'm going to look into it later. >>>>>> > > >>> >>>>>> > > >>> That would be fantastic. >>>>>> > > >>> >>>>>> > > >> >>>>>> > > >> I did a quick test, things are shared locked as expected. >>>>>> > > >> >>>>>> > > >> However, I found the following: >>>>>> > > >> if ((xmp->nullm_flags & NULLM_CACHE) != 0) { >>>>>> > > >> mp->mnt_kern_flag |= >>>>>> > > >> lowerrootvp->v_mount->mnt_kern_flag & >>>>>> > > >> (MNTK_SHARED_WRITES | MNTK_LOOKUP_SHARED | >>>>>> > > >> MNTK_EXTENDED_SHARED); >>>>>> > > >> } >>>>>> > > >> >>>>>> > > >> are you using the "nocache" option? it has a side effect of >>>>>> > > >> xlocking >>>>>> > > > >>>>>> > > > I use noatime, noexec, nosuid, nfsv4acls. I do NOT use nocache. >>>>>> > > > >>>>>> > > >>>>>> > > If you don't have "nocache" on null mounts, then I don't see how >>>>>> > > this >>>>>> > > could happen. >>>>>> > >>>>>> > There is also MNTK_NULL_NOCACHE on lower fs, which is currently set >>>>>> > for >>>>>> > fuse and nfs at least. >>>>>> >>>>>> 11 of those 122 nullfs mounts are ZFS datasets which are also NFS >>>>>> exported. >>>>>> 6 of those nullfs mounts are also exported via Samba. The NFS >>>>>> exports >>>>>> shouldn't be needed anymore, I will remove them. >>>>> By nfs I meant nfs client, not nfs exports. >>>> >>>> No NFS client mounts anywhere on this system. So where is this >>>> exclusive >>>> lock coming from then... >>>> This is a ZFS system. 2 pools: one for the root, one for anything I >>>> need >>>> space for. Both pools reside on the same disks. The root pool is a >>>> 3-way >>>> mirror, the "space-pool" is a 5-disk raidz2. All jails are on the >>>> space-pool. The jails are all basejail-style jails. >>>> >>> >>> While I don't see why xlocking happens, you should be able to dtrace >>> or printf your way into finding out. >> >> dtrace looks to me like a faster approach to get to the root than >> printf... my first naive try is to detect exclusive locks. I'm not 100% >> sure I got it right, but at least dtrace doesn't complain about it: >> ---snip--- >> #pragma D option dynvarsize=32m >> >> fbt:nullfs:null_lock:entry >> /args[0]->a_flags & 0x080000 != 0/ >> { >> stack(); >> } >> ---snip--- >> >> In which direction should I look with dtrace if this works in tonights >> run of periodic? I don't have enough knowledge about VFS to come up >> with some immediate ideas. > > After your sysctl fix for maxvnodes I increased the amount of vnodes 10 > times compared to the initial report. This has increased the speed of > the operation, the find runs in all those jails finished today after ~5h > (@~8am) instead of in the afternoon as before. Could this suggest that > in parallel some null_reclaim() is running which does the exclusive > locks and slows down the entire operation? > That may be a slowdown to some extent, but the primary problem is exclusive vnode locking for stat lookup, which should not be happening. -- Mateusz Guzik From nobody Mon Sep 4 13:09:58 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfTWd0MRFz4sfCW; Mon, 4 Sep 2023 13:10:05 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x112c.google.com (mail-yw1-x112c.google.com [IPv6:2607:f8b0:4864:20::112c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfTWc5sSfz4Lsw; Mon, 4 Sep 2023 13:10:04 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112c.google.com with SMTP id 00721157ae682-58d9ba95c78so13678847b3.1; Mon, 04 Sep 2023 06:10:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693833003; x=1694437803; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=enEXGogrCrBv00PRAD0aNwbkBdJkNW03jgW6e26rZw8=; b=eK9XnVNSuOE8uD56rCx0RTWIxvYvzq45+gO+kODC02g+yapyTdKedonLKrw2dP2Bal g2khEGgOdEpYIZFjm2MramQo8RmdO8myUN30B7CFqU2UaixYd+vqjjzUECL3+fMMGMKa RQLq2OjM+dN4x74hBl0D8XkAJIqxmSOenFjWQbOcVE6flrl+BjM3imaHpXKK/0LuLXcR N1YzCe9HFcY7vEIs0n2/qPD8kX2ryFsBzaY/w630hiMOfTg9oT031kns40G43iYbIjlP 3cFnd4iK2Owbn4J5JJ/KEtjDqWoJefcuTLhSSv4FnBkt7w7MRaS8MwAzvux+UPcfz9cY CLkg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693833003; x=1694437803; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=enEXGogrCrBv00PRAD0aNwbkBdJkNW03jgW6e26rZw8=; b=aqrQP9iU6AYpSaN7E1I1w0nlQss+oBzyOJC0uwWwN4OjcAM1CpXLHp4SK6iU9DouzI URsMJR0M484Ty0JUcSgnOr0SFkfU4MePo/r0Th6H2+fmCTjfGrpjeR+/gtHtJ5KELdu4 KVOW6OCUFkgKIi3fYLi7CZA4vtaJusoXkrg4BS53/uKhGE4miPpue2GDiV76YuWFK5vn WqSTdMsKt9qWn3ufrQ2ejF51KFA5E3pvZeS2G4hApWRYQzKyUUtivwXcKF0C+lA8DKfm zpRgU7H+z3hGCMKBG2dBZPjeov6vGtepzoMeIuydbriordDh9kyW9e0NNLXjY8LhPKj6 HTRw== X-Gm-Message-State: AOJu0Ywllnxb2oZSl51Tpex1NNLqR0+5vG2Z+AFKRCwxt1I+xb678zWa s9MaG5CaOJ6tS6yx3qxMAhk= X-Google-Smtp-Source: AGHT+IEuX1wTM2L/qEVg16VGY0usasUa7ZzaPGZf6KbbP5omiM0H1CpfICDvA0rY2wCmd4zp6nW6rw== X-Received: by 2002:a81:6c04:0:b0:583:8c5e:a3fa with SMTP id h4-20020a816c04000000b005838c5ea3famr10344243ywc.8.1693833002844; Mon, 04 Sep 2023 06:10:02 -0700 (PDT) Received: from [192.168.1.66] (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id m13-20020a81404d000000b00586108dd8f5sm1991603ywn.18.2023.09.04.06.10.02 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 04 Sep 2023 06:10:02 -0700 (PDT) Message-ID: <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> Date: Mon, 4 Sep 2023 09:09:58 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned Content-Language: en-US To: Mark Millard Cc: dev-commits-src-main@freebsd.org, Current FreeBSD References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> From: Alexander Motin In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RfTWc5sSfz4Lsw On 04.09.2023 05:56, Mark Millard wrote: > On Sep 4, 2023, at 02:00, Mark Millard wrote: >> On Sep 3, 2023, at 23:35, Mark Millard wrote: >>> On Sep 3, 2023, at 22:06, Alexander Motin wrote: >>>> On 03.09.2023 22:54, Mark Millard wrote: >>>>> After that ^t produced the likes of: >>>>> load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u 121.32s 1% 13004k >>>> >>>> So the full state is not "tx->tx", but is actually a "tx->tx_quiesce_done_cv", which means the thread is waiting for new transaction to be opened, which means some previous to be quiesced and then synced. >>>> >>>>> #0 0xffffffff80b6f103 at mi_switch+0x173 >>>>> #1 0xffffffff80bc0f24 at sleepq_switch+0x104 >>>>> #2 0xffffffff80aec4c5 at _cv_wait+0x165 >>>>> #3 0xffffffff82aba365 at txg_wait_open+0xf5 >>>>> #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 >>>> >>>> Here it seems like transaction commit is waited due to large amount of delete operations, which ZFS tries to spread between separate TXGs. >>> >>> That fit the context: cleaning out /usr/local/poudriere/data/.m/ >>> >>>> You should probably see some large and growing number in sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . >>> >>> After the reboot I started a -J64 example. It has avoided the >>> early "witness exhausted". Again I ^C'd after about an hours >>> after the 2nd builder had started. So: again cleaning out >>> /usr/local/poudriere/data/.m/ Only seconds between: >>> >>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276042 >>> >>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276427 >>> >>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 277323 >>> >>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 278027 As expected, deletes trigger and wait for TXG commits. >>> I have found a measure of progress: zfs list's USED >>> for /usr/local/poudriere/data/.m is decreasing. So >>> ztop's d/s was a good classification: deletes. >>> >>>>> #5 0xffffffff829a87d2 at zfs_rmnode+0x72 >>>>> #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d >>>>> #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 >>>>> #8 0xffffffff80c5a7d9 at vgonel+0x3a9 >>>>> #9 0xffffffff80c5af7f at vrecycle+0x3f >>>>> #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e >>>>> #11 0xffffffff80c598cf at vinactivef+0xbf >>>>> #12 0xffffffff80c590da at vput_final+0x2aa >>>>> #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 >>>>> #14 0xffffffff80c68588 at sys_unlink+0x28 >>>>> #15 0xffffffff8106323f at amd64_syscall+0x14f >>>>> #16 0xffffffff8103512b at fast_syscall_common+0xf8 >>>> >>>> What we don't see here is what quiesce and sync threads of the pool are actually doing. Sync thread has plenty of different jobs, including async write, async destroy, scrub and others, that all may delay each other. >>>> >>>> Before you rebooted the system, depending how alive it is, could you save a number of outputs of `procstat -akk`, or at least specifically `procstat -akk | grep txg_thread_enter` if the full is hard? Or somehow else observe what they are doing. >>> >>> # grep txg_thread_enter ~/mmjnk0[0-5].txt >>> /usr/home/root/mmjnk00.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk00.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk01.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk01.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk02.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk02.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk03.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk03.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk04.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk04.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk05.txt: 6 100881 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 fork_trampoline+0xe >>> /usr/home/root/mmjnk05.txt: 6 100882 zfskern txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 fork_trampoline+0xe So quiesce threads are idle, while sync thread is waiting for TXG commit writes completion. I see no no crime, we should see the same just for slow storage. >>>> `zpool status`, `zpool get all` and `sysctl -a` would also not harm. >>> >>> It is a very simple zpool configuration: one partition. >>> I only use it for bectl BE reasons, not the general >>> range of reasons for using zfs. I created the media with >>> my normal content, then checkpointed before doing the >>> git fetch to start to set up the experiment. OK. And I see no scrub or async destroy, that could delay sync thread. Though I don't see them in the above procstat either. >>> /etc/sysctl.conf does have: >>> >>> vfs.zfs.min_auto_ashift=12 >>> vfs.zfs.per_txg_dirty_frees_percent=5 >>> >>> The vfs.zfs.per_txg_dirty_frees_percent is from prior >>> Mateusz Guzik help, where after testing the change I >>> reported: >>> >>> Result summary: Seems to have avoided the sustained periods >>> of low load average activity. Much better for the context. >>> >>> But it was for a different machine (aarch64, 8 cores). But >>> it was for poudriere bulk use. >>> >>> Turns out the default of 30 was causing sort of like >>> what is seen here: I could have presented some of the >>> information via the small load average figures here. >>> >>> (Note: 5 is the old default, 30 is newer. Other contexts >>> have other problems with 5: no single right setting and >>> no automated configuration.) per_txg_dirty_frees_percent is directly related to the delete delays we see here. You are forcing ZFS to commit transactions each 5% of dirty ARC limit, which is 5% of 10% or memory size. I haven't looked on that code recently, but I guess setting it too low can make ZFS commit transactions too often, increasing write inflation for the underlying storage. I would propose you to restore the default and try again. >>> Other than those 2 items, zfs is untuned (defaults). >>> >>> sysctl -a is a lot more output (864930 Bytes) so I'll skip >>> it for now. >>> >>>> PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me shiver. Make sure there is no storage problems, like some huge delays, timeouts, etc, that can be seen, for example, as busy percents regularly spiking far above 100% in your `gstat -spod`. >>> >>> The "gstat -spod" output showed (and shows): around 0.8ms/w to 3ms/w, >>> mostly at the lower end of the range. < 98%busy, no spikes to > 100%. >>> It is a previously unused Samsung PSSD T7 Touch. Is the ~98% busy most of the time there? Unfortunately our umass does not support UASP, i.e. supports only one command at a time, so many small I/Os may accumulate more latency than other interface storages would. Higher number of small transaction commits may not help it either. >> A little more context here: that is for the "kB" figures seen >> during the cleanup/delete activity. During port builds into >> packages larger "kB" figures are seen and the ms/w figures >> will tend to be larger as well. The larger sizes can also >> lead to reaching somewhat above 100 %busy some of the time. >> >> I'll also note that I've ended up doing a lot more write >> activity exploring than I'd expected. >> >>> I was not prepared to replace the content of a PCIe slot's media >>> or M.2 connection's media for the temporary purpose. No spare >>> supply for those so no simple swapping for those. > > Trying -J36 (so: 32+4) got to 470 built in about an hour > after [02] reached "Builder started". /usr/local/poudriere/data/.m > used a little under 40 GiBytes at that point. (I do not have > a file count.) > > The cleanup seems to have gone somewhat faster after my ^C for > this context: > > ^C[01:20:20] Error: Signal SIGINT caught, cleaning up and exiting > [01:20:20] [27] [00:02:54] Finished math/p5-Data-Float | p5-Data-Float-0.013: Success > [main-amd64-bulk_a-default] [2023-09-04_00h30m42s] [sigint:] Queued: 34588 Built: 502 Failed: 1 Skipped: 50 Ignored: 335 Fetched: 0 Tobuild: 33700 Time: 01:20:12 > [01:20:22] Logs: /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-04_00h30m42s > [01:20:23] [25] [00:04:46] Finished www/p5-HTML-TreeBuilder-XPath | p5-HTML-TreeBuilder-XPath-0.14_1: Success > [01:20:24] Cleaning up > [02:17:01] Unmounting file systems > Exiting with status 1 > > So it took about an hour to cleanup after 502 port builds into > packages (not published, though). > > ( gstat -spod showed a fairly general, sustained lack of read activity, > instead of the comparitively small sustained amount I'd not mentioned > for the previous explorations. May be that helped. ) I suppose more builders mean deleting more work directories same time? I don't know if it should cause cumulative effect, but I suppose should be at least linear. -- Alexander Motin From nobody Mon Sep 4 13:39:44 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfV9y4hnnz4rKVG for ; Mon, 4 Sep 2023 13:39:50 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfV9x4DfLz4SdV; Mon, 4 Sep 2023 13:39:49 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=usQon1fC; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=/jiETyrR0CEYinalSEIlU0r9gY4ABY8jViy5OL0YVqM=; b=usQon1fCoGGpjAuAN+jI6dTkxn 7rc9bgYlZt6tPCWIRg2OqQ37zB9ODfZNqTebfUOpI4exnRPuUYNRmUbN5YjdqrkYfRd7fz9ROzr0i PdeLCYA1vUqnXSZ+mv8why+zqzOeQ5Olu1qMiUN4/b7amJGrhHInnk8in5h7LiV+eRYxWW2mwSS0w SRlfgJsn1la1bsAivP3LkWQcr/hgONriO0JQ9XqVqAiiFBjpyGMa6whgtN5U+RSIoZ4IzkB30raKc dyggVJABTjFpbqV5e9OfWd5B3KLZOr00FtRYUd1St+rdeK9R1JDNHIiKzURnlQbAW2XdZzvRM958C 8K2QQm4A==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qd9nt-00BZiW-PS; Mon, 04 Sep 2023 15:39:45 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qd9nt-0000gK-1c; Mon, 04 Sep 2023 13:39:45 +0000 Date: Mon, 4 Sep 2023 15:39:44 +0200 From: Felix Palmen To: current@freebsd.org Cc: dchagin@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: Mail-Followup-To: current@freebsd.org, dchagin@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="h5drkoshdyr5cgaj" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.50 / 15.00]; SIGNED_PGP(-2.00)[]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; FROM_HAS_DN(0.00)[]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_COUNT_TWO(0.00)[2]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DKIM_TRACE(0.00)[palmen-it.de:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4RfV9x4DfLz4SdV --h5drkoshdyr5cgaj Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello Dmitry, * Dmitry Chagin [20230830 14:04]: > Thanks, I see, I agree with your change, taken into account. Thanks a lot for committing the fix/workaround as well as the new feature! I just upgraded my test builders to 15-CURRENT to double-check. For some reason (I still have to try to get more information about it, will do soon), something else is broken now. While install from GNU coreutils works fine, some build systems use 'cp -p' to install files instead, which now fails with: | cp: preserving permissions for [...]: Operation not permitted I'm pretty sure this worked fine with the patch you linked earlier, and also with my own change taking the namespace into account ... Did you change anything else in your commits compared to the patch? I'll post a followup as soon as I could get some truss output to know exactly which syscall causes the issue now! Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --h5drkoshdyr5cgaj Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPXeCV8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MRhWAP9WRB9bV3yYk7+M90vuqYWCEUrE5Nnr2B7U4aSvtf+8KgEAvRRIntkP4a1P 1dIFED8086/AR5ZOOKMQ/zrLMc2inwI= =kgWH -----END PGP SIGNATURE----- --h5drkoshdyr5cgaj-- From nobody Mon Sep 4 14:03:54 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfVjp5M84z4rSJP for ; Mon, 4 Sep 2023 14:03:58 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfVjn6xPSz4YGR; Mon, 4 Sep 2023 14:03:57 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=CQhQ4nAj; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=2cDPqmp5aBNeI9MmoBENfXjvTk5CFmYi3q0nlMsifBw=; b=CQhQ4nAjlz9HFD/aTvZQPjG7SJ X7pyN14aw/Pqwdl+A5LTJKZg6hsrBFKdUdq7ZDax1YvCY5ssAitIKuaA0WGFBQg64TX7dJXYCPQun djsDITih05vO12v3M2VvBdJSVCkoUjzt8imEzbg0juJoejT4i1SXy3/ULqw24RJxNlfrGpc3HiYG8 uTnDLeN5iucsyoYZiJ3NHaY7CQTclAzKMn+U5XmhR5lV6ap2XDYeUBOXroi+O0efLDsjuKwuWcwj8 qKEm4SZlUdczSXVLzeKABZcrcfrSc9DC6Pe/nS4WbPwFBHNAXqihbDGxo6Jyy4vmRpdgsi8ach96r LE5CzGrg==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qdABI-00BZko-1Y; Mon, 04 Sep 2023 16:03:56 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qdABH-0000nA-0o; Mon, 04 Sep 2023 14:03:55 +0000 Date: Mon, 4 Sep 2023 16:03:54 +0200 From: Felix Palmen To: current@freebsd.org Cc: dchagin@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> Mail-Followup-To: current@freebsd.org, dchagin@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ygr3ndkcrikak3m7" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.50 / 15.00]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1:c]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2001:470:1f0b:bbb:1::1:server fail]; DMARC_NA(0.00)[freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[palmen-it.de:+]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4RfVjn6xPSz4YGR --ygr3ndkcrikak3m7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Felix Palmen [20230904 15:39]: > For some reason (I still have to try to get more information about it, > will do soon), something else is broken now. While install from GNU > coreutils works fine, some build systems use 'cp -p' to install files > instead, which now fails with: >=20 > | cp: preserving permissions for [...]: Operation not permitted The issue seems to be with listing attributes: | root@15-default:/wrkdirs/usr/ports/x11/linuxsrc-libxcb/work/libxcb-1.15/d= oc # truss /compat/linux/bin/cp -pR ./tutorial '/wrkdirs/usr/ports/x11/linu= xsrc-libxcb/work/stage/compat/linux/usr/share/doc/libxcb/' 2>&1 | grep xattr | linux_flistxattr(0x4,0x0,0x0) ERR#-1 'Operation not pe= rmitted' | linux_flistxattr(0x4,0x0,0x0) ERR#-1 'Operation not pe= rmitted' | linux_llistxattr(0xffffffffcdd9,0x0,0x0) ERR#-1 'Operation not pe= rmitted' The following q&d patch makes it work again: #v+ diff --git a/sys/compat/linux/linux_xattr.c b/sys/compat/linux/linux_xattr.c index 74b47f1cbaec..0b5af084b1b1 100644 --- a/sys/compat/linux/linux_xattr.c +++ b/sys/compat/linux/linux_xattr.c @@ -198,7 +198,7 @@ listxattr(struct thread *td, struct listxattr_args *arg= s) if (error =3D=3D 0) td->td_retval[0] =3D cnt; free(data, M_LINUX); - return (error_to_xattrerror(attrnamespace, error)); + return (error_to_xattrerror(EXTATTR_NAMESPACE_SYSTEM, error)); } =20 int #v- I think this makes sense, because listxattr iterates over all namespaces, so there's no sane way to know whether the EPERM was caused by trying to access "system" or something else. Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --ygr3ndkcrikak3m7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPXjyl8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MSPeAP92TH9wbrdHer+D7uaF1/jfOQ134xM+wWuqMZxc0C2t9AEA7OfJuEb7M1OX 5h+IOr6QfOh4gPF09LUvLELOwBy07gc= =LX/D -----END PGP SIGNATURE----- --ygr3ndkcrikak3m7-- From nobody Mon Sep 4 15:45:38 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfXzN6GZSz4sP8m for ; Mon, 4 Sep 2023 15:45:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-54.consmr.mail.gq1.yahoo.com (sonic315-54.consmr.mail.gq1.yahoo.com [98.137.65.30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfXzM6hRYz3Ynx for ; Mon, 4 Sep 2023 15:45:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693842349; bh=w0kXlOBScK6IxOmuwDZGWF0Fp5BAK7cRabQYJvIVhNg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=gm4uv5F2cDSfSiNsThDqWNkmcXd+SV6xyJodkWCUOdSaTQNuhAaKT/zJIu+ULr0kLPCHcBB8XBTtpsNFQ03s0g0+WoqJ8r8pZ7ICFzsqnrJ690cc2F22Ne/gSSDVEjUbYO0RQkv2xF3R39scqBKrmf6yuoJKcD7edmkMfT90BASEP0hytEvBvdq3G0aMvy/KThH7taQmJovXScUBqsxG3xJFX3SBfm4zfMnAvo2FOSYujhgDJLPExI7Rqf4r95FfxzMjXC50Q2wKyECKdofOsuimsaeaDE9O2NVklTZYNik1BPl7S8X7RjlvETzQW8Au+UtAIwC0mTWz4Ic9kECznA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693842349; bh=YrZB+zmOITd+1J6ixVdYnxPN5Vr81p8CuZp90cED+jO=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=J7v4TiXzI7qe0Kxi1v2LfnV4o5XM0PChPmS7qdS1Kl3STfMZdFCj8ictTHWGv+dZm5uTR/0y97rLeY0MsTCeG+Eq3goGx73+kztdmIBeXTjgZMtBiepMhhHsIC93meZlXDuxXPBMG+xVslBHlNmQbH0UwXJHLWzg6H4UdmWd2qsYJJGyCtp5Xahh08lXTWhxOyJFIbZX5WTl0BzawcDvUOt14HKS0KOq556UAuPJPfH4mjz8XMJ0MY8q5mHUW5ZRvJduIfJ/FIY6EsxViVZs+7+gCfmztAYS+cLdFDZhV15GlbDyWj9FcbCAIQzQhc4r5y522ReRQEeXyz7ksfPBHw== X-YMail-OSG: 1yVd7y8VM1k.eii6OuvVmcRnq67PohhWiUNFL98IZzUjrPbOchxIfWsvzsim7R0 9fq3LLZqZNP.665mBrXEINMmbWASrWaS6uT2nQtlyBtOOTwFIU8Y3X_q1NRemK2J7.3jyW.IjlZA ZphSr5okqE7NQ_xA4Ffkxc.r8A4Dat4LWMMF_ZXQtdiNlgmRWBYHLrFyTSsA7XNxn0Kw5YIVtMW1 Vio.DwnPooc0a2.7VpX5jZpCAfcMls76iI.gP9dVvWBBxmcCnX5X3lrm2ba0pij_nARoRoWp2fqV TVTW305rwU0P4cKRmcI8kLQLvVuO6vQvpbG0ft3ol5IpBdOJVZ1B1b_4hyyoOCdZkTLrMdOaGh9U l1hZk4nYOxIJ4JdioLLWe.vrpDyfS71hHF9atJP_Bcl7anN_.l7gceHkh182i6zHqgAHt69ikGVM cXuUpXTzZCMjc5E7BfItGbTvvGiNoFbd0yxkQWUF_nbNPTs1cRY1yYJmf_TbEz8udabGhC9CDhw0 CMJ8UxC6t9Df7O5N6FE1zSfVQoD2r74MD30YCgKF33zKukTJrulOVVIN.NX1bSX28Jr6f3ZtKJ8F ayyUB9Uwdx21Q2M5r3RtvDaJZqDn7rAsDhwama7f43w.4rO5zedX_B0J_XK8Q2Bk5Bcd8Lj8z3F3 PlHqAMSqVAcOvjKDDbGcnLKkDukxm6ueGDOgwq9Fx3EHhW8aoiiA0N3yggzm4WVZmOHof9APOR_n rxFyIXHdevhySluc91Fuzl.nEQHN0OG0aUUBGjg6TRZggYmjRRJh1fAgmklrGkFeDbDbu1W4OzPz Rv9Xe5WU_v.RCrtK0c.nKLPQw4eXhS4cmKylSqw2FdtDDN.0fGXIU14.V7blnznA.S_c2.kHKLUB sMxRanWwN1YvwnhvROuP9VnkDM3D2wJODyNUDgTUIXKY_FKYZyHioazGrA.bpYbxYLg0rqCr0omn A.GJdtPil3ld2GO081xPSLR5td6b6XTcqaGcFKABO5_xIV9cxPqcIdWlarI82KMRymrM3dW4uv3W i7XO12Vi6X99qjAHVXHxPjiVYtuAkaeCNiDRBGcZsOymTwbS5_NvmkoRb3DvM0.zyN7XIYauPg4F nPC_B2r6Ufs2RHNoVZZ7QxMKWqXuOcIcBs4fMpzSGfT9.nccebRXtEtikJB1N1VealNfNmPX1BeO jokIb4iLDRy5LmNQYh9b6pLuE7YclnHGPSeRznxV7th5_vRFDjGfWzflzjMijVdwPF3JtKff5tI2 XauMRw2f4Jcq.8dUGJXkJVEgZUHcB9GLrFj_X3m5XxcFFqGpMc0WG0Y4f1o3eINZClOoE7.xq1rb 7hPEy9vTqmfZ_McpDoAEQzf1XeZqrNmHBM9tXh2_LcIPdRzmWv3y1oXP709J6e4.S6qsq5Z.TkvM 0LRqSt2CjGz62J3p603.LIqeAUUTEzoHsHeRgwU2jILbxcVZLEIC.54W0r3V8DPnZjyAK.neJKg7 QOLyHl6G252K0Pdc7N8ZLrhQdu1G5jnSZyflUv.7_0Fgk8nIEDu5HOKMFQofAfH9t8n9KkYmmy_d YrIrktW_CQRNOI6flR0MUDUT82C.Qj.skWqt.JV3YlqMnCXl6ilQbXguymzqbttgqHp08KEuCA2e pnpRL_NfYdPQwhfkmWLGa9tTLZf80FSb.GQQtbRiI.AVXiN1ZAB7NNIc0NBgOhg9rhCAI0AomPMg 9LVSYmTHW7pFuMpZDaFl6LJO2Dx60CBbOC1fGOU5moTRs4lkyKgXcWzhZcMhWmMgeBlHtphEBxt3 LV70aDC4QpjKhvTW7rBvrupgGkccUctXYFVnsCQAgIcIj9YmWVj6eVjESI_E3o7nBlZzrNrGYW1p KK4e0hPjJSnzHCkZAvY47UTwk3tePk1yBArGJZommi6MLyMsyOTlMeyi58BvRkz6hrsK5zkFyw9X FRLlXcBz2D8.x0iUW5ElCSDkwv1P.zE9dXcDwatPgtUi3aqHAO3p5KROU09LxC_4kn9luyywLj7N ZoTAnQ1Cvu2ESZb2Dyl_Gz95bkAVIqfj_EZJPStAy4yUSgT3fI9NGAamTu7AnR3ki4Lj.BOouEP1 CHMTS9LO1glI4UpGXMTV0uXS4kHjzkcurF12ko9MIdA7GWzeASKQeGIGXy27m2PtEzTruXKS6IzN AS2xEGgxmMIp6n8ah6kknNUlrMl4N4Ps9cBGpnNoZTgOBldUVwnvaQ.1yazG4jQhxP6yA.C_RIf0 f_2kG3MSsTy87DrDzQt5Kq1LuBYJPJsVJc05_7IhbyAhD.y3gsJmU6rbHV5jp3hF9PoSaPa5i_wI BXQ-- X-Sonic-MF: X-Sonic-ID: 9813e03b-5509-4f5c-90e4-827e9d646bec Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 Sep 2023 15:45:49 +0000 Received: by hermes--production-gq1-6b7c87dcf5-sv5pn (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 490f1d8daee147dc9f9aaf4236cf86d1; Mon, 04 Sep 2023 15:45:48 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> Date: Mon, 4 Sep 2023 08:45:38 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RfXzM6hRYz3Ynx On Sep 4, 2023, at 06:09, Alexander Motin wrote: > On 04.09.2023 05:56, Mark Millard wrote: >> On Sep 4, 2023, at 02:00, Mark Millard wrote: >>> On Sep 3, 2023, at 23:35, Mark Millard wrote: >>>> On Sep 3, 2023, at 22:06, Alexander Motin wrote: >>>>> On 03.09.2023 22:54, Mark Millard wrote: >>>>>> After that ^t produced the likes of: >>>>>> load: 6.39 cmd: sh 4849 [tx->tx_quiesce_done_cv] 10047.33r 0.51u = 121.32s 1% 13004k >>>>>=20 >>>>> So the full state is not "tx->tx", but is actually a = "tx->tx_quiesce_done_cv", which means the thread is waiting for new = transaction to be opened, which means some previous to be quiesced and = then synced. >>>>>=20 >>>>>> #0 0xffffffff80b6f103 at mi_switch+0x173 >>>>>> #1 0xffffffff80bc0f24 at sleepq_switch+0x104 >>>>>> #2 0xffffffff80aec4c5 at _cv_wait+0x165 >>>>>> #3 0xffffffff82aba365 at txg_wait_open+0xf5 >>>>>> #4 0xffffffff82a11b81 at dmu_free_long_range+0x151 >>>>>=20 >>>>> Here it seems like transaction commit is waited due to large = amount of delete operations, which ZFS tries to spread between separate = TXGs. >>>>=20 >>>> That fit the context: cleaning out /usr/local/poudriere/data/.m/ >>>>=20 >>>>> You should probably see some large and growing number in sysctl = kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay . >>>>=20 >>>> After the reboot I started a -J64 example. It has avoided the >>>> early "witness exhausted". Again I ^C'd after about an hours >>>> after the 2nd builder had started. So: again cleaning out >>>> /usr/local/poudriere/data/.m/ Only seconds between: >>>>=20 >>>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276042 >>>>=20 >>>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 276427 >>>>=20 >>>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 277323 >>>>=20 >>>> # sysctl kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay >>>> kstat.zfs.misc.dmu_tx.dmu_tx_dirty_frees_delay: 278027 >=20 > As expected, deletes trigger and wait for TXG commits. >=20 >>>> I have found a measure of progress: zfs list's USED >>>> for /usr/local/poudriere/data/.m is decreasing. So >>>> ztop's d/s was a good classification: deletes. >>>>=20 >>>>>> #5 0xffffffff829a87d2 at zfs_rmnode+0x72 >>>>>> #6 0xffffffff829b658d at zfs_freebsd_reclaim+0x3d >>>>>> #7 0xffffffff8113a495 at VOP_RECLAIM_APV+0x35 >>>>>> #8 0xffffffff80c5a7d9 at vgonel+0x3a9 >>>>>> #9 0xffffffff80c5af7f at vrecycle+0x3f >>>>>> #10 0xffffffff829b643e at zfs_freebsd_inactive+0x4e >>>>>> #11 0xffffffff80c598cf at vinactivef+0xbf >>>>>> #12 0xffffffff80c590da at vput_final+0x2aa >>>>>> #13 0xffffffff80c68886 at kern_funlinkat+0x2f6 >>>>>> #14 0xffffffff80c68588 at sys_unlink+0x28 >>>>>> #15 0xffffffff8106323f at amd64_syscall+0x14f >>>>>> #16 0xffffffff8103512b at fast_syscall_common+0xf8 >>>>>=20 >>>>> What we don't see here is what quiesce and sync threads of the = pool are actually doing. Sync thread has plenty of different jobs, = including async write, async destroy, scrub and others, that all may = delay each other. >>>>>=20 >>>>> Before you rebooted the system, depending how alive it is, could = you save a number of outputs of `procstat -akk`, or at least = specifically `procstat -akk | grep txg_thread_enter` if the full is = hard? Or somehow else observe what they are doing. >>>>=20 >>>> # grep txg_thread_enter ~/mmjnk0[0-5].txt >>>> /usr/home/root/mmjnk00.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk00.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk01.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk01.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk02.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk02.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk03.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk03.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk04.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk04.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk05.txt: 6 100881 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 _cv_wait+0x165 = txg_thread_wait+0xeb txg_quiesce_thread+0x144 fork_exit+0x82 = fork_trampoline+0xe >>>> /usr/home/root/mmjnk05.txt: 6 100882 zfskern = txg_thread_enter mi_switch+0x173 sleepq_switch+0x104 = sleepq_timedwait+0x4b _cv_timedwait_sbt+0x188 zio_wait+0x3c9 = dsl_pool_sync+0x139 spa_sync+0xc68 txg_sync_thread+0x2eb fork_exit+0x82 = fork_trampoline+0xe >=20 > So quiesce threads are idle, while sync thread is waiting for TXG = commit writes completion. I see no no crime, we should see the same = just for slow storage. >=20 >>>>> `zpool status`, `zpool get all` and `sysctl -a` would also not = harm. >>>>=20 >>>> It is a very simple zpool configuration: one partition. >>>> I only use it for bectl BE reasons, not the general >>>> range of reasons for using zfs. I created the media with >>>> my normal content, then checkpointed before doing the >>>> git fetch to start to set up the experiment. >=20 > OK. And I see no scrub or async destroy, that could delay sync = thread. Though I don't see them in the above procstat either. >=20 >>>> /etc/sysctl.conf does have: >>>>=20 >>>> vfs.zfs.min_auto_ashift=3D12 >>>> vfs.zfs.per_txg_dirty_frees_percent=3D5 >>>>=20 >>>> The vfs.zfs.per_txg_dirty_frees_percent is from prior >>>> Mateusz Guzik help, where after testing the change I >>>> reported: >>>>=20 >>>> Result summary: Seems to have avoided the sustained periods >>>> of low load average activity. Much better for the context. >>>>=20 >>>> But it was for a different machine (aarch64, 8 cores). But >>>> it was for poudriere bulk use. >>>>=20 >>>> Turns out the default of 30 was causing sort of like >>>> what is seen here: I could have presented some of the >>>> information via the small load average figures here. >>>>=20 >>>> (Note: 5 is the old default, 30 is newer. Other contexts >>>> have other problems with 5: no single right setting and >>>> no automated configuration.) >=20 > per_txg_dirty_frees_percent is directly related to the delete delays = we see here. You are forcing ZFS to commit transactions each 5% of = dirty ARC limit, which is 5% of 10% or memory size. I haven't looked on = that code recently, but I guess setting it too low can make ZFS commit = transactions too often, increasing write inflation for the underlying = storage. I would propose you to restore the default and try again. While this machine is different, the original problem was worse than the issue here: the load average was less than 1 for the most part the parallel bulk build when 30 was used. The fraction of time waiting was much longer than with 5. If I understand right, both too high and too low for a type of context can lead to increased elapsed time and getting it set to a near optimal is a non-obvious exploration. The only reason I'm not using USE_TMPFS=3Dall in this context is that the relative lack of zfs I/O well avoids most all of the recent problems that I was trying to test for. An overall point for the goal of my activity is: what makes a good test context for checking if ZFS is again safe to use? May be other tradeoffs make, say, 4 hardware threads more reasonable than 32. A reported observation was that the number of parallel builders being notably greater than the hardware thread count seemed to make the deadlocks (and other issues?) more likely and that ALLOW_MAKE_JOBS seemed to make it less likely. This is how I got into the combination I was trying. Also, it may be that testing for repeating the recent problems just does not fit with use of the USB3 media that I've attempted to use. For ZFS not having deadlocks and the other issues, I have working configurations for doing bulk builds, even bulk -a . (I once got about half of one done on a 8 GiByte RPi4B before a power outage stopped it. I rarely run bulk -a and do so only as a check on my normal configurations still being reasonable after FreeBSD progressed for a notable time, unless it is part of a "ZFS working?" test, like here.) >>>> Other than those 2 items, zfs is untuned (defaults). >>>>=20 >>>> sysctl -a is a lot more output (864930 Bytes) so I'll skip >>>> it for now. >>>>=20 >>>>> PS: I may be wrong, but USB in "USB3 NVMe SSD storage" makes me = shiver. Make sure there is no storage problems, like some huge delays, = timeouts, etc, that can be seen, for example, as busy percents regularly = spiking far above 100% in your `gstat -spod`. >>>>=20 >>>> The "gstat -spod" output showed (and shows): around 0.8ms/w to = 3ms/w, >>>> mostly at the lower end of the range. < 98%busy, no spikes to > = 100%. >>>> It is a previously unused Samsung PSSD T7 Touch. >=20 > Is the ~98% busy most of the time there? Yes. > Unfortunately our umass does not support UASP, I'm aware that FreeBSD has this lack of UASP. > i.e. supports only one command at a time, I'd not thought about it before, but this might limit the utility of testing this way for deadlocks and such that occur via openzfs. > so many small I/Os may accumulate more latency than other interface = storages would. Higher number of small transaction commits may not help = it either. Yea. It may be that the only reasonable test for ZFS would involve replacing some PCIe slot's or M.2's media content. Given all the recent problems with ZFS ending up with data corruptions and deadlocks on main after an openzfs import, I may need to do that in order to be able to have a safe test-only context before progressing my normal contexts to/past an openzfs imports. >>> A little more context here: that is for the "kB" figures seen >>> during the cleanup/delete activity. During port builds into >>> packages larger "kB" figures are seen and the ms/w figures >>> will tend to be larger as well. The larger sizes can also >>> lead to reaching somewhat above 100 %busy some of the time. >>>=20 >>> I'll also note that I've ended up doing a lot more write >>> activity exploring than I'd expected. >>>=20 >>>> I was not prepared to replace the content of a PCIe slot's media >>>> or M.2 connection's media for the temporary purpose. No spare >>>> supply for those so no simple swapping for those. >> Trying -J36 (so: 32+4) got to 470 built in about an hour >> after [02] reached "Builder started". /usr/local/poudriere/data/.m >> used a little under 40 GiBytes at that point. (I do not have >> a file count.) >> The cleanup seems to have gone somewhat faster after my ^C for >> this context: >> ^C[01:20:20] Error: Signal SIGINT caught, cleaning up and exiting >> [01:20:20] [27] [00:02:54] Finished math/p5-Data-Float | = p5-Data-Float-0.013: Success >> [main-amd64-bulk_a-default] [2023-09-04_00h30m42s] [sigint:] Queued: = 34588 Built: 502 Failed: 1 Skipped: 50 Ignored: 335 Fetched: = 0 Tobuild: 33700 Time: 01:20:12 >> [01:20:22] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-04_0= 0h30m42s >> [01:20:23] [25] [00:04:46] Finished www/p5-HTML-TreeBuilder-XPath | = p5-HTML-TreeBuilder-XPath-0.14_1: Success >> [01:20:24] Cleaning up >> [02:17:01] Unmounting file systems >> Exiting with status 1 >> So it took about an hour to cleanup after 502 port builds into >> packages (not published, though). >> ( gstat -spod showed a fairly general, sustained lack of read = activity, >> instead of the comparitively small sustained amount I'd not mentioned >> for the previous explorations. May be that helped. ) >=20 > I suppose more builders mean deleting more work directories same time? Yep. One of the properties of poudriere that is visible via tmpfs storage size timing, is that the storage for a builder is not released at the time the builder finishes a build: the storage stays around if the builder is not used for a time and the adjustment only happens if it starts a new build (or the overall bulk finishes). This contributes to USE_TMPFS=3Dall RAM+SWAP requirements when the space for a large build sticks around for a time after it is done. > I don't know if it should cause cumulative effect, but I suppose = should be at least linear. >=20 Each builder-slot runs its own delete in parallel with the other slots. So, for more slots than hardware threads, that adds more waiting as well. It appears that I've a fundamental choice to make about handling progressing to/past openzfs imports and USB3 media is probably excluded from the testing environment if I have one. Thanks for your help. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 4 16:43:11 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfZFd2K46z4rww0 for ; Mon, 4 Sep 2023 16:43:17 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfZFc0Clfz4MNL for ; Mon, 4 Sep 2023 16:43:15 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de; dmarc=none Received: from [188.174.51.238] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdCfQ-00EIAl-NP for freebsd-current@freebsd.org; Mon, 04 Sep 2023 18:43:13 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 384GhCoc015582 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 4 Sep 2023 18:43:12 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 384GhBb4015581 for freebsd-current@freebsd.org; Mon, 4 Sep 2023 18:43:11 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Mon, 4 Sep 2023 18:43:11 +0200 From: Matthias Apitz To: freebsd-current@freebsd.org Subject: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="AFCCYDK0QqY9NShb" Content-Disposition: inline Content-Transfer-Encoding: 8bit X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.51.238 X-Spamd-Bar: - X-Spamd-Result: default: False [-1.10 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.997]; NEURAL_SPAM_SHORT(0.70)[0.697]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:178.254.4.101]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; FROM_HAS_DN(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[unixarea.de]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; HAS_XOIP(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MIME_TRACE(0.00)[0:+,1:+,2:+]; R_DKIM_NA(0.00)[]; HAS_REPLYTO(0.00)[guru@unixarea.de] X-Rspamd-Queue-Id: 4RfZFc0Clfz4MNL --AFCCYDK0QqY9NShb Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit I have a 14.0-CURRENT compiled from sources of head from August 4, which boots fine from a produced USB key, but the keyboard does not work on an Acer C720 (amd64), on other laptops the keyboard is fine. The keyboard works during the boot menu (for example to enable verbose boot messages) but not on the login: prompt of the booted system. I've enabled SSH access into the C720 (if someone need more information) and I'm attaching /var/log/messages of the booted system. Any ideas? matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub --AFCCYDK0QqY9NShb Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="messages.140" Sep 4 13:44:55 C720-1400094 syslogd: kernel boot file is /boot/kernel/kernel Sep 4 13:44:55 C720-1400094 kernel: ---<>--- Sep 4 13:44:55 C720-1400094 kernel: APIC: Using the MADT enumerator. Sep 4 13:44:55 C720-1400094 kernel: Copyright (c) 1992-2023 The FreeBSD Project. Sep 4 13:44:55 C720-1400094 kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Sep 4 13:44:55 C720-1400094 kernel: The Regents of the University of California. All rights reserved. Sep 4 13:44:55 C720-1400094 kernel: FreeBSD is a registered trademark of The FreeBSD Foundation. Sep 4 13:44:55 C720-1400094 kernel: FreeBSD 14.0-CURRENT amd64 1400094 #0 main-n264568-1d7ffb373c9d: Fri Aug 18 12:55:08 CEST 2023 Sep 4 13:44:55 C720-1400094 kernel: guru@jet:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Sep 4 13:44:55 C720-1400094 kernel: FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152) Sep 4 13:44:55 C720-1400094 kernel: WARNING: WITNESS option enabled, expect reduced performance. Sep 4 13:44:55 C720-1400094 kernel: PPIM 0: PA=0xa0000, VA=0xffffffff82810000, size=0x10000, mode=0 Sep 4 13:44:55 C720-1400094 kernel: pmap: large map 8 PML4 slots (4096 GB) Sep 4 13:44:55 C720-1400094 kernel: VT(vga): resolution 640x480 Sep 4 13:44:55 C720-1400094 kernel: Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81fee540. Sep 4 13:44:55 C720-1400094 kernel: Preloaded boot_entropy_cache "/boot/entropy" at 0xffffffff81ff77c8. Sep 4 13:44:55 C720-1400094 kernel: Preloaded TSLOG data "TSLOG" at 0xffffffff81ff7820. Sep 4 13:44:55 C720-1400094 kernel: Early TSC frequency 1396833720Hz calibrated from 8254 PIT Sep 4 13:44:55 C720-1400094 kernel: CPU: Intel(R) Celeron(R) 2955U @ 1.40GHz (1396.83-MHz K8-class CPU) Sep 4 13:44:55 C720-1400094 kernel: Origin="GenuineIntel" Id=0x40651 Family=0x6 Model=0x45 Stepping=1 Sep 4 13:44:55 C720-1400094 kernel: Features=0xbfebfbff Sep 4 13:44:55 C720-1400094 kernel: Features2=0x4ddaebbf Sep 4 13:44:55 C720-1400094 kernel: AMD Features=0x2c100800 Sep 4 13:44:55 C720-1400094 kernel: AMD Features2=0x21 Sep 4 13:44:55 C720-1400094 kernel: Structured Extended Features=0x2603 Sep 4 13:44:55 C720-1400094 kernel: XSAVE Features=0x1 Sep 4 13:44:55 C720-1400094 kernel: VT-x: (disabled in BIOS) Basic Features=0xda0400 Sep 4 13:44:55 C720-1400094 kernel: Pin-Based Controls=0x7f Sep 4 13:44:55 C720-1400094 kernel: Primary Processor Controls=0xfff9fffe Sep 4 13:44:55 C720-1400094 kernel: Secondary Processor Controls=0x1cff Sep 4 13:44:55 C720-1400094 kernel: Exit Controls=0xda0400 Sep 4 13:44:55 C720-1400094 kernel: Entry Controls=0xda0400 Sep 4 13:44:55 C720-1400094 kernel: EPT Features=0x6334141 Sep 4 13:44:55 C720-1400094 kernel: VPID Features=0xf01 Sep 4 13:44:55 C720-1400094 kernel: TSC: P-state invariant, performance statistics Sep 4 13:44:55 C720-1400094 kernel: Data TLB: 2 MByte or 4 MByte pages, 4-way set associative, 32 entries and a separate array with 1 GByte pages, 4-way set associative, 4 entries Sep 4 13:44:55 C720-1400094 kernel: Data TLB: 4 KB pages, 4-way set associative, 64 entries Sep 4 13:44:55 C720-1400094 kernel: Instruction TLB: 2M/4M pages, fully associative, 8 entries Sep 4 13:44:55 C720-1400094 kernel: Instruction TLB: 4KByte pages, 8-way set associative, 128 entries Sep 4 13:44:55 C720-1400094 kernel: 64-Byte prefetching Sep 4 13:44:55 C720-1400094 kernel: Shared 2nd-Level TLB: 4 KByte/2MByte pages, 8-way associative, 1024 entries Sep 4 13:44:55 C720-1400094 kernel: L2 cache: 256 kbytes, 8-way associative, 64 bytes/line Sep 4 13:44:55 C720-1400094 kernel: real memory = 4301258752 (4102 MB) Sep 4 13:44:55 C720-1400094 kernel: Physical memory chunk(s): Sep 4 13:44:55 C720-1400094 kernel: 0x0000000000010000 - 0x000000000002ffff, 131072 bytes (32 pages) Sep 4 13:44:55 C720-1400094 kernel: 0x0000000000040000 - 0x000000000009dfff, 385024 bytes (94 pages) Sep 4 13:44:55 C720-1400094 kernel: 0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages) Sep 4 13:44:55 C720-1400094 kernel: 0x0000000002402000 - 0x00000000751aefff, 1926942720 bytes (470445 pages) Sep 4 13:44:55 C720-1400094 kernel: 0x000000007bc00000 - 0x000000007bcf3fff, 999424 bytes (244 pages) Sep 4 13:44:55 C720-1400094 kernel: 0x0000000100000000 - 0x00000001005e7fff, 6193152 bytes (1512 pages) Sep 4 13:44:55 C720-1400094 kernel: avail memory = 1921609728 (1832 MB) Sep 4 13:44:55 C720-1400094 kernel: intel stolen mem: base 0x7ca00000 size 32 MB Sep 4 13:44:55 C720-1400094 kernel: MADT: Found CPU APIC ID 0 ACPI ID 0: enabled Sep 4 13:44:55 C720-1400094 kernel: SMP: Added CPU 0 (AP) Sep 4 13:44:55 C720-1400094 kernel: MADT: Found CPU APIC ID 2 ACPI ID 1: enabled Sep 4 13:44:55 C720-1400094 kernel: SMP: Added CPU 2 (AP) Sep 4 13:44:55 C720-1400094 kernel: Event timer "LAPIC" quality 600 Sep 4 13:44:55 C720-1400094 kernel: LAPIC: ipi_wait() us multiplier 25 (r 54028 tsc 1396833720) Sep 4 13:44:55 C720-1400094 kernel: ACPI APIC Table: Sep 4 13:44:55 C720-1400094 kernel: Package ID shift: 4 Sep 4 13:44:55 C720-1400094 kernel: L3 cache ID shift: 4 Sep 4 13:44:55 C720-1400094 kernel: L2 cache ID shift: 1 Sep 4 13:44:55 C720-1400094 kernel: L1 cache ID shift: 1 Sep 4 13:44:55 C720-1400094 kernel: Core ID shift: 1 Sep 4 13:44:55 C720-1400094 kernel: AP boot address 0x9c000 Sep 4 13:44:55 C720-1400094 kernel: INTR: Adding local APIC 2 as a target Sep 4 13:44:55 C720-1400094 kernel: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs Sep 4 13:44:55 C720-1400094 kernel: FreeBSD/SMP: 1 package(s) x 2 core(s) Sep 4 13:44:55 C720-1400094 kernel: Package HW ID = 0 Sep 4 13:44:55 C720-1400094 kernel: Core HW ID = 0 Sep 4 13:44:55 C720-1400094 kernel: CPU0 (BSP): APIC ID: 0 Sep 4 13:44:55 C720-1400094 kernel: Core HW ID = 1 Sep 4 13:44:55 C720-1400094 kernel: CPU1 (AP): APIC ID: 2 Sep 4 13:44:55 C720-1400094 kernel: APIC: CPU 0 has ACPI ID 0 Sep 4 13:44:55 C720-1400094 kernel: APIC: CPU 1 has ACPI ID 1 Sep 4 13:44:55 C720-1400094 kernel: Pentium Pro MTRR support enabled Sep 4 13:44:55 C720-1400094 kernel: x86bios: IVT 0x000000-0x0004ff at 0xfffff80000000000 Sep 4 13:44:55 C720-1400094 kernel: x86bios: SSEG 0x09c000-0x09cfff at 0xfffffe0007768000 Sep 4 13:44:55 C720-1400094 kernel: x86bios: EBDA 0x09e000-0x09ffff at 0xfffff8000009e000 Sep 4 13:44:55 C720-1400094 kernel: x86bios: ROM 0x0a0000-0x0fefff at 0xfffff800000a0000 Sep 4 13:44:55 C720-1400094 kernel: random: registering fast source Intel Secure Key RNG Sep 4 13:44:55 C720-1400094 kernel: random: fast provider: "Intel Secure Key RNG" Sep 4 13:44:55 C720-1400094 kernel: random: read 4096 bytes from preloaded cache Sep 4 13:44:55 C720-1400094 kernel: random: no platform bootloader entropy Sep 4 13:44:55 C720-1400094 kernel: random: unblocking device. Sep 4 13:44:55 C720-1400094 kernel: VIMAGE (virtualized network stack) enabled Sep 4 13:44:55 C720-1400094 kernel: hostuuid: using 00000000-0000-0000-0000-000000000000 Sep 4 13:44:55 C720-1400094 kernel: ULE: setup cpu 0 Sep 4 13:44:55 C720-1400094 kernel: ULE: setup cpu 1 Sep 4 13:44:55 C720-1400094 kernel: ACPI: RSDP 0x00000000000FDBB0 000024 (v02 CORE ) Sep 4 13:44:55 C720-1400094 kernel: ACPI: XSDT 0x000000007BF840E0 000054 (v01 CORE COREBOOT 00000000 CORE 00000000) Sep 4 13:44:55 C720-1400094 kernel: ACPI: FACP 0x000000007BF88690 0000F4 (v03 CORE COREBOOT 00000000 CORE 00000001) Sep 4 13:44:55 C720-1400094 kernel: ACPI: DSDT 0x000000007BF84250 004431 (v02 COREv4 COREBOOT 20110725 INTL 20090123) Sep 4 13:44:55 C720-1400094 kernel: ACPI: FACS 0x000000007BF84210 000040 Sep 4 13:44:55 C720-1400094 kernel: ACPI: HPET 0x000000007BF88790 000038 (v01 CORE COREBOOT 00000000 CORE 00000000) Sep 4 13:44:55 C720-1400094 kernel: ACPI: APIC 0x000000007BF887D0 00005C (v01 CORE COREBOOT 00000000 CORE 00000000) Sep 4 13:44:55 C720-1400094 kernel: ACPI: MCFG 0x000000007BF88830 00003C (v01 CORE COREBOOT 00000000 CORE 00000000) Sep 4 13:44:55 C720-1400094 kernel: ACPI: SSDT 0x000000007BF89730 0008A0 (v02 CORE COREBOOT 0000002A CORE 0000002A) Sep 4 13:44:55 C720-1400094 kernel: ACPI: SSDT 0x000000007BF89FD0 00005C (v02 CORE COREBOOT 0000002A CORE 0000002A) Sep 4 13:44:55 C720-1400094 kernel: MADT: Found IO APIC ID 2, Interrupt 0 at 0xfec00000 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: ver 0x20 maxredir 0x27 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: Routing external 8259A's -> intpin 0 Sep 4 13:44:55 C720-1400094 kernel: MADT: Interrupt override: source 0, irq 2 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: Routing IRQ 0 -> intpin 2 Sep 4 13:44:55 C720-1400094 kernel: MADT: Interrupt override: source 9, irq 9 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: intpin 9 trigger: level Sep 4 13:44:55 C720-1400094 kernel: ioapic0 irqs 0-39 Sep 4 13:44:55 C720-1400094 kernel: cpu0 BSP: Sep 4 13:44:55 C720-1400094 kernel: ID: 0x00000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff Sep 4 13:44:55 C720-1400094 kernel: lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000011ff Sep 4 13:44:55 C720-1400094 kernel: timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 Sep 4 13:44:55 C720-1400094 kernel: cmci: 0x000000f2 Sep 4 13:44:55 C720-1400094 kernel: SMP: AP CPU #1 Launched! Sep 4 13:44:55 C720-1400094 kernel: cpu1 AP: Sep 4 13:44:55 C720-1400094 kernel: ID: 0x02000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff Sep 4 13:44:55 C720-1400094 kernel: lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000011ff Sep 4 13:44:55 C720-1400094 kernel: timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 Sep 4 13:44:55 C720-1400094 kernel: cmci: 0x000000f2 Sep 4 13:44:55 C720-1400094 kernel: SMP: passed TSC synchronization test Sep 4 13:44:55 C720-1400094 kernel: wlan: <802.11 Link Layer> Sep 4 13:44:55 C720-1400094 kernel: random: entropy device external interface Sep 4 13:44:55 C720-1400094 kernel: snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024] Sep 4 13:44:55 C720-1400094 kernel: feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=2 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25 Sep 4 13:44:55 C720-1400094 kernel: EFI systbl not available Sep 4 13:44:55 C720-1400094 kernel: kbd: new array size 4 Sep 4 13:44:55 C720-1400094 kernel: kbd1 at kbdmux0 Sep 4 13:44:55 C720-1400094 kernel: mem: Sep 4 13:44:55 C720-1400094 kernel: crypto: Sep 4 13:44:55 C720-1400094 kernel: null: Sep 4 13:44:55 C720-1400094 kernel: [ath_hal] loaded Sep 4 13:44:55 C720-1400094 kernel: io: Sep 4 13:44:55 C720-1400094 kernel: tcp_log: tcp_log device Sep 4 13:44:55 C720-1400094 kernel: vtvga0: Sep 4 13:44:55 C720-1400094 kernel: smbios0: at iomem 0xfdbe0-0xfdbfe Sep 4 13:44:55 C720-1400094 kernel: smbios0: Version: 2.7 Sep 4 13:44:55 C720-1400094 kernel: crypto: assign cryptosoft0 driver id 0, flags 0x6000000 Sep 4 13:44:55 C720-1400094 kernel: aesni0: No AES or SHA support. Sep 4 13:44:55 C720-1400094 kernel: acpi0: Sep 4 13:44:55 C720-1400094 kernel: ACPI: 3 ACPI AML tables successfully acquired and loaded Sep 4 13:44:55 C720-1400094 kernel: PCIe: Memory Mapped configuration base @ 0xf0000000 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 Sep 4 13:44:55 C720-1400094 kernel: acpi0: Power Button (fixed) Sep 4 13:44:55 C720-1400094 kernel: acpi0: wakeup code va 0xfffffe00078cf000 pa 0x9d000 Sep 4 13:44:55 C720-1400094 kernel: hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Sep 4 13:44:55 C720-1400094 kernel: hpet0: vendor 0x8086, rev 0x1, 14318180Hz 64bit, 8 timers, legacy route Sep 4 13:44:55 C720-1400094 kernel: hpet0: t0: irqs 0x00f00000 (0), MSI, 64bit, periodic Sep 4 13:44:55 C720-1400094 kernel: hpet0: t1: irqs 0x00f00000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t2: irqs 0x00f00800 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t3: irqs 0x00f01000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t4: irqs 0x00000000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t5: irqs 0x00000000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t6: irqs 0x00000000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: hpet0: t7: irqs 0x00000000 (0), MSI Sep 4 13:44:55 C720-1400094 kernel: Timecounter "HPET" frequency 14318180 Hz quality 950 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 40 to local APIC 2 vector 48 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 41 to local APIC 0 vector 49 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 42 to local APIC 2 vector 49 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 43 to local APIC 0 vector 50 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 44 to local APIC 2 vector 50 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 45 to local APIC 0 vector 51 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 46 to local APIC 2 vector 51 Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI-X IRQ 47 to local APIC 0 vector 52 Sep 4 13:44:55 C720-1400094 kernel: msi: Assigning MSI-X IRQ 40 to local APIC 0 vector 53 Sep 4 13:44:55 C720-1400094 kernel: msi: Assigning MSI-X IRQ 41 to local APIC 2 vector 48 Sep 4 13:44:55 C720-1400094 kernel: msi: Assigning MSI-X IRQ 42 to local APIC 0 vector 49 Sep 4 13:44:55 C720-1400094 kernel: msi: Assigning MSI-X IRQ 44 to local APIC 0 vector 54 Sep 4 13:44:55 C720-1400094 kernel: msi: Assigning MSI-X IRQ 46 to local APIC 0 vector 55 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET" frequency 14318180 Hz quality 550 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET1" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET2" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET3" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET4" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET5" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: Event timer "HPET6" frequency 14318180 Hz quality 440 Sep 4 13:44:55 C720-1400094 kernel: cpu0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: cpu1: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: atrtc0: port 0x70-0x77 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: atrtc0: registered as a time-of-day clock, resolution 1.000000s Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 2 vector 49 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 0 vector 56 Sep 4 13:44:55 C720-1400094 kernel: Event timer "RTC" frequency 32768 Hz quality 0 Sep 4 13:44:55 C720-1400094 kernel: attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: Timecounter "i8254" frequency 1193182 Hz quality 0 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 2 (ISA IRQ 0) to lapic 0 vector 57 Sep 4 13:44:55 C720-1400094 kernel: Event timer "i8254" frequency 1193182 Hz quality 100 Sep 4 13:44:55 C720-1400094 kernel: ACPI timer: -> 10 Sep 4 13:44:55 C720-1400094 kernel: Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 Sep 4 13:44:55 C720-1400094 kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 Sep 4 13:44:55 C720-1400094 kernel: acpi_ec0: port 0x62,0x66 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: pci_link0: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 11 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link1: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 10 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link2: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 11 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link3: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 11 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 11 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link4: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link5: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link6: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 10 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: pci_link7: Index IRQ Rtd Ref IRQs Sep 4 13:44:55 C720-1400094 kernel: Initial Probe 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: Validation 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: After Disable 0 255 N 0 1 3 4 5 6 7 11 12 14 15 Sep 4 13:44:55 C720-1400094 kernel: acpi_lid0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: acpi_button0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: acpi_button1: irq 37 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: acpi_button2: irq 38 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: port 0xcf8-0xcff on acpi0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 5 range 0-0xff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 4 range 0-0xcf7 Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 4 range 0xd00-0xffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xa0000-0xbffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xc0000-0xc3fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xc4000-0xc7fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xc8000-0xcbfff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xcc000-0xcffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xd0000-0xd3fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xd4000-0xd7fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xd8000-0xdbfff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xdc000-0xdffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xe0000-0xe3fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xe4000-0xe7fff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xe8000-0xebfff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xec000-0xeffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xf0000-0xfffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0x7ea00001-0xfebfffff Sep 4 13:44:55 C720-1400094 kernel: pcib0: decoding 3 range 0xfed40000-0xfed44fff Sep 4 13:44:55 C720-1400094 kernel: pci0: on pcib0 Sep 4 13:44:55 C720-1400094 kernel: pci0: domain=0, physical bus=0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x0a04, revid=0x09 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=0, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=06-00-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0006, statreg=0x2090, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x0a06, revid=0x09 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=2, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=03-00-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0007, statreg=0x0090, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 2 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe0000000, size 22, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0000000-0xe03fffff) for rid 10 of pci0:0:2:0 Sep 4 13:44:55 C720-1400094 kernel: map[18]: type Prefetchable Memory, range 64, base 0xd0000000, size 28, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd0000000-0xdfffffff) for rid 18 of pci0:0:2:0 Sep 4 13:44:55 C720-1400094 kernel: map[20]: type I/O Port, range 32, base 0x1800, size 6, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1800-0x183f) for rid 20 of pci0:0:2:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x0a0c, revid=0x09 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=3, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=04-03-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 2 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe0510000, size 14, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0510000-0xe0513fff) for rid 10 of pci0:0:3:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c31, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=20, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=0c-03-30, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0290, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 2 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 8 messages, 64 bit Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe0500000, size 16, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0500000-0xe050ffff) for rid 10 of pci0:0:20:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c60, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=08-01-02, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 32, base 0xe0518000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0518000-0xe0518fff) for rid 10 of pci0:0:21:0 Sep 4 13:44:55 C720-1400094 kernel: map[14]: type Memory, range 32, base 0xe0519000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0519000-0xe0519fff) for rid 14 of pci0:0:21:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c61, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=1 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 32, base 0xe051a000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051a000-0xe051afff) for rid 10 of pci0:0:21:1 Sep 4 13:44:55 C720-1400094 kernel: map[14]: type Memory, range 32, base 0xe051b000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051b000-0xe051bfff) for rid 14 of pci0:0:21:1 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c62, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=2 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 32, base 0xe051c000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051c000-0xe051cfff) for rid 10 of pci0:0:21:2 Sep 4 13:44:55 C720-1400094 kernel: map[14]: type Memory, range 32, base 0xe051d000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051d000-0xe051dfff) for rid 14 of pci0:0:21:2 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c20, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=27, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=04-03-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message, 64 bit Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe0514000, size 14, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0514000-0xe0517fff) for rid 10 of pci0:0:27:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c10, revid=0xe4 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=28, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=06-04-00, hdrtype=0x01, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: secbus=1, subbus=1 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c26, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=29, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=0c-03-20, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0290, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 32, base 0xe051f800, size 10, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051f800-0xe051fbff) for rid 10 of pci0:0:29:0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c45, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=06-01-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0007, statreg=0x0210, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c03, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=2 Sep 4 13:44:55 C720-1400094 kernel: class=01-06-01, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0007, statreg=0x02b0, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=10 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: map[10]: type I/O Port, range 32, base 0x1860, size 3, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1860-0x1867) for rid 10 of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: map[14]: type I/O Port, range 32, base 0x1870, size 2, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1870-0x1873) for rid 14 of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: map[18]: type I/O Port, range 32, base 0x1868, size 3, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1868-0x186f) for rid 18 of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: map[1c]: type I/O Port, range 32, base 0x1874, size 2, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1874-0x1877) for rid 1c of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: map[20]: type I/O Port, range 32, base 0x1840, size 5, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x1840-0x185f) for rid 20 of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: map[24]: type Memory, range 32, base 0xe051f000, size 11, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051f000-0xe051f7ff) for rid 24 of pci0:0:31:2 Sep 4 13:44:55 C720-1400094 kernel: pcib0: matched entry for 0.31.INTA Sep 4 13:44:55 C720-1400094 kernel: pcib0: slot 31 INTA hardwired to IRQ 22 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c22, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=3 Sep 4 13:44:55 C720-1400094 kernel: class=0c-05-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0103, statreg=0x0280, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe051fc00, size 8, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051fc00-0xe051fcff) for rid 10 of pci0:0:31:3 Sep 4 13:44:55 C720-1400094 kernel: map[20]: type I/O Port, range 32, base 0x400, size 5, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 4 (0x400-0x41f) for rid 20 of pci0:0:31:3 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c24, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=6 Sep 4 13:44:55 C720-1400094 kernel: class=11-80-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0102, statreg=0x0010, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe051e000, size 12, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe051e000-0xe051efff) for rid 10 of pci0:0:31:6 Sep 4 13:44:55 C720-1400094 kernel: vgapci0: port 0x1800-0x183f mem 0xe0000000-0xe03fffff,0xd0000000-0xdfffffff at device 2.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: vgapci0: Boot video device Sep 4 13:44:55 C720-1400094 kernel: hdac0: mem 0xe0510000-0xe0513fff at device 3.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: hdac0: PCI card vendor: 0x1025, device: 0x0a11 Sep 4 13:44:55 C720-1400094 kernel: hdac0: HDA Driver Revision: 20120126_0002 Sep 4 13:44:55 C720-1400094 kernel: hdac0: Config options: on=0x00000000 off=0x00000000 Sep 4 13:44:55 C720-1400094 kernel: hdac0: attempting to allocate 1 MSI vectors (1 supported) Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI IRQ 48 to local APIC 2 vector 49 Sep 4 13:44:55 C720-1400094 kernel: hdac0: using IRQ 48 for MSI Sep 4 13:44:55 C720-1400094 kernel: hdac0: Caps: OSS 2, ISS 0, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256 Sep 4 13:44:55 C720-1400094 kernel: xhci0: mem 0xe0500000-0xe050ffff at device 20.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: xhci0: 32 bytes context size, 64-bit DMA Sep 4 13:44:55 C720-1400094 kernel: xhci0: attempting to allocate 1 MSI vectors (8 supported) Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI IRQ 49 to local APIC 0 vector 58 Sep 4 13:44:55 C720-1400094 kernel: xhci0: using IRQ 49 for MSI Sep 4 13:44:55 C720-1400094 kernel: xhci0: MSI enabled Sep 4 13:44:55 C720-1400094 kernel: xhci0: Port routing mask set to 0xffffffff Sep 4 13:44:55 C720-1400094 kernel: usbus0 on xhci0 Sep 4 13:44:55 C720-1400094 kernel: xhci0: usbpf: Attached Sep 4 13:44:55 C720-1400094 kernel: usbus0: 5.0Gbps Super Speed USB v3.0 Sep 4 13:44:55 C720-1400094 kernel: pci0: at device 21.0 (no driver attached) Sep 4 13:44:55 C720-1400094 kernel: pci0: at device 21.1 (no driver attached) Sep 4 13:44:55 C720-1400094 kernel: pci0: at device 21.2 (no driver attached) Sep 4 13:44:55 C720-1400094 kernel: hdac1: mem 0xe0514000-0xe0517fff at device 27.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: hdac1: PCI card vendor: 0x1025, device: 0x0a11 Sep 4 13:44:55 C720-1400094 kernel: hdac1: HDA Driver Revision: 20120126_0002 Sep 4 13:44:55 C720-1400094 kernel: hdac1: Config options: on=0x00000000 off=0x00000000 Sep 4 13:44:55 C720-1400094 kernel: hdac1: attempting to allocate 1 MSI vectors (1 supported) Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI IRQ 50 to local APIC 2 vector 50 Sep 4 13:44:55 C720-1400094 kernel: hdac1: using IRQ 50 for MSI Sep 4 13:44:55 C720-1400094 kernel: hdac1: Caps: OSS 4, ISS 4, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256 Sep 4 13:44:55 C720-1400094 kernel: pcib1: at device 28.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0400000-0xe04fffff) for rid 20 of pcib1 Sep 4 13:44:55 C720-1400094 kernel: pcib1: domain 0 Sep 4 13:44:55 C720-1400094 kernel: pcib1: secondary bus 1 Sep 4 13:44:55 C720-1400094 kernel: pcib1: subordinate bus 1 Sep 4 13:44:55 C720-1400094 kernel: pcib1: memory decode 0xe0400000-0xe04fffff Sep 4 13:44:55 C720-1400094 kernel: pcib1: special decode ISA Sep 4 13:44:55 C720-1400094 kernel: pci1: on pcib1 Sep 4 13:44:55 C720-1400094 kernel: pcib1: allocated bus range (1-1) for rid 0 of pci1 Sep 4 13:44:55 C720-1400094 kernel: pci1: domain=0, physical bus=1 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x168c, dev=0x0034, revid=0x01 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=1, slot=0, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=02-80-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0002, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=a, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 2 supports D0 D1 D2 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 4 messages, 64 bit, vector masks Sep 4 13:44:55 C720-1400094 kernel: map[10]: type Memory, range 64, base 0xe0400000, size 19, enabled Sep 4 13:44:55 C720-1400094 kernel: pcib1: allocated memory range (0xe0400000-0xe047ffff) for rid 10 of pci0:1:0:0 Sep 4 13:44:55 C720-1400094 kernel: ath0: mem 0xe0400000-0xe047ffff at device 0.0 on pci1 Sep 4 13:44:55 C720-1400094 kernel: pcib1: matched entry for 1.0.INTA Sep 4 13:44:55 C720-1400094 kernel: pcib1: slot 0 INTA hardwired to IRQ 16 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 16 (PCI IRQ 16) to lapic 0 vector 59 Sep 4 13:44:55 C720-1400094 kernel: ar9300_flash_map: unimplemented for now Sep 4 13:44:55 C720-1400094 kernel: Restoring Cal data from DRAM Sep 4 13:44:55 C720-1400094 kernel: Restoring Cal data from EEPROM Sep 4 13:44:55 C720-1400094 kernel: Restoring Cal data from Flash Sep 4 13:44:55 C720-1400094 syslogd: last message repeated 1 times Sep 4 13:44:55 C720-1400094 kernel: Restoring Cal data from OTP Sep 4 13:44:55 C720-1400094 kernel: ar9300_hw_attach: ar9300_eeprom_attach returned 0 Sep 4 13:44:55 C720-1400094 kernel: ath0: RX status length: 48 Sep 4 13:44:55 C720-1400094 kernel: ath0: RX buffer size: 4096 Sep 4 13:44:55 C720-1400094 kernel: ath0: TX descriptor length: 128 Sep 4 13:44:55 C720-1400094 kernel: ath0: TX status length: 36 Sep 4 13:44:55 C720-1400094 kernel: ath0: TX buffers per descriptor: 4 Sep 4 13:44:55 C720-1400094 kernel: ath0: ath_edma_setup_rxfifo: type=0, FIFO depth = 16 entries Sep 4 13:44:55 C720-1400094 kernel: ath0: ath_edma_setup_rxfifo: type=1, FIFO depth = 128 entries Sep 4 13:44:55 C720-1400094 kernel: ath0: RX timestamp: 32 bits Sep 4 13:44:55 C720-1400094 kernel: ath0: TX timestamp: 32 bits Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] enabling HT modes Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] enabling short-GI in 20MHz mode Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] 1 stream STBC receive enabled Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] 1 stream STBC transmit enabled Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] LDPC transmit/receive enabled Sep 4 13:44:55 C720-1400094 kernel: ath0: [HT] 2 RX streams; 2 TX streams Sep 4 13:44:55 C720-1400094 kernel: ath0: 11a rates: 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11b rates: 1Mbps 2Mbps 5.5Mbps 11Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11g rates: 1Mbps 2Mbps 5.5Mbps 11Mbps 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 2T2R Sep 4 13:44:55 C720-1400094 kernel: ath0: 11na MCS 20MHz Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 6.5Mbps - 65Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 13Mbps - 130Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11na MCS 20MHz SGI Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 7Mbps - 72Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 14.5Mbps - 144.5Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11na MCS 40MHz: Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 13.5Mbps - 135Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 27Mbps - 270Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11na MCS 40MHz SGI: Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 15Mbps - 150Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 30Mbps - 300Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11ng MCS 20MHz Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 6.5Mbps - 65Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 13Mbps - 130Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11ng MCS 20MHz SGI Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 7Mbps - 72Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 14.5Mbps - 144.5Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11ng MCS 40MHz: Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 13.5Mbps - 135Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 27Mbps - 270Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: 11ng MCS 40MHz SGI: Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 0-7: 15Mbps - 150Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: MCS 8-15: 30Mbps - 300Mbps Sep 4 13:44:55 C720-1400094 kernel: ath0: AR9460 mac 640.2 RF5110 phy 2456.12 Sep 4 13:44:55 C720-1400094 kernel: ath0: 2GHz radio: 0x0000; 5GHz radio: 0x0000 Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 1 for WME_AC_BE traffic Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 0 for WME_AC_BK traffic Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 2 for WME_AC_VI traffic Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 3 for WME_AC_VO traffic Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 8 for CAB traffic Sep 4 13:44:55 C720-1400094 kernel: ath0: Use hw queue 9 for beacons Sep 4 13:44:55 C720-1400094 kernel: ath0: using multicast key search Sep 4 13:44:55 C720-1400094 kernel: ehci0: mem 0xe051f800-0xe051fbff at device 29.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: matched entry for 0.29.INTA Sep 4 13:44:55 C720-1400094 kernel: pcib0: slot 29 INTA hardwired to IRQ 19 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 19 (PCI IRQ 19) to lapic 2 vector 51 Sep 4 13:44:55 C720-1400094 kernel: usbus1: EHCI version 1.0 Sep 4 13:44:55 C720-1400094 kernel: usbus1 on ehci0 Sep 4 13:44:55 C720-1400094 kernel: ehci0: usbpf: Attached Sep 4 13:44:55 C720-1400094 kernel: usbus1: 480Mbps High Speed USB v2.0 Sep 4 13:44:55 C720-1400094 kernel: isab0: at device 31.0 on pci0 Sep 4 13:44:55 C720-1400094 kernel: isa0: on isab0 Sep 4 13:44:55 C720-1400094 kernel: ahci0: port 0x1860-0x1867,0x1870-0x1873,0x1868-0x186f,0x1874-0x1877,0x1840-0x185f mem 0xe051f000-0xe051f7ff irq 22 at device 31.2 on pci0 Sep 4 13:44:55 C720-1400094 kernel: ahci0: attempting to allocate 1 MSI vectors (1 supported) Sep 4 13:44:55 C720-1400094 kernel: msi: routing MSI IRQ 51 to local APIC 0 vector 60 Sep 4 13:44:55 C720-1400094 kernel: ahci0: using IRQ 51 for MSI Sep 4 13:44:55 C720-1400094 kernel: ahci0: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported Sep 4 13:44:55 C720-1400094 kernel: ahci0: Caps: 64bit NCQ MPS SS ALP AL CLO 6Gbps PMD SSC PSC 32cmd 2ports Sep 4 13:44:55 C720-1400094 kernel: ahci0: Caps2: DESO SADM SDS APST Sep 4 13:44:55 C720-1400094 kernel: ahcich0: at channel 0 on ahci0 Sep 4 13:44:55 C720-1400094 kernel: ahcich0: Caps: DSP Sep 4 13:44:55 C720-1400094 kernel: ahcich1: not probed (disabled) Sep 4 13:44:55 C720-1400094 kernel: pci0: at device 31.3 (no driver attached) Sep 4 13:44:55 C720-1400094 kernel: pci0: at device 31.6 (no driver attached) Sep 4 13:44:55 C720-1400094 kernel: acpi_tz0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: acpi_acad0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: AcpiOsExecute: task queue not started Sep 4 13:44:55 C720-1400094 kernel: battery0: on acpi0 Sep 4 13:44:55 C720-1400094 kernel: AcpiOsExecute: task queue not started Sep 4 13:44:55 C720-1400094 kernel: atkbdc0: port 0x60,0x64 irq 1 on acpi0 Sep 4 13:44:55 C720-1400094 kernel: atkbd0: irq 1 on atkbdc0 Sep 4 13:44:55 C720-1400094 kernel: kbd0 at atkbd0 Sep 4 13:44:55 C720-1400094 kernel: kbd0: atkbd0, generic (0), config:0x0, flags:0x1f0000 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 2 vector 52 Sep 4 13:44:55 C720-1400094 kernel: atkbd0: [GIANT-LOCKED] Sep 4 13:44:55 C720-1400094 kernel: psm0: unable to allocate IRQ Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb0000-0xb07ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb0800-0xb0fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb1000-0xb17ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb1800-0xb1fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb2000-0xb27ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb2800-0xb2fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb3000-0xb37ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb3800-0xb3fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb4000-0xb47ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb4800-0xb4fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb5000-0xb57ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb5800-0xb5fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb6000-0xb67ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb6800-0xb6fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb7000-0xb77ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb7800-0xb7fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb8000-0xb87ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb8800-0xb8fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb9000-0xb97ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xb9800-0xb9fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xba000-0xba7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xba800-0xbafff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbb000-0xbb7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbb800-0xbbfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbc000-0xbc7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbc800-0xbcfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbd000-0xbd7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbd800-0xbdfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbe000-0xbe7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbe800-0xbefff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbf000-0xbf7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xbf800-0xbffff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc0000-0xc07ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc0800-0xc0fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc1000-0xc17ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc1800-0xc1fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc2000-0xc27ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc2800-0xc2fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc3000-0xc37ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc3800-0xc3fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc4000-0xc47ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc4800-0xc4fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc5000-0xc57ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc5800-0xc5fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc6000-0xc67ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc6800-0xc6fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc7000-0xc77ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc7800-0xc7fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc8000-0xc87ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc8800-0xc8fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc9000-0xc97ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xc9800-0xc9fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xca000-0xca7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xca800-0xcafff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcb000-0xcb7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcb800-0xcbfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcc000-0xcc7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcc800-0xccfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcd000-0xcd7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcd800-0xcdfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xce000-0xce7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xce800-0xcefff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcf000-0xcf7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xcf800-0xcffff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd0000-0xd07ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd0800-0xd0fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd1000-0xd17ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd1800-0xd1fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd2000-0xd27ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd2800-0xd2fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd3000-0xd37ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd3800-0xd3fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd4000-0xd47ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd4800-0xd4fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd5000-0xd57ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd5800-0xd5fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd6000-0xd67ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd6800-0xd6fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd7000-0xd77ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd7800-0xd7fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd8000-0xd87ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd8800-0xd8fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd9000-0xd97ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xd9800-0xd9fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xda000-0xda7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xda800-0xdafff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdb000-0xdb7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdb800-0xdbfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdc000-0xdc7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdc800-0xdcfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdd000-0xdd7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdd800-0xddfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xde000-0xde7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xde800-0xdefff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdf000-0xdf7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xdf800-0xdffff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0000-0xe07ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe0800-0xe0fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe1000-0xe17ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe1800-0xe1fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe2000-0xe27ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe2800-0xe2fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe3000-0xe37ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe3800-0xe3fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe4000-0xe47ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe4800-0xe4fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe5000-0xe57ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe5800-0xe5fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe6000-0xe67ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe6800-0xe6fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe7000-0xe77ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe7800-0xe7fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe8000-0xe87ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe8800-0xe8fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe9000-0xe97ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xe9800-0xe9fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xea000-0xea7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xea800-0xeafff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xeb000-0xeb7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xeb800-0xebfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xec000-0xec7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xec800-0xecfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xed000-0xed7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xed800-0xedfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xee000-0xee7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xee800-0xeefff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xef000-0xef7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xef800-0xeffff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf0000-0xf07ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf0800-0xf0fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf1000-0xf17ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf1800-0xf1fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf2000-0xf27ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf2800-0xf2fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf3000-0xf37ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf3800-0xf3fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf4000-0xf47ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf4800-0xf4fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf5000-0xf57ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf5800-0xf5fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf6000-0xf67ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf6800-0xf6fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf7000-0xf77ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf7800-0xf7fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf8000-0xf87ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf8800-0xf8fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf9000-0xf97ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xf9800-0xf9fff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfa000-0xfa7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfa800-0xfafff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfb000-0xfb7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfb800-0xfbfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfc000-0xfc7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfc800-0xfcfff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfd000-0xfd7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfe000-0xfe7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xfe800-0xfefff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xff000-0xff7ff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: allocated type 3 (0xff800-0xfffff) for rid 0 of orm0 Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 0: ioport 0xc00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 1: ioport 0x1c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 2: ioport 0x2c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 3: ioport 0x3c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 4: ioport 0x4c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 5: ioport 0x5c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 6: ioport 0x6c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 7: ioport 0x7c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 8: ioport 0x8c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 9: ioport 0x9c00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 10: ioport 0xac00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 11: ioport 0xbc00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 12: ioport 0xcc00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 13: ioport 0xdc00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: ahc_isa_identify 14: ioport 0xec00 alloc failed Sep 4 13:44:55 C720-1400094 kernel: isa_probe_children: disabling PnP devices Sep 4 13:44:55 C720-1400094 kernel: isa_probe_children: probing non-PnP devices Sep 4 13:44:55 C720-1400094 kernel: sc0 failed to probe on isa0 Sep 4 13:44:55 C720-1400094 kernel: vga0 failed to probe on isa0 Sep 4 13:44:55 C720-1400094 kernel: isa_probe_children: probing PnP devices Sep 4 13:44:55 C720-1400094 kernel: AcpiOsExecute: task queue not started Sep 4 13:44:55 C720-1400094 syslogd: last message repeated 1 times Sep 4 13:44:55 C720-1400094 kernel: est0: on cpu0 Sep 4 13:44:55 C720-1400094 kernel: p4tcc0: on cpu0 Sep 4 13:44:55 C720-1400094 kernel: est1: on cpu1 Sep 4 13:44:55 C720-1400094 kernel: p4tcc1: on cpu1 Sep 4 13:44:55 C720-1400094 kernel: Device configuration finished. Sep 4 13:44:55 C720-1400094 kernel: procfs registered Sep 4 13:44:55 C720-1400094 kernel: Statistical TSC calibration took 10844 us and 16583 data points Sep 4 13:44:55 C720-1400094 kernel: Timecounter "TSC" frequency 1396766381 Hz quality 1000 Sep 4 13:44:55 C720-1400094 kernel: Statistical lapic calibration took 3347 us and 13917 data points Sep 4 13:44:55 C720-1400094 kernel: lapic: Divisor 2, Frequency 49884425 Hz Sep 4 13:44:55 C720-1400094 kernel: lapic: deadline tsc mode, Frequency 1396766381 Hz Sep 4 13:44:55 C720-1400094 kernel: Timecounters tick every 1.000 msec Sep 4 13:44:55 C720-1400094 kernel: vlan: initialized, using hash tables with chaining Sep 4 13:44:55 C720-1400094 kernel: lo0: bpf attached Sep 4 13:44:55 C720-1400094 kernel: IPsec: Initialized Security Association Processing. Sep 4 13:44:55 C720-1400094 kernel: tcp_init: net.inet.tcp.tcbhashsize auto tuned to 16384 Sep 4 13:44:55 C720-1400094 kernel: ugen1.1: at usbus1 Sep 4 13:44:55 C720-1400094 kernel: ugen0.1: at usbus0 Sep 4 13:44:55 C720-1400094 kernel: uhub0 on usbus1 Sep 4 13:44:55 C720-1400094 kernel: uhub0: on usbus1 Sep 4 13:44:55 C720-1400094 kernel: uhub1 on usbus0 Sep 4 13:44:55 C720-1400094 kernel: uhub1: on usbus0 Sep 4 13:44:55 C720-1400094 kernel: AcpiOsExecute: enqueue 4 pending tasks Sep 4 13:44:55 C720-1400094 kernel: acpi_tz0: switched from NONE to _AC1: 37.9C Sep 4 13:44:55 C720-1400094 kernel: hdacc0: ahcich0: AHCI reset... Sep 4 13:44:55 C720-1400094 kernel: at cad 0 on hdac0 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: at nid 1 on hdacc0 Sep 4 13:44:55 C720-1400094 kernel: ahcich0: SATA connect time=100us status=00000133 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Subsystem ID: 0x80860101 Sep 4 13:44:55 C720-1400094 kernel: ahcich0: AHCI reset: device found Sep 4 13:44:55 C720-1400094 kernel: hdaa0: NumGPIO=0 NumGPO=0 NumGPI=0 GPIWake=0 GPIUnsol=0 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Original pins configuration: Sep 4 13:44:55 C720-1400094 kernel: ahcich0: AHCI reset: device ready after 0ms Sep 4 13:44:55 C720-1400094 kernel: hdaa0: nid 0x as seq device conn jack loc color misc Sep 4 13:44:55 C720-1400094 kernel: hdaa0: 3 18560010 1 0 Digital-out Jack Digital 0x18 Unknown 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Patched pins configuration: Sep 4 13:44:55 C720-1400094 kernel: hdaa0: nid 0x as seq device conn jack loc color misc Sep 4 13:44:55 C720-1400094 kernel: hdaa0: 3 18560010 1 0 Digital-out Jack Digital 0x18 Unknown 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: 1 associations found: Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Association 0 (1) out: Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Pin nid=3 seq=0 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Tracing association 0 (1) Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Pin 3 traced to DAC 2 Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Association 0 (1) trace succeeded Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Looking for additional DAC for association 0 (1) Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Tracing input monitor Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Tracing other input monitors Sep 4 13:44:55 C720-1400094 kernel: hdaa0: Tracing beeper Sep 4 13:44:55 C720-1400094 kernel: hdaa0: FG config/quirks: forcestereo ivref50 ivref80 ivref100 ivref Sep 4 13:44:55 C720-1400094 kernel: pcm0: at nid 3 on hdaa0 Sep 4 13:44:55 C720-1400094 kernel: acpi_acad0: acline initialization start Sep 4 13:44:55 C720-1400094 kernel: pcm0: Playback: Sep 4 13:44:55 C720-1400094 kernel: pcm0: Stream cap: 0x00000005 AC3 PCM Sep 4 13:44:55 C720-1400094 kernel: pcm0: PCM cap: 0x001e07f0 16 20 24 32 bits, 32 44 48 88 96 176 192 KHz Sep 4 13:44:55 C720-1400094 kernel: pcm0: DAC: 2 Sep 4 13:44:55 C720-1400094 kernel: pcm0: Sep 4 13:44:55 C720-1400094 kernel: system power profile changed to 'economy' Sep 4 13:44:55 C720-1400094 kernel: pcm0: nid=3 [pin: Digital-out (Jack)] Sep 4 13:44:55 C720-1400094 kernel: pcm0: + <- nid=2 [audio output] [src: pcm] Sep 4 13:44:55 C720-1400094 kernel: pcm0: Sep 4 13:44:55 C720-1400094 kernel: pcm0: Master Volume (OSS: vol): 0/0dB Sep 4 13:44:55 C720-1400094 kernel: pcm0: +- ctl 1 (nid 3 in acpi_acad0: Off Line Sep 4 13:44:55 C720-1400094 kernel: ): mute Sep 4 13:44:55 C720-1400094 kernel: pcm0: Sep 4 13:44:55 C720-1400094 kernel: pcm0: PCM Volume (OSS: pcm): 0/0dB Sep 4 13:44:55 C720-1400094 kernel: pcm0: +- ctl 1 (nid 3 in ): mute Sep 4 13:44:55 C720-1400094 kernel: acpi_acad0: acline initialization done, tried 1 times Sep 4 13:44:55 C720-1400094 kernel: pcm0: Sep 4 13:44:55 C720-1400094 kernel: pcm0: Mixer "vol":battery0: battery initialization start Sep 4 13:44:55 C720-1400094 kernel: Sep 4 13:44:55 C720-1400094 kernel: pcm0: Mixer "pcm": Sep 4 13:44:55 C720-1400094 kernel: pcm0: Soft PCM mixer ENABLED Sep 4 13:44:55 C720-1400094 kernel: battery0: rev = ffff Sep 4 13:44:55 C720-1400094 kernel: pcm0: Playback channel matrix is: unknown, assuming 7.1 (disconnected) Sep 4 13:44:55 C720-1400094 kernel: battery0: units = 0 Sep 4 13:44:55 C720-1400094 kernel: hdacc1: battery0: dcap = 0 Sep 4 13:44:55 C720-1400094 kernel: at cad 0battery0: lfcap = 0 Sep 4 13:44:55 C720-1400094 kernel: on hdac1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: battery0: btech = 0 Sep 4 13:44:55 C720-1400094 kernel: at nid 1 on hdacc1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Subsystem ID: 0x10ec0283 Sep 4 13:44:55 C720-1400094 kernel: battery0: dvol = 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: NumGPIO=3 NumGPO=0 NumGPI=0 GPIWake=0 GPIUnsol=1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO0: disabled Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO1: disabled Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO2: disabled Sep 4 13:44:55 C720-1400094 kernel: battery0: wcap = 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Original pins configuration: Sep 4 13:44:55 C720-1400094 kernel: hdaa1: nid 0x as seq device conn jack loc color misc Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 18 411111f0 15 0 Speaker None 1/8 Rear Black 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 20 90170110 1 0 Speaker Fixed Analog Internal Unknown 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 23 411111f0 15 0 Speaker None 1/8 Rear Black 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 24 411111f0 15 0 Speaker None 1/8 Rear Black 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 25 03a11020 2 0 Mic Jack 1/8 Left Black 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 26 90a70111 1 1 Mic Fixed Analog Internal Unknown 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 27 411111f0 15 0 Speaker None 1/8 Rear Black 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 29 4015812d 2 13 Speaker None Optical 0x00 Purple 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 30 411111f0 15 0 Speaker None 1/8 Rear Black 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 33 03211021 2 1 Headphones Jack 1/8 Left Black 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Patching widget caps nid=29 0x00400400 -> 0x00700400 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Patched pins configuration: Sep 4 13:44:55 C720-1400094 kernel: hdaa1: nid 0x as seq device conn jack loc color misc Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 18 411111f0 15 0 Speaker None 1/8 Rear Black 1 DISA Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 20 90170110 1 0 Speaker Fixed Analog Internal Unknown 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 23 411111f0 15 0 Speaker None 1/8 Rear Black 1 DISA Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 24 411111f0 15 0 Speaker None 1/8 Rear Black 1 DISA Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 25 03a11020 2 0 Mic Jack 1/8 Left Black 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 26 90a70111 1 1 Mic Fixed Analog Internal Unknown 1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 27 411111f0 15 0 Speaker None 1/8 Rear Black 1 DISA Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 30 411111f0 15 0 Speaker None 1/8 Rear Black 1 DISA Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 33 03211021 2 1 Headphones Jack 1/8 Left Black 0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: hdaa_audio_as_parse: Pin 26 has wrong direction for association 1! Disabling association. Sep 4 13:44:55 C720-1400094 kernel: hdaa1: hdaa_audio_as_parse: Pin 33 has wrong direction for association 2! Disabling association. Sep 4 13:44:55 C720-1400094 kernel: hdaa1: 2 associations found: Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Association 0 (1) out (disabled): Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Pin nid=20 seq=0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Pin nid=26 seq=1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Association 1 (2) in (disabled): Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Pin nid=25 seq=0 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Pin nid=33 seq=1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Tracing input monitor Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Tracing other input monitors Sep 4 13:44:55 C720-1400094 kernel: hdaa1: Tracing beeper Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO commit Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO0: output state=1 Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO1: disabled Sep 4 13:44:55 C720-1400094 kernel: hdaa1: GPIO2: disabled Sep 4 13:44:55 C720-1400094 kernel: hdaa1: FG config/quirks: forcestereo ivref50 ivref80 ivref100 ivref Sep 4 13:44:55 C720-1400094 kernel: battery0: lcap = 0 Sep 4 13:44:55 C720-1400094 kernel: battery0: gra1 = 0 Sep 4 13:44:55 C720-1400094 kernel: battery0: gra2 = 0 Sep 4 13:44:55 C720-1400094 kernel: battery0: battery initialization done, tried 1 times Sep 4 13:44:55 C720-1400094 kernel: ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 Sep 4 13:44:55 C720-1400094 kernel: ada0: ACS-2 ATA SATA 3.x device Sep 4 13:44:55 C720-1400094 kernel: ada0: Serial Number C196530955 Sep 4 13:44:55 C720-1400094 kernel: ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 1024bytes) Sep 4 13:44:55 C720-1400094 kernel: ada0: Command Queueing enabled Sep 4 13:44:55 C720-1400094 kernel: ada0: 244198MB (500118192 512 byte sectors) Sep 4 13:44:55 C720-1400094 kernel: pass0 at ahcich0 bus 0 scbus0 target 0 lun 0 Sep 4 13:44:55 C720-1400094 kernel: pass0: ACS-2 ATA SATA 3.x device Sep 4 13:44:55 C720-1400094 kernel: pass0: Serial Number C196530955 Sep 4 13:44:55 C720-1400094 kernel: pass0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 1024bytes) Sep 4 13:44:55 C720-1400094 kernel: pass0: Command Queueing enabled Sep 4 13:44:55 C720-1400094 kernel: pci0: driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c60, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=08-01-02, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:0: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c61, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=1 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:1: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c62, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=2 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:2: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c22, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=3 Sep 4 13:44:55 C720-1400094 kernel: class=0c-05-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0103, statreg=0x0280, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:31:3: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c24, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=6 Sep 4 13:44:55 C720-1400094 kernel: class=11-80-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0102, statreg=0x0010, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: pci0:0:31:6: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: pci1: driver added Sep 4 13:44:55 C720-1400094 kernel: WARNING: WITNESS option enabled, expect reduced performance. Sep 4 13:44:55 C720-1400094 kernel: Trying to mount root from ufs:/dev/ufs/FreeBSD_Install [rw,noatime]... Sep 4 13:44:55 C720-1400094 kernel: GEOM: new disk ada0 Sep 4 13:44:55 C720-1400094 kernel: uhub1: 13 ports with 13 removable, self powered Sep 4 13:44:55 C720-1400094 kernel: uhub0: 2 ports with 2 removable, self powered Sep 4 13:44:55 C720-1400094 kernel: Root mount waiting for: usbus0 usbus1 Sep 4 13:44:55 C720-1400094 kernel: ugen0.2: at usbus0 Sep 4 13:44:55 C720-1400094 kernel: ugen1.2: at usbus1 Sep 4 13:44:55 C720-1400094 kernel: uhub2 on uhub0 Sep 4 13:44:55 C720-1400094 kernel: uhub2: on usbus1 Sep 4 13:44:55 C720-1400094 kernel: ugen0.3: at usbus0 Sep 4 13:44:55 C720-1400094 kernel: uhub2: 8 ports with 8 removable, self powered Sep 4 13:44:55 C720-1400094 kernel: ugen0.4: at usbus0 Sep 4 13:44:55 C720-1400094 kernel: umass0 on uhub1 Sep 4 13:44:55 C720-1400094 kernel: umass0: on usbus0 Sep 4 13:44:55 C720-1400094 kernel: umass0: SCSI over Bulk-Only; quirks = 0x4101 Sep 4 13:44:55 C720-1400094 kernel: umass0:1:0: Attached to scbus1 Sep 4 13:44:55 C720-1400094 kernel: Root mount waiting for: CAM Sep 4 13:44:55 C720-1400094 kernel: pass1 at umass-sim0 bus 0 scbus1 target 0 lun 0 Sep 4 13:44:55 C720-1400094 kernel: pass1: Removable Direct Access SPC-2 SCSI device Sep 4 13:44:55 C720-1400094 kernel: pass1: Serial Number AC8B2BF6 Sep 4 13:44:55 C720-1400094 kernel: pass1: 40.000MB/s transfers Sep 4 13:44:55 C720-1400094 kernel: mountroot: waiting for device /dev/ufs/FreeBSD_Install... Sep 4 13:44:55 C720-1400094 kernel: da0 at umass-sim0 bus 0 scbus1 target 0 lun 0 Sep 4 13:44:55 C720-1400094 kernel: da0: Removable Direct Access SPC-2 SCSI device Sep 4 13:44:55 C720-1400094 kernel: da0: Serial Number AC8B2BF6 Sep 4 13:44:55 C720-1400094 kernel: da0: 40.000MB/s transfers Sep 4 13:44:55 C720-1400094 kernel: da0: 30000MB (61440000 512 byte sectors) Sep 4 13:44:55 C720-1400094 kernel: da0: quirks=0x2 Sep 4 13:44:55 C720-1400094 kernel: da0: Delete methods: Sep 4 13:44:55 C720-1400094 kernel: GEOM: new disk da0 Sep 4 13:44:55 C720-1400094 kernel: (da0:umass-sim0:0:0:0): PREVENT ALLOW MEDIUM REMOVAL not supported. Sep 4 13:44:55 C720-1400094 kernel: Warning: bad time from time-of-day clock, system time will not be set accurately Sep 4 13:44:55 C720-1400094 kernel: start_init: trying /sbin/init Sep 4 13:44:55 C720-1400094 kernel: pci0: driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c60, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=08-01-02, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:0: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c61, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=1 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:1: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: ig4iic0: mem 0xe051a000-0xe051afff,0xe051b000-0xe051bfff at device 21.1 on pci0 Sep 4 13:44:55 C720-1400094 kernel: ig4iic0: Using MSI Sep 4 13:44:55 C720-1400094 kernel: pcib0: matched entry for 0.21.INTC Sep 4 13:44:55 C720-1400094 kernel: pcib0: slot 21 INTC hardwired to IRQ 21 Sep 4 13:44:55 C720-1400094 kernel: ig4iic0: Controller parameters: Sep 4 13:44:55 C720-1400094 kernel: Speed: Fast Sep 4 13:44:55 C720-1400094 kernel: Regs: HCNT :LCNT :SDAHLD Sep 4 13:44:55 C720-1400094 kernel: Std: 0x01ab:0x01f3:0x0009 Sep 4 13:44:55 C720-1400094 kernel: Fast: 0x0057:0x009f:0x0009 Sep 4 13:44:55 C720-1400094 kernel: FIFO: RX:0x0020: TX:0x0020 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 0 vector 61 Sep 4 13:44:55 C720-1400094 kernel: iicbus0: on ig4iic0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c62, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=2 Sep 4 13:44:55 C720-1400094 kernel: class=0c-80-00, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:2: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: ig4iic1: mem 0xe051c000-0xe051cfff,0xe051d000-0xe051dfff at device 21.2 on pci0 Sep 4 13:44:55 C720-1400094 kernel: ig4iic1: Using MSI Sep 4 13:44:55 C720-1400094 kernel: pcib0: matched entry for 0.21.INTC Sep 4 13:44:55 C720-1400094 kernel: pcib0: slot 21 INTC hardwired to IRQ 21 Sep 4 13:44:55 C720-1400094 kernel: ig4iic1: Controller parameters: Sep 4 13:44:55 C720-1400094 kernel: Speed: Fast Sep 4 13:44:55 C720-1400094 kernel: Regs: HCNT :LCNT :SDAHLD Sep 4 13:44:55 C720-1400094 kernel: Std: 0x01ab:0x01f3:0x0009 Sep 4 13:44:55 C720-1400094 kernel: Fast: 0x0057:0x009f:0x0009 Sep 4 13:44:55 C720-1400094 kernel: FIFO: RX:0x0020: TX:0x0020 Sep 4 13:44:55 C720-1400094 kernel: iicbus1: on ig4iic1 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c22, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=3 Sep 4 13:44:55 C720-1400094 kernel: class=0c-05-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0103, statreg=0x0280, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:31:3: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: ichsmb0: port 0x400-0x41f mem 0xe051fc00-0xe051fcff at device 31.3 on pci0 Sep 4 13:44:55 C720-1400094 kernel: pcib0: matched entry for 0.31.INTB Sep 4 13:44:55 C720-1400094 kernel: pcib0: slot 31 INTB hardwired to IRQ 18 Sep 4 13:44:55 C720-1400094 kernel: ioapic0: routing intpin 18 (PCI IRQ 18) to lapic 2 vector 53 Sep 4 13:44:55 C720-1400094 kernel: smbus0: on ichsmb0 Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c24, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=31, func=6 Sep 4 13:44:55 C720-1400094 kernel: class=11-80-00, hdrtype=0x00, mfdev=0 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0102, statreg=0x0010, cachelnsz=0 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=c, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: MSI supports 1 message Sep 4 13:44:55 C720-1400094 kernel: pci0:0:31:6: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: mem 0xe051e000-0xe051efff at device 31.6 on pci0 Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: Enabling Sensor Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: Catastrophic Power Down Disable Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: SMBus report Enable Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: SMI on alert Disable Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: TSPM: 0 Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: MAX Thermal Sensor Shutdown Time 16s Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: Throttling 0 Sep 4 13:44:55 C720-1400094 kernel: pchtherm0: TL2 flag 0 Sep 4 13:44:55 C720-1400094 kernel: pci1: driver added Sep 4 13:44:55 C720-1400094 kernel: pci0: driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c60, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=08-01-02, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:0: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: pci1: driver added Sep 4 13:44:55 C720-1400094 kernel: pci0: driver added Sep 4 13:44:55 C720-1400094 kernel: found-> vendor=0x8086, dev=0x9c60, revid=0x04 Sep 4 13:44:55 C720-1400094 kernel: domain=0, bus=0, slot=21, func=0 Sep 4 13:44:55 C720-1400094 kernel: class=08-01-02, hdrtype=0x00, mfdev=1 Sep 4 13:44:55 C720-1400094 kernel: cmdreg=0x0106, statreg=0x0010, cachelnsz=16 (dwords) Sep 4 13:44:55 C720-1400094 kernel: lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) Sep 4 13:44:55 C720-1400094 kernel: intpin=b, irq=255 Sep 4 13:44:55 C720-1400094 kernel: powerspec 3 supports D0 D3 current D0 Sep 4 13:44:55 C720-1400094 kernel: pci0:0:21:0: reprobing on driver added Sep 4 13:44:55 C720-1400094 kernel: pci1: driver added Sep 4 13:44:55 C720-1400094 kernel: wlan0: bpf attached Sep 4 13:44:55 C720-1400094 syslogd: last message repeated 1 times Sep 4 13:44:55 C720-1400094 kernel: wlan0: Ethernet address: 90:48:9a:92:9e:43 Sep 4 13:44:55 C720-1400094 kernel: lo0: link state changed to UP Sep 4 13:44:55 C720-1400094 wpa_supplicant[264]: wlan0: Trying to associate with 7c:ff:4d:c8:78:e2 (SSID='tarara' freq=2432 MHz) Sep 4 13:44:55 C720-1400094 wpa_supplicant[264]: wlan0: Associated with 7c:ff:4d:c8:78:e2 Sep 4 13:44:55 C720-1400094 kernel: wlan0: link state changed to UP Sep 4 13:44:55 C720-1400094 wpa_supplicant[264]: wlan0: WPA: Key negotiation completed with 7c:ff:4d:c8:78:e2 [PTK=CCMP GTK=CCMP] Sep 4 13:44:55 C720-1400094 wpa_supplicant[264]: wlan0: CTRL-EVENT-CONNECTED - Connection to 7c:ff:4d:c8:78:e2 completed [id=17 id_str=] Sep 4 13:44:55 C720-1400094 dhclient[944]: New IP Address (wlan0): 192.168.178.24 Sep 4 13:44:55 C720-1400094 dhclient[948]: New Subnet Mask (wlan0): 255.255.255.0 Sep 4 13:44:55 C720-1400094 dhclient[952]: New Broadcast Address (wlan0): 192.168.178.255 Sep 4 13:44:55 C720-1400094 dhclient[956]: New Routers (wlan0): 192.168.178.1 Sep 4 13:45:17 C720-1400094 su[1034]: guru to root on /dev/pts/0 Sep 4 13:45:55 C720-1400094 kernel: usb_dev_suspend_peer: Setting device remote wakeup failed --AFCCYDK0QqY9NShb-- From nobody Mon Sep 4 16:55:52 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfZXg4RnSz4sJC9 for ; Mon, 4 Sep 2023 16:56:19 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfZXg16xdz4QPM for ; Mon, 4 Sep 2023 16:56:19 +0000 (UTC) (envelope-from grembo@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 42ada3f1; Mon, 4 Sep 2023 16:56:11 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 36c476f8 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 4 Sep 2023 16:56:10 +0000 (UTC) Date: Mon, 4 Sep 2023 18:55:52 +0200 From: Michael Gmelin To: Matthias Apitz Cc: freebsd-current@freebsd.org Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: <20230904185552.0f7559be.grembo@freebsd.org> In-Reply-To: References: X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE] X-Rspamd-Queue-Id: 4RfZXg16xdz4QPM On Mon, 4 Sep 2023 18:43:11 +0200 Matthias Apitz wrote: > I have a 14.0-CURRENT compiled from sources of head from August 4, > which boots fine from a produced USB key, but the keyboard does not > work on an Acer C720 (amd64), on other laptops the keyboard is fine. > > The keyboard works during the boot menu (for example to enable verbose > boot messages) but not on the login: prompt of the booted system. > > I've enabled SSH access into the C720 (if someone need more > information) and I'm attaching /var/log/messages of the booted system. Hi Matthias, The C720 required special patches for the keyboard to work, which I originally added here: https://cgit.freebsd.org/src/commit/?id=6c176113bbdd598231ec47d161d4c3714997169b I assume that something in that area changed recently. Without digging into it, this looks like a possible cause: https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=ce881170088c4c98c036fe561f8ee8413c2e2585 atkbd: Disable periodic polling by default. It is one of the few remaining Giant-locked callouts. It would be good to remove it, not mentioning that polling itself is not good. If this cause keyboard/mouse freezes on some hardware, please set loader tunable hw.atkbd.hz=1 as workaround and report the issue. So you could try to set hw.atkbd.hz=1 (or hw.atkbd.hz=10) in /boot/loader.conf, then reboot and see if it helps. Best Michael -- Michael Gmelin From nobody Mon Sep 4 17:05:00 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfZkk4HKjz4sMdN; Mon, 4 Sep 2023 17:05:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x112b.google.com (mail-yw1-x112b.google.com [IPv6:2607:f8b0:4864:20::112b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfZkk22d5z4SxJ; Mon, 4 Sep 2023 17:05:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112b.google.com with SMTP id 00721157ae682-58d40c2debeso16590597b3.2; Mon, 04 Sep 2023 10:05:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693847101; x=1694451901; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=Ur6PHKlsJUqc/qt+QfqPY/7wFvwcDeU72T/JsrFHVNQ=; b=cmecwnDPfN2FpafzYw8rwymI18+4CwU+L3VKtWC8qBE4zvBk5P5hUDCaMyzU9VGzFB hI9qx1zHdzof1VRpaciR5fbuyJTep3xiGFCUluwd5gVVt0eUfb9t9BMUW19z3Wc9bOS1 pbyW7G1I5EjdHigJjd8n38/X5REgIkq9AqLcF+M9FeEjfz9K3W2Kjb4ktT1UgO+eMQPZ iVkBX8cBGotznIQuPU5DG9T6XQw+nMt7nUBm9bd1Mw7bZDXIpOEPl7n2OCnnyHhJ9GET EyKZrc3c2ms/FUn5D/YPLvUnxrrawQSk9neHjmOC+yVef+7e66ElpnNHx7hQjomls+Ji aYtA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693847101; x=1694451901; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ur6PHKlsJUqc/qt+QfqPY/7wFvwcDeU72T/JsrFHVNQ=; b=KwuzQtFLhAvZZtZy9ZdoqFN0V/7KEozVBf9PirRdbnmfY+s7QLJBA0uavYJFTjcZmO 0KjqJQUzIDyJYi21vvSrxVNFRXP/q/LUHeSa14/ySYsj6P3oZ5RLed2KvSOBJ1Ca1QXV s8PWYGac0yiogoLqsiLxNmpr8DGWRklDQI5UV9qYEqIttWYD6ryaIEguaLEo/ARkfkCf 7fIoV4/+vkG8SVFrWV3sDVjkpYgaY4Bpvn8W+yXgc/9DR9Ntw1ugPqdaZUBdNqXmpbIT 2Z96C9lePNDYTgo+M5W3dW6TQXq+gKg9IEHqRmYYQdMT7/jmgeFNhmHIfm0bBE5FAsG/ I9WQ== X-Gm-Message-State: AOJu0YxBdnGLDl0hhfN2PEhX6p8ot6uNuzcG3lnvOtKOeqxPw7dBiocI SfaJoT48t4b0o2BiZerPpJE= X-Google-Smtp-Source: AGHT+IE/SVjFsNwNSey1Aoq9/hX0dww+OXhVeRMgvWhk7IkLd0H0kq/MKf6qTqf/Qy5MRJQmTLg98A== X-Received: by 2002:a81:9988:0:b0:59a:e672:5a03 with SMTP id q130-20020a819988000000b0059ae6725a03mr2828502ywg.44.1693847101261; Mon, 04 Sep 2023 10:05:01 -0700 (PDT) Received: from [192.168.1.66] (104-55-12-234.lightspeed.knvltn.sbcglobal.net. [104.55.12.234]) by smtp.gmail.com with ESMTPSA id eh10-20020a05690c298a00b0059adc0c4392sm721868ywb.140.2023.09.04.10.05.00 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 04 Sep 2023 10:05:00 -0700 (PDT) Message-ID: <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> Date: Mon, 4 Sep 2023 13:05:00 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned Content-Language: en-US To: Mark Millard Cc: dev-commits-src-main@freebsd.org, Current FreeBSD References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> From: Alexander Motin In-Reply-To: <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RfZkk22d5z4SxJ On 04.09.2023 11:45, Mark Millard wrote: > On Sep 4, 2023, at 06:09, Alexander Motin wrote: >> per_txg_dirty_frees_percent is directly related to the delete delays we see here. You are forcing ZFS to commit transactions each 5% of dirty ARC limit, which is 5% of 10% or memory size. I haven't looked on that code recently, but I guess setting it too low can make ZFS commit transactions too often, increasing write inflation for the underlying storage. I would propose you to restore the default and try again. > > While this machine is different, the original problem was worse than > the issue here: the load average was less than 1 for the most part > the parallel bulk build when 30 was used. The fraction of time waiting > was much longer than with 5. If I understand right, both too high and > too low for a type of context can lead to increased elapsed time and > getting it set to a near optimal is a non-obvious exploration. IIRC this limit was modified several times since originally implemented. May be it could benefit from another look, if default 30% is not good. It would be good if generic ZFS issues like this were reported to OpenZFS upstream to be visible to a wider public. Unfortunately I have several other project I must work on, so if it is not a regression I can't promise I'll take it right now, so anybody else is welcome. > An overall point for the goal of my activity is: what makes a > good test context for checking if ZFS is again safe to use? > May be other tradeoffs make, say, 4 hardware threads more > reasonable than 32. Thank you for your testing. The best test is one that nobody else run. It also correlates with the topic of "safe to use", which also depends on what it is used for. :) -- Alexander Motin From nobody Mon Sep 4 17:23:06 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfb7d4bbHz4sVgv for ; Mon, 4 Sep 2023 17:23:09 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfb7d3zzKz4Z3M; Mon, 4 Sep 2023 17:23:09 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [188.174.51.238] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdDI3-00Frs0-WC; Mon, 04 Sep 2023 19:23:08 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 384HN7V4018336 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 4 Sep 2023 19:23:07 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 384HN6bM018335; Mon, 4 Sep 2023 19:23:06 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Mon, 4 Sep 2023 19:23:06 +0200 From: Matthias Apitz To: Michael Gmelin , Alexander Motin Cc: freebsd-current@freebsd.org Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Michael Gmelin , Alexander Motin , freebsd-current@freebsd.org References: <20230904185552.0f7559be.grembo@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20230904185552.0f7559be.grembo@freebsd.org> X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.51.238 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4Rfb7d3zzKz4Z3M Added Alexander Motin to To: as the origin of the CI; Neither hw.atkbd.hz=1 nor hw.atkbd.hz=10 makes the keyboard working on my beloved Acer C720. Should I file a new PR? Thanks matthias El día lunes, septiembre 04, 2023 a las 06:55:52p. m. +0200, Michael Gmelin escribió: > > > On Mon, 4 Sep 2023 18:43:11 +0200 > Matthias Apitz wrote: > > > I have a 14.0-CURRENT compiled from sources of head from August 4, > > which boots fine from a produced USB key, but the keyboard does not > > work on an Acer C720 (amd64), on other laptops the keyboard is fine. > > > > The keyboard works during the boot menu (for example to enable verbose > > boot messages) but not on the login: prompt of the booted system. > > > > I've enabled SSH access into the C720 (if someone need more > > information) and I'm attaching /var/log/messages of the booted system. > > Hi Matthias, > > The C720 required special patches for the keyboard to work, which I > originally added here: > https://cgit.freebsd.org/src/commit/?id=6c176113bbdd598231ec47d161d4c3714997169b > > I assume that something in that area changed recently. > > Without digging into it, this looks like a possible cause: > > https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=ce881170088c4c98c036fe561f8ee8413c2e2585 > > atkbd: Disable periodic polling by default. > It is one of the few remaining Giant-locked callouts. It would be > good to remove it, not mentioning that polling itself is not good. > > If this cause keyboard/mouse freezes on some hardware, please set > loader tunable hw.atkbd.hz=1 as workaround and report the issue. > > So you could try to set hw.atkbd.hz=1 (or hw.atkbd.hz=10) in > /boot/loader.conf, then reboot and see if it helps. > > Best > Michael > > -- > Michael Gmelin > -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Sep 4 17:29:41 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfbHF1dT4z4sYFW for ; Mon, 4 Sep 2023 17:29:45 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfbHD5btcz4c9g; Mon, 4 Sep 2023 17:29:44 +0000 (UTC) (envelope-from grembo@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id e9a8d1b4; Mon, 4 Sep 2023 17:29:42 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 5d30aa39 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 4 Sep 2023 17:29:42 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: 14.0-CURRENT boots fine but keyboard does not work From: Michael Gmelin In-Reply-To: Date: Mon, 4 Sep 2023 19:29:41 +0200 Cc: Alexander Motin , freebsd-current@freebsd.org Message-Id: References: To: Matthias Apitz X-Mailer: iPhone Mail (20G75) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE] X-Rspamd-Queue-Id: 4RfbHD5btcz4c9g > On 4. Sep 2023, at 19:23, Matthias Apitz wrote: >=20 > =EF=BB=BF > Added Alexander Motin to To: as the origin of the CI; >=20 > Neither hw.atkbd.hz=3D1 nor hw.atkbd.hz=3D10 makes the keyboard working on= > my beloved Acer C720. Should I file a new PR? >=20 Filing a PR makes sense, could you please Cc me on it? Do you know which version of FreeBSD was the last that worked for you? Cheers >=20 >=20 >> El d=C3=ADa lunes, septiembre 04, 2023 a las 06:55:52p. m. +0200, Michael= Gmelin escribi=C3=B3: >>=20 >>=20 >>=20 >> On Mon, 4 Sep 2023 18:43:11 +0200 >> Matthias Apitz wrote: >>=20 >>> I have a 14.0-CURRENT compiled from sources of head from August 4, >>> which boots fine from a produced USB key, but the keyboard does not >>> work on an Acer C720 (amd64), on other laptops the keyboard is fine. >>>=20 >>> The keyboard works during the boot menu (for example to enable verbose >>> boot messages) but not on the login: prompt of the booted system. >>>=20 >>> I've enabled SSH access into the C720 (if someone need more >>> information) and I'm attaching /var/log/messages of the booted system. >>=20 >> Hi Matthias, >>=20 >> The C720 required special patches for the keyboard to work, which I >> originally added here: >> https://cgit.freebsd.org/src/commit/?id=3D6c176113bbdd598231ec47d161d4c37= 14997169b >>=20 >> I assume that something in that area changed recently. >>=20 >> Without digging into it, this looks like a possible cause: >>=20 >> https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=3Dce881170= 088c4c98c036fe561f8ee8413c2e2585 >>=20 >> atkbd: Disable periodic polling by default. >> It is one of the few remaining Giant-locked callouts. It would be >> good to remove it, not mentioning that polling itself is not good. >>=20 >> If this cause keyboard/mouse freezes on some hardware, please set >> loader tunable hw.atkbd.hz=3D1 as workaround and report the issue. >>=20 >> So you could try to set hw.atkbd.hz=3D1 (or hw.atkbd.hz=3D10) in >> /boot/loader.conf, then reboot and see if it helps. >>=20 >> Best >> Michael >>=20 >> --=20 >> Michael Gmelin >>=20 >=20 > --=20 > Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +49-17= 6-38902045 > Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Sep 4 17:34:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfbNp6HQfz4sZwJ for ; Mon, 4 Sep 2023 17:34:34 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfbNp5t9lz4fCF; Mon, 4 Sep 2023 17:34:34 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [188.174.51.238] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdDT7-00GHRm-FH; Mon, 04 Sep 2023 19:34:33 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 384HYWbo019154 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 4 Sep 2023 19:34:32 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 384HYWEU019153; Mon, 4 Sep 2023 19:34:32 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Mon, 4 Sep 2023 19:34:32 +0200 From: Matthias Apitz To: Michael Gmelin Cc: Alexander Motin , freebsd-current@freebsd.org Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Michael Gmelin , Alexander Motin , freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.51.238 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4RfbNp5t9lz4fCF El día lunes, septiembre 04, 2023 a las 07:29:41p. m. +0200, Michael Gmelin escribió: > > > > On 4. Sep 2023, at 19:23, Matthias Apitz wrote: > > > >  > > Added Alexander Motin to To: as the origin of the CI; > > > > Neither hw.atkbd.hz=1 nor hw.atkbd.hz=10 makes the keyboard working on > > my beloved Acer C720. Should I file a new PR? > > > > Filing a PR makes sense, could you please Cc me on it? > > Do you know which version of FreeBSD was the last that worked for you? I'm actually using (and typing this on it) r368166. Will file a PR tomorrow. Thanks matthias > >> El día lunes, septiembre 04, 2023 a las 06:55:52p. m. +0200, Michael Gmelin escribió: > >> > >> > >> > >> On Mon, 4 Sep 2023 18:43:11 +0200 > >> Matthias Apitz wrote: > >> > >>> I have a 14.0-CURRENT compiled from sources of head from August 4, > >>> which boots fine from a produced USB key, but the keyboard does not > >>> work on an Acer C720 (amd64), on other laptops the keyboard is fine. > >>> > >>> The keyboard works during the boot menu (for example to enable verbose > >>> boot messages) but not on the login: prompt of the booted system. > >>> > >>> I've enabled SSH access into the C720 (if someone need more > >>> information) and I'm attaching /var/log/messages of the booted system. > >> > >> Hi Matthias, > >> > >> The C720 required special patches for the keyboard to work, which I > >> originally added here: > >> https://cgit.freebsd.org/src/commit/?id=6c176113bbdd598231ec47d161d4c3714997169b > >> > >> I assume that something in that area changed recently. > >> > >> Without digging into it, this looks like a possible cause: > >> > >> https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=ce881170088c4c98c036fe561f8ee8413c2e2585 > >> > >> atkbd: Disable periodic polling by default. > >> It is one of the few remaining Giant-locked callouts. It would be > >> good to remove it, not mentioning that polling itself is not good. > >> > >> If this cause keyboard/mouse freezes on some hardware, please set > >> loader tunable hw.atkbd.hz=1 as workaround and report the issue. > >> > >> So you could try to set hw.atkbd.hz=1 (or hw.atkbd.hz=10) in > >> /boot/loader.conf, then reboot and see if it helps. > >> > >> Best > >> Michael > >> > >> -- > >> Michael Gmelin > >> > > > > -- > > Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 > > Public GnuPG key: http://www.unixarea.de/key.pub > > -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Sep 4 17:40:08 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfbWJ4T0pz4sd88 for ; Mon, 4 Sep 2023 17:40:12 +0000 (UTC) (envelope-from grembo@freebsd.org) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfbWH6mRdz3Cc5; Mon, 4 Sep 2023 17:40:11 +0000 (UTC) (envelope-from grembo@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 735e3b3e; Mon, 4 Sep 2023 17:40:09 +0000 (UTC) Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 89c066c4 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Mon, 4 Sep 2023 17:40:09 +0000 (UTC) Content-Type: multipart/alternative; boundary=Apple-Mail-78B0591B-95C1-48CD-983C-74937C493FF0 Content-Transfer-Encoding: 7bit List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: 14.0-CURRENT boots fine but keyboard does not work From: Michael Gmelin In-Reply-To: Date: Mon, 4 Sep 2023 19:40:08 +0200 Cc: Alexander Motin , freebsd-current@freebsd.org Message-Id: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> References: To: Matthias Apitz X-Mailer: iPhone Mail (20G75) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE] X-Rspamd-Queue-Id: 4RfbWH6mRdz3Cc5 --Apple-Mail-78B0591B-95C1-48CD-983C-74937C493FF0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable > On 4. Sep 2023, at 19:34, Matthias Apitz wrote: >=20 > =EF=BB=BFEl d=C3=ADa lunes, septiembre 04, 2023 a las 07:29:41p. m. +0200,= Michael Gmelin escribi=C3=B3: >=20 >>=20 >>=20 >>>> On 4. Sep 2023, at 19:23, Matthias Apitz wrote: >>>=20 >>> =EF=BB=BF >>> Added Alexander Motin to To: as the origin of the CI; >>>=20 >>> Neither hw.atkbd.hz=3D1 nor hw.atkbd.hz=3D10 makes the keyboard working o= n >>> my beloved Acer C720. Should I file a new PR? >>>=20 >>=20 >> Filing a PR makes sense, could you please Cc me on it? >>=20 >> Do you know which version of FreeBSD was the last that worked for you? >=20 > I'm actually using (and typing this on it) r368166. Will file a PR > tomorrow. Thanks >=20 This could also be related: https://cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2fee= 587aaf You could try to undo that patch and build a new kernel. Best Michael > matthias >=20 >>>> El d=C3=ADa lunes, septiembre 04, 2023 a las 06:55:52p. m. +0200, Micha= el Gmelin escribi=C3=B3: >>>>=20 >>>>=20 >>>>=20 >>>> On Mon, 4 Sep 2023 18:43:11 +0200 >>>> Matthias Apitz wrote: >>>>=20 >>>>> I have a 14.0-CURRENT compiled from sources of head from August 4, >>>>> which boots fine from a produced USB key, but the keyboard does not >>>>> work on an Acer C720 (amd64), on other laptops the keyboard is fine. >>>>>=20 >>>>> The keyboard works during the boot menu (for example to enable verbose= >>>>> boot messages) but not on the login: prompt of the booted system. >>>>>=20 >>>>> I've enabled SSH access into the C720 (if someone need more >>>>> information) and I'm attaching /var/log/messages of the booted system.= >>>>=20 >>>> Hi Matthias, >>>>=20 >>>> The C720 required special patches for the keyboard to work, which I >>>> originally added here: >>>> https://cgit.freebsd.org/src/commit/?id=3D6c176113bbdd598231ec47d161d4c= 3714997169b >>>>=20 >>>> I assume that something in that area changed recently. >>>>=20 >>>> Without digging into it, this looks like a possible cause: >>>>=20 >>>> https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=3Dce88117= 0088c4c98c036fe561f8ee8413c2e2585 >>>>=20 >>>> atkbd: Disable periodic polling by default. >>>> It is one of the few remaining Giant-locked callouts. It would be >>>> good to remove it, not mentioning that polling itself is not good. >>>>=20 >>>> If this cause keyboard/mouse freezes on some hardware, please set >>>> loader tunable hw.atkbd.hz=3D1 as workaround and report the issue. >>>>=20 >>>> So you could try to set hw.atkbd.hz=3D1 (or hw.atkbd.hz=3D10) in >>>> /boot/loader.conf, then reboot and see if it helps. >>>>=20 >>>> Best >>>> Michael >>>>=20 >>>> --=20 >>>> Michael Gmelin >>>>=20 >>>=20 >>> --=20 >>> Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +49-= 176-38902045 >>> Public GnuPG key: http://www.unixarea.de/key.pub >>=20 >>=20 >=20 > --=20 > Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +49-17= 6-38902045 > Public GnuPG key: http://www.unixarea.de/key.pub --Apple-Mail-78B0591B-95C1-48CD-983C-74937C493FF0 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable

On 4. Sep 2023, at 19:= 34, Matthias Apitz <guru@unixarea.de> wrote:

=EF=BB=BFEl d=C3=ADa lunes= , septiembre 04, 2023 a las 07:29:41p. m. +0200, Michael Gmelin escribi=C3=B3= :



On 4. Sep 2023, at 19:23, Mat= thias Apitz <guru@unixarea.de> wrote:

<= span>=EF=BB=BF
Added Alexander Motin <mav@FreeBSD.org&g= t; to To: as the origin of the CI;

Neit= her hw.atkbd.hz=3D1 nor hw.atkbd.hz=3D10 makes the keyboard working on
my beloved Acer C720. Should I file a new PR?


Filing a PR makes sense, c= ould you please Cc me on it?

Do you know w= hich version of FreeBSD was the last that worked for you?

I'm actually using (and typing this on it) r3681= 66. Will file a PR
tomorrow. Thanks
<= br>

This could also be related:
<= div>

Yo= u could try to undo that patch and build a new kernel.

<= div>Best
Michael



   matthias

El d=C3=ADa lunes, septiembre 04, 2023 a las 06:55:52p.= m. +0200, Michael Gmelin escribi=C3=B3:



On Mon, 4 Sep 2023 18:43:11 +020= 0
Matthias Apitz &l= t;guru@unixarea.de> wrote:

I have a 14.0-CURRENT compiled from sources of head from A= ugust 4,
which boots fine from a produced USB key, but t= he keyboard does not
work on an Acer C720 (amd64), on othe= r laptops the keyboard is fine.

=
The= keyboard works during the boot menu (for example to enable verbose
boot messages) but not on the login: prompt of the booted system= .

I've enabled SSH access into the C= 720 (if someone need more
<= /blockquote>
information) and I'm attaching /= var/log/messages of the booted system.
<= /blockquote>

Hi Matthias,
<= blockquote type=3D"cite">

The C720 re= quired special patches for the keyboard to work, which I
originally added here:
https://cgit.freebsd.org/src/commi= t/?id=3D6c176113bbdd598231ec47d161d4c3714997169b

I assume that something in that area changed recently.

Without digging into it, this looks like a pos= sible cause:

https://cgit.freebsd.or= g/src/commit/sys/dev/atkbdc/atkbd.c?id=3Dce881170088c4c98c036fe561f8ee8413c2= e2585

atkbd: Disable periodic pollin= g by default.
It i= s one of the few remaining Giant-locked callouts.  It would be
good to remove it, not men= tioning that polling itself is not good.

If this cause keyboard/mouse freezes on some hardware, please set
loader tunable hw.atkbd= .hz=3D1 as workaround and report the issue.

<= blockquote type=3D"cite">
So you could try to set hw.atkbd.hz=3D1 (or hw.atkbd.hz=3D10) in
/boot/loader.conf, then= reboot and see if it helps.

Best
Michael

--
Michael Gmelin
=

<= blockquote type=3D"cite">
--
Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +49-1= 76-38902045
Public GnuPG key: http://www.unixarea.de/key.p= ub


<= span>
--
Matthias Apitz, =E2=9C=89 guru@uni= xarea.de, http://www.unixarea.de/ +49-176-38902045
Public Gn= uPG key: http://www.unixarea.de/key.pub
= = --Apple-Mail-78B0591B-95C1-48CD-983C-74937C493FF0-- From nobody Mon Sep 4 18:10:56 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfcC240Qrz4ssFd for ; Mon, 4 Sep 2023 18:11:10 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x531.google.com (mail-ed1-x531.google.com [IPv6:2a00:1450:4864:20::531]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfcC225q9z3Myh for ; Mon, 4 Sep 2023 18:11:10 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x531.google.com with SMTP id 4fb4d7f45d1cf-52a49a42353so2472703a12.2 for ; Mon, 04 Sep 2023 11:11:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1693851068; x=1694455868; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=CgDVW8W41U5236zdZ/MziXCdAS07SHBfYyncMCmOOeI=; b=sLsmG2nwauCpLJ2hgIVHRQth1J3M6C/s7jun1DBwjWStNw/l40S2UDmjJjMMPw7D3N MM1bBcQuDFXpZLHf67y5vEAnTNR/bP48aRobMT2dZc3IBhyCUz4znqZQOWmzoRhOFGoO hrBtozKYXWvJDFC0xhjewkRWa+pQj1aqoiRKDTsZCFR835FE79u0fAbO1buwJal2IMpe CG5LQzcmVTpBqs3v2lTJJTdzAVrC0ZvvBbjd3FvX/odO/gHPM7hFpD0X9GRh8j0RY+4b I2VPL6rlKsKzJaK+jnnHhIsnR3uf0M/Ewgo93DCDkDF0Y6fm9/vaSnNxlGzIEkUX5Bh8 SaQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693851068; x=1694455868; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=CgDVW8W41U5236zdZ/MziXCdAS07SHBfYyncMCmOOeI=; b=SvdC/qaXqydd8lxVoZ6OicPqw9GHaF7YZi63A3znCCO5EF+kjQkhPCq/2lCz6CevgL cYdfvrjnhpA7X8iF4+NjGv+8iC+GHiWXcodd5ko8kbMrNsCiRXpNd+QGfsAnpvggQn/o rRvQnRzWU57DzTWF9e4rCo5J2A8YujwiOR2ln55JOzvdVl3UoDFnRMArcEa7EK2vGcxl Y5IJVESZ/6m+hg++FurcVHgs9AsU8MBLgMHg0hAFt7hXHXjSGTTOpYyf67GXKtChNtQQ vBz7dRZGtp3PuvZwDnUAdTgRPSOWzRTLgKD3RJN97nUyQZw/rdNajQdWMBq+qB03RbP8 0a4A== X-Gm-Message-State: AOJu0Yz7oXJc9ygJ9qiglMs3Ng8avk95ajjGfsZCcLT865+65Iz89aW5 DHRC/dkvcyRyPsBrT9VruQP6sC7wKzdj6Oe4jwK5rg== X-Google-Smtp-Source: AGHT+IF/kv2j9zga42tWCfiZQbTO0A9mE0Pa63h66IOHUFMQAI4EdvwMFCoFnaGNVoXjc4Wvg/R8m1PTb0qbaAdzt6g= X-Received: by 2002:a05:6402:3202:b0:52e:585a:e95 with SMTP id g2-20020a056402320200b0052e585a0e95mr654309eda.2.1693851067855; Mon, 04 Sep 2023 11:11:07 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> In-Reply-To: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> From: Warner Losh Date: Mon, 4 Sep 2023 12:10:56 -0600 Message-ID: Subject: Re: 14.0-CURRENT boots fine but keyboard does not work To: Michael Gmelin Cc: Matthias Apitz , Alexander Motin , FreeBSD Current Content-Type: multipart/alternative; boundary="00000000000033cdb406048c6feb" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RfcC225q9z3Myh --00000000000033cdb406048c6feb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Sep 4, 2023, 11:40 AM Michael Gmelin wrote: > > > On 4. Sep 2023, at 19:34, Matthias Apitz wrote: > > =EF=BB=BFEl d=C3=ADa lunes, septiembre 04, 2023 a las 07:29:41p. m. +0200= , Michael > Gmelin escribi=C3=B3: > > > > On 4. Sep 2023, at 19:23, Matthias Apitz wrote: > > > =EF=BB=BF > > Added Alexander Motin to To: as the origin of the CI; > > > Neither hw.atkbd.hz=3D1 nor hw.atkbd.hz=3D10 makes the keyboard working o= n > > my beloved Acer C720. Should I file a new PR? > > > > Filing a PR makes sense, could you please Cc me on it? > > > Do you know which version of FreeBSD was the last that worked for you? > > > I'm actually using (and typing this on it) r368166. Will file a PR > tomorrow. Thanks > > > This could also be related: > > > https://cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2= fee587aaf > > You could try to undo that patch and build a new kernel. > It shouldn't make a difference... but I may have been given bad advice if it did... if it's this one, I'll help sort it out. Warner Best > Michael > > > > matthias > > El d=C3=ADa lunes, septiembre 04, 2023 a las 06:55:52p. m. +0200, Michael > Gmelin escribi=C3=B3: > > > > > On Mon, 4 Sep 2023 18:43:11 +0200 > > Matthias Apitz wrote: > > > I have a 14.0-CURRENT compiled from sources of head from August 4, > > which boots fine from a produced USB key, but the keyboard does not > > work on an Acer C720 (amd64), on other laptops the keyboard is fine. > > > The keyboard works during the boot menu (for example to enable verbose > > boot messages) but not on the login: prompt of the booted system. > > > I've enabled SSH access into the C720 (if someone need more > > information) and I'm attaching /var/log/messages of the booted system. > > > Hi Matthias, > > > The C720 required special patches for the keyboard to work, which I > > originally added here: > > > https://cgit.freebsd.org/src/commit/?id=3D6c176113bbdd598231ec47d161d4c37= 14997169b > > > I assume that something in that area changed recently. > > > Without digging into it, this looks like a possible cause: > > > > https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atkbd.c?id=3Dce8811700= 88c4c98c036fe561f8ee8413c2e2585 > > > atkbd: Disable periodic polling by default. > > It is one of the few remaining Giant-locked callouts. It would be > > good to remove it, not mentioning that polling itself is not good. > > > If this cause keyboard/mouse freezes on some hardware, please set > > loader tunable hw.atkbd.hz=3D1 as workaround and report the issue. > > > So you could try to set hw.atkbd.hz=3D1 (or hw.atkbd.hz=3D10) in > > /boot/loader.conf, then reboot and see if it helps. > > > Best > > Michael > > > -- > > Michael Gmelin > > > > -- > > Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ > +49-176-38902045 > > Public GnuPG key: http://www.unixarea.de/key.pub > > > > > -- > Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ > +49-176-38902045 > Public GnuPG key: http://www.unixarea.de/key.pub > > --00000000000033cdb406048c6feb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Sep 4, 2023, 11:40 AM Michael Gmelin <grembo@freebsd.org> wrote:


On = 4. Sep 2023, at 19:34, Matthias Apitz <guru@unixarea.de> wrote:
=
=EF=BB=BF= El d=C3=ADa lunes, septiembre 04, 2023 a las 07:29:41p. m. +0200, Mic= hael Gmelin escribi=C3=B3:


<= br>
O= n 4. Sep 2023, at 19:23, Matthias Apitz <guru@unixarea.de> wrote:

=EF=BB=BF
Added Al= exander Motin <mav@FreeBSD.org> to To: as the origin of the CI;

Neither hw.atkbd.hz=3D1 nor hw.atkbd.hz= =3D10 makes the keyboard working on
my beloved Acer C720= . Should I file a new PR?


Filing a PR makes sense, could you please Cc me on it?<= /span>

Do you know which version of FreeBSD wa= s the last that worked for you?

I'm actually using (and typing this on it) r368166. Will file a PR
tomorrow. Thanks


This could also be related:

https://cgit.free= bsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2fee587aaf
=

You could try to undo that patch and build a new kernel= .

It shouldn't make a difference... but I may have been given b= ad advice if it did... if it's this one, I'll help sort it out.

Warner

Best
Michael

<= /div>


= =C2=A0 =C2=A0matthias

=
El d=C3=ADa lunes= , septiembre 04, 2023 a las 06:55:52p. m. +0200, Michael Gmelin escribi=C3= =B3:

<= /blockquote>

<= blockquote type=3D"cite">
On Mon, 4 Sep 2023 18:43:11 +0200
Matthias Apitz <guru@unixarea.de> = wrote:
= I have a 14.0-CURRENT compiled from sources of head from August 4,
which boots fine from a produced USB key, but the keyboard = does not
<= blockquote type=3D"cite">work on an Acer C720 (amd64), on other lapto= ps the keyboard is fine.
<= /blockquote>

The k= eyboard works during the boot menu (for example to enable verbose
boot messages) but not on the login: prompt of the booted syst= em.

I've enabled SSH acces= s into the C720 (if someone need more
<= /blockquote>
information) an= d I'm attaching /var/log/messages of the booted system.

Hi Matthias,

=
The C720 required special patches for the keyboard to= work, which I
or= iginally added here:
https://cgit.f= reebsd.org/src/commit/?id=3D6c176113bbdd598231ec47d161d4c3714997169b

I assume that something in that a= rea changed recently.
<= span>
Without dig= ging into it, this looks like a possible cause:
<= blockquote type=3D"cite">
https://cgit.freebsd.org/src/commit/sys/dev/atkbdc/atk= bd.c?id=3Dce881170088c4c98c036fe561f8ee8413c2e2585

=
atkbd: Disable periodic polling by default.
It is one of the few rem= aining Giant-locked callouts.=C2=A0 It would be
<= blockquote type=3D"cite"> good to remove it, not mentioning that poll= ing itself is not good.

If thi= s cause keyboard/mouse freezes on some hardware, please set
loader tunable hw.atkbd.hz=3D1 = as workaround and report the issue.

So you could try to set hw.atkbd.hz=3D1 (or hw.atkbd.hz=3D10) in<= br>
/boot/loader.conf, then = reboot and see if it helps.

Best<= /span>
=
Michael

--
Michael Gmelin


=
-- <= /span>
Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.u= nixarea.de/ +49-176-38902045
Public GnuPG key: = http://www.unixarea.de/key.pub



--
Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +4= 9-176-38902045
Public GnuPG key: http://www.unixarea.d= e/key.pub
<= /div> --00000000000033cdb406048c6feb-- From nobody Mon Sep 4 18:29:44 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfccf0kjMz4rHyR for ; Mon, 4 Sep 2023 18:29:54 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Received: from heemeyer.club (heemeyer.club [195.93.173.158]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfccd0dPjz3SGN for ; Mon, 4 Sep 2023 18:29:52 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of dchagin@heemeyer.club has no SPF policy when checking 195.93.173.158) smtp.mailfrom=dchagin@heemeyer.club; dmarc=none Received: from heemeyer.club (localhost [127.0.0.1]) by heemeyer.club (8.17.2/8.16.1) with ESMTP id 384ITioh035134 for ; Mon, 4 Sep 2023 21:29:44 +0300 (MSK) (envelope-from dchagin@heemeyer.club) Received: (from dchagin@localhost) by heemeyer.club (8.17.2/8.16.1/Submit) id 384ITisf035133 for current@freebsd.org; Mon, 4 Sep 2023 21:29:44 +0300 (MSK) (envelope-from dchagin) Date: Mon, 4 Sep 2023 21:29:44 +0300 From: Dmitry Chagin To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> X-Spamd-Bar: / X-Spamd-Result: default: False [-0.77 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.970]; FORGED_SENDER(0.30)[dchagin@freebsd.org,dchagin@heemeyer.club]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DMARC_NA(0.00)[freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[dchagin]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[dchagin@freebsd.org,dchagin@heemeyer.club]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; ASN(0.00)[asn:61400, ipnet:195.93.173.0/24, country:RU] X-Rspamd-Queue-Id: 4Rfccd0dPjz3SGN On Mon, Sep 04, 2023 at 04:03:54PM +0200, Felix Palmen wrote: > * Felix Palmen [20230904 15:39]: > > For some reason (I still have to try to get more information about it, > > will do soon), something else is broken now. While install from GNU > > coreutils works fine, some build systems use 'cp -p' to install files > > instead, which now fails with: > > > > | cp: preserving permissions for [...]: Operation not permitted > > The issue seems to be with listing attributes: > > | root@15-default:/wrkdirs/usr/ports/x11/linuxsrc-libxcb/work/libxcb-1.15/doc # truss /compat/linux/bin/cp -pR ./tutorial '/wrkdirs/usr/ports/x11/linuxsrc-libxcb/work/stage/compat/linux/usr/share/doc/libxcb/' 2>&1 | grep xattr > | linux_flistxattr(0x4,0x0,0x0) ERR#-1 'Operation not permitted' > | linux_flistxattr(0x4,0x0,0x0) ERR#-1 'Operation not permitted' > | linux_llistxattr(0xffffffffcdd9,0x0,0x0) ERR#-1 'Operation not permitted' > > The following q&d patch makes it work again: > > #v+ > diff --git a/sys/compat/linux/linux_xattr.c b/sys/compat/linux/linux_xattr.c > index 74b47f1cbaec..0b5af084b1b1 100644 > --- a/sys/compat/linux/linux_xattr.c > +++ b/sys/compat/linux/linux_xattr.c > @@ -198,7 +198,7 @@ listxattr(struct thread *td, struct listxattr_args *args) > if (error == 0) > td->td_retval[0] = cnt; > free(data, M_LINUX); > - return (error_to_xattrerror(attrnamespace, error)); > + return (error_to_xattrerror(EXTATTR_NAMESPACE_SYSTEM, error)); > } > > int > #v- > > I think this makes sense, because listxattr iterates over all > namespaces, so there's no sane way to know whether the EPERM was caused > by trying to access "system" or something else. Thanks for the report, please, try this: https://people.freebsd.org/~dchagin/lxattr.patch Don't be surprised, there 2 fixes > > Cheers, Felix > > -- > Felix Palmen {private} felix@palmen-it.de > -- ports committer -- {web} http://palmen-it.de > {pgp public key} http://palmen-it.de/pub.txt > {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 From nobody Mon Sep 4 18:43:02 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfcvv2G1wz4rQ2R for ; Mon, 4 Sep 2023 18:43:07 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfcvt0mbFz3Wcr for ; Mon, 4 Sep 2023 18:43:06 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=Sl8RHwFV; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:To:From:Date:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=EqjFzDK+lhEyvvcq4g5C8gR4e/M/Qe4tT43MNytMxoA=; b=Sl8RHwFVs6GS3KzF0cz2Xpe+hK gY3DcMVsNaoxFHbsIxce72xyHwbbPSVv7X14StweNY2iutQVDi2XHyDKtNzOhiP8PCKFkyOMhWvRG d7Vrz4FQqLuE4jJ5vcMyh5lgOElf5u2gEb0c4ixrN/cVl77/j3GMuUvWjphzOYCSMaybQgI1ajrHN K+1Xq2NbXstHSXHf2AKO6rLP1juXWu1kcZkbR6zgFksp/bfBPeAnn7NhHO0LSmt5VGiZjk72GEd1x gao6mg8FnGPTUhnnlmR3Mj2aHAaRlCZAhzzMNQadSiv93cyULR8Vc7LEpS0T6Q0+NT+XHAZ8m44Qb h0TFCwMw==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qdEXO-00BaPH-UN for current@freebsd.org; Mon, 04 Sep 2023 20:43:02 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qdEXO-000279-27 for current@freebsd.org; Mon, 04 Sep 2023 18:43:02 +0000 Date: Mon, 4 Sep 2023 20:43:02 +0200 From: Felix Palmen To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: Mail-Followup-To: current@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="6p45ktkcfvvftdmt" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.50 / 15.00]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[freebsd.org]; MLMMJ_DEST(0.00)[current@freebsd.org]; FROM_HAS_DN(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[palmen-it.de:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4Rfcvt0mbFz3Wcr --6p45ktkcfvvftdmt Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello Dmitry, * Dmitry Chagin [20230904 21:29]: > Thanks for the report, > please, try this: https://people.freebsd.org/~dchagin/lxattr.patch > Don't be surprised, there 2 fixes Thanks a lot for the quick patch! I have to admit I don't fully understand it immediately, but I assume it's an attempt to only list attributes not in system.* when that namespace is restricted? Well, it *does* solve the issue with 'cp -p' from GNU coreutils! I guess I'll now do a full rebuild of my linuxulator userspace branch on a kernel with that patch, just to be sure it won't break anything else, this will take a few hours, I will report back. So far looking really good :) Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --6p45ktkcfvvftdmt Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPYlIl8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MQAjAQCTDCc/Hc7NMXRVfSHTDt9ZR5PRFZNZQ+GYyONtW74D9gD/amYzRVF9NxFE DpqLk2+siUEH/7VDUr/0nyHOoRbmQAo= =d0H2 -----END PGP SIGNATURE----- --6p45ktkcfvvftdmt-- From nobody Mon Sep 4 18:49:59 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfd3t1llwz4rTGk for ; Mon, 4 Sep 2023 18:50:02 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Received: from heemeyer.club (heemeyer.club [195.93.173.158]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfd3s0HNQz3YjP for ; Mon, 4 Sep 2023 18:50:00 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of dchagin@heemeyer.club has no SPF policy when checking 195.93.173.158) smtp.mailfrom=dchagin@heemeyer.club; dmarc=none Received: from heemeyer.club (localhost [127.0.0.1]) by heemeyer.club (8.17.2/8.16.1) with ESMTP id 384InxXD035199 for ; Mon, 4 Sep 2023 21:49:59 +0300 (MSK) (envelope-from dchagin@heemeyer.club) Received: (from dchagin@localhost) by heemeyer.club (8.17.2/8.16.1/Submit) id 384InxqO035198 for current@freebsd.org; Mon, 4 Sep 2023 21:49:59 +0300 (MSK) (envelope-from dchagin) Date: Mon, 4 Sep 2023 21:49:59 +0300 From: Dmitry Chagin To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: / X-Spamd-Result: default: False [-0.77 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.968]; FORGED_SENDER(0.30)[dchagin@freebsd.org,dchagin@heemeyer.club]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DMARC_NA(0.00)[freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[dchagin]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[dchagin@freebsd.org,dchagin@heemeyer.club]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; ASN(0.00)[asn:61400, ipnet:195.93.173.0/24, country:RU] X-Rspamd-Queue-Id: 4Rfd3s0HNQz3YjP On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > Hello Dmitry, > > * Dmitry Chagin [20230904 21:29]: > > Thanks for the report, > > please, try this: https://people.freebsd.org/~dchagin/lxattr.patch > > Don't be surprised, there 2 fixes > > Thanks a lot for the quick patch! I have to admit I don't fully > understand it immediately, but I assume it's an attempt to only list > attributes not in system.* when that namespace is restricted? no, + if (error == EPERM) + break; mean that listxattr will fail if user is unauthorized to access system namespace, ie, listxattr will return ENOTSUP > > Well, it *does* solve the issue with 'cp -p' from GNU coreutils! > > I guess I'll now do a full rebuild of my linuxulator userspace branch on > a kernel with that patch, just to be sure it won't break anything else, > this will take a few hours, I will report back. So far looking really > good :) > nice, thanks > Cheers, Felix > > -- > Felix Palmen {private} felix@palmen-it.de > -- ports committer -- {web} http://palmen-it.de > {pgp public key} http://palmen-it.de/pub.txt > {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 From nobody Mon Sep 4 19:05:15 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfdPY24lKz4rsCH; Mon, 4 Sep 2023 19:05:21 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfdPX5Nckz3dcN; Mon, 4 Sep 2023 19:05:20 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=CFsle678; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:To:From:Date:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=dwt8wwUa1tiaL2ZQUEdY0ca9gCXjk8a1LmBN9P4kCrk=; b=CFsle678HC5GISYzHMKNpX3kT2 tyyrmcY9joT7vV8EPGGv6ox7HziDY2TA3oU4RcEaaXRtmCZyX9wS1kfKkREsAbcX05VEsWtEouVEo 3Gd/t9pif0chyfMS+T4s0cqV3nD38LknhI9KUtf8IS/bvnEG6M5AN9d6mZARk7XIK/EmwFCOzuBeX vy7i0gIsAjq7TnTkoCQiQutPdN1pm1iiQi5jD7VSOFbU1oTTEffSxlVtM5HNZ0o/zy313ItUhEoD5 7TLwTr25u9JiKVolJDcA/QdX0xTfrInlEDh/IUzla4yHOct2qHSvWT8ygI0j50dwnw/7lgp2J6xFs QBYx9qNQ==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qdEsu-00BaRF-BV; Mon, 04 Sep 2023 21:05:16 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qdEsu-0002EK-0V; Mon, 04 Sep 2023 19:05:16 +0000 Date: Mon, 4 Sep 2023 21:05:15 +0200 From: Felix Palmen To: freebsd-current@freebsd.org, current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org, current@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="7sg762hlmw5sgmou" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.49 / 15.00]; SIGNED_PGP(-2.00)[]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1:c]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; FROM_HAS_DN(0.00)[]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_COUNT_TWO(0.00)[2]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[palmen-it.de:+]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4RfdPX5Nckz3dcN --7sg762hlmw5sgmou Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Dmitry Chagin [20230904 21:49]: > On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > > Thanks a lot for the quick patch! I have to admit I don't fully > > understand it immediately, but I assume it's an attempt to only list > > attributes not in system.* when that namespace is restricted? >=20 > no, > + if (error =3D=3D EPERM) > + break; > mean that listxattr will fail if user is unauthorized to access system > namespace, ie, listxattr will return ENOTSUP Ah, now I get it, so breaking out of the loop there will leave attrnamespace at EXTATTR_NAMESPACE_SYSTEM if that was the cause, therefore error_to_xattrerror() works as expected. Nice! Well, given that I really don't expect any further problems, but give my poor builder a few hours to *really* verify :) Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --7sg762hlmw5sgmou Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPYqa18UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MTbKAQDKJp2XWwFxntwsV2HDTErZnwx03qu78jWsCG+LH/48AgEA6LD5eH9MD8dC 06n5WR6l1ox556TtpsSbSuUt7p8qEw8= =jei9 -----END PGP SIGNATURE----- --7sg762hlmw5sgmou-- From nobody Mon Sep 4 19:05:15 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfdPY24lKz4rsCH; Mon, 4 Sep 2023 19:05:21 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfdPX5Nckz3dcN; Mon, 4 Sep 2023 19:05:20 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=CFsle678; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:To:From:Date:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=dwt8wwUa1tiaL2ZQUEdY0ca9gCXjk8a1LmBN9P4kCrk=; b=CFsle678HC5GISYzHMKNpX3kT2 tyyrmcY9joT7vV8EPGGv6ox7HziDY2TA3oU4RcEaaXRtmCZyX9wS1kfKkREsAbcX05VEsWtEouVEo 3Gd/t9pif0chyfMS+T4s0cqV3nD38LknhI9KUtf8IS/bvnEG6M5AN9d6mZARk7XIK/EmwFCOzuBeX vy7i0gIsAjq7TnTkoCQiQutPdN1pm1iiQi5jD7VSOFbU1oTTEffSxlVtM5HNZ0o/zy313ItUhEoD5 7TLwTr25u9JiKVolJDcA/QdX0xTfrInlEDh/IUzla4yHOct2qHSvWT8ygI0j50dwnw/7lgp2J6xFs QBYx9qNQ==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qdEsu-00BaRF-BV; Mon, 04 Sep 2023 21:05:16 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qdEsu-0002EK-0V; Mon, 04 Sep 2023 19:05:16 +0000 Date: Mon, 4 Sep 2023 21:05:15 +0200 From: Felix Palmen To: freebsd-current@freebsd.org, current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org, current@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="7sg762hlmw5sgmou" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.49 / 15.00]; SIGNED_PGP(-2.00)[]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1:c]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; FROM_HAS_DN(0.00)[]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; RCVD_COUNT_TWO(0.00)[2]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[palmen-it.de:+]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4RfdPX5Nckz3dcN --7sg762hlmw5sgmou Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Dmitry Chagin [20230904 21:49]: > On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > > Thanks a lot for the quick patch! I have to admit I don't fully > > understand it immediately, but I assume it's an attempt to only list > > attributes not in system.* when that namespace is restricted? >=20 > no, > + if (error =3D=3D EPERM) > + break; > mean that listxattr will fail if user is unauthorized to access system > namespace, ie, listxattr will return ENOTSUP Ah, now I get it, so breaking out of the loop there will leave attrnamespace at EXTATTR_NAMESPACE_SYSTEM if that was the cause, therefore error_to_xattrerror() works as expected. Nice! Well, given that I really don't expect any further problems, but give my poor builder a few hours to *really* verify :) Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --7sg762hlmw5sgmou Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPYqa18UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MTbKAQDKJp2XWwFxntwsV2HDTErZnwx03qu78jWsCG+LH/48AgEA6LD5eH9MD8dC 06n5WR6l1ox556TtpsSbSuUt7p8qEw8= =jei9 -----END PGP SIGNATURE----- --7sg762hlmw5sgmou-- From nobody Tue Sep 5 00:16:56 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfmKP1Xcwz4sJ5L for ; Tue, 5 Sep 2023 00:17:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-21.consmr.mail.gq1.yahoo.com (sonic306-21.consmr.mail.gq1.yahoo.com [98.137.68.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfmKN0hQnz4RpW for ; Tue, 5 Sep 2023 00:17:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=lOuTJXRD; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693873030; bh=TkifR2Kfcj7/lsIOfFKJZ8QWUhIFupzPfk8sNHNrgyE=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=lOuTJXRDZfd4rsIPGtrIv/HFlqcLz+rJn3vwY8zs7vQ54AqOK9vOAknK5rrl+GmihC7gBcGAPCdwE2QTe0IcM/E65n1rN0SkJNIjMQ0jHGQowHAa5px72pxHc2D0GaoaAYdHvIZy/8m3gi3PyvNCJQwJ/LwQz9T1VrEgl9cHgC7LhSussjyXlIQkwXvfQv5jOE7iD0Igadwp424lCJROLLIGzM15sZHhk1bLdnJiH1iG9LohNyQdr9puzz/5NzEUdg1taf0fySWcC6AMXm+VVq7zFBuxVe457iwVFi8GuYkmYff1Me2IyV82x9fTkk5pBjxpnUYe44JUuH8Xeh8cJQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693873030; bh=XgKTTq422XAsXNgaqC/dr7LRWs/X0aeMyNg+CZyeOKI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=BJ7Hk3NTbRWEA/A6MvCgN7dSUhAhzQD0P2b40v0Tt2q8uqk1ZLbnn9914euO994A/C+0rS3vDGG3ilKLA+LzgtDYKfLqbltS//RryaEpDv8fU1JO4HB3rfgqOVR+nS+0QjpmxmJaaqMyefQnvuWzN9BTIS1QnKeFEdkm5TwQ4vtnqTzzp3hm3bbctKkzDB0e4Tz7IlIziLfhRQ+eqIZGX/4bMmg1euu1eZSD4cVsHt7oLoIas8K9zwGjYSvCDeBcCcHaEU/4vfwNw4N/LwqrhjYRcjatriAltPaBHOpmKv11Jj3w7TZO0qYkFVYvpzOot+JEKuvwlZEmlJe6M9x56g== X-YMail-OSG: 6amqwAYVM1l0p3SMKzGbD_Crql69oy3LRt18qIVctoMJpg6KT0IYtwuWg2affeo NlGtdX_ddNyx2iK3i4nzPV3xFXbM2tjkvUd2qCpxXrXNDp2v4wsOZUsMcVQt4VepEeINWO9Kdop0 s7CwcS6BR8.4hr06nS3WzpqRdas7L00nveLsGFITdwackugXVbflk2yl_qJLdsKwryEuCeV3vvPD 80Sxp.7vJu.XNCHMJt7lK6uhIvH_ZqeywDvIzeYol0V0CzJ4eBncL3J7Z_rqG2MxJ7AZfMbcGPl5 KIUqtY7WkOmqnrJKpODmavFskDWMkrxc.ZKUlLPiUMncWVBjUt.gSZUEDqtlr3GjhLOihLfUT3IH TfZFeD2dfP9TQDcNpg9KxdJjpDuYV74PLfI3Ttdaoli89.YYhfJ5eCkVI5fkaKYiyXBsvV4AWktU gFbt89IplweVW6vMyRx9pR2HbJrRTEC6IJvAsF4Xdt7nuz1BW.VvtlsmY7GOzXV8S1aMv9z44Pkr jkPbbnBXu0Zz9Z3IBTEW5vDuexZf1E0DNTn411HgQx7gTNyig00j6W8igEAN5uLxz4FM2CsRyb97 xh_0L79Qqq.ae1Mi7J0WNYgAH5UYiLb28UVwRsfSY5VUcPM_sznJ8kf5nhkZ6DOQStuSVqV2RRNw Oc_Usg4oVUQFsWaurM9.Ud_DZmvlWW7Mg6Qk.s8bPpXn8OXCjcLZ5EyVLHJmtbcIWzSkNT4gOf__ Z5imINUtVyEw79oXOGuc_4DsTwIdKHhSZuwi1ZOFyP2k3QF9LAhOOukHGRemPUUhoFesmKNWG7hi zKNXNzJJWiNokELiz7RKPGqDdhYGCTM5geOfYb1PlY.3wIoR8zEjbssFWIZAvOCCRT48sStvMvxQ Lf0O4pV7Jq0o67s8lw2tifwlIypYVTMRmURPAaJ3ZxA16IyaVzN06JJhEWqsQ1if5l0srOko6GR1 vVUe7TUnAROVHrZsMQ4znSG9SyVag1364Gb9YVQWmCxT4O8EPdEfpQv44Qx_Hwz1.wHWccqlnbA_ Xhef7D3LAC.Ulb.RUPeLNHRHn.wb2Z1oL_VQ8p876xIrWJIAtL7sIB8stn7iMRFNaceZuVqCllY9 MG9iQJBJP1zscyxn_L32rNtbQH9eRXV5rpPszjb1zOj96jma29owYQMEGgQzE3ZPpBCbozQOwNVy 0aHmRdzzCPlUYwozRYU_BzFyND6X9siYmwsYs.2RmeoWKeErmgcqbMHSPOqJnyIv5GOya4B59a0T Z_ymv2uC9_0P9jgS.d21PJSwAQtN_gsy8uVBIKrNXDpMjaesWD8lba196411xVDfz9yhQLEPTE8v XkRLbU9HyrSLDB2RIcj4eMIpQkcJDZ0qH66d6yoqQ8wZA7Xqicn2eE2Tv.YV2hBMx.qlXgRVxiSc mZn3fpFZLkGvyQ09VaVAJt6WrUKqfZtKyCzHBew.XsavtJ3VgBppPm8_ULJGh9v96R_JoaLRmtzo wzdRH5FsZ8u27cWd.krUuKktm.5.QDbiSWZypa9LPWiGgXR9Pk7xFSqwwPJ5GXASsUJfM0Z_yOPT QEbJW1FZg.jd_f9lNhCZr0SxSCt3frVaXKZQpJaSVdr84oIO.aAgRuzRdVfnXRPXMukhoTq8SlMO KIHlsrovo7X6RIpzN_SmNyI428vfAZwvtxHD0kVAMtDbSOAMQcafArWzXeMBY5T.vsGnCIOwF.Hr XNC94XJkogQ5xvJHn4hkLvV0X9ys1jCfmHSH6RujuKWuWq4e2med0GckdUm16OPFOM36LIPCvNce 2xeuWuiIJfT4YE02t_F1R.x13eV3bD3jrPoO.NshxrDaFqJjRin7dtM9eUdfZ6e5Yall4FhE8IPS RNvXxE0Z4ARxO9ILr53IAUi4SjxZfJDil2ehZ8wHV1fBXUCXF0FC7A6D.nTbxQWRVnOXwWBD4A4m v8bKsQXIhxmPaIl5hYp6ATNc1eeTesglLhZ0kaWRtCEgPB8Dj20VdYM_.sltElWcQpk4pCeNvQ.S zLCV5qHwWWOD2cyBFziL1nDt71EQAlbB96pf9WfNh3kk8ccW7KWFvNBk84CJ6imCbHHqWJj4ClpL rN_2vJpUPYtNFzfgJ7SfZ9x.ow.WoeISluQZkDZ_xjrW8fwRrCFmII846QZFC6N._VTOCqxNDQ5Y bcJt2vVfDtL2r3yt16UCRihIzOsx.q_LzoOpK9sK_LjJrNuaXZBRP1umAThlH8hRjUYy6GNlPPf1 jZ3ei.pisJM4cZgxMh6y1qaC3azecIXQIvaAA8FKkJ6pjYurBmH3LFSgD1ALyXGXAtME1w_RlS99 9SGjU9OKNqqk- X-Sonic-MF: X-Sonic-ID: 17fb4b19-44f2-4c48-a368-2c81ed101ab9 Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 00:17:10 +0000 Received: by hermes--production-gq1-6b7c87dcf5-m4lb7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 47d44e3f1c1eb6468b8e2f5aaa239dad; Tue, 05 Sep 2023 00:17:07 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: FYI: ^T use during poudriere bulk vs. /bin/sh operation: I got a "Unsafe ckmalloc() call" Abort trap that left a mess Message-Id: <6B7D2081-B152-400F-A294-11F039077A9F@yahoo.com> Date: Mon, 4 Sep 2023 17:16:56 -0700 Cc: "jilles@freebsd.org" , Bryan Drewery To: Current FreeBSD , FreeBSD Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: <6B7D2081-B152-400F-A294-11F039077A9F.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_EQ_ADDR_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.68.84:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.84:from]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.84:from]; FREEMAIL_FROM(0.00)[yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfmKN0hQnz4RpW During a (zfs based) poudriere bulk -a run a ^T got a: Unsafe ckmalloc() call Abort trap (core dumped) from /bin/sh . AT that point it had built something like 350 ports into packages in .building/ . After the last finish was reported for the already building ports, I killed 2 stuck poudriere related processes (the rest were gone already) and then I used: # poudriere jail -jmain-amd64-bulk_a -k [00:06:03] Unmounting file systems umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/tests = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/share = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/lib32 = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/tests = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/share = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/lib32 = failed: Device busy umount: unmount of = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue = failed: Device busy chflags: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue/rcorder:= Read-only file system chflags: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue/mdconfig= : Read-only file system chflags: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue/mdmfs: = Read-only file system . . . chflags: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/tests/lib: = Read-only file system chflags: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/tests: = Read-only file system rm: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/rescue: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/lib32: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/share: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr/tests: = Device busy rm: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/usr: = Directory not empty rm: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/dev: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/var/db/po= rts: Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/var/db: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/var/empty= : Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/var: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/rescue: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/sbin/init= : Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/sbin: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/libexec/l= d-elf.so.1: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/libexec/l= d-elf32.so.1: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/libexec: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/packages:= Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/proc: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/distfiles= : Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/compat/li= nux/proc: Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/compat/li= nux: Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/compat: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/lib/libth= r.so.3: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/lib/libc.= so.7: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/lib/libcr= ypt.so.5: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/lib: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/src: = Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin/c= rontab: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin/p= asswd: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin/c= hpass: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin/s= u: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin/l= ogin: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/bin: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/tests= : Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/ports= : Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/lib/l= ibrt.so.1: Operation not permitted rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/lib: = Directory not empty rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/lib32= : Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr/share= : Device busy rm: = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40/usr: = Directory not empty rm: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../40: = Directory not empty . . . rm: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/ref/../: = Invalid argument After that "df -m" shows lots of "Mounted on"s matching the patterns: /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/rescue /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/usr/lib32 /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/usr/share /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/usr/tests /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/var/db/ports /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/packages /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/usr/src /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/usr/ports /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/distfiles /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/dev /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/dev/fd = /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/compat/linux/proc= /usr/local/poudriere/data/.m/main-amd64-bulk_a-default/*/proc No clue if I'll ever reproduce it. The odd part of the context was I was testing bulk -J128 (no ALLOW_MAKE_JOBS use) on a ThreadRipper 1950X, so 32 hardware threads. This was part of attempting to see if I get any examples of deadlocks or corruptions or such that some earlier imports of openzfs had produced for others. For reference: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #118 = main-n265152-f49d6f583e9d-dirty: Mon Sep 4 14:26:56 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.a= md64/sys/GENERIC-NODBG amd64 amd64 1500000 1500000 My attribution to ^T handling is unverified: I did not find the sh.core file. It is just what the timing looked like. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 01:39:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfp8k5h58z4rm6P for ; Tue, 5 Sep 2023 01:39:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfp8k1yJJz3L24 for ; Tue, 5 Sep 2023 01:39:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693877987; bh=MLh2ZKkOcBMqd4kEA6M4JHaiI6Ys7B3oyWTj+C2aqWo=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=jQrFwqNQIJ4wILZor5uGUqGzAoQfygLoCnsUwln8YpeymXmyg59j9fJ+KFaEQNr3RP7g8AxnQQnXXf2SrvE2la4NgKcyfD62AUU5od12PExge+7zap3vgYA2lvBFkpS0zk3qbM9VAO7XHGU0hiGoO/IeR1W64WSfw6nJXWknIKyZaP4mrIBnBMDO7tE36JzOQYv4xsW4yyNjUqlq9PIx7Upal0AfaJKe2Wwg9trMMeTij2XVOMyi+bcVMB0vliYFp1T2SXXbyrL37qWoeWwGLISbnfB0qdli7MAbPEAVb72Gg9SRzND71DdKNDq0TpEkGYOHZN4OAL7W7y1QMpuEFA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693877987; bh=KtV55EkLgVb/DxBOEAOd5w/hn6wnQuAspon53etejXy=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jUxf06VGGqIYFcoqr3X0C0n3akonwwXnOBhE9NaRqEttlqQw3N7A63NB6R1US9+5YIf7WgqmdGZ7GrnVIdxyUedpdkCpr5pcb2K7S3gY+bwg8nJB0XeEsUVlr5T37GRTBTXGikjUV/Aw/Lln2fI6qjhp6cWVweGmFjo15TPHzjGceG33bCrNndvv/D5BXVyLs+wqef4QRXTkOSWewKPbBPPxnvxnQ1aJSCNVK3TmtMeOoAYfxTWItoIzUkkKJ8r+QFq7EuePqhpfGvrV6yaMK1cbN2cDoc9vgIOZv27r/SC2juIlgMv4XSGN3GqY3UGje6x7wsyYkvgs2VH1738uIA== X-YMail-OSG: V.l2G2cVM1mfnHr3WApbIrbqKTcJYA3NWF0aohCuL3.6MR5FJKfdz8Fz5NL3O5R 8pkwrggOhckIKnnuJKXE3QjW67DQGrl1QLuzTaZuES0xuVTrzghITifUBwPd0eJBNjVUsFhK8dCI BtTZR5wSxfs3JK490PU9leUDWHGWHynRpV_AEB9Sf8DF7ONRtc4LXEm4l9qZ_kPH_VwYhQTZqug. PfEXQobAEVwOtOY_XDnINb2JwxMCBAXyqj00.L8BN9FChOQEgfck2qzQmTORGMd0GLsz2BS0D_8k NuG.7iJhVoThfypQePngm0CpEvn37tglnWegdIWBMC9B1wFuDXQ28Fdq3qss9nC4jgwFg5Jp89fo 9J9R0EXWMcVTZUDHktfp3KZUANgYZs.niMlzSZcFmnhbJmsrF8juuU6YIZPSDHVFMZ5uGmCmQ2hw T0y3QadZQC.L2eNDh8np8cUIm_5DtfPMZusrNqy4F3OcIVV.cGUYoPRMDK6DdkZjvxicjNL9XuKp dnpWrodUshFqfAxa1g3kb9ZXifwla5JwnxCo7NjQuvM.MgD3mjMtcWFF1796E6b4HgVhIiCW6sNg XlymjOMNdUgLmo40XXG4hDimoymsmVmhEVwr5kkDSSI1ZbNpe_wgxuT_M0gTIW9mg0Yy1CO_ikab 94FLTudvut01eDf6QwGSXhbE5HROTs4bMC9LkzM6_IoCigQ1nhhl_6FpKiNubiu.IgBhkCWj68f2 doVNyz.w7iP3vA7mZ7a.kgQZ2p2TsJy7PAUAxWdJlWdTC.MXpj2h1r7ZSAeBHVpC1YoRBRWcRL33 2M9ED3BIAFn6I8Zt6TsqIMeGbrjuNlgRoc5DMWAZXNWG_bHHxTwvIaDavd5YBFkHLHMaA4UH9EEC IxNsnIH_vz2jH14W_pIF0IFm56A62EqJgZSGMftnnwFOeoAWlcZMlgBXSu5Eknmzpd2ZvKEWXCX6 glqWx2SEz__RHMVT.ZNLybbR66b2Ccnd8e6RxZqyceP33gDJdE5J52zS.y6JHclQm8idJt9k4CJ9 zl..f3fUQjK.Pw9Pwrda31zQtQYEojZiAEgNCke8Jhjjfv_Z_kU3CtP2M2iyCTUh3STG_k6MVoSa bgsEJHob.Nv82mKKE2BK.aZbxInM7I0wNHaFRIRGlgbJyJGybv0Efdo1cjqSIig6FAZZKQaW6wd2 Zvn4Dl7SiTdimhK_wDFtMAQt5tjJ2CyIo9PMIypRJDr_BtIsTWq2kTnovtNN67keNeQUiuAEea9W pPHKE1Fo0rrYV1edyYpnGX0HOC29DEOxnksmGkzU9lMZ6vozWCori9uCWdDMpXTs1WONmEvCs6Qv eyZ2JPz9.2QjIFjIm7bKkTouM7jgiZhaq5QpBcfsf9T8ApPpgJj1o6TDt2XTkurDPRsMEFPK9skw i.IcSMjSEKaQDKGDsdULT.KT3ucOhWbwnOjELKdy6YYlc.i56ceH5ajFLWIs3qBcTuEQs5YynQfF WYJauy.T_jPWSTNSmgj88q3CHCNdGK353921Z8AxumgRW87bVf31a1FVQzx6nquW1mvgInY5X1_F tDCbOcWq0fsD9wEY7d_p3T52ifTSewUa8zlGKIdAle45armYb0m1C1oZKAGiIbO_Qs9rWuJ.aoS8 bAvvh2zbCPoXgWb0OLFWmUaZo_w2mPDAgE5R_bCpjerSgjhQdszLsUHAILvW9WNKwMfMf39MEUHG UpmTZY.KUViv6XVKfN5tx4VL4tIHNv2e__bJk3Rfg0.9bEYuDaCl8mmc5hlZwgYzygfe4Sde2Ytb tIEchAjPiZ6K8Df84e0_5_SPx.pmb3kJUHwDI1d9uzWQ9K.ZQInm2G8SUZHnAjk6_1j7yRfjxILy CyR3325VIl2P4MpUqlc4EjXHn_AVpWSwzana9uLle.aBJNHsTMjQNBOfHVGFuBcyTph_wZfaSjVS c7z27ImyaS3KvpBvxYRm638ggrJ9uYQV.YrNqV1LnkFO3ZkkIKL.3ofACewyxUgPM_t.j3nrtDSM YluaQhfq5DjFC7Aenx7Ww1LcTnTjh.511Yu9tppen17GEjgm0brF3M.Ru9v_oGdtKEweyTSxQWm6 EhWE0AocpCKftQcuHiqA3YbkpQLFyI.xoy9W0O3ytPGVV4Ze4vBvovnBty1Aukakwl.sY9hg9YJ4 n7hr2Es7z7lwM0PsE1WbrJ8DYv6rY_MaLEGDWSfvzdJqFvY87TLMbdXMZG0QXG9tL7Q77nZX66Zi kJEV12gxaosHe8xo6TxqqOHCxvfIoLMZpYdtF_LSbAfLZZhw2L3veC35C6KwgF89Pvi88hDy2cM9 6 X-Sonic-MF: X-Sonic-ID: 2f556f5f-1f8b-4d44-b6ab-39b2b07d5ab8 Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 01:39:47 +0000 Received: by hermes--production-gq1-6b7c87dcf5-6x8bf (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 801c3bf5026c7120c3c60bafe3edf13c; Tue, 05 Sep 2023 01:39:42 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> Date: Mon, 4 Sep 2023 18:39:32 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4Rfp8k1yJJz3L24 On Sep 4, 2023, at 10:05, Alexander Motin wrote: > On 04.09.2023 11:45, Mark Millard wrote: >> On Sep 4, 2023, at 06:09, Alexander Motin wrote: >>> per_txg_dirty_frees_percent is directly related to the delete delays = we see here. You are forcing ZFS to commit transactions each 5% of = dirty ARC limit, which is 5% of 10% or memory size. I haven't looked on = that code recently, but I guess setting it too low can make ZFS commit = transactions too often, increasing write inflation for the underlying = storage. I would propose you to restore the default and try again. >> While this machine is different, the original problem was worse than >> the issue here: the load average was less than 1 for the most part >> the parallel bulk build when 30 was used. The fraction of time = waiting >> was much longer than with 5. If I understand right, both too high and >> too low for a type of context can lead to increased elapsed time and >> getting it set to a near optimal is a non-obvious exploration. >=20 > IIRC this limit was modified several times since originally = implemented. May be it could benefit from another look, if default 30% = is not good. It would be good if generic ZFS issues like this were = reported to OpenZFS upstream to be visible to a wider public. = Unfortunately I have several other project I must work on, so if it is = not a regression I can't promise I'll take it right now, so anybody else = is welcome. As I understand, there are contexts were 5 is inappropriate and 30 works fairly well: no good single answer as to what value range will avoid problems. >> An overall point for the goal of my activity is: what makes a >> good test context for checking if ZFS is again safe to use? >> May be other tradeoffs make, say, 4 hardware threads more >> reasonable than 32. >=20 > Thank you for your testing. The best test is one that nobody else = run. It also correlates with the topic of "safe to use", which also = depends on what it is used for. :) Looks like use of a M.2 Samsung SSD 960 PRO 1TB with a non-debug FreeBSD build is suitable for the bulk -a -J128 test (no ALLOW_MAKE_JOBS variants enabled, USE_TMPFS=3Dno in use) on the 32 hardware thread system. (The swap partition in use is from the normal environment's PCIe Optane media.) The %idle and the load averages and %user stayed reasonable in a preliminary test. One thing it does introduce is trim management (both available and potentially useful). (Optane media does not support or need it.) No per_txg_dirty_frees_percent adjustment involved (still 5). I've learned to not use ^T for fear of /bin/sh aborting and messing up poudriere's context. So I now monitor with: # poudriere status -b in a separate ssh session. I'll note that I doubt I'd try for a complete bulk -a . I'd probably stop it if I notice that the number of active builders drops off for a notable time (normal waiting for prerequisites appearing to be why). =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 05:06:45 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rftlq1CZgz4sHd6 for ; Tue, 5 Sep 2023 05:07:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rftln6Btfz3DjZ for ; Tue, 5 Sep 2023 05:07:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=lhqPwjKA; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693890419; bh=7nhxTNUkT8AMv1Gs52gY8VCOLEpf0ixNh0hQmH5e8NU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=lhqPwjKAvqRQA19ApqGQGJk6MF/nCpFcYvhqSj8sxFBAGyDtktK/WnrRBDMpQy3nCCfskJb12TwdN1m1NhHg0Dh6yNWexAeihoNrYmiyhdfzVFQwQH2kPHPYXNMTErQAd2pzNknyipO3Qq5ARGdn9hg3oFxRb9ht2F+F/VTsgLWdhpskZwzLb8OS9FEBzXg08unjG6NBrEWktAkqL9kdyqJdmcgqzDxLe3PLseFt+DJIfkY/2+SyKQHRYtphID53zZjWr+zsdYTjb5gJePXT3mC0hgKQpRv43ZTjxdX4DGix++8QMnAvjWUnP/rXb1c+4rrPoeWeFnYjUU0bYeY1Aw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693890419; bh=wg3wSjmioxjNzHbDqOVKVyj9Dl9QqzwMvlfTVufpeTp=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=hyWVuNPuzg91Y/ymAU3Es4djsNWhRf2gBlvZdd/vyDMB9GK7ogva/fCFs47Z9620XyxOBjA6vzqDJbmK2KPq5lFDJq7waRbQj6pwQyQ6oMwvbJ2Ge6U1K3k0Ji1NIUaLtBANBhrn/w7pPPt4P2dRTfejdh+jzxUlrN5S88yyEzQ9mFRZdH0pQzO3giCLdv/GtgHjhIUJML0qXdQbwpP68mmLPStx0qYfUm++HSyIUVwMfhS8shmv+5g+OPn8g2fenynRbiqeYtmj6rFsKEg1D3icvCw1hFirmD+u5wQNYxOdIa/uUvpihcufM77guE4ES76r6kf2tRyAzRMBtvAGWQ== X-YMail-OSG: D2CdCDcVM1nQOcXY5xjWdwCgM8r9WyU7avoauGp28wVYbswfKOYtk18ILsIstW1 cZp4Ow1EMFj113gWei_4OtuSTRz9Yc46v8BMhO6AICQp4zHxqSUCuaXLHWEyMZvgoT2Grn6B3vGQ iXgrJl8sokjwfv1zzAgVRGuBgq1tSPFvWP6Fd6SwvV3YziGuRBMfywUgC_nN2SEC3hcNXxg1pwKX VfFgJzFuc3zC_OnRDD.3DB6SdUIsAdBCRHtyY3cef2NyvxenswzF6.7byX4LHRU6LHFoNxJzT1_L jjq7PAdoxC8_f9Dtw2XqE8VDPn_5t7Adx5q15_BBLcgsZVL6PDvflAyDErqCDzS4g5cgZsHQRMHi t7GgGi71wqlRHecalsgcOpPutsjSx6re9MGUc50lQ5VaeJNLiYxEa8oq.hq7LwJVeen1ztsEhwYL VgLHcXvUFCvweHTWDTqY8pNGKoYxzZpBaT6VcVxW1AuAG6caN.dPb_Jtk8vSTtaAG9aApYn9Ag0t Y9kICJmQ1aoHsTxPUtyKBb7rRWIrC_DfF4Koor.98CJeAWTD9pKFiZrkOPlsDxDe9a_Ir1AShCjT jb92eh8FhRSfdPcnCd8qDX_9dt1yEHJptj5rvxv6LUFsFn_ve2LEkY2E4sP95bK2qGJo7e7jG1MG ZrJSMCCPxWTepPTDsh4dR0qX5_7iCpgC7k8l.NAdrovi.mQa90r1HFUa5gdtmx6YfQws30rvaVYk l2bdavcj7_fapIssV..VZWsVNZKei_Dcx038PbyGs.cvvS_V_zThVzEx_E1AISyWw_JrK0lgt37O 6FxUPptJBWy7SWjB7MKM5rydgwqvoGNBD8.hGwMGdofxEYTDjxRqQcyYR5ByuR2x3AFMB0wAYX5t HKiChEksgWlaU89t3oJ7jXq38zoJyrBO56pXqzSkuJ2bhUNX9nV5iKae9JWRA0s5n9kVDwN4Tc38 e_qxw0oqkGAmOZA7cBPlcfeUYf4EtRsTDvmvLPUIs5a4eSmyQ0E76HXv6RN7PjhK3tiOPnR_n0Qz cxor964WIb9FCsgTCFmm3mtVbUA78_95V4ypHm6E08XAoqo2k3GGi6BKSxrPHQSEvEhKUi4MbJE6 eu4qhlYszlv_thlZwSt2.wZBm9JBTaXY9K9SNS5aUinVomaDY4EDpDaxLdyfAChOzP8NXP43RQKu 09VqcZ8HNYumeUqgZhG8TV4l9tDOZ_R0ldhbxfPrGpF0IHR8N7K22gQrTak3zSnzV_VjTTanexJg r7W4eFhO8uV8jgCaNwqQau57_XMp1RnAYMkmD6DMVmnSBroh.NzjPVuQxIrD88g8rjIrD8SeOcno JqLkCYguY7kTSpGWVo.QQJO0Cu4IrYDQVwxGRGjw7CWSfzXICeDWGunHWXHqnje_Oa8rnq957kz5 A1vNLnMZxLjNkzNrSV6qs9Z.IjkPCWY.0RcD9uqT8MZMJyqdarvJ6akqhgj4unibDYGy0nVHbZs7 ttwuNPbFRFj4_FxIJyCXcQNd5RBZAOH0u8aIy_4e_um4r1v7c5y00V_GdvkmSODx8r3w1joBACcJ gsufW3q0WbPxPQv64NRgqJ9J3gSGuJbHdgRc_fq2X93sgGgbSn9kILMrBm_MuhD1gYmI.nR1DhuG mZMpCzq0AsrFrqGhQieVOwnbiFR7Notc2lMQTRUTBmYAVv2_OFA48DZpaIcuHBi6x3ScqhBNPdg_ eGublet99JzhOuQxX5yUoU2YvNDQBqfDBI0kgEMK5ocfnDPaCKQQz6jjHwu5MDAHIGtnW_VF96hm el8wNaqHgxtW8CoyQIVH6FQ8d.8vG3vZpTI7RHSFhCh3f809LgZ_aPK6tp4k7wWEe1RyWDWGnw2E _QxndF4xLACL0zvGOW2OYSClEgIWfBsBvtzktF3ZmEpCDddH1.0fVaK.SNxQ7qcCpjjvnsMwRa2J AEulDeks0gOaVa282hd0sxI239JdXcGyoL1V.ycEg9ZxyvLLWvwqABf2R4L0Yblq179bTlq7AElq x_vmN40y3hQSSc6w6XvsabZqqAPf6oS7xbH8rBdSeXTS6PQ9t8Fj28G4XgRKe.n_cOdSgmRTmbh0 Eer.OObh3sNGz.xf8K1mYyBXJm8qCzpdaLqLFntQLNaQ3RcR.a5Hi8fE7LV06zgH7FL6KgBUlLs9 YkXvqgDZIy2pacoUh4YT.D2Ou8qUpF23RytKRrKffQk2V_kxDGeFXo_d2613k.n0edZzK61itQBx kziEppEea8im08SEWntBSe0B0__YAVp598np2WYcXspmF61G6avSrB0YiUpngBzbSKfBpbVs17Ha H7.A- X-Sonic-MF: X-Sonic-ID: 225cd4e5-904d-4d53-9d73-38483c380d42 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 05:06:59 +0000 Received: by hermes--production-bf1-865889d799-7vf9r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID ccb0e102c847d0bfa14ec0471e6c74a4; Tue, 05 Sep 2023 05:06:54 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> Date: Mon, 4 Sep 2023 22:06:45 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <4E888EC8-4B06-4139-90DF-59AFBA700A5F@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.44 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.941]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.82:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.82:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rftln6Btfz3DjZ On Sep 4, 2023, at 18:39, Mark Millard wrote: > On Sep 4, 2023, at 10:05, Alexander Motin wrote: >=20 >> On 04.09.2023 11:45, Mark Millard wrote: >>> On Sep 4, 2023, at 06:09, Alexander Motin wrote: >>>> per_txg_dirty_frees_percent is directly related to the delete = delays we see here. You are forcing ZFS to commit transactions each 5% = of dirty ARC limit, which is 5% of 10% or memory size. I haven't looked = on that code recently, but I guess setting it too low can make ZFS = commit transactions too often, increasing write inflation for the = underlying storage. I would propose you to restore the default and try = again. >>> While this machine is different, the original problem was worse than >>> the issue here: the load average was less than 1 for the most part >>> the parallel bulk build when 30 was used. The fraction of time = waiting >>> was much longer than with 5. If I understand right, both too high = and >>> too low for a type of context can lead to increased elapsed time and >>> getting it set to a near optimal is a non-obvious exploration. >>=20 >> IIRC this limit was modified several times since originally = implemented. May be it could benefit from another look, if default 30% = is not good. It would be good if generic ZFS issues like this were = reported to OpenZFS upstream to be visible to a wider public. = Unfortunately I have several other project I must work on, so if it is = not a regression I can't promise I'll take it right now, so anybody else = is welcome. >=20 > As I understand, there are contexts were 5 is inappropriate > and 30 works fairly well: no good single answer as to what > value range will avoid problems. >=20 >>> An overall point for the goal of my activity is: what makes a >>> good test context for checking if ZFS is again safe to use? >>> May be other tradeoffs make, say, 4 hardware threads more >>> reasonable than 32. >>=20 >> Thank you for your testing. The best test is one that nobody else = run. It also correlates with the topic of "safe to use", which also = depends on what it is used for. :) >=20 > Looks like use of a M.2 Samsung SSD 960 PRO 1TB with a > non-debug FreeBSD build is suitable for the bulk -a -J128 > test (no ALLOW_MAKE_JOBS variants enabled, USE_TMPFS=3Dno in > use) on the 32 hardware thread system. (The swap partition > in use is from the normal environment's PCIe Optane media.) > The %idle and the load averages and %user stayed reasonable > in a preliminary test. One thing it does introduce is trim > management (both available and potentially useful). (Optane > media does not support or need it.) No > per_txg_dirty_frees_percent adjustment involved (still 5). >=20 > I've learned to not use ^T for fear of /bin/sh aborting > and messing up poudriere's context. So I now monitor with: >=20 > # poudriere status -b >=20 > in a separate ssh session. >=20 > I'll note that I doubt I'd try for a complete bulk -a . > I'd probably stop it if I notice that the number of > active builders drops off for a notable time (normal > waiting for prerequisites appearing to be why). >=20 >=20 So much for that idea. It has reached a state of staying under 3500 w/s and up to 4.5ms/w (normally above 2ms/w). %busy wondering in the range 85% to 101%. Lots of top showing tx->tx. There is some read and other activity as well. Of course the kBps figures are larger than the earlier USB3 context (larger kB figures). It reached about 1350 port->package builds over the first hour after the 2nd "Buildee started". autotrim is off. Doing a "zpool trim -w zamd64" leads to . . . larger w/s figures during the process. So more exploring to do at some point. Possibly: autotrim per_txg_dirty_frees_percent For now, I'm just running "zpool trim -w zamd64" once and a while so the process continues better. Still no evidence of deadlocks. No evidence of builds failing for corruptions. . . . At around the end of 2nd hour: 2920 or so built.=20 Still no evidence of deadlocks. No evidence of builds failing for corruptions. . . . I've turned on autotrim without stopping the bulk build. . . . At around the end of 3rd hour: 4080 or so built.=20 Still no evidence of deadlocks. No evidence of builds failing for corruptions. Looks like the % idle has been high for a significant time. I think I'll stop this specific test and clean things out. Looks like lang/guile* are examples of not respecting the lack of ALLOW_MAKE_JOBS use. Hmm. The ^C ended up with: ^C[03:41:07] Error: Signal SIGINT caught, cleaning up and exiting [main-amd64-bulk_a-default] [2023-09-04_17h49m28s] [sigint:] Queued: = 34588 Built: 4331 Failed: 12 Skipped: 303 Ignored: 335 Fetched: = 0 Tobuild: 29607 Time: 03:41:05 [03:41:07] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-04_1= 7h49m28s [03:41:19] [95] [00:06:59] Finished databases/php80-pdo_sqlite | = php80-pdo_sqlite-8.0.30: Failed: build-depends [03:41:20] [60] [00:10:53] Finished www/php82-session | = php82-session-8.2.9: Success [03:41:20] [19] [00:06:42] Finished databases/pecl-memcache@php80 | = php80-pecl-memcache-8.2: Failed: build-depends [03:41:23] [62] [00:06:40] Finished = net-mgmt/icingaweb2-module-incubator@php81 | = icingaweb2-module-incubator-php81-0.20.0: Success [03:41:24] Cleaning up exit: cannot open ./var/run/116_nohang.pid: No such file or directory exit: cannot open ./var/run/93_nohang.pid: No such file or directory and JID 253's processes are stuck in the STOP state, along with the related JID 0 processes. These are for x11-toolkits/libXaw . I do not know how long it might have been stuck. /usr/local/libexec/poudriere/sh -e /usr/local/share/poudriere/bulk.sh = -J128 -jmain-amd64-bulk_a -a is stuck in killpg state: 3896 101784 sh - mi_switch+0xbb = _sx_xlock_hard+0x3e1 killpg1+0x193 kern_kill+0x23c amd64_syscall+0x109 = fast_syscall_common+0xf8=20 Most recent process birth time listed-first order for the STOP's: 86826 634820 sh - mi_switch+0xbb = thread_suspend_switch+0xc3 cursig+0x7b9 ast_sig+0x1df ast_handler+0x88 = ast+0x20 doreti_ast+0x1c=20 86825 321240 sh - mi_switch+0xbb = thread_suspend_check+0x260 sig_intr+0x4c fork1+0x186 sys_fork+0x54 = amd64_syscall+0x109 fast_syscall_common+0xf8=20 86550 308525 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = pipe_read+0x420 dofileread+0x86 sys_read+0xbe amd64_syscall+0x109 = fast_syscall_common+0xf8=20 3998 637224 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 3976 298566 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 3974 309336 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 3962 577230 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 3958 635598 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ 0xf8=20 3915 668148 make - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ 0xf8=20 3912 638108 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ 0xf 46142 212631 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_timedwait_sig+0x12 = _cv_timedwait_sig_sbt+0x10c seltdwait+0x75 kern_select+0x95e = sys_select+0x57 amd64_syscall+0x109 fast_syscall_common+0xf8=20 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 05:52:52 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfvmm15rPz4sfwW for ; Tue, 5 Sep 2023 05:52:56 +0000 (UTC) (envelope-from felix@palmen-it.de) Received: from stef.palmen-it.de (stef.palmen-it.de [IPv6:2001:470:1f0b:bbb:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfvmk6pLCz3QbV for ; Tue, 5 Sep 2023 05:52:54 +0000 (UTC) (envelope-from felix@palmen-it.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=palmen-it.de header.s=20200414 header.b=NYMhv3pb; spf=pass (mx1.freebsd.org: domain of felix@palmen-it.de designates 2001:470:1f0b:bbb:1::1 as permitted sender) smtp.mailfrom=felix@palmen-it.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=palmen-it.de; s=20200414; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:To:From:Date:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=jlUgYu1KbL/v/i2CF34QI7lkpHadiX8x7aa9vn5AMy0=; b=NYMhv3pbdqAOr6aVK1TLhqJ20m DTShN16dDW4hmIhxENrtPUV+BHDbYojT9cBr4pt4tq6Ao/BCj9r8YHGmx3NkwWZ31v3HnVIJnXMzT JmngntvtEfSnNYlPz1TSD7iqbIKyK7tqeiGwlib0jWCM1gWUkm33o8un6urbrQvZTtOOsvworev4v 3L/L9UlxIWtGr5ofLoStWnnmJaEuyAulIMTRSQn4xmaHl4hjsEY8fNxkfCxgCr1HWRK65lB+tmC18 r9clx2GeZK03iMVFUyV8PB9c84q0ySUzebg2ZLfa3/TKPmt7mxC3Ibz1gSDx1pEH2uj19WXgbgRIr szE2J4vg==; Received: from [192.168.71.101] (helo=mail.home.palmen-it.de) by stef.palmen-it.de with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qdOzd-00Bc0q-4n for current@freebsd.org; Tue, 05 Sep 2023 07:52:53 +0200 Received: from nexus.home.palmen-it.de ([192.168.99.2]) by mail.home.palmen-it.de with esmtpsa (TLS1.3) tls TLS_CHACHA20_POLY1305_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qdOzc-0006Qc-2e for current@freebsd.org; Tue, 05 Sep 2023 05:52:52 +0000 Date: Tue, 5 Sep 2023 07:52:52 +0200 From: Felix Palmen To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: <7bp3nvxmtiotil6ea3mb3oxgcxcwo45l5ghbblzcuwfztpjztj@yh4b35gqqyrv> Mail-Followup-To: current@freebsd.org X-Face: /1K@t"h.}e~pR@]c7HorQ!T`F^RJCa'BCr#e>IKA{>C/9OTGB4|xh"y2{?1Z5M i2w"AH^pN_LlHR^{+f',_Np~;.B;!M/bL}*qk]p5*r7F5vW};{:@4u5S?T&f0$7BJ-71Q5SV]:v$`5 A0[DZ:=?S52x8HJ~5@^P_\T@MsjG{R( Organization: FreeBSD.org References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="2e3vk5kji2w5ce7x" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20230517 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.50 / 15.00]; DWL_DNSWL_MED(-2.00)[palmen-it.de:dkim]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; FORGED_SENDER(0.30)[zirias@freebsd.org,felix@palmen-it.de]; R_DKIM_ALLOW(-0.20)[palmen-it.de:s=20200414]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f0b:bbb:1::1:c]; RCVD_IN_DNSWL_MED(-0.20)[2001:470:1f0b:bbb:1::1:from]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; BLOCKLISTDE_FAIL(0.00)[2001:470:1f0b:bbb:1::1:server fail]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[palmen-it.de:+]; HAS_ORG_HEADER(0.00)[]; TO_DN_NONE(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_NEQ_ENVFROM(0.00)[zirias@freebsd.org,felix@palmen-it.de]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4Rfvmk6pLCz3QbV --2e3vk5kji2w5ce7x Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Dmitry Chagin [20230904 21:49]: > On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > > I guess I'll now do a full rebuild of my linuxulator userspace branch on > > a kernel with that patch, just to be sure it won't break anything else, > > this will take a few hours, I will report back. So far looking really > > good :) This completed while I was sleeping. No issues! With ~120 "Linux ports" building fine, using all sorts of tools (like python and some tools from coreutils), I think it's fair to assume it's all fixed now. Cheers, Felix --=20 Felix Palmen {private} felix@palmen-it.de -- ports committer -- {web} http://palmen-it.de {pgp public key} http://palmen-it.de/pub.txt {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 --2e3vk5kji2w5ce7x Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEABYKAH0WIQRpNhPVW79IN7ISOsxUreAGmHnyMQUCZPbCI18UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0Njkz NjEzRDU1QkJGNDgzN0IyMTIzQUNDNTRBREUwMDY5ODc5RjIzMQAKCRBUreAGmHny MZKtAP9a6Nx4uLJVMwWKMFt+RCAZ83JibcJH1i+u78aQ18MHOQD/e/4UUEjJtyrA nV0IOYEVHFGgB1axE/QPu7vkU+qnRAQ= =Voki -----END PGP SIGNATURE----- --2e3vk5kji2w5ce7x-- From nobody Tue Sep 5 06:13:06 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfwDF3pLpz4rryq for ; Tue, 5 Sep 2023 06:13:17 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfwDD3wCkz3WGG; Tue, 5 Sep 2023 06:13:16 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [188.174.63.136] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdPJJ-006uK7-M6; Tue, 05 Sep 2023 08:13:13 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 3856DAc5006345 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 5 Sep 2023 08:13:10 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 3856D6GZ006322; Tue, 5 Sep 2023 08:13:06 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Tue, 5 Sep 2023 08:13:06 +0200 From: Matthias Apitz To: Warner Losh Cc: Michael Gmelin , Alexander Motin , FreeBSD Current Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Warner Losh , Michael Gmelin , Alexander Motin , FreeBSD Current References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.63.136 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4RfwDD3wCkz3WGG El día lunes, septiembre 04, 2023 a las 12:10:56p. m. -0600, Warner Losh escribió: > On Mon, Sep 4, 2023, 11:40 AM Michael Gmelin wrote: > > > This could also be related: > > > > > > https://cgit.freebsd.org/src/commit/?id=319d2bf407b3762da6f1c67ffe8dce2fee587aaf > > > > You could try to undo that patch and build a new kernel. > > > > It shouldn't make a difference... but I may have been given bad advice if > it did... if it's this one, I'll help sort it out. > > Warner I've reverted the above change, compiled the kernel, copied it to the USB key into /boot/kernel/kernel (only this file), removed /boot/loader.conf and the keyboard is fine. Thanks, Michael. Warner, do you need a new PR for this? matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Tue Sep 5 07:00:51 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfxHW5hsJz4sJJf for ; Tue, 5 Sep 2023 07:01:11 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfxHV3dpcz4FRM for ; Tue, 5 Sep 2023 07:01:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Y8mOx4K8; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693897267; bh=pw1iElHKkMOpMg4Y7INooIt1Qti82KOxdt/SI3j0lzE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Y8mOx4K8KVHs8hmQ/32UJKqh09IZjxkpWDGzrsMWSm7BbCeB2WSJA2U2MzBtppsiDsunzfxldVFv4nl4zq4exTrIFJo6VkPpAMiUEta7owGe8GorA4dZg4WQrXB86mbgdLQ7MV09UcJEnE8lzETixKnq3iKM2JhJxbZ03/l8WoDKtdvCcPLYcBVJ+HdPGJyzRqfE8O2FnEYg+mg3S5NtfDNB8GwYTBJ7EkfSHzFqWAYSoEOnguGcEybQ7rA9ZGLh1E+QgkvPvAvDMoZ6B6LI7TiMg+ADAchauUUKvdxcufvlCgKhntrwwIFE3jFfwZnaGoqHqz+OHpfzQOWPQws0nQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693897267; bh=6vv2fQjzKtagdngREFoccdWXzzwtB+0tKhY/ddosAss=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=GJthfjfVnTT5Epa7ReQLTNd7mPtOSnXrzHv3EdRKbkuMCN05JHmS0wHi6GQQO2lbomr4ooHLearIn/NWteiSTxZDWNywkirXOlEsukKfkXEDZDJATlJZ9KPU1HUYegF2hJU8IhhUdpB7z4ThkJrEBq8ds2FiTISPaIgoIOHkKT0Q7mr5l8oy1GaghzrKyGs8on+Zmcgcc7cTEzgDGCxhzHJs6SriKs1AB+8qx+9IjW5KDt57vTlCeelKIFTSbT6DU1R1/0lencI8UKBdnXC70MQHn/LI/MLG4C7OP2hLLFRmeEZk4sLow9SKHIpmlhBEGXt0zFp+dvpapM9nDxDGAQ== X-YMail-OSG: UWGX7a8VM1ngMWLt00TDfCjEm0zBXUhT9xP2gBaaiXRGox_bO1JygZ3e.V8M843 JEWijb4MGnwgu6B4qupXLjoWrDwAxH8H8ut8xfhT8KxOWaguXIMdDTt02pnQwGkKStXN7yX.Ldri 5IhxLeZp_dAHUhXul4EhKImntgVh9YdJ8Ou14zGobFDVDq.qhKNrZ1asKWyHKZcoXMrZnNH5s0kY 8hsYzblKa9leF4NgIJh3S5ldIHT6SbbccWBkON2ZPMnUgahMURhrNGkQsKjaOfcqWnsAAFnUXy7w CdpKu1kjm05P26bHT4mYp0c1ANmqmuRxAG5T_FmBCFySJ4Hjjw_2uP6jKMMfaNrBE49ZzxsrQcv2 ds9EEJRNBFO1_FQY8OAu1LsYgcTAbh13r83bocU5TJ14Kw12HG_0sZMRagBTDJ_LpJZ.q7.hFdQt tlxdWAMwMyAsFA48CLl.8qTQy5fwi17NnisPHQRBqYI966uOyZRDxXj9qST0YRww8_qvefPvsA0c 1u1nwkdtM0rvRbz.TWp9ZxdZi84hDir4pHYa2PzMKFp8hu1A1GugD5EktAGz3zAyXR0XPs_eXyu7 HgaRgWB9l7qFO1W3MFlEUEHKeAM6.VybNQuYN41wQ_B8v1aWWdSjNeFk2kQt3gKTAX23.9tG6C6t WCSW6ivGmyb3UGIZRszaZhAt0kmgGwA.lTrrNzyjPTwE4NQ1E.H79fPMj.Fd4dMUsOPmT6C7gWRP VIwZvPOclfmeLYV7eHaIiN1bkJLfrMRjB47jsxlI7FzR7LlXV_ZCwthjflKX0k9Z8IZI0RJ3vpAA IzQ7jKM70_Kk3.9bzxYRcyrXYxiXAHh09v4LNzuviV_3iQgVL5_izk0juYNHfOZNyI83mDRa5P8C XBoqGIyC70SIkNOUKZ_dGn.nPmM2PyGE2EjyAPAYdA_0LRXUKRJtg25OEe6ckO3XTAGNO28rmsl6 d5LNctd3K5H7HfqePKrEFSj2WzCxqIGlriQThq1mMIuXpoC30bwhMVrYrISLyvoYqrkwfz7zKX.d Mum84UXidMIObPLQqlLkQW6H3Sx5Nw18lsa3w6UhajCpf4XPn1nvyX2_.AKRQlrqIS2xdDvVPnjf pHjA2WMU1Q_ZReFW952WxZMNqdVakiSRggVUr6_QupIES0SlSphpJyN4PPIWFS5XSnqMc4bHpRD6 LoqYLI.5lXhCgElW3Ogv5VSkN6IprQ7LgWsEyuMHTgP9hT1n_uJJ.Ya9_wXPuJSiVQ2OPtTBNIT6 bJB7XcruyP0bM370kPqCo3h1Uo0IYV3xROdF1Z3WhtIvXKK4wJAazsjihYuXhnueohS0peYXqMta seeloelhV7hhK5agdq1VATT.vQvEQc.jKxb7fng72L2g1d53q5uZ.qkQev7PB_3ExZd.Y8O5M8Ao ZDohOW51B7CFtzPpMhJMQ.nuxu3Q9zSEBRthDwTTEUV0Q6PCTu39_wF4GduIU_G0.5ar_pEhRyE0 nrvQoIBs66XLpPGpNZKBdBz43uCalUnTiUKTvAoC61VpGY2NhSrauUQM6uJBs06a.6i56X5TAlKX i0B2AdqvkMhqhckP9rgqt3IQOG1EAFgVWn3TPCToQDAlrn1Uvld59lswK.Mfhsq50Fe8XC9._h12 3PX98IIteRy7srbSc9x9Phj.UzjqvuIorOMYXhE4Rb1DG83DQaZexQFoSRh8v0hz3sG_8Iax4MaF jRiAjSwKGZmXJHJqIE01j6YRfwYaBD.fuu10StqEBPBP91qncnDRhGk8KRBQwRzsImKfxl_v59m_ Vhe09snM4j8wQNMNthXzfsYLk5v6ThM0M9rJXcEocAMfj_IK09kbdlU7cXiSgfkNZfH_oneCO6Aq HLZdbnhho_itCUw7ehctGUJ96.5oF7fSvdX7qRCZOCPAEuEOWkp05jqyPWJqV1Fz8OMTQSKcyp31 GCxn.idLGRnMXembeAo0Fo9rxvZfn.PKW6T25Shb.zQJi5mx976nyHbNNdw7Kj7_Elky0iUNSzhI 2N8EVW0opBjDlx1m2d.y8NVh4tWTK5.pVEbUaLMd0m8Bfhf_Uz1e4oaHXcwYMgcl9bjg50RUA5Ok gqrw4ND4qom5Y85ZonwP5J_zoGGzxZV35AMRnY1cpWTrlmzBwQRVFPUhX6yQSMz4EoADxA5snLMf cqHnk9P8EggmzzumH.PblYEOPKt9ZNZ_DN.p0FeKi09tdOjIqJ_qvm4NHcPPbwxdrx2lrmOvMY7u 4C283snzedLsIxYlgwyC7q63gjwnBtv95Imnk_xxhYNtM7iWNyRx._PVH.cGhOGedYTtuptBpL6j LADU- X-Sonic-MF: X-Sonic-ID: 7f64faff-6bd7-42ab-8b5b-148102c2a526 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 07:01:07 +0000 Received: by hermes--production-ne1-7b767b77cc-4t526 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 39c396e6b3ede7e9879b45bd04df2c2f; Tue, 05 Sep 2023 07:01:03 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" that did not go as planned From: Mark Millard In-Reply-To: <4E888EC8-4B06-4139-90DF-59AFBA700A5F@yahoo.com> Date: Tue, 5 Sep 2023 00:00:51 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <6990186B-E85B-4D64-8202-4B9ECBD876FD@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> <4E888EC8-4B06-4139-90DF-59AFBA700A5F@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.985]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.69.32:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.32:from]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.32:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RfxHV3dpcz4FRM On Sep 4, 2023, at 22:06, Mark Millard wrote: > On Sep 4, 2023, at 18:39, Mark Millard wrote: >=20 >> On Sep 4, 2023, at 10:05, Alexander Motin wrote: >>=20 >>> On 04.09.2023 11:45, Mark Millard wrote: >>>> On Sep 4, 2023, at 06:09, Alexander Motin wrote: >>>>> per_txg_dirty_frees_percent is directly related to the delete = delays we see here. You are forcing ZFS to commit transactions each 5% = of dirty ARC limit, which is 5% of 10% or memory size. I haven't looked = on that code recently, but I guess setting it too low can make ZFS = commit transactions too often, increasing write inflation for the = underlying storage. I would propose you to restore the default and try = again. >>>> While this machine is different, the original problem was worse = than >>>> the issue here: the load average was less than 1 for the most part >>>> the parallel bulk build when 30 was used. The fraction of time = waiting >>>> was much longer than with 5. If I understand right, both too high = and >>>> too low for a type of context can lead to increased elapsed time = and >>>> getting it set to a near optimal is a non-obvious exploration. >>>=20 >>> IIRC this limit was modified several times since originally = implemented. May be it could benefit from another look, if default 30% = is not good. It would be good if generic ZFS issues like this were = reported to OpenZFS upstream to be visible to a wider public. = Unfortunately I have several other project I must work on, so if it is = not a regression I can't promise I'll take it right now, so anybody else = is welcome. >>=20 >> As I understand, there are contexts were 5 is inappropriate >> and 30 works fairly well: no good single answer as to what >> value range will avoid problems. >>=20 >>>> An overall point for the goal of my activity is: what makes a >>>> good test context for checking if ZFS is again safe to use? >>>> May be other tradeoffs make, say, 4 hardware threads more >>>> reasonable than 32. >>>=20 >>> Thank you for your testing. The best test is one that nobody else = run. It also correlates with the topic of "safe to use", which also = depends on what it is used for. :) >>=20 >> Looks like use of a M.2 Samsung SSD 960 PRO 1TB with a >> non-debug FreeBSD build is suitable for the bulk -a -J128 >> test (no ALLOW_MAKE_JOBS variants enabled, USE_TMPFS=3Dno in >> use) on the 32 hardware thread system. (The swap partition >> in use is from the normal environment's PCIe Optane media.) >> The %idle and the load averages and %user stayed reasonable >> in a preliminary test. One thing it does introduce is trim >> management (both available and potentially useful). (Optane >> media does not support or need it.) No >> per_txg_dirty_frees_percent adjustment involved (still 5). >>=20 >> I've learned to not use ^T for fear of /bin/sh aborting >> and messing up poudriere's context. So I now monitor with: >>=20 >> # poudriere status -b >>=20 >> in a separate ssh session. >>=20 >> I'll note that I doubt I'd try for a complete bulk -a . >> I'd probably stop it if I notice that the number of >> active builders drops off for a notable time (normal >> waiting for prerequisites appearing to be why). >>=20 >>=20 >=20 > So much for that idea. It has reached a state of staying > under 3500 w/s and up to 4.5ms/w (normally above 2ms/w). > %busy wondering in the range 85% to 101%. Lots of top > showing tx->tx. There is some read and other activity as > well. Of course the kBps figures are larger than the > earlier USB3 context (larger kB figures). >=20 > It reached about 1350 port->package builds over the first > hour after the 2nd "Buildee started". >=20 > autotrim is off. Doing a "zpool trim -w zamd64" leads to > . . . larger w/s figures during the process. So > more exploring to do at some point. Possibly: >=20 > autotrim > per_txg_dirty_frees_percent >=20 > For now, I'm just running "zpool trim -w zamd64" once > and a while so the process continues better. >=20 > Still no evidence of deadlocks. No evidence of builds > failing for corruptions. >=20 > . . . At around the end of 2nd hour: 2920 or so built.=20 >=20 > Still no evidence of deadlocks. No evidence of builds > failing for corruptions. >=20 > . . . I've turned on autotrim without stopping the bulk > build. >=20 > . . . At around the end of 3rd hour: 4080 or so built.=20 >=20 > Still no evidence of deadlocks. No evidence of builds > failing for corruptions. >=20 > Looks like the % idle has been high for a significant > time. I think I'll stop this specific test and clean > things out. >=20 > Looks like lang/guile* are examples of not respecting > the lack of ALLOW_MAKE_JOBS use. >=20 > Hmm. The ^C ended up with: >=20 > ^C[03:41:07] Error: Signal SIGINT caught, cleaning up and exiting > [main-amd64-bulk_a-default] [2023-09-04_17h49m28s] [sigint:] Queued: = 34588 Built: 4331 Failed: 12 Skipped: 303 Ignored: 335 Fetched: = 0 Tobuild: 29607 Time: 03:41:05 > [03:41:07] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-04_1= 7h49m28s > [03:41:19] [95] [00:06:59] Finished databases/php80-pdo_sqlite | = php80-pdo_sqlite-8.0.30: Failed: build-depends > [03:41:20] [60] [00:10:53] Finished www/php82-session | = php82-session-8.2.9: Success > [03:41:20] [19] [00:06:42] Finished databases/pecl-memcache@php80 | = php80-pecl-memcache-8.2: Failed: build-depends > [03:41:23] [62] [00:06:40] Finished = net-mgmt/icingaweb2-module-incubator@php81 | = icingaweb2-module-incubator-php81-0.20.0: Success > [03:41:24] Cleaning up > exit: cannot open ./var/run/116_nohang.pid: No such file or directory > exit: cannot open ./var/run/93_nohang.pid: No such file or directory >=20 > and JID 253's processes are stuck in the STOP state, along with the > related JID 0 processes. These are for x11-toolkits/libXaw . I do > not know how long it might have been stuck. >=20 > /usr/local/libexec/poudriere/sh -e /usr/local/share/poudriere/bulk.sh = -J128 -jmain-amd64-bulk_a -a >=20 > is stuck in killpg state: >=20 > 3896 101784 sh - mi_switch+0xbb = _sx_xlock_hard+0x3e1 killpg1+0x193 kern_kill+0x23c amd64_syscall+0x109 = fast_syscall_common+0xf8=20 >=20 > Most recent process birth time listed-first order for the STOP's: >=20 > 86826 634820 sh - mi_switch+0xbb = thread_suspend_switch+0xc3 cursig+0x7b9 ast_sig+0x1df ast_handler+0x88 = ast+0x20 doreti_ast+0x1c=20 > 86825 321240 sh - mi_switch+0xbb = thread_suspend_check+0x260 sig_intr+0x4c fork1+0x186 sys_fork+0x54 = amd64_syscall+0x109 fast_syscall_common+0xf8=20 > 86550 308525 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = pipe_read+0x420 dofileread+0x86 sys_read+0xbe amd64_syscall+0x109 = fast_syscall_common+0xf8=20 > 3998 637224 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 > 3976 298566 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 > 3974 309336 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 > 3962 577230 gmake - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 = fast_syscall_common+0xf8=20 > 3958 635598 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ > 0xf8=20 > 3915 668148 make - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ > 0xf8=20 > 3912 638108 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_wait_sig+0x9 _sleep+0x1e3 = kern_wait6+0x51c sys_wait4+0x7d amd64_syscall+0x109 fast_syscall_common+ > 0xf > 46142 212631 sh - mi_switch+0xbb = sleepq_catch_signals+0x2ab sleepq_timedwait_sig+0x12 = _cv_timedwait_sig_sbt+0x10c seltdwait+0x75 kern_select+0x95e = sys_select+0x57 amd64_syscall+0x109 fast_syscall_common+0xf8=20 So I tried 30 for per_txg_dirty_frees_percent for 2 contexts: autotrim on vs. autotrim off where there was 100 GiByte+ to delete after a poudriere bulk run. autotrim on: takes a fair time to delete even 1 GiByte of the 100+ = GiByte vs. autotrim off: takes less time to delete more. The difference is very visible via "gstat -spod" use. autotrim on likely makes things less concurrent, somewhat like USB3 storage having only one command to the device at a time for FreeBSD. autotrim on seems to prevent the larger unit of work from being an effective way to decrease the time required, instead possibly increasing the time requirement. That may be an example of the context dependendency for what value of per_txg_dirty_frees_percent to use to avoid wasting much time. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 08:33:13 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfzKs1pwZz4s6b4 for ; Tue, 5 Sep 2023 08:33:21 +0000 (UTC) (envelope-from madis555@hot.ee) Received: from SMTPOUT02.DKA.mailcore.net (smtpout02.dka.mailcore.net [81.7.169.175]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtpout02.dka.mailcore.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfzKq5754z3Bn4 for ; Tue, 5 Sep 2023 08:33:19 +0000 (UTC) (envelope-from madis555@hot.ee) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=online.ee header.s=mailcore header.b=waZ8QyMj; spf=pass (mx1.freebsd.org: domain of madis555@hot.ee designates 81.7.169.175 as permitted sender) smtp.mailfrom=madis555@hot.ee; dmarc=pass (policy=reject) header.from=hot.ee Received: from SMTP.DKA.mailcore.net (DKA-SMTP01.mailcore.local [10.1.0.51]) by SMTPOUT05.DKA.mailcore.net (Postfix) with ESMTP id 46BF3E0DEF for ; Tue, 5 Sep 2023 10:33:14 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=online.ee; s=mailcore; t=1693902794; bh=JV5sFdExZT6VYtXlEuBB/PxdzWt4CorFjmU5jQlwwHI=; h=In-Reply-To:References:From:Date:Subject:To:Cc:From; b=waZ8QyMjBYzUxmFWatTNpOX0iGY6p/d6GsZz6F2LpSGT05RfaTD9i19wgF5AYPs+L ky+xNqISjRMISsEiuDpBMmGTWuKhl5fE4nflndbYe8ecuiM5cr6UMJRHFP/vgg29VJ Me6QZxCIr4w5DVSPxEg0nVKvJrJ+esC8Th271v2NxrlRq/aBhpdLmHe8ZMdkF1gUc6 q+fiB3+rqlVtBu2p6OLcq1d40wYhiR7m/H/ChCgiFpwexqFCpDbR0O5JYxSYiN/fan xpCsmDPCAE456Jz+J7d2vvzz+Ks2NDnqAv5c0U9mOYj5IsrncsFKvT2re5KnNsf7iv agxHDhvxN9kMg== Received: from mail-pl1-f182.google.com (mail-pl1-f182.google.com [209.85.214.182]) by SMTP.DKA.mailcore.net (Postfix) with ESMTPSA id 6899B4015F for ; Tue, 5 Sep 2023 10:33:16 +0200 (CEST) Received: by mail-pl1-f182.google.com with SMTP id d9443c01a7336-1bc8a2f71eeso12882835ad.0 for ; Tue, 05 Sep 2023 01:33:16 -0700 (PDT) X-Gm-Message-State: AOJu0YzT2h4QOdOVriIXJn+zH1s7HxWHCUa+WuCyvEQK3dmP2wPX8zyB Fpm0VIyqI+tfD+i2ADpaBcCu3hm0qHLLpoJmXIU= X-Google-Smtp-Source: AGHT+IFLC2vZPTECAX/Fp9Sc7zbNY7AXWZN1QJYxcrC8LmLVQiGNlHJHyf/zEtGxGIlW+qCk9OAbfLGT0aXGB3JNw5Y= X-Received: by 2002:a17:90b:d94:b0:26b:e80:11de with SMTP id bg20-20020a17090b0d9400b0026b0e8011demr9077005pjb.25.1693902793869; Tue, 05 Sep 2023 01:33:13 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:a05:6a06:147:b0:624:beb4:2d with HTTP; Tue, 5 Sep 2023 01:33:13 -0700 (PDT) In-Reply-To: References: From: Sulev-Madis Silber Date: Tue, 5 Sep 2023 11:33:13 +0300 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Stray characters in command history To: bob prohaska Cc: "freebsd-current@freebsd.org" Content-Type: multipart/alternative; boundary="0000000000005010290604987af2" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.54 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.997]; NEURAL_HAM_SHORT(-0.55)[-0.545]; DMARC_POLICY_ALLOW(-0.50)[hot.ee,reject]; R_SPF_ALLOW(-0.20)[+ip4:81.7.169.128/25]; R_DKIM_ALLOW(-0.20)[online.ee:s=mailcore]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[209.85.214.182:received]; TO_DN_EQ_ADDR_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FREEMAIL_ENVFROM(0.00)[hot.ee]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[online.ee:+]; RCVD_COUNT_THREE(0.00)[4]; ASN(0.00)[asn:47292, ipnet:81.7.128.0/18, country:DK]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[hot.ee]; TO_DN_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4RfzKq5754z3Bn4 --0000000000005010290604987af2 Content-Type: text/plain; charset="UTF-8" i'm experiencing kind of similar issue. unsure why or how. i have 13.2. console is sc. the other side, via serial, is running current. uart is from usb serial adapter. other side has native soc uart. when i establish connection to that thing with cu, which is embedded board btw, and log in, i get weird random chars as if i've typed them in. if i do some input right after, i don't seem to get it. it gets worse, if i let cu run in other terminal and do some testing that involves lot of reboot cycles, while doing some tasks on other terminal, sometimes weird chars get injected into my input elsewhere. eg i run editor and it's annoying for something to appear as if i've typed it in. is it related? thankfully target isn't untrusted, otherwise it would be pretty bad? or where this thing even comes from? i know that you can do funny stuff with tiocsti and co but this looks pretty bad. both the fact that something makes it and the fact that they get injected elsewhere. there is also a some recent bug around this. so i'm not sure what to think of it all? On Sunday, May 21, 2023, bob prohaska wrote: > Here is another example, perhaps a bit clearer. > > The ssh connection to the first Pi3 in the chain had dropped, so it was > re-establishing via a regular user login, then su was invoked and tip run: > ..... > To change this login announcement, see motd(5). > Want to go the directory you were just in? > Type "cd -" > bob@pelorus:~ % su > Password: > # tip ucom > Stale lock on cuaU0 PID=2487... overriding. > connected > osed by r31 www s <<<< This appeared spontaneously, then I hit return. > osed: Command not found. <<<<< I didn't type anything. > bob@www:/usr/src % <<<<< The shell prompt on the 2nd Pi3's serial console. > .... > Clearly nothing to do with sshd, might it simply be a misdirected echo of console > output generated by a (dead or broken) tip connection? The first example looked > possibly malicious, this does not.... > > Thanks for reading, > > bob prohaska > > > > On Sun, May 21, 2023 at 06:49:33AM -0700, bob prohaska wrote: >> Lately I've been playing with buildworld on a Pi3 running -current. The same machine >> acts as a terminal server for a second Pi3 also running -current in my "cluster". >> I ssh into the first Pi3, su to root and run tip to pick up a serial connection to >> the second Pi's console. Both machines are within a week of up-to-date. >> >> While building world on the first Pi3 the ssh connection frequently drops and must be >> re-established. If there was a shell running on the serial console of the second >> Pi3 it typically keeps running and when the tip session is restarted disgorges a >> stream of accumulated console message. >> >> This morning the same thing happened, but I noticed something odd. The stream of >> messages (all login failure announcements from ssh) ended with >> >> .... >> May 21 06:15:00 www sshd[33562]: error: Fssh_kex_exchange_identification: banner line contains invalid characters >> *+May 21 06:15:19 www sshd[33565]: error: Fssh_kex_exchange_identification: Connection closed by remote host >> May 21 06:15:33 www sshd[33613]: error: Protocol major versions differ: 2 vs. 1 >> >> At that point I hit carriage return and got >> *+: No match. >> >> I did not type the *+ so it looks like the characters were somehow introduced elsewhere, >> possibly from the ssh failure message. How they got into the command stream is unclear. >> >> This strikes me as undesirable at best and possibly much worse. The shell reporting >> the "no match" was a regular user shell, but if I'd been su'd to root it appears that >> the unmatched characters would be seen by the root shell as input. >> >> This more-or-less fits with the pattern seen earlier with reboots observed via serial >> console halting on un-typed keystrokes. Those halts were attributed to electrical noise >> on the serial line, but this looks like something injected via part of the network >> login process. Reboot pauses have been an ongoing phenomenon for months, this is the >> first time I've noticed the "invalid characters" message from ssh on the console. >> >> Thanks for reading, apologies if I'm being a worrywart. >> >> bob prohaska >> >> >> > > --0000000000005010290604987af2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable i'm experiencing kind of similar issue. unsure why or how. i have 13.2.= console is sc. the other side, via serial, is running current. uart is fro= m usb serial adapter. other side has native soc uart. when i establish conn= ection to that thing with cu, which is embedded board btw, and log in, i ge= t weird random chars as if i've typed them in. if i do some input right= after, i don't seem to get it. it gets worse, if i let cu run in other= terminal and do some testing that involves lot of reboot cycles, while doi= ng some tasks on other terminal, sometimes weird chars get injected into my= input elsewhere. eg i run editor and it's annoying for something to ap= pear as if i've typed it in. is it related? thankfully target isn't= untrusted, otherwise it would be pretty bad? or where this thing even come= s from? i know that you can do funny stuff with tiocsti and co but this loo= ks pretty bad. both the fact that something makes it and the fact that they= get injected elsewhere. there is also a some recent bug around this. so i&= #39;m not sure what to think of it all?


On Sunday, May 21, 2023,= bob prohaska <fbsd@www.zefox.net<= /a>> wrote:
> Here is another example, perhaps a bit clearer.
&= gt;
> The ssh connection to the first Pi3 in the chain had dropped, s= o it was
> re-establishing via a regular user login, then su was invo= ked and tip run:
> .....
> To change this login announcement, s= ee motd(5).
> Want to go the directory you were just in?
> Type= "cd -"
> bob@pelorus:~ % su
> Password:
> # ti= p ucom
> Stale lock on cuaU0 PID=3D2487... overriding.
> connec= ted
> osed by r31 www s=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0<<<= <=C2=A0 This appeared spontaneously, then I hit return.
> osed: Co= mmand not found.=C2=A0 <<<<< I didn't type anything.
= > bob@www:/usr/src %=C2=A0 =C2=A0 =C2=A0 =C2=A0 <<<<< The= shell prompt on the 2nd Pi3's serial console.
> ....
> Cle= arly nothing to do with sshd, might it simply be a misdirected echo of cons= ole
> output generated by a (dead or broken) tip connection? The firs= t example looked
> possibly malicious, this does not....
>
&= gt; Thanks for reading,
>
> bob prohaska
>
>
>= ;
> On Sun, May 21, 2023 at 06:49:33AM -0700, bob prohaska wrote:
= >> Lately I've been playing with buildworld on a Pi3 running -cur= rent. The same machine
>> acts as a terminal server for a second P= i3 also running -current in my "cluster".
>> I ssh into = the first Pi3, su to root and run tip to pick up a serial connection to
= >> the second Pi's console. Both machines are within a week of up= -to-date.
>>
>> While building world on the first Pi3 the= ssh connection frequently drops and must be
>> re-established. If= there was a shell running on the serial console of the second
>> = Pi3 it typically keeps running and when the tip session is restarted disgor= ges a
>> stream of accumulated console message.
>>
>= ;> This morning the same thing happened, but I noticed something odd. Th= e stream of
>> messages (all login failure announcements from ssh)= ended with
>>
>> ....
>> May 21 06:15:00 www ss= hd[33562]: error: Fssh_kex_exchange_identification: banner line contains in= valid characters
>> *+May 21 06:15:19 www sshd[33565]: error: Fssh= _kex_exchange_identification: Connection closed by remote host
>> = May 21 06:15:33 www sshd[33613]: error: Protocol major versions differ: 2 v= s. 1
>>
>> At that point I hit carriage return and got>> *+: No match.
>>
>> I did not type the *+ so it= looks like the characters were somehow introduced elsewhere,
>> p= ossibly from the ssh failure message. How they got into the command stream = is unclear.
>>
>> This strikes me as undesirable at best = and possibly much worse. The shell reporting
>> the "no match= " was a regular user shell, but if I'd been su'd to root it ap= pears that
>> the unmatched characters would be seen by the root s= hell as input.
>>
>> This more-or-less fits with the patt= ern seen earlier with reboots observed via serial
>> console halti= ng on un-typed keystrokes. Those halts were attributed to electrical noise<= br>>> on the serial line, but this looks like something injected via = part of the network
>> login process. Reboot pauses have been an o= ngoing phenomenon for months, this is the
>> first time I've n= oticed the "invalid characters" message from ssh on the console.<= br>>>
>> Thanks for reading, apologies if I'm being a wo= rrywart.
>>
>> bob prohaska
>>
>>=C2=A0=
>>
>
> --0000000000005010290604987af2-- From nobody Tue Sep 5 08:39:27 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RfzSz1vDCz4s9V2 for ; Tue, 5 Sep 2023 08:39:31 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Received: from heemeyer.club (heemeyer.club [195.93.173.158]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RfzSy1nfvz3DZP for ; Tue, 5 Sep 2023 08:39:29 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of dchagin@heemeyer.club has no SPF policy when checking 195.93.173.158) smtp.mailfrom=dchagin@heemeyer.club; dmarc=none Received: from heemeyer.club (localhost [127.0.0.1]) by heemeyer.club (8.17.2/8.16.1) with ESMTP id 3858dR1b037698 for ; Tue, 5 Sep 2023 11:39:27 +0300 (MSK) (envelope-from dchagin@heemeyer.club) Received: (from dchagin@localhost) by heemeyer.club (8.17.2/8.16.1/Submit) id 3858dRId037697 for current@freebsd.org; Tue, 5 Sep 2023 11:39:27 +0300 (MSK) (envelope-from dchagin) Date: Tue, 5 Sep 2023 11:39:27 +0300 From: Dmitry Chagin To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> <7bp3nvxmtiotil6ea3mb3oxgcxcwo45l5ghbblzcuwfztpjztj@yh4b35gqqyrv> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7bp3nvxmtiotil6ea3mb3oxgcxcwo45l5ghbblzcuwfztpjztj@yh4b35gqqyrv> X-Spamd-Bar: / X-Spamd-Result: default: False [-0.72 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; NEURAL_HAM_SHORT(-0.92)[-0.921]; FORGED_SENDER(0.30)[dchagin@freebsd.org,dchagin@heemeyer.club]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:61400, ipnet:195.93.173.0/24, country:RU]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; R_SPF_NA(0.00)[no SPF record]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; FROM_NEQ_ENVFROM(0.00)[dchagin@freebsd.org,dchagin@heemeyer.club]; FREEFALL_USER(0.00)[dchagin]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Queue-Id: 4RfzSy1nfvz3DZP On Tue, Sep 05, 2023 at 07:52:52AM +0200, Felix Palmen wrote: > * Dmitry Chagin [20230904 21:49]: > > On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > > > I guess I'll now do a full rebuild of my linuxulator userspace branch on > > > a kernel with that patch, just to be sure it won't break anything else, > > > this will take a few hours, I will report back. So far looking really > > > good :) > > This completed while I was sleeping. No issues! > > With ~120 "Linux ports" building fine, using all sorts of tools (like > python and some tools from coreutils), I think it's fair to assume it's > all fixed now. > Thank you! From nobody Tue Sep 5 08:45:06 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rfzbm09XCz4sDLX for ; Tue, 5 Sep 2023 08:45:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rfzbl1lmjz3HPH for ; Tue, 5 Sep 2023 08:45:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ul67ek3K; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693903520; bh=EgqBk9IoFF/DKJsohcrIQO9rMyfVoVf/NtClzC7kf5o=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ul67ek3KRtOALjitMbqMIIDogqPtbyyNdnH/V93M6uxldDnCIzA3BeW1gx/X57Lj8A5Hu71edVQ2cKBEmJpo4O1segVeEr8DinYpx2UlUga6+Pi8NHdmWT9jywH4Ad+FHmrMUtuMyx2glLbjAAp7niFh21C4fMbmbBFpUmk1RYuy4qkw95AZrFmIFtlREHnophTgKI53rFAMmpr0HmxhFhxr6GLGeZF1oTQEP6thBhm8vLeMG2LXnjQrjWSv0ruQLOFoBV1bGks4pUASg7zDw0I0csza0a0ivDa2FgwZWWM3SFsObBxstsId+7V6FYRs92xVv2n1U1kgBHCJ92L7jw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693903520; bh=UEDlHAhZQrEikL7243hgIyixEEcYn3b+0kRqORXBD77=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=rniJHizu4wOwO7hg6edbwAVtB6LCMNK+pt/YT7imA/LQbTMbVk2vyH6m/cr7RUwpOuzt2NVcGibEjkRAgHanoD0UK5yDvUL7XYCmnM6GToZlgq8ObIl6hNV7sogCnJZOvPLOv0PLh+hVyf6pNzIaegkc2PtjWzYVfMvmMJPFGUyJ1IiCaMU3cGzN7J6rJzGCAtqar/7UQERlYFJJqfPomsUzTYncBXMpRh0RjRN79GXVLA6fjbgK1mD7BhPar9Pb35+xKTm7Nq/ol/3wDO1oK/AEFf/xNTsrrXwNfdVbmTS1qkG1R63BIaVH7UzoCp+wXgk0MAKQLVbRF48k2O3KBg== X-YMail-OSG: 4JAPaB0VM1lyLq92D9HUQd5vAHdtmoabBVpBmY5EbUTShs82xiH.3Et2N0c3SJI 5Kipx.Uas0.en0VUn4E3_hoT52x9.JRhAMfZLE2zbFV5jlYZ_RkMOz2FVv8wcvMnT7NjVYjHTqb3 4EVXLzDawDohq03k9kzR9Lt3CMh6TGZpACOWOzYMZBwBgo.QcGr5ZMdZCg25AY.evoEAePsuM2N5 .2XLK4ZpJZGHW2.mM6r7awuLifRwAVbunY8vqghR5RKCi8dK6e9TCIkKjBpUUh0ijYvHRvdjj2kE Nep37jqnbmWB_POBJyH9.Nhqmu4GpqpGqlRDn293KF15gAv7tS.fgKxzwSSKFZ.lMV7m9VL_gkrf Cry34VBseLHLl94eXSmQ5BuE9YogGFP83pzj9Peu9H0B.FdNH7lO9Q87Xwhp5HqBQA4PEbm6kXKR eNOrVLwyLpaaXeVUVpWVwzWXXZPgBqDoljDB9A8yzVcglWrJcF0P5xcoLoUv0nPtszLrSoouEu9f hIwLq7G4210eFJ1u4OY1sQGJAu_lmC08DOcRpuLwCVy9PVF0p1Cp_1C05ShSCbVTng60JKQlEEC0 vUi1ZeM59T7wEz84gMGMZlsfHTdzePjS_r0ulN3m4kLVOlFIMqoWD5wX5AHTn.8MC22w9H6XkYZX MXiaurISmHBbNxEPT9g4YGi.h0GSxo_NO7HBc6YalDzNctKf4O.bZiiAR.uAb_pplPN43GS6twAo ZB.n3AooXrmzotJAnWS.hiDfOS7kjb2H3Y8Sw8iekc5.3KvXOrtgTus7Diq8ElkaFv6zcYFVBSTD XvOy6XFUd9vslL5fSN1Q8yIf65jel0iIDAVj4UiXdgbRgnjYIOQZ0UXerN45n0XFtym1CKnFzEpF LXvzjgsJi0hFtoRkOPRgLQydJ97ZGzUdZ_VUC1nTXj.hv6Ws29X8AO74YKzrMlYdWPymGch.3rKH edC4O.sChKoZlohT1UhPPJRTsJOVkOWS2.uDeXHQDTOU9h92NOevwCmb1bwrWUcm0shQOQxws3bx 0MbDn4VfyHgh.EV3sck4bU5Y44XhU1HfH2hEtCs8eYTkWYE38x8m.IX3DWFnlYHZjWnMiloh4HVo xmqJhJyc8cc6V7TttAh2bPzfKURHcjwly.W0kogS0jk.Hsvo0hIUp82eSH9wL1yJ4iQZrt2Ci1Lk X3cVCB8CcetsNXDByliwqnT8izTqSwyTBz63YT1djn_27pWsr2scBBS1NEKpTOwnoanREw6st1i. 2Uprladkc2D3_FzTUyQ0QDgjgmUb5HOZnYH9kqt_jlmoUvcMZHI2ohewrbJPk9x45gLl8Uqtc7bS .Fgi4EC9IxXhFLfSs0jGz2gnW9jXKiSwCVpht_soDdef17hjfLM7YeJnEkzWt54qieImBSMeMUpS .2TRu97ZrOjs3_q91iSPZU52wl3c6pFQRDE83zGJ09vQFiqKDSxyaCy8Hv_7mSkGD6ehOLDgIoS0 iCw6KjG8jJukYgewA0lid1Uackh4F3aYG6amloFixjz_1cCIY0r.InxYDurGcxvwPvFOW9DCPGex BshfPPuVWG6Tz7HMPfje5UjcS9OCsLMbk20mbotqupOLf3SmvA4QyigPCV10EYDJPEIzaLkijy24 f8e9F.C.S.2glam21eESXyIrvUa5qjl.tipsFd3iSYk3iI.96npKLLAVuKgbkhWObdI2c3PyjiKz LnLxetKxDGM57RWh02rRhiQCKxMuWO74r.qoSKCDmCalwAe1FNEkrrRCxwZC7lfubPLSw5l3B71y ErrW651T6Jl90Ss1WeA2FL0JsR_fqKfv417lfG38p0gA4UTHxek8SX7Ly.JYaFR4y34wMEzj5Yfq 1mXpNh1nnSsrEVCWPK6FSs2PqEBBjv0J6rq8zbFeTU8yajD97iB61xsXOwoI79LXoRJyEzbYClmW PKHthp4utduLWo1ABC9F_BtwV9.PGUthfAauxVp.Kytm_9p53wsKyAWGJITeW9II9MkMbBTo7ma7 LCThyIXQv5B3zqQ56DD34R8An8PinqzXl7FocVKRnHLvwVAaM_WE8nwGO..nw8B8Ubxury6zeEG2 DEMPWs7UQT_yXfk9rjLEQ_duATh3A16hQUN_V4FacObOVAYFQRJ_WOwB2r6TxtU3Zlj7elIpH3Vt gOQXI0DJVd7W.mO9vTxqnziDHtB4jvQqdiRQWIWiNGOfZ7q4YZU_mjHoFPnfmY7QoiI3RuO.oIv0 mTGq2.ury30BeqwRKOfBZ8N0SjOJ4TK4epaZrA.BDU7XONPSBcaEcM0HSJMc4EYZ0Cz1YkONTi57 2 X-Sonic-MF: X-Sonic-ID: 3b2bdd08-0d69-4024-99cb-6989f536a881 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 08:45:20 +0000 Received: by hermes--production-ne1-7b767b77cc-27nt8 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1abcd3db18bf15272f64f101035350ae; Tue, 05 Sep 2023 08:45:18 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" possible file odd result From: Mark Millard In-Reply-To: <6990186B-E85B-4D64-8202-4B9ECBD876FD@yahoo.com> Date: Tue, 5 Sep 2023 01:45:06 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <28614E14-6C55-4183-9315-A098C392B3AC@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> <4E888EC8-4B06-4139-90DF-59AFBA700A5F@yahoo.com> <6990186B-E85B-4D64-8202-4B9ECBD876FD@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.48 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.979]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.65.84:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rfzbl1lmjz3HPH On Sep 5, 2023, at 00:00, Mark Millard wrote: > On Sep 4, 2023, at 22:06, Mark Millard wrote: >=20 >> . . . >=20 > So I tried 30 for per_txg_dirty_frees_percent for 2 contexts: > autotrim on > vs. > autotrim off >=20 > where there was 100 GiByte+ to delete after a poudriere > bulk run. >=20 > autotrim on: takes a fair time to delete even 1 GiByte of the 100+ = GiByte > vs. > autotrim off: takes less time to delete more. >=20 > The difference is very visible via "gstat -spod" use. >=20 > autotrim on likely makes things less concurrent, somewhat > like USB3 storage having only one command to the device > at a time for FreeBSD. autotrim on seems to prevent the > larger unit of work from being an effective way to > decrease the time required, instead possibly increasing > the time requirement. >=20 > That may be an example of the context dependendency for > what value of per_txg_dirty_frees_percent to use to > avoid wasting much time. Trying autotrim off with 30 for per_txg_dirty_frees_percent got me the oddity/extra-message (just using 32 builders to match the hardware thread count): . . . [00:03:25] [32] [00:00:00] Builder starting [00:03:43] [01] [00:00:18] Finished print/indexinfo | indexinfo-0.3.1: = Success [00:03:43] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 [00:05:20] [01] [00:01:37] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success 23/.p/cleaning/rdeps/gettext-runtime-0.22_1/chemtool-1.6.14_4 copy: open = failed: No such file or directory [00:05:23] [01] [00:00:00] Building devel/gmake | gmake-4.3_2 [00:05:55] [02] [00:02:30] Builder started . . . (Not that I know if the context actually matters and I have no clue if I'll ever get a repetition.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 09:08:02 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rg05x1fydz4sQNY for ; Tue, 5 Sep 2023 09:08:05 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Received: from heemeyer.club (heemeyer.club [195.93.173.158]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rg05w1mPPz3QhY for ; Tue, 5 Sep 2023 09:08:04 +0000 (UTC) (envelope-from dchagin@heemeyer.club) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of dchagin@heemeyer.club has no SPF policy when checking 195.93.173.158) smtp.mailfrom=dchagin@heemeyer.club; dmarc=none Received: from heemeyer.club (localhost [127.0.0.1]) by heemeyer.club (8.17.2/8.16.1) with ESMTP id 385982MW037865 for ; Tue, 5 Sep 2023 12:08:02 +0300 (MSK) (envelope-from dchagin@heemeyer.club) Received: (from dchagin@localhost) by heemeyer.club (8.17.2/8.16.1/Submit) id 385982Be037864 for current@freebsd.org; Tue, 5 Sep 2023 12:08:02 +0300 (MSK) (envelope-from dchagin) Date: Tue, 5 Sep 2023 12:08:02 +0300 From: Dmitry Chagin To: current@freebsd.org Subject: Re: Possible issue with linux xattr support? Message-ID: References: <52go6mhpf34em7x7llzh7dgtf7ggdd7n2wuofm2yrndiw73yqk@pgngyvdypvhd> <7bp3nvxmtiotil6ea3mb3oxgcxcwo45l5ghbblzcuwfztpjztj@yh4b35gqqyrv> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7bp3nvxmtiotil6ea3mb3oxgcxcwo45l5ghbblzcuwfztpjztj@yh4b35gqqyrv> X-Spamd-Bar: / X-Spamd-Result: default: False [-0.77 / 15.00]; AUTH_NA(1.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.972]; FORGED_SENDER(0.30)[dchagin@freebsd.org,dchagin@heemeyer.club]; MIME_GOOD(-0.10)[text/plain]; R_SPF_NA(0.00)[no SPF record]; R_DKIM_NA(0.00)[]; DMARC_NA(0.00)[freebsd.org]; MLMMJ_DEST(0.00)[current@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; TO_DOM_EQ_FROM_DOM(0.00)[]; BLOCKLISTDE_FAIL(0.00)[195.93.173.158:server fail]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[dchagin]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[dchagin@freebsd.org,dchagin@heemeyer.club]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:61400, ipnet:195.93.173.0/24, country:RU] X-Rspamd-Queue-Id: 4Rg05w1mPPz3QhY On Tue, Sep 05, 2023 at 07:52:52AM +0200, Felix Palmen wrote: > * Dmitry Chagin [20230904 21:49]: > > On Mon, Sep 04, 2023 at 08:43:02PM +0200, Felix Palmen wrote: > > > I guess I'll now do a full rebuild of my linuxulator userspace branch on > > > a kernel with that patch, just to be sure it won't break anything else, > > > this will take a few hours, I will report back. So far looking really > > > good :) > > This completed while I was sleeping. No issues! > > With ~120 "Linux ports" building fine, using all sorts of tools (like > python and some tools from coreutils), I think it's fair to assume it's > all fixed now. > 11e37048d > Cheers, Felix > > -- > Felix Palmen {private} felix@palmen-it.de > -- ports committer -- {web} http://palmen-it.de > {pgp public key} http://palmen-it.de/pub.txt > {pgp fingerprint} 6936 13D5 5BBF 4837 B212 3ACC 54AD E006 9879 F231 From nobody Tue Sep 5 14:07:39 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rg6lp1Fc7z4skjY; Tue, 5 Sep 2023 14:07:50 +0000 (UTC) (envelope-from jilles@stack.nl) Received: from mail02.stack.nl (scw01.stack.nl [51.15.111.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "ecc.stack.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rg6ln65sSz3dvy; Tue, 5 Sep 2023 14:07:49 +0000 (UTC) (envelope-from jilles@stack.nl) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost.localdomain [127.0.0.1]) by mail02.stack.nl (Postfix) with ESMTP id E61AC1E014B; Tue, 5 Sep 2023 14:07:41 +0000 (UTC) Received: from mail02.stack.nl ([127.0.0.1]) by localhost (mail02.stack.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1pY0ph7snvZD; Tue, 5 Sep 2023 14:07:39 +0000 (UTC) Received: from blade.stack.nl (blade.stack.nl [192.168.121.130]) by mail02.stack.nl (Postfix) with ESMTP id 356FE1E0149; Tue, 5 Sep 2023 14:07:39 +0000 (UTC) Received: by blade.stack.nl (Postfix, from userid 1677) id 1A7C2237C4D; Tue, 5 Sep 2023 16:07:39 +0200 (CEST) Date: Tue, 5 Sep 2023 16:07:39 +0200 From: Jilles Tjoelker To: Mark Millard Cc: Current FreeBSD , FreeBSD Mailing List , Bryan Drewery Subject: Re: FYI: ^T use during poudriere bulk vs. /bin/sh operation: I got a "Unsafe ckmalloc() call" Abort trap that left a mess Message-ID: <20230905140739.GA7298@stack.nl> References: <6B7D2081-B152-400F-A294-11F039077A9F.ref@yahoo.com> <6B7D2081-B152-400F-A294-11F039077A9F@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <6B7D2081-B152-400F-A294-11F039077A9F@yahoo.com> User-Agent: Mutt/1.9.4 (2018-02-28) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12876, ipnet:51.15.0.0/17, country:FR] X-Rspamd-Queue-Id: 4Rg6ln65sSz3dvy On Mon, Sep 04, 2023 at 05:16:56PM -0700, Mark Millard wrote: > During a (zfs based) poudriere bulk -a run a ^T got a: > Unsafe ckmalloc() call > Abort trap (core dumped) > My attribution to ^T handling is unverified: I did not find the > sh.core file. It is just what the timing looked like. The error message means that ckmalloc() is being called without INTOFF in effect, i.e. at the time a SIGINT may cause an EXINT exception (longjmp()). Although malloc(3)'s data structures could be protected by surrounding the malloc() call with INTOFF and INTON, this would lead to a memory leak if a SIGINT happened at that time, since the pointer to the allocated memory would be lost. This check was added in git commit 9f9c9549fd4f7ce362e95e3a8a50f00ffd00175c. My first guess would be that there is a bug with a rare edge case of traps and/or errors, such as not applying INTOFF again after an exception has turned it off or doing INTON when interrupts are already enabled. A less likely possibility could be a violation related to volatile and synchronization between a signal handler and the main flow. Many common code paths are all exercised by the tests and normal use, so it must be something special in some way. -- Jilles Tjoelker From nobody Tue Sep 5 17:07:07 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgBkv0Bx4z4s7CM for ; Tue, 5 Sep 2023 17:07:19 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lj1-x22d.google.com (mail-lj1-x22d.google.com [IPv6:2a00:1450:4864:20::22d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgBkt3x6Bz3DTZ for ; Tue, 5 Sep 2023 17:07:18 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lj1-x22d.google.com with SMTP id 38308e7fff4ca-2bb9a063f26so43329011fa.2 for ; Tue, 05 Sep 2023 10:07:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1693933637; x=1694538437; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=k593RO/L1xEPoGFc9X+frz5hKjdY9YgU4JEimIxWV8w=; b=vHB/KwEcpdMWtqMOE8KlgKID4T58JqADDejuGh5t/jBq5hmrTwH+f07M1DSXH0oJza AAUMyXMqcFX8gyWZ0yRGjI2Fxdv/Rq+tcCIzqNeYQ0ZrJfOQRMWWQQMBn5rDkxwCmTFR mVW1JSgIyTba8AK68clbHxdhMIdyq6qu3cOqLIrXiDOnSDIWoyiQ5yWxflA2pMOMoBHN fiFtyhtshsURhsi/uo/8KBVtvzIwsbjNv5PzdRTm0SS3h+7wGC8oDeiWP0DIlqD5k0Ey ZGAreFbVuVkHRvgmLjrNmz3AVgUViUE/Oywp/eU/n80h3s9+a82HtSdAlBjqGyj+4dMt hw8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693933637; x=1694538437; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=k593RO/L1xEPoGFc9X+frz5hKjdY9YgU4JEimIxWV8w=; b=XFijbir+hOYT7MUdMtrn+9skWig9GhHPdA7sUXOuTKfAk5kvazt/vCTD52+xFk02TF 8rKEl8ngzj4PkMqtcPbF22YRSOgPCtIHGWkanrS1EAIotFzyykmOU9Ip3ngCfOQYujY0 VHQoCJWXUVjTpX/sSPWlZ2BtMOoGM24tGmtlTzBGCwRLGimHkZYBxZTcOks4NMVUfyOv Xzx0DcsVCEmfKKZczswO9FgF6JyBxxXoWgx6h5qwpn9UwmC67WQGudkytBizkmoi7TFV qXhCGcjLRy1vuc/Ldk/UiCQW8HLBDF932xUekeQi/gjEmHKzKajquKcggqUhrCFC1AED TK9g== X-Gm-Message-State: AOJu0Yz6sX+ID6nLoCohgKT48X+hNXzeQIh9S2ZYiNr7fzmE1/K3x7yo pCWZ4paKkiaBRUON3949I2z1e2EDold4Xjc8G1rgtVNcdxKOyDW6 X-Google-Smtp-Source: AGHT+IEiYQ6W+srlsBfVx3QBRRvn54v5wrYOmPO/FDyShiSwckVT3Rzwv6dZn86c9p1vbSEyIceRxIoQsRpkDvhdrT8= X-Received: by 2002:a2e:7204:0:b0:2b9:20fe:4bc4 with SMTP id n4-20020a2e7204000000b002b920fe4bc4mr294969ljc.40.1693933636771; Tue, 05 Sep 2023 10:07:16 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> In-Reply-To: From: Warner Losh Date: Tue, 5 Sep 2023 11:07:07 -0600 Message-ID: Subject: Re: 14.0-CURRENT boots fine but keyboard does not work To: Matthias Apitz , Warner Losh , Michael Gmelin , Alexander Motin , FreeBSD Current Content-Type: multipart/alternative; boundary="000000000000b17bec06049fa8e3" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RgBkt3x6Bz3DTZ --000000000000b17bec06049fa8e3 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Sep 5, 2023 at 12:13=E2=80=AFAM Matthias Apitz w= rote: > El d=C3=ADa lunes, septiembre 04, 2023 a las 12:10:56p. m. -0600, Warner = Losh > escribi=C3=B3: > > > On Mon, Sep 4, 2023, 11:40 AM Michael Gmelin wrote= : > > > > > This could also be related: > > > > > > > > > > https://cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2= fee587aaf > > > > > > You could try to undo that patch and build a new kernel. > > > > > > > It shouldn't make a difference... but I may have been given bad advice = if > > it did... if it's this one, I'll help sort it out. > > > > Warner > > I've reverted the above change, compiled the kernel, copied it to the > USB key into /boot/kernel/kernel (only this file), removed > /boot/loader.conf and the keyboard is fine. Thanks, Michael. > > Warner, do you need a new PR for this? > No. Let's see if I can puzzle out what went awry here. First up: can you report what 'kenv' on a boot system returns? Warner --000000000000b17bec06049fa8e3 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Tue, Sep 5, 2023 at 12:13=E2=80=AF= AM Matthias Apitz <guru@unixarea.de<= /a>> wrote:
E= l d=C3=ADa lunes, septiembre 04, 2023 a las 12:10:56p. m. -0600, Warner Los= h escribi=C3=B3:

> On Mon, Sep 4, 2023, 11:40 AM Michael Gmelin <grembo@freebsd.org> wrote:
>
> > This could also be related:
> >
> >
> > https://= cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2fee587aaf<= /a>
> >
> > You could try to undo that patch and build a new kernel.
> >
>
> It shouldn't make a difference... but I may have been given bad ad= vice if
> it did... if it's this one, I'll help sort it out.
>
> Warner

I've reverted the above change, compiled the kernel, copied it to the USB key into /boot/kernel/kernel (only this file), removed
/boot/loader.conf and the keyboard is fine. Thanks, Michael.

Warner, do you need a new PR for this?

--000000000000b17bec06049fa8e3-- From nobody Tue Sep 5 17:36:49 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgCPJ4Bf6z4sNms for ; Tue, 5 Sep 2023 17:37:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgCPJ1D1cz3M4y for ; Tue, 5 Sep 2023 17:37:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693935425; bh=WizMlhbA8XmNvf+TVUUV6QvjrMPRw5nIVZYX6eVFDu4=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=MmW2HPbnOjHrbWleAMhPZ5cskSHz/1yNQASwW3Aj0RpLgXSLfBsxgg1NHPiYcX6oCnkExUBp8H9LmeiKDrhul0i5Amz7To/PXnSyLsgdwtjQTr3kPbyCZK4XFb0e0FjxSDjazpOG7rVG9Q3vVCFU8qf/LXfZQHv+gk7s1Dll+Bi6BuQiUz95IvDebJUhr17yJNSzqFDDRBdSOQmlLR+qfhy/mRFbjHOEy30mUFoye/gzG4eCxAiXq4kYk/j3hRD+1CD1yJKzr2oiJbIxlpqJzI738cAAHalFJhRjobTYS45UDlDQPa6WGtfNzluqFbwbrylTvrZtFFTx+iBsgkMQxA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693935425; bh=G5g+mGjVM9SO93/xK7USM6Dp59z5BN02gUOOPXSLXzB=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=S1bB4R2D9SBjiYdjF836xDxlCuMoa8s8LvK4oM4CwAM2V1BVGX4kmb/nMUXLy/fcl2eO9Mfq0zTcjYQDBYAcvKeJCVE3j4H57VYDYtvVAKp9b/5IzUgQ/0XLpUhsIOC0c81j40SFRKqwL5/SK3pgoWS22hKet+MOapSkDWJYy+uIiBG9rFMqtxdrvNyJQ3FXrfywSxNg8YU7v5s5Y1Iuhi2ZjujAbOdQR4fhqmXJns15iumnfXpUj74+pLd6PPclhGUTbqXFiWg2ZbQt0wTm2pxGFYGXZZCMiOCGQYXR5GPzQDYJEO4bWB82kwUtbeKHngMuqSXOIZBhdQ1gSLfikA== X-YMail-OSG: Nh1i.m4VM1lrJJ1nfrRZiVOy3x8HVK2kTJ8SQkG9HhtMj3W74uhAh5tO5EXqDJh hn62Vx7yJQwFAGzniUOQTBj2SEgQZ10BBr2NsAZ8fyNmPOojKR2EuRNXN.UcH5D_sraIxIl8g1Og U2oo.UD0uPnremwsgR41yRbfQVzgRuBAxN6UXDKpB0.ncB0XN2h0SVMi6ZEsdIgtihMnjLjTkJ5j k6p.VHAvFTzg8TD3oq0jOuS270eq_w9OCdAb9e7VfaKc1GdB_y0Ut4wdklfK.H30qsY9m2jLLNpX jo2c4ehr9etSErirfAOJKNO.CTJIYAryfyhhJy1fCXwDCNriWFE0BiC7zBTECgYQ.jKFJGeO1zcq FGLw4kj_f56AD3FSB2cHdu3WZSbD0IPS9xBIgcwxH4ZfDEIL2nFI_GstON.OzBF3qxwaZX_AKFUR 8aJfRMv6.XPgAJV.sG90UFD0bL7VJW5QdKxNZVWhXWc1qrsf2_MzfYt73s2E_V3spZfhsoWlZEcK Ls11_HwotjJoe2aDbUj1KYpaqLHr28FjKibxqTglTnFj53C1t8PFZKPKg0C.a4tw3RIoDNoZEEp8 lejKHIrNVLExLdhr_Bvt5_PE8Ae.mf3X6XyOLU2z3pd6puUHJtZv54KE84cDilNG0Befl0XqsSAg IbpubTxIUnn37ho8ykRtMp9n7s0P2.GYOYFfTB5HuyEg4ywpj3Lw4191S1SPvRB8xw_4ug5hZbdR sGAW8ZX4_BeGt2Xzz_xHNP1a8t9w4.4kUJOYOn2Vw5t9oEZ90lb2vgQPBLjoA3H8ONKJu9d4k4iH Kbj5TbRxdlzQ15.HqiXtHX6yNhI5D0oAl2PwXXgUy0zo74uPAITVGKZwD1GHb1hPoq7QbsEzBqQ. Gqa5xgWiH_l9Xz.SHHEnoNww8b47G9TQdfEnB9h9WyFKTEabfJNQPzyeu.okLUx4myNe1gxud7GQ nb1EgIMBOATO9jIIGDAqvaDsDWXv94EqG1CQWnQYGmQw2NgScZ1a0k3QU7Vr2dUwNPMuqCcyDjAB FXgTRMfmGhA3_9zFx5rhzwFo01WHbtN_H3zB5a2UNXg55RqrzOrL8M.p9B6QTFcL0NurYP6.rALD 3jGPzmz2wsgVfEU1YZIRAciRl9N.Tdky0_YdnVUKpfKmzfeQfEYy81pxizEy9uGR4CIi4tH8OcEW 9uEZWIzSGOpGGn1D6HWLjb4taTesyIp3QH.2kcuClhsk63nOD9YUsvWMKiMfkXJoDgj01u0mEIg0 mSSdoUNL3k_3XRsfx3mRdEIdI_8FsDFP8BY60_CmaoPxGN4eOxH5ZuT7MewHtIRhJsCXXSTd_lP6 QXBK3tHXfZ7KA4pYKAwgRi_mLDWE3kRnKpzvnr_FlULVI.uAOTufjcUSyXvDD9psUR68IpKJQ9vZ UCAcB7.b8TFSN3oA.iRZisniJZNP2RcPYQCJN15eNQWdUQZ24caeOerSv87xiaCNPFtP8n5B3Er5 GyJYr_KdIIQnmn3MFCPZUbGaE4wnc5To8BDfQapvfo9PRG.D3sFXbDJXx_Syde67QHbXKotmazRc EbLzwHxsgZde5XqhI5TSZtbQJgZpWue8Z6hqAvw6bYS7yJDiWi_ukjal_Y9e9gYV56mzumU80NoJ QuJ1hBxpQW9_kdEHJcrdFEPmE914BH_OpfFlUmB1iA1VfE6VVGaJgV0SthbMUgUUWVfG2WK0ZRj. JBG4lNyb8Lhkc8_fRSr5RBAbaidmhH_XIYTa7w6HP68OZnCzAs8TTuzZVMbdq98f.tUSqbW_yerC hnCEmjIIcRRYVurkuYQavUbdsTUhiD87akl9yRWWSV0ypwILsdLeLPNT0j0DQlO_dv7zXcdnDk40 4FlcgjCE5dCTpl25UNbvz8uYOYzDDtlF.HnuCSixW6.r2yJWeozd92eIoe_fz7fx36rhQS8J_V8z 7NyAkFWqcQquBtBlGZpzOZdwV7zrbdPEeY5tgLiOJ2cgBwNWbxJjpjTRrZNpMSm1iwkKJ8MW0irO jyt0SVHdQNtvoMjYmEGhvS6RMu9Yo42QDQCmzL1AY_pcYDvo.fM3bAkQktgPjCEVJF6HhG3lQb8V f41MiMB3CiOuZj.caW2znV.5UxUiV9oI5jAlImvojPw4ZTY_A7snoXmKUUWdTCoM7uUEfQUSbdni OcNplOtQKW14hWUMBBb8.oS_IaRHb1x9JY.MHHTBpcx2f9HSIP.mB6IgDa2igLEx83nNpZdiZeMu RX.Ju2rs6GYz51VL_LA9dDVillcTwpwOee25t_iNWKKUdpUglTiVZUlbUxYYUy85nuCEN.pRSwup 2sgZv8M9UqMyR X-Sonic-MF: X-Sonic-ID: 42a91997-168d-4032-9144-e546820e5c76 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 17:37:05 +0000 Received: by hermes--production-bf1-865889d799-7vf9r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 500fd4fe3208a4db60ddc2bdb0062e20; Tue, 05 Sep 2023 17:37:02 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Possible regression in main causing poor performance From: Mark Millard In-Reply-To: <20230905155812.D746B71@slippy.cwsent.com> Date: Tue, 5 Sep 2023 10:36:49 -0700 Cc: Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arch , Martin Matuska Content-Transfer-Encoding: quoted-printable Message-Id: References: <8A267B4A-1B7B-4D61-AA57-8E3156470617@yahoo.com> <1B47E578-693D-4690-A577-947E8C9140B5@yahoo.com> <1C3E6B34-2937-46C6-862E-5B988B8A3A43@yahoo.com> <20230830184426.GM1219@FreeBSD.org> <20230830204406.24FDC7E@slippy.cwsent.com> <20230905155812.D746B71@slippy.cwsent.com> To: Cy Schubert , Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RgCPJ1D1cz3M4y On Sep 5, 2023, at 08:58, Cy Schubert wrote: > In message <20230830204406.24FDC7E@slippy.cwsent.com>, Cy Schubert = writes: >> In message <20230830184426.GM1219@FreeBSD.org>, Glen Barber writes: >>>=20 >>>=20 >>> On Mon, Aug 28, 2023 at 06:06:09PM -0700, Mark Millard wrote: >>>> Has any more been learned about this? Is it still an issue? >>>> =3D20 >>>=20 >>> I rebooted the machine before the ALPHA3 builds with no other = changes, >>> and the overall times for 14.x builds went back to normal. I do not >>> like to experiment with builders during a release cycle, but as we = are >>> going to have 15.x snapshots available moving forward, I will not = reboot >>> that machine next week in hopes to get some useful data. >>>=20 >>> If my memory serves correctly, mm@ has a pending ZFS import from >>> upstream for both main and stable/14 pending. Whether or not that = will >>> resolve any issue here, I do not know. >>=20 >> Two of my poudriere builder machines have experienced different = panics=20 >> since the ZFS import two days ago. The problems have been documented = on the=20 >> -current list. >=20 > Just an update. >=20 > The three pull requests amotin@ pointed to did resolve all my = problems. A=20 > subsequent update which included the latest ZFS commits worked just as=20= > well, without any new regressions. AFAIAC this problem has been = resolved. >=20 > The random email corruptions have also been resolved. >=20 >=20 > --=20 > Cheers, > Cy Schubert > FreeBSD UNIX: Web: https://FreeBSD.org > NTP: Web: https://nwtime.org >=20 > e^(i*pi)+1=3D0 >=20 >=20 >=20 >=20 > =C2=9C9O8 The just-above quoted line looks like a corruption to me. Otherwise, I'm just reporting more evidence from separate testing on amd64 . . . I will say that my separate-install/boot environment 10hr, 6366 port->package poudriere bulk -a prefix test of: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #118 = main-n265152-f49d6f583e9d-dirty: Mon Sep 4 14:26:56 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.a= md64/sys/GENERIC-NODBG amd64 amd64 1500000 1500000 did not show any deadlocks. The only oddity that I've noticed is the 1 extra message shown in: . . . [00:03:25] [32] [00:00:00] Builder starting [00:03:43] [01] [00:00:18] Finished print/indexinfo | indexinfo-0.3.1: = Success [00:03:43] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 [00:05:20] [01] [00:01:37] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success 23/.p/cleaning/rdeps/gettext-runtime-0.22_1/chemtool-1.6.14_4 copy: open = failed: No such file or directory [00:05:23] [01] [00:00:00] Building devel/gmake | gmake-4.3_2 [00:05:55] [02] [00:02:30] Builder started . . . I'm comfortable moving my normal environments forward to include this latest import of openzfs. The effort established a separate environment set up for doing testing of jumping to/past an openzfs import(s) in main. Too many recent imports have dangerous-to-the-file-system and/or had deadlocking issues for me to simply update to include them without first testing on separate media that does not have to stay operational. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 17:55:33 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgCpd66MBz4sXgN; Tue, 5 Sep 2023 17:55:37 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from omta001.cacentral1.a.cloudfilter.net (omta001.cacentral1.a.cloudfilter.net [3.97.99.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgCpd3rCfz3TSw; Tue, 5 Sep 2023 17:55:37 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Authentication-Results: mx1.freebsd.org; none Received: from shw-obgw-4002a.ext.cloudfilter.net ([10.228.9.250]) by cmsmtp with ESMTP id dY0fqQ9DcLAoIdaH1qWzl3; Tue, 05 Sep 2023 17:55:35 +0000 Received: from spqr.komquats.com ([70.66.152.170]) by cmsmtp with ESMTPA id daGzqMvznyAOedaH0qdblx; Tue, 05 Sep 2023 17:55:35 +0000 X-Authority-Analysis: v=2.4 cv=e5oV9Il/ c=1 sm=1 tr=0 ts=64f76b97 a=y8EK/9tc/U6QY+pUhnbtgQ==:117 a=y8EK/9tc/U6QY+pUhnbtgQ==:17 a=kj9zAlcOel0A:10 a=zNV7Rl7Rt7sA:10 a=CjxXgO3LAAAA:8 a=YxBL1-UpAAAA:8 a=VxmjJ2MpAAAA:8 a=6I5d2MoRAAAA:8 a=EkcXrb_YAAAA:8 a=3rs0Dif0S-5JwpwNab0A:9 a=CjuIK1q_8ugA:10 a=UJ0tAi3fqDAA:10 a=26XcPLqRqocA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=7gXAzLPJhVmCkEl4_tsf:22 a=IjZwj45LgO3ly-622nXo:22 a=LK5xJRSDVpKd5WXXoEvA:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTP id 7F9C7350; Tue, 5 Sep 2023 10:55:33 -0700 (PDT) Received: by slippy.cwsent.com (Postfix, from userid 1000) id 7589E1A8; Tue, 5 Sep 2023 10:55:33 -0700 (PDT) X-Mailer: exmh version 2.9.0 11/07/2018 with nmh-1.8+dev Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: Mark Millard cc: Cy Schubert , Alexander Motin , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arch , Martin Matuska Subject: Re: Possible regression in main causing poor performance In-reply-to: References: <8A267B4A-1B7B-4D61-AA57-8E3156470617@yahoo.com> <1B47E578-693D-4690-A577-947E8C9140B5@yahoo.com> <1C3E6B34-2937-46C6-862E-5B988B8A3A43@yahoo.com> <20230830184426.GM1219@FreeBSD.org> <20230830204406.24FDC7E@slippy.cwsent.com> <20230905155812.D746B71@slippy.cwsent.com> Comments: In-reply-to Mark Millard message dated "Tue, 05 Sep 2023 10:36:49 -0700." List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Tue, 05 Sep 2023 10:55:33 -0700 Message-Id: <20230905175533.7589E1A8@slippy.cwsent.com> X-CMAE-Envelope: MS4xfMFnni6gXWmeGiOT8uBYC/30mLL7MIb0STyhxhMf+Dzs/JF0ePlmym7eSlnpOSMnTB3r8RtCkqJ6r+mZJqmMjtlKLOL2KZKr3pSAJ+aYQRdKb8DLSHk9 HIfq/R2axOlQ3pBETDstKv/W9nY1pLC24iSJ7nUXNTlPKjOkYO4u8L08a3SJzJSbdp8cpQlfFrh9njfgwzgRdEB4ktlO5MnMGJlaPK2PQxpEYpJ9f7ZTGe9r hX/Y0mlfkBgJqKGp5uWzjSaS3TvyT4uuE8tF43cD2hhyrE4xwVxzIVsIChO2WMuDaKN/pnZuK92xTHVYfpg4YA/CBl9xGsmhNPEIvFHt0bsF5vteeSptQsoq h/X3CNC9dajejmmWYtCyOiPZ3gB9OhyYhfFxKU+qBFUcN2xJVhg= X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16509, ipnet:3.96.0.0/15, country:US] X-Rspamd-Queue-Id: 4RgCpd3rCfz3TSw In message , Mark Millard write s: > On Sep 5, 2023, at 08:58, Cy Schubert wrote: > > > In message <20230830204406.24FDC7E@slippy.cwsent.com>, Cy Schubert = > writes: > >> In message <20230830184426.GM1219@FreeBSD.org>, Glen Barber writes: > >>>=20 > >>>=20 > >>> On Mon, Aug 28, 2023 at 06:06:09PM -0700, Mark Millard wrote: > >>>> Has any more been learned about this? Is it still an issue? > >>>> =3D20 > >>>=20 > >>> I rebooted the machine before the ALPHA3 builds with no other = > changes, > >>> and the overall times for 14.x builds went back to normal. I do not > >>> like to experiment with builders during a release cycle, but as we = > are > >>> going to have 15.x snapshots available moving forward, I will not = > reboot > >>> that machine next week in hopes to get some useful data. > >>>=20 > >>> If my memory serves correctly, mm@ has a pending ZFS import from > >>> upstream for both main and stable/14 pending. Whether or not that = > will > >>> resolve any issue here, I do not know. > >>=20 > >> Two of my poudriere builder machines have experienced different = > panics=20 > >> since the ZFS import two days ago. The problems have been documented = > on the=20 > >> -current list. > >=20 > > Just an update. > >=20 > > The three pull requests amotin@ pointed to did resolve all my = > problems. A=20 > > subsequent update which included the latest ZFS commits worked just as=20= > > > well, without any new regressions. AFAIAC this problem has been = > resolved. > >=20 > > The random email corruptions have also been resolved. > >=20 > >=20 > > --=20 > > Cheers, > > Cy Schubert > > FreeBSD UNIX: Web: https://FreeBSD.org > > NTP: Web: https://nwtime.org > >=20 > > e^(i*pi)+1=3D0 > >=20 > >=20 > >=20 > >=20 > > =C2=9C9O8 > > The just-above quoted line looks like a corruption to me. > Hmm. Just to rule out that a build of the exmh2 and nmh-devel packages might have been corrupt, I've rebuilt the two and will continue to monitor. This email was sent by a rebuilt exmh2 and nmh-devel. -- Cheers, Cy Schubert FreeBSD UNIX: Web: https://FreeBSD.org NTP: Web: https://nwtime.org e^(i*pi)+1=0 From nobody Tue Sep 5 17:56:55 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgCrK4d80z4sYX9 for ; Tue, 5 Sep 2023 17:57:05 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgCrK2zFwz3XLK; Tue, 5 Sep 2023 17:57:05 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [80.187.119.39] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdaIL-00246h-Fk; Tue, 05 Sep 2023 19:56:57 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 385HutaN002530 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 5 Sep 2023 19:56:56 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 385HutYR002529; Tue, 5 Sep 2023 19:56:55 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Tue, 5 Sep 2023 19:56:55 +0200 From: Matthias Apitz To: Warner Losh Cc: Michael Gmelin , Alexander Motin , FreeBSD Current Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Warner Losh , Michael Gmelin , Alexander Motin , FreeBSD Current References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="QRYYqNADgBbPLQ9f" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 80.187.119.39 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4RgCrK2zFwz3XLK --QRYYqNADgBbPLQ9f Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit El día martes, septiembre 05, 2023 a las 11:07:07a. m. -0600, Warner Losh escribió: > > https://cgit.freebsd.org/src/commit/?id=319d2bf407b3762da6f1c67ffe8dce2fee587aaf > > > > > > > > You could try to undo that patch and build a new kernel. > > > > > > > ... > > No. Let's see if I can puzzle out what went awry here. > > First up: can you report what 'kenv' on a boot system returns? Please find attached the output of kenv matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub --QRYYqNADgBbPLQ9f Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="kenv.out" COLUMNS="80" LINES="25" acpi.oem="CORE " acpi.revision="2" acpi.rsdp="0x000fdbb0" acpi.rsdt="0x7bf84030" acpi.xsdt="0x000000007bf840e0" acpi.xsdt_length="36" acpi_dsdt_load="NO" acpi_dsdt_name="/boot/acpi_dsdt.aml" acpi_dsdt_type="acpi_dsdt" acpi_video_load="NO" audit_event_load="NO" audit_event_name="/etc/security/audit_event" audit_event_type="etc_security_audit_event" bitmap_load="NO" bitmap_name="splash.bmp" bitmap_type="splash_image_data" bootenv_autolist="YES" bootfile="kernel" comconsole_pcidev="" comconsole_port="1016" comconsole_speed="9600" console="vidconsole" cpu_microcode_load="NO" cpu_microcode_name="/boot/firmware/ucode.bin" cpu_microcode_type="cpu_microcode" currdev="disk0s2a:" efi_max_resolution="1x1" entropy_cache_load="YES" entropy_cache_name="/boot/entropy" entropy_cache_type="boot_entropy_cache" entropy_efi_seed="YES" hostuuid_load="YES" hostuuid_name="/etc/hostid" hostuuid_type="hostuuid" kernel="kernel" kernel_options="" kernel_path="/boot/kernel" kernelname="/boot/kernel/kernel" kernels_autodetect="YES" loaddev="disk0s2a:" loader_conf_dirs="/boot/loader.conf.d" module_blacklist="drm drm2 radeonkms i915kms amdgpu" module_path="/boot/kernel;/boot/modules;/boot/dtb;/boot/dtb/overlays" module_verbose="2" nextboot_conf="/boot/nextboot.conf" pcibios.config1="1" pcibios.config2="0" pcibios.major="2" pcibios.maxbus="1" pcibios.minor="0" ram_blacklist_load="NO" ram_blacklist_name="/boot/blacklist.txt" ram_blacklist_type="ram_blacklist" screen.font="8x16" screen.textmode="1" screensave_load="NO" screensave_name="green_saver" script.lang="lua" smbios.bios.reldate="08/13/2014" smbios.bios.revision="4.0" smbios.bios.vendor="coreboot" smbios.bios.version=" " smbios.chassis.maker="Acer" smbios.chassis.type="Desktop" smbios.system.maker="Acer" smbios.system.product="Peppy" smbios.system.serial="123456789" smbios.system.version="1.0" smbios.version="2.7" splash_bmp_load="NO" splash_pcx_load="NO" splash_txt_load="NO" teken.bg_color="0" teken.fg_color="7" twiddle_divisor="16" vbe_max_resolution="" verbose_loading="NO" vesa_load="NO" vfs.root.mountfrom="ufs:/dev/ufs/FreeBSD_Install" vfs.root.mountfrom.options="rw,noatime" dev.ax.sph_enable="1" --QRYYqNADgBbPLQ9f-- From nobody Tue Sep 5 18:13:43 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgDCx30Mvz4shTK for ; Tue, 5 Sep 2023 18:14:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgDCw1fFDz3dhk for ; Tue, 5 Sep 2023 18:14:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Aphb3V11; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693937642; bh=bK5YbA9fY0FnlE5hU8xOHJP+HlR3hDaLwvWGihi+X0Y=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Aphb3V11iPviQlFkDU33bm6r4Q+1pyr/FE+Hjv/fUrY6PZAdvPmJfOAa+d34olUnHyiuYX9hBmboUlxs8Bmj+SPeiFpfZY8BGE8U/txaWSjFP5DKpbTcuseoPLCHnobYboXzhzcfkVBkNn9+oc+dJXdepGxUiVTdxfP7ZYD69z7SAccHJiLdMEVEOfdnNZHZEYFTvHdvMzZpO9b3SkaYz8AnAzdVD9PvrJXFA/hkava4bUi1oksOZHaxWlCB8s4Va0GyHUaGyYTrSfBl0Zqq2bNTxCKR8oFkQJIJ5aFvJDzB/7nE9u6j/JqX7aPEmC4OQiHptQnLS9hankkx4fCuzQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693937642; bh=7EgNkSnxaslDmGnukWcV7GKVDaYZyID/BpGT8tQw5/k=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=rB31uTUbvDQXpwGYnPe8g/6uvDn+qfwbcxwzb7QdMm7BBddaMWbTYfsc2Py3xbU+6e+3G5d/4GeHi3AnhenX6g/xetxjj1wVTrgBXWQrQSaOHOSLJZ4WpjfD5PXswCz0RdOcjk7lkLtFR1R3joxd5+CNNEmYHTCRhHhNt+pDaift7B9B+KtQy5E5EnaPAEwi31AKJgEEAlcg2gj/q4+xVoLx34Hy9dSYdY10lA/J+DfFjnr6FF9RFntbc5gOzqkczZ9zDZXW1wsM78gTl/gsQTv8pezINWTm6lsvFHcl3vlgHQSNAtWKxInVw8vz58I5gN4XZUz+/xWY7Mvz57NzgA== X-YMail-OSG: mljiUMgVM1k15KMLN335gwn0JKTs9heo_LTG9EZ5nDvjsJ2WlZv5T8qO1FqlJ5h f0wO5Ay2ai5mkeCw8lRXt9Vw3slJRCCvnl4DhWxdQ6ivYnn0mQiWZ2HVpk.UYmFVKyUANMIMt_zX JAdIQUbo7joV8FZ4Sy26rczK2AxOQHq2xckrovRTW_Zr5p3gqnz43WDzvJDYUaIv72ewAlM3ektM _Jdz9VMqHe4i3g4ijxUYZK7dCmCuEw7S63xw3YWbaFNjNe5KLkTwScLh0K9.DRv25Ot_NqHwbSI. DKCH_2xYwZces9_M7mXIFjaTYbT1f8H_hOQyoz8dAgnXQujAZKpnP3a30Qil_nBXOHpul.aWUmF7 3n7TIhHmOn51y431w.TT4yluMlZ6Jk40_qtBh_9GDAewHzFSzoBKQDJpTNrUiv1zEuoLzrb12_Lv GojDthUjliMujFVhtn6PpTEqniW_ZZOtnrMhCTEOOIPRQ.IG0x_vJrvM.iRZSLAKjYBCwSiIP2yJ 2vKSkI5QIZrd6yBe5nGmmy5Ess7PCagagtoJ8jXxOiSRiohDegZz0lFVsnnZx6JwTwVcGrarW3Hw YEW0nzVXTDuD65hxpRXxet7_7qVlDC3UuMmK5PXPGPX3d_wnusyrkXkofDfERCecHa5ypca.ScNe 2.gN7WAgFaNBaDa.ewF59.8TDQtxB0Pql.1CpK5cj9y7w722Mg3eQAdfpiQKEVlCKDmxdKANvqge YiFpEZSIGL79fIPaGx337tBz0BMzg4s.sJI1ReQ7P5SrwuP65azLpvx1_gjzc_Jz3Qu8_HMYzRr9 6ZX8QucgOTjab9M5BiBzIdYzzdepoGceU7nxPO1sX5Kce0H8Ec_3L.BmGaSZInvrbz7xBrvSVMQh iGCKGit7HcyapwAS1yYGkrglZcRqYuDpXozB365_kUIbwRbaE.gFvqfVnyO.JSXkya0Wk57551Dt C.dSMCWHLnlskAplFnCHhPPr6XwJEI5Kk.fuBSGOjbP5qcIW1xfVDHfd6oiCljwS6rT3AsmMTA8B 0ii_jTRMoPjZx4E4AqUoH4ETjQ38.PcMgr0jQptGK8iBDf8Eau5er0aE9NSxdsU73Tpbz_uq3mza Df7npTG1Gwzc6Z1Zqbk1ODSupoAcqkcyEhWtv5obVrpdNPlDTTSsKye5muDzJfrxwEOKxzsxPeNI b8IlWM1jAf..aSocjWrhAEGKioDVLRifLyOatAJAFxNNv7iLdEcqvmjkE2uhrzAYnmAUexRJ7VmC pEomw3QurZkObohO9nPIKHhdHsJ_Ia0OwgF5Y91bF8YyphnNp4sAcYaTLIiSKlsc.GNh3u5GTVnS AmGJgD5MwrW9nCTIr96U_Z.0Qf9yg.mZu7CpDw.XaLnZUcYhdf0XPHzKJ8gesGfopA2Gt4XCjvvW qnml7uKToULQNu2WK6d7x9vdCOC27z9Qd5Ko8Lr5.adLpyXOYer5hQU8djvZ6gbb4FxMu.SJI3Z1 U.TigBtw7elRNYLUnGjGVtDgzjEUzKtt0aHyqwMDA0epf4ix0nWS7mePrMuK42teIhg.MVVNSIMR dnjQzOQgjx5AqKVbG_SDZE5Q3FfQm.tl7Bc2_SmEla29SiZvBi3nPd1QaFH6tfaMpSZqmQ4mBl.Q gFP_iDWEUaGeTbZD1z4UL5Yd0xS.hjieZZ2pH4CQwo5ThMNpapVSP84Y1fWCAWwZDA1uFJ4GnDzH iyHK0we5Pe1d5FFrCgEueP4QowH1AYK6jscs1J2Lku5iBgwlCoWBeEYzv2qFyZwENqy8rQw4FgdO FanFc2Vl8IeMGNrK8t5l1ZpAzJmf0v.9HprH.z7y3ysr7FpHXXKe6YhbsQOwIK4sGGzaUl2OzUd7 ufbjzsbYvQkMpmE8BW5gYTHWazG3Tmlz0gqC4nZoa.uYXnKXGGVZC56jmkG.Uxq78QcIFTPpBk3f yJR2clmp0FQPh4CrSF8G.M9E7Ti.0xcwOMx8mtjzDu1eK7bKsH9_W9fr9ZbVLU.habQIb.M3hsTE 0ktGkysue2WO2v7fwDzR5__f2a_McTLfil_xNBJLRoo3PvM667K6FwWh8IIICT3gHStu_4wJUJdK ckCaD16VxPgkhoyFeIjv2Z6DkhyzKJM_Sueip8TdGfeKrLUC4yc4oVFze9NE_Y0MnViNaYlGYfuc eeHYfnaWAAP0953CoI3tmLdcetvJLyb0tCEfbR8u21RuX6bU26XfsYNExZS0ms4CY2VFE_8UKyMf xb7SLjeAh5oz2vZ0S5.lDqJNvi24l3oM6OQBIpS5rdU06kYtzIi0cXl3R5N2GoXMXTP4_QOsdVpm c X-Sonic-MF: X-Sonic-ID: 8414f0fe-f7ea-4da1-b92d-d7f069140a72 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Tue, 5 Sep 2023 18:14:02 +0000 Received: by hermes--production-ne1-7b767b77cc-84nnk (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 5a4ca8194b93390995b68eadfb6e18b4; Tue, 05 Sep 2023 18:13:56 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: An attempted test of main's "git: 2ad756a6bbb3" "merge openzfs/zfs@95f71c019" possible file odd result From: Mark Millard In-Reply-To: <28614E14-6C55-4183-9315-A098C392B3AC@yahoo.com> Date: Tue, 5 Sep 2023 11:13:43 -0700 Cc: dev-commits-src-main@freebsd.org, Current FreeBSD Content-Transfer-Encoding: 7bit Message-Id: <6A693136-8F3B-482D-A8B3-4179683061D6@yahoo.com> References: <673A446E-6F94-451E-910F-079F678C5289@yahoo.com> <2BDD30B5-6248-4EC3-83C8-0499E0717D1D@yahoo.com> <69028684-c2cd-8f0c-617f-d0763c08dbe4@FreeBSD.org> <8D832756-6754-4D1E-AE8D-E716FE08F747@yahoo.com> <5605506b-5059-fb72-3e5a-741863d54444@FreeBSD.org> <5724006A-F4C4-42CA-98A9-90C5EB914F5E@yahoo.com> <4E888EC8-4B06-4139-90DF-59AFBA700A5F@yahoo.com> <6990186B-E85B-4D64-8202-4B9ECBD876FD@yahoo.com> <28614E14-6C55-4183-9315-A098C392B3AC@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.38 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.88)[-0.879]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.83:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.83:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RgDCw1fFDz3dhk Just FYI: For the specific machine/storage media combination used for the openzfs import testing, the following combination seemed to work well relative to the subject of the "odd result": A) /etc/sysctl.conf having "vfs.zfs.per_txg_dirty_frees_percent=30" B) autotrim off but use of "zpool trim -w zamd64" first, after any freeing of space by deleting files. (Probably again after the build and any cleanout of the tempprary results.) C) Avoid having more poudriere builders than hardware threads. Of course, the combination does not apply to media that does not have trim accessible (USB3, for example) --and that may not support trim in some cases (Optane, for example). By contrast . . . In a USB3 context, vfs.zfs.per_txg_dirty_frees_percent=30 did not work well because of the delete sequence when a builder is to be reused for its next build. vfs.zfs.per_txg_dirty_frees_percent=5 allowed more overall progress on that aarch64 system. The big cleanout of all the builders at the end is not the only consideration in setting vfs.zfs.per_txg_dirty_frees_percent (for at least some systems). === Mark Millard marklmi at yahoo.com From nobody Tue Sep 5 19:29:34 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgFvH4rd1z4s5hx for ; Tue, 5 Sep 2023 19:29:47 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgFvG6JJGz4WXl for ; Tue, 5 Sep 2023 19:29:46 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x534.google.com with SMTP id 4fb4d7f45d1cf-51e28cac164so369369a12.1 for ; Tue, 05 Sep 2023 12:29:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1693942185; x=1694546985; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=VOaz1eUBKdQRDNpYesu3HSPwDQMMYSOJdPbSAfbLZ4g=; b=b0YVzOcGZsUhXpmB8aunveobHsfLQzjAHxiFpSMegIcl3+7cgeKpLEc162IOf2T9NU tW7qGTq8wbW9ghLkcAOE2CHLLwPMLlMeixftvUX7WyAzBd07ocXR2Vp4UQ4/ltjOsavt sttnnOMvQuobFF7rqE8158pPpo2lrRyrffl/9YrX/4FrvfMIyGNjuCEQFNmNKhyefrAW lfyboCqCCpf0tfH7R1uI5VYby5OENiRgFCQliX8eCZ7HTLQx3cPwic+kMIr9O5vRnBa+ 2mvhlbCvtgIqPkLs622Kmj97HCr2yvmXpLVFfDsVvvegD4ueY2o4/5t7KXfcFjXuQW+H 6mpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693942185; x=1694546985; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=VOaz1eUBKdQRDNpYesu3HSPwDQMMYSOJdPbSAfbLZ4g=; b=LIs9nnJze7NME7lT6bqOQHMznmtWOAMwWwYV+NLGkWOC1s/E5q3xpY1z/UTASQ9+Gy a/n0FllqB97k/TeuyxYutEXeKBQT9I9iZ9nGoMSwxjn6jFeZ/HWb1smlVvqhSHI8z1Ol 2BMgH/zxFidZ7M/AJKqYv3YmqU3t7eEmwbBtAbPjsr6F79DzY3eSSRnOQAnELPoFt9P0 CZ7QfQ/Je7lFw6fdob8ktc5qHLI/SzI8PawXPi8UR1fUBElFwMKOLHRHraawlrjPXB8G 28X/FB+rHC8iwjgRseGI9RGfXZtB61TOzCvGFFQPMrQuFh+fmQ3ut4vI6eH+nT4cYMfa hErA== X-Gm-Message-State: AOJu0YxE9/Zi2/GTSuhUmA9ubWllhcK6DF2DzXsyovQJIl1dMyXcbQSf KntHg1m8XzomZJZtwnUCiNTuKTVvoglYW76mMMJ6Tg== X-Google-Smtp-Source: AGHT+IFLHJm8Eel4ImV97m/N5WeqZfwENJtZzp/LJVD07zXrQObs3FCE0m+ghv7kL7YlV7Gs9aNdVLQg8tnJifytPx8= X-Received: by 2002:a17:906:9754:b0:9a5:9b93:d60d with SMTP id o20-20020a170906975400b009a59b93d60dmr707403ejy.36.1693942185476; Tue, 05 Sep 2023 12:29:45 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> In-Reply-To: From: Warner Losh Date: Tue, 5 Sep 2023 13:29:34 -0600 Message-ID: Subject: Re: 14.0-CURRENT boots fine but keyboard does not work To: Matthias Apitz , Warner Losh , Michael Gmelin , Alexander Motin , FreeBSD Current Content-Type: multipart/alternative; boundary="0000000000003c5c670604a1a6d4" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RgFvG6JJGz4WXl --0000000000003c5c670604a1a6d4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Can you try this patch? (it's cut and paste inline, so if it fails, can you apply it by hand... it's pretty straight forward)... The reason is in the comments... Not 100% sure about using the version being all spaces, though... Nor the year 2018, honestly, but it beats having a longish list (see https://mrchromebox.tech/#devices for the list I worry about). Warner diff --git a/sys/dev/atkbdc/atkbdc.c b/sys/dev/atkbdc/atkbdc.c index 6168b389841b..ee7c6cf59da6 100644 --- a/sys/dev/atkbdc/atkbdc.c +++ b/sys/dev/atkbdc/atkbdc.c @@ -147,6 +147,7 @@ atkbdc_getquirks(void) char *maker =3D kern_getenv("smbios.system.maker"); char *product =3D kern_getenv("smbios.system.product"); char *version =3D kern_getenv("smbios.bios.version"); + char *reldate =3D kern_getenv("smbios.bios.reldate"); for (i =3D 0; i < nitems(quirks); i++) if (QUIRK_STR_EQUAL(quirks[i].bios_vendor, bios_vendor) && @@ -154,6 +155,16 @@ atkbdc_getquirks(void) QUIRK_STR_EQUAL(quirks[i].product, product) && QUIRK_STR_MATCH(quirks[i].version, version)) return (quirks[i].quirk); + /* + * Some Chromebooks don't confirm to the google comment above so do th= e + * Chromebook workaround for all <=3D 2018 coreboot systems that have = a + * 'blank' version. At least once Acer "Peppy" chromebook has this issue, + * with a reldate of 08/13/2014. + */ + if (QUIRK_STR_EQUAL("coreboot", bios_vendor) && + (version !=3D NULL && *version =3D=3D ' ') && + (reldate !=3D NULL && strlen(reldate) >=3D 10 && strcmp(reldate + 6= , "2018") <=3D 0)) + return (CHROMEBOOK_WORKAROUND); return (0); } On Tue, Sep 5, 2023 at 11:56=E2=80=AFAM Matthias Apitz w= rote: > El d=C3=ADa martes, septiembre 05, 2023 a las 11:07:07a. m. -0600, Warner= Losh > escribi=C3=B3: > > > > > https://cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2= fee587aaf > > > > > > > > > > You could try to undo that patch and build a new kernel. > > > > > > > > > ... > > > > No. Let's see if I can puzzle out what went awry here. > > > > First up: can you report what 'kenv' on a boot system returns? > > Please find attached the output of kenv > > matthias > > -- > Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ > +49-176-38902045 > Public GnuPG key: http://www.unixarea.de/key.pub > --0000000000003c5c670604a1a6d4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Can you try this patch? (it's cut and paste inlin= e, so if it fails, can you apply it by hand... it's pretty straight for= ward)...

The reason is in the comments... Not 100%= sure about using the version being all spaces, though...
Nor the= year 2018, honestly, but it beats having a longish list (see https://mrchromebox.tech/#devices
for the list I worry about).

Warner

diff --git a/sys/dev/atkbdc/atkbdc.c b/sys/dev/atkbdc/= atkbdc.c
index 6168b389841b..ee7c6cf59da6 100644
--- a/sys/dev/atkbdc= /atkbdc.c
+++ b/sys/dev/atkbdc/atkbdc.c
@@ -147,6 +147,7 @@ atkbdc_ge= tquirks(void)
=C2=A0 =C2=A0 =C2=A0char *maker =3D kern_getenv("smbi= os.system.maker");
=C2=A0 =C2=A0 =C2=A0char *product =3D kern_geten= v("smbios.system.product");
=C2=A0 =C2=A0 =C2=A0char *version = =3D kern_getenv("smbios.bios.version");
+ =C2=A0 =C2=A0char *r= eldate =3D kern_getenv("smbios.bios.reldate");
=C2=A0
=C2= =A0 =C2=A0 =C2=A0for (i =3D 0; i < nitems(quirks); i++)
=C2=A0 =C2=A0= =C2=A0 =C2=A0 if (QUIRK_STR_EQUAL(quirks[i].bios_vendor, bios_vendor) &= ;&
@@ -154,6 +155,16 @@ atkbdc_getquirks(void)
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 QUIRK_STR_EQUAL(quirks[i].product, product) &&= amp;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 QUIRK_STR_MATCH(quirks[i]= .version, version))
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 return (quirks[i].quirk);
+ =C2=A0 =C2=A0/*
+ =C2=A0 =C2=A0 * Som= e Chromebooks don't confirm to the google comment above so do the
+ = =C2=A0 =C2=A0 * Chromebook workaround for all <=3D 2018 coreboot systems= that have a
+ =C2=A0 =C2=A0 * 'blank' version.=C2=A0 At least o= nce Acer "Peppy" chromebook has this issue,
+ =C2=A0 =C2=A0 * = with a reldate of 08/13/2014.
+ =C2=A0 =C2=A0 */
+ =C2=A0 =C2=A0if (Q= UIRK_STR_EQUAL("coreboot", bios_vendor) &&
+ =C2=A0 = =C2=A0 =C2=A0 (version !=3D NULL && *version =3D=3D ' ') &a= mp;&
+ =C2=A0 =C2=A0 =C2=A0 (reldate !=3D NULL && strlen(rel= date) >=3D 10 && strcmp(reldate + 6, "2018") <=3D 0= ))
+ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 return (CHROMEBOOK_WORKAROUND);<= br>=C2=A0
=C2=A0 =C2=A0 =C2=A0return (0);
=C2=A0}

=
On Tue, Se= p 5, 2023 at 11:56=E2=80=AFAM Matthias Apitz <guru@unixarea.de> wrote:
El d=C3=ADa martes, septiembre 05, 2023 a las 11:= 07:07a. m. -0600, Warner Losh escribi=C3=B3:

> > https://= cgit.freebsd.org/src/commit/?id=3D319d2bf407b3762da6f1c67ffe8dce2fee587aaf<= /a>
> > > >
> > > > You could try to undo that patch and build a new kernel= .
> > > >
> > > ...
>
> No. Let's see if I can puzzle out what went awry here.
>
> First up: can you report what 'kenv' on a boot system returns?=

Please find attached the output of kenv

=C2=A0 =C2=A0 =C2=A0 =C2=A0 matthias

--
Matthias Apitz, =E2=9C=89 guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045
Public GnuPG key: http://www.unixarea.de/key.pub
--0000000000003c5c670604a1a6d4-- From nobody Tue Sep 5 20:22:42 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgH4Q5z1vz4sXjW for ; Tue, 5 Sep 2023 20:22:46 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgH4Q24nVz3H6L; Tue, 5 Sep 2023 20:22:46 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Authentication-Results: mx1.freebsd.org; none Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.17.1/8.17.1) with ESMTP id 385KMg4M000555; Tue, 5 Sep 2023 13:22:42 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.17.1/8.17.1/Submit) id 385KMgXM000554; Tue, 5 Sep 2023 13:22:42 -0700 (PDT) (envelope-from sgk) Date: Tue, 5 Sep 2023 13:22:42 -0700 From: Steve Kargl To: Warner Losh Cc: Matthias Apitz , Michael Gmelin , Alexander Motin , FreeBSD Current Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: sgk@troutmask.apl.washington.edu References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US] X-Rspamd-Queue-Id: 4RgH4Q24nVz3H6L On Tue, Sep 05, 2023 at 01:29:34PM -0600, Warner Losh wrote: > + /* > + * Some Chromebooks don't confirm to the google comment above so do the s/confirm/conform ? > + * Chromebook workaround for all <= 2018 coreboot systems that have a > + * 'blank' version. At least once Acer "Peppy" chromebook has this > issue, s/once/one ? -- Steve From nobody Tue Sep 5 21:24:30 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgJRt5k1Kz4s5ys for ; Tue, 5 Sep 2023 21:24:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-lf1-x134.google.com (mail-lf1-x134.google.com [IPv6:2a00:1450:4864:20::134]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgJRt2mtmz3crZ for ; Tue, 5 Sep 2023 21:24:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x134.google.com with SMTP id 2adb3069b0e04-5009d4a4897so5092095e87.0 for ; Tue, 05 Sep 2023 14:24:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1693949080; x=1694553880; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Fsi1Jmti7LUiuKEzJzv66oU8EMJkg7nG3zIU7EATPWM=; b=Mns+zVQFAnAp4R8/0TyJIDCr7lubjYSMYx1cY0P5OOk3TBxdRBRELIgEMNYb3II06u +Ef3eTERKJWH7b6gEEfrJHX/Ia17YIsPwp7VPOXR6PD7AqEzEVoKjRGMqSJp7brUENkt oD6orHV2wTQagqjjQ38h5yBZNY4c3PsckbLiydrMtXDfgBPBr670D8i98K2pgbU6Mvp5 5iUWJ5EM9ba4sgnP75fVGO9R8L5hu+xuLvqwCbebC7w9Y8dlsuklV3LJmRhucvTSXEjz TwzbtDPtYjB9261UtNAUejL4mDNqV5pQLCGCatfoeS2G34Xj25asVRu7gG1F/B0war1E eeEA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693949080; x=1694553880; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Fsi1Jmti7LUiuKEzJzv66oU8EMJkg7nG3zIU7EATPWM=; b=a1hVyXqTNKmGCZ9AD/0vifw4EAyEu1to29VcpVAw5phr/A7Gmf54kafG8scI16+JRY D3aL1KEmqK1adhoJyP7a9evVRX3dYO3iJQS3Vqs9kMb1ceUvwrrMP7Rz2ORBBnmkkq/q wdTh7xvI+95n/2sAIj7QeQsbNDlFetotPVv4MaKI6aboKBZs79fHvqyL6byQKrKJv3ju uNZ4/6QjPglidP4RE0nxzEp80ujquhflprzdCStBv9ipnNRtILJT/zNjiJADuHB1jqQc 0hwt+pd2peGWXmHAorF2n1fCZJXnFy+OnoHb0Gd2myYCyFuVZk8KUugRnbYLNOEwLKaA JXtw== X-Gm-Message-State: AOJu0YwNwmu2GFXWZUl2gS9Z1HjMVvNwpq3wVmg+11a6uQNqvBDc/dyg 6yuUU6h++R72Apa6yz9tPQaCAlkPgTBbWNoxVTlUJg== X-Google-Smtp-Source: AGHT+IFAarIf1IMEKAtvyktnkEYpeRx1dRIJ+jATvKrRSZinWV/VILK1D5A8ZRjzZdmtJfuTdsF5mrzmNZm9jeVRD6M= X-Received: by 2002:a19:644d:0:b0:500:a008:a4c5 with SMTP id b13-20020a19644d000000b00500a008a4c5mr742962lfj.59.1693949080300; Tue, 05 Sep 2023 14:24:40 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> In-Reply-To: From: Warner Losh Date: Tue, 5 Sep 2023 15:24:30 -0600 Message-ID: Subject: Re: 14.0-CURRENT boots fine but keyboard does not work To: sgk@troutmask.apl.washington.edu Cc: Matthias Apitz , Michael Gmelin , Alexander Motin , FreeBSD Current Content-Type: multipart/alternative; boundary="00000000000033103f0604a341ec" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RgJRt2mtmz3crZ --00000000000033103f0604a341ec Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Sep 5, 2023 at 2:22=E2=80=AFPM Steve Kargl wrote: > On Tue, Sep 05, 2023 at 01:29:34PM -0600, Warner Losh wrote: > > + /* > > + * Some Chromebooks don't confirm to the google comment above so d= o > the > > s/confirm/conform ? > > > > + * Chromebook workaround for all <=3D 2018 coreboot systems that h= ave > a > > + * 'blank' version. At least once Acer "Peppy" chromebook has thi= s > > issue, > > s/once/one ? > Yes. Thanks! Dashed off the comment in a hurry since I wanted to get the patch out there in a hurry... But that was kinda sloppy of me.. fixed. Warner --00000000000033103f0604a341ec Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Tue, Sep 5, 2023 at 2:22=E2=80=AFP= M Steve Kargl <sgk@t= routmask.apl.washington.edu> wrote:
On Tue, Sep 05, 2023 at 01:29:34PM -0600, Warner= Losh wrote:
> +=C2=A0 =C2=A0 /*
> +=C2=A0 =C2=A0 =C2=A0* Some Chromebooks don't confirm to the googl= e comment above so do the

s/confirm/conform=C2=A0 ?


> +=C2=A0 =C2=A0 =C2=A0* Chromebook workaround for all <=3D 2018 core= boot systems that have a
> +=C2=A0 =C2=A0 =C2=A0* 'blank' version.=C2=A0 At least once Ac= er "Peppy" chromebook has this
> issue,

s/once/one=C2=A0 ?

Yes. Thanks! Dashed = off the comment in a hurry since I wanted to get the patch out
th= ere in a hurry... But that was kinda sloppy of me.. fixed.
Warner
--00000000000033103f0604a341ec-- From nobody Wed Sep 6 05:34:15 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RgWJt2yNcz4shgp for ; Wed, 6 Sep 2023 05:34:22 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RgWJt16BGz3gm8; Wed, 6 Sep 2023 05:34:22 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none Received: from [188.174.50.15] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qdlBC-0091as-3k; Wed, 06 Sep 2023 07:34:18 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 3865YHwL006870 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 6 Sep 2023 07:34:17 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 3865YFoF006869; Wed, 6 Sep 2023 07:34:15 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Wed, 6 Sep 2023 07:34:15 +0200 From: Matthias Apitz To: Warner Losh Cc: sgk@troutmask.apl.washington.edu, Michael Gmelin , Alexander Motin , FreeBSD Current Subject: Re: 14.0-CURRENT boots fine but keyboard does not work Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Warner Losh , sgk@troutmask.apl.washington.edu, Michael Gmelin , Alexander Motin , FreeBSD Current References: <58E9D0C9-747F-4DEB-9DC7-5A2E8C54EABF@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="wqmAerRmXjsN2nMD" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.50.15 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4RgWJt16BGz3gm8 --wqmAerRmXjsN2nMD Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit El día martes, septiembre 05, 2023 a las 03:24:30p. m. -0600, Warner Losh escribió: > On Tue, Sep 5, 2023 at 2:22 PM Steve Kargl > wrote: > > > On Tue, Sep 05, 2023 at 01:29:34PM -0600, Warner Losh wrote: > > > + /* > > > + * Some Chromebooks don't confirm to the google comment above so do > > the > > > > s/confirm/conform ? > > > > > > > + * Chromebook workaround for all <= 2018 coreboot systems that have > > a > > > + * 'blank' version. At least once Acer "Peppy" chromebook has this > > > issue, > > > > s/once/one ? > > > > Yes. Thanks! Dashed off the comment in a hurry since I wanted to get the > patch out > there in a hurry... But that was kinda sloppy of me.. fixed. I've had to apply the patch manually (attached as context diff). With this the keyboard works also fine. Thanks matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub --wqmAerRmXjsN2nMD Content-Type: text/x-diff; charset=utf-8 Content-Disposition: attachment; filename="atkbdc.c.diff" *** /usr/src/sys/dev/atkbdc/atkbdc.c.ORIG Sat Aug 5 12:50:44 2023 --- /usr/src/sys/dev/atkbdc/atkbdc.c Wed Sep 6 07:08:49 2023 *************** *** 149,154 **** --- 149,155 ---- char *maker = kern_getenv("smbios.system.maker"); char *product = kern_getenv("smbios.system.product"); char *version = kern_getenv("smbios.bios.version"); + char *reldate = kern_getenv("smbios.bios.reldate"); for (i = 0; i < nitems(quirks); i++) if (QUIRK_STR_EQUAL(quirks[i].bios_vendor, bios_vendor) && *************** *** 156,161 **** --- 157,173 ---- QUIRK_STR_EQUAL(quirks[i].product, product) && QUIRK_STR_MATCH(quirks[i].version, version)) return (quirks[i].quirk); + + /* + * Some Chromebooks don't conform to the google comment above so do the + * Chromebook workaround for all <= 2018 coreboot systems that have a + * 'blank' version. At least one Acer "Peppy" chromebook has this issue, + * with a reldate of 08/13/2014. + */ + if (QUIRK_STR_EQUAL("coreboot", bios_vendor) && + (version != NULL && *version == ' ') && + (reldate != NULL && strlen(reldate) >= 10 && strcmp(reldate + 6, "2018") <= 0)) + return (CHROMEBOOK_WORKAROUND); return (0); } --wqmAerRmXjsN2nMD-- From nobody Thu Sep 7 06:09:14 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rh82n1nV3z4sSsv for ; Thu, 7 Sep 2023 06:09:21 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rh82m39JZz3fgC; Thu, 7 Sep 2023 06:09:20 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=mudqMYqG; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::62f as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-991c786369cso62930966b.1; Wed, 06 Sep 2023 23:09:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694066958; x=1694671758; darn=freebsd.org; h=subject:from:to:content-language:user-agent:mime-version:date :message-id:from:to:cc:subject:date:message-id:reply-to; bh=pGfDZlPuwiFkahQGt5V2TyWyNw8yu5RfGVClYgmXejQ=; b=mudqMYqGjxsLF7og/8Hhbcsu3Ojamxc1uWX81KSeaqfmPraOT6Tt8yE3iSpAXf3pwu xg6P4DjrziLu/MHgHG/2eF6DKeSEYgiNy6j15LCy4J6sGi5wu+LWc5vjGve1ZhWqHlPB mSV5in4oua3Rd5gIQCDZkNY4ZVqGx3/XrUuEX0wpO9YlZVUkoR8/RAPUfo/M+MTljoEL kS4j5bP0jVjSpIjmno9WsSixodX5yqMjr4QNYeJ5lCZ1ql+txwNXcl6m5MApKN6rBBZu teFzrhbqM3IqZLcniEIu8nl2vUIG2YssYCou9pnAVVJnt7SBiYhlFHqoQSn2DgypKxtR ynPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1694066958; x=1694671758; h=subject:from:to:content-language:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=pGfDZlPuwiFkahQGt5V2TyWyNw8yu5RfGVClYgmXejQ=; b=QNSu/V9LU5GrMt4HtqYYIdvMZakq/bNyUTHsHSSxl3C9WpU1sSh/pfrkx1/l46ZWCV JrMsNwt1puf8TC0yC9gotUy+Cd9sjPdPDUt5FAEUbVh+6fHgXKKwfrRdfybLVGL2f5Gv bEg+P/6e3OClpgyJ8dnU5lvhZr/KPphPwim/bR7eCpfXBovla05dhNogjUTj/LHEwS1w uWta83NdmMGU7y/TwXZZ993cUP80FZI+9bV0QrQTqAv13JUIGDO/LPSTvY6jf24RSXwM 0AGtil1e9Q9srGVKHvUXu+awgih5B4P3R0iYunrgivZe70hUcqYSIWjfjs+OjmylCd9r JpMA== X-Gm-Message-State: AOJu0YwQjvlSUgowi+sS8Tg+5NepimiBPHS/H73WK5FxCTv1rBgWkPWl rrFiIVr01N07aAP2LKj8hfylb8EOkUU= X-Google-Smtp-Source: AGHT+IEOfKraMh7fZlZfQk7MApP5G1J2yFgWkFIMguNqBPYJMPmXvzIy+VCGH2QGxVGkdsg8PJpcmQ== X-Received: by 2002:a17:907:77d3:b0:99e:1358:ffdf with SMTP id kz19-20020a17090777d300b0099e1358ffdfmr3912045ejc.72.1694066958226; Wed, 06 Sep 2023 23:09:18 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id tk26-20020a170907c29a00b009a1082f423esm9790778ejc.88.2023.09.06.23.09.16 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 06 Sep 2023 23:09:17 -0700 (PDT) Content-Type: multipart/alternative; boundary="------------XRYUJTwnPDcgs40QvS7DQZzU" Message-ID: Date: Thu, 7 Sep 2023 07:09:14 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-GB To: FreeBSD CURRENT , Colin Percival From: Graham Perrin Subject: sysutils/panicmail and boot environments X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEFALL_USER(0.00)[grahamperrin]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62f:from]; BLOCKLISTDE_FAIL(0.00)[80.42.66.93:server fail,2a00:1450:4864:20::62f:server fail]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rh82m39JZz3fgC This is a multi-part message in MIME format. --------------XRYUJTwnPDcgs40QvS7DQZzU Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit For the penultimate panic: panicmail was received (in my Gmail Inbox). For the most recent panic: no panicmail in the same Inbox. Might this be, because the kernel panicked in a different boot environment? If so: will a temporary boot of the environment be enough for delivery of the mail? >From : > Before the panic: with n265135-07bc20e4740d-b running, I created then > mounted n265135-07bc20e4740d-c, upgraded its packages, unmounted then > activated the environment, then restarted the OS. > > If I recall correctly: the panic occurred very close to the end of the > shutdown routine. --------------XRYUJTwnPDcgs40QvS7DQZzU Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

<https://www.freshports.org/sysutils/panicmail/>

For the penultimate panic: panicmail was received (in my Gmail Inbox).

For the most recent panic: no panicmail in the same Inbox. Might this be, because the kernel panicked in a different boot environment? If so: will a temporary boot of the environment be enough for delivery of the mail?

From <https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273610#c0>:

Before the panic: with n265135-07bc20e4740d-b running, I created then mounted n265135-07bc20e4740d-c, upgraded its packages, unmounted then activated the environment, then restarted the OS.

If I recall correctly: the panic occurred very close to the end of the shutdown routine.

--------------XRYUJTwnPDcgs40QvS7DQZzU-- From nobody Thu Sep 7 06:50:47 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rh8yj1n56z4sqGT for ; Thu, 7 Sep 2023 06:50:53 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rh8yh4H14z4RZT; Thu, 7 Sep 2023 06:50:52 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="MUpN/sMZ"; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::52d as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ed1-x52d.google.com with SMTP id 4fb4d7f45d1cf-51a52a7d859so3717917a12.0; Wed, 06 Sep 2023 23:50:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694069450; x=1694674250; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=HR9UFmhvMIpdER3RilI7txfvzUKq+wRANJPrfRaG5UM=; b=MUpN/sMZu1GdA5v3e371Gwxdlc3zdIKibxx4wHbLRwM8XS+fNAo46naqOO7AFjfrrt tOWKXuu1UQPor92L1TbGXRC5u78K6LWGEBLp/1iZo9GSDVnA3ap4mXeAg7CYDIebqAL1 yOaBIiEWW+Mdz4PWVulvUqOZU91fhx8UJTi4dDiosRjMpWluhFf/tmwRsK7sD5+PeHyU mVtuHsV+A8i30zuM7MoFGxhN0JxXAQdLv/tBzEmrYsOK9iS4WWP15H6JoagNRl+2LNbh zSK67IEajcyyypl7UL8KpAZucRzQDnJqM9EtFPdKaoxObGXCPfu7Cw50tb+HjEpeR16j Z63Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1694069450; x=1694674250; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=HR9UFmhvMIpdER3RilI7txfvzUKq+wRANJPrfRaG5UM=; b=azluLuOA73361FS9dd1MZczCtJVPsNvTjdvuTIbjMxx9AEuMmvy3ey1hzXmRrL31B0 96u1JXwTr7fhtzA3ZRmI1XqQJ5LUSuKP4nrWzdcWQsAnc+fWsCCjU11t700sPicZdI5G W/3Ichvff3pR1caI2J8Yeat5eM1pxg3cs7Qt5xKeOFwCISFbV7yRoeNAI58tLtdyyuvm d2TyLbKhMJvzKT2DA3XShzhaddZffwi60f4Kbcgh4vvDbY53eiuFj+Dt4HAewLvvwSvu oE6rjVh1n3uuVopJF+qAZ7mn5JyrNjASUVEBa3RVrUqBt9kIF0DCNA8GPmRibNiZfYwd nQvg== X-Gm-Message-State: AOJu0Yw4ZAYuhd6xGAzrpWLqwvutaRGW0+aekeXhbiuESgU/pF02FATF PBTcKE1v7wdFPJk5eypQMErrj25Estg= X-Google-Smtp-Source: AGHT+IGfCCdBz/sBvl/I6N3I6dpCPOl1RX9YjisDbJC7N7vrjyCm3A2ecGV2/OEta7tqHT/IOOoz5Q== X-Received: by 2002:a05:6402:180d:b0:523:3e27:caa7 with SMTP id g13-20020a056402180d00b005233e27caa7mr2140115edy.20.1694069450446; Wed, 06 Sep 2023 23:50:50 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id er23-20020a056402449700b0052c4dacf54csm5629956edb.44.2023.09.06.23.50.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 06 Sep 2023 23:50:49 -0700 (PDT) Message-ID: <7ea7014f-6193-09f8-bea3-a963cd0cc7f9@gmail.com> Date: Thu, 7 Sep 2023 07:50:47 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US To: Michael Gmelin Cc: FreeBSD-CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <20230903112623.2ed751a5.grembo@freebsd.org> From: Graham Perrin Subject: Re: kernel 100% CPU, and ports-mgmt/poudriere-devel 'Inspecting ports tree for modifications to git checkout...' for an extraordinarily long time In-Reply-To: <20230903112623.2ed751a5.grembo@freebsd.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.39 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.39)[-0.391]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FREEFALL_USER(0.00)[grahamperrin]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52d:from]; BLOCKLISTDE_FAIL(0.00)[80.42.66.93:server fail,2a00:1450:4864:20::52d:server fail]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rh8yh4H14z4RZT On 03/09/2023 10:26, Michael Gmelin wrote: > On Sat, 2 Sep 2023 09:53:38 +0100 > Graham Perrin wrote: > >> Some inspections are extraordinarily time-consuming. Others complete >> very quickly, as they should. >> >> One recent inspection took more than half an hour. >> >> Anyone else? >> > Does `git clone https://git.freebsd.org/ports.git` work for you? > (currently it's not working from where I am). Maybe related. > > Best > Michael Today, yes. Sorry for not replying sooner, Gmail sent your 2nd September email to spam. % pwd /tmp % time git clone https://git.freebsd.org/ports.git && rm -r ports Cloning into 'ports'... remote: Enumerating objects: 5943170, done. remote: Counting objects: 100% (943/943), done. remote: Compressing objects: 100% (127/127), done. remote: Total 5943170 (delta 923), reused 816 (delta 816), pack-reused 5942227 Receiving objects: 100% (5943170/5943170), 1.11 GiB | 6.29 MiB/s, done. Resolving deltas: 100% (3586216/3586216), done. Updating files: 100% (156931/156931), done. 941.630u 59.980s 10:11.66 163.7%        3333+442k 14+0io 58pf+16w override r--r--r-- grahamperrin/wheel for ports/.git/objects/pack/pack-d72c55d78249720bb87ae380c69ecb3c6dc5fe94.idx? ^C % sudo rm -r /tmp/ports grahamperrin's password: % From nobody Thu Sep 7 07:02:13 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rh9F14F4Hz4swYw for ; Thu, 7 Sep 2023 07:03:17 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rh9F01JNjz4Wjb for ; Thu, 7 Sep 2023 07:03:16 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=0++AA7pV; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 89.238.82.207 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1694070184; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=UXXNFgSJ0zv/GgemKx7InqUxj2f/HohxERCNu9Jm3P8=; b=0++AA7pVRqY7Dokf/MbNXsVU4NDCROIOvCptEtb72a+0EI0aQE5/4eH8WZHL/JWIvEIpGP 99eNav3SY9Gwzd8J4/vD5EivZIyH/qWhsrD5c+AoNlPzy/XwdAtz4E+yhznouz7ycBtNyj IpdpXeLy/5BOpkZc+qAntmD+301rTFxPyb/VxQ998UNAkbwuLiUFeHH78tzW3xd9M3CT1a 1lbXCqV7KA8ib4jumd/CI2eezLzkbyGTrQmavjLUUcNK+sN1FGxotDxez/UEP7MD7AUm1l +E/BG3czBzIzSf/DWRUrfhnvUN2e+SFkPTqXtxxEo1zX8qro7wEOt09GQBcG5Q== Date: Thu, 07 Sep 2023 09:02:13 +0200 From: Alexander Leidinger To: Mateusz Guzik Cc: current@freebsd.org Subject: Re: 100% CPU time for sysctl command, not killable In-Reply-To: References: <67616bb5b074851832053a0286c3c2fa@Leidinger.net> Message-ID: X-Sender: Alexander@Leidinger.net Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_5723f5783b7ae973d13b1c053298ae17"; micalg=pgp-sha256 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.09 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.99)[-0.990]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; MLMMJ_DEST(0.00)[current@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; HAS_ATTACHMENT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rh9F01JNjz4Wjb This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_5723f5783b7ae973d13b1c053298ae17 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2023-09-03 21:22, schrieb Alexander Leidinger: > Am 2023-09-02 16:56, schrieb Mateusz Guzik: >> On 8/20/23, Alexander Leidinger wrote: >>> Hi, >>> >>> sysctl kern.maxvnodes=1048576000 results in 100% CPU and a >>> non-killable >>> sysctl program. This is somewhat unexpected... >>> >> >> fixed here >> https://cgit.freebsd.org/src/commit/?id=32988c1499f8698b41e15ed40a46d271e757bba3 > > I confirm. There may be dragons...: kern.maxvnodes: 1048576000 vfs.wantfreevnodes: 262144000 vfs.freevnodes: 0 <----------------------- vfs.vnodes_created: 11832359 vfs.numvnodes: 146699 vfs.recycles_free: 4700765 vfs.recycles: 0 vfs.vnode_alloc_sleeps: 0 Another time I got an insanely huge amount of free vnodes (more than maxvnodes). Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_5723f5783b7ae973d13b1c053298ae17 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmT5dYYACgkQEg2wmwP4 2IZ4KA/8C8/E9QvhLHtGVuLZEtROJIYgpQo310iPxsQD36mgQZzMtPCs4RJGntia fRJduT/T8znbfQJDjpOnq2mQDPo8EVCVGI1lU3v0vP5zvRDXDRk7YhlkNSFcTlrd zLJHgcvWLISDseWUHNEmlsIkeLANQLfuLvkUcr6wOsxgDlAspGFcxHF7cDkkqLnS EI3wNrv/mhPBiBWKPFT5o2mG3lssAKXV9euT/KOKo2FTzUoSQFr0uCaAb9hwl67F 1XePZnoEcwx0+9XNZQpgzIQp/uwLmDDZyz0w2TjseiUA9QY6Q0SorMaEwo+kWnel 373zhPHqeFJlOMm5qSe/9J537ZHhmyLkAIIgNyV8BoQaXLvmys0s/sch5JtDkzfj fD7l5ZBy95+3cfDRvKOtfBOGaijZ/wYW23hn1JG34ffEGTIVhfYA3WpqtFtXFNFx xBH07Ag+BS+XJ1oSci7XODl1jySeiqVZMXa8Ebh1gmukPeH9Zdo+a7XqokKGY9E8 N7HrGLtY/TOjh9oCOcHLNR2OWTJsUTIwiUMvvpmatyLvDSCZXlDlQzlZsLcKx+il LgUGmXfSV9een8mc1TUOn4F2C7meDihi7Q/OckyJKInBfQSbUtEFdOXQCUSqGfQW 4K2BVT1igtMJrwUvbsuB4w1ynfIQoM/9k37bmO0xEZRtXbVi81Y= =cmrv -----END PGP SIGNATURE----- --=_5723f5783b7ae973d13b1c053298ae17-- From nobody Thu Sep 7 18:02:16 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhRsl1TzWz4sdkQ for ; Thu, 7 Sep 2023 18:02:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-24.consmr.mail.gq1.yahoo.com (sonic304-24.consmr.mail.gq1.yahoo.com [98.137.68.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhRsk0nvzz4Ztb for ; Thu, 7 Sep 2023 18:02:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Glf949Nr; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.205 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694109752; bh=Ih+MlzrpWBXPVdNwiryi22KM451jCkvPg8y25cp8J6o=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=Glf949Nr0sIxWyo4rozXxTuKpt0NoudR+DuEgVQwGYRfzobnovEcDbV14ynEkuGhJETiGDGyZDk/6Ei4JZiJcSDbKOKGG/jYrF1QiPhU68XVkfYFDlD61FZg/FK4hCyXLn2/2hihPT9JfY9Id56f/Qw9D80yalcEAKXaRMZG0TjiEgku1/ZpycHiK+ZE57n2qF8TO5lZWfCR4Rc7UztSqmpI517+LH03znYX1fkV49PYSNJgYi7CQCAwqkSwYDkzDCtQZdBfdl6llzzq5nXGqGBLG1W4KWPdDUoylrBhlOkUSmFDMo9zinc+nh2KH2GNMJor+aiOfXoYTfV2iDDtpQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694109752; bh=KCQozqplxVlQXODdOyUvdxbD2gSdfsWFOjRt1CYMy07=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=fs39eQeOSEgCWxFhCvJhPJfT+VLaUDyQUzjGhUQDVSnwYiSzXI/KUYzTXtG5AgvP3g+XK+XcdlyEVWeAZvYl22c/2UIkCrDdnSLX34zKr3GR8nXYz5805j2uoe3gsXyHVw99q6dmexsMH2H9gXeWUfF7ymZ4o+F47Sdv/RgnVl/i05Sruz91JoGZCPihFHS/PWjDgP1pKW9FQqE2fMSc6yLzokgoQjzWnLBaqi1SoV//X99spEEHTPSZs5HXSvt8rjwRmnyNnEPuUS9WxbQAsmgG09aYz7EWgydTeR3Mweu372v0KlOh7Rj9Fw75B5gDnEcw39dIDg5qC0QRJhGnsQ== X-YMail-OSG: .Tyg1gIVM1khRcV2KHv13ukxelWzwvssG_98l6l_3.TBNNydQj53Bwi4BkaONfM kMrEPkttVtTFsEr6DK8tnbwBV5rZIHa5bkjQHTsZRvFholY5MZ4aUZyKgfwQZV5pRer2ljQ4H4jb MyDkoRdFUAUhomIJpbxv4KvbuDx_CoJZGR36OdC4iUGRC85TMhxMu6xA.XTvjUuXcMWTriy9ZzLm JhAqnO4RmQ1aIn38aV3qgD1g1XA_9VOTU0Ets08dJrtbkUKftstx_vzXgohei4X.uAj0ZqJzCLSj 0FWZ8nvwhbrw3zBLR9Zn58iIdwTxReXzWrgYLcoqbWkFcikOiQR2TsXWXFDFvl._oSFLRSVtl2WD d2_jl8rY4LGfknn7P6MCDlIVMvAsSMb.LF0B4.U06PEcX3lM17Qtkk9O0gYfX80b2V_kDvc4fje6 hAWncIlluQpB_SuH0HI51OOh.HxoW6KH59u6TixTmOqmDfu0E52PvWVRe_RHY0t0d3hA5c9qXdlx 64UcK_N1UmORRoJDS_UW50yMz_E.O.u8LWzlhB_0CakCFk02ta2HX0gA1EwtGuoALMP8OrCVuv35 OfGyx.aHWMfGaItN2FyT8KA85wLT8wByA5w67UhtTqq4E.5sYaVU7xlxK_tpkQnbFKNnTxM7Y_TC NaN3sSUH5lOmNostOoW5LuvMc_QYFVjV5ZgaWs1jdSgVSCQ2t41bn3b292CKmzukYdAOzMk8F0B9 XTmh9ArLJYneJqnq4lhzeALy.rfVF9hHuGhzD7A7SS0I7XD8FINByAPuo0uOCtRR5URAfhXM0iv8 .j.jcRqKB7z3eyJMeXb1Qri3vGyx2K4kW1dU64y8xcccZtWEubqIz_..1Xb0SGRYhPjOccBlxZUU _26lSAodpBjBBBld2Tnc4HnPoeX25MW5QRljkhAd.xmZdACBNMFyk1CFa0t4LzVcvWdSNiQ6y1L5 HqiJSOP5KHCUwRUUrSXOhp31M8Yb8YSMD6xehhmGCXhQafdo7eEhfATWaE9embrW46_u7SVuEhd_ Mq1aPEdsgFcfFmI7rbdJE8pJynMvlCXfkmFqq_gvwH7JZvuenyfxtsz9p94Ez_A5rQSfyLdDmtdK c7CUi_jet9xuAwsiYFFuTQXs8ylT8gVzZQJN_f.928B_4zeY7geE1c4DOQO.JF1w1OjyplsLWHue uKM5hzYM5Argk20YW.z2vdLeM.Cpes_aAZW6lLx5kOxCSoOJB0K7dVeodFcV2ORMevfNvomVBa3B 0Iqo8POHkNBkPPSs0xcDZE4aQBZ5O6TtVWhS1W_PpZuv.f_UWVKSD8e4e.wCz7WNU9PAfVyyVZpL gn6dxJ50ldzhAe0XlikfqibxoWEkBpLeHHD7WaRlWogZWaZpPcF82kfrbAcMOxpFtVmOSpfBncjR 7EWKlCZHK.77GVVcwH8y1R1HAbMe6rnERnSglRW53uolQaPthm4iq6MxO.4iJ5YmLExc9KIW3Ddp 43YDOoVmWjwOI86pCHhxJpzJlHgoocfZ7B5xZw6Cmm9JZjfzxVGC_Yg1_q5GB_Umg9UfdKNKzKj7 Kjg5fJ1hdC1UBrktwuk80pA0YDVx5yqkWBSnAJ3g5gSPFXMC0IhxuU06gtYhz3uxOBky3u_MpVEy oDm3TrEyqh.xLcU4DuiFLrSgvegzfY24VYac1ufu6YAhe4lLhvuRDYElB9pnBl07yZkFdteiUNtV NPXJtv8ZBc.CLV4AmOn7UKS2C2g6LLIOFb.HnkU5meUygTLqg2lDOXJCnTtUJmsVeg8p2.IEHlnV H612Haiiny1wcrV4c9Eb6Y8l9.GnUyNR3g4SJdpbwfgshf4ZF09X0r3BsyrBjP267ZHrVms94ryZ 6luZd4N2zLpHn7RXuK4jnepzCbh7fKbn0LFGCyApJ6IbiCKAg7.RWUy2IiOUzLX6VpJiSSulRKfZ QNwVNIrTXyTfJBxZ3v1Ushc08azxfqLbYqRISzxu424p9ICXUFgf9P3YhDvh3xDMN0ey0pnlmGqg u.08nhv.MSU7t0mZssxoWNvvta5vdYByIyOxWwIRhMfo0aXEXFz3oAwhB2dwS482ZhSiMVhoBPkR .mgPgHDPjHvDJR3ilmbIfpaM.xeo0jbg7ULc9MYFI_1xcbY4PtWPRRvFiVRfiuk8CvdA58gkGrZm 1UEAUvNG2XykeODMI2wJd68Z85_de2GfnWjH7PckAMkw.JhYp99r1fUdAIA4C5gEWEsF5KXuot_N kRKtujNRGwd1aSMi2fyjXxLWydk0d8zOLImGI2OWOEJz3tNkcDVWPjhsfjyTVDWIBr6cN.fzRld5 mGvhCqmNtDwY- X-Sonic-MF: X-Sonic-ID: cbb56a35-0796-410c-a00c-e1178b0d7069 Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Thu, 7 Sep 2023 18:02:32 +0000 Received: by hermes--production-bf1-865889d799-7x4p2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d34197bc64bbc6e9ed481dc514c0e25f; Thu, 07 Sep 2023 18:02:29 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Message-Id: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> Date: Thu, 7 Sep 2023 11:02:16 -0700 Cc: Glen Barber To: Current FreeBSD , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.68.205:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.205:from]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.205:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RhRsk0nvzz4Ztb I was requested to do a test with vfs.zfs.bclone_enabled=3D1 and the bulk -a build paniced (having stored 128 *.pkg files in .building/ first): # more /var/crash/core.txt.3 . . . Unread portion of the kernel message buffer: panic: Solaris(panic): zfs: accessing past end of object 422/1108c16 = (size=3D2560 access=3D2560+2560) cpuid =3D 15 time =3D 1694103674 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe0352758590 vpanic() at vpanic+0x132/frame 0xfffffe03527586c0 panic() at panic+0x43/frame 0xfffffe0352758720 vcmn_err() at vcmn_err+0xeb/frame 0xfffffe0352758850 zfs_panic_recover() at zfs_panic_recover+0x59/frame 0xfffffe03527588b0 dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0x97/frame = 0xfffffe0352758960 dmu_brt_clone() at dmu_brt_clone+0x61/frame 0xfffffe03527589f0 zfs_clone_range() at zfs_clone_range+0xa6a/frame 0xfffffe0352758bc0 zfs_freebsd_copy_file_range() at zfs_freebsd_copy_file_range+0x1ae/frame = 0xfffffe0352758c40 vn_copy_file_range() at vn_copy_file_range+0x11e/frame = 0xfffffe0352758ce0 kern_copy_file_range() at kern_copy_file_range+0x338/frame = 0xfffffe0352758db0 sys_copy_file_range() at sys_copy_file_range+0x78/frame = 0xfffffe0352758e00 amd64_syscall() at amd64_syscall+0x109/frame 0xfffffe0352758f30 fast_syscall_common() at fast_syscall_common+0xf8/frame = 0xfffffe0352758f30 --- syscall (569, FreeBSD ELF64, copy_file_range), rip =3D = 0x1ce4506d155a, rsp =3D 0x1ce44ec71e88, rbp =3D 0x1ce44ec72320 --- KDB: enter: panic __curthread () at /usr/main-src/sys/amd64/include/pcpu_aux.h:57 57 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" = (offsetof(struct pcpu, (kgdb) #0 __curthread () at = /usr/main-src/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=3Dtextdump@entry=3D0) at /usr/main-src/sys/kern/kern_shutdown.c:405 #2 0xffffffff804a442a in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) at /usr/main-src/sys/ddb/db_command.c:591 #3 0xffffffff804a422d in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) at /usr/main-src/sys/ddb/db_command.c:504 #4 0xffffffff804a3eed in db_command_loop () at /usr/main-src/sys/ddb/db_command.c:551 #5 0xffffffff804a7876 in db_trap (type=3D, = code=3D) at /usr/main-src/sys/ddb/db_main.c:268 #6 0xffffffff80bb9e57 in kdb_trap (type=3Dtype@entry=3D3, = code=3Dcode@entry=3D0, tf=3Dtf@entry=3D0xfffffe03527584d0) at = /usr/main-src/sys/kern/subr_kdb.c:790 #7 0xffffffff8104ad3d in trap (frame=3D0xfffffe03527584d0) at /usr/main-src/sys/amd64/amd64/trap.c:608 #8 #9 kdb_enter (why=3D, msg=3D) at /usr/main-src/sys/kern/subr_kdb.c:556 #10 0xffffffff80b6aab3 in vpanic (fmt=3D0xffffffff82be52d6 "%s%s", = ap=3Dap@entry=3D0xfffffe0352758700) at /usr/main-src/sys/kern/kern_shutdown.c:958 #11 0xffffffff80b6a943 in panic ( fmt=3D0xffffffff820aa2e8 = "\312C$\201\377\377\377\377") at /usr/main-src/sys/kern/kern_shutdown.c:894 #12 0xffffffff82993c5b in vcmn_err (ce=3D, = fmt=3D0xffffffff82bfdd1f "zfs: accessing past end of object %llx/%llx = (size=3D%u access=3D%llu+%llu)", adx=3D0xfffffe0352758890) at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/spl/spl_cmn_err.c:60 #13 0xffffffff82a84d69 in zfs_panic_recover ( fmt=3D0x12 ) at /usr/main-src/sys/contrib/openzfs/module/zfs/spa_misc.c:1594 #14 0xffffffff829f8e27 in dmu_buf_hold_array_by_dnode = (dn=3D0xfffff813dfc48978, offset=3Doffset@entry=3D2560, = length=3Dlength@entry=3D2560, read=3Dread@entry=3D0, = tag=3D0xffffffff82bd8175, numbufsp=3Dnumbufsp@entry=3D0xfffffe03527589bc, = dbpp=3D0xfffffe03527589c0, flags=3D0) at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:543 #15 0xffffffff829fc6a1 in dmu_buf_hold_array (os=3D, = object=3D, read=3D0, numbufsp=3D0xfffffe03527589bc, = dbpp=3D0xfffffe03527589c0, offset=3D, length=3D, tag=3D) at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:654 #16 dmu_brt_clone (os=3Dos@entry=3D0xfffff8010ae0e000, object=3D, offset=3Doffset@entry=3D2560, length=3Dlength@entry=3D2560, = tx=3Dtx@entry=3D0xfffff81aaeb6e100, = bps=3Dbps@entry=3D0xfffffe0595931000, nbps=3D1, replay=3D0) at = /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:2301 #17 0xffffffff82b4440a in zfs_clone_range (inzp=3D0xfffff8100054c910, = inoffp=3D0xfffff81910c3c7c8, outzp=3D0xfffff80fb3233000, = outoffp=3D0xfffff819860a2c78, lenp=3Dlenp@entry=3D0xfffffe0352758c00, = cr=3D0xfffff80e32335200) at /usr/main-src/sys/contrib/openzfs/module/zfs/zfs_vnops.c:1302 #18 0xffffffff829b4ece in zfs_freebsd_copy_file_range = (ap=3D0xfffffe0352758c58) at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:629= 4 #19 0xffffffff80c7160e in VOP_COPY_FILE_RANGE (invp=3D, = inoffp=3D0x40, outvp=3D0xfffffe03527581d0, = outoffp=3D0xffffffff811e6eb7, lenp=3D0x0, flags=3D0, = incred=3D0xfffff80e32335200, outcred=3D0x0, = fsizetd=3D0xfffffe03586c0720) at ./vnode_if.h:2381 #20 vn_copy_file_range (invp=3Dinvp@entry=3D0xfffff8095e1e8000, = inoffp=3D0x40, inoffp@entry=3D0xfffff81910c3c7c8, = outvp=3D0xfffffe03527581d0, outvp@entry=3D0xfffff805d6107380, = outoffp=3D0xffffffff811e6eb7, outoffp@entry=3D0xfffff819860a2c78, = lenp=3D0x0, lenp@entry=3D0xfffffe0352758d50, flags=3Dflags@entry=3D0,= incred=3D0xfffff80e32335200, outcred=3D0xfffff80e32335200, = fsize_td=3D0xfffffe03586c0720) at = /usr/main-src/sys/kern/vfs_vnops.c:3085 #21 0xffffffff80c6b998 in kern_copy_file_range ( td=3Dtd@entry=3D0xfffffe03586c0720, infd=3D, = inoffp=3D0xfffff81910c3c7c8, inoffp@entry=3D0x0, outfd=3D, outoffp=3D0xfffff819860a2c78, outoffp@entry=3D0x0, = len=3D9223372036854775807, flags=3D0) at = /usr/main-src/sys/kern/vfs_syscalls.c:4971 #22 0xffffffff80c6bab8 in sys_copy_file_range (td=3D0xfffffe03586c0720, = uap=3D0xfffffe03586c0b20) at = /usr/main-src/sys/kern/vfs_syscalls.c:5009 #23 0xffffffff8104bab9 in syscallenter (td=3D0xfffffe03586c0720) at /usr/main-src/sys/amd64/amd64/../../kern/subr_syscall.c:187 #24 amd64_syscall (td=3D0xfffffe03586c0720, traced=3D0) at /usr/main-src/sys/amd64/amd64/trap.c:1197 #25 #26 0x00001ce4506d155a in ?? () Backtrace stopped: Cannot access memory at address 0x1ce44ec71e88 (kgdb)=20 Context details follow. Absent a openzfs-2.2 in: ls -C1 /usr/share/zfs/compatibility.d/openzfs-2.* /usr/share/zfs/compatibility.d/openzfs-2.0-freebsd /usr/share/zfs/compatibility.d/openzfs-2.0-linux /usr/share/zfs/compatibility.d/openzfs-2.1-freebsd /usr/share/zfs/compatibility.d/openzfs-2.1-linux I have copied: /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 over to: # ls -C1 /etc/zfs/compatibility.d/* /etc/zfs/compatibility.d/openzfs-2.2 and used it: # zpool get compatibility zamd64 NAME PROPERTY VALUE SOURCE zamd64 compatibility openzfs-2.2 local For reference: # zpool upgrade This system supports ZFS pool feature flags. All pools are formatted using feature flags. Some supported features are not enabled on the following pools. Once a feature is enabled the pool may become incompatible with software that does not support the feature. See zpool-features(7) for details. Note that the pool 'compatibility' feature can be used to inhibit feature upgrades. POOL FEATURE --------------- zamd64 redaction_list_spill which agrees with openzfs-2.2 . I did: # sysctl vfs.zfs.bclone_enabled=3D1 vfs.zfs.bclone_enabled: 0 -> 1 I also made a snapshot: zamd64@before-bclone-test and I then made a checkpoint. These were establshed just after the above enable. I then did a: zpool trim -w zamd64 The poudriere bulk command was: poudriere bulk -jmain-amd64-bulk_a -a where main-amd64-bulk_a has nothing prebuilt. USE_TMPFS=3Dno is in use. No form of ALLOW_MAKE_JOBS is in use. It is a 32 builder context (32 hardware threads). For reference: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #118 = main-n265152-f49d6f583e9d-dirty: Mon Sep 4 14:26:56 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.a= md64/sys/GENERIC-NODBG amd64 amd64 1500000 1500000 I'll note that with openzfs-2.1-freebsd compatibility I'd previously let such a bulk -a run for about 10 hr and it had reached 6366 port->package builds. Prior to that I'd done shorter experiments with default zpool features (no explicit compatibility constraint) but vfs.zfs.bclone_enabled=3D0 and I'd had no problems. (I have a separate M.2 boot media just for such experiments and can reconstruct its content at will.) All these have been based on the same personal main-n265152-f49d6f583e9d-dirty system build. Unfortunately, no appropriate snapshot of main was available to avoid my personal context being involved for the system build used. Similarly, the snapshot(s) of stable/14 predate: Sun, 03 Sep 2023 . . . git: f789381671a3 - stable/14 - zfs: merge openzfs/zfs@32949f256 = (zfs-2.2-release) into stable/14 that has required fixes for other issues. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 7 18:17:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhSC36g6Lz4smY6 for ; Thu, 7 Sep 2023 18:17:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-24.consmr.mail.gq1.yahoo.com (sonic312-24.consmr.mail.gq1.yahoo.com [98.137.69.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhSC260ftz3CKc for ; Thu, 7 Sep 2023 18:17:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=IH7HgLw3; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.205 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694110653; bh=5sFN3xXQaexLhfTaeL9ndfEG/M0UHb4VYVr0PE4Pt4I=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=IH7HgLw3JFhGvwXbS7xHYsEdLt1Y2UIWgGiXpHZLERRuNVaGeZXBj6SYYLPNSeXPUS/3eBVto81OkhejsYjW8lR6gQCdR+GzSTk1oBLTkDNSxrl+bgeS57OVRkQcZe1kp8AdFqcc9R1Gr7JSXFY7RIRdfUWYXGoILokrdit4KnB1sqPK5gFV1vh5rw5qvnYQ7Pks1KzCbnV3FhudZdnhYK3QqylCGLV8E5aPKoBN/O+ouIzi7hEuXpZ5lqo8GVFQINAX5o6LMsagpBNe1YvgLMjU7dSx6yQ8nxjUZ3YyqAJXqeIGWFwnNNzrOx2o24Iw4qNOwMSqYLx28fosIIZ96g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694110653; bh=48ftdgRrBHwrA8tgzroxr04zOUqAX6sejUQjV+r7hfn=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Lq9WOW0pbaUSmNIlAh/5whtMoMLrq8SejzvPHZPzV/NzA8QNpp5rjtqxfm7xgEucrui0sgwKJw7AVj8ROxWQ7zwZaU+ZGKflFTOv4jtC2iYpjBATeRkXDs2I1fWoBPwudBdl2g0IxmIp6HYLKVtGmJUnPoTFIa3CljQFR/JLL0+6WdFYrtOvuTmD77i/Wlv0juqGAu24ziB+eR+OxXMYPdmgQztOlNEDToWyznZ2S+tLeTcr+Qb2nK755Z+U8dr5QKmEPH3YDCZE4VzltsewkzHBS6EbIMt1OcPVxF+gpj0dEYe5ywIpme4bXTZyGWa8dnoSAisnUXQsX6Ee+c9Jsg== X-YMail-OSG: HAfkR1QVM1lNSKyNVzBjMBEn_ELh3PpL1S.SOJ3HrSL.776qmYtASIcsISCWUox TSkb8O1qjKp8hn.dSBx81XsQTGPl2OyfUNhzmaPjfmkgAKolez7fqgk22HFyW5wnj5qtlJ2nl7Pi LAd3HF0VIxI6lXv9O7q9mpEZwobTWvdc.gYLz_UmDs_kgcrTmpHENEk8CfG.OUtDGiMhXEQ0vdX6 XjKJbSf6BoP1ffUoEKKqa995lgqcl.NRyyVw.0Zh2S8_Vz8j2k2F7U5AG7yEs8YlRz_x.gCIQqZQ dGwli6AUrlnPrqp7Vu0hTNzrdf_6uXAKvNAO19h7ZDOQIvuVx2u.QBsjUFC6aEpE7o866S4Esq0Q zrvS7ySUznI8rM5e_NdbA0RRfHAxGpJmC1IwC7rhxwQfgJn_79jm0JACpJxbnjsqm5Igo1zebUNA Fu1q8fhjg.YmvBvHunuYBp.BauuQS6kl7LB9KXE2o_.E1mQFLxLq978GSEXXBCurCa7wC2uLxcws L_atX6P9YB_3ucqMU_jGbsWp_QZf3X5RP70DdH4n7xoXHbmjeoxv2jLbwSnVC_s3Jie0m62PgFU6 wgOSWJ08SeBiSoJIYGH_iwIFrUOzHHJQ4EVAIynXul9s4N6CFhlSqN0u26KCdqCkLthZJP79MXHL 4vMCNEvBmpUTJ6U4sqXjquoa_n.NLH_6D6jFzZB4HFfSLtFJDYnqFabH9UrTs3oFO2wdzz5GEOEw gKdM4av4ts7HP3J4GZJctwgD6WIJMMW1YRFSt9b89MtOgVvW4rR6NBlsElZlPeMdvYEvpeHQENgE wi7dMBxiGU1k5oWMDzcJE5qkKgsKmJN910ViQTW_RoMcX6EWcB44UfzqIWo5_JVG51_YcmfT_BU4 TEfoj6wUcQKDrTodm78ObLRR5Z2R0ifK2b3yu2osj.u5RITGM3pwslqV842LtObWXUdJaR2o40sS 96sSTKHdhZHXG9xZs1N2PuxUimRpuSoqzCRH6Txnzifcg20gJyamPzviMtrDGoqQ3xBHzlhgnRTp O_WZTBN08z5cIhkru2tbX2HBUUCMIaYPli1Z1lHP9np8UNeDd2WLbWe6vfTEOWSlgkdWCmJ1IY.x aPMJb9kfeov.5fH8dE07ZHLvQqy8OUHDqrOkVk5.wwqfExZHgAMJydquPQDQ8JexSHQI45AqiH7W wXUlVpiUi_SM9KIZpzOcFBPg3NZg8aV9uGYotBHTXu3oo4jc1yydPmVzycBRt87j4DnDrGE5RZTL CePEcD0xoGRzASpxq20Qt7XNju.ZP5Okzy3Rt74HsQPB0yU8gQuR8kNiWFqFbsdHjSnqFYo1ZAtq cIvWILOulw2pybomE8AGFIgKlAR81kbH7ACrGv9s213._ogip5GD8kN6Y.2dkIUWYyajheDqARqS PJs5Nh6IEyPTvtKXnUsdYw4P9_vAAqO_oGjkvk_KRr_TuWtZ.vXFCeLrs7Y_gfCm_KMgCS6Wikt5 86iI0qIaBTCCYICK1v3.xh4B15ju8BQa8yN2jB.2YQzBgq1Vx83SD38LrTsFRZ3PdM8csX9tgcXX 1UzZagFvVlGKm7nYKflIJPcYBGHUnkyG5GliCiYqMEQcuQ.v5UOt89x215Ev1mnCEyzJIznUw6NA GZ6kfE7zdcG4ggJsuO5nQbHVClQBEsccUdpitSmwKqcJATT6LbFRgywxJl8gXh9E3NXhacT5W_9p NRymhREw4XweUuSFzt5U96tqlR9TYMltnvliepmy7CKFl7bulnIItUoC.mOPAx4v1Ahb5LJQvU4W cnPclgeU52iUbHEyc2i_IrVqLBTX0ZkokAPs4QkTDGYHopJ0W2tGw9gs7yxfdB8kHuXRJ2TVvySl y7F4AnPd8A_RXuK6a.KtqM1pQLO1_Z0.GLLodcA6g6dv58vfUE8Ppmv7PH5U6MdqvV3DqlqFmaFF 6rBQiiaijYo2_fe_AUoZb_VhqLM1Ys0nzVJoTIgc6arztY52QIyo9fqjNbCMoITOTB3gWe7bbh4b H8fX5cmwOOkXCF6XbTNfRNfE4V06OgsOR.ESBbaG5cJkKa1vsbAS85zIW3oqsU_yRCIsEwI.rm86 A.OXhC55dQeSWN0nmuBHigu0XJpiHCCit.UmVgvHK42nj1be5d_eugFV_8OjdD.8fnfnqa6mexMc EcPuPQAqO0Zqux8VYQLr66oaOorldNC_5i_0W2mRE2MxqVSU94BKh6DP0PgCmbMp_EinfB9iOKCz UlBkitHRDi.I90OAwGNpk9sPJIXZjgQL98R748delGjYG_Ol4ciIXeAjN4or3w9VyvVFIu5D01jQ w._cHeMQE X-Sonic-MF: X-Sonic-ID: e84200eb-531b-4c8f-a9de-aa0a36d2dd20 Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Thu, 7 Sep 2023 18:17:33 +0000 Received: by hermes--production-bf1-865889d799-x5klk (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 54dbc57beef42a41a0b046b389ee1fcc; Thu, 07 Sep 2023 18:17:27 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> Date: Thu, 7 Sep 2023 11:17:22 -0700 Cc: Glen Barber , Pawel Jakub Dawidek , Alexander Motin Content-Transfer-Encoding: quoted-printable Message-Id: <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> To: Martin Matuska , Current FreeBSD , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.205:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.205:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RhSC260ftz3CKc [Drat, the request to rerun my tests did not not mention the more recent change: vfs: copy_file_range() between multiple mountpoints of the same fs type and I'd not noticed on my own and ran the test without updating.] On Sep 7, 2023, at 11:02, Mark Millard wrote: > I was requested to do a test with vfs.zfs.bclone_enabled=3D1 and > the bulk -a build paniced (having stored 128 *.pkg files in > .building/ first): Unfortunately, rerunning my tests with this set was testing a context predating: Wed, 06 Sep 2023 . . . =E2=80=A2 git: 969071be938c - main - vfs: copy_file_range() between = multiple mountpoints of the same fs type Martin Matuska So the information might be out of date for main and for stable/14 : I've no clue how good of a test it was. May be some of those I've cc'd would know. When I next have time, should I retry based on a more recent vintage of main that includes 969071be938c ? > # more /var/crash/core.txt.3 > . . . > Unread portion of the kernel message buffer: > panic: Solaris(panic): zfs: accessing past end of object 422/1108c16 = (size=3D2560 access=3D2560+2560) > cpuid =3D 15 > time =3D 1694103674 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe0352758590 > vpanic() at vpanic+0x132/frame 0xfffffe03527586c0 > panic() at panic+0x43/frame 0xfffffe0352758720 > vcmn_err() at vcmn_err+0xeb/frame 0xfffffe0352758850 > zfs_panic_recover() at zfs_panic_recover+0x59/frame 0xfffffe03527588b0 > dmu_buf_hold_array_by_dnode() at = dmu_buf_hold_array_by_dnode+0x97/frame 0xfffffe0352758960 > dmu_brt_clone() at dmu_brt_clone+0x61/frame 0xfffffe03527589f0 > zfs_clone_range() at zfs_clone_range+0xa6a/frame 0xfffffe0352758bc0 > zfs_freebsd_copy_file_range() at = zfs_freebsd_copy_file_range+0x1ae/frame 0xfffffe0352758c40 > vn_copy_file_range() at vn_copy_file_range+0x11e/frame = 0xfffffe0352758ce0 > kern_copy_file_range() at kern_copy_file_range+0x338/frame = 0xfffffe0352758db0 > sys_copy_file_range() at sys_copy_file_range+0x78/frame = 0xfffffe0352758e00 > amd64_syscall() at amd64_syscall+0x109/frame 0xfffffe0352758f30 > fast_syscall_common() at fast_syscall_common+0xf8/frame = 0xfffffe0352758f30 > --- syscall (569, FreeBSD ELF64, copy_file_range), rip =3D = 0x1ce4506d155a, rsp =3D 0x1ce44ec71e88, rbp =3D 0x1ce44ec72320 --- > KDB: enter: panic >=20 > __curthread () at /usr/main-src/sys/amd64/include/pcpu_aux.h:57 > 57 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" = (offsetof(struct pcpu, > (kgdb) #0 __curthread () at = /usr/main-src/sys/amd64/include/pcpu_aux.h:57 > #1 doadump (textdump=3Dtextdump@entry=3D0) > at /usr/main-src/sys/kern/kern_shutdown.c:405 > #2 0xffffffff804a442a in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) > at /usr/main-src/sys/ddb/db_command.c:591 > #3 0xffffffff804a422d in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) > at /usr/main-src/sys/ddb/db_command.c:504 > #4 0xffffffff804a3eed in db_command_loop () > at /usr/main-src/sys/ddb/db_command.c:551 > #5 0xffffffff804a7876 in db_trap (type=3D, = code=3D) > at /usr/main-src/sys/ddb/db_main.c:268 > #6 0xffffffff80bb9e57 in kdb_trap (type=3Dtype@entry=3D3, = code=3Dcode@entry=3D0, tf=3Dtf@entry=3D0xfffffe03527584d0) at = /usr/main-src/sys/kern/subr_kdb.c:790 > #7 0xffffffff8104ad3d in trap (frame=3D0xfffffe03527584d0) > at /usr/main-src/sys/amd64/amd64/trap.c:608 > #8 > #9 kdb_enter (why=3D, msg=3D) > at /usr/main-src/sys/kern/subr_kdb.c:556 > #10 0xffffffff80b6aab3 in vpanic (fmt=3D0xffffffff82be52d6 "%s%s", = ap=3Dap@entry=3D0xfffffe0352758700) > at /usr/main-src/sys/kern/kern_shutdown.c:958 > #11 0xffffffff80b6a943 in panic ( > fmt=3D0xffffffff820aa2e8 = "\312C$\201\377\377\377\377") > at /usr/main-src/sys/kern/kern_shutdown.c:894 > #12 0xffffffff82993c5b in vcmn_err (ce=3D, = fmt=3D0xffffffff82bfdd1f "zfs: accessing past end of object %llx/%llx = (size=3D%u access=3D%llu+%llu)", adx=3D0xfffffe0352758890) > at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/spl/spl_cmn_err.c:60 > #13 0xffffffff82a84d69 in zfs_panic_recover ( > fmt=3D0x12 ) > at /usr/main-src/sys/contrib/openzfs/module/zfs/spa_misc.c:1594 > #14 0xffffffff829f8e27 in dmu_buf_hold_array_by_dnode = (dn=3D0xfffff813dfc48978, offset=3Doffset@entry=3D2560, = length=3Dlength@entry=3D2560, read=3Dread@entry=3D0, = tag=3D0xffffffff82bd8175, numbufsp=3Dnumbufsp@entry=3D0xfffffe03527589bc, = dbpp=3D0xfffffe03527589c0, flags=3D0) > at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:543 > #15 0xffffffff829fc6a1 in dmu_buf_hold_array (os=3D, = object=3D, read=3D0, numbufsp=3D0xfffffe03527589bc, = dbpp=3D0xfffffe03527589c0, offset=3D, length=3D, tag=3D) > at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:654 > #16 dmu_brt_clone (os=3Dos@entry=3D0xfffff8010ae0e000, = object=3D, offset=3Doffset@entry=3D2560, = length=3Dlength@entry=3D2560, tx=3Dtx@entry=3D0xfffff81aaeb6e100, = bps=3Dbps@entry=3D0xfffffe0595931000, nbps=3D1, replay=3D0) at = /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:2301 > #17 0xffffffff82b4440a in zfs_clone_range (inzp=3D0xfffff8100054c910, = inoffp=3D0xfffff81910c3c7c8, outzp=3D0xfffff80fb3233000, = outoffp=3D0xfffff819860a2c78, lenp=3Dlenp@entry=3D0xfffffe0352758c00, = cr=3D0xfffff80e32335200) > at /usr/main-src/sys/contrib/openzfs/module/zfs/zfs_vnops.c:1302 > #18 0xffffffff829b4ece in zfs_freebsd_copy_file_range = (ap=3D0xfffffe0352758c58) > at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:629= 4 > #19 0xffffffff80c7160e in VOP_COPY_FILE_RANGE (invp=3D, = inoffp=3D0x40, outvp=3D0xfffffe03527581d0, = outoffp=3D0xffffffff811e6eb7, lenp=3D0x0, flags=3D0, = incred=3D0xfffff80e32335200, outcred=3D0x0, = fsizetd=3D0xfffffe03586c0720) at ./vnode_if.h:2381 > #20 vn_copy_file_range (invp=3Dinvp@entry=3D0xfffff8095e1e8000, = inoffp=3D0x40, inoffp@entry=3D0xfffff81910c3c7c8, = outvp=3D0xfffffe03527581d0, outvp@entry=3D0xfffff805d6107380, = outoffp=3D0xffffffff811e6eb7, outoffp@entry=3D0xfffff819860a2c78, = lenp=3D0x0, lenp@entry=3D0xfffffe0352758d50, flags=3Dflags@entry=3D0,= incred=3D0xfffff80e32335200, outcred=3D0xfffff80e32335200, = fsize_td=3D0xfffffe03586c0720) at = /usr/main-src/sys/kern/vfs_vnops.c:3085 > #21 0xffffffff80c6b998 in kern_copy_file_range ( > td=3Dtd@entry=3D0xfffffe03586c0720, infd=3D, = inoffp=3D0xfffff81910c3c7c8, inoffp@entry=3D0x0, outfd=3D, outoffp=3D0xfffff819860a2c78, outoffp@entry=3D0x0, = len=3D9223372036854775807, flags=3D0) at = /usr/main-src/sys/kern/vfs_syscalls.c:4971 > #22 0xffffffff80c6bab8 in sys_copy_file_range (td=3D0xfffffe03586c0720, = uap=3D0xfffffe03586c0b20) at = /usr/main-src/sys/kern/vfs_syscalls.c:5009 > #23 0xffffffff8104bab9 in syscallenter (td=3D0xfffffe03586c0720) > at /usr/main-src/sys/amd64/amd64/../../kern/subr_syscall.c:187 > #24 amd64_syscall (td=3D0xfffffe03586c0720, traced=3D0) > at /usr/main-src/sys/amd64/amd64/trap.c:1197 > #25 > #26 0x00001ce4506d155a in ?? () > Backtrace stopped: Cannot access memory at address 0x1ce44ec71e88 > (kgdb)=20 >=20 >=20 > Context details follow. >=20 > Absent a openzfs-2.2 in: >=20 > ls -C1 /usr/share/zfs/compatibility.d/openzfs-2.* > /usr/share/zfs/compatibility.d/openzfs-2.0-freebsd > /usr/share/zfs/compatibility.d/openzfs-2.0-linux > /usr/share/zfs/compatibility.d/openzfs-2.1-freebsd > /usr/share/zfs/compatibility.d/openzfs-2.1-linux >=20 > I have copied: >=20 > = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 >=20 > over to: >=20 > # ls -C1 /etc/zfs/compatibility.d/* > /etc/zfs/compatibility.d/openzfs-2.2 >=20 > and used it: >=20 > # zpool get compatibility zamd64 > NAME PROPERTY VALUE SOURCE > zamd64 compatibility openzfs-2.2 local >=20 > For reference: >=20 > # zpool upgrade > This system supports ZFS pool feature flags. >=20 > All pools are formatted using feature flags. >=20 >=20 > Some supported features are not enabled on the following pools. Once a > feature is enabled the pool may become incompatible with software > that does not support the feature. See zpool-features(7) for details. >=20 > Note that the pool 'compatibility' feature can be used to inhibit > feature upgrades. >=20 > POOL FEATURE > --------------- > zamd64 > redaction_list_spill >=20 > which agrees with openzfs-2.2 . >=20 > I did: >=20 > # sysctl vfs.zfs.bclone_enabled=3D1 > vfs.zfs.bclone_enabled: 0 -> 1 >=20 > I also made a snapshot: zamd64@before-bclone-test and > I then made a checkpoint. These were establshed just > after the above enable. >=20 > I then did a: zpool trim -w zamd64 >=20 > The poudriere bulk command was: poudriere bulk -jmain-amd64-bulk_a -a > where main-amd64-bulk_a has nothing prebuilt. USE_TMPFS=3Dno > is in use. No form of ALLOW_MAKE_JOBS is in use. It is a > 32 builder context (32 hardware threads). >=20 > For reference: >=20 > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #118 = main-n265152-f49d6f583e9d-dirty: Mon Sep 4 14:26:56 PDT 2023 = root@amd64_ZFS:/usr/obj/BUILDs/main-amd64-nodbg-clang/usr/main-src/amd64.a= md64/sys/GENERIC-NODBG amd64 amd64 1500000 1500000 >=20 > I'll note that with openzfs-2.1-freebsd compatibility I'd > previously let such a bulk -a run for about 10 hr and it > had reached 6366 port->package builds. >=20 > Prior to that I'd done shorter experiments with default > zpool features (no explicit compatibility constraint) > but vfs.zfs.bclone_enabled=3D0 and I'd had no problems. >=20 > (I have a separate M.2 boot media just for such experiments > and can reconstruct its content at will.) >=20 > All these have been based on the same personal > main-n265152-f49d6f583e9d-dirty system build. Unfortunately, > no appropriate snapshot of main was available to avoid my > personal context being involved for the system build used. > Similarly, the snapshot(s) of stable/14 predate: >=20 > Sun, 03 Sep 2023 > . . . > git: f789381671a3 - stable/14 - zfs: merge openzfs/zfs@32949f256 = (zfs-2.2-release) into stable/14 >=20 > that has required fixes for other issues. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 7 18:48:23 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhStf4gkfz4rrZG; Thu, 7 Sep 2023 18:48:26 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhStf4DYhz3Nm7; Thu, 7 Sep 2023 18:48:26 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694112506; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=8xGzZ6mOBVk45BMLBVTdI7zQeZeSv8bpekpKYxnAwgQ=; b=JpRPwCZOlPJnN6sDn+VBxmm0mrhczr8Povxhy40vrGpc6cSFClwZzsYEyMzWwTQ5p4syVH DIWAu+ea6URIslIgA6AIntPIJmmfPVCfX1FOmTliTAj5/D2g0RsyaFar9Cx9w3QFXIcNhZ Yegsv2mSkXApcFqTwPy7sMhTgiziCH9DwQrgwp8Zh4CYGPHUpaoPubSh2LuC4fY2zelw+m +x5BncHl+WK+OMx7t8m/V2varNEvZ4G9rT79a8n/CYQ7j483vPa4FF8wpN+ZskY8esE31p JcH1uWb3zeI5D21G4Ay7Js8V/Cq2tXp5FVmOTETimVhPyl6nfEiGF+LAFmfOpA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694112506; a=rsa-sha256; cv=none; b=DVdAOLjdcYrn6yEmeLVCsGeJQy8rZGUFlraMfvDgQgCm0d0EMrN/KzuuLXCfFGWkA6CqkO bHeYSBqkd1Idjt/kKtshkdzlFA0J0AMmOaEyKyLqSaij19/S1kt9g4gVt1NhTYNvvNw2s5 Q1GjN6P30t53295shkUu8zBOhD90+tBx+cLBcAyIif04h74L1h/XWz3xY1DdJ631v4Fh1e fAJPllXxm57VID5lvvcvPNN8MHd9hqrdiT+7iPbVGfm/unjH+pRv1CmCn8/bUBPpu8GinZ 8FAETMSO3FHX+ZHGkUR6JLLPU6SGsiAq9vfpRZdqR/uwGmyIewlQajc1dqpfOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694112506; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=8xGzZ6mOBVk45BMLBVTdI7zQeZeSv8bpekpKYxnAwgQ=; b=rluSIV+WIVihpbchR+11R+q9CLqY7m7xHjLmu8d5FyO8LbIuEDUUZIm/rou5WZDpE4askE +vgJx9hjTV/0IcG9MgFo/X/glOzkrERWuny1g3r5B6XtxWR3a/v1/3DhLkp28pGmsEhwjf lTnfaZ97JgnA7/QOjLxiZeAX58Xv6s2eCWXz4Pjw/NOI/E91ntlbbpgJOC4XtdTQiMmqRS NkwUCq0JK4hBMKGZ9l30MnToPjER0rYQZFppL/QuqCAp2PlnpZX8J0iyRJ9ybcmPXwkOS2 mAYuRBTuC4iYZjtoNdwvsBzBZGzjk0av2j4IfpR6SZPLzCQdWNcBd9kjvYFnUw== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 24355158A9; Thu, 7 Sep 2023 18:48:26 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Thu, 7 Sep 2023 18:48:23 +0000 From: Glen Barber To: Mark Millard Cc: Martin Matuska , Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek , Alexander Motin Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Message-ID: <20230907184823.GC4090@FreeBSD.org> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="AXo2lOxbfudqq8ta" Content-Disposition: inline In-Reply-To: <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> --AXo2lOxbfudqq8ta Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: > When I next have time, should I retry based on a more recent > vintage of main that includes 969071be938c ? >=20 Yes, please, if you can. Glen --AXo2lOxbfudqq8ta Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmT6GvcACgkQAxRYpUeP 4pPW0BAAlnTUPTfLJYS6O+vHnV6YYBLf3stXqdf17hsdwNQtwrbeRuhJRnmoyN5T QUowdKDSEYPjp49ibMBnHgSTYtjbEux+xmO6ctaSvqJCSLqPtkKsCvCprgdU4o/P a2r+iwQk/sPXaNMbl3DIPhBGNkM4teL9h5EYXzIdI2pf9O9ouyZKLbsgtYa8d/TR WFOnckiGn0uzGY6JGZ6MafmxrJFm3CisD6w2zPZYPdZCrxpXSIFD5GwDGMcUkvmn yrihpQspXDYQlKpE9yqI+DiA19+/NNAHsGGlcEkSeL04+0MRRf5fmKrxYwrhzp7n n5rZd/Du7gL7cdMAcdbOfIEBvlwt9b+5tdZ5XQHT1FfUinolLlUyA0ofzCOhPdDr OqPnoau3g4BCw28VRjWdUIbIKhyqvdRumiUvY1MPJQBkSNhO45mbDuJ8dlyeNLVm Bmnir5AJCLax6+tb4zENEUgzsqDGZzrsGDFanlyfkEGeRtDSJ4wPyk96XO/zHOFo KU53upxNIYV08dth9R5pb+/iCVszcVijyPHR8QCAqdPvcEhJnDMD3iGqeGe+g0J8 UuNHTLeOLiQ6zHsFmwGmS1bjYg6CmtY2zSOTTNMospAcXoDS6vax9a6w2rA3RBG6 JkbmjeilURuQJqhO03kOG9U41N1bfLNL0tosRYhhAv4JL4SteoA= =CbtC -----END PGP SIGNATURE----- --AXo2lOxbfudqq8ta-- From nobody Thu Sep 7 19:40:36 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhV3B1JSPz4sPnG for ; Thu, 7 Sep 2023 19:40:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-24.consmr.mail.gq1.yahoo.com (sonic312-24.consmr.mail.gq1.yahoo.com [98.137.69.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhV3B093qz4GW4 for ; Thu, 7 Sep 2023 19:40:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694115651; bh=M+MqA0csUHMUaWxa+zSanbioXgAJKG3pyTcBMhnMQXE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ExvcDhzXWBaMgD1BTMceAMM1v4sBmIiZsOgiuygpyy/Q7NcOyD0v/fHqeZLn5DiwcHCGZjqOEpp2PjteP6HUnkFs5fNwpHD26cW/EoPhyA69f2uthPWVLaNTQzcU4kp4dIG94Wgc7nBeF7o9apiz+WuEv6Fp4WZe7Y166ZG2Gs1bPN03zk7ZjxBeouBivpBXLgY2L85mObIFwgyL0bFtYK5s0u+xfQomAeLR0TIHXa7uSOesGinb9SBUGgpPqrfMdJ1jYM/V1bi7soovekgN4iSChdPShejYW0ZrO7C1Ou7hWEMwjTo7qlekZ9vP6rHCcjpMj4QZjfZ63dtfXIZBdw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694115651; bh=5uzItdXMPZXlqsvxzllCppFn3A7G0dLXEP8QXshmaEp=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=L0zLWaGAGoH19IMAqcMDWN7XD+/RMH0xYERyyIW7G7pJduSWghw8zi+1DS/r2IdUiRtAtBc11jonl4bsgY4jrZRfsvHs09S3s6dwxTnZyZAmtZj72uK6JqfqSWiLRD8Mw1AAOQbLLqHdgpLqa2wROfT2mNESKS1xbeVd0/dtr1AJxLB24pz50MA4cwGpv0BcZzYAAgyojvl6GCV3lCmyu7gq2s/cnIx/Fr+HZWK8s9yOv5Kdv4URVXXNKTniFNd4e0iDK247VKUvMWsM4R2mVRbKcioUwlrnkMBwQ+sBVhvEwaIUEjwJN0HPRwvglNDX9nBEv9ZBEvEgWiy8KifKsQ== X-YMail-OSG: XfCKd1UVM1mudsCeWaOX7hcoInv9rDMsEctY7fRMQvjpPpkFMfGLotROk51fY_t 95BdEfhaadg9fqfa77JsPiRs2LUL8vOjbcqT6JeVPoEmYiS7PrYy.tMFM4CKXn5CashVKqhL49tC yWrWyAyDCKZYrRFa6F3IimisOlEgu03Xq245g.l.sQV4rNAuWuu2AzGF5PXFO4TJUKcWaEhQYy72 3qqSfckpjt4EHBftR.DLN79w1L3O4UiXnIa1muZfXwQmDdC7wMjkTFmajWT5SziTISYG16q3lE0b o4U1x6qYjUX4bqwuU1_oGvqQkr0k83qhJ5bsazyEZpJqxvR2EOK04BFhnTwh3MrK3i4fyu9XKcLD .6z4tgUJc3xp1atCPPwgk27itEqoeyTXGnJQAbDDWb5XU8CNuYF15CDDNKrU3E2sQO2YbmHLIdrn 9G2cnyycFMlmGl4Api2AHKHjLnaZ4YNsshoWYnSNCq2jm.uyV.I4ZpD_j49OGftKHS5waevCi1EX 0dDicyM.UN3GBnHi_zWibgAD3UQ1OjQWVg1f50VzHque17xp76gGxeEwsD9foKyE4bod0.KWfnrU vsnk48BKdlEIhq.OGrQCkwrk92qsAIezjnfEpxLxuh9kPL8A2u2327ygF.ncOOc_J8oHFGZMo.ZQ gzSMwGvPDZmbX0TZMhBTHIMNvSAidG7Q16PCEMt3eyqhGV28xe3kfInlgI.n56kTXi6Tci0jL55u gomFAAR0o0ArF0oVOG7QA8I0BVc9zS2BKr3E1mBiphsrzqVDXwk8sy25ASSzsHLsX07FcyiUXBer p2ucCg.MGWxSBmfhUXd.ykeclhnqI9gpTCjWeQQKtQCjLfW1bHFSoxmqnswyn.f5nMpfYZkKBi83 3QtWuD1H9MiAsCrZPwaBk5T.ToXu5lt8Wpa74q8GqFQXCHRzhTMQkwLL.MkNFHlCOd1AVgaTXTzD RWqVEjzumWrvhQHfmD_bd_h1fqPiP4iw1R.PMlt.6RO1W2XJznfheMPyl158D_nptz0JYzRs2I1F mwWL3iLODzIenL1GSVMYUqE1oydAQQ_GNXNT_F7kQ3kTGlFWXMeJ9_k4ViXoaq2mQuqdLMex9jcl VVoGmxCEzooHvUsQOihlHMgvfD7A2kBnsUi94liIjNNfqM4z6UnPGJ2f0wRXS0y2zDEHJRPPqWSy TVZiyjas2R36tDQn1tSXRupNydbztFtTnNoNgZY9IPqptZtWmnAMzgRn4YQe4Sz92iV6g4on2Ndh iwXI0MIxqEqVQeigqoMZzxfPM5Fyt2JT66aak1l1LTaSnvMarXV4EP30aIX7sWXvKmd2HeMimuUI MoSg_H5xuDJVT6gPuNYge2DnD_P8VnN924P7o20FfDYM6dj6x..biD52HvfBs_Rtg48nbHMH.lIe rDSkMzMPMAvOf2v6sCI4tf5OFI5Lu23uHx0PQI08VggWVLvkYCwmC_5YBCKyvOO2qBUPcdrRJS8s yaTjfBi0e3hSEaTb3GFHap90Y.gppH8L6OIIiuj_UynyftrYP4jEAlC2g2XyNfJQH28TDCeQIWQx Iq0xuNmM.t.7CA4aaPyKrDvj_a2wGqLZPLrcQrx9Ki5vnXGGuWL9twZSKnjC5ACo0TBWGuU3_ZyM e1OH40L4371OZgni8rxJbcb2g00AL9nxW3jba.jg5UjggDN3OwAJj0hrQ.gnyK9VqnuSIAhD.QqO J8NzlMsfvAJpE7bZUp884aDX5GioytjHJYUbNLGgL._Bo8uAmytBRhNP6cKov.N7NEC4IaQP6.mA JEcWGo5w1ssQW_NOvC.xLbdkkbPsny8bOyze6vrJ1sW6KUhqjqFt0kHdaaMFmvQAmKKTsZWCZwEh 7XNaECEwtjRH3A3p85dUTOF9T9g4pwbtYjURftG3qVXxNnJ_xQ7kLoUCyuR0ck_EmI9_c_nNalbY VvhlSR7siflFU5744xfy1ndHGSeCqskPMjF4IVZLrrlfQCRzFNTYP3xwBBxuqoUTXQu9aRCERvab WWx11u0TMOyBT7TUz2geTC5X69SOq0WpdapAoDdOSJPaCbAOkw15guI2fvq92AajFRZE1eCjEjl5 C6SHQYZWB2R4dTmU_vC1tmlyXE8_ZmDNcin_CmHo9tXqgY.x.a5rxkPtquUDmYAnUQxVh9bAiBQZ uftSTs7vfBnDsPs1hUWoOUf8ZTBV2OZQ.IMrSwHCSwjdI6uKg0hBgvDZt0cQkvapf.rE1OXDf7ic yxmP9ZkoM62x4dcGtJwxR0JSVro07P0aloVeC6VAgCSXG53XNO4T_PTHnvgd57.P7vMPGxuxux7b sr9CQYPAUTfQtnOg- X-Sonic-MF: X-Sonic-ID: 18bdaa88-2da8-4fe7-af1d-7060ca596b3b Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Thu, 7 Sep 2023 19:40:51 +0000 Received: by hermes--production-gq1-6b7c87dcf5-qfzfj (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f3670204f7cff43689bc2a6e6d8c3804; Thu, 07 Sep 2023 19:40:47 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <20230907184823.GC4090@FreeBSD.org> Date: Thu, 7 Sep 2023 12:40:36 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek , Alexander Motin Content-Transfer-Encoding: quoted-printable Message-Id: References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> To: Glen Barber , Martin Matuska X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RhV3B093qz4GW4 On Sep 7, 2023, at 11:48, Glen Barber wrote: > On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: >> When I next have time, should I retry based on a more recent >> vintage of main that includes 969071be938c ? >>=20 >=20 > Yes, please, if you can. As stands, I rebooted that machine into my normal enviroment, so the after-crash-with-dump-info context is preserved. I'll presume lack of a need to preserve that context unless I hear otherwise. (But I'll work on this until later today.) Even my normal environment predates the commit in question by a few commits. So I'll end up doing a more general round of updates overall. Someone can let me know if there is a preference for debug over non-debug for the next test run. Looking at "git: 969071be938c - main", the relevant part seems to be just (white space possibly not preserved accurately): diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c index 9fb5aee6a023..4e4161ef1a7f 100644 --- a/sys/kern/vfs_vnops.c +++ b/sys/kern/vfs_vnops.c @@ -3076,12 +3076,14 @@ vn_copy_file_range(struct vnode *invp, off_t = *inoffp, struct vnode *outvp, goto out; =20 /* - * If the two vnode are for the same file system, call + * If the two vnodes are for the same file system type, call * VOP_COPY_FILE_RANGE(), otherwise call = vn_generic_copy_file_range() - * which can handle copies across multiple file systems. + * which can handle copies across multiple file system types. */ *lenp =3D len; - if (invp->v_mount =3D=3D outvp->v_mount) + if (invp->v_mount =3D=3D outvp->v_mount || + strcmp(invp->v_mount->mnt_vfc->vfc_name, + outvp->v_mount->mnt_vfc->vfc_name) =3D=3D 0) error =3D VOP_COPY_FILE_RANGE(invp, inoffp, outvp, = outoffp, lenp, flags, incred, outcred, fsize_td); else That looks to call VOP_COPY_FILE_RANGE in more contexts and vn_generic_copy_file_range in fewer. The backtrace I reported involves: VOP_COPY_FILE_RANGE So it appears this change is unlikely to invalidate my test result, although failure might happen sooner if more VOP_COPY_FILE_RANGE calls happen with the newer code. That in turns means that someone may come up with some other change for me to test by the time I get around to setting up another test. Let me know if so. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 7 20:07:55 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhVg86Z0Hz4sh32; Thu, 7 Sep 2023 20:08:36 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-oi1-x234.google.com (mail-oi1-x234.google.com [IPv6:2607:f8b0:4864:20::234]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhVg84j9Dz4R46; Thu, 7 Sep 2023 20:08:36 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oi1-x234.google.com with SMTP id 5614622812f47-3ab3aa9ae33so983599b6e.2; Thu, 07 Sep 2023 13:08:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694117316; x=1694722116; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=qYhcbEsafebrUYIdq8f68T9hpIi/Uoo+JVfBQEkiuQw=; b=MIHw3rKlwGexVTimGLCebSIIRsUKQJ+tYV68V2W1lhGu3+hqBQ9ePiWL5FrdRJabla 2YRCjwv5GWZWMpzZX2ILTXI8uqSqI76DkjgSie2/EPgiEE4wuXuhCO65zbqD5fLB4wXX 0Andd73hMsi5lHM+ioLaxJ9uydIUSW91m8cs+laMZkpy5rDCV7PX9DK38AYF3zMPJDqa yz3H9hmrsu+6n6mJCHZTixROcLhsROayW8/6EH30fi7uIl3kz/38yTIyO3aqpiNVCV5g dFJRu3Ia1fqH7ED4g+ZWMLk4x8PO4dW8mUhGR/Te3sP1i1ncQ+TThmhrF2+Qc9egRK7I d6eg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694117316; x=1694722116; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=qYhcbEsafebrUYIdq8f68T9hpIi/Uoo+JVfBQEkiuQw=; b=QHfqVALxlfqh9L07XOIb21AwlBo6pUcpHJGiAhMU606kFs02TKvdVM7+KftreH3hni tbuNXlZxnhv/x8EsrSlF9bp3PNkksoh7SDOQ3Cztrebc0YrviBLQI2cvJkc3X5CUjJ1b o6mtKjjxxPzafiWp3vwHxVYtimsxkZPyADv1i5z5/zewlOT9YO6vJa21BpNICnSgeeqF 8nR4+0hiZ8m46DI+4ciwR65gzGmUbMjJJv4ptE21YruFz9h1VOUKXCf3GpFBV7j+G8om QR2sJU4KAVo937/pvEUch+srswzpzwhS0hG3cHfNMxNBGgvGWNoLh3qeLSFDGNbcGW7B wtYA== X-Gm-Message-State: AOJu0YwFZBg7p71ERpGQv8kCaV10jtYUIbhba9rZFAnZrwZbbQtWgTZs aOla51v5HyzIBqA+irlgkMhDRBVl/fX46A== X-Google-Smtp-Source: AGHT+IG1FSLvSjXyMr8r+ifF0ilm5Q34xaA1h2cXf3b6mEp/AgqG5Qbd7ZptnYpluEz6A6yC2qB3BQ== X-Received: by 2002:a05:6808:21a3:b0:3a1:dd99:8158 with SMTP id be35-20020a05680821a300b003a1dd998158mr826362oib.6.1694117315617; Thu, 07 Sep 2023 13:08:35 -0700 (PDT) Received: from [10.230.45.5] ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id x188-20020a0deec5000000b00592236855cesm51245ywe.61.2023.09.07.13.08.34 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 07 Sep 2023 13:08:35 -0700 (PDT) Message-ID: <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> Date: Thu, 7 Sep 2023 16:07:55 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: Mark Millard , Glen Barber , Martin Matuska Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> From: Alexander Motin Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RhVg84j9Dz4R46 Thanks, Mark. On 07.09.2023 15:40, Mark Millard wrote: > On Sep 7, 2023, at 11:48, Glen Barber wrote: > >> On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: >>> When I next have time, should I retry based on a more recent >>> vintage of main that includes 969071be938c ? >> >> Yes, please, if you can. > > As stands, I rebooted that machine into my normal > enviroment, so the after-crash-with-dump-info > context is preserved. I'll presume lack of a need > to preserve that context unless I hear otherwise. > (But I'll work on this until later today.) > > Even my normal environment predates the commit in > question by a few commits. So I'll end up doing a > more general round of updates overall. > > Someone can let me know if there is a preference > for debug over non-debug for the next test run. It is not unknown when some bugs disappear once debugging is enabled due to different execution timings, but generally debug may to detect the problem closer to its origin instead of looking on random consequences. I am only starting to look on this report (unless Pawel or somebody beat me on it), and don't have additional requests yet, but if you can repeat the same with debug kernel (in-base ZFS's ZFS_DEBUG setting follows kernel's INVARIANTS), it may give us some additional information. > Looking at "git: 969071be938c - main", the relevant > part seems to be just (white space possibly not > preserved accurately): > > diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c > index 9fb5aee6a023..4e4161ef1a7f 100644 > --- a/sys/kern/vfs_vnops.c > +++ b/sys/kern/vfs_vnops.c > @@ -3076,12 +3076,14 @@ vn_copy_file_range(struct vnode *invp, off_t *inoffp, struct vnode *outvp, > goto out; > > /* > - * If the two vnode are for the same file system, call > + * If the two vnodes are for the same file system type, call > * VOP_COPY_FILE_RANGE(), otherwise call vn_generic_copy_file_range() > - * which can handle copies across multiple file systems. > + * which can handle copies across multiple file system types. > */ > *lenp = len; > - if (invp->v_mount == outvp->v_mount) > + if (invp->v_mount == outvp->v_mount || > + strcmp(invp->v_mount->mnt_vfc->vfc_name, > + outvp->v_mount->mnt_vfc->vfc_name) == 0) > error = VOP_COPY_FILE_RANGE(invp, inoffp, outvp, outoffp, > lenp, flags, incred, outcred, fsize_td); > else > > That looks to call VOP_COPY_FILE_RANGE in more contexts and > vn_generic_copy_file_range in fewer. > > The backtrace I reported involves: VOP_COPY_FILE_RANGE > So it appears this change is unlikely to invalidate my > test result, although failure might happen sooner if > more VOP_COPY_FILE_RANGE calls happen with the newer code. Your logic is likely right, but if you have block cloning requests both within and between datasets, this patch may change the pattern. Though it is obviously not a fix for the issue. I responded to the commit email only because it makes no difference while vfs.zfs.bclone_enabled is 0. > That in turns means that someone may come up with some > other change for me to test by the time I get around to > setting up another test. Let me know if so. -- Alexander Motin From nobody Thu Sep 7 23:32:34 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhbBr6wKXz4sfBj for ; Thu, 7 Sep 2023 23:32:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhbBr3tVzz4TJc for ; Thu, 7 Sep 2023 23:32:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694129570; bh=h1aQmrPwATVZowD7blxy+TP63SaEbhwfe/6+Klbn7sY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=hY5OHGq6Z197abcd5rwNaRlnjh2DuXW8Mrn7O1r12QoKkHrS/EFcgk4qcQij1I+Z9v9C3fDnDpqvmEA/1ksaHEg0HY8iGYxra+SM3Vc5h9VCHbG0tea/GBda/vo1ARbsKc7t7oA3WR0TQrp5TyIMld5S51swhGLsJO9oKqKpPML4cKhahucerUapLZf7mK1/A3LrFzAwV6a8TJ+aeUSr5KALV86AZto41z4oDBW+uV34o3YQyp8kDlj6XPx5+lTM8nFnuJVhwCxujVqU2iQIVzW9Idx7+aj+SxfU1cGbmGmnRsqL23lnAOn0N55rITS8mC9DCS1bd4Tz9PAr/5HUTg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694129570; bh=Au1pKf3QM0gKdWxsuhGp96p2UJ7zPBBvqXFmYcWajBG=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=IUZEvTdXQE1lj8Gxgl+IVG51RoNGr83GFiBrbf66Jjg2T3V5Niwi7MZOC+/d9dT0J4TcVb1L7gdLAM+JcXugevUBILwzFQa1pLU9Gi0rX91Tn2PYvMJ3/tQaN/4C7dev2wg4Ser4FwRDlQePE2a2Dh9zT8sGQjHSnLnbZ/v+p8rOgzqGEVzUqYGAlgJmb21yWbUld1B4qwiSEn2dhB22ajheTKZIS4YXuS7i5m1vUiFT3JRLh0GN9moQ+QJFOCJJUUrdF6wY9MdmjA3eutSNvjLHR0RNjotuXbiHnc4HGdQwlCCy5P/BgD22UpznRgbg9K4J83A/1eHAJfoO6Jmnog== X-YMail-OSG: xT_GXLEVM1lTy3ILszW9tsmN5Fm7x9FquhYBqyIqgZA4ko1rR4.vWjuiAF8ABj_ CEVR7FSz82uleVcVGCOIix3ei5Hvobblg0m2BOYnSGHeQ_0ovT.ooFgSACtXUAcWSzUVBldFAlDk Y.UsD_x0Zq6ClyGPsj6HU6azgNNxbz7bLnQEb0z5n.c0UOZNlQKIcYfppa0_wLRrSwZRm4.glVEN nXwevOwdIlJkKW_jX4HhkK1N2g8EQOFDrEUYu3.sFwPhNHeIu1LJoCvt0brr7tzItHG6DdWLyTR6 EWH9QODAamsTt968D5OS7ldWVsqLmJ4KdXQx1XVWKdEkKCKE.gbWutAjUW_Hlw_LnkySPyx96xHj LKnrfG6XMDK1XreiTbeLfwK6KT2FlSnvuhZQkWhg_VHLHFikx3uLHibmDM0Ack3TIAdYkbUxxl69 jgceb8Iwf8u_GT_mAEkvv6NC1hBVMsxGkUOAjYDo_elBKFuWbqgm7d4FGNAPyLzzWLDDhJqP2ZH7 CNnAOj8PhKNWq6Y0.WfH46kIkTE8jBv.PkjDAoLBR8.3Qn2zPKz.UOqHGfvAwVUWCnByAZ4ppz1U vsHxtteYea_aPTDxqEsI5NSsTE8.6deIzbHv2Z9fDopBW31lMhhn.0pyz5DZnX5wwgk8oo1ls9mI 6AqW5q06cJvxNH1Pizot2zh9DUzfgqhmPVtn7iQWFS.H5W_tQcY.ncdlpBovCxajwylU5moq3GKq NefQBRsiSSxFhJ4e6zH.WVUBdS8hEi5lzQrdprrL2raugxrMP.ttpTh0zq6jSQOluxq9t54Z8kSz _70uGUL1Hqp2oeJdRJL3L85Gvg1a7SmQaZz3geI0XGymwQb0hMDHGErU.m9saLN67lo4GMgDwQbI HfWn9oi9EcN1V8dqVuAwiiwP7KuxgOZO4NK5LOu7waHkPTvrkaVlAviJGd4aSB5A8jy6yI_ye0mw g6lBfVWqLxw74O6A58Cw0hQasOONF0gTdGQFVPNVw7ZV5YfYEi9Lef_VR_7NzQic4oJgkqW1j4.Z O80mb6zt2cXamRJbUqZaUU7XbrdhkKAEHY6XPWnWZD7hGSS.RGKrqO5ahdXzarEJTS.XIJadlm58 Hqv5v9qd3k6jw24snMSKNL7SgwU8O8kPbM7kCYqGwVfkEJl_AbktmosMw9ypv_3HYVsVr_KgxSHj XHYpQdifaAKDyfS5p2g.fLPYdjRpALVSeBxC2Ttbf17zgZxq94XKkij7GLBZpHF6k_NG0R7TSigH iVmcXL2FvnYPiURpT6VshCvXmiMR41SXYn3wsNcEyhwPBXXCEuPPmoYBYuKw14nd7lqT.dbJiUJ4 1UWdBd44v0ftO9LY4okU4H25PtiGd8sUaYoByilf_GSgvw.EWUNPz0pDFrdDpJkZmVI7SchwttPg CGPJX6b8qYLjcsU4OayJoGe_nSrKEg4zyOPo1jXL3I6ipjNxFFV4jfhImMM_THH2ZewtfU91kOKo YzQ6JXSm07HSylHj_.R9PSkjmjsCOxBu6sRe7SnyFvi.WKLAD5zquMUTEGN3kw.t4.QuZmJQlUzt zk1JDfc3TB00LUxEoDn6TeBHpegEmBuNsMA8QVThvZTswK7vRXL4ncel_mULAqNrFUz9Vq71xTuj Xb4vXG4p3xnnzVB32kuUjuNts3gl3BPxlyAFxTvLvDl3wf0KLuoHUG.BMG9B6XlaSHB3sW9toaFA HrjnfFzAgZLJcogtbnhqsOSpZhnye6zIz6dbynAaMrpw3RHc11nUFPBgIb81ReGK5Q_UVy.k0kX9 DxWmWsdL2pRMiJK8IqjmR.UhO_Mqgojdi7v3mYhfnf3ApKGV2rC1qZQ7NJBHNoWQ_FbRQBOrxqDa r0AHhdAAveRTRpqhqoBHa916MyPvp6trN2xRujyoJxGosVAa9Mf0S9_aRwbHJZX6w4PqGNZmvlHG dPtfSX2Ril2p.TQlWroU4qjZXUK6W7p.3OHSsYYi1WTK6Kc.rO0KL723Vd6RD.gMNsK4MQEie1Rl s_J2CQdqw00PmRtwskfFV3lQADfzyH_QGxCOjngfxAJVrBh5Ba1.Fhp49K_L7dLGa33d3aQ9TMSz H0QskMlp0rJ2WOzG8LwsXCvbbvLncNedvo6.RuAywAkP3Dphe0BBzrjv3JAHd2zJyWpBg7.esUDe FtuPVcx3kKUqI2afubRBz9OQpwjLJPEtqbYzjwfB_YtqUGTQu9SOWZL05Yzi.XID.Xsj47dCvz0h aHlzUx6SedPfFjNleqvslr1_HvIM8iJR9u70Dq1PoDY6tf5QFYCxJIHfzbj7d9Hoj.uRdGGJcy4V HwhDpZUtJ X-Sonic-MF: X-Sonic-ID: 47d7f830-3b57-42e9-9641-67c4340520e4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Thu, 7 Sep 2023 23:32:50 +0000 Received: by hermes--production-ne1-7b767b77cc-q899j (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID ad8c6981922bf36ed77b9b2519e01bd1; Thu, 07 Sep 2023 23:32:45 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> Date: Thu, 7 Sep 2023 16:32:34 -0700 Cc: Glen Barber , Martin Matuska , Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RhbBr3tVzz4TJc On Sep 7, 2023, at 13:07, Alexander Motin wrote: > Thanks, Mark. >=20 > On 07.09.2023 15:40, Mark Millard wrote: >> On Sep 7, 2023, at 11:48, Glen Barber wrote: >>> On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: >>>> When I next have time, should I retry based on a more recent >>>> vintage of main that includes 969071be938c ? >>>=20 >>> Yes, please, if you can. >> As stands, I rebooted that machine into my normal >> enviroment, so the after-crash-with-dump-info >> context is preserved. I'll presume lack of a need >> to preserve that context unless I hear otherwise. >> (But I'll work on this until later today.) >> Even my normal environment predates the commit in >> question by a few commits. So I'll end up doing a >> more general round of updates overall. >> Someone can let me know if there is a preference >> for debug over non-debug for the next test run. >=20 > It is not unknown when some bugs disappear once debugging is enabled = due to different execution timings, but generally debug may to detect = the problem closer to its origin instead of looking on random = consequences. I am only starting to look on this report (unless Pawel or = somebody beat me on it), and don't have additional requests yet, but if = you can repeat the same with debug kernel (in-base ZFS's ZFS_DEBUG = setting follows kernel's INVARIANTS), it may give us some additional = information. So I did a zpool import, rewinding to the checkpoint. (This depends on the questionable zfs doing fully as desired for this. Notably the normal environment has vfs.zfs.bclone_enabled=3D0 , including when it was doing this activity.) My normal environment reported no problems. Note: the earlier snapshot from my first setup was still in place since it was made just before the original checkpoint used above. However, the rewind did remove the /var/crash/ material that had been added. I did the appropriate zfs mount. I installed a debug kernel and world to the import. Again, no problems reported. I did the appropriate zfs umount. I did the appropriate zpool export. I rebooted with the test media. # sysctl vfs.zfs.bclone_enabled vfs.zfs.bclone_enabled: 1 # zpool trim -w zamd64 # zpool checkpoint zamd64 # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #74 = main-n265188-117c54a78ccd-dirty: Tue Sep 5 21:29:53 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 (So, before the 969071be938c vintage, same sources as for my last run but a debug build.) # poudriere bulk -jmain-amd64-bulk_a -a . . . [00:03:23] Building 34214 packages using up to 32 builders [00:03:23] Hit CTRL+t at any time to see build progress and stats [00:03:23] [01] [00:00:00] Builder starting [00:04:19] [01] [00:00:56] Builder started [00:04:20] [01] [00:00:01] Building ports-mgmt/pkg | pkg-1.20.6 [00:05:33] [01] [00:01:14] Finished ports-mgmt/pkg | pkg-1.20.6: Success [00:05:53] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 [00:05:53] [02] [00:00:00] Builder starting . . . [00:05:54] [32] [00:00:00] Builder starting [00:06:11] [01] [00:00:18] Finished print/indexinfo | indexinfo-0.3.1: = Success [00:06:12] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 [00:08:24] [01] [00:02:12] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success [00:08:31] [01] [00:00:00] Building devel/libtextstyle | = libtextstyle-0.22 [00:10:06] [05] [00:04:13] Builder started [00:10:06] [05] [00:00:00] Building devel/autoconf-switch | = autoconf-switch-20220527 [00:10:06] [31] [00:04:12] Builder started [00:10:06] [31] [00:00:00] Building devel/libatomic_ops | = libatomic_ops-7.8.0 . . . Crashed again, with 158 *.pkg files in .building/All/ after rebooting. The crash is similar to the non-debug one. No extra output from the debug build. For reference: Unread portion of the kernel message buffer: panic: Solaris(panic): zfs: accessing past end of object 422/10b1c02 = (size=3D2560 access=3D2560+2560) cpuid =3D 15 time =3D 1694127988 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe02e783b5a0 vpanic() at vpanic+0x132/frame 0xfffffe02e783b6d0 panic() at panic+0x43/frame 0xfffffe02e783b730 vcmn_err() at vcmn_err+0xeb/frame 0xfffffe02e783b860 zfs_panic_recover() at zfs_panic_recover+0x59/frame 0xfffffe02e783b8c0 dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0xb8/frame = 0xfffffe02e783b970 dmu_brt_clone() at dmu_brt_clone+0x61/frame 0xfffffe02e783b9f0 zfs_clone_range() at zfs_clone_range+0xaa3/frame 0xfffffe02e783bbc0 zfs_freebsd_copy_file_range() at zfs_freebsd_copy_file_range+0x18a/frame = 0xfffffe02e783bc40 vn_copy_file_range() at vn_copy_file_range+0x114/frame = 0xfffffe02e783bce0 kern_copy_file_range() at kern_copy_file_range+0x36c/frame = 0xfffffe02e783bdb0 sys_copy_file_range() at sys_copy_file_range+0x78/frame = 0xfffffe02e783be00 amd64_syscall() at amd64_syscall+0x14f/frame 0xfffffe02e783bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame = 0xfffffe02e783bf30 --- syscall (569, FreeBSD ELF64, copy_file_range), rip =3D = 0xa8a8d32b55a, rsp =3D 0xa8a8c8fa158, rbp =3D 0xa8a8c8fa5f0 --- KDB: enter: panic __curthread () at /usr/main-src/sys/amd64/include/pcpu_aux.h:57 57 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" = (offsetof(struct pcpu, (kgdb) #0 __curthread () at = /usr/main-src/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=3Dtextdump@entry=3D0) at /usr/main-src/sys/kern/kern_shutdown.c:405 #2 0xffffffff804a505a in db_dump (dummy=3D,=20 dummy2=3D, dummy3=3D, = dummy4=3D) at /usr/main-src/sys/ddb/db_command.c:591 #3 0xffffffff804a4e5d in db_command (last_cmdp=3D,=20 cmd_table=3D, dopager=3Dtrue) at /usr/main-src/sys/ddb/db_command.c:504 #4 0xffffffff804a4b1d in db_command_loop () at /usr/main-src/sys/ddb/db_command.c:551 #5 0xffffffff804a81f6 in db_trap (type=3D, = code=3D) at /usr/main-src/sys/ddb/db_main.c:268 #6 0xffffffff80bb0793 in kdb_trap (type=3Dtype@entry=3D3, = code=3Dcode@entry=3D0,=20 tf=3Dtf@entry=3D0xfffffe02e783b4e0) at = /usr/main-src/sys/kern/subr_kdb.c:790 #7 0xffffffff810623c9 in trap (frame=3D0xfffffe02e783b4e0) at /usr/main-src/sys/amd64/amd64/trap.c:608 #8 #9 kdb_enter (why=3D, msg=3D) at /usr/main-src/sys/kern/subr_kdb.c:556 #10 0xffffffff80b61b33 in vpanic (fmt=3D0xffffffff82c3914f "%s%s",=20 ap=3Dap@entry=3D0xfffffe02e783b710) at /usr/main-src/sys/kern/kern_shutdown.c:958 #11 0xffffffff80b61913 in panic ( fmt=3D0xffffffff82369800 = "W\346\025\201\377\377\377\377") at /usr/main-src/sys/kern/kern_shutdown.c:894 #12 0xffffffff8299464b in vcmn_err (ce=3D,=20 fmt=3D0xffffffff82c6f791 "zfs: accessing past end of object = %llx/%llx (size=3D%u access=3D%llu+%llu)", adx=3D0xfffffe02e783b8a0) at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/spl/spl_cmn_err.c:60 #13 0xffffffff82ab1ab9 in zfs_panic_recover ( fmt=3D0x12 ) at /usr/main-src/sys/contrib/openzfs/module/zfs/spa_misc.c:1594 #14 0xffffffff82a10138 in dmu_buf_hold_array_by_dnode = (dn=3D0xfffff80b9edd67f0,=20 offset=3Doffset@entry=3D2560, length=3Dlength@entry=3D2560, = read=3Dread@entry=3D0,=20 tag=3D0xffffffff82c1c507, = numbufsp=3Dnumbufsp@entry=3D0xfffffe02e783b9bc,=20 dbpp=3D0xfffffe02e783b9c0, flags=3D0) at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:543 #15 0xffffffff82a13c91 in dmu_buf_hold_array (os=3D,=20 object=3D, read=3D0, numbufsp=3D0xfffffe02e783b9bc,=20= dbpp=3D0xfffffe02e783b9c0, offset=3D, = length=3D,=20 tag=3D) at /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:654 #16 dmu_brt_clone (os=3Dos@entry=3D0xfffff8011e989800, object=3D,=20 offset=3Doffset@entry=3D2560, length=3Dlength@entry=3D2560,=20 tx=3Dtx@entry=3D0xfffff81b68d0bb00, = bps=3Dbps@entry=3D0xfffffe04bcc60000, nbps=3D1,=20 replay=3D0) at = /usr/main-src/sys/contrib/openzfs/module/zfs/dmu.c:2301 #17 0xffffffff82b7e393 in zfs_clone_range (inzp=3D0xfffff805a65f7000,=20 inoffp=3D0xfffff805c5e13548, outzp=3D0xfffff809d42c2cb0,=20 outoffp=3D0xfffff80134c184f8, lenp=3Dlenp@entry=3D0xfffffe02e783bc00,=20= cr=3D0xfffff8041841f700) at /usr/main-src/sys/contrib/openzfs/module/zfs/zfs_vnops.c:1302 #18 0xffffffff829b77ca in zfs_freebsd_copy_file_range = (ap=3D0xfffffe02e783bc58) at = /usr/main-src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:629= 4 #19 0xffffffff80c74694 in VOP_COPY_FILE_RANGE (invp=3D,=20= inoffp=3D, outvp=3D0xffffffff81183b4f,=20 outvp@entry=3D0xfffffe02e783bce0, outoffp=3D0xffffffff812265a2, = lenp=3D0x0,=20 lenp@entry=3D0xfffffe02e783bc70, flags=3D0, = incred=3D0xfffff8041841f700,=20 outcred=3D0x0, fsizetd=3D0xfffffe021b5f4740) at ./vnode_if.h:2385 #20 vn_copy_file_range (invp=3Dinvp@entry=3D0xfffff80435eef8c0,=20 inoffp=3Dinoffp@entry=3D0xfffff805c5e13548, = outvp=3D0xffffffff81183b4f,=20 outvp@entry=3D0xfffff80ce8c8ee00, outoffp=3D0xffffffff812265a2, = lenp=3D0x0,=20 lenp@entry=3D0xfffffe02e783bd40, flags=3Dflags@entry=3D0,=20 incred=3D0xfffff8041841f700, outcred=3D0xfffff8041841f700,=20 fsize_td=3D0xfffffe021b5f4740) at = /usr/main-src/sys/kern/vfs_vnops.c:3085 #21 0xffffffff80c6f22c in kern_copy_file_range ( td=3Dtd@entry=3D0xfffffe021b5f4740, infd=3D,=20 inoffp=3D0xfffff805c5e13548, inoffp@entry=3D0x0, outfd=3D,=20 outoffp=3D0xffffffff812265a2, outoffp@entry=3D0x0, = len=3D9223372036854775807,=20 flags=3D0) at /usr/main-src/sys/kern/vfs_syscalls.c:4971 #22 0xffffffff80c6f338 in sys_copy_file_range (td=3D0xfffffe021b5f4740,=20= uap=3D0xfffffe021b5f4b40) at = /usr/main-src/sys/kern/vfs_syscalls.c:5009 #23 0xffffffff8106323f in syscallenter (td=3D0xfffffe021b5f4740) at /usr/main-src/sys/amd64/amd64/../../kern/subr_syscall.c:187 #24 amd64_syscall (td=3D0xfffffe021b5f4740, traced=3D0) at /usr/main-src/sys/amd64/amd64/trap.c:1197 #25 #26 0x00000a8a8d32b55a in ?? () Backtrace stopped: Cannot access memory at address 0xa8a8c8fa158 (kgdb)=20 >> Looking at "git: 969071be938c - main", the relevant >> part seems to be just (white space possibly not >> preserved accurately): >> diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c >> index 9fb5aee6a023..4e4161ef1a7f 100644 >> --- a/sys/kern/vfs_vnops.c >> +++ b/sys/kern/vfs_vnops.c >> @@ -3076,12 +3076,14 @@ vn_copy_file_range(struct vnode *invp, off_t = *inoffp, struct vnode *outvp, >> goto out; >> /* >> - * If the two vnode are for the same file system, call >> + * If the two vnodes are for the same file system type, call >> * VOP_COPY_FILE_RANGE(), otherwise call = vn_generic_copy_file_range() >> - * which can handle copies across multiple file systems. >> + * which can handle copies across multiple file system types. >> */ >> *lenp =3D len; >> - if (invp->v_mount =3D=3D outvp->v_mount) >> + if (invp->v_mount =3D=3D outvp->v_mount || >> + strcmp(invp->v_mount->mnt_vfc->vfc_name, >> + outvp->v_mount->mnt_vfc->vfc_name) =3D=3D 0) >> error =3D VOP_COPY_FILE_RANGE(invp, inoffp, outvp, outoffp, >> lenp, flags, incred, outcred, fsize_td); >> else >> That looks to call VOP_COPY_FILE_RANGE in more contexts and >> vn_generic_copy_file_range in fewer. >> The backtrace I reported involves: VOP_COPY_FILE_RANGE >> So it appears this change is unlikely to invalidate my >> test result, although failure might happen sooner if >> more VOP_COPY_FILE_RANGE calls happen with the newer code. >=20 > Your logic is likely right, but if you have block cloning requests = both within and between datasets, this patch may change the pattern. = Though it is obviously not a fix for the issue. I responded to the = commit email only because it makes no difference while = vfs.zfs.bclone_enabled is 0. >=20 >> That in turns means that someone may come up with some >> other change for me to test by the time I get around to >> setting up another test. Let me know if so. >=20 > --=20 > Alexander Motin =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Sep 8 04:32:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhjrX5v7Tz4sNJY for ; Fri, 8 Sep 2023 04:32:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-21.consmr.mail.gq1.yahoo.com (sonic314-21.consmr.mail.gq1.yahoo.com [98.137.69.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhjrW5cQXz3RLK for ; Fri, 8 Sep 2023 04:32:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Rly7Vloo; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694147545; bh=T/859hwkDHR2VGagWWbzN+fjv13WjUFSPw4ddwNJIIY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Rly7VloohIcKt8EesI4ZSWhplqv+bXmnKAoOiGVGtSqX/fETBtihJlBnEb3rL/AVC5jqRmM/78/Rz3ss6g7j6jHC+QH+ltrz8JCnoHs9hEVh/sk4j7ldmN2VzRDswtpaPBFxBmmLLiTtxvoV+juy8a7cHtRzZuQLl+2kWE3KCrUbQYjRg/lHogHuWG6YBHjRv2wdkjpxh96jb+OW6Jx6YS+fpznQl7os9G+SeElHOLhyP5s924HHxLnZMVDk/y20Ca9zRimEQbYPvpyJe66CPl9cvm6BOSseUefPkama/ziOiZwggQXcMghHLSQKYXzhhsHI/s/xK/W/kgOPq/naCQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694147545; bh=thI0DAxiZxrCFQSMHaBOatWwW7+D5yBRTnfQPiBHHeP=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=qMm2kEZfQTLCGrYKcW5sDYg2KpU8sOJVwUCOy7HJUJM+cgSU6Qq5B68bIiQBbfNEQgwB2/a1DeVe6LpCJTh5Pz7Tq/Z6na+1I4J6yaEKwm2YBgA9VcM/yA6m5DEZK3fQZO9D1PjiFdNlaE53JktCDjqEGNmHN/sYPMtITYHIgpplvD8d6RH97tJ1a4J21rLN+RH9SXNdJSu388u3zSnQKITg18sKUr/uXPZAw9ktb0sb5BNx8dFlj9OojHTMxXfdEnHfSc0oJcHfwULcfctGACzOxzl9UpXFbhkGMDGMolq2AS1ZTD8ai8pi8OPig1gPWvPvoeUtygel2KAekhvhnA== X-YMail-OSG: PWQ3i68VM1k8XJfD7_RzRicVaJrYYmjnPK7T6jqv3xvza.vEOhtw1fDT73b8_qp rUq29CLnzOok013gqBGpMq4EyctE4LcPVPjisLvDLSAfj0Hl1.yZdS4Q16ZmO9RRd5Cr1VwZ7MLP OGaECnqaQF1vH5fvMhy5EEMg5f1FJjluDi8KHRc6se3lYMHWw.1Bih2CXRphj30bxE5aQNTLkEaE xMHprZ9rulMstDQSXMXFMHPE3scr2Wqd3_XAKEAy5AW9Z1MF8R02lqbJ.DyESyjiyyThQStYE0an J_sdnUinjPjLyupxxMkpUPqHvYex0CY6oslxl6DpADI2C1uc7GV6GlN4It260jP3E03YUeuKY8.o HRXQfiYDl5miSf9h7l6TheFtYVMvCWy1PVSlfnJZatCXFNsM3HQMuSsTv3Frh_g5XJYQvbuTxmFc Jaml7seJSw_pXxfAUoTPmRIElvtYb3wZ7lSeuBKwWW6FCoCHkqs1SlStn_pgcGF85WqLHxColy_t qVvko9H9TA1uNAEQXVAhxJI37ZyIjWW4n92vR1rIubuTKp72nKrqlkBhFiX2aYjVnElmbQRuoJzW cJbrVY15LH02.BMbOHTvo9fZhYIwIaRHdhgJb3vlXuH6TE2lSIew8nyFKRObLgy_MtTXaZSv4KP9 gpSK6fLlSHYWxqRA14Q4nSgDmJCSTwwOSqyahUUsIf78x8AE36JKWtbOKpbJD.y8RcizC7Vb9tN4 rbpNxX3a3ZKdvjv_4QOFHKa5dH3dCVwJOYBoAGpi6gcs2JP6FuC9XkXcV2u6g8E2brmWizcCAH7p Pz39rjINGfR9z6sTAHuUxu4OGaHc0HNvg66R20zlMosLirN51CMYvEUr8oe_d.rx_20DAh7_nff7 ypNCd5EaSDBpdDBDnJwPaMx19HuiPAiSN9BrZ6Js6gqXu2Ps815JZk58Y8Y_V1qyJx59uBGPM30S VwBcf7PdikQr4KYwERKDrnSs..H.NAVtD0wDu3TUscgjsZR0IudHMjFsjosws3jH8CD2QhZE_Ush bpOgkjZkp3RScKT7E3fPa8KNRWd7SpXqQEvujwYxKRBb_wtbC3jWuWADh0yYmaNBBG__PPszpJa8 XE1rRZmwknoTn8FjWuNED0JqSiGKRmbeQdTdcZd5kTdOcKadZ4Y.s4u2f_gqz2fyHknYlxAilQk5 EK76SOW7LWuE5CQ8QyPzkmVWTMJOW46av0NK0iS4mkD6O9x9WHnU8hkC9pJQXH6bob1LuXYjz5Ol g3tXc4ivCJ4E5rOIMCKyKpLJdAP77a9yqHeA51PxxFkrujPR4jqxPCak2MQongoV8FYcXiTKetwP lTbq42kJOoMQywwE.sm74g77dZ4caGwPCoGU3hZgZ_4j57RSGBfsDTsezAWUj_gLGyGSYVYYBA6y ZunszwCPZcFmMrIzDoGLeH.bUt0a4xHc33bTwT0NbXZCiK_qBJK6uj1efQxPwRRk4l4cGTjACdHK 2h2FOeIAqdcJ_P0KbA5864eYIskpMNjhM6KrRyGrkqiPUASSpM8EP0xeGADRtLQdDpUFD3Cw6O7t TNTpitNRlQ3EoKS33LFBc5AM8OJCLn5i_wxwYmdL.r5OowM05ErxjfzTOkiumjUDP6ytFRdp2Q3V 5cwDkAPRfjpwIp66R3BI_KMYVF7tr72089Fn9uAe9yPEkPcGefWFo2Ysq0XYLX0c4oClUyPLW7Uf 8stDNxq13X2uNDSaVmP2dyAu2.agXWS1ynOD8q9OXC8ODI43y1lZ3.qrkz630VTfJ1rXXCj7hThV PaMBwLHFEGMvIsKLKV3HHpdEzQ3RPVt9xEHFuuZanBaRMqCzJBWH0Ph00zksrG9Kw2cx8A7EDpfr 2Yy9O9xwJoIvYNTGNV1uta.AyPQHD.RuhFBO3Qze2vdN9SZMBlcilpJZ2FHdulAvED24qDFk7Mrx ztwijNAY8zQXTrAlzdV3tR7SUxZ5cogoLgTd7yqpqa8163M1Ft1daXkGmIIZgrfGrrFBaWBxsjaI 6WtrxqcsiowCKAvvpityMF0PwL4NTIisJqyBa_u8Yx.Lixv1YV2deB75xpeYnPoy.2C7wsk_DkLZ iWuWZajR29lvlpbuUi5drCYTAYZ9O3yko84KiTh.rmp5HvrSXoe.LVvtXvrzslUWfUBB6.gHvgO. dJ3DAHQ94qlCqgjO3tgZMw1TnEB4N3STKGVX6m.EY_WeRggZWTXJaMRobT7AFVcpGxhBcotJBb2i WYXwalPXtKgJYydEfqTHkb1CmbWpsUAIYCFokrg1VXh.POvdmMSpOIeZtqkueYhiXOD5LMG.gwqy Q6DLjB3A6Eef71rXy X-Sonic-MF: X-Sonic-ID: e4541169-7798-47f3-b7a8-60622728fefc Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Fri, 8 Sep 2023 04:32:25 +0000 Received: by hermes--production-ne1-7b767b77cc-27nt8 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 4475f12bd510bf710db871c929ca1675; Fri, 08 Sep 2023 04:32:22 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> Date: Thu, 7 Sep 2023 21:32:09 -0700 Cc: Martin Matuska , Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> To: Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.84:from]; BLOCKLISTDE_FAIL(0.00)[98.137.69.84:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.84:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RhjrW5cQXz3RLK [Today's main-snapshot kernel panics as well.] On Sep 7, 2023, at 16:32, Mark Millard wrote: > On Sep 7, 2023, at 13:07, Alexander Motin wrote: >=20 >> Thanks, Mark. >>=20 >> On 07.09.2023 15:40, Mark Millard wrote: >>> On Sep 7, 2023, at 11:48, Glen Barber wrote: >>>> On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: >>>>> When I next have time, should I retry based on a more recent >>>>> vintage of main that includes 969071be938c ? >>>>=20 >>>> Yes, please, if you can. >>> As stands, I rebooted that machine into my normal >>> enviroment, so the after-crash-with-dump-info >>> context is preserved. I'll presume lack of a need >>> to preserve that context unless I hear otherwise. >>> (But I'll work on this until later today.) >>> Even my normal environment predates the commit in >>> question by a few commits. So I'll end up doing a >>> more general round of updates overall. >>> Someone can let me know if there is a preference >>> for debug over non-debug for the next test run. >>=20 >> It is not unknown when some bugs disappear once debugging is enabled = due to different execution timings, but generally debug may to detect = the problem closer to its origin instead of looking on random = consequences. I am only starting to look on this report (unless Pawel or = somebody beat me on it), and don't have additional requests yet, but if = you can repeat the same with debug kernel (in-base ZFS's ZFS_DEBUG = setting follows kernel's INVARIANTS), it may give us some additional = information. >=20 > So I did a zpool import, rewinding to the checkpoint. > (This depends on the questionable zfs doing fully as > desired for this. Notably the normal environment has > vfs.zfs.bclone_enabled=3D0 , including when it was > doing this activity.) My normal environment reported > no problems. >=20 > Note: the earlier snapshot from my first setup was > still in place since it was made just before the > original checkpoint used above. >=20 > However, the rewind did remove the /var/crash/ > material that had been added. >=20 > I did the appropriate zfs mount. >=20 > I installed a debug kernel and world to the import. Again, > no problems reported. >=20 > I did the appropriate zfs umount. >=20 > I did the appropriate zpool export. >=20 > I rebooted with the test media. >=20 > # sysctl vfs.zfs.bclone_enabled > vfs.zfs.bclone_enabled: 1 >=20 > # zpool trim -w zamd64 >=20 > # zpool checkpoint zamd64 >=20 > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #74 = main-n265188-117c54a78ccd-dirty: Tue Sep 5 21:29:53 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >=20 > (So, before the 969071be938c vintage, same sources as for > my last run but a debug build.) >=20 > # poudriere bulk -jmain-amd64-bulk_a -a > . . . > [00:03:23] Building 34214 packages using up to 32 builders > [00:03:23] Hit CTRL+t at any time to see build progress and stats > [00:03:23] [01] [00:00:00] Builder starting > [00:04:19] [01] [00:00:56] Builder started > [00:04:20] [01] [00:00:01] Building ports-mgmt/pkg | pkg-1.20.6 > [00:05:33] [01] [00:01:14] Finished ports-mgmt/pkg | pkg-1.20.6: = Success > [00:05:53] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 > [00:05:53] [02] [00:00:00] Builder starting > . . . > [00:05:54] [32] [00:00:00] Builder starting > [00:06:11] [01] [00:00:18] Finished print/indexinfo | indexinfo-0.3.1: = Success > [00:06:12] [01] [00:00:00] Building devel/gettext-runtime | = gettext-runtime-0.22_1 > [00:08:24] [01] [00:02:12] Finished devel/gettext-runtime | = gettext-runtime-0.22_1: Success > [00:08:31] [01] [00:00:00] Building devel/libtextstyle | = libtextstyle-0.22 > [00:10:06] [05] [00:04:13] Builder started > [00:10:06] [05] [00:00:00] Building devel/autoconf-switch | = autoconf-switch-20220527 > [00:10:06] [31] [00:04:12] Builder started > [00:10:06] [31] [00:00:00] Building devel/libatomic_ops | = libatomic_ops-7.8.0 > . . . >=20 > Crashed again, with 158 *.pkg files in .building/All/ after > rebooting. >=20 > The crash is similar to the non-debug one. No extra output > from the debug build. >=20 > For reference: >=20 > Unread portion of the kernel message buffer: > panic: Solaris(panic): zfs: accessing past end of object 422/10b1c02 = (size=3D2560 access=3D2560+2560) > . . . Same world with newer snapshot main kernel that should be compatible with the world: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #0 = main-n265205-03a7c36ddbc0: Thu Sep 7 03:10:34 UTC 2023 = root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC = amd64 amd64 1500000 1500000 Steps: #NOTE: (re)boot to normal environment #NOTE: login cd ~/artifacts/ #NOTE: as needed . . . fetch = http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/kernel.tx= z fetch = http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/kernel-db= g.txz fetch = http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/src.txz #NOTE: /zamd64-mnt is a pre-existing empty directory for such use: zpool import --rewind-to-checkpoint -f -N -R /zamd64-mnt -t zamd64 = zpamd64 zpool checkpoint zpamd64 #NOTE: My BE's for bectl use have mountpoint=3Dnone normally. zfs set mountpoint=3D/ zpamd64/ROOT/main-amd64 zfs mount zpamd64/ROOT/main-amd64 mv /zamd64-mnt/boot/kernel /zamd64-mnt/boot/kernel.mm tar -xpf kernel.txz -C /zamd64-mnt/ mv /zamd64-mnt/usr/lib/debug/boot/kernel = /zamd64-mnt/usr/lib/debug/boot/kernel.mm tar -xpf kernel-dbg.txz -C /zamd64-mnt/ zfs umount zpamd64/ROOT/main-amd64 zfs set mountpoint=3Dnone zpamd64/ROOT/main-amd64 zfs mount zpamd64/usr/src #NOTE: /zamd64-mnt/usr/src/ being empty initially #NOTE: My normal environment's source is in a worktree /usr/main-src/ tar -xpf src.txz -C /zamd64-mnt/ zfs umount zpamd64/usr/src zpool export zpamd64 #NOTE: reboot to zamd64 #(my test environment) #NOTE: login uname -apKU sysctl vfs.zfs.bclone_enabled zpool trim -w zamd64 poudriere bulk -jmain-amd64-bulk_a -a Paniced. #NOTE: dump #NOTE: reboot to zamd64 #(my test environment) #NOTE: login ls -Tlod = /usr/local/poudriere/data/packages/main-amd64-bulk_a-default/.building/All= /*.pkg | wc -l 122 less /var/crash/core.txt.3 . . . Unread portion of the kernel message buffer: panic: Solaris(panic): zfs: accessing past end of object 422/10d670b = (size=3D2560 access=3D2560+2560) cpuid =3D 18 time =3D 1694146387 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe033f721590 vpanic() at vpanic+0x132/frame 0xfffffe033f7216c0 panic() at panic+0x43/frame 0xfffffe033f721720 vcmn_err() at vcmn_err+0xeb/frame 0xfffffe033f721850 zfs_panic_recover() at zfs_panic_recover+0x59/frame 0xfffffe033f7218b0 dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0xb8/frame = 0xfffffe033f721960 dmu_brt_clone() at dmu_brt_clone+0x61/frame 0xfffffe033f7219e0 zfs_clone_range() at zfs_clone_range+0xaa3/frame 0xfffffe033f721bb0 zfs_freebsd_copy_file_range() at zfs_freebsd_copy_file_range+0x18a/frame = 0xfffffe033f721c30 vn_copy_file_range() at vn_copy_file_range+0x163/frame = 0xfffffe033f721ce0 kern_copy_file_range() at kern_copy_file_range+0x36c/frame = 0xfffffe033f721db0 sys_copy_file_range() at sys_copy_file_range+0x78/frame = 0xfffffe033f721e00 amd64_syscall() at amd64_syscall+0x138/frame 0xfffffe033f721f30 fast_syscall_common() at fast_syscall_common+0xf8/frame = 0xfffffe033f721f30 --- syscall (569, FreeBSD ELF64, copy_file_range), rip =3D = 0x2c05a58a355a, rsp =3D 0x2c05a4312138, rbp =3D 0x2c05a43125d0 --- KDB: enter: panic __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 57 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" = (offsetof(struct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=3Dtextdump@entry=3D0) at /usr/src/sys/kern/kern_shutdown.c:405 #2 0xffffffff804a401a in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) at /usr/src/sys/ddb/db_command.c:591 #3 0xffffffff804a3e1d in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) at /usr/src/sys/ddb/db_command.c:504 #4 0xffffffff804a3add in db_command_loop () at /usr/src/sys/ddb/db_command.c:551 #5 0xffffffff804a71b6 in db_trap (type=3D, = code=3D) at /usr/src/sys/ddb/db_main.c:268 #6 0xffffffff80b9dfb3 in kdb_trap (type=3Dtype@entry=3D3, = code=3Dcode@entry=3D0, tf=3Dtf@entry=3D0xfffffe033f7214d0) at = /usr/src/sys/kern/subr_kdb.c:790 #7 0xffffffff8104d579 in trap (frame=3D0xfffffe033f7214d0) at /usr/src/sys/amd64/amd64/trap.c:608 #8 #9 kdb_enter (why=3D, msg=3D) at /usr/src/sys/kern/subr_kdb.c:556 #10 0xffffffff80b4f683 in vpanic (fmt=3D0xffffffff8223d54e "%s%s", = ap=3Dap@entry=3D0xfffffe033f721700) at = /usr/src/sys/kern/kern_shutdown.c:958 #11 0xffffffff80b4f463 in panic ( fmt=3D0xffffffff8196c800 = "$\222\024\201\377\377\377\377") at /usr/src/sys/kern/kern_shutdown.c:894 #12 0xffffffff81f9964b in vcmn_err (ce=3D, = fmt=3D0xffffffff82274462 "zfs: accessing past end of object %llx/%llx = (size=3D%u access=3D%llu+%llu)", adx=3D0xfffffe033f721890) at = /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_cmn_err.c:60 #13 0xffffffff820b6a59 in zfs_panic_recover ( fmt=3D0x12 ) at /usr/src/sys/contrib/openzfs/module/zfs/spa_misc.c:1594 #14 0xffffffff820150d8 in dmu_buf_hold_array_by_dnode = (dn=3D0xfffff802c3c41be8, offset=3Doffset@entry=3D2560, = length=3Dlength@entry=3D2560, read=3Dread@entry=3D0, = tag=3D0xffffffff8222139b, numbufsp=3Dnumbufsp@entry=3D0xfffffe033f7219ac, = dbpp=3D0xfffffe033f7219b0, flags=3D0) at /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:543 #15 0xffffffff82018c31 in dmu_buf_hold_array (os=3D, = object=3D, read=3D0, numbufsp=3D0xfffffe033f7219ac, = dbpp=3D0xfffffe033f7219b0, offset=3D, length=3D, tag=3D) at = /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:654 #16 dmu_brt_clone (os=3Dos@entry=3D0xfffff8019696b800, object=3D, offset=3Doffset@entry=3D2560, length=3Dlength@entry=3D2560, = tx=3Dtx@entry=3D0xfffff81433e03d00, = bps=3Dbps@entry=3D0xfffffe0442ce5000, nbps=3D1, replay=3D0) at = /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:2301 #17 0xffffffff82183333 in zfs_clone_range (inzp=3D0xfffff80e37f64000, = inoffp=3D0xfffff8019ab32b38, outzp=3D0xfffff80d931a5910, = outoffp=3D0xfffff80662d0a548, lenp=3Dlenp@entry=3D0xfffffe033f721bf0, = cr=3D0xfffff8051d1c4800) at /usr/src/sys/contrib/openzfs/module/zfs/zfs_vnops.c:1302 #18 0xffffffff81fbc76a in zfs_freebsd_copy_file_range = (ap=3D0xfffffe033f721c48) at = /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:6294 #19 0xffffffff80c612a3 in VOP_COPY_FILE_RANGE (invp=3D0xfffff80eb09c08c0, = inoffp=3D0xfffff8019ab32b38, outvp=3D0xfffff80e7f998000, = outoffp=3D0xfffff80662d0a548, lenp=3D0xfffffe033f721d40, = incred=3D0xfffff8051d1c4800, flags=3D, = outcred=3D, fsizetd=3D) at = ./vnode_if.h:2385 #20 vn_copy_file_range (invp=3Dinvp@entry=3D0xfffff80eb09c08c0, = inoffp=3Dinoffp@entry=3D0xfffff8019ab32b38, = outvp=3Doutvp@entry=3D0xfffff80e7f998000, outoffp=3D0xfffff80662d0a548, = lenp=3Dlenp@entry=3D0xfffffe033f721d40, flags=3Dflags@entry=3D0, = incred=3D0xfffff8051d1c4800, outcred=3D0xfffff8051d1c4800, = fsize_td=3D0xfffffe033fdf1c80) at /usr/src/sys/kern/vfs_vnops.c:3087 #21 0xffffffff80c5be9c in kern_copy_file_range ( td=3Dtd@entry=3D0xfffffe033fdf1c80, infd=3D, = inoffp=3D0xfffff8019ab32b38, inoffp@entry=3D0x0, outfd=3D, outoffp=3D0xffffffff8120f47f, outoffp@entry=3D0x0, = len=3D9223372036854775807, flags=3D0) at = /usr/src/sys/kern/vfs_syscalls.c:4971 #22 0xffffffff80c5bfa8 in sys_copy_file_range (td=3D0xfffffe033fdf1c80, = uap=3D0xfffffe033fdf2080) at /usr/src/sys/kern/vfs_syscalls.c:5009 #23 0xffffffff8104e3d8 in syscallenter (td=3D) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:187 #24 amd64_syscall (td=3D0xfffffe033fdf1c80, traced=3D0) at /usr/src/sys/amd64/amd64/trap.c:1197 #25 #26 0x00002c05a58a355a in ?? () Backtrace stopped: Cannot access memory at address 0x2c05a4312138 (kgdb)=20 . . . So the problem is not special to my personal kernel builds. >>> Looking at "git: 969071be938c - main", the relevant >>> part seems to be just (white space possibly not >>> preserved accurately): >>> diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c >>> index 9fb5aee6a023..4e4161ef1a7f 100644 >>> --- a/sys/kern/vfs_vnops.c >>> +++ b/sys/kern/vfs_vnops.c >>> @@ -3076,12 +3076,14 @@ vn_copy_file_range(struct vnode *invp, off_t = *inoffp, struct vnode *outvp, >>> goto out; >>> /* >>> - * If the two vnode are for the same file system, call >>> + * If the two vnodes are for the same file system type, call >>> * VOP_COPY_FILE_RANGE(), otherwise call = vn_generic_copy_file_range() >>> - * which can handle copies across multiple file systems. >>> + * which can handle copies across multiple file system types. >>> */ >>> *lenp =3D len; >>> - if (invp->v_mount =3D=3D outvp->v_mount) >>> + if (invp->v_mount =3D=3D outvp->v_mount || >>> + strcmp(invp->v_mount->mnt_vfc->vfc_name, >>> + outvp->v_mount->mnt_vfc->vfc_name) =3D=3D 0) >>> error =3D VOP_COPY_FILE_RANGE(invp, inoffp, outvp, outoffp, >>> lenp, flags, incred, outcred, fsize_td); >>> else >>> That looks to call VOP_COPY_FILE_RANGE in more contexts and >>> vn_generic_copy_file_range in fewer. >>> The backtrace I reported involves: VOP_COPY_FILE_RANGE >>> So it appears this change is unlikely to invalidate my >>> test result, although failure might happen sooner if >>> more VOP_COPY_FILE_RANGE calls happen with the newer code. >>=20 >> Your logic is likely right, but if you have block cloning requests = both within and between datasets, this patch may change the pattern. = Though it is obviously not a fix for the issue. I responded to the = commit email only because it makes no difference while = vfs.zfs.bclone_enabled is 0. >>=20 >>> That in turns means that someone may come up with some >>> other change for me to test by the time I get around to >>> setting up another test. Let me know if so. >> . . . =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Sep 8 09:35:40 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhrZT6yG3z4sFry for ; Fri, 8 Sep 2023 09:35:45 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhrZT0Vzsz3gfP for ; Fri, 8 Sep 2023 09:35:44 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de; dmarc=none Received: from [212.222.85.178] (helo=pureos) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qeXtu-004qri-BS for freebsd-current@freebsd.org; Fri, 08 Sep 2023 11:35:42 +0200 Date: Fri, 8 Sep 2023 11:35:40 +0200 From: Matthias Apitz To: freebsd-current@freebsd.org Subject: Acer C720 Chromebook Cypress Trackpad Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 212.222.85.178 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.57 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; NEURAL_HAM_SHORT(-0.87)[-0.874]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:178.254.4.101]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[unixarea.de]; BLOCKLISTDE_FAIL(0.00)[212.222.85.178:server fail,178.254.4.101:server fail]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; HAS_XOIP(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; HAS_REPLYTO(0.00)[guru@unixarea.de] X-Rspamd-Queue-Id: 4RhrZT0Vzsz3gfP It seems that something has changed in cyapa.ko how the (not existing) three buttons of the trackpad are emulated. In FreeBSD 13.0-CURRENT r368166 I used only the cyapa.ko module and some xinput commands in .xinitrc to get button1, button2 and button3 as shown in the small "grafic" below. This was not working anymore and it took me some hours of testing, until I got it working again with loading the additional kmod chromebook_platform.ko. Now the three buttons are there as expected. I add this here if someone runs into the same problem (or if someone has comments on this): $ cat ~/.xinitrc ... # Trackpad section # # old (pre 14-CURRENT) section: # # device="Cypress APA I2C Trackpad" # # xinput set-prop "$device" "libinput Tapping Enabled" 1 # # for those who like "natural" scrolling: # # xinput set-prop "$device" "libinput Natural Scrolling Enabled" 1 # # this gives three buttons in the lower part of the TP: # # xinput set-prop "$device" "libinput Middle Emulation Enabled" 0 # # 14.0-CURRENT, September 2023 section: # we also load now in /boot/loader.conf not only the cyapa.ko, # but also chromebook_platform.ko; and access to the device has # slightly changed to id=11 and id=12, resp. # xinput set-prop 11 "libinput Natural Scrolling Enabled" 1 xinput set-prop 12 "libinput Natural Scrolling Enabled" 1 xinput set-prop 11 "libinput Tapping Enabled" 1 xinput set-prop 12 "libinput Tapping Enabled" 1 # Trackpad layout: # # +------------------------------------+ # | | # | main area | # | | # | | # +------------------------------------+ # | button1 | button2 | button3 | ~10mm in high # +------------------------------------+ # # see also: # https://wayland.freedesktop.org/libinput/doc/latest/clickpad-softbuttons.html # # end of Trackpad section ... matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Fri Sep 8 13:52:02 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rhyq83pfpz4rn8S; Fri, 8 Sep 2023 14:17:08 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from www541.your-server.de (www541.your-server.de [213.133.107.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rhyq82SkCz4gG4; Fri, 8 Sep 2023 14:17:08 +0000 (UTC) (envelope-from mm@FreeBSD.org) Authentication-Results: mx1.freebsd.org; none Received: from sslproxy06.your-server.de ([78.46.172.3]) by www541.your-server.de with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qebty-000JMG-Vh; Fri, 08 Sep 2023 15:52:03 +0200 Received: from [188.167.171.2] (helo=[10.0.9.122]) by sslproxy06.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qebty-000IE2-M2; Fri, 08 Sep 2023 15:52:02 +0200 Message-ID: <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> Date: Fri, 8 Sep 2023 15:52:02 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics To: Mark Millard , Alexander Motin , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> Content-Language: en-US From: Martin Matuska In-Reply-To: <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Authenticated-Sender: martin@matuska.de X-Virus-Scanned: Clear (ClamAV 0.103.8/27025/Fri Sep 8 09:37:45 2023) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.133.96.0/19, country:DE] X-Rspamd-Queue-Id: 4Rhyq82SkCz4gG4 I digged a little and was able to reproduce the panic without poudriere with a shell script. You may want to increase "repeats". The script causes the panic in dmu_buf_hold_array_by_dnode() on my VirtualBox with the cat command on 9th iteration. Here is the script: #!/bin/sh nl=' ' sed_script=s/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb/ for ac_i in 1 2 3 4 5 6 7; do     sed_script="$sed_script$nl$sed_script" done echo "$sed_script" 2>/dev/null | sed 99q >conftest.sed repeats=8 count=0 echo -n 0123456789 >"conftest.in" while : do     cat "conftest.in" "conftest.in" >"conftest.tmp"     mv "conftest.tmp" "conftest.in"     cp "conftest.in" "conftest.nl"     echo '' >> "conftest.nl"     sed -f conftest.sed < "conftest.nl" >"conftest.out" 2>/dev/null || break     diff "conftest.out" "conftest.nl" >/dev/null 2>&1 || break     count=$(($count + 1))     echo "count: $count"     # 10*(2^10) chars as input seems more than enough     test $count -gt $repeats && break done rm -f conftest.in conftest.tmp conftest.nl conftest.out On 8. 9. 2023 6:32, Mark Millard wrote: > [Today's main-snapshot kernel panics as well.] > > On Sep 7, 2023, at 16:32, Mark Millard wrote: > >> On Sep 7, 2023, at 13:07, Alexander Motin wrote: >> >>> Thanks, Mark. >>> >>> On 07.09.2023 15:40, Mark Millard wrote: >>>> On Sep 7, 2023, at 11:48, Glen Barber wrote: >>>>> On Thu, Sep 07, 2023 at 11:17:22AM -0700, Mark Millard wrote: >>>>>> When I next have time, should I retry based on a more recent >>>>>> vintage of main that includes 969071be938c ? >>>>> Yes, please, if you can. >>>> As stands, I rebooted that machine into my normal >>>> enviroment, so the after-crash-with-dump-info >>>> context is preserved. I'll presume lack of a need >>>> to preserve that context unless I hear otherwise. >>>> (But I'll work on this until later today.) >>>> Even my normal environment predates the commit in >>>> question by a few commits. So I'll end up doing a >>>> more general round of updates overall. >>>> Someone can let me know if there is a preference >>>> for debug over non-debug for the next test run. >>> It is not unknown when some bugs disappear once debugging is enabled due to different execution timings, but generally debug may to detect the problem closer to its origin instead of looking on random consequences. I am only starting to look on this report (unless Pawel or somebody beat me on it), and don't have additional requests yet, but if you can repeat the same with debug kernel (in-base ZFS's ZFS_DEBUG setting follows kernel's INVARIANTS), it may give us some additional information. >> So I did a zpool import, rewinding to the checkpoint. >> (This depends on the questionable zfs doing fully as >> desired for this. Notably the normal environment has >> vfs.zfs.bclone_enabled=0 , including when it was >> doing this activity.) My normal environment reported >> no problems. >> >> Note: the earlier snapshot from my first setup was >> still in place since it was made just before the >> original checkpoint used above. >> >> However, the rewind did remove the /var/crash/ >> material that had been added. >> >> I did the appropriate zfs mount. >> >> I installed a debug kernel and world to the import. Again, >> no problems reported. >> >> I did the appropriate zfs umount. >> >> I did the appropriate zpool export. >> >> I rebooted with the test media. >> >> # sysctl vfs.zfs.bclone_enabled >> vfs.zfs.bclone_enabled: 1 >> >> # zpool trim -w zamd64 >> >> # zpool checkpoint zamd64 >> >> # uname -apKU >> FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #74 main-n265188-117c54a78ccd-dirty: Tue Sep 5 21:29:53 PDT 2023 root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >> >> (So, before the 969071be938c vintage, same sources as for >> my last run but a debug build.) >> >> # poudriere bulk -jmain-amd64-bulk_a -a >> . . . >> [00:03:23] Building 34214 packages using up to 32 builders >> [00:03:23] Hit CTRL+t at any time to see build progress and stats >> [00:03:23] [01] [00:00:00] Builder starting >> [00:04:19] [01] [00:00:56] Builder started >> [00:04:20] [01] [00:00:01] Building ports-mgmt/pkg | pkg-1.20.6 >> [00:05:33] [01] [00:01:14] Finished ports-mgmt/pkg | pkg-1.20.6: Success >> [00:05:53] [01] [00:00:00] Building print/indexinfo | indexinfo-0.3.1 >> [00:05:53] [02] [00:00:00] Builder starting >> . . . >> [00:05:54] [32] [00:00:00] Builder starting >> [00:06:11] [01] [00:00:18] Finished print/indexinfo | indexinfo-0.3.1: Success >> [00:06:12] [01] [00:00:00] Building devel/gettext-runtime | gettext-runtime-0.22_1 >> [00:08:24] [01] [00:02:12] Finished devel/gettext-runtime | gettext-runtime-0.22_1: Success >> [00:08:31] [01] [00:00:00] Building devel/libtextstyle | libtextstyle-0.22 >> [00:10:06] [05] [00:04:13] Builder started >> [00:10:06] [05] [00:00:00] Building devel/autoconf-switch | autoconf-switch-20220527 >> [00:10:06] [31] [00:04:12] Builder started >> [00:10:06] [31] [00:00:00] Building devel/libatomic_ops | libatomic_ops-7.8.0 >> . . . >> >> Crashed again, with 158 *.pkg files in .building/All/ after >> rebooting. >> >> The crash is similar to the non-debug one. No extra output >> from the debug build. >> >> For reference: >> >> Unread portion of the kernel message buffer: >> panic: Solaris(panic): zfs: accessing past end of object 422/10b1c02 (size=2560 access=2560+2560) >> . . . > Same world with newer snapshot main kernel that should > be compatible with the world: > > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #0 main-n265205-03a7c36ddbc0: Thu Sep 7 03:10:34 UTC 2023 root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 amd64 1500000 1500000 > > > Steps: > > #NOTE: (re)boot to normal environment > #NOTE: login > > cd ~/artifacts/ > > #NOTE: as needed . . . > fetch http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/kernel.txz > fetch http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/kernel-dbg.txz > fetch http://ftp3.freebsd.org/pub/FreeBSD/snapshots/amd64/15.0-CURRENT/src.txz > > #NOTE: /zamd64-mnt is a pre-existing empty directory for such use: > zpool import --rewind-to-checkpoint -f -N -R /zamd64-mnt -t zamd64 zpamd64 > zpool checkpoint zpamd64 > > #NOTE: My BE's for bectl use have mountpoint=none normally. > zfs set mountpoint=/ zpamd64/ROOT/main-amd64 > zfs mount zpamd64/ROOT/main-amd64 > > mv /zamd64-mnt/boot/kernel /zamd64-mnt/boot/kernel.mm > tar -xpf kernel.txz -C /zamd64-mnt/ > > mv /zamd64-mnt/usr/lib/debug/boot/kernel /zamd64-mnt/usr/lib/debug/boot/kernel.mm > tar -xpf kernel-dbg.txz -C /zamd64-mnt/ > > zfs umount zpamd64/ROOT/main-amd64 > zfs set mountpoint=none zpamd64/ROOT/main-amd64 > > zfs mount zpamd64/usr/src > #NOTE: /zamd64-mnt/usr/src/ being empty initially > #NOTE: My normal environment's source is in a worktree /usr/main-src/ > tar -xpf src.txz -C /zamd64-mnt/ > zfs umount zpamd64/usr/src > > zpool export zpamd64 > > #NOTE: reboot to zamd64 #(my test environment) > #NOTE: login > > uname -apKU > > sysctl vfs.zfs.bclone_enabled > > zpool trim -w zamd64 > poudriere bulk -jmain-amd64-bulk_a -a > > Paniced. > > #NOTE: dump > #NOTE: reboot to zamd64 #(my test environment) > #NOTE: login > > ls -Tlod /usr/local/poudriere/data/packages/main-amd64-bulk_a-default/.building/All/*.pkg | wc -l > 122 > > less /var/crash/core.txt.3 > . . . > Unread portion of the kernel message buffer: > panic: Solaris(panic): zfs: accessing past end of object 422/10d670b (size=2560 access=2560+2560) > cpuid = 18 > time = 1694146387 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe033f721590 > vpanic() at vpanic+0x132/frame 0xfffffe033f7216c0 > panic() at panic+0x43/frame 0xfffffe033f721720 > vcmn_err() at vcmn_err+0xeb/frame 0xfffffe033f721850 > zfs_panic_recover() at zfs_panic_recover+0x59/frame 0xfffffe033f7218b0 > dmu_buf_hold_array_by_dnode() at dmu_buf_hold_array_by_dnode+0xb8/frame 0xfffffe033f721960 > dmu_brt_clone() at dmu_brt_clone+0x61/frame 0xfffffe033f7219e0 > zfs_clone_range() at zfs_clone_range+0xaa3/frame 0xfffffe033f721bb0 > zfs_freebsd_copy_file_range() at zfs_freebsd_copy_file_range+0x18a/frame 0xfffffe033f721c30 > vn_copy_file_range() at vn_copy_file_range+0x163/frame 0xfffffe033f721ce0 > kern_copy_file_range() at kern_copy_file_range+0x36c/frame 0xfffffe033f721db0 > sys_copy_file_range() at sys_copy_file_range+0x78/frame 0xfffffe033f721e00 > amd64_syscall() at amd64_syscall+0x138/frame 0xfffffe033f721f30 > fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033f721f30 > --- syscall (569, FreeBSD ELF64, copy_file_range), rip = 0x2c05a58a355a, rsp = 0x2c05a4312138, rbp = 0x2c05a43125d0 --- > KDB: enter: panic > > __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > 57 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, > (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > #1 doadump (textdump=textdump@entry=0) > at /usr/src/sys/kern/kern_shutdown.c:405 > #2 0xffffffff804a401a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) > at /usr/src/sys/ddb/db_command.c:591 > #3 0xffffffff804a3e1d in db_command (last_cmdp=, cmd_table=, dopager=true) > at /usr/src/sys/ddb/db_command.c:504 > #4 0xffffffff804a3add in db_command_loop () > at /usr/src/sys/ddb/db_command.c:551 > #5 0xffffffff804a71b6 in db_trap (type=, code=) > at /usr/src/sys/ddb/db_main.c:268 > #6 0xffffffff80b9dfb3 in kdb_trap (type=type@entry=3, code=code@entry=0, tf=tf@entry=0xfffffe033f7214d0) at /usr/src/sys/kern/subr_kdb.c:790 > #7 0xffffffff8104d579 in trap (frame=0xfffffe033f7214d0) > at /usr/src/sys/amd64/amd64/trap.c:608 > #8 > #9 kdb_enter (why=, msg=) > at /usr/src/sys/kern/subr_kdb.c:556 > #10 0xffffffff80b4f683 in vpanic (fmt=0xffffffff8223d54e "%s%s", ap=ap@entry=0xfffffe033f721700) at /usr/src/sys/kern/kern_shutdown.c:958 > #11 0xffffffff80b4f463 in panic ( > fmt=0xffffffff8196c800 "$\222\024\201\377\377\377\377") > at /usr/src/sys/kern/kern_shutdown.c:894 > #12 0xffffffff81f9964b in vcmn_err (ce=, fmt=0xffffffff82274462 "zfs: accessing past end of object %llx/%llx (size=%u access=%llu+%llu)", adx=0xfffffe033f721890) > at /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_cmn_err.c:60 > #13 0xffffffff820b6a59 in zfs_panic_recover ( > fmt=0x12 ) > at /usr/src/sys/contrib/openzfs/module/zfs/spa_misc.c:1594 > #14 0xffffffff820150d8 in dmu_buf_hold_array_by_dnode (dn=0xfffff802c3c41be8, offset=offset@entry=2560, length=length@entry=2560, read=read@entry=0, tag=0xffffffff8222139b, numbufsp=numbufsp@entry=0xfffffe033f7219ac, dbpp=0xfffffe033f7219b0, flags=0) > at /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:543 > #15 0xffffffff82018c31 in dmu_buf_hold_array (os=, object=, read=0, numbufsp=0xfffffe033f7219ac, dbpp=0xfffffe033f7219b0, offset=, length=, tag=) at /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:654 > #16 dmu_brt_clone (os=os@entry=0xfffff8019696b800, object=, offset=offset@entry=2560, length=length@entry=2560, tx=tx@entry=0xfffff81433e03d00, bps=bps@entry=0xfffffe0442ce5000, nbps=1, replay=0) at /usr/src/sys/contrib/openzfs/module/zfs/dmu.c:2301 > #17 0xffffffff82183333 in zfs_clone_range (inzp=0xfffff80e37f64000, inoffp=0xfffff8019ab32b38, outzp=0xfffff80d931a5910, outoffp=0xfffff80662d0a548, lenp=lenp@entry=0xfffffe033f721bf0, cr=0xfffff8051d1c4800) > at /usr/src/sys/contrib/openzfs/module/zfs/zfs_vnops.c:1302 > #18 0xffffffff81fbc76a in zfs_freebsd_copy_file_range (ap=0xfffffe033f721c48) > at /usr/src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vnops_os.c:6294 > #19 0xffffffff80c612a3 in VOP_COPY_FILE_RANGE (invp=0xfffff80eb09c08c0, inoffp=0xfffff8019ab32b38, outvp=0xfffff80e7f998000, outoffp=0xfffff80662d0a548, lenp=0xfffffe033f721d40, incred=0xfffff8051d1c4800, flags=, outcred=, fsizetd=) at ./vnode_if.h:2385 > #20 vn_copy_file_range (invp=invp@entry=0xfffff80eb09c08c0, inoffp=inoffp@entry=0xfffff8019ab32b38, outvp=outvp@entry=0xfffff80e7f998000, outoffp=0xfffff80662d0a548, lenp=lenp@entry=0xfffffe033f721d40, flags=flags@entry=0, incred=0xfffff8051d1c4800, outcred=0xfffff8051d1c4800, fsize_td=0xfffffe033fdf1c80) at /usr/src/sys/kern/vfs_vnops.c:3087 > #21 0xffffffff80c5be9c in kern_copy_file_range ( > td=td@entry=0xfffffe033fdf1c80, infd=, inoffp=0xfffff8019ab32b38, inoffp@entry=0x0, outfd=, outoffp=0xffffffff8120f47f, outoffp@entry=0x0, len=9223372036854775807, flags=0) at /usr/src/sys/kern/vfs_syscalls.c:4971 > #22 0xffffffff80c5bfa8 in sys_copy_file_range (td=0xfffffe033fdf1c80, uap=0xfffffe033fdf2080) at /usr/src/sys/kern/vfs_syscalls.c:5009 > #23 0xffffffff8104e3d8 in syscallenter (td=) > at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:187 > #24 amd64_syscall (td=0xfffffe033fdf1c80, traced=0) > at /usr/src/sys/amd64/amd64/trap.c:1197 > #25 > #26 0x00002c05a58a355a in ?? () > Backtrace stopped: Cannot access memory at address 0x2c05a4312138 > (kgdb) > . . . > > > So the problem is not special to my personal kernel builds. > > >>>> Looking at "git: 969071be938c - main", the relevant >>>> part seems to be just (white space possibly not >>>> preserved accurately): >>>> diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c >>>> index 9fb5aee6a023..4e4161ef1a7f 100644 >>>> --- a/sys/kern/vfs_vnops.c >>>> +++ b/sys/kern/vfs_vnops.c >>>> @@ -3076,12 +3076,14 @@ vn_copy_file_range(struct vnode *invp, off_t *inoffp, struct vnode *outvp, >>>> goto out; >>>> /* >>>> - * If the two vnode are for the same file system, call >>>> + * If the two vnodes are for the same file system type, call >>>> * VOP_COPY_FILE_RANGE(), otherwise call vn_generic_copy_file_range() >>>> - * which can handle copies across multiple file systems. >>>> + * which can handle copies across multiple file system types. >>>> */ >>>> *lenp = len; >>>> - if (invp->v_mount == outvp->v_mount) >>>> + if (invp->v_mount == outvp->v_mount || >>>> + strcmp(invp->v_mount->mnt_vfc->vfc_name, >>>> + outvp->v_mount->mnt_vfc->vfc_name) == 0) >>>> error = VOP_COPY_FILE_RANGE(invp, inoffp, outvp, outoffp, >>>> lenp, flags, incred, outcred, fsize_td); >>>> else >>>> That looks to call VOP_COPY_FILE_RANGE in more contexts and >>>> vn_generic_copy_file_range in fewer. >>>> The backtrace I reported involves: VOP_COPY_FILE_RANGE >>>> So it appears this change is unlikely to invalidate my >>>> test result, although failure might happen sooner if >>>> more VOP_COPY_FILE_RANGE calls happen with the newer code. >>> Your logic is likely right, but if you have block cloning requests both within and between datasets, this patch may change the pattern. Though it is obviously not a fix for the issue. I responded to the commit email only because it makes no difference while vfs.zfs.bclone_enabled is 0. >>> >>>> That in turns means that someone may come up with some >>>> other change for me to test by the time I get around to >>>> setting up another test. Let me know if so. >>> . . . > > === > Mark Millard > marklmi at yahoo.com > > From nobody Fri Sep 8 14:49:25 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RhzXm6G4dz4s9xq for ; Fri, 8 Sep 2023 14:49:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-20.consmr.mail.gq1.yahoo.com (sonic305-20.consmr.mail.gq1.yahoo.com [98.137.64.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RhzXm38srz3NkP for ; Fri, 8 Sep 2023 14:49:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694184581; bh=2Z4xapkPfoaIRV02NEk0K2X6SgdAMsAIQZ6OJIiM1WA=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=IErHXnYm6XEnxviScSqdDRkm9XU5fGQacR6HQD+i7ushtz3x2c367v7HTthEboOq0BywLZhgzjeMRtdy+fq63ddbGlDG3ug5TidE/ckhZ16VnDJ6G9d96zfFC1cN93NXRVLKYIEkINGAQO60BFFsSUHn1sfmOGZDStd7QBw84izabmAgnadM/qacB2Scx29OFgDmFwnUti9RZ5Ra5oW/x6KDWtXHSsfQe5x66sXpJx77vlqfewDWVaeL1Y7lhDsDmP8uL5UGy/hTgUELFsh/Sgpol6HUj9soUF9iCGDV063xnFAT91/xPowl1fyRMKcFZzuTojyU7Xm0CD/SrY5j+A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694184581; bh=9mtiyNMeT39N1n22jvLUUl8KGnGKHr+AxXpis9329qC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=UQi92dPruxwXi2H2uWSI/moJLzetsZN1GfiLDMNFt9vDJLqlzMABQJ3+w4ymISMMkUXGxKD2p0MMM0YJEu2XFGqJ00c0A/ZsbqBD0dUI2SnPGp+Mv5xiulUq0qJiMk27FpOCVGF6RbiS/rxgYl7Lz7vmI602EOuETExbPnbkmoQ9K4PhTmYuHe0QUR2HRJVIw/2vxorSUT/lAUyIMcLpixerry6To7P979ZXWkM4HlxCB5wlMlMPXHoeONqNzstCMwFZF6+KBOkzetxuJHdKWv4nSthxb3FniRA/D6zB9DTU20D/hkyAq9tyf398kjgv1v1yrJQhZGRrTqkjFcB/vA== X-YMail-OSG: 5pgSvooVM1kH1PtzXznp8vwCOd7W8vLCFg7pgqtbbX_Z8l77HAP4Q759nQElY31 mS9q6DLy_4EqetglymwNdYDQmtwYmhoibvzShj24yUGbggkrCu5Xe9AXwBS01anU5U65pgETiBVO ApNL7RSwwi8vsYPZZCG2iQsJTqSo7CuTEblEnZiqT5rerdkIoCMIwq7MDUElqV9v55JG.T3wSKQT 1..4XYn9Zl6gpIXNYEh5BEgqk7H1pJTHvTu5gCVT.iA8BR9fZT47ItBoAOlb4cwFZzKsUPOPaIid ngzc5Zj7xfBPi3NVTzKoRLXdlBI9l3N48wzoRpzGFz1gH003XXjMxcD4.YgozZDJVVcg9AxR4tqC ld5372wrs4iv5fuAxlrMpVz8FVj8T3rvEVYbVXHr_.i9PyUFSGsm5NaoLm2QXn2KZiuAY_R2IYUh oN5m58cs53kAHrFwmF51NjICV7UyM4IyjjtVM3vi2_IBj1xTiPOShXlr4LmQOAwRp7HMMTUVegCX qNXmtrc9MLIsEsGyrapcRh8hVzCyGKo2iND4UMAJjlPHBBxLy2xJqMGcMd1D75m.YT4XB4fRwEfT Bjoxy1ag5ZtC17g1hkhrrMPweYgHhrBv3UgUNOZFJwdEmWLS0D4s8xs8fpTR1JeFb20cL_DGiD.H 1fH4BbgYIQSbSYVXHo3qKwdvnw6UatFAf.Q22AO61esUlh7PGedZ90Mg2gJ1VOa9nYO2vrrRHb_G BJxaWiI8bp3pVyjHAMUO09n1dMb.cpzK.vqthosPnYhPxQ0PsjMMpvabPqlnxIZXgyyYiizN.jXg 8BA7cnO.M47gzEO.yYwyAvFUDufL9O8ODAz9sWLYwWQ1ecxMoFJpB_Cm0suGzaIpLgTdjhiQc52o cgkjWvEXgL3YbJDFlNeKkCWl07UvJL6YILsMjo79m0pZeHBTo_JX7NCTjEveAFGW1qHfw2r3XDLY T76_z7bTX3ym895pWKSFDGq8eYyk51_3WLwrSCGi_t7YPbhe9S7sfauVANJnGraZPtlIWjqxgZ0E lW6z68s5f11PtWw_zQWuGYCcRAYahGzQU5XOCobcWpJjMujqmnOhLIGkJ87xPhjJnZCwEIQppBZC JJJhm7FhuA6O4oOf3wgfDVu.ugVHJvAvwQPKyNrjbRTivHLgrw03w75P6PuaIFOWsvhFn6X22xd1 a5sv1TxXyeSlDYKHPwqpPczCvkCWaWH2pisvB15QEL.ccgnQeAO1kAHOj4MulHOkeTPXO2Axz2ct .Ils4887B_g4EKhBY9aOBsVWI2z_epKPMHDank6H6TUF9m6ArLnTdBvlAHqGaXfusMZsCdkiCARh j6s_pnmQ98nl2ZUKyxjN7BRwFDUtG5fjOxSQTN4BR_dy6WkzavAPQnFv_cXHtQbYyREUBcIq95bn M8lEmA0bcJz3mVjjy.QeM1CevHGukYQiCTmtbJFHQPMKrZW9_2EvnpE1LhX1v4ecwlTqQTwdhJxM hT4He3ffF0fVin3w4gqJg0VRKa5f03nLteL.jCcn_Ekio5zCX1UyjVGP2qtliAMp2P3O_3YrbOM6 ZvjlUo34Fxv5Bu2sPaE_WiRqQa_RMLDIT4Rl3Jw2tv5BtT.Utbsun1RD58U5zc.Izj.AkrkmC8Te Dpzz6OoeKhCBxFRElSOlcFNFhXpq3iV5QkbAdipBYV79olv_tnyqqS1GxwedKBG6uy4H6_y9Eky6 yQYxVSBGRBy_tNu0JhRG9zZBm_aWA9FyJtvvVPMcXRbCPXMCnEvUyClIbnBScSPcRMjYX53mOLn2 QvuGDkZG.0XfPt0KPd8YENNdCMs0RLfHXqPJbmQtrbdygfKSlhzuftjnyFmjJ9RFJaxKfj3Jg0HX UqOf8IONNfVKb0jyT_t_7.2Gw2keBdzHLFRo9dQu5WYlQHhV9swZbZW_S4zIEkRPigsuCUQvgd_S qePwnWIE2VH3fASsWDunME3E0ezP34MAxOUEmCX3u55pBg1K2sc_zP0ZeW0fc1GZ.0JPvCMI3FF8 p1duezu74V.hX23ggItL9BdYZtdmsXlSHrxhs85.EmEglugsPEIE20o37gs9QLn3Zjd_MLcHkgvq 93Jv3z00oMZI9ZAroSGKAGf1xk7LSbIbRn2rqH7bRIDGYZ22W6hqnfwApr9TzWknGwGC5OfyVLNq PhpSW_XMK8_CdvDQyZfGrfOR8xgi_9Lkp1rc_LZh.5aUoPDG5nYAgCoZsUIQNaMIga7L2dx8fRUD gM6LfXem6W8SieiRo4l6Thx1DQiLcy5W.sVQe3BdZOfYhoJMPwa91EkLcyI.PQZY1MgofxUq45Fj Zk_HE X-Sonic-MF: X-Sonic-ID: 14158615-367d-4d7b-b367-50df115f91d5 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Fri, 8 Sep 2023 14:49:41 +0000 Received: by hermes--production-bf1-865889d799-xc84r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID e09beb3c2fbe6fee8a89eb4f2216e9d4; Fri, 08 Sep 2023 14:49:38 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> Date: Fri, 8 Sep 2023 07:49:25 -0700 Cc: Alexander Motin , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <62BE6390-3893-4909-B5A0-A98015FF5083@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> To: Martin Matuska X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RhzXm38srz3NkP On Sep 8, 2023, at 06:52, Martin Matuska wrote: > I digged a little and was able to reproduce the panic without = poudriere with a shell script. >=20 > You may want to increase "repeats". > The script causes the panic in dmu_buf_hold_array_by_dnode() on my = VirtualBox with the cat command on 9th iteration. >=20 > Here is the script: >=20 > #!/bin/sh > nl=3D' > ' > = sed_script=3Ds/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/bbbbbbbbbbbbbbbbbbbbbbb= bbbbbbbbbb/ > for ac_i in 1 2 3 4 5 6 7; do > sed_script=3D"$sed_script$nl$sed_script" > done > echo "$sed_script" 2>/dev/null | sed 99q >conftest.sed >=20 > repeats=3D8 > count=3D0 > echo -n 0123456789 >"conftest.in" > while : > do > cat "conftest.in" "conftest.in" >"conftest.tmp" > mv "conftest.tmp" "conftest.in" > cp "conftest.in" "conftest.nl" > echo '' >> "conftest.nl" > sed -f conftest.sed < "conftest.nl" >"conftest.out" 2>/dev/null || = break > diff "conftest.out" "conftest.nl" >/dev/null 2>&1 || break > count=3D$(($count + 1)) > echo "count: $count" > # 10*(2^10) chars as input seems more than enough > test $count -gt $repeats && break > done > rm -f conftest.in conftest.tmp conftest.nl conftest.out . . . (history removed) . . . # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #0 = main-n265205-03a7c36ddbc0: Thu Sep 7 03:10:34 UTC 2023 = root@releng3.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC = amd64 amd64 1500000 1500000 In my test environment with yesterday's snapshot kernel in use and with vfs.zfs.bclone_enabled=3D1 : # ~/bclone_panic.sh count: 1 count: 2 count: 3 count: 4 count: 5 count: 6 count: 7 count: 8 then panic: no 9. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Sep 8 22:09:20 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rj9Jq11vLz4sRdF; Fri, 8 Sep 2023 22:10:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x1131.google.com (mail-yw1-x1131.google.com [IPv6:2607:f8b0:4864:20::1131]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rj9Jp6HrRz3WVl; Fri, 8 Sep 2023 22:10:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1131.google.com with SMTP id 00721157ae682-5924093a9b2so25118047b3.2; Fri, 08 Sep 2023 15:10:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694211001; x=1694815801; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=rWBcnRs5Wav0FBJFlqfy4EcvCQStG37/cpDo/kq1GZc=; b=Bs4Csdb0qBE+PRhk91BZf052zY+P9xpBVhB2zAUrcezDaNoqcg0y1oTZnInG8BpmZO 4r8HI4I/dQo1jhTQYJy+bbhuSPMrgCeIrlmGf5rI4iA/XkX4khhM8vydgXuVlhyPDp6t teJESr595Y0KlOLGwLU088vkf6gqIwz592AxEuFWVNW3K8cfdOeyzW6g1dCdCLDR2RP3 6OlwtF2FZY6jOCKYX+e8EUscI33+hYPyNJiNnLpunQUgbW/hFj2vtFBNflyOJsARhBkf a681fxyuX7Lot/SVA4niRCZjbyGUBRZW8IZkL313vnHB7OzQXNJIANJ7pOT0M05C78NN 5HNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694211001; x=1694815801; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=rWBcnRs5Wav0FBJFlqfy4EcvCQStG37/cpDo/kq1GZc=; b=ohxKn4WjdOYE0dGZYuRXbcA3OqYc6ikzV1oPVWNHy33qX5v1JormXDteycyUSBITeA X2CTTZkDW6Bpsmo/Ds991rlAWrL8Rto22EpRSuXTUIp0lNXwTVh2W/ZX+Y4BuRrYdGet 7TXHo0h4GL23ryHmLkV8a91Qvor0o0BY2k4HXjx95Mp5M2DrXVXiCJvniUGowvDN9ak5 UpNM1I8uRdVryk0grj4RVglVYqVTixwJy7pfnB96doJg72iJVrv21T8iFlYu8yJiCDLe +VTQXLP0FNG3gzRj15330tJR2GQmo/RoNIsIQg94n+I0PiXD9miCRO5VGeUFhx++3rnG GoIw== X-Gm-Message-State: AOJu0Yy50c1YIau5nDs7BWNoDfm8E9Ut42K/pEFhOB6bys3xJw9kYKSk 9nEHupKEWkF5aLhxnDRsVxaCbTLrjcQNjQ== X-Google-Smtp-Source: AGHT+IGok/kyWyNBPq7I2HyFBtDAgA5PcnpedWXw0CYb9a7rTLn+MWnnHjhT9Q025JNrmYsERzmHoA== X-Received: by 2002:a0d:ea0b:0:b0:57a:3dd8:1038 with SMTP id t11-20020a0dea0b000000b0057a3dd81038mr4089938ywe.12.1694211001386; Fri, 08 Sep 2023 15:10:01 -0700 (PDT) Received: from [10.230.45.5] ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id h6-20020a0df706000000b0058c55d40765sm639106ywf.106.2023.09.08.15.10.00 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 08 Sep 2023 15:10:00 -0700 (PDT) Message-ID: <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> Date: Fri, 8 Sep 2023 18:09:20 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: Martin Matuska , Mark Millard , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> From: Alexander Motin Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics In-Reply-To: <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rj9Jp6HrRz3WVl On 08.09.2023 09:52, Martin Matuska wrote: > I digged a little and was able to reproduce the panic without poudriere > with a shell script. > > #!/bin/sh > nl=' > ' > sed_script=s/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb/ > for ac_i in 1 2 3 4 5 6 7; do >     sed_script="$sed_script$nl$sed_script" > done > echo "$sed_script" 2>/dev/null | sed 99q >conftest.sed > > repeats=8 > count=0 > echo -n 0123456789 >"conftest.in" > while : > do >     cat "conftest.in" "conftest.in" >"conftest.tmp" >     mv "conftest.tmp" "conftest.in" >     cp "conftest.in" "conftest.nl" >     echo '' >> "conftest.nl" >     sed -f conftest.sed < "conftest.nl" >"conftest.out" 2>/dev/null || > break >     diff "conftest.out" "conftest.nl" >/dev/null 2>&1 || break >     count=$(($count + 1)) >     echo "count: $count" >     # 10*(2^10) chars as input seems more than enough >     test $count -gt $repeats && break > done > rm -f conftest.in conftest.tmp conftest.nl conftest.out Thank you, Martin. I was able to reproduce the issue with your script and found the cause. I first though the issue is triggered by the `cp`, but it appeared to be triggered by `cat`. It also got copy_file_range() support, but later than `cp`. That is probably why it slipped through testing. This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . Mark, could you please try the patch? -- Alexander Motin From nobody Fri Sep 8 22:30:41 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjB7d0jK8z4sqYV; Fri, 8 Sep 2023 22:47:09 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from www541.your-server.de (www541.your-server.de [213.133.107.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjB7c53Ydz4FHZ; Fri, 8 Sep 2023 22:47:08 +0000 (UTC) (envelope-from mm@FreeBSD.org) Authentication-Results: mx1.freebsd.org; none Received: from sslproxy06.your-server.de ([78.46.172.3]) by www541.your-server.de with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qejzv-000LO3-HV; Sat, 09 Sep 2023 00:30:43 +0200 Received: from [188.167.171.2] (helo=[10.0.9.122]) by sslproxy06.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qejzu-000RYw-De; Sat, 09 Sep 2023 00:30:42 +0200 Message-ID: <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> Date: Sat, 9 Sep 2023 00:30:41 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Content-Language: en-US To: Alexander Motin , Mark Millard , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> From: Martin Matuska In-Reply-To: <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Authenticated-Sender: martin@matuska.de X-Virus-Scanned: Clear (ClamAV 0.103.8/27025/Fri Sep 8 09:37:45 2023) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.133.96.0/19, country:DE] X-Rspamd-Queue-Id: 4RjB7c53Ydz4FHZ Hi Alexander, I can confirm that the patch fixes the panic caused by the provided script on my test systems. Mark, would it be possible to try poudriere on your system with a patched kernel? Thanks mm On 9. 9. 2023 0:09, Alexander Motin wrote: > On 08.09.2023 09:52, Martin Matuska wrote: >> I digged a little and was able to reproduce the panic without >> poudriere with a shell script. >> >> #!/bin/sh >> nl=' >> ' >> sed_script=s/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb/ >> >> for ac_i in 1 2 3 4 5 6 7; do >>      sed_script="$sed_script$nl$sed_script" >> done >> echo "$sed_script" 2>/dev/null | sed 99q >conftest.sed >> >> repeats=8 >> count=0 >> echo -n 0123456789 >"conftest.in" >> while : >> do >>      cat "conftest.in" "conftest.in" >"conftest.tmp" >>      mv "conftest.tmp" "conftest.in" >>      cp "conftest.in" "conftest.nl" >>      echo '' >> "conftest.nl" >>      sed -f conftest.sed < "conftest.nl" >"conftest.out" 2>/dev/null >> || break >>      diff "conftest.out" "conftest.nl" >/dev/null 2>&1 || break >>      count=$(($count + 1)) >>      echo "count: $count" >>      # 10*(2^10) chars as input seems more than enough >>      test $count -gt $repeats && break >> done >> rm -f conftest.in conftest.tmp conftest.nl conftest.out > > Thank you, Martin.  I was able to reproduce the issue with your script > and found the cause. > > I first though the issue is triggered by the `cp`, but it appeared to > be triggered by `cat`.  It also got copy_file_range() support, but > later than `cp`.  That is probably why it slipped through testing.  > This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . > > Mark, could you please try the patch? > From nobody Fri Sep 8 23:33:08 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjC8k2MyZz4sZn8; Fri, 8 Sep 2023 23:33:10 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjC8k27nCz4Tdr; Fri, 8 Sep 2023 23:33:10 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694215990; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=mIgwZ3JXv4YeEbbTcGzf13s7LQ4jeWyoXJp6rOVMabU=; b=uQEGgsOvd13JCwDkpXZ+6T/9OEcDAz8HfXy4nH+hTfpPpQxLHTlwNmnkLSQxgsAPhIG3SG +PJ0qlL/b3DyeqqNcI9SdCbxvY9yQha59KZp10qImCG9xANceP5xx2AoZZlrohpwLvXhLe DQ1+bA9B0bbBpg1k1F7ucR54alAnR/xz7h8Blcm+vCzzScoFqK3VR0SvOskPJUih3SZr0N x0MdHDJaBnkmFeezjn9ntYFl5MxvimzXkQoPKCUbSdJSMJNVcFX2uRZOwoAUmvEhrR3Oex hbqO7qOfjgn0Xxi+Vov/+GuWe4gBxZRcOD3VWrlXyB2nnaL48QrUhh2BLa+LHg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694215990; a=rsa-sha256; cv=none; b=BXCVYCJpyrW6qRFJ7WZuOnN841SAHYW/SM6MpDm8JwWg4uL7GrMYmYbc2yyhbk9lt1PRkR TpxqK+D7DUR8ifkawK7wgDVEq2POlDYJeghQBeoa9KMHsHXkxXnVjWk4WdRlY+uc62XJDB fXF1wmImRWC8YFPiBuvkxlCscElUqb2PcLRaK6oNsYiwRCrQcFcxho8LRfM18BUB9XJKBY 7hF56H8Le81OZWAp2GwNaS7zFdE3JeZPKzWaZutTUcE4EFocRL0zKQKffOtIcE93AK9pau XF02GdhSz37XN3x+G2kCDN4iJW3uRxddNRY3JjTIzdwhFN8mRXjRQ5qlNgfkhw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694215990; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=mIgwZ3JXv4YeEbbTcGzf13s7LQ4jeWyoXJp6rOVMabU=; b=Q4zfmnRMA6XDkXYaA4Bsc42XB+KZM3LG74UZC06HXi0+y6L7o0j5W6XXqA8csnA7wSTukC tBem3sNIomKNS75jN5tyNjSBM35Jt7rpXMFm0FtzW8UoiAN9wE57ERh6JDR/ZQmPVqhRgj 9MC+kKWTWYzseBlUyHNGUGNmeeq1wl8JwvdvQL0Kuli1RaP0a2isoHbt6M9M5s0k8aDfcQ cQxJ3GhaXa2z81uOfT5x0w1He2Rk36kJ9D/lOhZpZvoL9LwLfuMg6NW44mrUv1cb3GiGTt UOrWLpMfqEAUji+6oVLS5K8D+2kXN2W7yWXn8okyjZVU+EYn9q5m05fbArlouQ== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id E1B1118DF9; Fri, 8 Sep 2023 23:33:09 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 8 Sep 2023 23:33:08 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 14.0-BETA1 Now Available Message-ID: <20230908233308.GS1219@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The first BETA build of the 14.0-RELEASE release cycle is now available. Installation images are available for: o 14.0-BETA1 amd64 GENERIC o 14.0-BETA1 i386 GENERIC o 14.0-BETA1 powerpc GENERIC o 14.0-BETA1 powerpc64 GENERIC64 o 14.0-BETA1 powerpc64le GENERIC64LE o 14.0-BETA1 powerpcspe MPC85XXSPE o 14.0-BETA1 armv7 GENERICSD o 14.0-BETA1 aarch64 GENERIC o 14.0-BETA1 aarch64 RPI o 14.0-BETA1 aarch64 PINE64 o 14.0-BETA1 aarch64 PINE64-LTS o 14.0-BETA1 aarch64 PINEBOOK o 14.0-BETA1 aarch64 ROCK64 o 14.0-BETA1 aarch64 ROCKPRO64 o 14.0-BETA1 riscv64 GENERIC o 14.0-BETA1 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.0" branch. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, aarch64, and riscv64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA1/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.0-BETA1/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.0/BETA1 FreeBSD/arm64 EC2 AMIs are not available for BETA1, and the cause is being investigated. === Vagrant Images === FreeBSD/amd64 images are not available for BETA1. The cause is being investigated. === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64 and i386 systems running earlier FreeBSD releases. Note, aarch64 binary updates are expected to be available starting with BETA2, due to a configuration error. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 14.0-BETA1 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 14.0-BETA1 amd64 GENERIC: SHA512 (FreeBSD-14.0-BETA1-amd64-bootonly.iso) = 655b733d5897e741bde7d0a03ddc7893237dc468263303e5898d0590e6b7223354ce5554b9c6d1c9b6dc11d446e1804a7238382e0f5bbf59f8c54b9aed4e6ec0 SHA512 (FreeBSD-14.0-BETA1-amd64-bootonly.iso.xz) = 2ecf86e2f198e0f01a305f572cad987e0589e587cf9d2bebd0740c18de35e7272fe06dcfd2456c641c2924def75e734e91de28bb965b929556a842ad70923a4f SHA512 (FreeBSD-14.0-BETA1-amd64-disc1.iso) = 2f49b058bd39f6491ae720af773dad7861509a5da2a5439e66b8c8ae36baff3be1ac266600de83b7dd073b49cb57114e404cf6339870fc66937d282ade249e05 SHA512 (FreeBSD-14.0-BETA1-amd64-disc1.iso.xz) = 4ceb48c7e5b3a11e9d7953c482ce3f51f397d88e919b80446c1883c1bb904cc2b33b6e058a33ba2e1affc605f1f1ba99b3a8d48235ac06deaca0370ab21aa0e3 SHA512 (FreeBSD-14.0-BETA1-amd64-dvd1.iso) = efef7c826a002a5cd180b8e3aaa4f50f46c752314ffb115078655c73464a7310e23a0a3cc8fab63c7ba103750314c9e042da9ec4710d8550db1f5497e33eff8e SHA512 (FreeBSD-14.0-BETA1-amd64-dvd1.iso.xz) = 03bc53d4643bee6f6c406a564c88d1430551edd3aa30d31089dafc5abde469888c881b018038c8176d169f94593e779eb20e035a5aa6f88b16439bd8317bf9f8 SHA512 (FreeBSD-14.0-BETA1-amd64-memstick.img) = 63f1554816df44a0dbfdbe77e845ca899d6f26bb7f4553ca43e92f2f964970e47f5f07fba7cf0f2d2767c2a518ffa970e4180e896d7d91fe547029a469004957 SHA512 (FreeBSD-14.0-BETA1-amd64-memstick.img.xz) = 858cefe490018be1925e04eb8f1f4ed320840d85caf82f071d8b8d8d9f00fb8ebbefef874662da71a0f4abf7c244c989be1c2f85c41781d53cdea444a7fa276a SHA512 (FreeBSD-14.0-BETA1-amd64-mini-memstick.img) = 2fbfb0aa9e437922fea5a4c00573d189859f88a9a01453b2a462a1a78c8bb02fb11033594ecafa56947dbb30a37616369ff8a15fe9c13a2e8d189091495233e7 SHA512 (FreeBSD-14.0-BETA1-amd64-mini-memstick.img.xz) = 312d59eae8614efdabc86ec7e79f857ae3662ecc0de69d7ea17a929bea6ae246566f2d6a36de000eabe4a4747e4c6abf1bde39904303d71f4e792a8f0bf73570 SHA256 (FreeBSD-14.0-BETA1-amd64-bootonly.iso) = 1aa1b288a3d3ea789af77cbb36c3a7ae7818630f4871df3851b0d8d8f6ed1152 SHA256 (FreeBSD-14.0-BETA1-amd64-bootonly.iso.xz) = b755ed0620c42fd191edf58d8c30ce0dd07354919db61866e707b20c13f98af2 SHA256 (FreeBSD-14.0-BETA1-amd64-disc1.iso) = 3833852cf8823d2fca82ab14cee3841459fa40fef179d030b96200686571bd36 SHA256 (FreeBSD-14.0-BETA1-amd64-disc1.iso.xz) = 16f0d548d371d800cbda29443d6bbefe8cf002e58723da94fdc31f785c3899eb SHA256 (FreeBSD-14.0-BETA1-amd64-dvd1.iso) = e07f48ae2cc0c4a5a60cab73d4a1ca3c00b5c4fa337497dea9ed7095c66c7f3d SHA256 (FreeBSD-14.0-BETA1-amd64-dvd1.iso.xz) = 90abc23bc95bc6e53a6373f1292b49093637d9e15eee2e8b3852d50d162bb178 SHA256 (FreeBSD-14.0-BETA1-amd64-memstick.img) = 40f54a892614430e8bc91ac6f2cda3f324ef26f5fd152d1f8fb547d74c48f497 SHA256 (FreeBSD-14.0-BETA1-amd64-memstick.img.xz) = 52e5ed0e46c729fa6a27734b512065daa4fe7fb1d8b50768d6f857efffe22d96 SHA256 (FreeBSD-14.0-BETA1-amd64-mini-memstick.img) = 71d5f0cea86d5810a7988664c1bf9f32ddb1c422b565c6514d934efe211e91f8 SHA256 (FreeBSD-14.0-BETA1-amd64-mini-memstick.img.xz) = 0b6aa0b44f52782407856371c980cbe3f7446d9eb779e9e9132851f377bf3b9c o 14.0-BETA1 i386 GENERIC: SHA512 (FreeBSD-14.0-BETA1-i386-bootonly.iso) = 04fd64c4ce87ab4c821c60dd049d2f671c519ba2816ef3f2fb76df79751eb86335a1dd5e0d037ec5a72d20ac68fd751638a41392fcb0803510a22d777d0a5624 SHA512 (FreeBSD-14.0-BETA1-i386-bootonly.iso.xz) = ce8c7e4e0e128a86f0bc869d4bbd57736d18ebcb49ad132c523a51bf5f3ad8f5d1258836f3a3f0200397d781ee36afc2493a70332504791c4d3e04384c5bb765 SHA512 (FreeBSD-14.0-BETA1-i386-disc1.iso) = c66d06ea252803f811508638e1ce267dbf9de27b7743a9747d3dd3ab64f7a84159ab27ed65319900eb92f43990ce81fbb7d471fc43b677d913034c72ac321647 SHA512 (FreeBSD-14.0-BETA1-i386-disc1.iso.xz) = 7350934e0f1ebd66cf676b77db4e985644a5acfb5a0c8a547090e78c8da156d05adeb83d6e68aea10bf9b9c92e22fb6f15ad461d9f0d80132db3c2215209250c SHA512 (FreeBSD-14.0-BETA1-i386-dvd1.iso) = 458f6ee3d5abbbcb419bbc0a388003f387d0b98bfd50d7a75c84f1e1af580665f5d16e6ed29b736867f9247fe8a9a5be84cd82edf3c5461f9965d19a2ac5f0a5 SHA512 (FreeBSD-14.0-BETA1-i386-dvd1.iso.xz) = 89de14a82abf6b67f4c89354f6713561da92bb89ca58d19f550bbd33ec11775bbe8ef67647b2316c78fd4e7d96ccd37599c9bc98bbb00a625d92ce146921e47c SHA512 (FreeBSD-14.0-BETA1-i386-memstick.img) = 7e4b922aea158f481b30f59a69e2ec542e2551335d4880848d4fe3d28d8afbb18bfab532530c934ff9371a180d4db7fc66ddcafdc9a0842b8179ae8140e4b5d9 SHA512 (FreeBSD-14.0-BETA1-i386-memstick.img.xz) = 67d4d86f7168514908f3606dce132dc442e4ca4ebd380b16c77268e7140e0433ff5a2204da541272dbed172093f130eef2db39e04c79089d1e02c67d58aef22d SHA512 (FreeBSD-14.0-BETA1-i386-mini-memstick.img) = a1934b51b8a54738d30212294b969911bd13b1391cc563ea8045d7e9b7ae51a9aaa32c7ceb0cab1cb8ba6f7fdd17e3bb579c791f9d8c80b39be773ff3d522815 SHA512 (FreeBSD-14.0-BETA1-i386-mini-memstick.img.xz) = 22270b48861ad88d32f75ae7f012ef6c615bfa451e862ce52a00641dc42c7633321bba4c9fafef60678868e4b7808aa79d2bdde2254b50def0a32cf69c1a028f SHA256 (FreeBSD-14.0-BETA1-i386-bootonly.iso) = a325495deb3e1a7d2a0119e2d9f693e5ab2256790853c6c836827fe70d8e20f8 SHA256 (FreeBSD-14.0-BETA1-i386-bootonly.iso.xz) = f31092bf005ff8765a1ca5ce18324e22c091920e72162da3ad61fb78b01cbb1b SHA256 (FreeBSD-14.0-BETA1-i386-disc1.iso) = b6eb1170716b2e31ac1b86ec465b44c6e67737f592479541749e38879614a23d SHA256 (FreeBSD-14.0-BETA1-i386-disc1.iso.xz) = a21d3a3dac2141d71469b59f159643f782413c4038e58d0a300c01f84d7584b0 SHA256 (FreeBSD-14.0-BETA1-i386-dvd1.iso) = ed9d9bba43d4cc8c832c2cfaf4e36868b7cf263568d8da69f819eb2999e068f0 SHA256 (FreeBSD-14.0-BETA1-i386-dvd1.iso.xz) = 71a9c3e7d877d459fe49deaf26229e0bec25efdb1117dbb8590258ea76bd6e94 SHA256 (FreeBSD-14.0-BETA1-i386-memstick.img) = d2b9136ef3c6f61bd2321a4f8b3cb19930deb9fc05671630e98b4dea19515e82 SHA256 (FreeBSD-14.0-BETA1-i386-memstick.img.xz) = be56668113af3d1126ac18c6a0f4e2c0244bd3fce39c60ab91f50a61eb8fafa2 SHA256 (FreeBSD-14.0-BETA1-i386-mini-memstick.img) = 31922474320f6474c6260b5a3a6ec499326a31bb9c93c8821a738c38172b4133 SHA256 (FreeBSD-14.0-BETA1-i386-mini-memstick.img.xz) = 1ccdb5d43962ac5c145864c0382ab83745afd6bee0912233e231fa3a755398fc o 14.0-BETA1 powerpc GENERIC: SHA512 (FreeBSD-14.0-BETA1-powerpc-bootonly.iso) = 3502711cc2738e153145e0ae5a265ec320da21d50ab214b953fa7c9d73a76e3ee081e23d98a34edc8a4339b6de0c9b2f637d579ad8bc00eaed01d2afe6578232 SHA512 (FreeBSD-14.0-BETA1-powerpc-bootonly.iso.xz) = b2f3ab3b722aa75f0734e3f49f90ee088c035ae8572ef9ab6f2067b220c4beb2ddc931b8847d45e5747b11916615faff29f556b6a8dc43c8d33521ab94471b90 SHA512 (FreeBSD-14.0-BETA1-powerpc-disc1.iso) = 934c615d6e2954d9cb995f45567390e4d78389252b2aae99833e5ddd693d5ff0f3aad44d5c6a9cc9775d5a3a12885ebccd1bcb955c4de6acd0c43e853aabcf77 SHA512 (FreeBSD-14.0-BETA1-powerpc-disc1.iso.xz) = 3ff3e33f5bdc9d8050d3bc42f6200930876c3ff455f4af6e8e4b8454c72b4f7f4a0065ebc1fbcceb1be2c922b07a6088474a55c7d85dee23fda08d1ecf149566 SHA256 (FreeBSD-14.0-BETA1-powerpc-bootonly.iso) = 31ad840e58f401943ae9d6f55231d771c098fb377ce4bc931541fc3aa22b37ae SHA256 (FreeBSD-14.0-BETA1-powerpc-bootonly.iso.xz) = f96d19fc7bdc0f4d50a0214fa483e51baab558c85a333e4e62cc46ea8a9b7591 SHA256 (FreeBSD-14.0-BETA1-powerpc-disc1.iso) = c7d3d1d889f92a169e431a77e213b26afbfbefe8ac2cecdaa9770f17fb0a76b5 SHA256 (FreeBSD-14.0-BETA1-powerpc-disc1.iso.xz) = e951b5015ee15b8f900a0df4baa9569fcf4d763ec095ef40d1a560461dcd7864 o 14.0-BETA1 powerpc64 GENERIC64: SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64-bootonly.iso) = e3102d3696afdae14650d6c4993001c57f10e91cb0b0bd57b04e5ac348b308918715756d95c098a4536447baf19248dd79f5871db7d8fdcd4e0778e51f038997 SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64-bootonly.iso.xz) = caa2e6dc0c115c4361a30ac7703e8952048e922ce04cac4940e9cf4c0e8e593e317b13aaec4c3eafc59560d2fbdcc2188b5a33366fbcaa3ddc75388a5b461d5f SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64-disc1.iso) = 735287f54959a28358d39bde078a3b0642f718b3d53f4b2d4afd66fa23bd29ce7757e5d00c46b8c7c8a5c70cd5cbf092e7a8220c6aafd746e8e38093de13a032 SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64-disc1.iso.xz) = 999db24d107d77f852587ee05cd481d0a916a50d094c28801cb488ce6a9986038aab4f757be004740b29f038efc6453696b9abb0abe41d90382d582ed638b493 SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64-bootonly.iso) = bc37e4aa9586d5e1c2c2559c320b39c01150f7d664f3453d81e4a9b40c30243b SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64-bootonly.iso.xz) = aa3c8acfbc6b4836c45bad46fd6677c56bff53dee8a303dc2e43ae84a5da9a08 SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64-disc1.iso) = 3c4b7eb3c6f143c8d6fcd6a5159f97f1dc79690751ca2921c8b7fa0bb6b5a4fe SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64-disc1.iso.xz) = 013f41b7efca47f0380f0036d44eae318c6cb1993d52a6756b60721f25508525 o 14.0-BETA1 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-bootonly.iso) = 61eab0e88566cf97d9ea0611ebcd99650ef221999e165c13a6aed4cc5d3049c33070d22c1cac8a1b34ae1cf835be8a25228ea730ac85819c78e3298dfb0917ac SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-bootonly.iso.xz) = 2676fd4db2005563924e9395445ed4f01b9e5a2ad099c1fa6055afcc4623ab4fa37dded0adb02429177155b4624f98b739e2aec96268693a8d43e9ebffaec68c SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-disc1.iso) = 45e543fbfd6e68a746de636593de39798d5c0a682a151594b37d8cb63d4f03ee1f9beeee09caffd271e82776ba8ee353ff4b92468eaf8358447a7bb466961c49 SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-disc1.iso.xz) = 6da8e96a7dffd296ed98618f5eb8683cbfa4caaf7e955be06b0acf7dc9e79f0e2cbbeb5fe3ecf28ad70acfca7df0fcaf9c3abb9a76741640b39c7b44997f1309 SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-bootonly.iso) = 05935b7803b52cbfd3473364285b86aff244188d7b4d5effba80b438270917b1 SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-bootonly.iso.xz) = 750ac8874cc57601b1349228a1510bdba41c732ef65235c7f66e352712dbb5ce SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-disc1.iso) = 1d530fc643a1cc4cf383293f6b039b688833b7235c26de6cd9b5509e4bfd4097 SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpc64le-disc1.iso.xz) = 02ed5b81115ce5f1dfd88e8c60a6c73a758abf5eae0caf3eebbeec58f057a37e o 14.0-BETA1 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-bootonly.iso) = f50b60ded12c1124696114a64ad7c8320979b7154815ba42869d4f2504bbb2c17de04cce0fad821c85f60b9709af74d4e46b9106adc6f10de93bfb1d45413917 SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-bootonly.iso.xz) = 30a81688340e7b0f6538e6117ad9a34562a3ddf7d21f08d1de1f0937896d04b7135757de8c113833f1f9472ecb1a19754b937b9de99434b57046fc3ab829784d SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-disc1.iso) = 9bdc5ff370ef76b63f822cbf40a2725d430bf05573a62ac4fb9c40b50596d3a87f258e707fb50dffe0c572f8c2e4c61a47d2c3904da6393670d4c9333dcb5642 SHA512 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-disc1.iso.xz) = dc13ecdddcfcd3d43ecb8e5265ebb8283ceec0c655818dfdc6c3e80d4317956d37f96c1d9804fbac1f6c6f76745ed2013cb230204aa3521280abc3084fc7582e SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-bootonly.iso) = d0b11a84e249a3c348c1b7549dbfb54ea92409a7756eb9990cdf7b4101139c3b SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-bootonly.iso.xz) = dd3c592f5ba69680f4bb74c83ec9a04df228e5c58740ce32abaa742e88c5569d SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-disc1.iso) = 52895e8c340247c1a5e70a9c8b2c93b0a875340dfa86d8b3d18a7c409e5bdd7b SHA256 (FreeBSD-14.0-BETA1-powerpc-powerpcspe-disc1.iso.xz) = d8db29545adccced5ac248c96fead88920b86b877e179fa879df07edd122918f o 14.0-BETA1 armv7 GENERICSD: SHA512 (FreeBSD-14.0-BETA1-arm-armv7-GENERICSD.img.xz) = 6d96bd66538a08d176afeaa34d876a37c1b45f0058d600392ffd13dfee3b1513a7a699d4f08632b5d6ebbecb969ae636553a56de1a1b8337686b74d05c6b1ea6 SHA256 (FreeBSD-14.0-BETA1-arm-armv7-GENERICSD.img.xz) = cbed08bc31f47a24ca8bfbeece0811c1a41ec3fab9d66aac4abf206d5f152c93 o 14.0-BETA1 aarch64 GENERIC: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-bootonly.iso) = 2db57093f2eba676cb4028beb823f9511ba13afd6865a67d24d74160f30e536fe5c5796847453f132e3cbbe67bfa916c2c75cc3b5acf217a07bd9ce9949169d9 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-bootonly.iso.xz) = 572c3c295fdb804c98c3e7d9e656223dea4a81046ac57f906c2ca1002578ef662b7e82cdc6db6b3de5c373efb12b385d21dfa20b20a02f145087ae134f97a44e SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-disc1.iso) = 60a7e38d47541820b53be0f754f4f89ba02a8e341d9bcf2d75aa4d366d0dd98d8609bddb76f35446297da3c9da3536667a416f15c9f9f705b53df1ce4947c2d6 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-disc1.iso.xz) = 20849e69878d071f4d8da766fce40bda65e8b218a716213df8c351a2e6c544cb0364b19ab7735fd07e3fd2accb57b8a6fcf561cbcf7e8c19f3da98766fedecb3 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-memstick.img) = 17389f625de79d98d06dab7ebd01ee394a5123c9a10ef501254a5b5391d54552848179477ea269c264c46402defe8575ef98da3c05acd16cbb77421fee7b68a7 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-memstick.img.xz) = a1a430b75e2d80823b8a0d7ef00a6a92f50ec4b8d568d7e0f40eb359c3a4479b633f99b17e5a4016cd437a2df1359bfec0bab8db833e924388589c9ade58a56f SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-mini-memstick.img) = 7d4842772383b55e46e5ce5c217bf5526ef9e514d0f52564747582403392716169c36f22b60049e51deea26f5af8eb8f68267192288f5f3e194e90766cc57f7c SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-mini-memstick.img.xz) = 7594b98776b5b9760c2e45fb29bc5581761a1249171a6062e2f640b07f130c2300c7a42af71c6564dae513e80d6b4ba62dc786493d6a1296c1e57d61e3d50b7b SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-bootonly.iso) = a573d36991e781809695c97946b6645d2f8150419afe774eee83bc012321ab2f SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-bootonly.iso.xz) = 44da455aeeb7b4231d07843a49c99f393a49d27ab35f125a897e788dee538b52 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-disc1.iso) = 462f266b972629938ef0a23b905b42135fb7554a128a9f78c7cd34fe54246aa0 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-disc1.iso.xz) = 553155bb0b7bc02be09a7f82820f6b65f1b531f6d39cfb3f2de3ed3d767cd19d SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-memstick.img) = 5974fe276f31d14c68c841c12558a26b200c9c41aa92d5f30afcce0120c1943a SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-memstick.img.xz) = 475b028431e576c1c76e309056363f14bb48cb4be0f72194f033906ea80fec48 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-mini-memstick.img) = 53d3be2f526590fe1869e483a328c2ed423a89d45819d5a3e2b5e70809c3c762 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-mini-memstick.img.xz) = a725482606079dcfcaa2310540505ca77a5e3c2e38c0b3f251e40c45381a080c o 14.0-BETA1 aarch64 RPI: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-RPI.img.xz) = c29f37ac3852ff0320bca1b05bbfbfa68aef81fb8267d4d4bc0bc418043a20819aa768abcbfa373184ee1c4f132d2ae8bdf99b107878afba228d81b730f71572 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-RPI.img.xz) = 820041ba13c813ce9240d7cadabd4b030907d0cfe19cbef1bbbd058608f54365 o 14.0-BETA1 aarch64 PINE64: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-PINE64.img.xz) = 92ed0bee06815aed119874164a0891c1b93a440e31066a881cd438a4bb2974982bdaf9c4e2c2fdbf274407210d6ebea6768d49e5a595ced31b73fc1be559719d SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-PINE64.img.xz) = 74a653492f04c189c4ab0c07fe3cebd3b27b17b54e3038a97c76b67267a20de1 o 14.0-BETA1 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-PINE64-LTS.img.xz) = 66adcd68b06207acd80d75118c1a49ce79bde3f6d7ad11548f68a0afcca1d99d6c858c3fb10a83bac490aebdb523e9fa86084cc857897ab641873c4f10a6b553 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-PINE64-LTS.img.xz) = 89d32d693687c016e904ecc9289c9f6ce078dc2b69ebc11c0b7c10fbe1149893 o 14.0-BETA1 aarch64 PINEBOOK: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-PINEBOOK.img.xz) = 13739881805b7402d825df8c899195ad8b62c38df42849e63b8635e21c3c53483de97bd6b548adf79f1d88c1b345fb646825ac760649406f13e6a8d9a7edabc7 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-PINEBOOK.img.xz) = cb434360482298a6a4a613775d93614d4296c78bc9008ab95271b9e62a7dae8b o 14.0-BETA1 aarch64 ROCK64: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ROCK64.img.xz) = 05aeb5d9d00a1e537d619ca92173c34c8af6e89210499de34f2ca0337127b95c205c6eb3449fc06a61e3916cf533686265e2b0b1103daf5acd6de4604ab30ffd SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ROCK64.img.xz) = 7b826c1721eb186e4510eb01379df1c59c014edd15302f048195cdef57503127 o 14.0-BETA1 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ROCKPRO64.img.xz) = 7f7c6c6f3561d16ce67a8b38850acd15ae51a2e0f70d70cb7217da0488107bc1d1e359420ee4cd8499bd7c2d6c68e9234566e270ddd6674404133b25aba3d7b8 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ROCKPRO64.img.xz) = 012f67a7f05d458908126bdcff697ea36d0bbe7f933bc51770be795f60652de6 o 14.0-BETA1 riscv64 GENERIC: SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-bootonly.iso) = e38c3fd40a92b72b53e2a28367fb4f1c21399cf87ec76865a1fc20326d9fca3e4115088956cb872534352fc75a2004b419069f6fef22259757eec762e7c081ad SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-bootonly.iso.xz) = 72c72038a78806ed9ce91ff3409fc42264846f66ddcf7dd377bb7f4a3aa13fc0a7ae27cf7bb1f88440cb64a1a0dda5ec0696a46b3f29f62f0df2b75eaeed21e4 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-disc1.iso) = 2d28e5478bf1bd0bbfd17d664bc62db025df4952e6a1900f2bf06716ab189dee32ac2fb95755d17d3115047cdc3508ea87225bc8d4661e7f2811666c0b660a78 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-disc1.iso.xz) = eca5d47a08cf3714770df5d8ea1f9d51f5cdbad717f5d416866f64b499b5d03256b491dbe4ea0166f69070ea75bb786d14809f55bda73347c7c0bf3908ee3e19 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-memstick.img) = 11c9eabbca2b2b7ab0fa3462aa26181724cd9e3079c094660c8e1861b9829a4e11d6d3c681ef0a6200aaa8045179b05a25aaace99440538302b7acc616809d58 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-memstick.img.xz) = a93aa4a8f563d18b2a75ac67ff825413969badc04ea7680e7ead47ff2695acc6cd02929e7b24e9c8df03e0c92a98aba5d7683c70ad571c171fe3dbb589453b2f SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-mini-memstick.img) = e162df26f8ecc528ea872dc4a03047a0f85d21c47d7dc25661dd72f8e7941020c4c1d8f009fc74a94277e4788f3aefdd55d3a451aa5f87cd9b5ffea8f29dda42 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-mini-memstick.img.xz) = 66619e79600a1cb1ee4df110bf50b9b8d6150064b60195e9ddef1f8fa18fd70a3cef678830466ad532b6879437170687168baa1844e80d21ba8d94cbbb5c0672 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-bootonly.iso) = f492fc9d9a26f23442abefdf9f7f232cc6e8bd856e3572e6e4378cbefeef3833 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-bootonly.iso.xz) = d891c8044f6d7197901881f85672a17699702d347a9965153b910fbcd2c1b62d SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-disc1.iso) = 9fd0fa4d59d33aa42bf153bb029da620fd37d87fa413bb2615e1d52a5aba6ddc SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-disc1.iso.xz) = 6ec312a7d08d01ee4a1ee53bc377bc7c42acb2ab29c68104de9b2e267998725c SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-memstick.img) = 7e15ad1fbd3a5460e9175b67f4d019bdab6905735d9f585ab91660f5b3dfe4f9 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-memstick.img.xz) = 7117043efdb2c5abb1298412c064f646930c1c9e9d182c966ec051437a22c985 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-mini-memstick.img) = 0dc180ea2e26f667a6687a4061ed4e2c019935e95169ba1b08d205ec88afe417 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-mini-memstick.img.xz) = 291e268b7ae6d257de9148d4bfe6ded3c69f0bb5e6eea4b57f623c8088c2f5ce o 14.0-BETA1 riscv64 GENERICSD: SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-GENERICSD.img.xz) = 5de5af587e2a3e7702d8aa3800d8fbc6be1fc2484c710f6d6417d4e70b2279d209bbbb1a57ffd2a63efefb1155fda759c9123439bebcf484c868090ac69ae213 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-GENERICSD.img.xz) = 38d886814a1e0071f50b4685a2a92f8519aa2640da88a951b201140e51d7b571 == VM IMAGE CHECKSUMS == o 14.0-BETA1 amd64: SHA512 (FreeBSD-14.0-BETA1-amd64-ufs.qcow2.xz) = 88768e7cd7dcbfb158eeed5a0bbe06e51ee3c22095d14d355d0a6ef81e6ffd9d59d93aaa92b42a0affed0224c2b4119202fce7b92c52f6c9ad9413d1e57909f3 SHA512 (FreeBSD-14.0-BETA1-amd64-ufs.raw.xz) = e557273cadd6e4a0236168c24679309232e6e08eea32d63f1f3a06e59ecd0029e7d3a59760eca4dc316f604e9058d9d5f7a11959cb86ede821a091b5ed45b0ae SHA512 (FreeBSD-14.0-BETA1-amd64-ufs.vhd.xz) = 1c1b469ce6c9fe29c082a3261f8a5b9683bd679a01a3f5d8e8be8f65d2ac3243b673e0364f5377901c57fa7312220bf10da2eedb5f29f144bacce144dfec4517 SHA512 (FreeBSD-14.0-BETA1-amd64-ufs.vmdk.xz) = e8d4b57a4f6d7ed36b1dd9ac4542dce9e19c85b498089e308fe5d8a269228a1930141293d81dbd61edb2c36e3638c9eb4644f43169a02d4f8d0eb541484df90c SHA512 (FreeBSD-14.0-BETA1-amd64-zfs.qcow2.xz) = 6250f1b95b6c8bddd05ae9c7338014d4f427ba10a5318609a1c09bbdac328a226c8620d5a1a64bd5d366e45d91fccc266a9693a243e21aa180b75dc8553db9d3 SHA512 (FreeBSD-14.0-BETA1-amd64-zfs.raw.xz) = fb83cf9e958ffb100451f15757445c9789c3f76ef71db83e066db05bd3894f10715c607c164a47c2ccc58eb1332876978e7f19deca5b5e5a664f4d7647436227 SHA512 (FreeBSD-14.0-BETA1-amd64-zfs.vhd.xz) = 8ccde4e0f81a0ea713e96fe394c5df0c5d1db7e15f5beaf9c755b51f30d16f65f83edbab3c8a16cde59f07282529a112eb268c0b80154c0562a958f23220c08f SHA512 (FreeBSD-14.0-BETA1-amd64-zfs.vmdk.xz) = 81d84da3112999f6747f0d7dd68302f9779b3ccb4ec81835cb36569b64e201be5204ae565d9a7325781c14a9c2d55fc36329d7754116e89f4227b59e55821a74 SHA512 (FreeBSD-14.0-BETA1-amd64.qcow2.xz) = 88768e7cd7dcbfb158eeed5a0bbe06e51ee3c22095d14d355d0a6ef81e6ffd9d59d93aaa92b42a0affed0224c2b4119202fce7b92c52f6c9ad9413d1e57909f3 SHA512 (FreeBSD-14.0-BETA1-amd64.raw.xz) = e557273cadd6e4a0236168c24679309232e6e08eea32d63f1f3a06e59ecd0029e7d3a59760eca4dc316f604e9058d9d5f7a11959cb86ede821a091b5ed45b0ae SHA512 (FreeBSD-14.0-BETA1-amd64.vhd.xz) = 1c1b469ce6c9fe29c082a3261f8a5b9683bd679a01a3f5d8e8be8f65d2ac3243b673e0364f5377901c57fa7312220bf10da2eedb5f29f144bacce144dfec4517 SHA512 (FreeBSD-14.0-BETA1-amd64.vmdk.xz) = e8d4b57a4f6d7ed36b1dd9ac4542dce9e19c85b498089e308fe5d8a269228a1930141293d81dbd61edb2c36e3638c9eb4644f43169a02d4f8d0eb541484df90c SHA256 (FreeBSD-14.0-BETA1-amd64-ufs.qcow2.xz) = 9806c8b312e8924b9b410f8b8364aa27fe855efaec196477b5523b2108e67c43 SHA256 (FreeBSD-14.0-BETA1-amd64-ufs.raw.xz) = a5a75f11020a6faed8e72b148176c7629a391f560348d465f4e5a5bbe9fb844a SHA256 (FreeBSD-14.0-BETA1-amd64-ufs.vhd.xz) = 42abf5406b835996f0dc2dddb777df4360b78ec7ebcd7e63df0c4a02663bbe4a SHA256 (FreeBSD-14.0-BETA1-amd64-ufs.vmdk.xz) = e13c5caf25b4516bb95de414ed93f8e36bb851c217867ed89e708449d42ede2b SHA256 (FreeBSD-14.0-BETA1-amd64-zfs.qcow2.xz) = 615b06d1aaa88947b7a811eee9e27032041694dfebbf19cfa862554d932c5fb8 SHA256 (FreeBSD-14.0-BETA1-amd64-zfs.raw.xz) = bb92d4f7dfdb2008a9420399e5b7504f5db7c3d33b2fe2921f615f700c73913e SHA256 (FreeBSD-14.0-BETA1-amd64-zfs.vhd.xz) = 82c7f85cdfa72e45b6a559708ce4b38735f73cd777a29e3b137629046c6642db SHA256 (FreeBSD-14.0-BETA1-amd64-zfs.vmdk.xz) = 9774d8285019809fec7b3bdbec1d58093f422146cce70a3b4e26a49277d716cf SHA256 (FreeBSD-14.0-BETA1-amd64.qcow2.xz) = 9806c8b312e8924b9b410f8b8364aa27fe855efaec196477b5523b2108e67c43 SHA256 (FreeBSD-14.0-BETA1-amd64.raw.xz) = a5a75f11020a6faed8e72b148176c7629a391f560348d465f4e5a5bbe9fb844a SHA256 (FreeBSD-14.0-BETA1-amd64.vhd.xz) = 42abf5406b835996f0dc2dddb777df4360b78ec7ebcd7e63df0c4a02663bbe4a SHA256 (FreeBSD-14.0-BETA1-amd64.vmdk.xz) = e13c5caf25b4516bb95de414ed93f8e36bb851c217867ed89e708449d42ede2b o 14.0-BETA1 i386: SHA512 (FreeBSD-14.0-BETA1-i386-ufs.qcow2.xz) = 398ed465ed36e3b08a2b84c05686a22ebaf2bcdedd150cee4ca116ed232844814bf3a54d012350cd50103f75c15ac63c6e1dbd497c8b49719089e5f7e26331aa SHA512 (FreeBSD-14.0-BETA1-i386-ufs.raw.xz) = 33aaebe58651d33907dc80e877be744340048a7d909862bd2ca2ed1a3ae5b3e318a505f9067abdd0da0c18ffb88e187bb815484d85cd412433ea88486690cfd1 SHA512 (FreeBSD-14.0-BETA1-i386-ufs.vhd.xz) = 8316cd09e32a2d0168a6597453b7e030ace221876846d3b62a3bf04e451735da734780e9f57cbcf222dd14912409cee83dd71b2bf0fa05718989cfa159892937 SHA512 (FreeBSD-14.0-BETA1-i386-ufs.vmdk.xz) = 29a51d2dd9e3c02bdec68ed5386342bc094c8cbeda57515d0d61f40b17afa227aba484efd8fb8137c9853020cb3c9954822a1c185be8c0e0af8693ba51db702e SHA512 (FreeBSD-14.0-BETA1-i386-zfs.qcow2.xz) = d3217800085df6ac550226f8cb4ebc1bef0d138fbfece3b35573d3b684e4cf5b134e8efa0cbfbd981c36c21639dc622b9d74cba28c975f6c470f62d8214927ca SHA512 (FreeBSD-14.0-BETA1-i386-zfs.raw.xz) = e043234ac5b2a68844e5254a845f7e67f3080bab42d0213dd60b8ac3a6190961cfc88a4291b59d031bdc5a1a867df866e92965af6a86b845a273687e7553e0c7 SHA512 (FreeBSD-14.0-BETA1-i386-zfs.vhd.xz) = 1a761c97f23f2e8748dc821c2ab22d38889b4318f4f505153f01318e92644b25dd71ece546dfa2240bf6063356b8c776cac659af304dc5d64022b0106d1dcf86 SHA512 (FreeBSD-14.0-BETA1-i386-zfs.vmdk.xz) = 49b67ecda81b0353f113a5af15b7a1dee69158e91ab87e6230635d384941ef07c7a2713cf4465eafd8db3b346a96b03af6c9b508141ffcf7b1f5df72688e429d SHA512 (FreeBSD-14.0-BETA1-i386.qcow2.xz) = 398ed465ed36e3b08a2b84c05686a22ebaf2bcdedd150cee4ca116ed232844814bf3a54d012350cd50103f75c15ac63c6e1dbd497c8b49719089e5f7e26331aa SHA512 (FreeBSD-14.0-BETA1-i386.raw.xz) = 33aaebe58651d33907dc80e877be744340048a7d909862bd2ca2ed1a3ae5b3e318a505f9067abdd0da0c18ffb88e187bb815484d85cd412433ea88486690cfd1 SHA512 (FreeBSD-14.0-BETA1-i386.vhd.xz) = 8316cd09e32a2d0168a6597453b7e030ace221876846d3b62a3bf04e451735da734780e9f57cbcf222dd14912409cee83dd71b2bf0fa05718989cfa159892937 SHA512 (FreeBSD-14.0-BETA1-i386.vmdk.xz) = 29a51d2dd9e3c02bdec68ed5386342bc094c8cbeda57515d0d61f40b17afa227aba484efd8fb8137c9853020cb3c9954822a1c185be8c0e0af8693ba51db702e SHA256 (FreeBSD-14.0-BETA1-i386-ufs.qcow2.xz) = dbfc09bcdea24d8d2ef33896586db1e17a307fca0378995073bd84c78d40b403 SHA256 (FreeBSD-14.0-BETA1-i386-ufs.raw.xz) = 7115a9b00e1057db11c4c328cf8b26fea0c8f24c95d34090b5110cfffbc296df SHA256 (FreeBSD-14.0-BETA1-i386-ufs.vhd.xz) = 1718ea51019f8356af9096019822530661732de2e7ff561e00bf2fff6f8de561 SHA256 (FreeBSD-14.0-BETA1-i386-ufs.vmdk.xz) = ce45a6099f2a617ec6250c0856aad9d695ae81adb120b731a68231662147f837 SHA256 (FreeBSD-14.0-BETA1-i386-zfs.qcow2.xz) = cc778f4268de4b5bbe115f217b5d02c293fd5f588a1c6db4e991d3e468a845f0 SHA256 (FreeBSD-14.0-BETA1-i386-zfs.raw.xz) = 8bf661596986525569ba00993b2ee8498fb82955896686bdd7d082677a46a48d SHA256 (FreeBSD-14.0-BETA1-i386-zfs.vhd.xz) = 04ece57110af7301fb9c5bc68fcdfb42da428ce09c3dbff20530c0c516116ecc SHA256 (FreeBSD-14.0-BETA1-i386-zfs.vmdk.xz) = ccecaa6381acc6960afe23a8a4476b03109032f0315e9bc2f31bf114d4539db3 SHA256 (FreeBSD-14.0-BETA1-i386.qcow2.xz) = dbfc09bcdea24d8d2ef33896586db1e17a307fca0378995073bd84c78d40b403 SHA256 (FreeBSD-14.0-BETA1-i386.raw.xz) = 7115a9b00e1057db11c4c328cf8b26fea0c8f24c95d34090b5110cfffbc296df SHA256 (FreeBSD-14.0-BETA1-i386.vhd.xz) = 1718ea51019f8356af9096019822530661732de2e7ff561e00bf2fff6f8de561 SHA256 (FreeBSD-14.0-BETA1-i386.vmdk.xz) = ce45a6099f2a617ec6250c0856aad9d695ae81adb120b731a68231662147f837 o 14.0-BETA1 aarch64: SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.qcow2.xz) = a004a801504f01e8f228443f11decb0fb4a50a758e13f20e007094311780fa320635c0f1c14e92b0513f24a721f46daa90a26769139de4b3ca31f63326a7d368 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.raw.xz) = f76fd36bc4a95ccdd1b6745c0b75036605affb525c8e985bbc38232ffbca8cad3e7d52e3807e77b9d8f101ac948d47f071b6f6a125f4905c728256fd34d9eb27 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.vhd.xz) = dc6b9fd69079587f93c068c2516a2fa3ba2159017754292489b4a7c057c7399b2a36cb231dc6a1dca5f2f0ea49f8c3d1b0b8216ffb8118254637839195724917 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.vmdk.xz) = 87deac1af5ef3ebff01f18349f19fad2eb65c46f7f66a96dcbad77634245f85ad4065a6fb4920cd64a9139d4d9f84769157cb6c9568eabb72c4898e8e54e6463 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.qcow2.xz) = 2570d176320c4f1021ad27bc00260fc42299a2dba53c631ab976962b8c660c7ffc1dae469ed0bc465c1395461dcb5099ba6c94d0c5e2c087c5ac9eb793ba1b85 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.raw.xz) = e26f9c15bffb280e8d96c24297490dba673e2d41aa62ef35442958af2e2fa850b5dae9b06aebd0c32f71f52acb63bab598b0871690985abf911d50a5e3bfe9e1 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.vhd.xz) = d005b1b0cdd3a8fb8474fa5517c8c75e50d2e254af8fa42700b96e024489c1e9fee68c2cdda2b4f6fca102134bd47a7e4374e02b65fc55f6a13b800186371d4d SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.vmdk.xz) = eece73d646984e4898d84e75a4b1442c31d5d157f6c393efa8ced85c73f6b9bc94923d1c327a86495f0b7fc7f388af4b8fbbb8c2bc5ec38de3c5d1bea549b5fa SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64.qcow2.xz) = a004a801504f01e8f228443f11decb0fb4a50a758e13f20e007094311780fa320635c0f1c14e92b0513f24a721f46daa90a26769139de4b3ca31f63326a7d368 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64.raw.xz) = f76fd36bc4a95ccdd1b6745c0b75036605affb525c8e985bbc38232ffbca8cad3e7d52e3807e77b9d8f101ac948d47f071b6f6a125f4905c728256fd34d9eb27 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64.vhd.xz) = dc6b9fd69079587f93c068c2516a2fa3ba2159017754292489b4a7c057c7399b2a36cb231dc6a1dca5f2f0ea49f8c3d1b0b8216ffb8118254637839195724917 SHA512 (FreeBSD-14.0-BETA1-arm64-aarch64.vmdk.xz) = 87deac1af5ef3ebff01f18349f19fad2eb65c46f7f66a96dcbad77634245f85ad4065a6fb4920cd64a9139d4d9f84769157cb6c9568eabb72c4898e8e54e6463 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.qcow2.xz) = 1971abc90261d0a356ce6abbe15350845986f60995ce923fc2c5bcd52f205df5 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.raw.xz) = 16137190d8c7195eab4ea5abf41675f87e8f3c74317cc9ab7cae35b02b668b0c SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.vhd.xz) = 87a648c8ead3b41d8ea085caa7c93eb6864f63fa9a47ff81483477cee5135cb5 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-ufs.vmdk.xz) = 02edb922169a770fec77960627737ec3b4d4a5d4dede8c0b68bb2af12d515453 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.qcow2.xz) = 6ac7ba709e07324aab6ac1938f5c21f949de281b955fc3c25e33014188726fd9 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.raw.xz) = 7c9f5f4f495126648fc76d1c8841bdb733c1002e69f875856a3c4c1118999a7b SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.vhd.xz) = 3ec7d38f1054e47a922d784a9aca0ecfa5e31337592a339c927465d0cc5e7385 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64-zfs.vmdk.xz) = b64d6734fc5462686ffbe837e0f062869ffdac91e51672d2742ba4286cb5ac8d SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64.qcow2.xz) = 1971abc90261d0a356ce6abbe15350845986f60995ce923fc2c5bcd52f205df5 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64.raw.xz) = 16137190d8c7195eab4ea5abf41675f87e8f3c74317cc9ab7cae35b02b668b0c SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64.vhd.xz) = 87a648c8ead3b41d8ea085caa7c93eb6864f63fa9a47ff81483477cee5135cb5 SHA256 (FreeBSD-14.0-BETA1-arm64-aarch64.vmdk.xz) = 02edb922169a770fec77960627737ec3b4d4a5d4dede8c0b68bb2af12d515453 o 14.0-BETA1 riscv64: SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.qcow2.xz) = 16f6ec04b5a60b65e0f4762730be806362b94d76427e6474356c866b1aa313ddf3d8b2eb9acd80c70a9e644349e80af94e63014560b9ca6ef59363fb2cf9d775 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.raw.xz) = 3c20f49cf239c90f50adb1a821cea5f6b674e2e658784642f1701a0d7334b5f44efe0228d4fa450216d79ce354478b38da20b9bebca8ec42532d1f7a8627e824 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.vhd.xz) = 0fbb1d46fc7cc52336f3d9be2ac9739b0851c258aa1bd473f5718f55b635acf592faf87c7b4d402d28e5fcfc6257afcc77f1554ca9c2a7da4913e210a543650f SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.vmdk.xz) = 3bdbc17b3d94e33324a4613629281d8fa3e9890edae26921c078d6c314bb463bc16dfbdbc75c3be0b5297ea406338db4e188cc0cf362761d4a098b0b7c8c45de SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.qcow2.xz) = b8797bac6878775a397e3efeaa22a4fa087931d44242de35cf2333b295926bdbc8396d732004822b11801321fdce19a14ad9f598bc46f00e396576d67fd94f2e SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.raw.xz) = d334777ec1f290a7b9ec48b7439b7a12bc2a2416959eff6886b05486ad9e5a1b789432a546409ef82b6fd1b3fef1d07a0553f8ac7225aca900d98aec7ca299af SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.vhd.xz) = 5f2acf783a41dd51f28fa48d25f460070249352728191f61f5ffca0644e55c1c7b15db4680c50ea3d8525c32eb4628656266b73fb2742ac72f10780e257cd09d SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.vmdk.xz) = 0820b06227aab1f3528412d57723858b57d5d5144f622dc69040955d3d72c5c6fc6bddb394ad96525b84220071926d910ae01b3f04d87d24cbd20feb79543f82 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64.qcow2.xz) = 16f6ec04b5a60b65e0f4762730be806362b94d76427e6474356c866b1aa313ddf3d8b2eb9acd80c70a9e644349e80af94e63014560b9ca6ef59363fb2cf9d775 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64.raw.xz) = 3c20f49cf239c90f50adb1a821cea5f6b674e2e658784642f1701a0d7334b5f44efe0228d4fa450216d79ce354478b38da20b9bebca8ec42532d1f7a8627e824 SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64.vhd.xz) = 0fbb1d46fc7cc52336f3d9be2ac9739b0851c258aa1bd473f5718f55b635acf592faf87c7b4d402d28e5fcfc6257afcc77f1554ca9c2a7da4913e210a543650f SHA512 (FreeBSD-14.0-BETA1-riscv-riscv64.vmdk.xz) = 3bdbc17b3d94e33324a4613629281d8fa3e9890edae26921c078d6c314bb463bc16dfbdbc75c3be0b5297ea406338db4e188cc0cf362761d4a098b0b7c8c45de SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.qcow2.xz) = 76e835eca7f7d11a218ccceba865df3b8b3f8c9b9990e84161cc10223eb7aa74 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.raw.xz) = d62d0e74ea0799fb0f4a129bf63e3baa206945ee8f50181238ee203e05ebf66b SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.vhd.xz) = 657fca6466ffaccbbef099e9be0937ce9cb9fa3aee7e9ed96838f8a566b31254 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-ufs.vmdk.xz) = e9059d8b62cf646a9797d7e3480127f60085b7f4e1e7044bd5485f64b6f49250 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.qcow2.xz) = 50c85066d87cc5d763ab647729c846518354f7f9c8bb3b5ffff7f1d92633718a SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.raw.xz) = 0e68f2510f29806a2d04888dabd7a54ff165ae347aed413932dfbfc2c8aa2e14 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.vhd.xz) = e885095fa91ff0b814d4c16d3e7be89c4ad590b9d4a0f064b11e4ab7b963e7d1 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64-zfs.vmdk.xz) = 3390d44a9db209678e11e5771e12d882fe3eb2635235e91989cda71c4913f262 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64.qcow2.xz) = 76e835eca7f7d11a218ccceba865df3b8b3f8c9b9990e84161cc10223eb7aa74 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64.raw.xz) = d62d0e74ea0799fb0f4a129bf63e3baa206945ee8f50181238ee203e05ebf66b SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64.vhd.xz) = 657fca6466ffaccbbef099e9be0937ce9cb9fa3aee7e9ed96838f8a566b31254 SHA256 (FreeBSD-14.0-BETA1-riscv-riscv64.vmdk.xz) = e9059d8b62cf646a9797d7e3480127f60085b7f4e1e7044bd5485f64b6f49250 o 14.0-BETA1 amd64 BASIC-CI: SHA512 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = e0a5d92b960d1057eaeb029b1483a39cef853a79af3fbcd0081d78904b168bf5bd42619aab4b34e03e2e7f8b0a42568afb28b5d3197d13d1bab5cbf3e0ca52d7 SHA256 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = de92cc7e3fcb44e3370539adcf6ca6f5abe85371100b0a5d18b32694232a60fc Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmT7rzMACgkQAxRYpUeP 4pPB8g/8DLSW5lcJBJLpmxBLrEG0f7gIkSNNT+nR4RdWYdiZaGqkkY6DXcWp33Lt Y4ILsBY4UPmkkC8DWVsdk8scIIpXdc5i6IyYbycZ6hdRBortYT7KcvE6I+u8641/ X7/akgRxLzuMtUMsG+y4+G3bH8uwlhquY0EA6czhM1G+b3jZI0WN59tRiClkh0yt M4/M7MgsTKSePBkYN9zK9eydkPwb6W1V7yGA4JTBkqtfcR2SPilLCq7WDGzZT0D1 Cd0HvXMAJ+zbZgRmNwt+cG09n2Nh99EQhdJqYNbxUEi34c7JcrQIZ86MqyRVHUFL WFHGVN87LP1R0vRIYvozCH0cEBghOxLWi5pStBGl3K5Des8lDBXnVJyxiwJuoply 6AZztkUXKKx7VAX97244ffEA0Y6oBhq72GJsuL8m2L9Lw4cdroANhyA2oEgT2Bu/ X4944o/KDVLwFsLlmmytziN6rMAFXzNZnoCF99wu5+BGrqjPYGS6+f7hvYGlPj5k RVQdC/78zEEeYUNc6K9Wxa1XrA/4AULkHv5UTLIzqHauPo+0RzvjgtLpT+QkmdGR vqoVR0lHyWFLpLYzPKz55uNQ2OCH1ffknzTzBjgKnECLGLJ0SsZqklYU/SH5W8FP 7LC+vi2kdJ6pjgKi6+ks2wg8tGi0MbL3Hz1I+/viYjCc7BOsgvU= =qncn -----END PGP SIGNATURE----- From nobody Sat Sep 9 00:03:07 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjCqh1L67z4stHP for ; Sat, 9 Sep 2023 00:03:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjCqg5sgkz3CkH for ; Sat, 9 Sep 2023 00:03:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694217805; bh=gk0+mRoepxUPcivNE0z95JLP4LsmUN7aHapQf5FZhJ4=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=cQD57SOw6dAMEG5Bdp40dE5a5gquRKgmKYbMm8uhrdPKi/t87cM8ruAT5DgDHmqhRmZ4acElwWWYpt3gFNUFPC1QKqRxAQ7yqkxzgdaIR134val9ose8/4qls3ZzDtIl+8CyXF24xGUl2aJe1uWq9InQ/XhL1mQZaI9dbJGaZWb4LKU5vZXDpr+8YzAf9ACalvyI7WzPQQdaHgAMp7DIVMO8k5O9ISPH3MGQ9RHOU9LBeBs539NUFwKx5HK9YmIC3W8NsJR55RI6IK0meN//5LmG09iWMOHXWr+hCNSDCNddCh9qmnYeRPTOqVP3axF/dd7xfCj9pLKCDLbBHRN4lA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694217805; bh=dgitIsqkIIOfeXEpp1DL4p7WqHYy90NlIovfOwV8M3k=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=tJRJut6tnO0lROH4AOaQsh345jsvIZ799ra8SaiXFzPoYh3c3pWUFGs6D7ivkgz2YjpzkZfr1XxbCZZ+OD/0Fpuv3dUO8CqHYsH1bNfQr2+iZHtAdYsWN1iBmRwNU/kgXoyLJHSejAVy7Qi1TBSThN4ra+rdYgoZhFOKyP0TYeGDlDwVrzd4CwirIoGEukm/fPs3FJUo4WyA4YMg2dfr2JjQe2It6COjvrv5p7I8hU+d2KyjtBdeuzSaWvFI5vP0d7tutqQTW4g3xJmJetRAcTdG13Pl2I3Ih2qSkaG0Bp1LUEH2w4kpRzivj+WYayheeI+Z/P+uvNL0ie344/H2EQ== X-YMail-OSG: B47ojbEVM1nqPHtZtQohdkx.Jw0uTreT5y21sbz0_DUlHCM4.WJZZG16gvxnS__ JjTwKJkiU8Ufv1NElLTtKExsbsUiwzEGlowzb_k.8KW7b9XjkNUZlxBcXzT3rAHrfG1YIalV6NTu YBQBUpSTmgYvVPqr3whsYKb8w2k.GUDli5iFxjDJzW1cTEqxamFEY3PrUfzV8dtZaC21RK1fq6Mc 8Dz0EkQVSlzgoXwx3iJjTVXKPPqaYkNDLxof9Smz1Kru108OXS_cxzi2rMuzt8OSLZbcD0wHCYGI psOebP5SqW96QoqTXs_s20asYpCWWbcc3JOGZJWInycufDg8Jzhd2GDkjSTNsrpkAL9aZuddxjwO kWwITq7Cg6Z2dnz_fvpSjfQgj7YKgkdFeyDF0nXbU7KuzesxJ1w2ouSiMoYlwOkGHpLelhYbMFTo P29D1j6_WEfa_1AP5AD0i6VjxN_RMbYQJaFrxD5UxeH7DRm62u17u3yzqzP0Qz9tbUdmX8qc4evk UKzcfRmjaZoxoeinAatElU_xKLxggKOeweqcMgrYXO.efY.bFk4NQbX.pT4ZIQLIdS8n5YfnNcrO 0tIZrubvAhMfrLSAk0w1c92oZiAYvFQSymIPuZeAbdn2q0cD_XcuEnYANBpeuJ6dxWpNvWNsDV1u 7dP_FZqiVBkV1DyYo0QrGY5DyoTaVbPvzXemFI0c02NxyLf3A_TZ2sKVdBPRXnko6axF.IU16eUs Jtet96wbLvQDBXb1yAMxf7hYP.50tqMFjcqujNUH3YFS_6iJQnZA1uomPMmcrzp8olNXl6wQDLE0 cBtW_nyXNJRmLA2.RWITUm_edF8BEqikf5Ac1i9nRuRPj0hIPy7HvX1gEZHCzS1i2ggKXpDyV0s. S55G2YqQfLtQQfAkCX9hNYQB.kj.KDpqr4PDowNZqeSVlX9ZY9202uEc1AaI8u.4jl9GgLP9RK.8 HXraZB2w8bQ1DwSuGYb7GR5aOBEtFBVxjQgCwLqWYNN1A6DxakQ9Ak03fqeAYG1sOsgu.kFyeBd2 4TbIigjxpNIyaC2nhTzWrl_3YV54AkFvFGr8YWqG7G3dtVOUBhpKz568eYwDW2PHKqMyM7YsTdup tRK8oLHAcOAmpcUpZKIm6Bj1uPA2BfUYR2F0ScSLLQqgoMuEe0DOSxkguCP52xba2oPcvELauQ74 HG9teShSQbsg2DP.VZStmgQSf5jI0bbLxaCSHf7.oFhm.FKy.qBI4KJ8oWHDG6O.PJf8XogFjiLI FS6pJiHvkPEueBcMyNUTYXfVuNvCC2jvf6UsNUfetMx2jqnDE6P2mEpku9Wg8ouhyQsYMj0KAetL np8gGrDOBNlyIbs5NvdNNLP2lWdVRBfq3zcoXZH7QJJZstEmtEpyy7XUO7G27jPK37jvgbD4CYTi rYplJHfyGCsHcwULUdL1jrrr2Fidm4Sv_saRw9I5cxDdt5CInjQNB4Wt7HDoioOhdBSdbOJb_bqS rcVE3YD7QMhlimsX245qZpZtmOYdcNJiyxNa3BGpamp00auzo724.MNpkaYfqYT41LeQn7cgMgj5 88RUAt0GFPWlvnz9iHj6PrGnyssWE2wR7CIlbbo4VQBkwRXh5eVY3l98XoKarMaprIskvmAyqna_ cbH.Xykniw40QNoVwZcdKAAWUqUzTYd4K8xa1A1ZA1C0P0Kj9Ca8r3lDgA5eqbkVsSiwCLo4ZVG8 L2HDu7dJms0hlwgN344AzEaowYHoDslIZz7L6RYUrlWzEa5mh2y01pqta37XlLhUbOR5tID_64Vv eHLLpoLyvF9YQKFLVWb7hu42n3IZEwxrP36DOy4c9NByTG6lSzQB9NuSBx1deqQnIQZhBNaERMM7 hJ6zeOqxC1sJA1bz1gzgY4BHf0oHID9OpMtLx7mHOEDIOQezjJ_BoWb3hnuEg8m9L.a2f5JU4Z0K Kes_Q_lNliMUIMteSxGOVUs065OTIJhNdnUlUZZKouSQkaquRmcAI5_C8m8pgv8WrU8bF1GdQ.55 T7yHcwGnkVqjrupWZ6tmgo418pw3We3Tl93xaVAj1y5YxSd2KguRvApu3_bfxEXJcb7dPicD83yQ zzcldkXOAGndkUxvP7Hr2d.PwHUzIEva5w1.Lfe_TMa1DLWsdV26emLF4AvM0JhITZ_thRuuJZkO VXGLulIghNxjkT0iK3BtugYB.TC0cE2f.tGjXWs02a4EZLGYez3OVpGeNGs2Dt35MKNshEBnUDNt r4Ifqw3OmtZTgVBHUb49JjGx1uT4aLPLVU8ZRD7A3oUlw.bi9vNbwYYKzWzNhjwAiam7CKCBjBs6 _HwCOT3N7TQ-- X-Sonic-MF: X-Sonic-ID: 5acf8791-a29f-474f-b383-0802f0077ea0 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Sep 2023 00:03:25 +0000 Received: by hermes--production-ne1-7b767b77cc-6mpms (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 09a2eb0089434ee07565f42060571837; Sat, 09 Sep 2023 00:03:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> Date: Fri, 8 Sep 2023 17:03:07 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> To: Martin Matuska , Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RjCqg5sgkz3CkH On Sep 8, 2023, at 15:30, Martin Matuska wrote: > I can confirm that the patch fixes the panic caused by the provided = script on my test systems. > Mark, would it be possible to try poudriere on your system with a = patched kernel? . . . On 9. 9. 2023 0:09, Alexander Motin wrote: > On 08.09.2023 09:52, Martin Matuska wrote: >> . . . >=20 > Thank you, Martin. I was able to reproduce the issue with your script = and found the cause. >=20 > I first though the issue is triggered by the `cp`, but it appeared to = be triggered by `cat`. It also got copy_file_range() support, but later = than `cp`. That is probably why it slipped through testing. This patch = fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >=20 > Mark, could you please try the patch? If all goes well, this will end up reporting that the poudriere bulk -a is still running but has gotten past, say, 320+ port->package builds finished (so: more than double observed so far for the panic context). Later would be a report with a larger figure. A normal run I might let go for 6000+ ports and 10 hr or so. Notes as I go . . . Patch applied, built, and installed to the test media. Also, booted: # uname -apKU FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #75 = main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 Note that this is with a debug kernel (-dbg- in path and -DBG in the GENERIC* name). Also, the vintage of what it is based on has: git: 969071be938c - main - vfs: copy_file_range() between multiple = mountpoints of the same fs type The usual sort of sequencing previously reported to get to this point. Media update starts with the rewind to the checkpoint in hopes of avoiding oddities from the later failure. . . . : [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 = Fetched: 0 Tobuild: 33800 Time: 00:30:41 So 414 and and still building. More later. (It may be a while.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 9 00:27:52 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjDN470yNz4t76d; Sat, 9 Sep 2023 00:28:04 +0000 (UTC) (envelope-from pjd@FreeBSD.org) Received: from mail.dawidek.net (mail.dawidek.net [94.130.64.56]) by mx1.freebsd.org (Postfix) with ESMTP id 4RjDN40Pplz3LjS; Sat, 9 Sep 2023 00:28:04 +0000 (UTC) (envelope-from pjd@FreeBSD.org) Authentication-Results: mx1.freebsd.org; none Received: from [192.168.250.133] (c-73-70-21-143.hsd1.ca.comcast.net [73.70.21.143]) by mail.dawidek.net (Postfix) with ESMTPSA id 6EEBD22F73; Sat, 9 Sep 2023 02:27:55 +0200 (CEST) Message-ID: Date: Fri, 8 Sep 2023 17:27:52 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Content-Language: en-US To: Alexander Motin , Martin Matuska , Mark Millard , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> From: Pawel Jakub Dawidek In-Reply-To: <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE] X-Rspamd-Queue-Id: 4RjDN40Pplz3LjS On 9/8/23 15:09, Alexander Motin wrote: > Thank you, Martin.  I was able to reproduce the issue with your script > and found the cause. > > I first though the issue is triggered by the `cp`, but it appeared to be > triggered by `cat`.  It also got copy_file_range() support, but later > than `cp`.  That is probably why it slipped through testing.  This patch > fixes it for me: https://github.com/openzfs/zfs/pull/15251 . > > Mark, could you please try the patch? Thank you Alex for the fix! -- Pawel Jakub Dawidek From nobody Sat Sep 9 01:19:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjFWL2KCWz4rvyv for ; Sat, 9 Sep 2023 01:19:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjFWK07f8z3c9y for ; Sat, 9 Sep 2023 01:19:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=tphWE8p3; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694222363; bh=wqX5AFH2jH+nSZtZh3giI4iv5Iq0vNudXur0k95KmeE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=tphWE8p3+zDN4B2kRkBB7jA5NQnQZTwQVuNulalPc92bwd3jUKaLXhfG50WvjmUHp8ePGH7I8AHTWVXzScfoTX1skjpaqxP6AIrS05ItLKMf4HT6K3heOploJkwq1NuBHqPS26+LHr957bXhJyvaRx3+uJwEuj3/3su+tAm+632LtuoNl4G4AtbhhgaZTzUUBNFD6JOn5Ri9WOj2srVSI8whKTuNMaObKpZ0ABd8lkoZWvgETAbcKNuPRNOLOTjKPfpfEQRRQs1gLYGbh/LssdIWQUmrvsxSr4ZWRREc/Bq5Xw8A3qzb9O4bdA4CKSgKmvwqe7biSPNHk8unvqIbpw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694222363; bh=1TpCDeS5If32Qv/NV8n3/H/SDYbpxTsehHbgFlgrEDk=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=G1RgmNrQMarxfrOXFfizTfT1OEWgTG33EnVqiDEP4IvxWKASniVQZ6+pEGarHZv+ND7WAa/uZhqMvSqI94YNWk+HSV4XYifXBa6ZKPr+m9iQ+ptTKIE1pQJS6e7oBsAEgg/JxF34T6BTOK+ExIP2NMmStV//jsaYmr8EYKv/YK+nzXgpbySSuuzzlxsp5wVal0ul8Ao6nglqCFsJPuJqpfG6xyQS3k7PPjfNx3ty6U9fldxV1JjnPgE7U+TYfGjQoNckN4p0mf1dNUhndCRdngVPQjvKMlt58/TtCBAAyGxOOKo0sIbankYkA4IKB42lYz5REQp/4FHRrOxk6GEvAA== X-YMail-OSG: SHWlyX0VM1nwkdKGbY0mw7w.xpYhCnuu3ZsUjiKH3_osr4o22ERo2aeQPMMYgfM y9vEUex8UiL.eoGiF7WkkGeS2mAuKlM0d0qSYuFyz78ruteYkckPixJ2u3hFRMD0tS2KO3nh1zZ9 Tw0oDcwfB8s9KuYE8ONj3SgM.svvj_jo0NeCk0yN.V67YIOF3tx_xrDdnrb4QiYzdqfg9T3BcQj4 8K.Zcag4KVOgBV4oX9yYfLypftnY5Zw6eG4Dn_MDfRguBrxUbZnahlZq.SDmwR5I.EzEcVojDWaw EpLYuK7ud9T9uq3BusD.amxrWkTZwR_YGK_FcNuSM.CEw1DR1yIQlSK0Cfq8HMi_b_SUzg0d9ADd A0gK1mBJE0Zom84JSpkdmyYpKL2K59f.4FK01gydJsT1JsxmwUxE4gtg_LKkATlB3rQolFZicnSS VCkTw_HTrcFuZ5ZqlNWHqlNJafg4oitOfAV5lAc7RClPYThLsKugmSl.l7HyDBXRsLO5TN1Q9qnX 850YPQ6ul32JNFo_4vx1hS_hG96DCFguUP00tqYgOtg.4fjAh93eQUnAf_32xF7PRzbE.1Auc9CY .zew3mIxeD1ZYF4WcaHX.jEjFO.UDGmpvC0FJMW3urAK.OhtQXPExTUcAb9KwtSt390Yd7Kcsiw6 E0Stb4ims7SY6doUsAgZkx9fmu5ziEnY326pySqq0B5LNst9kXqcfS82hXZ1IHBIV07HICQ3G1YT 473rflZ.HRYS2O5jjfhAlwFhbS5jcT7DKJmkl.hL6iSylLpMCLYMfW1rOEsVsYl7QBAWd0QyFO8a RAa0WpAOCDV8eK7X9EV_biPL9KpzNFzXIu6uAvvKzkOri4pBSRuGNXFWwTlRvilcDwYxr86iGhM4 Txa6Q443.4EgzUVtG7ilqIGlBtqZ_zLV3sG487DWBl4cPP2_IIoX3UqfaGzBrYy81JljOPIKH131 lCug5T9qfmy1O0wcP5isQAopt3XxdZHp1.ttcU66CGPWPHhurd3G3wqTWE2wdvpj9hRAQICD5cDX kEgNPNDS38jmNjWenm7kpMYxEw49voMyd9lFiHNDuWTOHza6w8mzNT.YPgmImfMXA3Yxfo7S0USu IxkiMkTGZWhYms59Gv9_NCFMdIu.jlk69y2KaJ1ITzaHmTjaH_Ihyzo9DrQ9B1tJQEOJIBht_KZJ sgty6UX8kyYgSRrd_m4lqsaPK.YHTqLcioJj8iyjBTMoMm73Hv19dBIqiSF.05SKvV6Mgcq9qtsg pNb3NSPZ5rpkcqHLlD6rWI7SkqVJtyDOJyzzkDpmFRjeQ2s7RI.AaYjyf6s2ka2l9Xu.8mcgU_HL OzBmz2bOS3j9qtcfGAzHVTSLTXo.n4Wv0vTeZ9AGCbWE3X4wDrZ6bQWKFErASLrgd3QH6MiPrQ8d zLSogHl8qx0qqHrSddAATQ.Qw0G5yT1bTL9LoY_L6CXwT32yxcMItKUSuQn3tFboFbFzWlBSAIqT 9OGzqNdgty3XuQr._OIqbLNTRmCLRs00pBOfO002Aw1WvmJyDgHmbv6boTWV2fGQ0G_RSuSHgjr1 ephbGgbLopMMcWcHf41.i3ZoqCUJjyKDnWShGaxqvicp4RMBiCivSosrYnUCxb8ehZFdKfcvAy3S SCe7.NUNJqpYv3RV5OmdUseo4Ghg.3FMKHdvhdtSHpf6SN10M9utuBpRNxybeGhTV.Q4BLs7USv0 wVct2w.fqyep99NeA9RsTrf2Vl2D0rGbRMsLNwWWLEytURaPeIVocgeIJvVEOQUJ6tlcrAQZqWNK 7NAGjwPaPkwjNQNVkJETqojrZfsmo2k4NG1tLoBDfaTpDozQflJ24miLbgVtC7uhWSxu2nID9x7L beulFCMlFH11AnhqtuCRdkRosiduu8c4Lig2hX.KbByqyrIYqYsQ2FwlNhguHdzViVXtYc2QKmzE itvClJRonD9BYhcci47ngMwrav2XJkJ9oDJZt2qRSiQQgIDZaQjLmzm.PNwkB5Gz7FW6mFhX5nxf UbbfN6tMr8tFzx9DmZe9Qh3R7W8fNi12a.eJE4q1EtjOKJBJEAKqfPn65mq7Xaw5_KZv7IEByRDO Nhz60koXbB7aoQIhEFyn6e3QejzPH7E5BD1OQKoFMUF74Qk3XGRAcKo1LEKM.xKr6K8iFV9603rS lDnIBK56FyIofyEzFc1qxe1HBduG5i1B1lZRrAR7i7crP06cJyHYUzRgumYVRykTCWP7I6gq6jug rKpC0PfOed3sfmzE48pHxXYkl8ZbDpJhhlLqQq9vhwyf21OxRcKchFilx882I1.HUcCc97o19CVv sUMZnb.q0rQ-- X-Sonic-MF: X-Sonic-ID: 8943c28e-9c3a-4d3b-a271-a12530d7bef4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Sep 2023 01:19:23 +0000 Received: by hermes--production-gq1-6b7c87dcf5-m4lb7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 25afddf1784b80f9a64ce82e4d6dbd5b; Sat, 09 Sep 2023 01:19:20 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> Date: Fri, 8 Sep 2023 18:19:09 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> To: Martin Matuska , Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.970]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; BLOCKLISTDE_FAIL(0.00)[98.137.65.84:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RjFWK07f8z3c9y On Sep 8, 2023, at 17:03, Mark Millard wrote: > On Sep 8, 2023, at 15:30, Martin Matuska wrote: >=20 >> I can confirm that the patch fixes the panic caused by the provided = script on my test systems. >> Mark, would it be possible to try poudriere on your system with a = patched kernel? >=20 > . . . >=20 > On 9. 9. 2023 0:09, Alexander Motin wrote: >> On 08.09.2023 09:52, Martin Matuska wrote: >>> . . . >>=20 >> Thank you, Martin. I was able to reproduce the issue with your = script and found the cause. >>=20 >> I first though the issue is triggered by the `cp`, but it appeared to = be triggered by `cat`. It also got copy_file_range() support, but later = than `cp`. That is probably why it slipped through testing. This patch = fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>=20 >> Mark, could you please try the patch? >=20 > If all goes well, this will end up reporting that the > poudriere bulk -a is still running but has gotten past, > say, 320+ port->package builds finished (so: more than > double observed so far for the panic context). Later > would be a report with a larger figure. A normal run > I might let go for 6000+ ports and 10 hr or so. >=20 > Notes as I go . . . >=20 > Patch applied, built, and installed to the test media. > Also, booted: >=20 > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #75 = main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >=20 > Note that this is with a debug kernel (-dbg- in path and -DBG in > the GENERIC* name). Also, the vintage of what it is based on has: >=20 > git: 969071be938c - main - vfs: copy_file_range() between multiple = mountpoints of the same fs type >=20 > The usual sort of sequencing previously reported to get to this > point. Media update starts with the rewind to the checkpoint in > hopes of avoiding oddities from the later failure. >=20 > . . . : >=20 > [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 = Fetched: 0 Tobuild: 33800 Time: 00:30:41 >=20 >=20 > So 414 and and still building. >=20 > More later. (It may be a while.) >=20 [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 2013 Failed: 2 Skipped: 179 Ignored: 335 = Fetched: 0 Tobuild: 32059 Time: 01:42:47 and still going. (FYI: The failures are expected.) After a while I might stop it and start over with a non-debug kernel installed instead. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 9 02:30:06 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjH574XM4z4svd2; Sat, 9 Sep 2023 02:30:19 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjH5674dkz4Tq6; Sat, 9 Sep 2023 02:30:18 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 3892U7r0007987; Sat, 9 Sep 2023 11:30:07 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sat, 9 Sep 2023 11:30:06 +0900 From: Tomoaki AOKI To: Mark Millard Cc: Martin Matuska , Alexander Motin , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Message-Id: <20230909113006.47f1f0d60a8c9820131e8020@dec.sakura.ne.jp> In-Reply-To: <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP] X-Rspamd-Queue-Id: 4RjH5674dkz4Tq6 On Fri, 8 Sep 2023 17:03:07 -0700 Mark Millard wrote: > On Sep 8, 2023, at 15:30, Martin Matuska wrote: > > > I can confirm that the patch fixes the panic caused by the provided script on my test systems. > > Mark, would it be possible to try poudriere on your system with a patched kernel? > > . . . > > On 9. 9. 2023 0:09, Alexander Motin wrote: > > On 08.09.2023 09:52, Martin Matuska wrote: > >> . . . > > > > Thank you, Martin. I was able to reproduce the issue with your script and found the cause. > > > > I first though the issue is triggered by the `cp`, but it appeared to be triggered by `cat`. It also got copy_file_range() support, but later than `cp`. That is probably why it slipped through testing. This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . > > > > Mark, could you please try the patch? > > If all goes well, this will end up reporting that the > poudriere bulk -a is still running but has gotten past, > say, 320+ port->package builds finished (so: more than > double observed so far for the panic context). Later > would be a report with a larger figure. A normal run > I might let go for 6000+ ports and 10 hr or so. > > Notes as I go . . . > > Patch applied, built, and installed to the test media. > Also, booted: > > # uname -apKU > FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #75 main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 > > Note that this is with a debug kernel (-dbg- in path and -DBG in > the GENERIC* name). Also, the vintage of what it is based on has: > > git: 969071be938c - main - vfs: copy_file_range() between multiple mountpoints of the same fs type > > The usual sort of sequencing previously reported to get to this > point. Media update starts with the rewind to the checkpoint in > hopes of avoiding oddities from the later failure. > > . . . : > > [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 Fetched: 0 Tobuild: 33800 Time: 00:30:41 > > > So 414 and and still building. > > More later. (It may be a while.) > > === > Mark Millard > marklmi at yahoo.com Would it planned to be MFC'ed to stable/14, and then releng/14.0 once MFV'ed to main? Regards. -- Tomoaki AOKI From nobody Sat Sep 9 04:54:14 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjLHW1jYVz4sBgf for ; Sat, 9 Sep 2023 04:54:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-21.consmr.mail.gq1.yahoo.com (sonic314-21.consmr.mail.gq1.yahoo.com [98.137.69.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjLHV0D41z4DTP for ; Sat, 9 Sep 2023 04:54:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=EKK6YCv3; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694235267; bh=v585CdV9aZ5BPDMDMynso/u18oN39eBJDpgvByZYHLs=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=EKK6YCv3/H8CY0qXxdj4WZb5KxrOVa7HCDz/uvU5cP8st+hR8TzF5IT98tKILQlXoYTMntjCDYRiWdTV3YthDsMJvrJ94tb3r7tp+JzA8n6NvLqlPCCLOb4E2uOCV6O136o9WNZvNnHiMrTraiL98it7iC1S/DyvcYW9CI3u53EXvMSwLa5LlWrD7dvjwcrVIXbe9vaUjBZcUYZ1MLoq4/E5aFllM1xX1yqUK4YoIHpxjRXHBnx1lCS26uSWiXpSzZrYVbm8YgEgXEQN1BjZmTbs1fd378ALpYX21QS+MLk8VMQGGV7p8AgJh9AwnPpEthyhIfPeFq2G7f1VYZ+/Ag== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694235267; bh=lfgbNcpldc8ZauWVBpY7oLccS0XNDjvqHdWxUCn87Kl=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=p+Enj3LxwwfX2jAnzT1D3X6S8Lhb7uNt9odk7/78uY9/MiOruM9RGg7frEpBlp+TWv95MgkrN9Gh4G7fGVXxSvASPxt3jKUNuVPHmpvkr7qEvKuqF1LW2jnC14moLcRqRcthHWbBKApgx3Z8c4K+dGZ5ECHMjGGPiWncQA1NYuhNRGW0aIE/ngVlv2p+YFbnXDnsbx6Q0pXhSfG+/4mIuKg9oZB0pY/bLcOuFV0iK0WhcoFJKBtLykj3RJveO05Zi8ZmYwiCOObBMufeUhPgccb4mUBuqNIVO1PRWdg760S4xu1/27GNsvNP0L/uHCkHAb2XFNalvB3zXvO+n9NsTQ== X-YMail-OSG: p81Q6soVM1m_XWNTO7l1.pvAmHNtvdCdr8S1KM7O05wCtfGqc4x_gXZcbA_F5Rz bwn4cUBBh9Jqx.1cCPmrbkXOqsvglreqSa3FyyZ7dX.gXwuVLP5N9PCle2G0ikQVLTOY38UWUK9M GmuRthKtlSvqoo3dV3nomivLTvYWXJFB33rk69CeJXgXs2_2jE661t82dQQyO3HeY3G98egBEhR7 7aQnKhu159YZcrFfoEKyqOg1d5LSxd3vwJDraNn8Y0pOF.8aYEvePawTodAl4SK_1ZDWrQoPM9Md 7NGsWyFMleoPQcKZ1wTSRl5GwKrCig.GtLD7SpeAHj9ZazXhNiIiL_9pweIHhZGZA.tEQVnwxcsW SmJQ2cmAOy9PHKr0vKJVgdZ4EnYL2y5xvVyNq3RX8DU5wg7_reak1yW.m8mBAY0lKfJaUVt3mF3c JDkY5IYoFpjddspxR9r7dA.XEW7BA4L4uPmWHUb_F3K3kYefQ4e80t1zDqQ2f8ge4qiaCCrZ74lG 5SF1_uG.6.iSqHJxIAooPkYe3saHj642QSYho0BHyGgSbYi6qyweNHPs0G2.grW7DBW3Zx4PoIt1 TdS9DTo6S9tng_DfCft_7ZULL0oOzRp2NYBJfFbBcxJvzg9U54Bpj8rc3KkBBwqlmAyCrdP4l1_s oaPlq9gun_Me11hhA1KK9qGh5oqxoXrBC2eiGBOzXjbMZU3ItIci1nfSlHFH6uqvyE7Ryb_MFDnb tXXO8kiR.Lz.gD4fjB_aE02hd_nHFiQXdfRozvg2hmWk6QnmkqkbgtOxb08.XfVylldj3rBisMuB BnGu3tqc0ScEk2U5ZXUoN8mQBi39Ll3R6l7cKqNOXBZmS78aQvln7GvirfUY3oZOBugJLJZVa9qP a9rZLR5ZK1N5OTZyK5n6MNoi5fM1itDC7VHu.v2e5iMaz_r2ePA3km2wNK7O50ezJxlNtEFTo0H9 faxptq9UmT0qTE5NT6BVGjwDtlPgYjgsy7RV5CGpSkO052pM6EJSaUNCtTDDSse7nqAQi51GfzQt e9oJtairXriHKpSLiH.POTyuBH7zidOdIRloZnbT6uJ4UkRGdSQ5UJTPFnpyzmK9j8aSR34dZErG 5B0mYA6i.18vQz3rgPtY8junN4N208vwl2UF837qFt5kgCnY5N_62QDTBF5y86EsMz8vE9WpSMna DXSSJ_.CLccnt0PzQnZcBja_O5Kc79jlZNAgTT7XxuEo.bWhpn3w.qlRzymbwxKAs7Dso5L_KAIl gUAvQZH2Mhzp3miC30GG.Oz9gg43.ue0zF2hEaXbe73P33hnKXLZElLjtX0kdJcFtxvaXWYW5c2E .nGhHM7PjEVPtqLxvTAEcWSi7g0f.N6m7vUUSkLbrHfZJeff7m_h6o3v1lBTc43LEFTZGyRmWiRO XINiAtFgnusjcCzzsTPVr5LMZMoNkppiKdFgUeELUD73GLhTSYn_wubLxnuUu1gMJUsdJ1G0r09L ph5D3SwmdMFtGK_flMh_sKlsC94R1ZZEXKHgMBYxphaTSZ6FTng5UdjACsMRxSKNvIJxJr.XyhRk ZxWElNdWlTcoU6Zi6pDukLlXpu8g2NvfHm0E6oiC6EBfyDlWr.rOfKBfZHVsPoPTFTrn5tnjktgj br0Inv4NK_R3hXENa6vlkytIC1BkL0Y8DtrmtvCjBghi2dKUutrlY34jWs_FiResnZ4YyTEi5il0 UvIvXABOoIG0OD6WZn9Tys47R.XLCCdHq4xg7ebwmmO4r6yc9.kmRNnpwx7xFOQx73BPfj6qKrEg 1L1egrxbBKZ84bgkE9e6t5D_FcdArYruI8ZgiW1WdP3kiZF4jP.slaH6cbCDyi9sJkBG3w1NH425 qL8xRj1y0dSuUTPZfTF8AgDXarHux9lQVmc5e6csFVf7MVDeoiu75Z2nV4mEDszKBaWOt_6k87rZ aXdVapfgOsIpkX8h.wJo4.tMFALsS9BZbz5FixP.ZE1RkfFqkkIffoiMK92zuIrm_cISV_Wi33iv vm3aiplPAiRszqXeexpRDw0A9fnO220snMwZvVUFCCeAI6jO7UaBYfBfItwntZH_TXXGJmn9ilCy 7QGfrxBZ_nlTjVJ5QsXji4WNxpItWV1oCA2fe8EtuIK5M10VLvyKdKkXPd0UJ1rxZWt2tElzxveA qRO5ZmGafLZeC349Gn8nGchfE9Ad5TIeDX1HEyMsj0On4y_S0vfaRphDPVdhrUqXPr2EOgaEyQ7q qdYNiYUmJc3P8yVijjFmMK0sBv70dtL4JtDY.tQECX32hcPiuVa3QK9MoHGqjyCJAPg28UuRNsGk vbfd9mZEKLOs- X-Sonic-MF: X-Sonic-ID: 264c2783-4b2e-48d8-b189-d16e630b9fee Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Sep 2023 04:54:27 +0000 Received: by hermes--production-gq1-6b7c87dcf5-wlch2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 407869484ee6bdc0f2b208629e18a038; Sat, 09 Sep 2023 04:54:24 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: Date: Fri, 8 Sep 2023 21:54:14 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> To: Martin Matuska , Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.84:from]; BLOCKLISTDE_FAIL(0.00)[98.137.69.84:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.84:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RjLHV0D41z4DTP On Sep 8, 2023, at 18:19, Mark Millard wrote: > On Sep 8, 2023, at 17:03, Mark Millard wrote: >=20 >> On Sep 8, 2023, at 15:30, Martin Matuska wrote: >>=20 >>> I can confirm that the patch fixes the panic caused by the provided = script on my test systems. >>> Mark, would it be possible to try poudriere on your system with a = patched kernel? >>=20 >> . . . >>=20 >> On 9. 9. 2023 0:09, Alexander Motin wrote: >>> On 08.09.2023 09:52, Martin Matuska wrote: >>>> . . . >>>=20 >>> Thank you, Martin. I was able to reproduce the issue with your = script and found the cause. >>>=20 >>> I first though the issue is triggered by the `cp`, but it appeared = to be triggered by `cat`. It also got copy_file_range() support, but = later than `cp`. That is probably why it slipped through testing. This = patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>>=20 >>> Mark, could you please try the patch? >>=20 >> If all goes well, this will end up reporting that the >> poudriere bulk -a is still running but has gotten past, >> say, 320+ port->package builds finished (so: more than >> double observed so far for the panic context). Later >> would be a report with a larger figure. A normal run >> I might let go for 6000+ ports and 10 hr or so. >>=20 >> Notes as I go . . . >>=20 >> Patch applied, built, and installed to the test media. >> Also, booted: >>=20 >> # uname -apKU >> FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 #75 = main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >>=20 >> Note that this is with a debug kernel (-dbg- in path and -DBG in >> the GENERIC* name). Also, the vintage of what it is based on has: >>=20 >> git: 969071be938c - main - vfs: copy_file_range() between multiple = mountpoints of the same fs type >>=20 >> The usual sort of sequencing previously reported to get to this >> point. Media update starts with the rewind to the checkpoint in >> hopes of avoiding oddities from the later failure. >>=20 >> . . . : >>=20 >> [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 = Fetched: 0 Tobuild: 33800 Time: 00:30:41 >>=20 >>=20 >> So 414 and and still building. >>=20 >> More later. (It may be a while.) >>=20 >=20 > [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 2013 Failed: 2 Skipped: 179 Ignored: 335 = Fetched: 0 Tobuild: 32059 Time: 01:42:47 >=20 > and still going. (FYI: The failures are expected.) >=20 > After a while I might stop it and start over with a non-debug > kernel installed instead. I did ^C after 2.5 hr (with 2447 built): ^C[02:30:05] Error: Signal SIGINT caught, cleaning up and exiting [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [sigint:] Queued: = 34588 Built: 2447 Failed: 5 Skipped: 226 Ignored: 335 Fetched: = 0 Tobuild: 31575 Time: 02:29:59 [02:30:05] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_1= 6h31m51s [02:30:05] Cleaning up [02:38:04] Unmounting file systems Exiting with status 1 I'll switch it over to a non-debug kernel and, probably, world and setup/run another test. . . . (time goes by) . . . Hmm. This did not get sent when I wrote the above. FYI, non-debug test status: [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [parallel_build:] = Queued: 34588 Built: 2547 Failed: 5 Skipped: 239 Ignored: 335 = Fetched: 0 Tobuild: 31462 Time: 01:59:58 I may let it run overnight. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 9 06:12:15 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjN1W5vKDz4sGNk; Sat, 9 Sep 2023 06:12:31 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Received: from mail-lf1-f47.google.com (mail-lf1-f47.google.com [209.85.167.47]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjN1W1Dmmz4bwv; Sat, 9 Sep 2023 06:12:31 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f47.google.com with SMTP id 2adb3069b0e04-500a8b2b73eso4390426e87.0; Fri, 08 Sep 2023 23:12:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694239948; x=1694844748; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Zr3+lqHd1LmqmvPTDWaqer+G/QVzH0t4qz7zAvspBRM=; b=L9se8TGFzYcJ/VBt+AK2JMCoTqx0uV7+PnnEYW2SlSqZwUNuIi8zltGZa91nC6PjwC yIA+93ks+T5nq1rtKL/KbLmyCSKsI3IRIJR3RgOUfy7XfnUG11iy5AP6+pJteo5U86Bt jDdv4/vr0X4AtzkhykGyanECw2BMcp5G441u8lFABSVyNug1Zuxo/vlihE4QEzhv5wR8 /lpcvONpF/ZWMKvukdwU6wcCX0lWf2c5iBwI5+JQrOTwQKzQeZSRkLtkLeI/hOecCbmA DoJhIsFkdSZmL8+o6qVDSLix+FEDf9m2wVFksJdfr8J7TFFfCCbFHLmA/1YwkO0VTuEC OAEg== X-Gm-Message-State: AOJu0YzTEirDsWhztjayRdnDRpmpkUHkzwd3gHyOI5QoRXWZnl4TIoYS YOXcEPqagPTBO+j9qnfPIrPT/+55l629187SW4UpZcmevmA= X-Google-Smtp-Source: AGHT+IFwq1fyCUDFqgOrwje2kTP8G2Klu+atjWmnfx3koCtvM5/7L7O3DDI5vWAAXMS/pmRO+S/7L5oN1N0U2PKG6WM= X-Received: by 2002:a05:6512:252c:b0:4ff:9efd:8a9e with SMTP id be44-20020a056512252c00b004ff9efd8a9emr4057498lfb.7.1694239947424; Fri, 08 Sep 2023 23:12:27 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <202309090605.38965LCd020383@gitrepo.freebsd.org> In-Reply-To: <202309090605.38965LCd020383@gitrepo.freebsd.org> From: Antoine Brodin Date: Sat, 9 Sep 2023 06:12:15 +0000 Message-ID: Subject: Re: git: ed03cfc5d231 - main - textproc/jq: Add USES=bison; Use gsed to fix configuration failure on 15 To: Yuri Victorovich , FreeBSD Current Cc: ports-committers@freebsd.org, dev-commits-ports-all@freebsd.org, dev-commits-ports-main@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Queue-Id: 4RjN1W1Dmmz4bwv On Sat, Sep 9, 2023 at 6:05=E2=80=AFAM Yuri Victorovich = wrote: > > The branch main has been updated by yuri: > > URL: https://cgit.FreeBSD.org/ports/commit/?id=3Ded03cfc5d231cad6ad16febf= b3c1c7da411908d1 > > commit ed03cfc5d231cad6ad16febfb3c1c7da411908d1 > Author: Yuri Victorovich > AuthorDate: 2023-09-09 06:04:00 +0000 > Commit: Yuri Victorovich > CommitDate: 2023-09-09 06:05:11 +0000 > > textproc/jq: Add USES=3Dbison; Use gsed to fix configuration failure = on 15 > --- Hello, This is not the correct fix. Please report this bug to the FreeBSD Current mailing list. Antoine From nobody Sat Sep 9 06:46:50 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjNnG2FrJz4scGY for ; Sat, 9 Sep 2023 06:46:58 +0000 (UTC) (envelope-from yuri@FreeBSD.org) Received: from shell1.rawbw.com (shell1.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 4RjNn85Plwz3HxJ for ; Sat, 9 Sep 2023 06:46:52 +0000 (UTC) (envelope-from yuri@FreeBSD.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=softfail (mx1.freebsd.org: 198.144.192.42 is neither permitted nor denied by domain of yuri@FreeBSD.org) smtp.mailfrom=yuri@FreeBSD.org; dmarc=none Received: from [192.168.5.3] (c-73-202-23-161.hsd1.ca.comcast.net [73.202.23.161]) (authenticated bits=0) by shell1.rawbw.com (8.15.1/8.15.1) with ESMTPSA id 3896kpcW009561 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Fri, 8 Sep 2023 23:46:51 -0700 (PDT) (envelope-from yuri@FreeBSD.org) X-Authentication-Warning: shell1.rawbw.com: Host c-73-202-23-161.hsd1.ca.comcast.net [73.202.23.161] claimed to be [192.168.5.3] Message-ID: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> Date: Fri, 8 Sep 2023 23:46:50 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Content-Language: en-US To: current From: Yuri Subject: sed in CURRENT fails in textproc/jq Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: / X-Spamd-Result: default: False [0.60 / 15.00]; VIOLATED_DIRECT_SPF(3.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[freebsd.org]; FREEFALL_USER(0.00)[yuri]; TO_DOM_EQ_FROM_DOM(0.00)[]; BLOCKLISTDE_FAIL(0.00)[198.144.192.42:query timed out,73.202.23.161:query timed out]; TO_DN_ALL(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; HAS_XAW(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:7961, ipnet:198.144.192.0/19, country:US]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[current@freebsd.org] X-Rspamd-Queue-Id: 4RjNn85Plwz3HxJ Either something has changed in sed(1) in CURRENT, or sed just fails during the configure stage of textproc/jq: sed: No error: 0 checking for sys/cygwin.h... eval: ${+...}: Bad substitution See the log: https://pkg-status.freebsd.org/beefy18/data/main-amd64-default/peb032111a352_s9c80d66ec1/logs/jq-1.7.log Yuri From nobody Sat Sep 9 07:01:56 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjP6q3xpKz4slqr for ; Sat, 9 Sep 2023 07:02:11 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Received: from mail-lf1-f49.google.com (mail-lf1-f49.google.com [209.85.167.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjP6q23lfz3NdT; Sat, 9 Sep 2023 07:02:11 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f49.google.com with SMTP id 2adb3069b0e04-500d13a8fafso4615575e87.1; Sat, 09 Sep 2023 00:02:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694242929; x=1694847729; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=0rMTVrOe+bPgZ8FiPBPPSXphR2CUKfqPG4vV32v0cW4=; b=CrOhMq0wQ/8hy2o0kNtFqOaDlGPFDJgF2MA8gYU3Jop768QFtRuOhcW21H/6wGM7ac IDE124i9IsnKGsHHaAABhR2UaZYsmEkm+8b2pQYRqCDBTws6cMtp9mNaVa61rrlbqmju ZMOA99VU6Tx3KXVyvuKSlhfLF1QckVx+TVuSGx0Ia4LlFz8Z6qbR8/h0V4GNiZJZcmeE 3RDSYCNC0hRbXurFb5qLHhPyrNqjnhIE1Nsy1aQ52AVvOCA+b3jDDjauU2FZEE1inP7O VXPaRg3/dSdBLfMh8pB/AK9DBzs+wKUfvQKwFp3OxMBUDBVCOHb5oV1Ct244tTnJNizC nezQ== X-Gm-Message-State: AOJu0YyN44QkjgFwtBoqHD1CHEhAuHxtRIPA68E3Y/HYBjRiZQYuABQf eVwnAMHSlE6uDat7sFDrfktAJlDtP+QLFHQ8hI6+mUwsGsE= X-Google-Smtp-Source: AGHT+IHd2bVasZWxK/iJGmQLp/VOEZMBpXzw+e5tNcUxAGkRxZpUEh+TSqRJ8CF/lGWonMIdD6y5fT0qZPa+VI+p4DA= X-Received: by 2002:a05:6512:401b:b0:501:a583:e49a with SMTP id br27-20020a056512401b00b00501a583e49amr4630582lfb.69.1694242928349; Sat, 09 Sep 2023 00:02:08 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> In-Reply-To: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> From: Antoine Brodin Date: Sat, 9 Sep 2023 07:01:56 +0000 Message-ID: Subject: Re: sed in CURRENT fails in textproc/jq To: Yuri Cc: current Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4RjP6q23lfz3NdT On Sat, Sep 9, 2023 at 6:47=E2=80=AFAM Yuri wrote: > > Either something has changed in sed(1) in CURRENT, or sed just fails > during the configure stage of textproc/jq: > > sed: No error: 0 > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > See the log: > https://pkg-status.freebsd.org/beefy18/data/main-amd64-default/peb032111a= 352_s9c80d66ec1/logs/jq-1.7.log This seems to be a recent issue (less than 5 days). Hundreds of configure scripts now fail to run on 15-current due to this sed failure: https://pkg-status.freebsd.org/gohan03/data/main-amd64-default-baseline/peb= 032111a352_s9c80d66ec1/logs/errors/readline-8.2.1.log https://pkg-status.freebsd.org/gohan03/data/main-amd64-default-baseline/peb= 032111a352_s9c80d66ec1/logs/errors/expat-2.5.0.log https://pkg-status.freebsd.org/gohan03/data/main-amd64-default-baseline/peb= 032111a352_s9c80d66ec1/logs/errors/libedit-3.1.20221030,1.log etc. Antoine From nobody Sat Sep 9 09:06:38 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjRtd3WFZz4sqSh for ; Sat, 9 Sep 2023 09:06:49 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjRtb6zmgz4Zd7; Sat, 9 Sep 2023 09:06:47 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de; dmarc=none Received: from [188.174.63.158] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1qetvO-003XW5-Sj; Sat, 09 Sep 2023 11:06:43 +0200 Received: from localhost.my.domain (localhost [127.0.0.1]) by localhost.unixarea.de (8.16.1/8.14.9) with ESMTPS id 38996d5H014834 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 9 Sep 2023 11:06:39 +0200 (CEST) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.16.1/8.14.9/Submit) id 38996cuQ014833; Sat, 9 Sep 2023 11:06:38 +0200 (CEST) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Sat, 9 Sep 2023 11:06:38 +0200 From: Matthias Apitz To: freebsd-current@freebsd.org Cc: Vladimir Kondratyev , Vladimir Kondratyev Subject: Re: Acer C720 Chromebook Cypress Trackpad Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org, Vladimir Kondratyev , Vladimir Kondratyev References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 13.0-CURRENT r368166 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 188.174.63.158 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.79 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:178.254.4.101]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_THREE(0.00)[3]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; HAS_XOIP(0.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; BLOCKLISTDE_FAIL(0.00)[178.254.4.101:server fail,188.174.63.158:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; HAS_XAW(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[unixarea.de]; TO_DN_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; HAS_REPLYTO(0.00)[guru@unixarea.de] X-Rspamd-Queue-Id: 4RjRtb6zmgz4Zd7 Please don't use what I said in my yesterday posting (attached below only as reference). Loading the kmod chromebook_platform.ko makes the mouse pointer jumping without any reason back and for to other places when Xorg is running. I observed and do use now: - the cyapa EVDEV patches from December 2020, I've got from Vladimir at that time, are in head; - I use in ~/.xinitrc: device="Cypress APA I2C Trackpad" xinput set-prop "$device" "libinput Tapping Enabled" 1 xinput set-prop "$device" "libinput Natural Scrolling Enabled" 1 xinput set-prop "$device" "libinput Middle Emulation Enabled" 0 and in /etc/sysctl.conf # Cypress Trackpad: kern.evdev.rcpt_mask=3 debug.cyapa_enable_tapclick=3 debug.cyapa_tapclick_max_ticks=20 This gives the Trackpad working as described in cyapa(4), esp. with this layout for taps (not clicks!): Trackpad layout 2/3 1/3 +--------------------+------------+ | | Middle | | | Button | | Left | | | Button +------------+ | | Right | | | Button | +--------------------+............| | Thumb/Button Area | 15% +---------------------------------+ In the past (December 2020) exactly this configuration gave another layout: +------------------------------------+ | | | main area | | | | | +------------------------------------+ | button1 | button2 | button3 | ~10mm in high +------------------------------------+ which also was in sync with the freedesktop.org documentation: https://wayland.freedesktop.org/libinput/doc/latest/clickpad-softbuttons.html Why this has changed? And is there any chance to get the old layout back, as I'm used to it :-) Thanks matthias El día viernes, septiembre 08, 2023 a las 11:35:40a. m. +0200, Matthias Apitz escribió: > > It seems that something has changed in cyapa.ko how the (not existing) > three buttons of the trackpad are emulated. In FreeBSD 13.0-CURRENT r368166 > I used only the cyapa.ko module and some xinput commands in .xinitrc > to get button1, button2 and button3 as shown in the small "grafic" > below. This was not working anymore and it took me some hours of > testing, until I got it working again with loading the additional kmod > chromebook_platform.ko. Now the three buttons are there as expected. > > I add this here if someone runs into the same problem (or if someone has > comments on this): > > ... -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Sat Sep 9 11:52:18 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjWYn4jb8z4sH0N for ; Sat, 9 Sep 2023 11:52:29 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Received: from xmailer.gwdg.de (xmailer.gwdg.de [134.76.10.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjWYm3jGYz4R3G for ; Sat, 9 Sep 2023 11:52:28 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of rhurlin@gwdg.de designates 134.76.10.29 as permitted sender) smtp.mailfrom=rhurlin@gwdg.de; dmarc=none Received: from excmbx-24.um.gwdg.de ([134.76.9.234] helo=email.gwdg.de) by mailer.gwdg.de with esmtp (GWDG Mailer) (envelope-from ) id 1qewVl-0004qd-AZ for current@freebsd.org; Sat, 09 Sep 2023 13:52:25 +0200 Received: from MBX19-GWD-03.um.gwdg.de (10.108.142.56) by excmbx-24.um.gwdg.de (134.76.9.234) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.2507.32; Sat, 9 Sep 2023 13:52:25 +0200 Received: from [192.168.178.23] (10.250.9.199) by MBX19-GWD-03.um.gwdg.de (10.108.142.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.1258.25; Sat, 9 Sep 2023 13:52:24 +0200 Message-ID: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> Date: Sat, 9 Sep 2023 13:52:18 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 To: current Content-Language: en-US Reply-To: "Hurling, Rainer" From: Rainer Hurling Subject: 15.0-CURRENT build broken in lib/libmagic Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.250.9.199] X-ClientProxiedBy: EXCMBX-12.um.gwdg.de (134.76.9.221) To MBX19-GWD-03.um.gwdg.de (10.108.142.56) X-Virus-Scanned: (clean) by clamav X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; NEURAL_HAM_SHORT(-0.98)[-0.982]; RWL_MAILSPIKE_EXCELLENT(-0.40)[134.76.10.29:from]; RCVD_IN_DNSWL_MED(-0.20)[134.76.9.234:received]; R_SPF_ALLOW(-0.20)[+ip4:134.76.10.0/23]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[134.76.10.29:from]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[rhurlin]; HAS_REPLYTO(0.00)[rhurlin@gwdg.de]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[gwdg.de]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:207592, ipnet:134.76.0.0/16, country:DE]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; REPLYTO_ADDR_EQ_FROM(0.00)[]; HAS_XOIP(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[current@freebsd.org] X-Rspamd-Queue-Id: 4RjWYm3jGYz4R3G If I try to build world from todays c1b26df2972d with 15.0-CURRENT (main-n265063-e0752f431b01), it aborts with an error. Seems it is not able to handle line 4979 of the magic file (Microsoft Advanced Streaming Format ASF): ===> lib/libmagic (all) echo libmagic.so.4: /usr/obj/usr/src/amd64.amd64/tmp/usr/lib/libz.a >> .depend cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.apprentice.o -MTapprentice.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/apprentice.c -o apprentice.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.apptype.o -MTapptype.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/apptype.c -o apptype.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.ascmagic.o -MTascmagic.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/ascmagic.c -o ascmagic.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.buffer.o -MTbuffer.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/buffer.c -o buffer.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.cdf.o -MTcdf.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/cdf.c -o cdf.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.cdf_time.o -MTcdf_time.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/cdf_time.c -o cdf_time.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.compress.o -MTcompress.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/compress.c -o compress.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.der.o -MTder.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/der.c -o der.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.encoding.o -MTencoding.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/encoding.c -o encoding.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.fsmagic.o -MTfsmagic.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/fsmagic.c -o fsmagic.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.funcs.o -MTfuncs.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/funcs.c -o funcs.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_json.o -MTis_json.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_json.c -o is_json.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_csv.o -MTis_csv.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_csv.c -o is_csv.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_tar.o -MTis_tar.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_tar.c -o is_tar.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.magic.o -MTmagic.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/magic.c -o magic.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.print.o -MTprint.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/print.c -o print.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.readcdf.o -MTreadcdf.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/readcdf.c -o readcdf.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.readelf.o -MTreadelf.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/readelf.c -o readelf.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.seccomp.o -MTseccomp.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/seccomp.c -o seccomp.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.softmagic.o -MTsoftmagic.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/softmagic.c -o softmagic.o cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.apprentice.pico -MTapprentice.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/apprentice.c -o apprentice.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.apptype.pico -MTapptype.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/apptype.c -o apptype.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.ascmagic.pico -MTascmagic.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/ascmagic.c -o ascmagic.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.buffer.pico -MTbuffer.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/buffer.c -o buffer.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.cdf.pico -MTcdf.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/cdf.c -o cdf.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.cdf_time.pico -MTcdf_time.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/cdf_time.c -o cdf_time.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.compress.pico -MTcompress.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/compress.c -o compress.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.der.pico -MTder.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/der.c -o der.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.encoding.pico -MTencoding.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/encoding.c -o encoding.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.fsmagic.pico -MTfsmagic.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/fsmagic.c -o fsmagic.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.funcs.pico -MTfuncs.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/funcs.c -o funcs.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_json.pico -MTis_json.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_json.c -o is_json.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_csv.pico -MTis_csv.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_csv.c -o is_csv.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.is_tar.pico -MTis_tar.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/is_tar.c -o is_tar.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.magic.pico -MTmagic.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/magic.c -o magic.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.print.pico -MTprint.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/print.c -o print.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.readcdf.pico -MTreadcdf.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/readcdf.c -o readcdf.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.readelf.pico -MTreadelf.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/readelf.c -o readelf.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.seccomp.pico -MTseccomp.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/seccomp.c -o seccomp.pico cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC -O2 -pipe -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic -I/usr/src/contrib/file/src -MD -MF.depend.softmagic.pico -MTsoftmagic.pico -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Qunused-arguments -c /usr/src/contrib/file/src/softmagic.c -o softmagic.pico building static magic library ar -crsD libmagic.a apprentice.o apptype.o ascmagic.o buffer.o cdf.o cdf_time.o compress.o der.o encoding.o fsmagic.o funcs.o is_json.o is_csv.o is_tar.o magic.o print.o readcdf.o readelf.o seccomp.o softmagic.o building shared library libmagic.so.4 cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -Wl,-zrelro -fstack-protector-strong -shared -Wl,-x -Wl,--fatal-warnings -Wl,--warn-shared-textrel -o libmagic.so.4 -Wl,-soname,libmagic.so.4 apprentice.pico apptype.pico ascmagic.pico buffer.pico cdf.pico cdf_time.pico compress.pico der.pico encoding.pico fsmagic.pico funcs.pico is_json.pico is_csv.pico is_tar.pico magic.pico print.pico readcdf.pico readelf.pico seccomp.pico softmagic.pico -lz cat /usr/src/contrib/file/magic/Header /usr/src/contrib/file/magic/Localstuff /usr/src/contrib/file/magic/Magdir/acorn /usr/src/contrib/file/magic/Magdir/adi /usr/src/contrib/file/magic/Magdir/adventure /usr/src/contrib/file/magic/Magdir/aes /usr/src/contrib/file/magic/Magdir/algol68 /usr/src/contrib/file/magic/Magdir/allegro /usr/src/contrib/file/magic/Magdir/alliant /usr/src/contrib/file/magic/Magdir/amanda /usr/src/contrib/file/magic/Magdir/amigaos /usr/src/contrib/file/magic/Magdir/android /usr/src/contrib/file/magic/Magdir/animation /usr/src/contrib/file/magic/Magdir/aout /usr/src/contrib/file/magic/Magdir/apache /usr/src/contrib/file/magic/Magdir/apl /usr/src/contrib/file/magic/Magdir/apple /usr/src/contrib/file/magic/Magdir/application /usr/src/contrib/file/magic/Magdir/applix /usr/src/contrib/file/magic/Magdir/apt /usr/src/contrib/file/magic/Magdir/archive /usr/src/contrib/file/magic/Magdir/aria /usr/src/contrib/file/magic/Magdir/arm /usr/src/contrib/file/magic/Magdir/asf /usr/src/contrib/file/magic/Magdir/assembler /usr/src/contrib/file/magic/Magdir/asterix /usr/src/contrib/file/magic/Magdir/att3b /usr/src/contrib/file/magic/Magdir/audio /usr/src/contrib/file/magic/Magdir/avm /usr/src/contrib/file/magic/Magdir/basis /usr/src/contrib/file/magic/Magdir/beetle /usr/src/contrib/file/magic/Magdir/ber /usr/src/contrib/file/magic/Magdir/bflt /usr/src/contrib/file/magic/Magdir/bhl /usr/src/contrib/file/magic/Magdir/bioinformatics /usr/src/contrib/file/magic/Magdir/biosig /usr/src/contrib/file/magic/Magdir/blackberry /usr/src/contrib/file/magic/Magdir/blcr /usr/src/contrib/file/magic/Magdir/blender /usr/src/contrib/file/magic/Magdir/blit /usr/src/contrib/file/magic/Magdir/bm /usr/src/contrib/file/magic/Magdir/bout /usr/src/contrib/file/magic/Magdir/bsdi /usr/src/contrib/file/magic/Magdir/bsi /usr/src/contrib/file/magic/Magdir/btsnoop /usr/src/contrib/file/magic/Magdir/burp /usr/src/contrib/file/magic/Magdir/bytecode /usr/src/contrib/file/magic/Magdir/c-lang /usr/src/contrib/file/magic/Magdir/c64 /usr/src/contrib/file/magic/Magdir/cad /usr/src/contrib/file/magic/Magdir/cafebabe /usr/src/contrib/file/magic/Magdir/cbor /usr/src/contrib/file/magic/Magdir/ccf /usr/src/contrib/file/magic/Magdir/cddb /usr/src/contrib/file/magic/Magdir/chord /usr/src/contrib/file/magic/Magdir/cisco /usr/src/contrib/file/magic/Magdir/citrus /usr/src/contrib/file/magic/Magdir/clarion /usr/src/contrib/file/magic/Magdir/claris /usr/src/contrib/file/magic/Magdir/clipper /usr/src/contrib/file/magic/Magdir/clojure /usr/src/contrib/file/magic/Magdir/coff /usr/src/contrib/file/magic/Magdir/commands /usr/src/contrib/file/magic/Magdir/communications /usr/src/contrib/file/magic/Magdir/compress /usr/src/contrib/file/magic/Magdir/console /usr/src/contrib/file/magic/Magdir/convex /usr/src/contrib/file/magic/Magdir/coverage /usr/src/contrib/file/magic/Magdir/cracklib /usr/src/contrib/file/magic/Magdir/crypto /usr/src/contrib/file/magic/Magdir/ctags /usr/src/contrib/file/magic/Magdir/ctf /usr/src/contrib/file/magic/Magdir/cubemap /usr/src/contrib/file/magic/Magdir/cups /usr/src/contrib/file/magic/Magdir/dact /usr/src/contrib/file/magic/Magdir/database /usr/src/contrib/file/magic/Magdir/dataone /usr/src/contrib/file/magic/Magdir/dbpf /usr/src/contrib/file/magic/Magdir/der /usr/src/contrib/file/magic/Magdir/diamond /usr/src/contrib/file/magic/Magdir/dif /usr/src/contrib/file/magic/Magdir/diff /usr/src/contrib/file/magic/Magdir/digital /usr/src/contrib/file/magic/Magdir/dolby /usr/src/contrib/file/magic/Magdir/dsf /usr/src/contrib/file/magic/Magdir/dump /usr/src/contrib/file/magic/Magdir/dyadic /usr/src/contrib/file/magic/Magdir/ebml /usr/src/contrib/file/magic/Magdir/edid /usr/src/contrib/file/magic/Magdir/editors /usr/src/contrib/file/magic/Magdir/efi /usr/src/contrib/file/magic/Magdir/elf /usr/src/contrib/file/magic/Magdir/encore /usr/src/contrib/file/magic/Magdir/epoc /usr/src/contrib/file/magic/Magdir/erlang /usr/src/contrib/file/magic/Magdir/espressif /usr/src/contrib/file/magic/Magdir/esri /usr/src/contrib/file/magic/Magdir/fcs /usr/src/contrib/file/magic/Magdir/filesystems /usr/src/contrib/file/magic/Magdir/finger /usr/src/contrib/file/magic/Magdir/flash /usr/src/contrib/file/magic/Magdir/flif /usr/src/contrib/file/magic/Magdir/fonts /usr/src/contrib/file/magic/Magdir/forth /usr/src/contrib/file/magic/Magdir/fortran /usr/src/contrib/file/magic/Magdir/frame /usr/src/contrib/file/magic/Magdir/freebsd /usr/src/contrib/file/magic/Magdir/fsav /usr/src/contrib/file/magic/Magdir/fusecompress /usr/src/contrib/file/magic/Magdir/games /usr/src/contrib/file/magic/Magdir/gcc /usr/src/contrib/file/magic/Magdir/gconv /usr/src/contrib/file/magic/Magdir/gentoo /usr/src/contrib/file/magic/Magdir/geo /usr/src/contrib/file/magic/Magdir/geos /usr/src/contrib/file/magic/Magdir/gimp /usr/src/contrib/file/magic/Magdir/git /usr/src/contrib/file/magic/Magdir/glibc /usr/src/contrib/file/magic/Magdir/gnome /usr/src/contrib/file/magic/Magdir/gnu /usr/src/contrib/file/magic/Magdir/gnumeric /usr/src/contrib/file/magic/Magdir/gpt /usr/src/contrib/file/magic/Magdir/gpu /usr/src/contrib/file/magic/Magdir/grace /usr/src/contrib/file/magic/Magdir/graphviz /usr/src/contrib/file/magic/Magdir/gringotts /usr/src/contrib/file/magic/Magdir/hardware /usr/src/contrib/file/magic/Magdir/hitachi-sh /usr/src/contrib/file/magic/Magdir/hp /usr/src/contrib/file/magic/Magdir/human68k /usr/src/contrib/file/magic/Magdir/ibm370 /usr/src/contrib/file/magic/Magdir/ibm6000 /usr/src/contrib/file/magic/Magdir/icc /usr/src/contrib/file/magic/Magdir/iff /usr/src/contrib/file/magic/Magdir/images /usr/src/contrib/file/magic/Magdir/inform /usr/src/contrib/file/magic/Magdir/intel /usr/src/contrib/file/magic/Magdir/interleaf /usr/src/contrib/file/magic/Magdir/island /usr/src/contrib/file/magic/Magdir/ispell /usr/src/contrib/file/magic/Magdir/isz /usr/src/contrib/file/magic/Magdir/java /usr/src/contrib/file/magic/Magdir/javascript /usr/src/contrib/file/magic/Magdir/jpeg /usr/src/contrib/file/magic/Magdir/karma /usr/src/contrib/file/magic/Magdir/kde /usr/src/contrib/file/magic/Magdir/keepass /usr/src/contrib/file/magic/Magdir/kerberos /usr/src/contrib/file/magic/Magdir/kicad /usr/src/contrib/file/magic/Magdir/kml /usr/src/contrib/file/magic/Magdir/lammps /usr/src/contrib/file/magic/Magdir/lecter /usr/src/contrib/file/magic/Magdir/lex /usr/src/contrib/file/magic/Magdir/lif /usr/src/contrib/file/magic/Magdir/linux /usr/src/contrib/file/magic/Magdir/lisp /usr/src/contrib/file/magic/Magdir/llvm /usr/src/contrib/file/magic/Magdir/locoscript /usr/src/contrib/file/magic/Magdir/lua /usr/src/contrib/file/magic/Magdir/luks /usr/src/contrib/file/magic/Magdir/m4 /usr/src/contrib/file/magic/Magdir/mach /usr/src/contrib/file/magic/Magdir/macintosh /usr/src/contrib/file/magic/Magdir/macos /usr/src/contrib/file/magic/Magdir/magic /usr/src/contrib/file/magic/Magdir/mail.news /usr/src/contrib/file/magic/Magdir/make /usr/src/contrib/file/magic/Magdir/map /usr/src/contrib/file/magic/Magdir/maple /usr/src/contrib/file/magic/Magdir/marc21 /usr/src/contrib/file/magic/Magdir/mathcad /usr/src/contrib/file/magic/Magdir/mathematica /usr/src/contrib/file/magic/Magdir/matroska /usr/src/contrib/file/magic/Magdir/mcrypt /usr/src/contrib/file/magic/Magdir/measure /usr/src/contrib/file/magic/Magdir/mercurial /usr/src/contrib/file/magic/Magdir/metastore /usr/src/contrib/file/magic/Magdir/meteorological /usr/src/contrib/file/magic/Magdir/microfocus /usr/src/contrib/file/magic/Magdir/mime /usr/src/contrib/file/magic/Magdir/mips /usr/src/contrib/file/magic/Magdir/mirage /usr/src/contrib/file/magic/Magdir/misctools /usr/src/contrib/file/magic/Magdir/mkid /usr/src/contrib/file/magic/Magdir/mlssa /usr/src/contrib/file/magic/Magdir/mmdf /usr/src/contrib/file/magic/Magdir/modem /usr/src/contrib/file/magic/Magdir/modulefile /usr/src/contrib/file/magic/Magdir/motorola /usr/src/contrib/file/magic/Magdir/mozilla /usr/src/contrib/file/magic/Magdir/msdos /usr/src/contrib/file/magic/Magdir/msooxml /usr/src/contrib/file/magic/Magdir/msvc /usr/src/contrib/file/magic/Magdir/msx /usr/src/contrib/file/magic/Magdir/mup /usr/src/contrib/file/magic/Magdir/music /usr/src/contrib/file/magic/Magdir/nasa /usr/src/contrib/file/magic/Magdir/natinst /usr/src/contrib/file/magic/Magdir/ncr /usr/src/contrib/file/magic/Magdir/netbsd /usr/src/contrib/file/magic/Magdir/netscape /usr/src/contrib/file/magic/Magdir/netware /usr/src/contrib/file/magic/Magdir/news /usr/src/contrib/file/magic/Magdir/nifty /usr/src/contrib/file/magic/Magdir/nim-lang /usr/src/contrib/file/magic/Magdir/nitpicker /usr/src/contrib/file/magic/Magdir/numpy /usr/src/contrib/file/magic/Magdir/oasis /usr/src/contrib/file/magic/Magdir/ocaml /usr/src/contrib/file/magic/Magdir/octave /usr/src/contrib/file/magic/Magdir/ole2compounddocs /usr/src/contrib/file/magic/Magdir/olf /usr/src/contrib/file/magic/Magdir/openfst /usr/src/contrib/file/magic/Magdir/opentimestamps /usr/src/contrib/file/magic/Magdir/oric /usr/src/contrib/file/magic/Magdir/os2 /usr/src/contrib/file/magic/Magdir/os400 /usr/src/contrib/file/magic/Magdir/os9 /usr/src/contrib/file/magic/Magdir/osf1 /usr/src/contrib/file/magic/Magdir/palm /usr/src/contrib/file/magic/Magdir/parix /usr/src/contrib/file/magic/Magdir/parrot /usr/src/contrib/file/magic/Magdir/pascal /usr/src/contrib/file/magic/Magdir/pbf /usr/src/contrib/file/magic/Magdir/pbm /usr/src/contrib/file/magic/Magdir/pc88 /usr/src/contrib/file/magic/Magdir/pc98 /usr/src/contrib/file/magic/Magdir/pci_ids /usr/src/contrib/file/magic/Magdir/pcjr /usr/src/contrib/file/magic/Magdir/pdf /usr/src/contrib/file/magic/Magdir/pdp /usr/src/contrib/file/magic/Magdir/perl /usr/src/contrib/file/magic/Magdir/pgf /usr/src/contrib/file/magic/Magdir/pgp /usr/src/contrib/file/magic/Magdir/pgp-binary-keys /usr/src/contrib/file/magic/Magdir/pkgadd /usr/src/contrib/file/magic/Magdir/plan9 /usr/src/contrib/file/magic/Magdir/plus5 /usr/src/contrib/file/magic/Magdir/pmem /usr/src/contrib/file/magic/Magdir/polyml /usr/src/contrib/file/magic/Magdir/printer /usr/src/contrib/file/magic/Magdir/project /usr/src/contrib/file/magic/Magdir/psdbms /usr/src/contrib/file/magic/Magdir/psl /usr/src/contrib/file/magic/Magdir/pulsar /usr/src/contrib/file/magic/Magdir/puzzle /usr/src/contrib/file/magic/Magdir/pwsafe /usr/src/contrib/file/magic/Magdir/pyramid /usr/src/contrib/file/magic/Magdir/python /usr/src/contrib/file/magic/Magdir/qt /usr/src/contrib/file/magic/Magdir/revision /usr/src/contrib/file/magic/Magdir/riff /usr/src/contrib/file/magic/Magdir/ringdove /usr/src/contrib/file/magic/Magdir/rpi /usr/src/contrib/file/magic/Magdir/rpm /usr/src/contrib/file/magic/Magdir/rpmsg /usr/src/contrib/file/magic/Magdir/rst /usr/src/contrib/file/magic/Magdir/rtf /usr/src/contrib/file/magic/Magdir/ruby /usr/src/contrib/file/magic/Magdir/sc /usr/src/contrib/file/magic/Magdir/sccs /usr/src/contrib/file/magic/Magdir/scientific /usr/src/contrib/file/magic/Magdir/securitycerts /usr/src/contrib/file/magic/Magdir/selinux /usr/src/contrib/file/magic/Magdir/sendmail /usr/src/contrib/file/magic/Magdir/sequent /usr/src/contrib/file/magic/Magdir/sereal /usr/src/contrib/file/magic/Magdir/sgi /usr/src/contrib/file/magic/Magdir/sgml /usr/src/contrib/file/magic/Magdir/sharc /usr/src/contrib/file/magic/Magdir/sinclair /usr/src/contrib/file/magic/Magdir/sisu /usr/src/contrib/file/magic/Magdir/sketch /usr/src/contrib/file/magic/Magdir/smalltalk /usr/src/contrib/file/magic/Magdir/smile /usr/src/contrib/file/magic/Magdir/sniffer /usr/src/contrib/file/magic/Magdir/softquad /usr/src/contrib/file/magic/Magdir/sosi /usr/src/contrib/file/magic/Magdir/spec /usr/src/contrib/file/magic/Magdir/spectrum /usr/src/contrib/file/magic/Magdir/sql /usr/src/contrib/file/magic/Magdir/ssh /usr/src/contrib/file/magic/Magdir/ssl /usr/src/contrib/file/magic/Magdir/statistics /usr/src/contrib/file/magic/Magdir/subtitle /usr/src/contrib/file/magic/Magdir/sun /usr/src/contrib/file/magic/Magdir/sylk /usr/src/contrib/file/magic/Magdir/symbos /usr/src/contrib/file/magic/Magdir/sysex /usr/src/contrib/file/magic/Magdir/tcl /usr/src/contrib/file/magic/Magdir/teapot /usr/src/contrib/file/magic/Magdir/terminfo /usr/src/contrib/file/magic/Magdir/tex /usr/src/contrib/file/magic/Magdir/tgif /usr/src/contrib/file/magic/Magdir/ti-8x /usr/src/contrib/file/magic/Magdir/timezone /usr/src/contrib/file/magic/Magdir/tplink /usr/src/contrib/file/magic/Magdir/troff /usr/src/contrib/file/magic/Magdir/tuxedo /usr/src/contrib/file/magic/Magdir/typeset /usr/src/contrib/file/magic/Magdir/uf2 /usr/src/contrib/file/magic/Magdir/unicode /usr/src/contrib/file/magic/Magdir/unisig /usr/src/contrib/file/magic/Magdir/unknown /usr/src/contrib/file/magic/Magdir/usd /usr/src/contrib/file/magic/Magdir/uterus /usr/src/contrib/file/magic/Magdir/uuencode /usr/src/contrib/file/magic/Magdir/vacuum-cleaner /usr/src/contrib/file/magic/Magdir/varied.out /usr/src/contrib/file/magic/Magdir/varied.script /usr/src/contrib/file/magic/Magdir/vax /usr/src/contrib/file/magic/Magdir/vicar /usr/src/contrib/file/magic/Magdir/virtual /usr/src/contrib/file/magic/Magdir/virtutech /usr/src/contrib/file/magic/Magdir/visx /usr/src/contrib/file/magic/Magdir/vms /usr/src/contrib/file/magic/Magdir/vmware /usr/src/contrib/file/magic/Magdir/vorbis /usr/src/contrib/file/magic/Magdir/vxl /usr/src/contrib/file/magic/Magdir/warc /usr/src/contrib/file/magic/Magdir/weak /usr/src/contrib/file/magic/Magdir/web /usr/src/contrib/file/magic/Magdir/webassembly /usr/src/contrib/file/magic/Magdir/windows /usr/src/contrib/file/magic/Magdir/wireless /usr/src/contrib/file/magic/Magdir/wordprocessors /usr/src/contrib/file/magic/Magdir/wsdl /usr/src/contrib/file/magic/Magdir/x68000 /usr/src/contrib/file/magic/Magdir/xdelta /usr/src/contrib/file/magic/Magdir/xenix /usr/src/contrib/file/magic/Magdir/xilinx /usr/src/contrib/file/magic/Magdir/xo65 /usr/src/contrib/file/magic/Magdir/xwindows /usr/src/contrib/file/magic/Magdir/yara /usr/src/contrib/file/magic/Magdir/zfs /usr/src/contrib/file/magic/Magdir/zilog /usr/src/contrib/file/magic/Magdir/zip /usr/src/contrib/file/magic/Magdir/zyxel > magic ./mkmagic magic magic, 4979: Warning: Current entry does not yet have a description for adding a MIME type mkmagic: could not find any valid magic files! *** [magic.mgc] Error code 1 make[5]: stopped in /usr/src/lib/libmagic Is this a known problem? Any idea how to solve this? Thanks in advance for any hint, Rainer Hurling From nobody Sat Sep 9 15:15:35 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjc4D5JsZz4sSps for ; Sat, 9 Sep 2023 15:15:40 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Received: from xmailer.gwdg.de (xmailer.gwdg.de [134.76.10.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjc4C3xV6z4DXb for ; Sat, 9 Sep 2023 15:15:39 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of rhurlin@gwdg.de designates 134.76.10.29 as permitted sender) smtp.mailfrom=rhurlin@gwdg.de; dmarc=none Received: from excmbx-23.um.gwdg.de ([134.76.9.233] helo=email.gwdg.de) by mailer.gwdg.de with esmtp (GWDG Mailer) (envelope-from ) id 1qezgO-000O3G-Lj for current@freebsd.org; Sat, 09 Sep 2023 17:15:36 +0200 Received: from MBX19-GWD-03.um.gwdg.de (10.108.142.56) by EXCMBX-23.um.gwdg.de (134.76.9.233) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.2507.32; Sat, 9 Sep 2023 17:15:36 +0200 Received: from [192.168.178.23] (10.250.9.199) by MBX19-GWD-03.um.gwdg.de (10.108.142.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.1258.25; Sat, 9 Sep 2023 17:15:36 +0200 Message-ID: Date: Sat, 9 Sep 2023 17:15:35 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: 15.0-CURRENT build broken in lib/libmagic Content-Language: en-US From: Rainer Hurling To: current Reply-To: Rainer Hurling References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> In-Reply-To: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [10.250.9.199] X-ClientProxiedBy: excmbx-25.um.gwdg.de (134.76.9.235) To MBX19-GWD-03.um.gwdg.de (10.108.142.56) X-Virus-Scanned: (clean) by clamav X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.79 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.997]; RWL_MAILSPIKE_EXCELLENT(-0.40)[134.76.10.29:from]; NEURAL_SPAM_MEDIUM(0.21)[0.206]; RCVD_IN_DNSWL_MED(-0.20)[134.76.9.233:received]; R_SPF_ALLOW(-0.20)[+ip4:134.76.10.0/23]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[134.76.10.29:from]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; FREEFALL_USER(0.00)[rhurlin]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[gwdg.de]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_REPLYTO(0.00)[rhurlin@FreeBSD.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; REPLYTO_DN_EQ_FROM_DN(0.00)[]; HAS_XOIP(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_ALL(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:207592, ipnet:134.76.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[current@freebsd.org] X-Rspamd-Queue-Id: 4Rjc4C3xV6z4DXb Just an update. This also happens in Poudriere, when I try to update my jails for 13.2, 14.0 and 15.0-CURRENT. It seems, that my installed version of 15.0-CURRENT (main-n265063-e0752f431b01) is the culprit :( Am 09.09.23 um 13:52 schrieb Rainer Hurling: > If I try to build world from todays c1b26df2972d with 15.0-CURRENT > (main-n265063-e0752f431b01), it aborts with an error. > > Seems it is not able to handle line 4979 of the magic file (Microsoft > Advanced Streaming Format ASF): > > > ===> lib/libmagic (all) > echo libmagic.so.4: /usr/obj/usr/src/amd64.amd64/tmp/usr/lib/libz.a >> > .depend > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.apprentice.o > -MTapprentice.o -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/apprentice.c -o apprentice.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.apptype.o -MTapptype.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/apptype.c -o apptype.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.ascmagic.o -MTascmagic.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/ascmagic.c -o ascmagic.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.buffer.o -MTbuffer.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/buffer.c -o buffer.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.cdf.o -MTcdf.o -std=gnu99 > -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers > -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/cdf.c -o cdf.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.cdf_time.o -MTcdf_time.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/cdf_time.c -o cdf_time.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.compress.o -MTcompress.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/compress.c -o compress.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.der.o -MTder.o -std=gnu99 > -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers > -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/der.c -o der.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.encoding.o -MTencoding.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/encoding.c -o encoding.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.fsmagic.o -MTfsmagic.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/fsmagic.c -o fsmagic.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.funcs.o -MTfuncs.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/funcs.c -o funcs.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_json.o -MTis_json.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_json.c -o is_json.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_csv.o -MTis_csv.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_csv.c -o is_csv.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_tar.o -MTis_tar.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_tar.c -o is_tar.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.magic.o -MTmagic.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/magic.c -o magic.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.print.o -MTprint.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/print.c -o print.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.readcdf.o -MTreadcdf.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/readcdf.c -o readcdf.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.readelf.o -MTreadelf.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/readelf.c -o readelf.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.seccomp.o -MTseccomp.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/seccomp.c -o seccomp.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe -fno-common > -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.softmagic.o -MTsoftmagic.o > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/softmagic.c -o softmagic.o > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.apprentice.pico > -MTapprentice.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/apprentice.c -o apprentice.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.apptype.pico > -MTapptype.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/apptype.c -o apptype.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.ascmagic.pico > -MTascmagic.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/ascmagic.c -o ascmagic.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.buffer.pico -MTbuffer.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/buffer.c -o buffer.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.cdf.pico -MTcdf.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/cdf.c -o cdf.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.cdf_time.pico > -MTcdf_time.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/cdf_time.c -o cdf_time.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.compress.pico > -MTcompress.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/compress.c -o compress.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.der.pico -MTder.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/der.c -o der.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.encoding.pico > -MTencoding.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/encoding.c -o encoding.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.fsmagic.pico > -MTfsmagic.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/fsmagic.c -o fsmagic.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.funcs.pico -MTfuncs.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/funcs.c -o funcs.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_json.pico > -MTis_json.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_json.c -o is_json.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_csv.pico -MTis_csv.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_csv.c -o is_csv.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.is_tar.pico -MTis_tar.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/is_tar.c -o is_tar.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.magic.pico -MTmagic.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/magic.c -o magic.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.print.pico -MTprint.pico > -std=gnu99 -Wno-format-zero-length -fstack-protector-strong > -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter > -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith > -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body > -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/print.c -o print.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.readcdf.pico > -MTreadcdf.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/readcdf.c -o readcdf.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.readelf.pico > -MTreadelf.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/readelf.c -o readelf.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.seccomp.pico > -MTseccomp.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/seccomp.c -o seccomp.pico > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -fpic -DPIC  -O2 -pipe > -fno-common -DMAGIC='"/usr/share/misc/magic"' -DHAVE_CONFIG_H > -I/usr/src/lib/libmagic -I/usr/obj/usr/src/amd64.amd64/lib/libmagic > -I/usr/src/contrib/file/src   -MD  -MF.depend.softmagic.pico > -MTsoftmagic.pico -std=gnu99 -Wno-format-zero-length > -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k > -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes > -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wdate-time > -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable > -Wno-error=unused-but-set-parameter -Wno-tautological-compare > -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function > -Wno-enum-conversion -Wno-unused-local-typedef > -Wno-address-of-packed-member  -Qunused-arguments    -c > /usr/src/contrib/file/src/softmagic.c -o softmagic.pico > building static magic library > ar -crsD libmagic.a apprentice.o apptype.o ascmagic.o buffer.o cdf.o > cdf_time.o compress.o der.o encoding.o fsmagic.o funcs.o is_json.o > is_csv.o is_tar.o magic.o print.o readcdf.o readelf.o seccomp.o softmagic.o > building shared library libmagic.so.4 > cc -target x86_64-unknown-freebsd15.0 > --sysroot=/usr/obj/usr/src/amd64.amd64/tmp > -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin  -Wl,-zrelro > -fstack-protector-strong -shared -Wl,-x -Wl,--fatal-warnings > -Wl,--warn-shared-textrel  -o libmagic.so.4 -Wl,-soname,libmagic.so.4 > apprentice.pico apptype.pico ascmagic.pico buffer.pico cdf.pico > cdf_time.pico compress.pico der.pico encoding.pico fsmagic.pico > funcs.pico is_json.pico is_csv.pico is_tar.pico magic.pico print.pico > readcdf.pico readelf.pico seccomp.pico softmagic.pico  -lz > cat /usr/src/contrib/file/magic/Header > /usr/src/contrib/file/magic/Localstuff > /usr/src/contrib/file/magic/Magdir/acorn > /usr/src/contrib/file/magic/Magdir/adi > /usr/src/contrib/file/magic/Magdir/adventure > /usr/src/contrib/file/magic/Magdir/aes > /usr/src/contrib/file/magic/Magdir/algol68 > /usr/src/contrib/file/magic/Magdir/allegro > /usr/src/contrib/file/magic/Magdir/alliant > /usr/src/contrib/file/magic/Magdir/amanda > /usr/src/contrib/file/magic/Magdir/amigaos > /usr/src/contrib/file/magic/Magdir/android > /usr/src/contrib/file/magic/Magdir/animation > /usr/src/contrib/file/magic/Magdir/aout > /usr/src/contrib/file/magic/Magdir/apache > /usr/src/contrib/file/magic/Magdir/apl > /usr/src/contrib/file/magic/Magdir/apple > /usr/src/contrib/file/magic/Magdir/application > /usr/src/contrib/file/magic/Magdir/applix > /usr/src/contrib/file/magic/Magdir/apt > /usr/src/contrib/file/magic/Magdir/archive > /usr/src/contrib/file/magic/Magdir/aria > /usr/src/contrib/file/magic/Magdir/arm > /usr/src/contrib/file/magic/Magdir/asf > /usr/src/contrib/file/magic/Magdir/assembler > /usr/src/contrib/file/magic/Magdir/asterix > /usr/src/contrib/file/magic/Magdir/att3b > /usr/src/contrib/file/magic/Magdir/audio > /usr/src/contrib/file/magic/Magdir/avm > /usr/src/contrib/file/magic/Magdir/basis > /usr/src/contrib/file/magic/Magdir/beetle > /usr/src/contrib/file/magic/Magdir/ber > /usr/src/contrib/file/magic/Magdir/bflt > /usr/src/contrib/file/magic/Magdir/bhl > /usr/src/contrib/file/magic/Magdir/bioinformatics > /usr/src/contrib/file/magic/Magdir/biosig > /usr/src/contrib/file/magic/Magdir/blackberry > /usr/src/contrib/file/magic/Magdir/blcr > /usr/src/contrib/file/magic/Magdir/blender > /usr/src/contrib/file/magic/Magdir/blit > /usr/src/contrib/file/magic/Magdir/bm > /usr/src/contrib/file/magic/Magdir/bout > /usr/src/contrib/file/magic/Magdir/bsdi > /usr/src/contrib/file/magic/Magdir/bsi > /usr/src/contrib/file/magic/Magdir/btsnoop > /usr/src/contrib/file/magic/Magdir/burp > /usr/src/contrib/file/magic/Magdir/bytecode > /usr/src/contrib/file/magic/Magdir/c-lang > /usr/src/contrib/file/magic/Magdir/c64 > /usr/src/contrib/file/magic/Magdir/cad > /usr/src/contrib/file/magic/Magdir/cafebabe > /usr/src/contrib/file/magic/Magdir/cbor > /usr/src/contrib/file/magic/Magdir/ccf > /usr/src/contrib/file/magic/Magdir/cddb > /usr/src/contrib/file/magic/Magdir/chord > /usr/src/contrib/file/magic/Magdir/cisco > /usr/src/contrib/file/magic/Magdir/citrus > /usr/src/contrib/file/magic/Magdir/clarion > /usr/src/contrib/file/magic/Magdir/claris > /usr/src/contrib/file/magic/Magdir/clipper > /usr/src/contrib/file/magic/Magdir/clojure > /usr/src/contrib/file/magic/Magdir/coff > /usr/src/contrib/file/magic/Magdir/commands > /usr/src/contrib/file/magic/Magdir/communications > /usr/src/contrib/file/magic/Magdir/compress > /usr/src/contrib/file/magic/Magdir/console > /usr/src/contrib/file/magic/Magdir/convex > /usr/src/contrib/file/magic/Magdir/coverage > /usr/src/contrib/file/magic/Magdir/cracklib > /usr/src/contrib/file/magic/Magdir/crypto > /usr/src/contrib/file/magic/Magdir/ctags > /usr/src/contrib/file/magic/Magdir/ctf > /usr/src/contrib/file/magic/Magdir/cubemap > /usr/src/contrib/file/magic/Magdir/cups > /usr/src/contrib/file/magic/Magdir/dact > /usr/src/contrib/file/magic/Magdir/database > /usr/src/contrib/file/magic/Magdir/dataone > /usr/src/contrib/file/magic/Magdir/dbpf > /usr/src/contrib/file/magic/Magdir/der > /usr/src/contrib/file/magic/Magdir/diamond > /usr/src/contrib/file/magic/Magdir/dif > /usr/src/contrib/file/magic/Magdir/diff > /usr/src/contrib/file/magic/Magdir/digital > /usr/src/contrib/file/magic/Magdir/dolby > /usr/src/contrib/file/magic/Magdir/dsf > /usr/src/contrib/file/magic/Magdir/dump > /usr/src/contrib/file/magic/Magdir/dyadic > /usr/src/contrib/file/magic/Magdir/ebml > /usr/src/contrib/file/magic/Magdir/edid > /usr/src/contrib/file/magic/Magdir/editors > /usr/src/contrib/file/magic/Magdir/efi > /usr/src/contrib/file/magic/Magdir/elf > /usr/src/contrib/file/magic/Magdir/encore > /usr/src/contrib/file/magic/Magdir/epoc > /usr/src/contrib/file/magic/Magdir/erlang > /usr/src/contrib/file/magic/Magdir/espressif > /usr/src/contrib/file/magic/Magdir/esri > /usr/src/contrib/file/magic/Magdir/fcs > /usr/src/contrib/file/magic/Magdir/filesystems > /usr/src/contrib/file/magic/Magdir/finger > /usr/src/contrib/file/magic/Magdir/flash > /usr/src/contrib/file/magic/Magdir/flif > /usr/src/contrib/file/magic/Magdir/fonts > /usr/src/contrib/file/magic/Magdir/forth > /usr/src/contrib/file/magic/Magdir/fortran > /usr/src/contrib/file/magic/Magdir/frame > /usr/src/contrib/file/magic/Magdir/freebsd > /usr/src/contrib/file/magic/Magdir/fsav > /usr/src/contrib/file/magic/Magdir/fusecompress > /usr/src/contrib/file/magic/Magdir/games > /usr/src/contrib/file/magic/Magdir/gcc > /usr/src/contrib/file/magic/Magdir/gconv > /usr/src/contrib/file/magic/Magdir/gentoo > /usr/src/contrib/file/magic/Magdir/geo > /usr/src/contrib/file/magic/Magdir/geos > /usr/src/contrib/file/magic/Magdir/gimp > /usr/src/contrib/file/magic/Magdir/git > /usr/src/contrib/file/magic/Magdir/glibc > /usr/src/contrib/file/magic/Magdir/gnome > /usr/src/contrib/file/magic/Magdir/gnu > /usr/src/contrib/file/magic/Magdir/gnumeric > /usr/src/contrib/file/magic/Magdir/gpt > /usr/src/contrib/file/magic/Magdir/gpu > /usr/src/contrib/file/magic/Magdir/grace > /usr/src/contrib/file/magic/Magdir/graphviz > /usr/src/contrib/file/magic/Magdir/gringotts > /usr/src/contrib/file/magic/Magdir/hardware > /usr/src/contrib/file/magic/Magdir/hitachi-sh > /usr/src/contrib/file/magic/Magdir/hp > /usr/src/contrib/file/magic/Magdir/human68k > /usr/src/contrib/file/magic/Magdir/ibm370 > /usr/src/contrib/file/magic/Magdir/ibm6000 > /usr/src/contrib/file/magic/Magdir/icc > /usr/src/contrib/file/magic/Magdir/iff > /usr/src/contrib/file/magic/Magdir/images > /usr/src/contrib/file/magic/Magdir/inform > /usr/src/contrib/file/magic/Magdir/intel > /usr/src/contrib/file/magic/Magdir/interleaf > /usr/src/contrib/file/magic/Magdir/island > /usr/src/contrib/file/magic/Magdir/ispell > /usr/src/contrib/file/magic/Magdir/isz > /usr/src/contrib/file/magic/Magdir/java > /usr/src/contrib/file/magic/Magdir/javascript > /usr/src/contrib/file/magic/Magdir/jpeg > /usr/src/contrib/file/magic/Magdir/karma > /usr/src/contrib/file/magic/Magdir/kde > /usr/src/contrib/file/magic/Magdir/keepass > /usr/src/contrib/file/magic/Magdir/kerberos > /usr/src/contrib/file/magic/Magdir/kicad > /usr/src/contrib/file/magic/Magdir/kml > /usr/src/contrib/file/magic/Magdir/lammps > /usr/src/contrib/file/magic/Magdir/lecter > /usr/src/contrib/file/magic/Magdir/lex > /usr/src/contrib/file/magic/Magdir/lif > /usr/src/contrib/file/magic/Magdir/linux > /usr/src/contrib/file/magic/Magdir/lisp > /usr/src/contrib/file/magic/Magdir/llvm > /usr/src/contrib/file/magic/Magdir/locoscript > /usr/src/contrib/file/magic/Magdir/lua > /usr/src/contrib/file/magic/Magdir/luks > /usr/src/contrib/file/magic/Magdir/m4 > /usr/src/contrib/file/magic/Magdir/mach > /usr/src/contrib/file/magic/Magdir/macintosh > /usr/src/contrib/file/magic/Magdir/macos > /usr/src/contrib/file/magic/Magdir/magic > /usr/src/contrib/file/magic/Magdir/mail.news > /usr/src/contrib/file/magic/Magdir/make > /usr/src/contrib/file/magic/Magdir/map > /usr/src/contrib/file/magic/Magdir/maple > /usr/src/contrib/file/magic/Magdir/marc21 > /usr/src/contrib/file/magic/Magdir/mathcad > /usr/src/contrib/file/magic/Magdir/mathematica > /usr/src/contrib/file/magic/Magdir/matroska > /usr/src/contrib/file/magic/Magdir/mcrypt > /usr/src/contrib/file/magic/Magdir/measure > /usr/src/contrib/file/magic/Magdir/mercurial > /usr/src/contrib/file/magic/Magdir/metastore > /usr/src/contrib/file/magic/Magdir/meteorological > /usr/src/contrib/file/magic/Magdir/microfocus > /usr/src/contrib/file/magic/Magdir/mime > /usr/src/contrib/file/magic/Magdir/mips > /usr/src/contrib/file/magic/Magdir/mirage > /usr/src/contrib/file/magic/Magdir/misctools > /usr/src/contrib/file/magic/Magdir/mkid > /usr/src/contrib/file/magic/Magdir/mlssa > /usr/src/contrib/file/magic/Magdir/mmdf > /usr/src/contrib/file/magic/Magdir/modem > /usr/src/contrib/file/magic/Magdir/modulefile > /usr/src/contrib/file/magic/Magdir/motorola > /usr/src/contrib/file/magic/Magdir/mozilla > /usr/src/contrib/file/magic/Magdir/msdos > /usr/src/contrib/file/magic/Magdir/msooxml > /usr/src/contrib/file/magic/Magdir/msvc > /usr/src/contrib/file/magic/Magdir/msx > /usr/src/contrib/file/magic/Magdir/mup > /usr/src/contrib/file/magic/Magdir/music > /usr/src/contrib/file/magic/Magdir/nasa > /usr/src/contrib/file/magic/Magdir/natinst > /usr/src/contrib/file/magic/Magdir/ncr > /usr/src/contrib/file/magic/Magdir/netbsd > /usr/src/contrib/file/magic/Magdir/netscape > /usr/src/contrib/file/magic/Magdir/netware > /usr/src/contrib/file/magic/Magdir/news > /usr/src/contrib/file/magic/Magdir/nifty > /usr/src/contrib/file/magic/Magdir/nim-lang > /usr/src/contrib/file/magic/Magdir/nitpicker > /usr/src/contrib/file/magic/Magdir/numpy > /usr/src/contrib/file/magic/Magdir/oasis > /usr/src/contrib/file/magic/Magdir/ocaml > /usr/src/contrib/file/magic/Magdir/octave > /usr/src/contrib/file/magic/Magdir/ole2compounddocs > /usr/src/contrib/file/magic/Magdir/olf > /usr/src/contrib/file/magic/Magdir/openfst > /usr/src/contrib/file/magic/Magdir/opentimestamps > /usr/src/contrib/file/magic/Magdir/oric > /usr/src/contrib/file/magic/Magdir/os2 > /usr/src/contrib/file/magic/Magdir/os400 > /usr/src/contrib/file/magic/Magdir/os9 > /usr/src/contrib/file/magic/Magdir/osf1 > /usr/src/contrib/file/magic/Magdir/palm > /usr/src/contrib/file/magic/Magdir/parix > /usr/src/contrib/file/magic/Magdir/parrot > /usr/src/contrib/file/magic/Magdir/pascal > /usr/src/contrib/file/magic/Magdir/pbf > /usr/src/contrib/file/magic/Magdir/pbm > /usr/src/contrib/file/magic/Magdir/pc88 > /usr/src/contrib/file/magic/Magdir/pc98 > /usr/src/contrib/file/magic/Magdir/pci_ids > /usr/src/contrib/file/magic/Magdir/pcjr > /usr/src/contrib/file/magic/Magdir/pdf > /usr/src/contrib/file/magic/Magdir/pdp > /usr/src/contrib/file/magic/Magdir/perl > /usr/src/contrib/file/magic/Magdir/pgf > /usr/src/contrib/file/magic/Magdir/pgp > /usr/src/contrib/file/magic/Magdir/pgp-binary-keys > /usr/src/contrib/file/magic/Magdir/pkgadd > /usr/src/contrib/file/magic/Magdir/plan9 > /usr/src/contrib/file/magic/Magdir/plus5 > /usr/src/contrib/file/magic/Magdir/pmem > /usr/src/contrib/file/magic/Magdir/polyml > /usr/src/contrib/file/magic/Magdir/printer > /usr/src/contrib/file/magic/Magdir/project > /usr/src/contrib/file/magic/Magdir/psdbms > /usr/src/contrib/file/magic/Magdir/psl > /usr/src/contrib/file/magic/Magdir/pulsar > /usr/src/contrib/file/magic/Magdir/puzzle > /usr/src/contrib/file/magic/Magdir/pwsafe > /usr/src/contrib/file/magic/Magdir/pyramid > /usr/src/contrib/file/magic/Magdir/python > /usr/src/contrib/file/magic/Magdir/qt > /usr/src/contrib/file/magic/Magdir/revision > /usr/src/contrib/file/magic/Magdir/riff > /usr/src/contrib/file/magic/Magdir/ringdove > /usr/src/contrib/file/magic/Magdir/rpi > /usr/src/contrib/file/magic/Magdir/rpm > /usr/src/contrib/file/magic/Magdir/rpmsg > /usr/src/contrib/file/magic/Magdir/rst > /usr/src/contrib/file/magic/Magdir/rtf > /usr/src/contrib/file/magic/Magdir/ruby > /usr/src/contrib/file/magic/Magdir/sc > /usr/src/contrib/file/magic/Magdir/sccs > /usr/src/contrib/file/magic/Magdir/scientific > /usr/src/contrib/file/magic/Magdir/securitycerts > /usr/src/contrib/file/magic/Magdir/selinux > /usr/src/contrib/file/magic/Magdir/sendmail > /usr/src/contrib/file/magic/Magdir/sequent > /usr/src/contrib/file/magic/Magdir/sereal > /usr/src/contrib/file/magic/Magdir/sgi > /usr/src/contrib/file/magic/Magdir/sgml > /usr/src/contrib/file/magic/Magdir/sharc > /usr/src/contrib/file/magic/Magdir/sinclair > /usr/src/contrib/file/magic/Magdir/sisu > /usr/src/contrib/file/magic/Magdir/sketch > /usr/src/contrib/file/magic/Magdir/smalltalk > /usr/src/contrib/file/magic/Magdir/smile > /usr/src/contrib/file/magic/Magdir/sniffer > /usr/src/contrib/file/magic/Magdir/softquad > /usr/src/contrib/file/magic/Magdir/sosi > /usr/src/contrib/file/magic/Magdir/spec > /usr/src/contrib/file/magic/Magdir/spectrum > /usr/src/contrib/file/magic/Magdir/sql > /usr/src/contrib/file/magic/Magdir/ssh > /usr/src/contrib/file/magic/Magdir/ssl > /usr/src/contrib/file/magic/Magdir/statistics > /usr/src/contrib/file/magic/Magdir/subtitle > /usr/src/contrib/file/magic/Magdir/sun > /usr/src/contrib/file/magic/Magdir/sylk > /usr/src/contrib/file/magic/Magdir/symbos > /usr/src/contrib/file/magic/Magdir/sysex > /usr/src/contrib/file/magic/Magdir/tcl > /usr/src/contrib/file/magic/Magdir/teapot > /usr/src/contrib/file/magic/Magdir/terminfo > /usr/src/contrib/file/magic/Magdir/tex > /usr/src/contrib/file/magic/Magdir/tgif > /usr/src/contrib/file/magic/Magdir/ti-8x > /usr/src/contrib/file/magic/Magdir/timezone > /usr/src/contrib/file/magic/Magdir/tplink > /usr/src/contrib/file/magic/Magdir/troff > /usr/src/contrib/file/magic/Magdir/tuxedo > /usr/src/contrib/file/magic/Magdir/typeset > /usr/src/contrib/file/magic/Magdir/uf2 > /usr/src/contrib/file/magic/Magdir/unicode > /usr/src/contrib/file/magic/Magdir/unisig > /usr/src/contrib/file/magic/Magdir/unknown > /usr/src/contrib/file/magic/Magdir/usd > /usr/src/contrib/file/magic/Magdir/uterus > /usr/src/contrib/file/magic/Magdir/uuencode > /usr/src/contrib/file/magic/Magdir/vacuum-cleaner > /usr/src/contrib/file/magic/Magdir/varied.out > /usr/src/contrib/file/magic/Magdir/varied.script > /usr/src/contrib/file/magic/Magdir/vax > /usr/src/contrib/file/magic/Magdir/vicar > /usr/src/contrib/file/magic/Magdir/virtual > /usr/src/contrib/file/magic/Magdir/virtutech > /usr/src/contrib/file/magic/Magdir/visx > /usr/src/contrib/file/magic/Magdir/vms > /usr/src/contrib/file/magic/Magdir/vmware > /usr/src/contrib/file/magic/Magdir/vorbis > /usr/src/contrib/file/magic/Magdir/vxl > /usr/src/contrib/file/magic/Magdir/warc > /usr/src/contrib/file/magic/Magdir/weak > /usr/src/contrib/file/magic/Magdir/web > /usr/src/contrib/file/magic/Magdir/webassembly > /usr/src/contrib/file/magic/Magdir/windows > /usr/src/contrib/file/magic/Magdir/wireless > /usr/src/contrib/file/magic/Magdir/wordprocessors > /usr/src/contrib/file/magic/Magdir/wsdl > /usr/src/contrib/file/magic/Magdir/x68000 > /usr/src/contrib/file/magic/Magdir/xdelta > /usr/src/contrib/file/magic/Magdir/xenix > /usr/src/contrib/file/magic/Magdir/xilinx > /usr/src/contrib/file/magic/Magdir/xo65 > /usr/src/contrib/file/magic/Magdir/xwindows > /usr/src/contrib/file/magic/Magdir/yara > /usr/src/contrib/file/magic/Magdir/zfs > /usr/src/contrib/file/magic/Magdir/zilog > /usr/src/contrib/file/magic/Magdir/zip > /usr/src/contrib/file/magic/Magdir/zyxel > magic > ./mkmagic magic > magic, 4979: Warning: Current entry does not yet have a description for > adding a MIME type > mkmagic: could not find any valid magic files! > *** [magic.mgc] Error code 1 > make[5]: stopped in /usr/src/lib/libmagic > > > Is this a known problem? Any idea how to solve this? > > Thanks in advance for any hint, > Rainer Hurling > From nobody Sat Sep 9 16:02:37 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjd6S5623z4sydX for ; Sat, 9 Sep 2023 16:02:40 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjd6S3pb7z4TV8; Sat, 9 Sep 2023 16:02:40 +0000 (UTC) (envelope-from jhb@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694275360; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=p1ITb4nE8HPK/XRSVMnhCIV5esYusbLwIZTiP0/lTcI=; b=GYpY4wqJMLAep7V4BoyCnpcdJp+ESXqe/HwqLVCpggL+/pVODMfYqIn+HrJmIqngQDIfwG k0qU2y1ej7kjzORrEW1ArvL+bxgswopWV61khnj35+rIefObQ91A3+RVlqAk7V+8o9uwNL m6Vnw/OGxmeHIdTPatRo9i/mNCnSE5b9rvM2rX4NCiX4nnKYABziFgjYYYEBAoiw58DsIY wuf+02MxhEjuJ2TC+ySGvs2CKDt8C3HWdGy47MWmj/YAClA7h0iT9azOIuYmx+XYtDUftI JD4k7onKm+Gxi2DL0ESmwvRJwHcfK3gncYRztGrEncg01uMtmGLAaoPIz9tZRA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694275360; a=rsa-sha256; cv=none; b=tEuGsNU99/ct5+GGCgPqsgdzAqCQ3kt1Y0YTujJ/OMDUvd8pCKGzkgZtLIFkZDE11jJ1NI +zA9dfSiT4EgkFDYSRIJ93pyury5gXBf6bZbmAiD5/EEngDSJ9Y8KlaVVMDfASJ6jRIM4y 6lmXTLIsTMLFXP+loz5L0gCzISkz6UO6F7QmTMF/iayp9G2x7uDUz2ND1n7M0cM78PtV31 pVqkG2ILJ7rRtpprE8Rq4QamUh3PDUk2PQOZripJ/65+lVwGnmfuTy40/BwN9ZenIKxkJj pSQmUPACALp0rRrH5dqjNtTaTXXbk49EujDNCOcUrkV+wamKDZFU/OkWhPvUHg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694275360; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=p1ITb4nE8HPK/XRSVMnhCIV5esYusbLwIZTiP0/lTcI=; b=ufH42utLSHKeNE/OcfDMOq6GuD0ZWQryrsUleWV5oifzyY3k8I2x4G/j1pU2dwQTnHtr83 eKxtegsPlPrBIA8qXRPEf6/olzbgGChyWGdC9924Z6NFY3dXjbG3Lx/pighD7aD8s7du4g xJ3RiHBLgwD6XGBlj1EtQ0ys/r6LbsCCe4i3/tkxLAlgA30X4Lnn3tO970Dr3frxHcYdFA QIJTlpdi57n7YbSjdKr66koHTaskxU3EvGyM3x0DYolJ0AIxvSOIHePnXKd/GtlqkA/EqM Khr1AgDOV7JC5VEuXyly/VxxyiAIuKh1aSRtH5pPYctgAaOgcnkWm8MsheORfQ== Received: from [IPV6:2601:648:8683:a9e0:346e:8e34:11f3:aeb0] (unknown [IPv6:2601:648:8683:a9e0:346e:8e34:11f3:aeb0]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: jhb) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rjd6R6v0Pz18dc; Sat, 9 Sep 2023 16:02:39 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Message-ID: <865dc0ef-a19d-876c-b0a5-03b888b531f5@FreeBSD.org> Date: Sat, 9 Sep 2023 09:02:37 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 To: Dimitry Andric References: <5c5c3ea5-5b14-d969-f55f-b894e4983359@sonicboom.org> <46ee9e3b-adeb-4cd1-5fcc-43547c5c7231@gmail.com> <222e96ba-70b6-e976-8e32-d3726dde18b1@sonicboom.org> <7CDB341A-F9E1-4816-8443-E4C349A86C84@FreeBSD.org> Content-Language: en-US From: John Baldwin Subject: Re: user problems when upgrading to v15 Cc: "freebsd-current@freebsd.org" , brian whalen In-Reply-To: <7CDB341A-F9E1-4816-8443-E4C349A86C84@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 9/2/23 7:11 AM, Dimitry Andric wrote: > On 1 Sep 2023, at 03:42, brian whalen wrote: >> >> Repeating the entire process: >> >> I created a 13.2 vm with 6 cores and 8GB of ram. >> >> Ran freebsd-update fetch and install. >> >> Ran pkg install git bash ccache open-vm-tools-nox11 >> >> Used git clone to get current and ports source files. >> >> Edited /etc/make.conf to use ccache >> >> Ran make -j6 buildworld && make -j6 kernel >> >> I then rebooted in single user mode and did the next steps saving output to a file with > filename. >> >> etcupdate -p was pretty uneventful. It did show the below and did not prompt to edit. >> >> root@f15:~ # less etcupdatep >> C /etc/group >> C /etc/master.passwd > > This is a problem: the "C" characters mean there were conflicts, and it's indeed very unfortunate that etcupdate does not immediately force you to resolve them. Because now you basically have mangled group and master.passwd files, with conflict markers in them! No, the conflicted files are in /var/db/etcupdate/conflicts, the files in /etc are still the old ones at this point and won't be updated until you run 'etcupdate resolve' to fix them. I suspect what happened here is that Brian chose the 'tf' (theirs-full) option for 'etcupdate resolve' when he really wanted to do 'e' to edit the conflicted version. > Immediately after this, you should run "etcupdate resolve", and fix any conflicts that it has found. > > Note that recently there was a lot of churn due to the removal of $FreeBSD$ keywords, and this almost always creates conflicts in the group and passwd files. For lots of other files in /etc, the conflicts are resolved automatically, but unfortunately not for the files that are essential to log in! > > >> make installworld seemed mostly error free though I did see a nonzero status for a man page failed inn the man4 directory. >> >> etcupdate -B only showed the below. This was my first build after install. >> >> root@f15:~ # less etcupdateB >> Conflicts remain from previous update, aborting. > > Yes, that is indeed the problem. You must first resolve conflicts from any previous etcupdate run, before doing anything else. As to why it does not immediately forces you to do so, and delegates this to a separate step, which can easily be forgotten, I have no idea. So that if you are doing scripted upgrades, you don't hang forever in a script. The intention is that after doing a bunch of scripted installworld + etcupdate's on various hosts you can use 'etcupdate status' to see if there are any remaining steps requiring manual intervention. There could be an option to request batched vs interactivate updates perhaps. >> If I type exit in single user mode to go multi user mode, the local user still works. After a reboot the local user still works. This local user can also sudo as expected. This wasn't the case for the previous build when I first reported this. However, if I run etcupdate resolve it is still presenting /etc/group and /etc/master/passwd as problems. >> >> If this is is expected behavior for current then no big deal. I just wasn't sure. > > The conflicts themselves are expected, alas. But you _must_ resolve them, otherwise you can end up with a mostly-bricked system. No, the conflict markers are not placed in the versions in /etc. However, etucpdate does refuse to do a "new" upgrade until you resolve all the conflicts from your previous upgrade to ensure that conflicted upgrades aren't missed. -- John Baldwin From nobody Sat Sep 9 16:23:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjdZZ3Gw3z4t9LD for ; Sat, 9 Sep 2023 16:23:34 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjdZZ2qrmz4Zy6 for ; Sat, 9 Sep 2023 16:23:34 +0000 (UTC) (envelope-from jhb@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694276614; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=HskTewKEpgVJAd83EKowBUp73km+gNknS9vFHmJpu70=; b=ZFQfWcRtpE60WGuvLoT2Kn2DZc5TT1N89I8MEE2Z1GCXVS7v/sZuqnISWJ217SeqAPqLLn oG989x/AHSFzapJs7Gily12EVJKtC1G07ua4bETAV9zlQx1wgQ+mVDBoNOsZkMjXWRCbWc IifSsgUPbO5+mSjwJ/iqrep6f7TteV6tKGazof3osrBtbj2yW1wKz4swfG72mcAV8hStz/ h0wKuH8pSzD4V0RMNXgWImRVvutMN6DjXN4LRkD+c9qhQp1DmvvkZygAaHl1Egy6hiPcd6 58BVeLqvhHz+bH41KQ2ncqt42PgrZJLUKBUeVH3+ZvCQNA+5OcrLvRH/5rueMw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694276614; a=rsa-sha256; cv=none; b=at95FZDxkNycgttHURS2/t2lr7dn+CX1kJ0PoAz8nm8tN1aDzaCqcDKLP+2rJn3HZd85yq 0PPGIcjIW/g0ouWLNkcN8BRaENHp1woZol90Jg/T0Q4rvmZFTCZsrWuDSknleYUjzKSVTx ZrmQ+GwptGYaQbkevwQz/yA/2mHT73OpWCE3Ily0Ho5bcAlQpKNsCT/jUs/nWvyBMDjQbO HXFpPk5Tv/4EBRxSAR3bxmkVA0BOfDVO/z0mTN9KGPuCUAD9kE5nWjepSuu5/CvFmZNMQm SAWSS9SBYfv63024LXUfyjXXDsUJm7zWzhdaZiD7KfPh/QdVnbIY5C9oeL6sGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694276614; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=HskTewKEpgVJAd83EKowBUp73km+gNknS9vFHmJpu70=; b=u3oXzIt8eMBjoXtOfAUe593b/ytmyc8B80n11Eima6Y4PXTKY5SEpQc5Su+m8VZGwuG2Xt gu1iXz47f3BsCVU9h+KM8jUA55DyG28w8cr1jMeWH1KyS4zBWmy/G+tdPjQ3cxnT1nynOy 3rX+iuz0tPMsLf0HgMv1AjFYX0oRD3DE3PO3QHzucRft8xVhmoESTMDf01IlCcLDSGwQ3H qZLieXfZpEmlub0jJK2B0ikgTjkyMhufjgEU8LfVyJgn0fOKBFB83BUTYkfjn3bNHCoAUF BeIKz+7KgN1ViZp/ZdWjuMeg4sgFT1TQLS2BYnVHRnnGfte28RkApK1RBRcH+g== Received: from [IPV6:2601:648:8683:a9e0:346e:8e34:11f3:aeb0] (unknown [IPv6:2601:648:8683:a9e0:346e:8e34:11f3:aeb0]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: jhb) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RjdZZ0MqSz19xh for ; Sat, 9 Sep 2023 16:23:33 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Message-ID: <27c5905c-1917-2ad5-6171-9be40693105e@FreeBSD.org> Date: Sat, 9 Sep 2023 09:23:32 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US From: John Baldwin To: "freebsd-current@freebsd.org" Subject: 15/14 upgrades break old sudo, maybe bump PAM's shlib? Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit I upgraded my laptop from a late June current to current from yesterday today, and after installworld sudo stopped working (dies with a SIGBUS). After some debugging, the issue ended up being OpenSSL library version mismatches as sudo uses PAM and PAM is linked agianst OpenSSL 3, but sudo is linked against OpenSSL 1.1.1. Both shlibs get mapped into the the process and at some point sudo crosses the streams and the crash occurs inside OpenSSL 3's libcrypto. I realize that we do have a generate note about needing to update third party packages after an upgrade, but I tend to use sudo as part of my workflow for doing that sort of thing. I generally build all my own packages via poudriere and use sudo at various points in that process, but even if I were using FreeBSD.org packages I would be using sudo to try to run 'pkg upgrade'. su(8) in base works fine, so that's my workaround for now on my laptop, but I wonder if we want to make this particular bump on the upgrade path a little less bumpy? Either by being clear in our release notes that tools like sudo (and I suspect any other third-party su wrappers that also use PAM, xscreensaver's screen lock doesn't seem to be affected since it probably doesn't use OpenSSL directly thankfully) can break, or another route we could take would be to bump the DSO versions of things that depend on libcrypto/libssl in base. We did not do this latter approach for the OpenSSL 1.0.2 -> 1.1.1 upgrade FWIW. If we wanted to do the shlib bump approach, Enji had a good list from a while back (though Enji wanted to make them all private rather than bumping): - kerberos - libarchive - libbsnmp - libfetch - libgeli - libldns - libmp - libradius - libunbound From my research it seems that PAM (library and modules), gssapi libraries, and libzfs would also need to be on the list. libldns is already private as is libunbound, though bumping them might be safter anyway. There is on libgeli, instead there is geli_eli.so which has no version, but hopefully is not widely used in ports the same as PAM. Note also that if we did this, we would want to do it for 14.0 as 13.x -> 14 upgrades are affected in the same way. -- John Baldwin From nobody Sat Sep 9 16:32:33 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjdnJ3X9mz4tFMN for ; Sat, 9 Sep 2023 16:32:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-21.consmr.mail.gq1.yahoo.com (sonic310-21.consmr.mail.gq1.yahoo.com [98.137.69.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjdnH3yJ5z4fDw for ; Sat, 9 Sep 2023 16:32:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=UgzQdwsK; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694277169; bh=weTyd1bs9Rvq/AfYBi6SheE/T1juWcs47saskxKNi5A=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=UgzQdwsKr4C2C9zP1tQFW2MwW2VQqAt7+PpF3eyqV37+pVXuq7l+MKqCsRnfajrm07I5JQnzamUSuqzWQkJEuxSRtxUS+Yqd6YypBeEsQvHj1ygSG5BHXNt2rreaNlidBkvaonrn9G57fg6xJZgJwtDSmorT1qkyfSjdC5XY5SYPOWGRZoVBmOjmWo7W5Y275Jn2DPGUvKvvYrInDjGjlqKzdBk5bPIuwqDsnZ6aCuA0vtAzDD99ODqrYCd0zAjEL/QYckwitBsI4TC9T+nCORuC/S1ZvD1UA85tB3likTPG0ccqqTo496Fufzd+hgYKUsK2E3pfBpIK5KxwgjtWiA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694277169; bh=IaNjl5Xyh86UoYs6V/SLmByy5XhBbxcbF0P12XlyEyD=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=lW32LKSFozRint7dznXgQZlZ0VHA6p6hSz/LvCb5X/qe9MngAfv09Dg/ydhTxtVwVV6eVifsvAbzMWqYT0f1E8Vxk2RVBHrd94b/lE+WTiVFaKv5NwJq0XNeDb3D1A7xAsTc25jagr2WV4POptTL1txRg7mGXbXj0gQ0CYAuGPMSHGqYXClqNw2gHv03W3YxwxOU4/hSiYcUGWozCTKet0fFj7zD5ACVmtUdZ2poAk+zzPqYGip3cSc52ylcofal0NR1vl0drs+oIzYOTBEPsTX7ZbloEfn0UKYvb74R9lQoaIsUV1WplXb5S8AtZsj2BU+VTKU02VUda7Se99aRVA== X-YMail-OSG: BguVTfQVM1mUJxxH9Q_s3TcW_raiwcFx13_4kwzgeFoeHvotY1jIut6eAne_2Zm EwGgQEHF7EQc7UBvj2MM.PSc462TISmnLQ4HdQ1ekzmpbjgK_zGCI_1x6egKXs.y2pJG7vY7C5qk SArlWNlFzgt0kg2JF5YwNjcE3RyoFdbNl1ehRAJCQcAt7lKDr2Oypc3X44IQGz3IcMLTWjkU_8EX Kn6zisshRNFCKTgCnFoDkOlkQkQCnc37hH1bWDwg_Q42I9PdvcIVaK6HrzhVqmynwmbcoiRGbPob .zdiYxR9DlNJ3WSQJWn67c051qmWJouvGqNibEEEi8cBM_NJ_eZXShNvmbQieVyAlYHpmnsV85X_ hi48q3x8l7XxJQtNYjkSKt2vwWExMwRtzbQzbW80hTIU7C2Nbke2RWWE1KojAE5xCVsyM9j8jBXR rfCeayyRxIcMmBk1CoHiiKgmvsc.Om1ViD9Lh7SCwz4ddoexBR.TdyI4_v.DlKomFh3mQg34w3hW IaEzs39KQUtEREFFVkjrFVdyaY.osjX_kxjYU7GdYXYRsAGQKQa0J6G.gb9TSIm6cDiObqn0AY.D 81bQLPFTv_Z.6wRpQQYBsRAxzmpBrY8dU2c_3FasnNXcUp0DjOWN2FrhZWVfKexLfv08v1B4bwWL pyfSl.6aVr_qXaqk_nnhJ6wtJrrBWv0sCbfAq9aWIdFvvi_i7ksEwU3uTFHpbZCqvWcPGmbCIURw XhDxc0fe2BAfjd81pHFw1JBoCs93nUzWAV6G3pM9SKxf8RosaQUgSlQ1MUqK26_vTC.fQg4ZVCTo tQ_PXD.JtkutQhinlnbgrj23JYcTSWly5czKW.Us0Ev_YJdMCIP.Nh6RMZYgLtb4RDyLAvuQXzFD 1ahUaoYET9JX1OmJoE_rmWAZpzAaQlSM3zUS.xQDaKZ7GK.bsZ8Nv0UvwqAoPZB0mXzpyoV1A18. 0eeCSj4vwQl0tYDYXRAISsH0Aqxi6pc.MlE1dOkMdNUsx_L4AHXQ08VRVMsbqhc2DwEvgrvdmcO5 z7KX3O2jVf6KbmK2BILxzqieAfg9WKEOxHmnORAy35NKjhi7.qob84Otdpff_wQgVoaEoYG6.Gom JxtOkHzsBPi6Uu3IBWuXAf0qkt2geawYdLL7c1ZvDnLBQRr9khz8MTphOeI19JY6mGlnaJyqQgvb n1bB8mXJXqHiukgHeuExGUtqxXNRSJZhnTKvRS4wjzEhNxmeGv4swtIVDA6h_m0WoaN0v5LmdWug sL9RZVporD7zfcpJPG1WJS1hJhDKkK_SeMab91CXsjt1aaYB7elBHAOdl7Mxck5cb6aSAQf9iMFF MZue4xZ6s4R5SyjDlxfu5iTxPQ0CfeCj_Vp9SFCgAyEowW0eUgbNy1cf_8NrFNOPTUDTfR1zhqGa 5roc22EjKm2d5eyGAR45by5Kf3aGzLgLkfnHLsLUNc_eRnDmG4tt1SzjqH9C5fYK0ozHOTNpbVTn 1WHep7Cf.V.OMkNwV_XhmEiv2FL.4WXixOaLcW0DvPQ_28bnl58yR2eDqzXqXw0GQ.JhMrRBV0B1 MNYFS7qrbza3W83VWMPgz3N1yYvsQ_vkrvXw1hUfAsPcR8iV1DNI4TKoniOA8O4VPtlPZG.l6cWS K6Yjkzhqa2VJXOqQU7FdqpMSkKL4oZBmJf8jMc4qY7pBA7wIpiJaR4pENTI.eBPbq.0mfcxag5ad Z1BnAT35hEsij4xtGiUmk0sj8Sz03OzFbn9SPGDnHvIO8JzSOdnC9ZRHcj9_9YS9OoQt5GgujJeT bGTbe.zaHjI0_063hlWY4d7ZppPHcS0TkcKW0BvNE9WF4OFQgijPdkhr0qsr.sYyO22nOSCFgDb6 UQlB1QL2zaMvNwweswFFg1GEWYDxIPD1N.3f2FIUAczGSzhnGbw2DNipZ1U84iDjLgjYAu0cWbGH fJGmuK_bfpjWfIgGvScq3tLJ6KA0qMeUsOv4VYggrLxtqpVZ7hl4QJapM4gn7qt97y3DvjoFH5F. VXkwnwK4dmQesVvatqSMmrc1XGClFjT.G.dSnOaa20AkkE.qIlFMDoXfe3bVoCBBG3rbuxEIVYS_ cIUFfW8Ji7ot9NhO.zPoZ0zcMHmehOPUwo67LNQSyETH.OeaZxYmYvi09JKRboJpBKtbv01XLRm0 gfHWD2XT5xffFVetspjU7N79qsfVPn4UGu9MnpLJxXSc1Nu5nF9ktP65qHvDYrkSHwQYz87clnVz 7aJq0Rdc7TJk9vbjQfE8mXIkA6w7ADVe59NOR0vxN38AuwTHac41Tnpm36OcKGlDR8wJRzNj3E.u CwTWKyXDSxA-- X-Sonic-MF: X-Sonic-ID: 38ec0d9c-0e85-44c9-974b-f419a2f472c3 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Sep 2023 16:32:49 +0000 Received: by hermes--production-gq1-6b7c87dcf5-sv5pn (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b392d06b9743fbafddba95b9ff9f6f4a; Sat, 09 Sep 2023 16:32:44 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics From: Mark Millard In-Reply-To: <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> Date: Sat, 9 Sep 2023 09:32:33 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek Content-Transfer-Encoding: quoted-printable Message-Id: <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> To: Martin Matuska , Alexander Motin , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.147:from]; BLOCKLISTDE_FAIL(0.00)[98.137.69.147:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.147:from]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RjdnH3yJ5z4fDw On Sep 8, 2023, at 21:54, Mark Millard wrote: > On Sep 8, 2023, at 18:19, Mark Millard wrote: >=20 >> On Sep 8, 2023, at 17:03, Mark Millard wrote: >>=20 >>> On Sep 8, 2023, at 15:30, Martin Matuska wrote: >>>=20 >>>> I can confirm that the patch fixes the panic caused by the provided = script on my test systems. >>>> Mark, would it be possible to try poudriere on your system with a = patched kernel? >>>=20 >>> . . . >>>=20 >>> On 9. 9. 2023 0:09, Alexander Motin wrote: >>>> On 08.09.2023 09:52, Martin Matuska wrote: >>>>> . . . >>>>=20 >>>> Thank you, Martin. I was able to reproduce the issue with your = script and found the cause. >>>>=20 >>>> I first though the issue is triggered by the `cp`, but it appeared = to be triggered by `cat`. It also got copy_file_range() support, but = later than `cp`. That is probably why it slipped through testing. This = patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>>>=20 >>>> Mark, could you please try the patch? >>>=20 >>> If all goes well, this will end up reporting that the >>> poudriere bulk -a is still running but has gotten past, >>> say, 320+ port->package builds finished (so: more than >>> double observed so far for the panic context). Later >>> would be a report with a larger figure. A normal run >>> I might let go for 6000+ ports and 10 hr or so. >>>=20 >>> Notes as I go . . . >>>=20 >>> Patch applied, built, and installed to the test media. >>> Also, booted: >>>=20 >>> # uname -apKU >>> FreeBSD amd64-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT amd64 1500000 = #75 main-n265228-c9315099f69e-dirty: Thu Sep 7 13:28:47 PDT 2023 = root@amd64-ZFS:/usr/obj/BUILDs/main-amd64-dbg-clang/usr/main-src/amd64.amd= 64/sys/GENERIC-DBG amd64 amd64 1500000 1500000 >>>=20 >>> Note that this is with a debug kernel (-dbg- in path and -DBG in >>> the GENERIC* name). Also, the vintage of what it is based on has: >>>=20 >>> git: 969071be938c - main - vfs: copy_file_range() between multiple = mountpoints of the same fs type >>>=20 >>> The usual sort of sequencing previously reported to get to this >>> point. Media update starts with the rewind to the checkpoint in >>> hopes of avoiding oddities from the later failure. >>>=20 >>> . . . : >>>=20 >>> [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 414 Failed: 0 Skipped: 39 Ignored: 335 = Fetched: 0 Tobuild: 33800 Time: 00:30:41 >>>=20 >>>=20 >>> So 414 and and still building. >>>=20 >>> More later. (It may be a while.) >>>=20 >>=20 >> [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [parallel_build:] = Queued: 34588 Built: 2013 Failed: 2 Skipped: 179 Ignored: 335 = Fetched: 0 Tobuild: 32059 Time: 01:42:47 >>=20 >> and still going. (FYI: The failures are expected.) >>=20 >> After a while I might stop it and start over with a non-debug >> kernel installed instead. >=20 > I did ^C after 2.5 hr (with 2447 built): >=20 > ^C[02:30:05] Error: Signal SIGINT caught, cleaning up and exiting > [main-amd64-bulk_a-default] [2023-09-08_16h31m51s] [sigint:] Queued: = 34588 Built: 2447 Failed: 5 Skipped: 226 Ignored: 335 Fetched: = 0 Tobuild: 31575 Time: 02:29:59 > [02:30:05] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_1= 6h31m51s > [02:30:05] Cleaning up > [02:38:04] Unmounting file systems > Exiting with status 1 >=20 > I'll switch it over to a non-debug kernel and, probably, world > and setup/run another test. >=20 > . . . (time goes by) . . . >=20 > Hmm. This did not get sent when I wrote the above. FYI, non-debug > test status: >=20 > [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [parallel_build:] = Queued: 34588 Built: 2547 Failed: 5 Skipped: 239 Ignored: 335 = Fetched: 0 Tobuild: 31462 Time: 01:59:58 >=20 > I may let it run overnight. I finally stopped it at 7473 built (a little over 13 hrs elapsed): ^C[13:08:30] Error: Signal SIGINT caught, cleaning up and exiting [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [sigint:] Queued: = 34588 Built: 7473 Failed: 23 Skipped: 798 Ignored: 335 Fetched: = 0 Tobuild: 25959 Time: 13:08:26 [13:08:30] Logs: = /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_1= 9h51m52s [13:08:31] Cleaning up [13:17:10] Unmounting file systems Exiting with status 1 In part that was more evidence for deadlocks at least being fairly rare as well. None of the failed ones looked odd. (A fair portion are because the bulk -a was mostly doing WITH_DEBUG=3D builds. Many upstreams change library names, some other file names, or paths used for debug builds and ports generally do not cover well building the debug builds for such. I've used these runs to extend my list of exceptions that avoid using WITH_DEBUG .) So no evidence of corruptions. (I do not normally do bulk -a builds. The rare bulk -a runs are normally to check that my configuration of a builder machine still works reasonably --beyond building just the few hundred ports that I normally build. So I should be able to build most any combination that I decide to try.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 9 17:04:24 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjfTk03jNz4s54j for ; Sat, 9 Sep 2023 17:04:26 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjfTj6lKBz3NcB; Sat, 9 Sep 2023 17:04:25 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694279065; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4sqPBimgF7c/gI/68jkfgJJCSyqRmiEG8Ikz655hqiI=; b=ifUhlUeeYxZ09Y5/1T5SmfA+Mrw44wTkqVx1Rvnn1+kxYvgLlQJIWYymQAtuwzQ4k06D00 e8VbY+TozvpGSdoMVZIEqe0ngYQv/QIV9G/9bNnXvqUFiW7ilgyg/5/g4FQ631IhFXebdi VU10HcBXGCl+6NDzTVGTR4BRZsTetCVe+Fo7P6ePqJawyFhY8n0Pldb85GclZ6XMaSBEpT zAjIsi8c06oH2n2rmeYch5ApTjp4WpodrfdtVK6yW+y/cD5piAkbVqlHuk1rvD81k21cHd /dOvbSv9PhqdXTqbwXRuulz2BN7nek4oYtGuHUk7qaZ+SlW+QZqwoDSFhxmblQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694279065; a=rsa-sha256; cv=none; b=ZfUEMLnJirL5kBtH/8MJPPRdFMa74Km5CjVlqy4Pm5HNCQNVcori9n7OjOL/n9l0SMT0PG NAbi2eepT68aTG4cZ0e4Jn7WON7M8ZZvD4x1AuyF1NGZwzig19LzIT+SjBm2MoKwZVyU8e cx5hbZUbjUY8g+lPJJU476BHYoMKsNg3LofkkYI3LLr+YSAG+afH5hHxHsKsfRXuiAUzgh UtRlT0b77T68+T1kMpdcTjnBdVaOWoZhDUYpyeez2ku97tvXE/xDUAeBEX+Y0l8HZgs6lN LwdKDIak5tmziKhrFkrToaM4G50MbL+pwvSEne5QS5/NzpcDvtK14cmqUuKyBg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694279065; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4sqPBimgF7c/gI/68jkfgJJCSyqRmiEG8Ikz655hqiI=; b=ivz8NkQIlpkh+By9SDRzrpwBWVD2R2smotBMpODVVi/PvtRs5ecSGP5ZuOH2rJ3ozlecnt 64Astb9xIA39hIXMSu7yvKWi8JJqvy6eMoMuMgoIwCAgafckIYcGBTbkZOCHXmRN0NV6J5 yNHNri1O3NMXxCWErTPTraNfiojr0qqGVsL/InbrkAHwTFTE2cmWZtsF18ijg+ZnrsB8tq 0YE8aUsd6wnRVQpBzsjoZOa2X1WGyQ1OtV078UxS9F25CRQdrpF1L2pV1w3abYIouds6AZ 2c+2gEjhknf4NLvLjb+O3JQE8zjRSlqIGxRc0Bx2vYkkUFG01SMCgBwM6TvmXQ== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RjfTj4xMSz19Ns; Sat, 9 Sep 2023 17:04:25 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 248BF4E2E2; Sat, 9 Sep 2023 19:04:24 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Rainer Hurling Cc: current Subject: Re: 15.0-CURRENT build broken in lib/libmagic In-Reply-To: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> (Rainer Hurling's message of "Sat, 9 Sep 2023 13:52:18 +0200") References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Sat, 09 Sep 2023 19:04:24 +0200 Message-ID: <86il8jqnvr.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Rainer Hurling writes: > If I try to build world from todays c1b26df2972d with 15.0-CURRENT > (main-n265063-e0752f431b01), it aborts with an error. Either update your source tree or apply aca3bd160257, then build and install libc before attempting buildworld. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sat Sep 9 17:12:29 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjfg31MNBz4s9RW for ; Sat, 9 Sep 2023 17:12:31 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjfg30wgJz3RBk; Sat, 9 Sep 2023 17:12:31 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694279551; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HaicSsxF0rAuGtZTs2agIHTsEwPu7w5Gs/PsguLTLlo=; b=FXhw7bLzyOB3dwxQrkTjCcxFAscgsQ1FUQKg97rX2qzHKryCMqqzElC+t9lLP1ue2YOIKx R01arrWJoIr6hYWbb207IHCvSffGDYy255xhld4+mCMTr3NlbZWSiGrSew3mXNV/YeOX8M jr3Z5DyOoiIyhwNKMHWo2+Hz78Sow4bgdsQqpXw74EpdO56AN7opD7uDbH3DlCmGDDRm4a 1UWZ0YCeJrWSydD8p2/H/v7gY0clmwmEqcpY4iTJeX2P7FpVf7EA8fqdYYnt8CY7Fk73Ei Gl8rAGDkFlgE5TeLb2Jsm7ADyc7o39oQO7Mr39XOywrpzhQB+1mWgMKQXpb71w== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694279551; a=rsa-sha256; cv=none; b=bVMuz6NP8m2MXFMj52/mdiy4gq2MPy8uXfUx1jEcurjr0qP+89ml+gVcGnhJSa59VL9OiA SQO92XgJx6Qv9QOGvUIrPcLwtiOPb6qKDsjwXX7rp+mIU7DyzmanxrfXKSsJbRfQVF/SJa J2dukfy4mdHABzwagLGwAL1e2t12/XB1IotMN1TgbPFNuF3pripgGBW4DHVi6uBDMwRoBI kC5Od26mTmsPX4JeiGGCmF2vQxrio5NwXG7Eu1ljM+KxrjCadfXOwSRRp8pr/ElpRh6JRh V3pLZYik3uLPXjM6UkauoEVAxIQb22+PDbvvJUGkQ7VDcNtk/fhPXmnx/JoKJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694279551; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HaicSsxF0rAuGtZTs2agIHTsEwPu7w5Gs/PsguLTLlo=; b=rtE4zho4xE0DDgSqIqHvgJRwpdt45hvNAQaJay8MS4bTXZld3QTz7o2Bzat3Haa45hTYjS VwB0F7NhcjeUDQrW43tTGXeQIctkyYQjS3sFniiPjdPa9lFFtg9vX3nqOH2nDrRJjMWvWq proJsa+4I6Gko6vcLdhhgwooGFbrkrvdKUSrpp6NOJSl22RZZtJH1+BeEiawdp/TafQDS5 odDwFLylF5ihkyThcYVA65dJQpnGo6McN4294lthvp+xKzcV6bXIwSYjMOiuupm5vfxG5c KyNvBfSp6B6EP4A1y59RN9Wai8JlchNEuTKrVyZIeKc+AZ9Gkek8pBjHtWikSA== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rjfg26NQpz1Blv; Sat, 9 Sep 2023 17:12:30 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 68DFD4E850; Sat, 9 Sep 2023 19:12:29 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Antoine Brodin Cc: Yuri , current , Robert Clausecker Subject: Re: sed in CURRENT fails in textproc/jq In-Reply-To: (Antoine Brodin's message of "Sat, 9 Sep 2023 07:01:56 +0000") References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Sat, 09 Sep 2023 19:12:29 +0200 Message-ID: <86edj7qnia.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Antoine Brodin writes: > Yuri writes: > > Either something has changed in sed(1) in CURRENT, or sed just fails > > during the configure stage of textproc/jq: > > > > sed: No error: 0 > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > This seems to be a recent issue (less than 5 days). > Hundreds of configure scripts now fail to run on 15-current due to > this sed failure: [...] Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of these. If that helps, yell at fuz@ :) DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sat Sep 9 17:44:19 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjgMw2gQFz4sWdW for ; Sat, 9 Sep 2023 17:44:28 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Received: from xmailer.gwdg.de (xmailer.gwdg.de [134.76.10.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjgMv6Bhnz3dJ5; Sat, 9 Sep 2023 17:44:27 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Authentication-Results: mx1.freebsd.org; none Received: from excmbx-12.um.gwdg.de ([134.76.9.221] helo=email.gwdg.de) by mailer.gwdg.de with esmtp (GWDG Mailer) (envelope-from ) id 1qf20Q-0001Fb-1Y; Sat, 09 Sep 2023 19:44:26 +0200 Received: from MBX19-GWD-03.um.gwdg.de (10.108.142.56) by EXCMBX-12.um.gwdg.de (134.76.9.221) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.2507.32; Sat, 9 Sep 2023 19:44:25 +0200 Received: from [192.168.178.23] (10.250.9.199) by MBX19-GWD-03.um.gwdg.de (10.108.142.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.1258.25; Sat, 9 Sep 2023 19:44:25 +0200 Message-ID: <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> Date: Sat, 9 Sep 2023 19:44:19 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: 15.0-CURRENT build broken in lib/libmagic To: =?UTF-8?Q?Dag-Erling_Sm=c3=b8rgrav?= CC: current References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> <86il8jqnvr.fsf@ltc.des.no> Content-Language: en-US Reply-To: Rainer Hurling From: Rainer Hurling In-Reply-To: <86il8jqnvr.fsf@ltc.des.no> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [10.250.9.199] X-ClientProxiedBy: excmbx-11.um.gwdg.de (134.76.9.220) To MBX19-GWD-03.um.gwdg.de (10.108.142.56) X-Virus-Scanned: (clean) by clamav X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:207592, ipnet:134.76.0.0/16, country:DE] X-Rspamd-Queue-Id: 4RjgMv6Bhnz3dJ5 Am 09.09.23 um 19:04 schrieb Dag-Erling Smørgrav: > Rainer Hurling writes: >> If I try to build world from todays c1b26df2972d with 15.0-CURRENT >> (main-n265063-e0752f431b01), it aborts with an error. > > Either update your source tree or apply aca3bd160257, then build and > install libc before attempting buildworld. > > DES Hi Dag-Erling, Many thanks for your answer and the tip with libc! Source tree was updated already to c1b26df2972d, so aca3bd160257 is already included. I checked for its contents. After removing /usr/obj and 'make cleanworld', I tried to build libc like the following, but it fails: cd /usr/src/lib/libc make [..] building shared library libc.so.7 cc -nodefaultlibs -Wl,-zrelro -Wl,--version-script=Version.map -Wl,-znoexecstack -shared -Wl,-x -Wl,--fatal-warnings -Wl,--warn-shared-textrel -o libc.so.7.full -Wl,-soname,libc.so.7 machdep_ldisx.pico libc_start1.pico bt_close.pico bt_conv.pico bt_debug.pico bt_delete.pico bt_get.pico bt_open.pico bt_overflow.pico bt_page.pico bt_put.pico bt_search.pico bt_seq.pico bt_split.pico bt_utils.pico db.pico hash.pico hash_bigkey.pico hash_buf.pico hash_func.pico hash_log2.pico hash_page.pico ndbm.pico mpool.pico mpool-compat.pico rec_close.pico rec_delete.pico rec_get.pico rec_open.pico rec_put.pico rec_search.pico rec_seq.pico rec_utils.pico creat.pico gethostid.pico getwd.pico killpg.pico sethostid.pico setpgrp.pico setrgid.pico setruid.pico sigcompat.pico __getosreldate.pico __pthread_mutex_init_calloc_cb_stub.pico __xuname.pico _once_stub.pico _pthread_stubs.pico _rand48.pico _spinlock_stub.pico _thread_init.pico alarm.pico arc4random.pico arc4random-compat.pico arc4random_uniform.pico assert.pico auxv.pico basename.pico basename_compat.pico cap_sandboxed.pico check_utility_compat.pico clock.pico clock_getcpuclockid.pico closedir.pico confstr.pico cpuset_alloc.pico cpuset_free.pico crypt.pico ctermid.pico daemon.pico devname.pico devname-compat11.pico dirfd.pico dirname.pico dirname_compat.pico disklabel.pico dlfcn.pico drand48.pico dup3.pico elf_utils.pico erand48.pico err.pico errlst.pico errno.pico eventfd.pico exec.pico exect.pico fdevname.pico feature_present.pico fmtcheck.pico fmtmsg.pico fnmatch.pico fpclassify.pico frexp.pico fstab.pico ftok.pico fts.pico fts-compat.pico fts-compat11.pico ftw.pico ftw-compat11.pico getbootfile.pico getbsize.pico getcap.pico getcwd.pico getdomainname.pico getentropy.pico getgrent.pico getgrouplist.pico gethostname.pico getloadavg.pico getlogin.pico getmntinfo.pico getmntinfo-compat11.pico getnetgrent.pico getosreldate.pico getpagesize.pico getpagesizes.pico getpeereid.pico getprogname.pico getpwent.pico getttyent.pico getusershell.pico getutxent.pico getvfsbyname.pico glob.pico glob-compat11.pico initgroups.pico isatty.pico isinf.pico isnan.pico jrand48.pico kqueue1.pico lcong48.pico libc_dlopen.pico lockf.pico lrand48.pico memalign.pico mrand48.pico nftw.pico nftw-compat11.pico nice.pico nlist.pico nrand48.pico opendir.pico pause.pico pmadvise.pico popen.pico posix_spawn.pico psignal.pico pututxline.pico pw_scan.pico raise.pico readdir.pico readdir-compat11.pico readpassphrase.pico recvmmsg.pico rewinddir.pico scandir.pico scandir_b.pico scandir-compat11.pico sched_getaffinity.pico sched_setaffinity.pico seed48.pico seekdir.pico semctl.pico sendmmsg.pico setdomainname.pico sethostname.pico setjmperr.pico setmode.pico setproctitle.pico setprogname.pico siginterrupt.pico siglist.pico signal.pico sigsetops.pico sleep.pico srand48.pico statvfs.pico stringlist.pico strtofflags.pico sysconf.pico sysctl.pico sysctlbyname.pico sysctlnametomib.pico syslog.pico telldir.pico termios.pico time.pico times.pico timespec_get.pico timespec_getres.pico timezone.pico tls.pico ttyname.pico ttyslot.pico ualarm.pico ulimit.pico uname.pico unvis-compat.pico usleep.pico utime.pico utxdb.pico valloc.pico wait.pico wait3.pico waitpid.pico waitid.pico wordexp.pico pwcache.pico unvis.pico vis.pico cancelpoints_sem.pico cancelpoints_sem_new.pico _setjmp.pico rfork_thread.pico setjmp.pico sigsetjmp.pico fabs.pico infinity.pico ldexp.pico makecontext.pico signalcontext.pico flt_rounds.pico fpgetmask.pico fpsetmask.pico fpgetprec.pico fpsetprec.pico fpgetround.pico fpsetround.pico fpgetsticky.pico gmon.pico mcount.pico citrus_bcs.pico citrus_bcs_strtol.pico citrus_bcs_strtoul.pico citrus_csmapper.pico citrus_db.pico citrus_db_factory.pico citrus_db_hash.pico citrus_esdb.pico citrus_hash.pico citrus_iconv.pico citrus_lookup.pico citrus_lookup_factory.pico citrus_mapper.pico citrus_memstream.pico citrus_mmap.pico citrus_module.pico citrus_none.pico citrus_pivot_factory.pico citrus_prop.pico citrus_stdenc.pico bsd_iconv.pico iconv_compat.pico inet_addr.pico inet_cidr_ntop.pico inet_cidr_pton.pico inet_lnaof.pico inet_makeaddr.pico inet_net_ntop.pico inet_net_pton.pico inet_neta.pico inet_netof.pico inet_network.pico inet_ntoa.pico inet_ntop.pico inet_pton.pico nsap_addr.pico ev_streams.pico ev_timers.pico ascii.pico big5.pico btowc.pico collate.pico collcmp.pico euc.pico fix_grouping.pico gb18030.pico gb2312.pico gbk.pico ctype.pico isctype.pico iswctype.pico ldpart.pico lmessages.pico lmonetary.pico lnumeric.pico localeconv.pico mblen.pico mbrlen.pico mbrtowc.pico mbsinit.pico mbsnrtowcs.pico mbsrtowcs.pico mbtowc.pico mbstowcs.pico mskanji.pico nextwctype.pico nl_langinfo.pico nomacros.pico none.pico rpmatch.pico rune.pico runetype.pico setlocale.pico setrunelocale.pico table.pico tolower.pico toupper.pico utf8.pico wcrtomb.pico wcsnrtombs.pico wcsrtombs.pico wcsftime.pico wcstof.pico wcstod.pico wcstoimax.pico wcstol.pico wcstold.pico wcstoll.pico wcstombs.pico wcstoul.pico wcstoull.pico wcstoumax.pico wctob.pico wctomb.pico wctrans.pico wctype.pico wcwidth.pico xlocale.pico c16rtomb_iconv.pico c32rtomb_iconv.pico mbrtoc16_iconv.pico mbrtoc32_iconv.pico md5c.pico ns_name.pico ns_netint.pico ns_parse.pico ns_print.pico ns_samedomain.pico ns_ttl.pico base64.pico ether_addr.pico eui64.pico gai_strerror.pico getaddrinfo.pico gethostbydns.pico gethostbyht.pico gethostbynis.pico gethostnamadr.pico getifaddrs.pico getifmaddrs.pico getnameinfo.pico getnetbydns.pico getnetbyht.pico getnetbynis.pico getnetnamadr.pico getproto.pico getprotoent.pico getprotoname.pico getservent.pico if_indextoname.pico if_nameindex.pico if_nametoindex.pico ip6opt.pico linkaddr.pico map_v4v6.pico name6.pico ntoh.pico nsdispatch.pico nslexer.pico nsparser.pico nss_compat.pico rcmd.pico rcmdsh.pico recv.pico rthdr.pico sctp_sys_calls.pico send.pico sockatmark.pico sourcefilter.pico vars.pico nscache.pico nscachedcli.pico msgcat.pico acl_branding.pico acl_calc_mask.pico acl_cmp_np.pico acl_compat.pico acl_copy.pico acl_delete.pico acl_delete_entry.pico acl_entry.pico acl_equiv_mode_np.pico acl_extended_file_np.pico acl_flag.pico acl_free.pico acl_from_mode_np.pico acl_from_text.pico acl_from_text_nfs4.pico acl_get.pico acl_id_to_name.pico acl_init.pico acl_perm.pico acl_set.pico acl_strip.pico acl_support.pico acl_support_nfs4.pico acl_to_text.pico acl_to_text_nfs4.pico acl_valid.pico extattr.pico mac.pico mac_exec.pico mac_get.pico mac_set.pico subr_acl_nfs4.pico regcomp.pico regerror.pico regexec.pico regfree.pico herror.pico h_errno.pico mtctxres.pico res_comp.pico res_data.pico res_debug.pico res_findzonecut.pico res_init.pico res_mkquery.pico res_mkupdate.pico res_query.pico res_send.pico res_state.pico res_update.pico _flock_stub.pico asprintf.pico clrerr.pico dprintf.pico fclose.pico fcloseall.pico fdopen.pico feof.pico ferror.pico fflush.pico fgetc.pico fgetln.pico fgetpos.pico fgets.pico fgetwc.pico fgetwln.pico fgetws.pico fileno.pico findfp.pico flags.pico fmemopen.pico fopen.pico fopencookie.pico fprintf.pico fpurge.pico fputc.pico fputs.pico fputwc.pico fputws.pico fread.pico freopen.pico fscanf.pico fseek.pico fsetpos.pico ftell.pico funopen.pico fvwrite.pico fwalk.pico fwide.pico fwprintf.pico fwscanf.pico fwrite.pico getc.pico getchar.pico getdelim.pico getline.pico gets.pico gets_s.pico getw.pico getwc.pico getwchar.pico makebuf.pico mktemp.pico open_memstream.pico open_wmemstream.pico perror.pico printf.pico printf-pos.pico putc.pico putchar.pico puts.pico putw.pico putwc.pico putwchar.pico refill.pico remove.pico rewind.pico rget.pico scanf.pico setbuf.pico setbuffer.pico setvbuf.pico snprintf.pico sprintf.pico sscanf.pico stdio.pico swprintf.pico swscanf.pico tempnam.pico tmpfile.pico tmpnam.pico ungetc.pico ungetwc.pico vasprintf.pico vdprintf.pico vfprintf.pico vfscanf.pico vfwprintf.pico vfwscanf.pico vprintf.pico vscanf.pico vsnprintf.pico vsprintf.pico vsscanf.pico vswprintf.pico vswscanf.pico vwprintf.pico vwscanf.pico wbuf.pico wprintf.pico wscanf.pico wsetup.pico xprintf.pico xprintf_float.pico xprintf_int.pico xprintf_str.pico xprintf_errno.pico xprintf_hexdump.pico xprintf_quote.pico xprintf_time.pico xprintf_vis.pico asctime.pico difftime.pico localtime.pico strftime.pico strptime.pico timelocal.pico time32.pico amd64_get_fsbase.pico amd64_get_gsbase.pico amd64_set_fsbase.pico amd64_set_gsbase.pico clock_gettime.pico gettimeofday.pico __vdso_gettimeofday.pico __error.pico interposing_table.pico getdents.pico lstat.pico mknod.pico stat.pico fstat.pico fstatat.pico fstatfs.pico getfsstat.pico statfs.pico getdirentries.pico brk.pico closefrom.pico pipe.pico shm_open.pico vadvise.pico POSIX2x_Fork.pico compat-stub.pico accept.pico accept4.pico aio_suspend.pico clock_nanosleep.pico close.pico connect.pico fcntl.pico fdatasync.pico fsync.pico fork.pico kevent.pico msync.pico nanosleep.pico open.pico openat.pico pdfork.pico poll.pico ppoll.pico pselect.pico ptrace.pico read.pico readv.pico recvfrom.pico recvmsg.pico select.pico sendmsg.pico sendto.pico setcontext.pico sigaction.pico sigprocmask.pico sigsuspend.pico sigtimedwait.pico sigwait.pico sigwaitinfo.pico swapcontext.pico wait4.pico wait6.pico write.pico writev.pico vfork.pico cerror.pico getcontext.pico syscall.pico link.pico unlink.pico chdir.pico fchdir.pico freebsd11_mknod.pico chmod.pico chown.pico break.pico getpid.pico mount.pico unmount.pico setuid.pico getuid.pico geteuid.pico getpeername.pico getsockname.pico access.pico chflags.pico fchflags.pico sync.pico kill.pico getppid.pico dup.pico freebsd10_pipe.pico getegid.pico profil.pico ktrace.pico getgid.pico setlogin.pico acct.pico sigaltstack.pico ioctl.pico reboot.pico revoke.pico symlink.pico readlink.pico execve.pico umask.pico chroot.pico freebsd11_vadvise.pico munmap.pico mprotect.pico madvise.pico mincore.pico getgroups.pico setgroups.pico getpgrp.pico setpgid.pico setitimer.pico swapon.pico getitimer.pico getdtablesize.pico dup2.pico setpriority.pico socket.pico getpriority.pico bind.pico setsockopt.pico listen.pico getrusage.pico getsockopt.pico settimeofday.pico fchown.pico fchmod.pico setreuid.pico setregid.pico rename.pico flock.pico mkfifo.pico shutdown.pico socketpair.pico mkdir.pico rmdir.pico utimes.pico adjtime.pico setsid.pico quotactl.pico nlm_syscall.pico nfssvc.pico lgetfh.pico getfh.pico sysarch.pico rtprio.pico semsys.pico msgsys.pico shmsys.pico setfib.pico ntp_adjtime.pico setgid.pico setegid.pico seteuid.pico freebsd11_stat.pico freebsd11_fstat.pico freebsd11_lstat.pico pathconf.pico fpathconf.pico getrlimit.pico setrlimit.pico freebsd11_getdirentries.pico __syscall.pico __sysctl.pico mlock.pico munlock.pico undelete.pico futimes.pico getpgid.pico freebsd7___semctl.pico semget.pico semop.pico freebsd7_msgctl.pico msgget.pico msgsnd.pico msgrcv.pico shmat.pico freebsd7_shmctl.pico shmdt.pico shmget.pico clock_settime.pico clock_getres.pico ktimer_create.pico ktimer_delete.pico ktimer_settime.pico ktimer_gettime.pico ktimer_getoverrun.pico ffclock_getcounter.pico ffclock_setestimate.pico ffclock_getestimate.pico clock_getcpuclockid2.pico ntp_gettime.pico minherit.pico rfork.pico issetugid.pico lchown.pico aio_read.pico aio_write.pico lio_listio.pico freebsd11_getdents.pico lchmod.pico lutimes.pico freebsd11_nstat.pico freebsd11_nfstat.pico freebsd11_nlstat.pico preadv.pico pwritev.pico fhopen.pico freebsd11_fhstat.pico modnext.pico modstat.pico modfnext.pico modfind.pico kldload.pico kldunload.pico kldfind.pico kldnext.pico kldstat.pico kldfirstmod.pico getsid.pico setresuid.pico setresgid.pico aio_return.pico aio_cancel.pico aio_error.pico mlockall.pico munlockall.pico __getcwd.pico sched_setparam.pico sched_getparam.pico sched_setscheduler.pico sched_getscheduler.pico sched_yield.pico sched_get_priority_max.pico sched_get_priority_min.pico sched_rr_get_interval.pico utrace.pico kldsym.pico jail.pico nnpfs_syscall.pico sigpending.pico __acl_get_file.pico __acl_set_file.pico __acl_get_fd.pico __acl_set_fd.pico __acl_delete_file.pico __acl_delete_fd.pico __acl_aclcheck_file.pico __acl_aclcheck_fd.pico extattrctl.pico extattr_set_file.pico extattr_get_file.pico extattr_delete_file.pico aio_waitcomplete.pico getresuid.pico getresgid.pico kqueue.pico freebsd11_kevent.pico extattr_set_fd.pico extattr_get_fd.pico extattr_delete_fd.pico __setugid.pico eaccess.pico afs3_syscall.pico nmount.pico __mac_get_proc.pico __mac_set_proc.pico __mac_get_fd.pico __mac_get_file.pico __mac_set_fd.pico __mac_set_file.pico kenv.pico lchflags.pico uuidgen.pico sendfile.pico mac_syscall.pico freebsd11_getfsstat.pico freebsd11_statfs.pico freebsd11_fstatfs.pico freebsd11_fhstatfs.pico ksem_close.pico ksem_post.pico ksem_wait.pico ksem_trywait.pico ksem_init.pico ksem_open.pico ksem_unlink.pico ksem_getvalue.pico ksem_destroy.pico __mac_get_pid.pico __mac_get_link.pico __mac_set_link.pico extattr_set_link.pico extattr_get_link.pico extattr_delete_link.pico __mac_execve.pico sigreturn.pico freebsd13_swapoff.pico __acl_get_link.pico __acl_set_link.pico __acl_delete_link.pico __acl_aclcheck_link.pico thr_create.pico thr_exit.pico thr_self.pico thr_kill.pico freebsd10__umtx_lock.pico freebsd10__umtx_unlock.pico jail_attach.pico extattr_list_fd.pico extattr_list_file.pico extattr_list_link.pico ksem_timedwait.pico thr_suspend.pico thr_wake.pico kldunloadf.pico audit.pico auditon.pico getauid.pico setauid.pico getaudit.pico setaudit.pico getaudit_addr.pico setaudit_addr.pico auditctl.pico _umtx_op.pico thr_new.pico sigqueue.pico kmq_open.pico kmq_setattr.pico kmq_timedreceive.pico kmq_timedsend.pico kmq_notify.pico kmq_unlink.pico abort2.pico thr_set_name.pico aio_fsync.pico rtprio_thread.pico sctp_peeloff.pico sctp_generic_sendmsg.pico sctp_generic_sendmsg_iov.pico sctp_generic_recvmsg.pico pread.pico pwrite.pico mmap.pico lseek.pico truncate.pico ftruncate.pico thr_kill2.pico freebsd12_shm_open.pico shm_unlink.pico cpuset.pico cpuset_setid.pico cpuset_getid.pico cpuset_getaffinity.pico cpuset_setaffinity.pico faccessat.pico fchmodat.pico fchownat.pico fexecve.pico freebsd11_fstatat.pico futimesat.pico linkat.pico mkdirat.pico mkfifoat.pico freebsd11_mknodat.pico readlinkat.pico renameat.pico symlinkat.pico unlinkat.pico posix_openpt.pico gssd_syscall.pico jail_get.pico jail_set.pico jail_remove.pico freebsd12_closefrom.pico __semctl.pico msgctl.pico shmctl.pico lpathconf.pico __cap_rights_get.pico cap_enter.pico cap_getmode.pico pdkill.pico pdgetpid.pico getloginclass.pico setloginclass.pico rctl_get_racct.pico rctl_get_rules.pico rctl_get_limits.pico rctl_add_rule.pico rctl_remove_rule.pico posix_fallocate.pico posix_fadvise.pico cap_rights_limit.pico cap_ioctls_limit.pico cap_ioctls_get.pico cap_fcntls_limit.pico cap_fcntls_get.pico bindat.pico connectat.pico chflagsat.pico pipe2.pico aio_mlock.pico procctl.pico futimens.pico utimensat.pico fhstat.pico fhstatfs.pico mknodat.pico cpuset_getdomain.pico cpuset_setdomain.pico getrandom.pico getfhat.pico fhlink.pico fhlinkat.pico fhreadlink.pico funlinkat.pico copy_file_range.pico __sysctlbyname.pico shm_open2.pico shm_rename.pico sigfastblock.pico __realpathat.pico close_range.pico rpctls_syscall.pico __specialfd.pico aio_writev.pico aio_readv.pico fspacectl.pico swapoff.pico kqueuex.pico membarrier.pico timerfd_create.pico timerfd_gettime.pico timerfd_settime.pico _exit.pico _getlogin.pico _clock_gettime.pico _gettimeofday.pico _sched_getcpu.pico _fstat.pico _fstatat.pico _fstatfs.pico _getfsstat.pico _statfs.pico _getdirentries.pico _accept.pico _accept4.pico _aio_suspend.pico _clock_nanosleep.pico _close.pico _connect.pico _fcntl.pico _fdatasync.pico _fsync.pico _fork.pico _kevent.pico _msync.pico _nanosleep.pico _open.pico _openat.pico _pdfork.pico _poll.pico _ppoll.pico _pselect.pico _ptrace.pico _read.pico _readv.pico _recvfrom.pico _recvmsg.pico _select.pico _sendmsg.pico _sendto.pico _setcontext.pico _sigaction.pico _sigprocmask.pico _sigsuspend.pico _sigtimedwait.pico _sigwait.pico _sigwaitinfo.pico _swapcontext.pico _wait4.pico _wait6.pico _write.pico _writev.pico stack_protector.pico stack_protector_compat.pico auth_none.pico auth_unix.pico authunix_prot.pico bindresvport.pico clnt_bcast.pico clnt_dg.pico clnt_generic.pico clnt_perror.pico clnt_raw.pico clnt_simple.pico clnt_vc.pico rpc_dtablesize.pico getnetconfig.pico getnetpath.pico getrpcent.pico getrpcport.pico mt_misc.pico pmap_clnt.pico pmap_getmaps.pico pmap_getport.pico pmap_prot.pico pmap_prot2.pico pmap_rmt.pico rpc_prot.pico rpc_commondata.pico rpc_callmsg.pico rpc_generic.pico rpc_soc.pico rpcb_clnt.pico rpcb_prot.pico rpcb_st_xdr.pico rpcsec_gss_stub.pico svc.pico svc_auth.pico svc_dg.pico svc_auth_unix.pico svc_generic.pico svc_raw.pico svc_run.pico svc_simple.pico svc_vc.pico auth_time.pico auth_des.pico authdes_prot.pico des_crypt.pico des_soft.pico crypt_client.pico key_call.pico key_prot_xdr.pico getpublickey.pico svc_auth_des.pico netname.pico netnamer.pico rpcdname.pico rtime.pico crypt_clnt.pico crypt_xdr.pico uuid_compare.pico uuid_create.pico uuid_create_nil.pico uuid_equal.pico uuid_from_string.pico uuid_hash.pico uuid_is_nil.pico uuid_stream.pico uuid_to_string.pico xdr.pico xdr_array.pico xdr_float.pico xdr_mem.pico xdr_rec.pico xdr_reference.pico xdr_sizeof.pico xdr_stdio.pico __vdso_gettc.pico pkru.pico sched_getcpu_x86.pico getcontextx.pico xdryp.pico yp_xdr.pico yplib.pico subr_capability.pico div.pico ldiv.pico lldiv.pico amd64_archlevel.pico bcmp.pico memchr.pico memcmp.pico memcpy.pico memmove.pico memset.pico stpcpy.pico strcat.pico strchrnul.pico strcmp.pico strcpy.pico strcspn.pico strlen.pico strnlen.pico strspn.pico _hdtoa.pico _hldtoa.pico _ldtoa.pico glue.pico gdtoa_strtorx.pico gdtoa_dmisc.pico gdtoa_dtoa.pico gdtoa_gdtoa.pico gdtoa_gethex.pico gdtoa_gmisc.pico gdtoa_hd_init.pico gdtoa_hexnan.pico gdtoa_misc.pico gdtoa_smisc.pico gdtoa_strtod.pico gdtoa_strtodg.pico gdtoa_strtof.pico gdtoa_strtord.pico gdtoa_sum.pico gdtoa_ulp.pico modf.pico C99_Exit.pico a64l.pico abort.pico abs.pico atexit.pico atof.pico atoi.pico atol.pico atoll.pico bsearch.pico cxa_thread_atexit.pico cxa_thread_atexit_impl.pico exit.pico getenv.pico getopt.pico getopt_long.pico getsubopt.pico hcreate.pico hcreate_r.pico hdestroy_r.pico heapsort.pico heapsort_b.pico hsearch_r.pico imaxabs.pico imaxdiv.pico insque.pico l64a.pico labs.pico llabs.pico lsearch.pico merge.pico mergesort_b.pico ptsname.pico qsort.pico qsort_r.pico qsort_r_compat.pico qsort_s.pico quick_exit.pico radixsort.pico rand.pico random.pico reallocarray.pico reallocf.pico realpath.pico remque.pico set_constraint_handler_s.pico strfmon.pico strtoimax.pico strtol.pico strtold.pico strtoll.pico strtoq.pico strtoul.pico strtonum.pico strtoull.pico strtoumax.pico strtouq.pico system.pico tdelete.pico tfind.pico tsearch.pico twalk.pico jemalloc_jemalloc.pico jemalloc_arena.pico jemalloc_background_thread.pico jemalloc_base.pico jemalloc_bin.pico jemalloc_bitmap.pico jemalloc_ckh.pico jemalloc_ctl.pico jemalloc_div.pico jemalloc_extent.pico jemalloc_extent_dss.pico jemalloc_extent_mmap.pico jemalloc_hash.pico jemalloc_hook.pico jemalloc_large.pico jemalloc_log.pico jemalloc_malloc_io.pico jemalloc_mutex.pico jemalloc_mutex_pool.pico jemalloc_nstime.pico jemalloc_pages.pico jemalloc_prng.pico jemalloc_prof.pico jemalloc_rtree.pico jemalloc_safety_check.pico jemalloc_sc.pico jemalloc_stats.pico jemalloc_sz.pico jemalloc_tcache.pico jemalloc_test_hooks.pico jemalloc_ticker.pico jemalloc_tsd.pico jemalloc_witness.pico bcopy.pico bzero.pico explicit_bzero.pico ffs.pico ffsl.pico ffsll.pico fls.pico flsl.pico flsll.pico memccpy.pico memrchr.pico memmem.pico mempcpy.pico memset_s.pico stpncpy.pico strcasecmp.pico strcasestr.pico strchr.pico strcoll.pico strdup.pico strerror.pico strlcat.pico strlcpy.pico strmode.pico strncat.pico strncmp.pico strncpy.pico strndup.pico strnstr.pico strpbrk.pico strrchr.pico strsep.pico strsignal.pico strstr.pico strtok.pico strverscmp.pico strxfrm.pico swab.pico timingsafe_bcmp.pico timingsafe_memcmp.pico wcpcpy.pico wcpncpy.pico wcscasecmp.pico wcscat.pico wcschr.pico wcscmp.pico wcscoll.pico wcscpy.pico wcscspn.pico wcsdup.pico wcslcat.pico wcslcpy.pico wcslen.pico wcsncasecmp.pico wcsncat.pico wcsncmp.pico wcsncpy.pico wcsnlen.pico wcspbrk.pico wcsrchr.pico wcsspn.pico wcsstr.pico wcstok.pico wcswidth.pico wcsxfrm.pico wmemchr.pico wmemcmp.pico wmemcpy.pico wmemmove.pico wmempcpy.pico wmemset.pico -L/usr/obj/usr/src/amd64.amd64/lib/libcompiler_rt -lcompiler_rt ld: error: version script assignment of 'FBSD_1.0' to symbol 'mpool_stat' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'mexitcount' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hesiod_init' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hesiod_end' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hesiod_to_bind' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hesiod_resolve' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hesiod_free_list' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hes_init' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hes_to_bind' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hes_resolve' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hes_error' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol 'hes_free' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol '_nsdbtdump' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.0' to symbol '__sF' failed: symbol not defined ld: error: version script assignment of 'FBSD_1.4' to symbol 'bsearch_b' failed: symbol not defined ld: error: version script assignment of 'FBSDprivate_1.0' to symbol '_citrus_bcs_isalnum' failed: symbol not defined ld: error: version script assignment of 'FBSDprivate_1.0' to symbol '_citrus_bcs_isalpha' failed: symbol not defined ld: error: version script assignment of 'FBSDprivate_1.0' to symbol '_citrus_bcs_isblank' failed: symbol not defined ld: error: version script assignment of 'FBSDprivate_1.0' to symbol '_citrus_bcs_isdigit' failed: symbol not defined ld: error: version script assignment of 'FBSDprivate_1.0' to symbol '_citrus_bcs_iseol' failed: symbol not defined ld: error: too many errors emitted, stopping now (use --error-limit=0 to see all errors) cc: error: linker command failed with exit code 1 (use -v to see invocation) *** Error code 1 Hmm, don't know how to proceed :( Regards, Rainer From nobody Sat Sep 9 18:28:41 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjhLz4tT1z4sG5C for ; Sat, 9 Sep 2023 18:28:43 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjhLz4MWNz4Nr0; Sat, 9 Sep 2023 18:28:43 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694284123; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=I31GDMDtm3XiM58GARrhRrjE8pdGQGu5we1CzGdBr5g=; b=Gpc5N/ruYRK/NzOhy0JsJzXqIK2XGolAzmm9wKOYbsTpBBV/lbNbShsKGreVaKqBfrSYO5 FD1Ll3b4UIG37hA39OLfH1TcPDPAj6KOsJ+jzellFbdN2ePfrL15aC0y6diHC8T8LeEOku sRnRrK1EAj3MjQpMwWwzHVd5X1nH2kwEgwijf6Bi7iCISe/FPG5oGQKVbMFTvB45KZkD4V IMAJ/uprTAC/OJRg8AEtcfCvWCsR2RYS77bTsEnOvICZgKM2DjDandMAKynUV9yZu5cBc2 hbJN7BzXC50k7NICLLXpl3AKUVvzqLLCkXCTZNfgn1/Oqv7wpKYkvRzN4u3Sdw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694284123; a=rsa-sha256; cv=none; b=d/9TnI1MNmxBjYB4JQAPMkreMAuD2OTjldx6HOpErUcgcJMOS5KBeuIcBK3LeghZs7+D0p /nRk1S9XCaC3f/Cnv98ZWGGFTHMvSlQ2zhR1d7WwvahINrNz67xXgrEk+m1+OmHs0JutWg 0RVMEjMjEnXk6vFD7LYVwdPVS2HxR9jIYDEwCNFDm7C3SeZ7TUikJzAxKLVBiteFvPk9hJ QH1//WazsALR9/46ij2cwQ7O7unxaRykQ3vX1cCctzA3JTS18kLi1i7GibCbJxTOn70/WI /Ak/X10aALKFlUtSp4GqoeniTScPpBmP2vrqzOQjXze24saWV91jTDs4pDkISg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694284123; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=I31GDMDtm3XiM58GARrhRrjE8pdGQGu5we1CzGdBr5g=; b=ICPjofejt3/p8cjXH47Pgo2uUY3TuVLpUCrWcS2Ls7qlCyYgfwgVplP7Q101vf9jQhUKpx XGzKsqox3xVmGBb8Y6+VhcLEQRTluzidIplP+dD5m73Xn9IOf+KgddlNne7qLkIDD4Gke5 nrQQZjPdvAMH+foDeM23j/8dSY6pJPCKeiAmGouThNr1BjJetZhcuHi6auempCwIqPNtF3 Jd/HZ7ii59FSN52sBpan2uonEof10hW0A/YF1i01tHoAYqgbE6UYq5QEZZ4k+e4Xj7F9LG Qt5tx4RduDuXDbklMZ4GkCz6rY5SNv+NDig5tpUxJm1zo9eE4+sWmXyhJLBt6Q== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RjhLz2YX9z1Ct8; Sat, 9 Sep 2023 18:28:43 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 4C5334E852; Sat, 9 Sep 2023 20:28:41 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Rainer Hurling Cc: Rainer Hurling , current Subject: Re: 15.0-CURRENT build broken in lib/libmagic In-Reply-To: <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> (Rainer Hurling's message of "Sat, 9 Sep 2023 19:44:19 +0200") References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> <86il8jqnvr.fsf@ltc.des.no> <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Sat, 09 Sep 2023 20:28:41 +0200 Message-ID: <86a5tvqjza.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Rainer Hurling writes: > After removing /usr/obj and 'make cleanworld', That was unnecessary. > I tried to build libc like the following, but it fails: > [...] $ cd /usr/src $ make buildenv inside the buildenv, run: $ make -C lib/libc -j$(nproc) then exit the buildenv and run $ sudo make -C lib/libc install then buildworld as usual. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sat Sep 9 18:52:04 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjhtG3xJKz4sVVc for ; Sat, 9 Sep 2023 18:52:22 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Received: from xmailer.gwdg.de (xmailer.gwdg.de [134.76.10.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjhtG3X7Nz4WB1; Sat, 9 Sep 2023 18:52:22 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Authentication-Results: mx1.freebsd.org; none Received: from excmbx-01.um.gwdg.de ([134.76.9.216] helo=email.gwdg.de) by mailer.gwdg.de with esmtp (GWDG Mailer) (envelope-from ) id 1qf348-0007CG-4n; Sat, 09 Sep 2023 20:52:20 +0200 Received: from MBX19-GWD-03.um.gwdg.de (10.108.142.56) by excmbx-01.um.gwdg.de (134.76.9.216) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.2507.32; Sat, 9 Sep 2023 20:52:19 +0200 Received: from [192.168.178.23] (10.250.9.199) by MBX19-GWD-03.um.gwdg.de (10.108.142.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.1258.25; Sat, 9 Sep 2023 20:52:19 +0200 Message-ID: <09885472-d22e-4c1e-b71e-ad0bc24ff6fa@gwdg.de> Date: Sat, 9 Sep 2023 20:52:04 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: 15.0-CURRENT build broken in lib/libmagic To: =?UTF-8?Q?Dag-Erling_Sm=c3=b8rgrav?= CC: current References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> <86il8jqnvr.fsf@ltc.des.no> <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> <86a5tvqjza.fsf@ltc.des.no> Content-Language: en-US Reply-To: Rainer Hurling From: Rainer Hurling In-Reply-To: <86a5tvqjza.fsf@ltc.des.no> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [10.250.9.199] X-ClientProxiedBy: excmbx-25.um.gwdg.de (134.76.9.235) To MBX19-GWD-03.um.gwdg.de (10.108.142.56) X-Virus-Scanned: (clean) by clamav X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:207592, ipnet:134.76.0.0/16, country:DE] X-Rspamd-Queue-Id: 4RjhtG3X7Nz4WB1 Am 09.09.23 um 20:28 schrieb Dag-Erling Smørgrav: > Rainer Hurling writes: >> After removing /usr/obj and 'make cleanworld', > > That was unnecessary. > >> I tried to build libc like the following, but it fails: >> [...] > > $ cd /usr/src > $ make buildenv done > inside the buildenv, run: > > $ make -C lib/libc -j$(nproc) Unfortunately, here it breaks with: make -C lib/libc cc -target x86_64-unknown-freebsd15.0 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -DNO__SCCSID -DNO__RCSID -I/usr/src/lib/libc/include -I/usr/src/include -I/usr/src/lib/libc/amd64 -DNLS -ftls-model=initial-exec -DCRT_IRELOC_RELA -DINIT_IRELOCS="init_cpu_features()" -I/usr/src/lib/libc/csu/amd64 -D__DBINTERFACE_PRIVATE -I/usr/src/contrib/gdtoa -I/usr/src/contrib/libc-vis -DINET6 -I/usr/obj/usr/src/amd64.amd64/lib/libc -I/usr/src/lib/libc/resolv -D_ACL_PRIVATE -DPOSIX_MISTAKE -I/usr/src/lib/libmd -I/usr/src/contrib/jemalloc/include -I/usr/src/lib/libc/locale -DBROKEN_DES -DPORTMAP -DDES_BUILTIN -I/usr/src/lib/libc/rpc -DWANT_HYPERV -DYP -DNS_CACHING -DSYMBOL_VERSIONING -g -gz=zlib -MD -MF.depend.machdep_ldisx.o -MTmachdep_ldisx.o -std=gnu99 -Wno-format-zero-length -fstack-protector-strong -Wsystem-headers -Werror -Wall -Wno-format-y2k -Wno-uninitialized -Wno-pointer-sign -Wdate-time -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Wno-switch -Wno-switch-enum -Wno-knr-promoted-parameter -Qunused-arguments -I/usr/src/lib/libutil -I/usr/src/lib/msun/amd64 -I/usr/src/lib/msun/x86 -I/usr/src/lib/msun/src -c /usr/src/lib/libc/gdtoa/machdep_ldisx.c -o machdep_ldisx.o /usr/src/lib/libc/gdtoa/machdep_ldisx.c:40:10: fatal error: 'sys/cdefs.h' file not found #include ^~~~~~~~~~~~~ 1 error generated. *** Error code 1 Stop. make[2]: stopped in /usr/src/lib/libc > > then exit the buildenv and run > > $ sudo make -C lib/libc install > > then buildworld as usual. > > DES Thanks for this description. Seems, that something more is odd here? From nobody Sat Sep 9 19:20:25 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjjVp0b4Nz4smYP for ; Sat, 9 Sep 2023 19:20:34 +0000 (UTC) (envelope-from brian@sonicboom.org) Received: from sheehan.sonicboom.org (sheehan.sonicboom.org [69.75.45.53]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjjVn289Lz4fX9 for ; Sat, 9 Sep 2023 19:20:33 +0000 (UTC) (envelope-from brian@sonicboom.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of brian@sonicboom.org designates 69.75.45.53 as permitted sender) smtp.mailfrom=brian@sonicboom.org; dmarc=none Received: from [10.10.1.112] (rrcs-69-75-45-51.west.biz.rr.com [69.75.45.51]) by sheehan.sonicboom.org (Postfix) with ESMTPSA id BA9DA3A00129 for ; Sat, 9 Sep 2023 12:20:25 -0700 (PDT) Message-ID: Date: Sat, 9 Sep 2023 12:20:25 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: user problems when upgrading to v15 To: freebsd-current@freebsd.org References: <5c5c3ea5-5b14-d969-f55f-b894e4983359@sonicboom.org> <46ee9e3b-adeb-4cd1-5fcc-43547c5c7231@gmail.com> <222e96ba-70b6-e976-8e32-d3726dde18b1@sonicboom.org> <7CDB341A-F9E1-4816-8443-E4C349A86C84@FreeBSD.org> <865dc0ef-a19d-876c-b0a5-03b888b531f5@FreeBSD.org> Content-Language: en-US From: brian whalen In-Reply-To: <865dc0ef-a19d-876c-b0a5-03b888b531f5@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip4:69.75.45.53]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_ALL(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:20001, ipnet:69.75.0.0/16, country:US]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[sonicboom.org]; RCPT_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[brian]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RjjVn289Lz4fX9 Over the last week or so, stable/13, stable/14 and current have improved. Finally, I can make it through a build and install with a password on the root account and a user in the wheel group without having it fail. Brian On 9/9/2023 9:02 AM, John Baldwin wrote: > On 9/2/23 7:11 AM, Dimitry Andric wrote: >> On 1 Sep 2023, at 03:42, brian whalen wrote: >>> >>> Repeating the entire process: >>> >>> I created a 13.2 vm with 6 cores and 8GB of ram. >>> >>> Ran freebsd-update fetch and install. >>> >>> Ran pkg install git bash ccache open-vm-tools-nox11 >>> >>> Used git clone to get current and ports source files. >>> >>> Edited /etc/make.conf to use ccache >>> >>> Ran make -j6 buildworld && make -j6 kernel >>> >>> I then rebooted in single user mode and did the next steps saving >>> output to a file with > filename. >>> >>> etcupdate -p was pretty uneventful. It did  show the below and did >>> not prompt to edit. >>> >>> root@f15:~ # less etcupdatep >>>    C /etc/group >>>    C /etc/master.passwd >> >> This is a problem: the "C" characters mean there were conflicts, and >> it's indeed very unfortunate that etcupdate does not immediately >> force you to resolve them. Because now you basically have mangled >> group and master.passwd files, with conflict markers in them! > > No, the conflicted files are in /var/db/etcupdate/conflicts, the files > in /etc are still > the old ones at this point and won't be updated until you run > 'etcupdate resolve' to > fix them. > > I suspect what happened here is that Brian chose the 'tf' > (theirs-full) option for > 'etcupdate resolve' when he really wanted to do 'e' to edit the > conflicted version. > >> Immediately after this, you should run "etcupdate resolve", and fix >> any conflicts that it has found. >> >> Note that recently there was a lot of churn due to the removal of >> $FreeBSD$ keywords, and this almost always creates conflicts in the >> group and passwd files. For lots of other files in /etc, the >> conflicts are resolved automatically, but unfortunately not for the >> files that are essential to log in! >> >> >>> make installworld seemed mostly error free though I did see a >>> nonzero status for a man page failed inn the man4 directory. >>> >>> etcupdate -B only showed the below. This was my first build after >>> install. >>> >>> root@f15:~ # less etcupdateB >>> Conflicts remain from previous update, aborting. >> >> Yes, that is indeed the problem. You must first resolve conflicts >> from any previous etcupdate run, before doing anything else. As to >> why it does not immediately forces you to do so, and delegates this >> to a separate step, which can easily be forgotten, I have no idea. > > So that if you are doing scripted upgrades, you don't hang forever in > a script. > The intention is that after doing a bunch of scripted installworld + > etcupdate's > on various hosts you can use 'etcupdate status' to see if there are > any remaining > steps requiring manual intervention. > > There could be an option to request batched vs interactivate updates > perhaps. > >>> If I type exit in single user mode to go multi user mode, the local >>> user still works. After a reboot the local user still works. This >>> local user can also sudo as expected. This wasn't the case for the >>> previous build when I first reported this. However, if I run >>> etcupdate resolve it is still presenting /etc/group and >>> /etc/master/passwd as problems. >>> >>> If this is is expected behavior for current then no big deal. I just >>> wasn't sure. >> >> The conflicts themselves are expected, alas. But you _must_ resolve >> them, otherwise you can end up with a mostly-bricked system. > > No, the conflict markers are not placed in the versions in /etc. > However, etucpdate > does refuse to do a "new" upgrade until you resolve all the conflicts > from your > previous upgrade to ensure that conflicted upgrades aren't missed. > From nobody Sat Sep 9 21:38:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjmYq5y0nz4sr0Q; Sat, 9 Sep 2023 21:38:23 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-lf1-f53.google.com (mail-lf1-f53.google.com [209.85.167.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RjmYq2P6kz4Ks3; Sat, 9 Sep 2023 21:38:23 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f53.google.com with SMTP id 2adb3069b0e04-5007abb15e9so5415937e87.0; Sat, 09 Sep 2023 14:38:23 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694295501; x=1694900301; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=kVph2YuRV82Uh17RiOx48L7cg2YuVco2JEzPRbuVLQQ=; b=iKRxO9f+3aJxeohNID4k+RLmt3kfZ44B37WijpmJCUgbusE4LSKn2ZArC7J8shP/Cz cRoUeTMDsPH3fjReTeczpQhb0w+ab46MKHnOdzo/WOoC73fOlTxYR/uil86Q9aNTVY0s 3zzZTOEvaFJrm7Q2/35Y8uYhDxDYK8XdMuvJH2/4DwhbLH/kURSVt+Lrfi+4aYl1fpo6 k9Y0dIiZOyk/LnMCOSDct8NCAnjRZrvuUzYACzSfpwtOS3vL6YXAwcHoQTHciR1StHfH 8k9YC+AryouQWbP1+AlaqK6kElMAOw/0+31hahViZSzw0LMMm+zXQLXCnwQVt24W/7O7 ESHg== X-Gm-Message-State: AOJu0YwSJpAViDI/UYXZRex3C8QycYJIA23hFTSEGeI1sqc6MvSYkMt7 1dnfYsWqn/cBlpqHknQB9RjHiG3AhroaSH8KeT4mWvvUCtvZUg== X-Google-Smtp-Source: AGHT+IFhChV7QQNrG1bdNoQSmK0Q5sqbFycs5tTvMVOsN4jIH/qiHx2YepTlkHXJeuDtBS0suU3s8eVe2KPk6dJiab0= X-Received: by 2002:a05:6512:3c8c:b0:500:7f51:d129 with SMTP id h12-20020a0565123c8c00b005007f51d129mr5351370lfv.34.1694295500717; Sat, 09 Sep 2023 14:38:20 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <20230908233308.GS1219@FreeBSD.org> In-Reply-To: <20230908233308.GS1219@FreeBSD.org> From: Ed Maste Date: Sat, 9 Sep 2023 17:38:09 -0400 Message-ID: Subject: Re: FreeBSD 14.0-BETA1 Now Available To: Glen Barber Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, FreeBSD Release Engineering Team Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4RjmYq2P6kz4Ks3 On Fri, 8 Sept 2023 at 19:33, Glen Barber wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > The first BETA build of the 14.0-RELEASE release cycle is now available. > ... > The freebsd-update(8) utility supports binary upgrades of amd64 and i386 > systems running earlier FreeBSD releases. Note, aarch64 binary updates > are expected to be available starting with BETA2, due to a configuration > error. Systems running earlier FreeBSD releases can upgrade as follows: > > # freebsd-update upgrade -r 14.0-BETA1 Upgrading with FreeBSD-update is failing with: # freebsd-update install src component not installed, skipped Creating snapshot of existing boot environment... done. Installing updates...install: ///usr/include/c++/v1/__string exists but is not a directory install: ///usr/include/c++/v1/__string/char_traits.h: Not a directory install: ///usr/include/c++/v1/__string/extern_template_lists.h: Not a directory Reported by Vedran Miletic in PR273661. We'll provide an update with additional information and possible workarounds, when available.