From nobody Fri Oct 27 15:38:58 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SH6K25xYPz4yMtL for ; Fri, 27 Oct 2023 15:39:02 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SH6K218Nnz3JHB for ; Fri, 27 Oct 2023 15:39:02 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=madpilot.net header.s=bjowvop61wgh header.b="j +E9ipJ"; spf=pass (mx1.freebsd.org: domain of mad@madpilot.net designates 159.69.1.99 as permitted sender) smtp.mailfrom=mad@madpilot.net; dmarc=pass (policy=quarantine) header.from=madpilot.net Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4SH6K11t9Wz6ddR for ; Fri, 27 Oct 2023 17:39:01 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1698421139; x= 1700235540; bh=UZasNgtLEpyNFGriItBPvJktHL0H3vqO1n3fFtSyTWs=; b=j +E9ipJIjV5nv6udPSAVobRn778qw+CdClPtqHUN1GLbo00Rj8c5JOlp2kBQ5ZVrl vODKtN6V2tflXrqwgeovI/Ja9bJmk0hNS+L18zeK8EtLfO30CymBz64JOslyZNNN gKpKrfcporCXSY8MSexymzQCYMWECS8CdxeipR8qEXn2qCzA/c4cRv/elXMepXqO xG7JU1Nk86ZCl+iGg2yMYUQb/a7gSFdCbquTo22WActBEvM2037R//zKyzC/JzBy hUjOsssy11jgM8eQK7CjVestTgkIvZ3RWFMJHh+17RzZDUFE7yK/ncujiWnkhK5z 0waOxxs1E6YLr9I/DKzoA== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id 92qR2B32YUnj for ; Fri, 27 Oct 2023 17:38:59 +0200 (CEST) Message-ID: <767774d4-50b5-47c8-9cf1-c0c99fe33e00@madpilot.net> Date: Fri, 27 Oct 2023 17:38:58 +0200 Subject: Re: periodic daily takes a very long time to run (14-stable) Content-Language: en-US, it To: freebsd-stable@freebsd.org References: <1122335317.4913.1698407124469@localhost> <794932758.6659.1698413675475@localhost> <8a5c1f89eb5842f20e463c7d60538e598da3bc46.camel@gromit.dlib.vt.edu> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeAQTAQIAIgUCT4b6XQIbAwYL CQgHAwIGFQgCCQoLBBYCAwECHgECF4AACgkQGuaGDlbL0pOWigf/YVTVf3+ZRnzeGP7CjGV1 Wrrxzjc8h8W64NZasV0XLHGFjl5MYwtm9jJ9gbL8Ubtqstey7lYpjOk2fG6YDhY5eptWCpR6 1QqYrioukhCfKbodSk6PnIZcx719nJVK2P7ihdFEN78TavpBwqIf9hGEcKkMpbRFQv1mYvXD hKVwQGY+8bkH/a/pAWmIyD4qMfKCMurH5DexxEt5SYWu5BB5hd/DWyZ0wuZ+F79KMPzLBPJW 5cpdLNbrvenSqFZGJEGhtTp7GFJJr6lTy8VLBArxmFHiY5jGyR45eZEGDcz86FfGgvPnnpi7 aNCc/ROdF7fnZYPh8uZGGjQbd4EYK4xMzc7BTQRTEHtBARAAoWGsNx6g90r8gcNKaiPpJBiK y8ztV2FyV5LsT0OgQBW3vIxt/odtsxVNNjpyS/BNZCyzLAsFc1WrGBzhYsmPN9SGB5/5YTvk zf5YViU5VAsZlj/MRWCZrWtpic4c0A7N4csOYReNtk/q8YB4PIFsZ9A+kTuoZhnu5t5PdfBA 74+SVwKu84+PZk9wDEY1LbFVT8vM42oKsmoswlIhwJ2xuJI/gbk+cMUe0yiRpNjo4Svw4RB8 4B6uFwdRr/PtS7xi2Zqoof5AaQT9YSBpGpKJOe/Qk5MP4PF6Fqq+go89n77Y2kJkwcHaLoD/ GJ+ZDASIiMRe1y54FHOQ1RCTGGpnJLXdKuGhwv3J21pU8HNlq0ASNQMMQmYAwtUWzjmp/KEy I1qkcmjafcxb8TmiaoK8SQN1Zf96fc/sIrZN6Z5oOCEyyCQ0prH/PTA2jlRkKQ487PTGk2JS KU5VuS57Nlk2DrnvjWp57aV9eFAhpnrrJPuGmFz83/Pc8gC0t7N7i7VVHYRcC5naxYB2UoI1 OUkyxpT/HvQFXXVZ3/KmdXMzrx191AggCPWIwUAP+VcaURSYpeDk6/ZVAOVOe1ChqcJisCD7 wK20/OOvJ2AtkWreGu1CZ9zSx7nK/VYdLr34GxQ4bT1G+9rBQNnFSNbX2TJ431Mdo1GCjDeR K4CtSnrNKYkAEQEAAcLAXwQYAQgACQUCUxB7QQIbDAAKCRAa5oYOVsvSkw3nCADhsKRf+rAR ULTpOh5HoLam62ZJZAyCkNqqu/rke5uj5AaaDY/h7BNhBDiDqhhZLTeofGpVVaErPsWN+tX5 0fypsIt9KAhy90GFrtrIZlWuyK4wsoZvDfp9yaRk+lIM58dw/Rcfxn670JaPTFSRPECVn/uL qBhJSkbYlY212YT9fxVUTJe6wIvDLQrQEjrQD/h1FMhfcLhAqsndltRd6DPvTKeMd/6VAxn0 hkoBKhEy5LkWjM9CHppu+bBkQ91/kj2uJQSXO8euonwHHS3c+6N2i2H7I0emcHGu07wuRB2t Dnw/RLBxohffdPZT2kbxuG7lhVHzwVDw5DRwSw8GkOdy In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-2.00 / 15.00]; MISSING_MIME_VERSION(2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; R_SPF_ALLOW(-0.20)[+mx:c]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4SH6K218Nnz3JHB X-Spamd-Bar: - List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org On 27/10/23 17:24, void wrote: > Hi, > > On Fri, Oct 27, 2023 at 11:01:03AM -0400, Paul Mather wrote: > >> This doesn't affect the periodic daily run (to my knowledge) > > # ps x | grep periodic > > 59319 14  S+       0:00.00 grep periodic > 27376 17  I+       0:00.00 /bin/sh - /etc/periodic/security/110.neggrpperm > 27987 17  I+       0:00.00 /bin/sh - /etc/periodic/security/110.neggrpperm > 43295 17  I+       0:00.00 /bin/sh - /usr/sbin/periodic daily > 44018 17  I+       0:00.00 lockf -s -t 0 /var/run/periodic.daily.lock > /bin/sh /usr/sbin/periodic LOCKED daily > 44447 17  I+       0:00.01 /bin/sh /usr/sbin/periodic LOCKED daily > 47348 17  I+       0:00.01 /bin/sh /usr/sbin/periodic LOCKED daily > 47882 17  I+       0:00.00 /bin/sh /etc/periodic/daily/450.status-security > 48386 17  I+       0:00.00 /bin/sh - /usr/sbin/periodic security > 49217 17  I+       0:00.00 lockf -s -t 0 /var/run/periodic.security.lock > /bin/sh /usr/sbin/periodic LOCKED security > 49566 17  I+       0:00.01 /bin/sh /usr/sbin/periodic LOCKED security > 51783 17  I+       0:00.00 /bin/sh /usr/sbin/periodic LOCKED security > > It's been like this (110.newgrpperm) for 2hrs 16 mins > > /etc/periodic/security/110.neggrpperm has the following line, which I've > put > in quote marks (the quote marks are not present in the actual file) > > "n=$(find -sx $MP /dev/null \( ! -fstype local \) -prune -o -type f \" > > although I'm not certain, it suggests to me it's looking through the > entire disk, > not excluding anything. If this script is the culprit is easily tested, disable it and see. I guess you can stay a few days without checking for negative permissions. Also, $MP is defined in such a way to exclude filesystems that set "nosuid/noexec". I do happen to have those setup for my ccache directory so it is skipping that. With zfs it is especially easy to set these flags, and I think having noexec/nosuid/nodev for ccache cache is a good practice anyway. I have this for ccache FS (zfs): dumpster/ccache compression lz4 inherited from dumpster dumpster/ccache atime on local dumpster/ccache devices off local dumpster/ccache exec off local dumpster/ccache setuid off inherited from dumpster -- Guido Falsi