From nobody Mon Nov 18 07:17:52 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XsJqw3jh4z5dxnB for ; Mon, 18 Nov 2024 07:18:04 +0000 (UTC) (envelope-from jszhao@yeah.net) Received: from mail-m16.yeah.net (mail-m16.yeah.net [1.95.21.16]) by mx1.freebsd.org (Postfix) with ESMTP id 4XsJqq6dnYz522h for ; Mon, 18 Nov 2024 07:17:58 +0000 (UTC) (envelope-from jszhao@yeah.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yeah.net header.s=s110527 header.b=bz9FkhVn; spf=pass (mx1.freebsd.org: domain of jszhao@yeah.net designates 1.95.21.16 as permitted sender) smtp.mailfrom=jszhao@yeah.net; dmarc=pass (policy=none) header.from=yeah.net DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yeah.net; s=s110527; h=Message-ID:Date:MIME-Version:Subject:From: Content-Type; bh=lcexB1SQrypTncU/59AN5FyVgdWMDkYExNHdCIlPVnY=; b=bz9FkhVnUc61pTagKvQL3sqYP3xoQ62EzIa8xihUBvcMuZhW5zHbvfwj3QNijN SVF70M4K4XYWie5/K7PJQuhG9+q7yceX3XhzKuvJ4YyYPwKuIzzR58HAdaOjwnYE C2ee+1vqLg4tepBodzzkBcd1/pQBMWcp9F/CZfbnsuvW0= Received: from [10.162.4.204] (unknown []) by gzsmtp1 (Coremail) with SMTP id Mc8vCgD3H1Ug6jpneZnIAg--.64S2; Mon, 18 Nov 2024 15:17:53 +0800 (CST) Message-ID: <90dada2f-5978-4aaa-bc9d-e949a77f2177@yeah.net> Date: Mon, 18 Nov 2024 15:17:52 +0800 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: `zpool list` return No such file or directory To: freebsd-fs@freebsd.org References: <4a0983b2-04f2-4489-a37c-6d4c71603606@yeah.net> Content-Language: en-US From: Jinsong Zhao In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-CM-TRANSID:Mc8vCgD3H1Ug6jpneZnIAg--.64S2 X-Coremail-Antispam: 1Uf129KBjvJXoW7AF1DWryDZw4UGr4xZw48Crg_yoW8uFyDpr W09Fy7KF4kJFy7Aws7tF17WFyjkr40yFs8JryUWryqy345ZFZagF12krWFkayUArs3Kr1j vrW8t3ZxZFyUXrJanT9S1TB71UUUUU7qnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDUYxBIdaVFxhVjvjDU0xZFpf9x07UuKZAUUUUU= X-Originating-IP: [220.249.99.167] X-CM-SenderInfo: xmv2xt3r61vtnkoqv3/1tbiAgubz2c65ZsPmAAAsp X-Spamd-Result: default: False [-2.92 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; DMARC_POLICY_ALLOW(-0.50)[yeah.net,none]; R_SPF_ALLOW(-0.20)[+ip4:1.95.21.0/27]; R_DKIM_ALLOW(-0.20)[yeah.net:s=s110527]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_SHORT(-0.04)[-0.041]; XM_UA_NO_VERSION(0.01)[]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yeah.net]; FREEMAIL_ENVFROM(0.00)[yeah.net]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[1.95.21.16:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_NONE(0.00)[]; DWL_DNSWL_NONE(0.00)[yeah.net:dkim]; HAS_XOIP(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yeah.net:+] X-Rspamd-Queue-Id: 4XsJqq6dnYz522h X-Spamd-Bar: -- On 2024/11/18 0:47, Alan Somers wrote: > On Sun, Nov 17, 2024 at 6:33 AM Jinsong Zhao wrote: >> >> Hi there, >> >> I have successfully installed FreeBSD 14.1 root on ZFS using GPT with >> VirtualBox. Now I tried to migrate the whole system to a new disk: >> >> >> zfs snapshot E580/ROOT/fb14@today >> >> zpool create test /dev/ada1p2 >> >> zfs send -R E580/ROOT/fb14@today | zfs receive test/fb14 >> >> All done successfully. >> >> After that, I tried to list all pools using >> >> zpool list >> >> It came back: >> >> No such file or directory > > This should be impossible, unless there are some steps missing. Is > this on the system with E580 or ada1p2? Did you reboot after the "zfs > receive" but before the "zpool list"? If so, you need to do a "zpool > import". If you want that to happen automatically, you need to add > "zfs_enable=YES" to /etc/rc.conf . System with E580 is on ada0p2, and the new pool test is on ada1 (or ada1p2, the same phenomena). No reboot after "zfs receive". After several rounds of testing, I think the problem may be that I didn't specify the mount point in the new pool. Also, "zfs receive" will automatically mount the received boot environment after it finishes when "-u" is not specified. So, there are two ways to fix this, either by specifying "-o altroot=/mnt" when "zpool create" or "-u" when "zfs receive". > >> >> I tried other zfs related commands, all give the same return. >> >> Now, I reboot the whole system, I can not even enter the system. > > If you are trying to create a second zfs-root system, based on copying > the file system from an already-working system, you left out a few > steps: > > * You only send/received a single boot environment, but there's more > to the pool than that. You should do something more like "zfs send -R > E580@today | zfs receive -F test" > * You need to set the bootable fs with "zfs set bootfs=test/ROOT/fb14 test" > * You didn't install the bootloader onto ada1p1. The details of how > to do that vary based on whether you are booting with EFI or BIOS. > >> >> What's the problem? I cannot find any hints with zpool/zfs man page. >> >> >> Best, >> >> Jinsong >> >> >> From nobody Mon Nov 18 10:28:28 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XsP3g4Yjrz5cfxH for ; Mon, 18 Nov 2024 10:28:31 +0000 (UTC) (envelope-from avg@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XsP3g3yZpz48WC; Mon, 18 Nov 2024 10:28:31 +0000 (UTC) (envelope-from avg@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1731925711; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=sXaiU+76dCXYv2Oh3XlSzGEFCA2Lx4crLN+PYTZdOyQ=; b=rQUA3Tex/td+z1MKkhtldiKIms9npOhv4oaZj7hPZaJhOcZhGiCExYMH8FaGDgRI1yDBmx CkE3Vf9KMxDeM8LJs8s0pgBafxvj3uDSXxrwyXmlQgJFQkp1VqXwaWhr/pYofbr6hS83TR 9FHRLyWcKCsIp7wzag0fvJ54vuR52Mx3QUARbpMHQ9anyYsB/BpK7uUltnMmw4ZSokuGOb +xyTxFPzrqgYk6bt4ZGolmP+eX8sXMzUKigRxpEjhRWFZYnQeVsSgJw1mloPTEcUrFGCpl lsN4mEbjeMUTvNn0y+cDFdTHNR0BdLZgq6D2Qej5JHo7Be5rIhFC/ybdzsGhvg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1731925711; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=sXaiU+76dCXYv2Oh3XlSzGEFCA2Lx4crLN+PYTZdOyQ=; b=aeiTfw3LfZCFIY2t8QOpNEFQqQiFiaWTrts5cukqXQH9AxSiSRSkU7WWGmhOapImm6kZ41 /v8nQxiFAZrCTXJo7J8hgM5E+x4BM3VLPfrda3yUFx5X8PY4mT7NydDP3oBRGERaD0bjd6 rvGNxYFUl/cwS05MkLM8+Gn1V3dFOa/DllvpSjnCs3a1ZtmfNAcTgaj2YoBFmSPnmX9m2v NlocphaXKc3beDuLGWjLaOycpsazVPIk2QJU/F7VhHzznxJkJsvBf7jzHfaPJB0QLRqU1T npQKCFI3K7NNatYS/TRT0OaXsE6rzEfQFVfrO0jaDhxpHDK2/l4IFBTKgsph/g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1731925711; a=rsa-sha256; cv=none; b=WRQzWK1kO1HLNdOnbR2xTEa1RYARiJolTVc+NCga6yzyAfxPb8MpjEMZFFLhqog/933tph gRPK7UX9tcW6bE3nJ+hVfHJMvkILVB1hLjwmPn8eV5KY9gG3aEytVSjs1RU6XelVoKC42F l1IU6vZvoik4c1ufF6bU7ZzC+2aI0c0mi5qV0fFuWq1HhTnr5Hbtzvhw4BLboTMSoZO4A6 vt6M3vDVigjzHPunDG1obOYY4XmyXs8yqO6+zUsFv2BdaVGPx1S2oXegpOrpwwhHol/pwK hN7hTpiR0C559R4flzXOIUoumFuUzvbZZz5lrS1/hcaFenn+zF6IPZr/4oHiqg== Received: from [192.168.0.88] (unknown [93.188.39.137]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4XsP3g0wWCzhQP; Mon, 18 Nov 2024 10:28:30 +0000 (UTC) (envelope-from avg@freebsd.org) Message-ID: <4334a3f7-5246-46db-ad43-771bd797ec05@freebsd.org> Date: Mon, 18 Nov 2024 12:28:28 +0200 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Andriy Gapon Subject: Re: tmpfs loses (sub-page chunks of) data? To: Konstantin Belousov Cc: freebsd-fs References: <140eb994-ae19-41b4-8f0e-fc4290603ce0@freebsd.org> Content-Language: en-US Autocrypt: addr=avg@freebsd.org; keydata= xsDNBGcKrHEBDADRvwQOK0b/yo4ys5cs6bOQMhEh4xtfbaZ/CU00cpPgUip3sOZCdrtMWlRC g25z97prxE9pKueZi+HXDhIPpa9xl14ghqF4oYScuJ1i18HyiOH2y5Q3Vv/TtFiSzicd3EAu QgS3jVidpgDSPDdj2Yz3UxYpZ+PuFl6nOnvCvqOFcjUlzKCyPaiN2b86l1Nscmhnc+zQ/faB erUOEFEDQbWMA5YfXi8HrbeR16hfRfGt7E0aMDlIj9FIPIq71UWMN9CimPgs4+rbNr1MAlLa z4GxSDhVYZEY5rqtCzr+PLXboRQWnaUwXl0/biw9enf17NHdYv1SNAFTX2eC4dZ3qBVI74dS PgNprm+PMfz+6Hhs/dAv+Nan5nVhg3EFIjYTiy0MnjMSq8uI0v0ykpAGAcJJ5xl6d23aLxgN 6f0z6pJRCO0hGPgU7UzvFD0MxJxmbzqdT1R51KDan1oD41b+tjl2LMBuCDCoB0U44Pu0zLdp xMfFTxCXtwIYKIUxwd28jwMAEQEAAc0eQW5kcml5IEdhcG9uIDxhdmdARnJlZUJTRC5vcmc+ wsENBBMBCAA3FiEEmXvSmjiQFHPVOpLnzDOt5NLj67sFAmcKrHEFCQeEzgACGwMECwkIBwUV CAkKCwUWAgMBAAAKCRDMM63k0uPru5tSDACFK15LLbq89RSQ6QMnjiIm1t/wYJyumb519MHu Dhzxx1lbr8oghf0RHtF6kYRLQPaW2VdToi74pRobd3CN4bhZKDLSL6WfTn17RfavDjL6Njwp KBo30CkOeYKWq1mDmo0xEoQj8cc7ybEZnus+YScZOpj8Ti4EFwhRt6SHer7YDb161IHKL8m4 MsCxpFSGEjbKj8Iul3Ri/fTOO8w14ivcuEEQIvJt4/+4YV5Az8G23wKzL/3aJ7SOT3oYGmR9 atBTmVO3DlODjM+rZLegd8SfLSPTcBTHspWE5duemIzZbEX3BP77r3Qx4Fo5Tkit3bG1XVar yPQato+sFGFEGifdE9USBQoAoOaaeZevwAWjDU0TIuCT0CUe0sKtQuNP4LRq0n9EEHOXBu9a CfdMhFUSkAZnuE7miSVwgPvoVNJ1stA37EXLN/sVsWik7wslTQ5vF81VpdGFiwoQPOe2XEKh ogcwGSnXbwv1gD4x+Gz/7Y+kFyr1NY+4/nSaeXVcS2fOwM0EZwqscgEMAMQTe6ypAmQe/TFO HqKD2hfFKdksTptKi6uEh8xIwct8G/0FBldDWXo9eu8CGr/ZrDg0/bAwJxbaLRQCMH19Gq2Y hLvZ1QK5GQJVzZKcqfxbF2LiDUTs6WkdOBIhGpdDy7p1xFrvqCGCtNFYHuGYm067EozibBSF BWAPstKu2FQuVHZNMOfs7p3OIz3Yfqu9woXDeg3/8G2qVQJINe+8EwXKlhgh4CyDbq7nAZoA kIu1SE9z9u3WI5mcNy/0dFmVUsFxBqRC3ewbvzie8tKyZ9yFOlaZPT0Y4nRBXQTI3mLZ8zQ8 mtrWK5OOmrJ02kdeO9RBXe+OMaUUWMf92ZIoBFb4HP6N+B+4N1y1OwULousfl7JRoYxA4MRL ls7E2sSoJvrEBTJB3Pc34xu8rsJ1A5V3NgN6djX8yEZYpTRkcmrBeWy/ofDqZPVqneAx0LRm eldDS9msXDW4KXODyPZ+9unvmHAcoH0xaBYaSH44CDZDQDg4LNcmbOvuu1TEXBJhjQARAQAB wsD8BBgBCAAmFiEEmXvSmjiQFHPVOpLnzDOt5NLj67sFAmcKrHMFCQeEzgACGwwACgkQzDOt 5NLj67sUCAv5AXqgWnYN9EblapMbZjkiqL8pZQ0GNqh+Pg9FwbyULxjtRTO6rD4D0IxizByb ef+neeUNyYlagt5nfKMysEr0SU/gHKCi8vyTF/63ukMrGUNGmJJxrndl5ZYKC6j6eX7twrZF L1Uvlmn6FnQ22red5kHO93fDjG4zaDIZvHfwj7kzjZ4tpC7Byinf88s14mdZeScc0PnU2hj4 UGYju/wg2FF4YxaZYhcmdTiRYY0Wx85XSMZv19pnn78sadEuRvfRd4JTmw++j1xGXeqQGWzz /CTG5/Ex9GAkQ02hZbmi236byDXoet4G8TEyOph9QFVkV9bNd0jQZaFZPGEj4PSPUYGAF7s5 xJaNGgctC3aZ7WjEv1FBoo44XCU4xcjJ1wZQUrHxRhx6TW0Jtcl0U9qfKFW30TSPo6RyiXuj X4ltWKAtjoXB8nUmEJckaz7IRu2b4pXDeazZuz5JBygUs10yJjDxh2vFQZo0KaBAPx9MZlPn gpPTjT15L8xGftEjQXF6 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 17/11/2024 04:10, Konstantin Belousov wrote: > On Sat, Nov 16, 2024 at 02:31:25PM +0200, Andriy Gapon wrote: >> I think that mmap is not involved at all. >> Files are written from kernel using kern_writev(). > Why? Why from kernel or why kern_writev? That's how our appliance works. >> After they are complete, they are read from userland using whatever libssl >> uses to read input files (when encrypting). Looks like that's fread(3) / >> read(2). > > Try to reproduce it on the HEAD kernel. > Then, turn off swap and see if it is still there. > On HEAD, if reproducable without swap, try to add 'pgread' option to the > tmpfs moount. > > I am interested if the issue persists after all the measures listed above. Switching the systems where the problem happens to HEAD would be very nontrivial, unfortunately. I can experiment with swap and pgread much more easily. Thank you for suggestions. -- Andriy Gapon From nobody Tue Nov 19 00:32:32 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XsltL43Yfz5dGgK for ; Tue, 19 Nov 2024 00:36:42 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XsltJ5NKpz4jQp for ; Tue, 19 Nov 2024 00:36:39 +0000 (UTC) (envelope-from li-fbsd@citylink.dinoex.sub.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of li-fbsd@citylink.dinoex.sub.org designates 2a0b:f840::12 as permitted sender) smtp.mailfrom=li-fbsd@citylink.dinoex.sub.org; dmarc=none; arc=pass ("uucp.dinoex.org:s=M20221114:i=1") Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]) by uucp.dinoex.org (8.18.1/8.18.1) with ESMTPS id 4AJ0aCRY002931 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Tue, 19 Nov 2024 01:36:12 +0100 (CET) (envelope-from li-fbsd@citylink.dinoex.sub.org) ARC-Seal: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1731976574; cv=none; b=GyXYTkUNJhV3uFp9rcqExU4nmUMOgQPORKYYtvsbZ9k6DlbwRUeYUTO8OImRAFRD4deEy9CCk5/X/Wg306F30Wcwwe+HYxCdpAN+T8zxd2FXrLj93LyeqXcsJ6Dhckm3ckinK0hsryXtlTQjU5RnAxJEp7HxrnQbNeothsJ9JvE= ARC-Message-Signature: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1731976574; c=relaxed/simple; bh=w6+8rha7ZdppgbmJL9TujZoSoo1TKC53v1bRuzpPB4c=; h=Received:Received:Received:X-Authentication-Warning:From: X-Newsgroups:Subject:Date:Message-ID:References:MIME-Version: Content-Type:Content-Transfer-Encoding:Injection-Date: Injection-Info:User-Agent:To:X-Milter:X-Greylist; b=luOwFlvXslgR0rmjG2ZgbGG2DJ/jbv7HVh/m/n/4lmKxlDAGuyQM+FImNjQBxiGb/bLP9c6Ox44YE0JS3cVZR5V4jkCA+ZARayI08laqrEwJM2tuMSEML6pK1ojtmfNjeJnz7cpsOth5Py91q4azDhylcylATzgt1ylqMzoI0rw= ARC-Authentication-Results: i=1; uucp.dinoex.org X-MDaemon-Deliver-To: Received: (from uucp@localhost) by uucp.dinoex.org (8.18.1/8.18.1/Submit) with UUCP id 4AJ0aCjv002930 for freebsd-fs@freebsd.org; Tue, 19 Nov 2024 01:36:12 +0100 (CET) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from admn.intra.daemon.contact (localhost [127.0.0.1]) by admn.intra.daemon.contact (8.18.1/8.18.1) with ESMTPS id 4AJ0X1i9033692 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Tue, 19 Nov 2024 01:33:01 +0100 (CET) (envelope-from li-fbsd@citylink.dinoex.sub.org) Received: from intra.daemon.contact (news@localhost) by admn.intra.daemon.contact (8.18.1/8.18.1/Submit) with NNTP id 4AJ0WWQA033494 for freebsd-fs@freebsd.org; Tue, 19 Nov 2024 01:32:32 +0100 (CET) (envelope-from li-fbsd@citylink.dinoex.sub.org) X-Authentication-Warning: admn.intra.daemon.contact: news set sender to li-fbsd@citylink.dinoex.sub.org using -f From: "Peter 'PMc' Much" X-Newsgroups: m2n.fbsd.fs Subject: Re: Can ZFS ARC be run with roundrobin policy? Date: Tue, 19 Nov 2024 00:32:32 -0000 (UTC) Message-ID: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Injection-Date: Tue, 19 Nov 2024 00:32:32 -0000 (UTC) Injection-Info: admn.intra.daemon.contact; logging-data="31693"; mail-complaints-to="usenet@citylink.dinoex.sub.org" User-Agent: slrn/1.0.3 (FreeBSD) To: freebsd-fs@freebsd.org X-Milter: Spamilter (Reciever: uucp.dinoex.org; Sender-ip: 0:0:2a0b:f840::; Sender-helo: uucp.dinoex.org;) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]); Tue, 19 Nov 2024 01:36:14 +0100 (CET) X-Spamd-Result: default: False [-2.97 / 15.00]; ARC_ALLOW(-1.00)[uucp.dinoex.org:s=M20221114:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.973]; FORGED_SENDER(0.30)[pmc@citylink.dinoex.sub.org,li-fbsd@citylink.dinoex.sub.org]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_NEQ_ENVFROM(0.00)[pmc@citylink.dinoex.sub.org,li-fbsd@citylink.dinoex.sub.org]; ASN(0.00)[asn:205376, ipnet:2a0b:f840::/32, country:DE]; RCVD_COUNT_THREE(0.00)[4]; R_DKIM_NA(0.00)[]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[sub.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org] X-Rspamd-Queue-Id: 4XsltJ5NKpz4jQp X-Spamd-Bar: -- On 2024-11-03, Graham Perrin wrote: > On 15/07/2024 12:23, Peter wrote: > >> Hi, >> from what I perceive, the ZFS ARC allocates in firsttouch >> policy, … > >> … not always to my liking. I would prefer roundrobin >> allocations here. But, I didn't easily find a switch, and, reading >> into the UMA allocator, it states that it can do roundrobin, but it is >> not so easily figured how that be made happen in practice. >> >> Pointers on where I might look into, are welcome. > > > Does (closed in 2023) help > to shape your thoughts? > >> Specify a balanced NUMA policy for kernel buffers on FreeBSD by >> markjdb · Pull Request #14437 · openzfs/zfs Wow, cool finding! It shows very much the same as what I already did in the meantime, while wondering why it is not even documented in the uma(9) manpage but then seems to work nevertheless. From nobody Wed Nov 20 06:10:25 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XtWDy178zz5dJkx for ; Wed, 20 Nov 2024 06:10:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XtWDx4c0Kz4L4H for ; Wed, 20 Nov 2024 06:10:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1732083025; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jSAGJNQ5jn7tNDrEShkmkcGT0lsZjfCad2lEWAz5/00=; b=qsF9HMedtvLToAFFoGY063MBQtsvsG2B7cmb3hu455VrsHgMZ0aP7l8Vzr4flj6ki6PUME aLdid7PGlZvC0sOiAGrT/qhFkzAbrbpD21GeHaiqeA6GwvKtgVGw3zT6b18qc5UAoHIAxM PZ9BYtK9ZaQg+9NNK/ihu3ePslQZy7KJArhOIaBIVhoGEcXM03wnJVggeNe8ukgaHVl9ti /B2TveRwxJcTYIhskCgnT7uQbeE6dCwRZHmybvo3O6/LNoKlHNVE6IUI/oMJc3IS7rQhVt DY6C1cQvNa7lSGHFkCifVDM3oQGvsH1dMiwfhzxtM6xgg30bJvv/oE11B0YucQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1732083025; a=rsa-sha256; cv=none; b=bGOZmXsT+pIKiMAFKTTqjaDiniXKWey56clJ1TQ89wkPEnahMFxeh5P9dHr6ucFScI13ks YkPdtzudnYjjzUnpMpGqfOXjoIDLNBi376LNeUuOsjOUiO4hGYxXP+bBWylDDUviE7c8Xg cGUDLLl2QpUL0IHeZtlum18oMNBr83k06hg0fD3uiSBMEQo+MKihomN2ZuaWW+U0I406VH YCIrS6i2OXkHFTFj8FoYV5GmhhUpn/rJpw60OHQCBV7+kohBUGKxcdtdueuD+sbiyNMlfB 3LIfEhhjxzPp+aO2BA8UWzrRX1ft1y2N5yi4Mvv6Ik89k/E3GFsz4xafeiytEw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XtWDx44FDzj6P for ; Wed, 20 Nov 2024 06:10:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4AK6APik020972 for ; Wed, 20 Nov 2024 06:10:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4AK6AP0u020971 for fs@FreeBSD.org; Wed, 20 Nov 2024 06:10:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 282870] rtnl_handle_iflink() has a type mismatch for ifnet_link_event Date: Wed, 20 Nov 2024 06:10:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282870 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Nov 20 06:49:12 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XtX5j1ysxz5dM0x for ; Wed, 20 Nov 2024 06:49:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XtX5h6Mcqz4NRl for ; Wed, 20 Nov 2024 06:49:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1732085352; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4g51/xzx3NSIs7E/pK1G7d9Kv1f8eD+cqPfrgXqP6QM=; b=hqnYOSYoImTS0ikEfb0LKzogth03WA+t0cTLt5ZNtnDCURwHNN4TP4xWBRUZRSXKPb2DNr F+NP+OZk5oTZA3b6/mSp2vU7AL1POEvCzTSwNuTeTrTXldeFCgq23A9MKWvlKenUU7wzJN NnDdHZ8vu155zPt7fTvh3eDloP8zvq+lvbfp07nk7pZ9op/iE75lCU9VxmsJD9zrVCZzpU vzXI4Jn+itsolI/PsKVqcqE8IWmyQ1+wet3xPowIPn+hSuv80+xKkBz7xH33r7HSs+w/AW Jk9kR5Jr1sr3UGQ1AztyecnnIS1B/xvi1rByNHj+U9C2bJc4wSc35PZPJDzOUw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1732085352; a=rsa-sha256; cv=none; b=QyP5W0p7Dp+ITmD/G45wmQN1ozSIZXrICaNvT/ehDx2vT/n74QfT7e+TaVmAkC4+kEfhbV Zjm1WrRFR7Wqe9ZExfyGslHuWjUEiIPpQ4s1oFBvgJvsP5JZ3BKTYvXJQTha7iwaGyrg3G PWN1YQpwchmz1b+nfVeSAESJn9iatHcPKPpT9HI+egmRt78yccFClXvLOTkuGxXKbk2dxl Nr2qN36ZK5voVFBBYthE4s/ikQiI3ywspMHNM706xJ6oOgWfN4e6nGXMVtW39qD2gGRGTw zF357ybte0Ca5vBlakO5LW3F/C2vXLFFGVtAyYprcZpN7M5VaFP9dlFIdwwiqg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XtX5h5zmFzkRJ for ; Wed, 20 Nov 2024 06:49:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4AK6nCRE088318 for ; Wed, 20 Nov 2024 06:49:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4AK6nCfn088317 for fs@FreeBSD.org; Wed, 20 Nov 2024 06:49:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 282870] rtnl_handle_iflink() has a type mismatch for ifnet_link_event Date: Wed, 20 Nov 2024 06:49:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282870 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Nov 20 08:15:55 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XtZ264HWCz5dRBs for ; Wed, 20 Nov 2024 08:16:14 +0000 (UTC) (envelope-from pen@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [130.236.254.3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XtZ254Rpfz4VQ1 for ; Wed, 20 Nov 2024 08:16:13 +0000 (UTC) (envelope-from pen@lysator.liu.se) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of pen@lysator.liu.se designates 130.236.254.3 as permitted sender) smtp.mailfrom=pen@lysator.liu.se; dmarc=pass (policy=none) header.from=lysator.liu.se Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id 789ABD944 for ; Wed, 20 Nov 2024 09:16:10 +0100 (CET) Received: by mail.lysator.liu.se (Postfix, from userid 1004) id 6C6EBD865; Wed, 20 Nov 2024 09:16:10 +0100 (CET) X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-13) on hermod.lysator.liu.se X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,AWL,HTML_MESSAGE, T_FILL_THIS_FORM_SHORT,T_SCC_BODY_TEXT_LINE autolearn=disabled version=4.0.0 X-Spam-Score: -1.0 Received: from smtpclient.apple (unknown [IPv6:2001:6b0:17:f002:1000::897]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id 6D946D991 for ; Wed, 20 Nov 2024 09:16:05 +0100 (CET) From: Peter Eriksson Content-Type: multipart/alternative; boundary="Apple-Mail=_30ABFAAF-129A-4792-A3F9-88E6B923AB8E" List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51.11.1\)) Subject: Re: zfs snapshot corruption when using encryption Date: Wed, 20 Nov 2024 09:15:55 +0100 References: <03E4CCF5-0F9A-4B0E-A9DA-81C7C677860C@FreeBSD.org> <3E85AAAE-8B1E-47C7-B581-E3D98AB03907@FreeBSD.org> <6F51D3D6-D9A3-46D8-94F2-535262F43EF4@FreeBSD.org> To: FreeBSD FS In-Reply-To: <6F51D3D6-D9A3-46D8-94F2-535262F43EF4@FreeBSD.org> Message-Id: X-Mailer: Apple Mail (2.3776.700.51.11.1) X-Virus-Scanned: ClamAV using ClamSMTP X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; NEURAL_HAM_MEDIUM(-0.98)[-0.977]; DMARC_POLICY_ALLOW(-0.50)[lysator.liu.se,none]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:mail.lysator.liu.se]; RCVD_IN_DNSWL_MED(-0.20)[130.236.254.3:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:2843, ipnet:130.236.0.0/16, country:SE]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4XtZ254Rpfz4VQ1 X-Spamd-Bar: --- --Apple-Mail=_30ABFAAF-129A-4792-A3F9-88E6B923AB8E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I=E2=80=99m seeing something similar on one of our systems - the one = system where I=E2=80=99ve just now started trying to use ZFS native = encryption. Setup: FreeBSD 13.4-RELEASE-p1, 512GB RAM 3 Zpools:=20 zroot - mirror of two SSD drives ENCRYPTED - ZFS over GELI-encrypted SAS 10TB drives SEKUR01D1 - ZFS over SAS 18TB drives with ZFS encryption enabled for = individual filesystems - ZFS snapshots are taken every hour of the ENCRYPTED zpool. - zfs send is being done on some filesystem on the ENCRYPTED spool - A big =E2=80=9Ccp -a=E2=80=9D (about 70TB of files) of data from zfs = filesystems in ENCRYPTED to SEKUR01D1 filesystems is running. CKSUM errors pop up in zroot! Fixed some errors yesterday, ran =E2=80=98zpool scrub=E2=80=99 & = =E2=80=98zpool clear=E2=80=99 and got a clean bill of health: # zpool status -v zroot pool: zroot state: ONLINE scan: scrub repaired 0B in 00:07:15 with 0 errors on Tue Nov 19 = 21:46:36 2024 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p4 ONLINE 0 0 0 diskid/DISK-PHDW817002MK150Ap4 ONLINE 0 0 0 errors: No known data errors This morning: # zpool scrub zroot # zpool status -v zroot pool: zroot state: ONLINE scan: scrub in progress since Wed Nov 20 08:11:31 2024 19.4G scanned at 6.48G/s, 772K issued at 257K/s, 49.3G total 0B repaired, 0.00% done, no estimated completion time config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p4 ONLINE 0 0 0 diskid/DISK-PHDW817002MK150Ap4 ONLINE 0 0 0 errors: No known data errors # zpool status -v zroot pool: zroot state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A scan: scrub repaired 0B in 00:07:20 with 1 errors on Wed Nov 20 = 08:18:51 2024 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p4 ONLINE 0 0 2 diskid/DISK-PHDW817002MK150Ap4 ONLINE 0 0 2 errors: Permanent errors have been detected in the following files: /var/audit/20241119235400.20241120000543 Snapshots & zfs send only being done on the =E2=80=9CENCRYPTED=E2=80=9D = zpool, not on =E2=80=9Czroot=E2=80=9D or =E2=80=9CSEKUR01D1=E2=80=9D. Ie = not on the zpool with the Zfs-native-encrypted filesystems. Not 100% sure it is related but something is fishy. This is a server = that has been running fine with GELI-encrypted disks for many years = now=E2=80=A6=20 - Peter > On 9 Nov 2024, at 15:53, Palle Girgensohn wrote: >=20 >=20 >=20 >> 9 nov. 2024 kl. 02:59 skrev void : >>=20 >> % zfs version >=20 > Ah, of course. >=20 > $ zfs version=20 > zfs-2.2.4-FreeBSD_g256659204 > zfs-kmod-2.2.4-FreeBSD_g256659204 >=20 > Palle >=20 --Apple-Mail=_30ABFAAF-129A-4792-A3F9-88E6B923AB8E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 I=E2=80=99m = seeing something similar on one of our systems - the one system where = I=E2=80=99ve just now started trying to use ZFS native = encryption.

Setup:
FreeBSD 13.4-RELEASE-p1, = 512GB RAM

3 Zpools: 
  = zroot - mirror of two SSD drives
  ENCRYPTED - ZFS over = GELI-encrypted SAS 10TB drives
  SEKUR01D1 - ZFS over SAS = 18TB drives with ZFS encryption enabled for individual = filesystems

- ZFS snapshots are taken every = hour of the ENCRYPTED zpool.
- zfs send is being done on some = filesystem on the ENCRYPTED spool
- A big =E2=80=9Ccp -a=E2=80=9D= (about 70TB of files) of data from zfs filesystems in ENCRYPTED to = SEKUR01D1 filesystems is running.

CKSUM errors = pop up in zroot!

Fixed some errors yesterday, = ran =E2=80=98zpool scrub=E2=80=99 & =E2=80=98zpool clear=E2=80=99 = and got a clean bill of health:

# zpool = status -v zroot
  pool: zroot
 state: = ONLINE
  scan: scrub repaired 0B in 00:07:15 with 0 = errors on Tue Nov 19 21:46:36 = 2024
config:

NAME =                     =            STATE     READ WRITE = CKSUM
zroot               =                 ONLINE   =     0     0     0
=   mirror-0             =              ONLINE     =   0     0     0
=     ada0p4           =                ONLINE   =     0     0     0
=     diskid/DISK-PHDW817002MK150Ap4  ONLINE =       0     0     = 0

errors: No known data = errors

This morning:

# = zpool scrub zroot

# zpool status -v = zroot
  pool: zroot
 state: = ONLINE
  scan: scrub in progress since Wed Nov 20 = 08:11:31 2024
19.4G scanned at 6.48G/s, 772K = issued at 257K/s, 49.3G total
0B repaired, 0.00% done, no = estimated completion = time
config:

NAME =                     =            STATE     READ WRITE = CKSUM
zroot               =                 ONLINE   =     0     0     0
=   mirror-0             =              ONLINE     =   0     0     0
=     ada0p4           =                ONLINE   =     0     0     0
=     diskid/DISK-PHDW817002MK150Ap4  ONLINE =       0     0     = 0

errors: No known data = errors

# zpool status -v zroot
  = pool: zroot
 state: ONLINE
status: One or more = devices has experienced an error resulting in data
= corruption.  Applications may be affected.
action: = Restore the file in question if possible.  Otherwise restore = the
entire pool from backup.
   see: = https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  = scan: scrub repaired 0B in 00:07:20 with 1 errors on Wed Nov 20 08:18:51 = 2024
config:

NAME =                     =            STATE     READ WRITE = CKSUM
zroot               =                 ONLINE   =     0     0     0
=   mirror-0             =              ONLINE     =   0     0     0
=     ada0p4           =                ONLINE   =     0     0     2
=     diskid/DISK-PHDW817002MK150Ap4  ONLINE =       0     0     = 2

errors: Permanent errors have been detected = in the following files:

      =   = /var/audit/20241119235400.20241120000543


Snapshots & zfs send only being done on the =E2=80=9CENCRYPTED=E2= =80=9D zpool, not on =E2=80=9Czroot=E2=80=9D or =E2=80=9CSEKUR01D1=E2=80=9D= . Ie not on the zpool with the
Zfs-native-encrypted = filesystems.

Not 100% sure it is related but = something is fishy. This is a server that has been running fine with = GELI-encrypted disks for many years = now=E2=80=A6 

- = Peter

On 9 = Nov 2024, at 15:53, Palle Girgensohn <girgen@FreeBSD.org> = wrote:



9 nov. 2024 kl. 02:59 skrev void = <void@f-m.fm>:

% zfs = version

Ah, of = course.

$ zfs = version 
zfs-2.2.4-FreeBSD_g256659204
zfs-kmod-2.= 2.4-FreeBSD_g256659204

Palle

=

= --Apple-Mail=_30ABFAAF-129A-4792-A3F9-88E6B923AB8E-- From nobody Wed Nov 20 17:22:21 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xtp9T3T9Jz5dWLk for ; Wed, 20 Nov 2024 17:23:25 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fout-b6-smtp.messagingengine.com (fout-b6-smtp.messagingengine.com [202.12.124.149]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xtp9R6bQFz4R6H for ; Wed, 20 Nov 2024 17:23:23 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=hE2h61KM; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=WfHZMI6u; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.149 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-05.internal (phl-compute-05.phl.internal [10.202.2.45]) by mailfout.stl.internal (Postfix) with ESMTP id A2C9A114018B for ; Wed, 20 Nov 2024 12:23:22 -0500 (EST) Received: from phl-imap-04 ([10.202.2.82]) by phl-compute-05.internal (MEProxy); Wed, 20 Nov 2024 12:23:22 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1732123402; x=1732209802; bh=MMmNUsf/Gh8qYZV4Ss5n+JGJwCWvGEwaH1UJ34G5+4k=; b= hE2h61KMw2yKjJPs1Nic2olhw1PfGIyBkSqTNSNR1In3RztprBM/qEa5GVonIUzy 9APEAz+XKWE3S12mKULk/cwTTCwmlXuHTxqKWH3aPMAIayLViOmCJJLdrQEfeGKW eCXzsJSxAAuhISHn8uP2VqwFuOPtOCsTRlXXasuWA0UEBnRQNznQAReVdKbPtu6G qjhWn5cCK042mDxX9HLZUKYZf+BytJKroyiEZUP8PMir8GwYqvzAGEoZYY7LJeTf YgJNC+cO5f/65vnsuGhAuMGfA3tEFeaNu4qSy4bj7SXj1kGE20lXfQiqIp8CdrGj b8AsDiSIKlbxwJYeDk0nbQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; t=1732123402; x=1732209802; bh=M MmNUsf/Gh8qYZV4Ss5n+JGJwCWvGEwaH1UJ34G5+4k=; b=WfHZMI6uCItf84Dde MYAWGNonRdUnbrZpl4cpzr4yaeMYRKFhcrC5ziEJJrcofJxFT4JBBU0R1Z7EbUNl RD1glCZJPxbZs6MQyiGB3JyqbC9soPwbNmYxtVb/pDDkzYEbT9SoDXHUfC6dNgwO rEiIbonVRfclQcLNQV6uwKiFmn+WP9wWW4dR/TFDQHhdG/+S1Zw5cdI1ei1XG3dW chxh5AWXrL99g1CQaNQVE34zBqbD3UikyOY/QYN0WFiq7qne6qeC6NTl7tSabx/u CdbWO0rCmgEyXP4JNWt0aKhiVlsNQoyKua7W2JrgC63c4ITN89+5O1leiKdNpM98 DifEw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefuddrfeeggdellecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdpuffr tefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecunecujfgurhepofggfffhvf fkjghfufgtgfesthejredtredttdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepiedtfeeifeetiefffeefgfejueevffeltdehff egtdffhfefuefggfeuhfekgfdvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomhepvhhoihgusehfqdhmrdhfmhdpnhgspghrtghpthhtohepuddpmh houggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqfhhssehfrhgvvggs shgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id 332A32E60084; Wed, 20 Nov 2024 12:23:22 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Date: Wed, 20 Nov 2024 17:22:21 +0000 From: void To: freebsd-fs Message-Id: <7c108c57-e005-47d4-b9e2-947502d951da@app.fastmail.com> In-Reply-To: References: Subject: Re: improving nfs client & server performance Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.05 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.996]; NEURAL_HAM_MEDIUM(-0.96)[-0.964]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.149:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_FROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; TO_DN_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4Xtp9R6bQFz4R6H X-Spamd-Bar: ---- Hi, On Fri, 15 Nov 2024, at 16:30, J David wrote: > Perhaps I'm overstating the case, but I believe that using ZFS on SMR > disks is strongly discouraged. I haven't tried myself, mainly due to > the horror stories I've read. Stories that sound a lot like yours. I've heard about SMR drives too [0]. But when I was offered one at a Great Price [1] I installed it. I'll admit i didn't hear about SMR+ZFS combination being inadvisable, though. it *was* working ok for the purpose I allocated it - namely, more like a tape drive than a hard drive, in terms of write speed. But read speed *was* acceptable. Ish. It's this which has deteriorated. Everything that was on that drive that was important is now on other non-SMR based hardware or backed up offsite. [0] in the context of archiving not-often-accessed data [1] a gift [2] theoretically, with eg copies=3 it should have been self-healing errors [3] a failure mode of slowing down is preferable to completely giving up. Now, with all the data off it, it'll be junked as too slow for purpose. From nobody Thu Nov 21 04:50:44 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xv5QY2Xldz5fD5J for ; Thu, 21 Nov 2024 04:50:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xv5QX6ctsz4jpc for ; Thu, 21 Nov 2024 04:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1732164644; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HlKAnoZo/0hUphWPOjrlg/aFwka2PPRRt1RBoHOtBNI=; b=YnnPvETTjs6ReLLyrB9Bknn+PKsSwIDR/gkwq8c0qdavJhoPxfsW4fvFE1ItAyR9/Pp9lb eXyShoJxonmyp2WINoSxelyNGVbkVsS5MEWYgSJUOvir22xX6dA6UqkzmOa5dOD7R/aLlx yRfKFcNAU2nTS2xgKi7kRVuQo9xjp3apnUc+RDT6WhhRw4TJKvzc6O4fjdh/nAnIuX1e7Q Yv9W2oQg5s5YcTK1AaU0DTtXhKVjYooS5xoD7mOfjPsChXIu9GBYIsXVpS9KpzVt0pBF96 PD9ypZvJ7NzbbxKI9KXVVPXaMWW4bAxKbxHAqKlgqRwY5rJWjEIMFexF7//mIw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1732164644; a=rsa-sha256; cv=none; b=hF+BxxTIiLRl1RjywBpE2I3izBlQvnPqiJFHODN9Wg229F4YN/VF2Md9tZQuIjyzT8N3Zm vJWw+l9icBPPmgEeU21BX5ablLRXwoIiyMn4sVq8wswf4DK4zp+sRgq9jwRy6bMmdUbFrF fiLBCuB80GB+6w/cvLg0bwNZIKxuP8aitusxTbzTerzoXd3Lqv1M2J0hgCifN8907Wo36p nQiTbyVEdxUQZih2mGfFJsBszG5gd3YGrkHyDjV33gSG7vnrByhEIM83gcwlcXIjz+gLJj kt5nfxf7X/Vz3CNN/r+Mng14qFIUOlmQ28LPgu57RNk2A9L4LnWplqBoPn9kPA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xv5QX66TgzQ4v for ; Thu, 21 Nov 2024 04:50:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4AL4oiXc048797 for ; Thu, 21 Nov 2024 04:50:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4AL4oiha048796 for fs@FreeBSD.org; Thu, 21 Nov 2024 04:50:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 282878] panic: excl->share in zfs_clone_range when block_cloning is enabled Date: Thu, 21 Nov 2024 04:50:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-CURRENT X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282878 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |crash Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.=