From nobody Mon Aug 21 13:49:35 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTv4063W8z4qpBj for ; Mon, 21 Aug 2023 13:49:52 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTv404svgz3Tqb for ; Mon, 21 Aug 2023 13:49:52 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LDnjwq014396 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 15:49:51 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: Date: Mon, 21 Aug 2023 15:49:35 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTv404svgz3Tqb X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 15:41, Kaya Saman = wrote: >=20 >=20 > On 8/21/23 14:38, freebsd@vanderzwan.org wrote: >>=20 >>> On 21 Aug 2023, at 15:34, Kaya Saman = wrote: >>>=20 >>>=20 >>> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>>> On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >>>>>=20 >>>>>=20 >>>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>>> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >>>>>>> # zfs list -ro space zroot/ROOT >>>>>>> NAME AVAIL USED = USEDSNAP USEDDS USEDREFRESERV USEDCHILD >>>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>>>>=20 >>>>>> That last line seems to indicate there is 52.0 G used in = snapshots of zroot/ROOT/default and 36.5G in the dataset itself. >>>>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default = should give a list of the snapshots and the sizes. >>>>>>=20 >>>>>> Paul >>>>>>=20 >>>>>>=20 >>>>> Thanks so much Paul.... I feel like I'm spinning around in circles = currently... >>>>>=20 >>>>>=20 >>>>> There doesn't seem to be anything indicative of that space being = used up? >>>>>=20 >>>>>=20 >>>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>>>=20 >>>>>=20 >>>>> certainly not 52GB? >>>>>=20 >>>>>=20 >>>> That=E2=80=99s definitely confusing. >>>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99= and of 'zpool list -v zroot=E2=80=99 >>>>=20 >>>> Paul >>>>=20 >>>>=20 >>> Here are the outputs: >>>=20 >>>=20 >>> zfs list -o space -r zroot >>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>> zroot 720M 107G 0B = 2.20G 0B 105G >>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>> zroot/swap 3.78G 6.19G 0B = 3.11G 3.08G 0B >>> zroot/tmp 720M 121M 0B = 121M 0B 0B >>> zroot/usr 720M 7.09G 0B = 88K 0B 7.09G >>> zroot/usr/home 720M 88K 0B = 88K 0B 0B >>> zroot/usr/obj 720M 4.75G 0B = 4.75G 0B 0B >>> zroot/usr/ports 720M 432K 0B = 176K 0B 256K >>> zroot/usr/ports/distfiles 720M 168K 0B = 168K 0B 0B >>> zroot/usr/ports/packages 720M 88K 0B = 88K 0B 0B >>> zroot/usr/src 720M 2.35G 0B = 2.35G 0B 0B >>> zroot/var 720M 2.60G 0B = 88K 0B 2.60G >>> zroot/var/audit 720M 88K 0B = 88K 0B 0B >>> zroot/var/backups 720M 141M 0B = 141M 0B 0B >>> zroot/var/crash 720M 88K 0B = 88K 0B 0B >>> zroot/var/db 720M 1.69G 0B = 1.59G 0B 94.8M >>> zroot/var/db/pkg 720M 94.8M 0B = 94.8M 0B 0B >>> zroot/var/empty 720M 88K 0B = 88K 0B 0B >>> zroot/var/log 720M 792M 0B = 792M 0B 0B >>> zroot/var/mail 720M 3.96M 0B = 3.96M 0B 0B >>> zroot/var/run 720M 248K 0B = 248K 0B 0B >>> zroot/var/tmp 720M 672K 0B = 672K 0B 0B >>>=20 >>>=20 >>> zpool list -v zroot >>> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP = DEDUP HEALTH ALTROOT >>> zroot 111G 104G 7.22G - - 82% 93% = 1.00x ONLINE - >>> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >>> ada0p3 111G - - - - - - - = ONLINE >>> ada1p3 111G - - - - - - - = ONLINE >>>=20 >>=20 >> Those look quite normal. What about 'zfs list -r -t all -o space = zroot/ROOT/default=E2=80=99 ? >>=20 >> Paul >>=20 >>=20 >>=20 >=20 > zfs list -r -t all -o space zroot/ROOT/default > NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD > zroot/ROOT/default 720M 88.5G 52.0G 36.5G = 0B 0B > zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - > zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - > zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - > zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - > zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >=20 >=20 > Strange! It shows a 52GB 'claimed' snapshot but where is it? >=20 >=20 Can you give output of 'zfs get all zroot/ROOT/default=E2=80=99 as well = ? Maybe that gives a hint. Paul