From nobody Sat Aug 19 10:17:12 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSZRg0Mblz4qX88 for ; Sat, 19 Aug 2023 10:17:19 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-lf1-x12f.google.com (mail-lf1-x12f.google.com [IPv6:2a00:1450:4864:20::12f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSZRd0W3nz3J8s for ; Sat, 19 Aug 2023 10:17:17 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=rfexwAbE; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::12f as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lf1-x12f.google.com with SMTP id 2adb3069b0e04-4ff9121fd29so2509667e87.3 for ; Sat, 19 Aug 2023 03:17:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692440235; x=1693045035; h=content-transfer-encoding:in-reply-to:subject:from:references:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=Ci7JxyyUMegxXpKXqSpL4n6jACz0WjibIgxyXhxI/wk=; b=rfexwAbEVC7F46ZFa4HWpjHGLIe4kQ71bcc60Ixf+GCdEx2xfFHkXm3KsC/weHZz5e HwJ8cspQsai2rDRBYovHy6llCBHd/x8VE2qdlcBxRqPzQw4uMGC4LgTfdcTGFMjWqcqy tkR9MOfhP+jahB3jDS1yGOjeJshE+Fm7lDTtUpMjMkeBdB4hDlWf3LRI12FrMI6+bTWg QL5DCo2y0+GaeP4LDVF2t0rTuAeEI1A/PWYaj3VYiUekzw2lFkBPccSEmb/2p6OaMb0r xtBT4O71ym73Z4lFZeLXjPlz/n1DhaYPoNVJRdGzetuJq+bH62YDO0DosL/Uc4mbD2aT UtWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692440235; x=1693045035; h=content-transfer-encoding:in-reply-to:subject:from:references:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Ci7JxyyUMegxXpKXqSpL4n6jACz0WjibIgxyXhxI/wk=; b=P3hh1uURcMaOvhZXbf+udNvE6+57Fs65ufFxMMKGFi+nP3gaBkiRrolWmBIQb+Zv2W KnkiWS4n9rusqtiKmDJ9oMpVMLonEocql7i0eo8M60vnVB288z2pqb4p1Ig9xnFbT1Px mqJ5501aFwz7d1JR4BGoax2k2RmJ0oZG0e2HUrjh8WHuRup7+GFCJfDXp4F/5hJcMAlK rPGPGLbp9po0gmrkBZidJG8FzBEWBj7MhZyA1cFN71n06aUW//y6IAk3/Bo1bSIYmOdd 2RKIkxkfYfwMhS4OGK2OwbkyuAYo5StCCaNc7COlZFMOUQfZBM0jr+VXP+1pPbKHJt25 i4fg== X-Gm-Message-State: AOJu0YyASUWL1I9/tRn7TvBz22EI64Q6s1Q4lvNcGBaLh2NqBOqEFmUv V33evj1K6eQ4VPnJ6mlLeqhdwHWeaUI= X-Google-Smtp-Source: AGHT+IHpxVR8I/9MnhhI0YtW1AU59sFIbaiBZGzyYe2B4ZYZnN3AArGNudTV4mBzt4ABq+3VC0c3VQ== X-Received: by 2002:a05:6512:32cf:b0:4fb:821e:2241 with SMTP id f15-20020a05651232cf00b004fb821e2241mr1154372lfg.23.1692440234491; Sat, 19 Aug 2023 03:17:14 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id i21-20020aa7dd15000000b00523d5d9bf1bsm2295685edv.23.2023.08.19.03.17.13 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 19 Aug 2023 03:17:13 -0700 (PDT) Message-ID: Date: Sat, 19 Aug 2023 11:17:12 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Content-Language: en-US To: questions@freebsd.org References: <88d40ec4-1b5a-4d5e-b6f7-618a3b31fdbb@gmail.com> <835b25ff-81a5-6c18-f335-e8141c8da81a@gmail.com> <8987c03b-8630-48e2-a303-6bbd9ff1900f@FreeBSD.org> <940473ca-2052-a490-c4e0-56785b5de839@gmail.com> From: Graham Perrin Subject: glob, re_format(7) In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12f:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[questions@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RSZRd0W3nz3J8s On 15/08/2023 20:40, Kurt Hackenberg wrote: > On Tue, Aug 15, 2023 at 07:46:13PM +0100, Graham Perrin wrote: > >> Is there a good manual page alternative to >> ? > > That Wikipedia article describes the library functions fnmatch() and > glob(), which both exist and have man pages in FreeBSD (manual section > 3).  The shells also document their filename matching, in their man > pages. Obscurely, via for gstat(8) I stumbled into:     re_format(7) Not what I was seeking, originally, however it does contain much of what I want. The online view (above) is somewhat difficult to read due to the peculiar appearance of ` characters, there's no such problem when the page is viewed in a console or terminal. I could/should have found re_format(7) via the SEE ALSO section of regex(3), but I didn't get that far down the page because I was turned off by the preceding sections :-) From nobody Sun Aug 20 00:13:12 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSx0H2cGfz4qQ2P for ; Sun, 20 Aug 2023 00:13:19 +0000 (UTC) (envelope-from DtxdF@disroot.org) Received: from layka.disroot.org (layka.disroot.org [178.21.23.139]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSx0G3nKtz3bQy for ; Sun, 20 Aug 2023 00:13:18 +0000 (UTC) (envelope-from DtxdF@disroot.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=disroot.org header.s=mail header.b="bQ/n+Try"; spf=pass (mx1.freebsd.org: domain of DtxdF@disroot.org designates 178.21.23.139 as permitted sender) smtp.mailfrom=DtxdF@disroot.org; dmarc=pass (policy=reject) header.from=disroot.org Received: from localhost (localhost [127.0.0.1]) by disroot.org (Postfix) with ESMTP id B253740D62 for ; Sun, 20 Aug 2023 02:13:17 +0200 (CEST) X-Virus-Scanned: SPAM Filter at disroot.org Received: from layka.disroot.org ([127.0.0.1]) by localhost (disroot.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Bkm6d8KYPEes for ; Sun, 20 Aug 2023 02:13:16 +0200 (CEST) Date: Sun, 20 Aug 2023 00:13:12 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=disroot.org; s=mail; t=1692490396; bh=eGOfpCkpeVuO1Ee4uN2Ajt42951LDjVXwWV9CPDwpRo=; h=Date:From:To:Subject; b=bQ/n+TryKchLVqFb7u4ezCZAxp2qalBIsYk0ICtYxjM+QN9lej1p/IiKta4ct03UC fZ2HSSvhBoY+sZGxMdIWfHc05QciOn37FeI0a8LoR47/nTO523jXnveiMFf14gyp+S jvsu+hO3q592vhKBp2AZKG6faEjEXzSv1u05Jw4D0rNMQc2gFNNfQatzapLPH18XKw KNnoqqY4ztclpfypH9sCqeVRfMzlrzDEtAQ4pxdllLi6D4kUtwLKnL5F9gJFkZd2t/ GaE5d5NP+1WvopjHGzpNtvKXZ/S3Kvvc51EpRhc0E+siJCTEvraZoTfIAxZNtgxRRQ v99v8/c49kjCQ== From: DtxdF To: freebsd-questions@freebsd.org Subject: AppJail Image Mirror Message-ID: List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=----UH43UNAVPKMN5KGUXB6SF9M1WUF2F2 Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[disroot.org,reject]; R_SPF_ALLOW(-0.20)[+a:c]; R_DKIM_ALLOW(-0.20)[disroot.org:s=mail]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:50673, ipnet:178.21.23.0/24, country:NL]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[disroot.org:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RSx0G3nKtz3bQy ------UH43UNAVPKMN5KGUXB6SF9M1WUF2F2 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello everyone, I am writing this thread because I need help with my project, AppJail, spe= cifically, distributing its images=2E AppJail [1] is a tool to create, maintain and automate the creation of iso= lated environments using FreeBSD jails=2E This tool has a feature, images [= 2], that allows the user to export a jail in a portable way, just like Dock= er or pot have images=2E To create an image in an automated way, AppJail us= es Makejails [3], a text file that has the steps to create the jail=2E Ther= e are many Makejails in the centralized repository [4] and almost all of th= em have images=2E For months I have been using some third-party services: Anonfiles, Google = Drive, Dropbox, etc=2E, to distribute AppJail images=2E I was comfortable w= ith Anonfiles as it offered more resources than the project suite, but Anon= files is currently shutting down, so I'm using Google Drive in the meantime= =2E All images are updated weekly to keep up with pkgs updates=2E All images consume 4 GiB in total currently, but this is expected to grow = when 14=2E0-RELEASE is released=2E What I need is someone to bring me a way to upload (e=2Eg=2E: sftp) and an= HTTP server to distribute the images, since every week I need to update th= e images, the images need to be uploaded every week=2E I know I'm asking a lot, but any help is welcome=2E [1] https://github=2Ecom/DtxdF/AppJail [2] https://github=2Ecom/DtxdF/AppJail#images [3] https://github=2Ecom/DtxdF/AppJail#makejail [4] https://github=2Ecom/AppJail-makejails ------UH43UNAVPKMN5KGUXB6SF9M1WUF2F2 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Hello everyone,

I am wr= iting this thread because I need help with my project, AppJail, specificall= y, distributing its images=2E

AppJail [1] is a tool to create, maint= ain and automate the creation of isolated environments using FreeBSD jails= =2E This tool has a feature, images [2], that allows the user to export a j= ail in a portable way, just like Docker or pot have images=2E To create an = image in an automated way, AppJail uses Makejails [3], a text file that has= the steps to create the jail=2E There are many Makejails in the centralize= d repository [4] and almost all of them have images=2E

For months I = have been using some third-party services: Anonfiles, Google Drive, Dropbox= , etc=2E, to distribute AppJail images=2E I was comfortable with Anonfiles = as it offered more resources than the project suite, but Anonfiles is curre= ntly shutting down, so I'm using Google Drive in the meantime=2E

All= images are updated weekly to keep up with pkgs updates=2E

All image= s consume 4 GiB in total currently, but this is expected to grow when 14=2E= 0-RELEASE is released=2E

What I need is someone to bring me a way to= upload (e=2Eg=2E: sftp) and an HTTP server to distribute the images, since= every week I need to update the images, the images need to be uploaded eve= ry week=2E

I know I'm asking a lot, but any help is welcome=2E
[1] https://github=2Ecom/D= txdF/AppJail
[2] https://github=2Ecom/DtxdF/AppJail#images
[3] https://github=2Ecom/DtxdF/AppJail#mak= ejail
[4] https:/= /github=2Ecom/AppJail-makejails
------UH43UNAVPKMN5KGUXB6SF9M1WUF2F2-- From nobody Mon Aug 21 08:06:23 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTlRm1d7rz4qQJH for ; Mon, 21 Aug 2023 08:06:28 +0000 (UTC) (envelope-from chris@cretaforce.gr) Received: from relay4.cretaforce.gr (relay4.cretaforce.gr [195.201.253.147]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "*.cretaforce.gr", Issuer "RapidSSL TLS RSA CA G1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTlRk6dlZz3clM for ; Mon, 21 Aug 2023 08:06:26 +0000 (UTC) (envelope-from chris@cretaforce.gr) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cretaforce.gr header.s=cretaforce header.b=LSnQoz8e; spf=pass (mx1.freebsd.org: domain of chris@cretaforce.gr designates 195.201.253.147 as permitted sender) smtp.mailfrom=chris@cretaforce.gr; dmarc=pass (policy=none) header.from=cretaforce.gr Received: from server1.cretaforce.gr (server1.cretaforce.gr [94.130.217.104]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) client-signature RSA-PSS (2048 bits)) (Client CN "*.cretaforce.gr", Issuer "RapidSSL TLS RSA CA G1" (verified OK)) by smtp2.cretaforce.gr (Postfix) with ESMTPS id 3685D1FBA6 for ; Mon, 21 Aug 2023 11:06:25 +0300 (EEST) Received: from smtpclient.apple (unknown [80.107.124.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: chris@cretaforce.gr) by server1.cretaforce.gr (Postfix) with ESMTPSA id D77DDD5E6; Mon, 21 Aug 2023 11:06:24 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cretaforce.gr; s=cretaforce; t=1692605185; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=cNcos0u2vghYQpw1nAm8eRbR2psPqK3tSt6BfJ+YQoA=; b=LSnQoz8eqB7mhDW/dGGYW5PuN7NnE2SCh8tmBz0wzlX2oFRdqOQNP9d5WSDvAKTI4nnCYb HN0Zl2G3cper4tlMPqXSlVqseQhmsoXHzm1gMUbeJOnvMqokds9k2rUZwj6zdi8FVD3w20 3Wa2hlTIeNl8rL3R3lxzkjxuYGpd3zU= From: Christos Chatzaras Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Intel/AMD Downfall/Inception Vulnerabilities Message-Id: Date: Mon, 21 Aug 2023 11:06:23 +0300 Cc: FreeBSD To: freebsd-security@freebsd.org X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Result: default: False [-4.60 / 15.00]; DWL_DNSWL_LOW(-1.00)[cretaforce.gr:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[cretaforce.gr,none]; R_DKIM_ALLOW(-0.20)[cretaforce.gr:s=cretaforce]; R_SPF_ALLOW(-0.20)[+ip4:195.201.253.147:c]; RCVD_IN_DNSWL_LOW(-0.10)[195.201.253.147:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[94.130.217.104:server fail,80.107.124.177:server fail,195.201.253.147:server fail]; FREEFALL_USER(0.00)[chris]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[cretaforce.gr:+]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:24940, ipnet:195.201.0.0/16, country:DE]; RCVD_TLS_ALL(0.00)[] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4RTlRk6dlZz3clM Hello, There are security vulnerabilities in Intel and AMD processors. More information can be found at = https://www.openssl.org/blog/blog/2023/08/15/downfall/ It appears that changes are required both in the operating system code = and microcode/bios updates. If I remember correctly, when Spectre and Meltdown vulnerabilities were = disclosed in early 2018, there was significant controversy surrounding = the notification process. Several entities, including certain Linux = distributions and the FreeBSD project, were not informed as early as = some major tech companies. I am aware that work is currently being done for upcoming FreeBSD 14 = release and there may not be available human resources, but is there = anyone working on this? Kind regards, Christos Chatzaras= From nobody Mon Aug 21 11:46:18 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTrKc1p1qz4qfhk for ; Mon, 21 Aug 2023 11:46:28 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTrKZ54l5z4XV5 for ; Mon, 21 Aug 2023 11:46:26 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=xhqC0Mkp; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 7C40815C2C73 for ; Mon, 21 Aug 2023 12:46:19 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id NNMoZAt6yGi4 for ; Mon, 21 Aug 2023 12:46:19 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 0FF8915C2E18 for ; Mon, 21 Aug 2023 12:46:19 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com 0FF8915C2E18 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692618379; bh=BQl7d8SRMqXwg0Xmf10LOFTBbX2p+NDno7Qr/c+41FI=; h=Message-ID:Date:MIME-Version:To:From; b=xhqC0Mkp0O5gdrV9gFomFk0rTo2W0JMk9GRq8l0INJxqpR0idX6zkys4HFj6oLH3j w5/wq+ULbxQmUyjwiAUYrC6Oo4AAiwt/J2fiO9wo61LSq8WXjdr/+V0/f7SCF9UXLY 4U6GhjHTdEyKY5HeEMdSlOpUTpnNZncJmFpLpii+CWgtsOl9Wavvd6czCh1Ls1PH+n ERO5zNdvTlIWXR7jgFnUkzPBvGPmzMJzO4munGonH2KlGkZCnvX+Iidi6s/Qvj6xB9 nt3/Khze4DTrGb7rmyldL32jhYs1l9o+b7tpGs3iypuGKoPGQ09eNRzBePUb9wMJXE cCWy7UBufpYbA== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id AfqI-j8Lx4H9 for ; Mon, 21 Aug 2023 12:46:18 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id EEC2315C2C73 for ; Mon, 21 Aug 2023 12:46:18 +0100 (BST) Message-ID: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> Date: Mon, 21 Aug 2023 12:46:18 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Content-Language: en-US To: freebsd-questions@freebsd.org From: Kaya Saman Subject: ZFS Root size keeps going down after upgrade to 13.2-release Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTrKZ54l5z4XV5 Hi all, I have just upgraded my system from 13.1 -> 13.2 and now the maximum=20 file system size keeps going down and 'df' is showing as hardly any=20 space left on the drive? # df -h Filesystem=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Size=C2=A0=C2=A0=C2=A0 Used=C2=A0=C2= =A0 Avail Capacity=C2=A0=20 Mounted on zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 37G=C2=A0=C2=A0=C2=A0=C2=A0 36G=C2=A0=C2=A0=C2=A0 720M 98%=C2=A0=C2=A0=C2= =A0 / Yesterday when performing the upgrade I did notice this which happened=20 after deleting over 20GB of 'preview' files for one of my webapps in=20 /usr/local/www/ which is hosted by the apache2 port. The file system was=20 at around 97% yet after the 'rm -rf *' command the file system went to 10= 0%? Just as an FYI, it's the standard upgrade from the FAQ page: freebsd-update -r 13.2-RELEASE upgrade The root system is mirrored between two disks: =C2=A0=C2=A0=C2=A0 NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 STATE=C2= =A0=C2=A0=C2=A0=C2=A0 READ WRITE CKSUM =C2=A0=C2=A0 =C2=A0zroot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ONLINE=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2= =A0=C2=A0 0 =C2=A0=C2=A0 =C2=A0=C2=A0 mirror-0=C2=A0 ONLINE=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0 0 =C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 ada0p3=C2=A0 ONLINE=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0= 0 =C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0 ada1p3=C2=A0 ONLINE=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0= 0 Reading up a little I found a posting where someone had been trying to=20 delete snapshots which where taking up huge areas of space. Not the same=20 problem I think since the snapshots of upgrades do not take up that much=20 and I have already removed the larger obsolete snapshots containing=20 FreeBSD 12.x. Here is the output from 'zfs list -o space': zroot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0 107G 0B=C2=A0=C2=A0=20 2.20G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 105G zroot/ROOT=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 720M=C2=A0 88.5G 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 88.5G zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B The actual link I found that I mentioned above was this one:=20 https://forums.freebsd.org/threads/zfs-how-to-properly-remove-unnecessary= -snapshots-and-not-damage-data.85436/ in which here is the output of 'bectl list': # bectl list BE=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Active Mountpoint Space Created 13.1-RELEASE-p5_2023-08-20_220010 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 34.5M 2023-08-20 22:00 13.2-RELEASE-p2_2023-08-20_224534 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 9.56M 2023-08-20 22:45 default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 NR=C2=A0=C2=A0=C2=A0=C2=A0 /=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 88.5G 2018-08-07 02:53 What I really do not understand is why is the space getting smaller for=20 the file system 'size' and how do I regain it? I probably have deleted=20 around 40GB (of user based files) already yet nothing is showing up and=20 no space is clearing. I wonder if the recent update has done something=20 to the root pool? Would anyone be able to help on this one? Basically I just want to=20 create space again on the drive as currently I am unable to even fetch=20 the @ports collection with only 720M of disk space being shown as=20 left.... cleaning @ports should have given me quite a few GB spare but=20 nothing happening at all?? Many thanks. Kaya From nobody Mon Aug 21 11:47:38 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTrM349nNz4qgQh for ; Mon, 21 Aug 2023 11:47:43 +0000 (UTC) (envelope-from roger.marsh@btinternet.com) Received: from re-prd-fep-048.btinternet.com (mailomta25-re.btinternet.com [213.120.69.118]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTrM159FNz4YNX for ; Mon, 21 Aug 2023 11:47:41 +0000 (UTC) (envelope-from roger.marsh@btinternet.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=btinternet.com header.s=btmx201904 header.b=hreYPsME; spf=pass (mx1.freebsd.org: domain of roger.marsh@btinternet.com designates 213.120.69.118 as permitted sender) smtp.mailfrom=roger.marsh@btinternet.com; dmarc=pass (policy=reject) header.from=btinternet.com Received: from re-prd-rgout-002.btmx-prd.synchronoss.net ([10.2.54.5]) by re-prd-fep-048.btinternet.com with ESMTP id <20230821114740.SNBI17945.re-prd-fep-048.btinternet.com@re-prd-rgout-002.btmx-prd.synchronoss.net> for ; Mon, 21 Aug 2023 12:47:40 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=btinternet.com; s=btmx201904; t=1692618460; bh=ZBh3wxFtI7fg9zvgK3fgJogm5umWxWLFn3L/TceIbpc=; h=Date:From:To:Subject:Message-ID:X-Mailer:MIME-Version; b=hreYPsMEx3yIAjcvWdVcBVzP9PVVjRB+/cWHGfVxDxhyiQHg0O+KseRTAHya+c5k/KmocRGV5y34rety/LTILRnbXOnjsygznVS/y8ixKuDG3W2QEygIuJiTmaXKa1xq4VsMO3L6ZxaEXfW2qQrMhYUFxJ8FIz51VumSSQ2j95AqYslZ1QJkxx18ly0dH8HXXXLLT1/Ma+rhDdIfhzzmp3ijRg7eCsap9qnJLTyyrRY4xid0O9qUb/Evnrtu94BINLJtXxskpGMj3IAba3Ri4OvSbSfNPUtfPUtbDHFFNyDxvqpH2lMIPLTxgDX1fCZvRY/1nnfprk1K1Ko76HjL9g== X-SNCR-Rigid: 64D16FE601845999 X-Originating-IP: [80.229.151.92] X-OWM-Source-IP: 80.229.151.92 (GB) X-OWM-Env-Sender: roger.marsh@btinternet.com X-VadeSecure-score: verdict=clean score=0/300, class=clean X-RazorGate-Vade: gggruggvucftvghtrhhoucdtuddrgedviedrudduledggeegucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuueftkffvkffujffvgffngfevqffopdfqfgfvnecuuegrihhlohhuthemuceftddunecunecujfgurhepfffhvffukffogggtgfesthejredtredtvdenucfhrhhomheptfhoghgvrhcuofgrrhhshhcuoehrohhgvghrrdhmrghrshhhsegsthhinhhtvghrnhgvthdrtghomheqnecuggftrfgrthhtvghrnhepgfefffeltdfgfeegkeehheejleetteffueffkeeguedtiedttefhheevudfhjeeknecukfhppeektddrvddvledrudehuddrledvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehhvghlohepohhpvghnuggvvhdrhhhomhgvpdhinhgvthepkedtrddvvdelrdduhedurdelvddpmhgrihhlfhhrohhmpehrohhgvghrrdhmrghrshhhsegsthhinhhtvghrnhgvthdrtghomhdpnhgspghrtghpthhtohepuddprhgtphhtthhopehfrhgvvggsshguqdhquhgvshhtihhonhhssefhrhgvvgeuufffrdhorhhgpdhrvghvkffrpehrmhhsfigthhdrphhluhhsrdgtohhmpdgruhhthhgpuhhsvghrpehrohhgvghrrdhmrghrshhhsegsthhinhhtvghrnhgvthdrtghomhdpghgvohfkrfepifeupdfovfetjfhoshhtpehrvgdqphhrugdqrhhgohhuthdqtddtvd X-RazorGate-Vade-Verdict: clean 0 X-RazorGate-Vade-Classification: clean X-SNCR-hdrdom: btinternet.com Received: from opendev.home (80.229.151.92) by re-prd-rgout-002.btmx-prd.synchronoss.net (5.8.814.02) (authenticated as roger.marsh) id 64D16FE601845999 for freebsd-questions@FreeBSD.org; Mon, 21 Aug 2023 12:47:40 +0100 Date: Mon, 21 Aug 2023 11:47:38 +0000 From: Roger Marsh To: freebsd-questions@FreeBSD.org Subject: Running vscode via ssh Message-ID: <20230821114738.0701fd43@opendev.home> X-Mailer: Claws Mail 4.1.1 (GTK 3.24.37; x86_64-unknown-openbsd7.3) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[btinternet.com,reject]; R_SPF_ALLOW(-0.20)[+ip4:213.120.69.0/24]; R_DKIM_ALLOW(-0.20)[btinternet.com:s=btmx201904]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:2856, ipnet:213.120.0.0/14, country:GB]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[213.120.69.118:from]; DKIM_TRACE(0.00)[btinternet.com:+]; FREEMAIL_ENVFROM(0.00)[btinternet.com]; MLMMJ_DEST(0.00)[freebsd-questions@FreeBSD.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; HAS_XOIP(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_FROM(0.00)[btinternet.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; DWL_DNSWL_NONE(0.00)[btinternet.com:dkim] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTrM159FNz4YNX Hi, I installed vscode (on a freebsd installation) and confirmed it is usable by typing 'vscode' at the command prompt of a terminal started from the 'Exec exec xterm -title roger@freedev -e ssh -Y freedev' entry in the user .fvwmrc configuration file of an openbsd installation. Using the .fvwmrc entry 'Exec exec ssh -Y freedev vscode' gives a vscode window with the expected title and usable (fvwm) tools at top-left and top-right corner but a blank user area. 'ssh -X' was tried too, just in case vscode likes one but not the other, with the same outcome. Other applications, such as evince and idle3.9, just start from their entries like the one for vscode. Am I missing something particular to vscode or is the 'Exec exec ssh -Y freedev vscode' entry just not going to give a productive usable session? Roger From nobody Mon Aug 21 12:01:32 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTrgC3qdHz4qh3x for ; Mon, 21 Aug 2023 12:01:43 +0000 (UTC) (envelope-from 4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTrgB3MMgz4Zw7 for ; Mon, 21 Aug 2023 12:01:42 +0000 (UTC) (envelope-from 4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=VWrqPhe3; spf=pass (mx1.freebsd.org: domain of 4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1692619302; x=1695211302; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:to:from:date:x-thread-info:subject:to:from:cc:reply-to; bh=ERJC9BI7R1IEB1e5xpRo9h8yEyf1M5cba83P0x6Q5WA=; b=VWrqPhe3By6u++QL/8Vacnt0eudp7uXbl00i3WTJkqBTCgYY1jWdGbL2v/dMM0SvmapkuzxqcMYa160S5vkOEnCvOrz4Mgii6mSXxHdGM11RTar/sAyT/smFZXcAOu1qZfWRPeheJywFYnuL7p/7jOJLdnMsKvuCSyyP/uAPe6w= X-Thread-Info: NDI1MC4xMi4xZDUwNDAwMDBiYTIyOGUucXVlc3Rpb25zPWZyZWVic2Qub3Jn Received: from r2.us-west-2.aws.in.socketlabs.com (r2.us-west-2.aws.in.socketlabs.com [142.0.190.2]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Mon, 21 Aug 2023 08:01:36 -0400 Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r2.us-west-2.aws.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Mon, 21 Aug 2023 08:01:34 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qY3bB-0008oV-Lz for questions@freebsd.org; Mon, 21 Aug 2023 13:01:32 +0100 Date: Mon, 21 Aug 2023 13:01:32 +0100 From: Steve O'Hara-Smith To: questions@freebsd.org Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Message-Id: <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> In-Reply-To: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.1) X-Clacks-Overhead: "GNU Terry Pratchett" List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-2.70 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[142.0.190.2:received]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d5040000ba228e.5742682109d169d55bc3903bb06fbd6b@email-od.com]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[email-od.com:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[sohara.org]; DWL_DNSWL_NONE(0.00)[email-od.com:dkim] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RTrgB3MMgz4Zw7 On Mon, 21 Aug 2023 12:46:18 +0100 Kaya Saman wrote: > Yesterday when performing the upgrade I did notice this which happened > after deleting over 20GB of 'preview' files for one of my webapps in > /usr/local/www/ which is hosted by the apache2 port. The file system was > at around 97% yet after the 'rm -rf *' command the file system went to > 100%? There's probably at least one snapshot of that 20GB. -- Steve O'Hara-Smith From nobody Mon Aug 21 12:21:23 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTs5x6nMYz4qjRD for ; Mon, 21 Aug 2023 12:21:25 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTs5x1Z25z4cX1 for ; Mon, 21 Aug 2023 12:21:25 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=26blRDUE; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 4F3DE15C2E18 for ; Mon, 21 Aug 2023 13:21:24 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id Y5L8SX66_96D for ; Mon, 21 Aug 2023 13:21:24 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id EF15015C2E70 for ; Mon, 21 Aug 2023 13:21:23 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com EF15015C2E70 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692620484; bh=E02y3qJQkFtIwoanAfs8htWj//MbkCgGPdfAo4pRJZs=; h=Message-ID:Date:MIME-Version:To:From; b=26blRDUESUECYjFOGpTZiqirFqiPw8hhQlGRBdbCaiy7czFucnDsC7nwwI5+bAIk6 k4lNCYP6WA4pN0iEI8Xxt5rTVzodatPoQB6D1TL/naoDQ1oIuhA1jiik72at6R+CI5 qkUSquVgpxSz7OiH5wjf9Z3jy6W2oclxdzyrvVlzZ/l4ZgGcGusG+viLjEsjL2KpeK LuLSJHNj7l6zKt17hMwv7qt4yp1EDWBhD2do0mmcLiTnbGPBXr9GkWQG/dtsunNmwp vJbYgLt3LRi1JF/69W4/TcuT4AyHKF9uO8qq5SnbNcQEklszwz24q2CB010l3c7LVJ 4HZsctbOMAnBQ== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id 73p8H_BGhz7k for ; Mon, 21 Aug 2023 13:21:23 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id DA62115C2E18 for ; Mon, 21 Aug 2023 13:21:23 +0100 (BST) Message-ID: <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> Date: Mon, 21 Aug 2023 13:21:23 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> From: Kaya Saman In-Reply-To: <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTs5x1Z25z4cX1 On 8/21/23 13:01, Steve O'Hara-Smith wrote: > On Mon, 21 Aug 2023 12:46:18 +0100 > Kaya Saman wrote: > >> Yesterday when performing the upgrade I did notice this which happened >> after deleting over 20GB of 'preview' files for one of my webapps in >> /usr/local/www/ which is hosted by the apache2 port. The file system w= as >> at around 97% yet after the 'rm -rf *' command the file system went to >> 100%? > There's probably at least one snapshot of that 20GB. > Hmm.... thanks Steve. How to find it? Just reading through this right now:=20 https://docs.oracle.com/cd/E19253-01/819-5461/gbiqe/index.html issued: zfs list -t snapshot result is this: zroot/ROOT/default@2022-11-28-06:08:26-0=C2=A0=C2=A0 583M=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0 63.2G - zroot/ROOT/default@2022-11-28-06:38:48-0=C2=A0 11.4M=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0 63.1G - zroot/ROOT/default@2022-11-28-07:26:20-0=C2=A0 9.41M=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0 63.2G - zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0 34.5M=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0 78.2G - zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0 9.55M=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0 78.3G - Unless there is a snapshot that is on disk but not listed? # zfs list -ro space zroot/ROOT NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 AVAIL=C2=A0=C2=A0 USED USEDSNAP=C2=A0=20 USEDDS=C2=A0 USEDREFRESERV=C2=A0 USEDCHILD zroot/ROOT=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 720M=C2=A0 88.5G 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 88.5G zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0 88.5G 52.0G=C2=A0=C2=A0=20 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B I think 'default' is the snapshot in use currently. Regards, Kaya From nobody Mon Aug 21 12:28:16 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTsFy1cQgz4qjkX for ; Mon, 21 Aug 2023 12:28:22 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32c.google.com (mail-wm1-x32c.google.com [IPv6:2a00:1450:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTsFw5nbTz4f3P for ; Mon, 21 Aug 2023 12:28:20 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=nQrTTU2c; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32c as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x32c.google.com with SMTP id 5b1f17b1804b1-3feef504ccbso10527055e9.2 for ; Mon, 21 Aug 2023 05:28:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692620898; x=1693225698; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id:from :to:cc:subject:date:message-id:reply-to; bh=vaj8LMA/BNqQR109rDhmJM1BZJz8hLz5T3WNyZpPk+c=; b=nQrTTU2ctp/mKgn5MSynQrTZPEUNpWgiN5abTDiqMeSvdEBdKR0vZCNgWWzFYUYqRZ 3oUo4GytxOJc23dZilAEh1DrFNz65ktbkAMTKTiVr/Q+JJ+uccosxpKC3A0dQJM74OT7 H3iE3B52HgFHLzPspt4EjqfQvwcHf35mtRZIcbPZoh5goV9dyHIW9Erl3JfgZsX9wkB/ /2F29xJ4SvTYWRdkivBAL8x4nBr7D2VVQOWoLljDM/e+zMQMTYQk53LN2GoRzBI9J9GP 5FCzxMeGM/TgWPskoJViJ8f2kp0ytkWA6nvirN6lOd0NFYQK5TsmYvFtYMPUbHTpBltj gMqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692620898; x=1693225698; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=vaj8LMA/BNqQR109rDhmJM1BZJz8hLz5T3WNyZpPk+c=; b=S1ER6/3w+KXR8yHhSOKnu0bNSsVzlViJD+y4o19MJEf6dx5mab2Ctuf1cC/TPX2D7p 175KyGE28LdodOYOk+oYHagyx/m+qAvS67Ew9Llc2soduZfB8YOibV1JQ+/kWMPkDaAe 8WYKeftGF+eVp/edMbgA+c9AAjIAP8C9Q8Mchiv347Va7Q6KwSZ12yjc4tPs89tnUyfB 5q1d8qLxXyTTBbgGMjyUu2gL4dBW7YpBEajUjUYTsUm065/8103lbLbsc7gtkwpj5Cdp lnWuwHZ+MxRiOKSViKsxBcM97lPJHhYuhR3Hf/je9Obxfbp/loJ4hqhQN7ARfdzp6CIx e5qA== X-Gm-Message-State: AOJu0Yx8MZQgMYx75eE+SEKHCLBnUJhYzFjko0T82ciLwpfA+yo7UE5F ezVKa7HYeykI+eIAgWQzkBkDVddQpjE= X-Google-Smtp-Source: AGHT+IHa+pNGzuCo6H3xXEOtBxl/+PePZthjbz0adhLH8IZPo7Tz99MPezbpZ6cu/9PB6isSAUuotg== X-Received: by 2002:a05:600c:28b:b0:3fe:2108:eb8e with SMTP id 11-20020a05600c028b00b003fe2108eb8emr4926149wmk.34.1692620898399; Mon, 21 Aug 2023 05:28:18 -0700 (PDT) Received: from [194.81.204.27] (oa-mowa-01-194.81.204.27.brighton.ac.uk. [194.81.204.27]) by smtp.gmail.com with ESMTPSA id c1-20020a7bc001000000b003fee567235bsm8435905wmb.1.2023.08.21.05.28.17 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 21 Aug 2023 05:28:17 -0700 (PDT) Message-ID: Date: Mon, 21 Aug 2023 13:28:16 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> Content-Language: en-US From: Graham Perrin In-Reply-To: <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.969]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32c:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[questions@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTsFw5nbTz4f3P On 21/08/2023 13:21, Kaya Saman wrote: > I think 'default' is the snapshot in use currently. Initial orientation (you'll know this, already): bectl list | grep -e ' N' Try this, if you have not already: bectl list -s -c creation From nobody Mon Aug 21 12:32:53 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTsMC70lYz4qjnk for ; Mon, 21 Aug 2023 12:32:55 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTsMC01fCz4g8C for ; Mon, 21 Aug 2023 12:32:55 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=tlFdngSd; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 195E115C2C73 for ; Mon, 21 Aug 2023 13:32:54 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id uFqPJ69ZBcDd for ; Mon, 21 Aug 2023 13:32:53 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id BC9D915C2E18 for ; Mon, 21 Aug 2023 13:32:53 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com BC9D915C2E18 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692621173; bh=sDhKvsmWtX65yFZBWxK9QMnlcKUoBCeyu0f5wTKfsyk=; h=Message-ID:Date:MIME-Version:To:From; b=tlFdngSd5Ln1HYVga3i2DtMjZTlA0ncaFAlPKT05jfX4E4YMf6aqt9D+JIYY4gG0d /Cd3Vak4CL8fwIuv68BFAVRh4yRhMSccoBT/cIak+GdSkG36hJkoV57c/tQSKwUF+t OsaldUJwHn4uwWzvwuTp5sM79SZt68tDP0PtgztHDwHQnH2VT1lm/mXMJdynk1ITDF cLUYBmiC3iAIs7CFoBj0eX//JB+QgeXdvlV1F2S3oqaXj8eyRvSAw88QemvB2IH6QR L34TA+PlZslQiRrIiztpnN9521HC4TnEA/XIE6mM4Jx/sqSEI//iZImGSgvUHlWiAe IKiPFUxxQSvzQ== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id 6coMPWImVVJ2 for ; Mon, 21 Aug 2023 13:32:53 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id A959F15C2C73 for ; Mon, 21 Aug 2023 13:32:53 +0100 (BST) Message-ID: <3f71983d-9f00-dddb-a05a-03b4322cb423@optiplex-networks.com> Date: Mon, 21 Aug 2023 13:32:53 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> From: Kaya Saman In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTsMC01fCz4g8C On 8/21/23 13:28, Graham Perrin wrote: > On 21/08/2023 13:21, Kaya Saman wrote: >> I think 'default' is the snapshot in use currently.=20 > > > Initial orientation (you'll know this, already): > > bectl list | grep -e ' N' > > > Try this, if you have not already: > > bectl list -s -c creation > > Thought I've been using FreeBSD and ZFS for years I have actually never=20 used snapshots (in terms of having to work with them or manage them) so=20 this is new for me.... Outputs of commands: bectl list | grep -e ' N' default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 NR=C2=A0=C2=A0=C2=A0=C2=A0 /=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 88.5G 2018-08-07 02:53 bectl list -s -c creation BE/Dataset/Snapshot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Active Mountpoint Space=20 Created default =C2=A0 zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 NR=C2=A0=C2=A0=C2=A0=C2=A0 / 88.5G=20 2018-08-07 02:53 =C2=A0 default@2022-11-28-06:08:26-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 583M=C2=A0=20 2022-11-28 06:08 =C2=A0 default@2022-11-28-06:38:48-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 11.4M=20 2022-11-28 06:38 =C2=A0 default@2022-11-28-07:26:20-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 9.41M=20 2022-11-28 07:26 =C2=A0 default@2023-08-20-22:00:10-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 34.5M=20 2023-08-20 22:00 =C2=A0 default@2023-08-20-22:45:34-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 9.55M=20 2023-08-20 22:45 13.1-RELEASE-p5_2023-08-20_220010 =C2=A0 zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 -=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 - 8K=C2=A0=C2=A0=C2=A0=20 2023-08-20 22:00 =C2=A0=C2=A0=C2=A0 zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0=C2=A0 = -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - 34.5M=20 2023-08-20 22:00 13.2-RELEASE-p2_2023-08-20_224534 =C2=A0 zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 -=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 - 8K=C2=A0=C2=A0=C2=A0=20 2023-08-20 22:45 =C2=A0=C2=A0=C2=A0 zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0=C2=A0 = -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - 9.55M=20 2023-08-20 22:45 From nobody Mon Aug 21 12:45:21 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTsdb751wz4qkcp for ; Mon, 21 Aug 2023 12:45:23 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTsdb0llyz3D8H for ; Mon, 21 Aug 2023 12:45:23 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=L6tDyGEa; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 2951E15C2E7D for ; Mon, 21 Aug 2023 13:45:22 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id 9-n16JjEV6Dd for ; Mon, 21 Aug 2023 13:45:21 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id C318715C2E81 for ; Mon, 21 Aug 2023 13:45:21 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com C318715C2E81 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692621921; bh=+il2ouA1hY7ssHZ9pfqEjBM7iMBdADb3yEGjPI+1rDw=; h=Message-ID:Date:MIME-Version:To:From; b=L6tDyGEa69diRLnesz2oGQxuVHqQufN1LefGNHNGphFlVVLgJLuAe3a5VpVWU5gtX WAzutGQL1SJV2CpW8RYkQ/hle6JYYr+ZEVZJKQXQPFPjWRr3t9VbWYHFEl+d6qScdk skISVzrCjm5jm0Vh1qLEeFLpJcA5JRyjTWA/XmnHjb8XJm9cbXNzidFNoQWOEsAQI9 AlKu/Sy4kSk2OZHabnrAusvEH0+pxmAvnyTbE6dGad0EflPKWtcqA+75sy3R+lLPrS fJOWZWME6KLgC38e/PYQgeCLZiYBS6HOc5uNDg+OSkDyb4Bqczmbq8f/Kp+rA0/la4 lW8oIcPBjt1Qw== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id yQ1BCkgNG21N for ; Mon, 21 Aug 2023 13:45:21 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id ADF0C15C2E7D for ; Mon, 21 Aug 2023 13:45:21 +0100 (BST) Message-ID: <33a06143-e2d8-d44a-d7de-9d02d67179fd@optiplex-networks.com> Date: Mon, 21 Aug 2023 13:45:21 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <3f71983d-9f00-dddb-a05a-03b4322cb423@optiplex-networks.com> From: Kaya Saman In-Reply-To: <3f71983d-9f00-dddb-a05a-03b4322cb423@optiplex-networks.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTsdb0llyz3D8H On 8/21/23 13:32, Kaya Saman wrote: > > On 8/21/23 13:28, Graham Perrin wrote: >> On 21/08/2023 13:21, Kaya Saman wrote: >>> I think 'default' is the snapshot in use currently.=20 >> >> >> Initial orientation (you'll know this, already): >> >> bectl list | grep -e ' N' >> >> >> Try this, if you have not already: >> >> bectl list -s -c creation >> >> > > Thought I've been using FreeBSD and ZFS for years I have actually=20 > never used snapshots (in terms of having to work with them or manage=20 > them) so this is new for me.... > > > Outputs of commands: > > > bectl list | grep -e ' N' > default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 NR=C2=A0=C2=A0=C2=A0=C2=A0 /=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 88.5G 2018-08-07=20 > 02:53 > > > bectl list -s -c creation > BE/Dataset/Snapshot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Active Mountpoint Space=20 > Created > > default > =C2=A0 zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 NR=C2=A0=C2=A0=C2=A0=C2=A0 / 88.5G=20 > 2018-08-07 02:53 > =C2=A0 default@2022-11-28-06:08:26-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 583M=20 > 2022-11-28 06:08 > =C2=A0 default@2022-11-28-06:38:48-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 11.4M=20 > 2022-11-28 06:38 > =C2=A0 default@2022-11-28-07:26:20-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 9.41M=20 > 2022-11-28 07:26 > =C2=A0 default@2023-08-20-22:00:10-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 34.5M=20 > 2023-08-20 22:00 > =C2=A0 default@2023-08-20-22:45:34-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 9.55M=20 > 2023-08-20 22:45 > > 13.1-RELEASE-p5_2023-08-20_220010 > =C2=A0 zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 8K 2023-08-20=20 > 22:00 > =C2=A0=C2=A0=C2=A0 zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - 34.5M=20 > 2023-08-20 22:00 > > 13.2-RELEASE-p2_2023-08-20_224534 > =C2=A0 zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - 8K 2023-08-20=20 > 22:45 > =C2=A0=C2=A0=C2=A0 zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - 9.55M=20 > 2023-08-20 22:45 > > Just wondering here but could it be tmpfs that's causing this? df -h Filesystem=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Size=C2=A0=C2=A0=C2=A0 Used=C2=A0=C2= =A0 Avail Capacity=C2=A0=20 Mounted on zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 37G=C2=A0=C2=A0=C2=A0=C2=A0 36G=C2=A0=C2=A0=C2=A0 720M 98%=C2=A0=C2=A0=C2= =A0 / devfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1.0K=C2=A0=C2= =A0=C2=A0 1.0K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B 100%=C2=A0=C2=A0=C2=A0 /d= ev tmpfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 26G=C2= =A0=C2=A0=C2=A0 4.0K=C2=A0=C2=A0=C2=A0=C2=A0 26G 0%=C2=A0=C2=A0=C2=A0 /tm= p 26GB for /tmp ? From nobody Mon Aug 21 12:58:30 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTsws0VTHz4qlQj for ; Mon, 21 Aug 2023 12:58:37 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTswq5f5Lz3FZ7 for ; Mon, 21 Aug 2023 12:58:35 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=QBYfwmII; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32a as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x32a.google.com with SMTP id 5b1f17b1804b1-3fe4cdb72b9so31381485e9.0 for ; Mon, 21 Aug 2023 05:58:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692622713; x=1693227513; h=content-transfer-encoding:in-reply-to:subject:from:references:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=Ksqng1AXosnKTEYw6LQJmxKLfxr/4Hh3xSAW5mMDTXE=; b=QBYfwmII0xngkY1F016bbcmxpza6S97MzPPA57P6BdvJVYpqDPek3UnCsvn/SUXL5S BtpJKb1Dknz7XuoS7up0ihnHZ5UjP1irLPaPyLaWkUADnUdWrYodPjHd8d2cY68W2aAE ErKnGCQ0Bog8/vBtWPgtB+btQsXGOftK4S12cae7XoLTL5xWbFoGLLck7JtwymtQlwy4 nssp1T3QF6J+TT1U2rEHFShBvSNHXa2a7kX77Bsr+QdPBcxkX4tz1KwYPZPQYd25FUPa QzSQRBb1AGhvP3Owsc9Dtip4L/SiIcAbi+WAZWorC6ZtUkks+6Xoipsa8ARxRNwRjeKU QE/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692622713; x=1693227513; h=content-transfer-encoding:in-reply-to:subject:from:references:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Ksqng1AXosnKTEYw6LQJmxKLfxr/4Hh3xSAW5mMDTXE=; b=UC3SeGCA84ptpG+DUXyvsOSo9KAGHXxuaW+rS3s/t4xE77+MAtfPM9lENPOQqkTLEu qAQlsMATijG0UVVzD8m3lwarF64ZJOa3dv53zC2QxllL2sMB+k3mNkXaddPxI6d7of44 dSlr2Bi+zkl65DUNG5kVQKLL6HRkw8IQkTckfI6CRV84BYUidwVJthhpY4X/SkOCknda purP271O6pmEx557sSyZ0xMV8z3yn5QnDDAyY+zalgx38oafzL+c0LJG27NUK30rxcXH fG/bRW+EHZy19BiXUrc9QEHUB8DOJTNdhXdqy3gC/+NqQLwwsKKI7ylvFhGCnqhd6RZq K9Gw== X-Gm-Message-State: AOJu0YxE6MOmLx4MSWHKCPVuVFxlrnS4CtsMMFGTmqajtR8S/BL8A5Te /P7yysMHzFTeZfXzWhPWqCF322KppFE= X-Google-Smtp-Source: AGHT+IGQsyr1ckmBD7F2XAfshxf12rQtlMS+NdkdYNPrKsRwIJ3P8GIB+3X/jDzXsMeJ/i2MQezJTw== X-Received: by 2002:a7b:c4c9:0:b0:3fe:2b8c:9f0b with SMTP id g9-20020a7bc4c9000000b003fe2b8c9f0bmr4902039wmk.23.1692622712847; Mon, 21 Aug 2023 05:58:32 -0700 (PDT) Received: from [194.81.204.27] (oa-mowa-01-194.81.204.27.brighton.ac.uk. [194.81.204.27]) by smtp.gmail.com with ESMTPSA id a22-20020a05600c225600b003fed8e12d62sm10474666wmm.27.2023.08.21.05.58.31 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 21 Aug 2023 05:58:32 -0700 (PDT) Message-ID: <5867a6b1-6cdf-894d-0635-d7911c4a9ecc@gmail.com> Date: Mon, 21 Aug 2023 13:58:30 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <3f71983d-9f00-dddb-a05a-03b4322cb423@optiplex-networks.com> <33a06143-e2d8-d44a-d7de-9d02d67179fd@optiplex-networks.com> From: Graham Perrin Subject: tmpfs(5) (was: ZFS Root size keeps going down after upgrade to 13.2-release) In-Reply-To: <33a06143-e2d8-d44a-d7de-9d02d67179fd@optiplex-networks.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32a:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[questions@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTswq5f5Lz3FZ7 On 21/08/2023 13:45, Kaya Saman wrote: > … > > df -h > Filesystem                              Size    Used   Avail Capacity  > Mounted on > zroot/ROOT/default                       37G     36G    720M 98%    / > devfs                                   1.0K    1.0K      0B 100%    /dev > tmpfs                                    26G    4.0K     26G 0% /tmp > > > 26GB for /tmp ? Available, not used. From the (very) little that I know about tmpfs(5), I don't imagine this solving your puzzle about sizes in relation to boot environments. From nobody Mon Aug 21 13:05:36 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTt5039SMz4qlgD for ; Mon, 21 Aug 2023 13:05:40 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTt4z2RwCz3Gsj for ; Mon, 21 Aug 2023 13:05:39 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=hwyJCLJY; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id AA16F15C2E7B for ; Mon, 21 Aug 2023 14:05:36 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id NNlix76E8rT0 for ; Mon, 21 Aug 2023 14:05:36 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 5865315C2E82 for ; Mon, 21 Aug 2023 14:05:36 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com 5865315C2E82 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692623136; bh=HaGZi/krTKfM7S1wAvksP1Ss5NYTZ8S2nvLh+YRnLCg=; h=Message-ID:Date:MIME-Version:To:From; b=hwyJCLJYNYowVehLv8sCf9GUnY3gs93rQGJzeYVv4rcdoehS1xG874jkPeXbYtjyX zlqABnLFmt1BHdl23EQWUPXTyhiVcjPFt+0ogDHxIBfFu003bHJcH5tvmL2IMY4WmN ZO07VXRNsXSKxnj1zIHt2CQZKWXTEACKdKeFHC1pSRqNmsJZ5n574mZ1i6MuXt9KAG ZYKyaP32TUsk6kdW2NEFzwFEu7Uz9IAFMrjS7j/hchi3b3oidBInb/iOcFF/ySChgo 2FDT8C/ML28+0i0wtkyyyWlmQQDrgDylsYyd2Mf6Hh+aw9BrG5y2/+VxNPlnfXGt3a y2amiLkednhzQ== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id l-Px5AGaCFjf for ; Mon, 21 Aug 2023 14:05:36 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 44ECF15C2E7B for ; Mon, 21 Aug 2023 14:05:36 +0100 (BST) Message-ID: <7acf71ee-375d-1ee3-4000-29ea5a821b2d@optiplex-networks.com> Date: Mon, 21 Aug 2023 14:05:36 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: tmpfs(5) (was: ZFS Root size keeps going down after upgrade to 13.2-release) Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <3f71983d-9f00-dddb-a05a-03b4322cb423@optiplex-networks.com> <33a06143-e2d8-d44a-d7de-9d02d67179fd@optiplex-networks.com> <5867a6b1-6cdf-894d-0635-d7911c4a9ecc@gmail.com> From: Kaya Saman In-Reply-To: <5867a6b1-6cdf-894d-0635-d7911c4a9ecc@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.976]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTt4z2RwCz3Gsj On 8/21/23 13:58, Graham Perrin wrote: > On 21/08/2023 13:45, Kaya Saman wrote: >> =E2=80=A6 >> >> df -h >> Filesystem=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Size=C2=A0=C2=A0=C2=A0 Used=C2=A0= =C2=A0 Avail=20 >> Capacity=C2=A0 Mounted on >> zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 37G=C2=A0=C2=A0=C2=A0=C2=A0 36G=C2=A0=C2=A0=C2=A0 720M 98%=C2=A0=C2=A0= =C2=A0 / >> devfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1.0K=C2=A0= =C2=A0=C2=A0 1.0K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B 100%=C2=A0=C2=A0=C2=A0= =20 >> /dev >> tmpfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 26G= =C2=A0=C2=A0=C2=A0 4.0K=C2=A0=C2=A0=C2=A0=C2=A0 26G 0% /tmp >> >> >> 26GB for /tmp ?=20 > > > Available, not used. > > From the (very) little that I know about tmpfs(5), I don't imagine=20 > this solving your puzzle about sizes in relation to boot environments. > > =20 > > > I did find this in the meantime:=20 https://forums.freebsd.org/threads/tmpfs-size-limit.26701/ in addition. Looks like /tmp is only 121MB in the file system while the rest is being=20 used by RAM. zroot/tmp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 121M=C2=A0=C2=A0 721M 121M=C2=A0 /tmp I do have this line in fstab: tmpfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 /tmp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 tmpfs rw,nosuid,mode=3D01777=C2=A0=C2= =A0=C2=A0=20 0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0 It still doesn't help in any case why deleting files strikes them off=20 the file list but doesn't touch the disk itself? Hopefully there will a solution down the line and hopefully I will learn=20 something too.... currently my mind seems to be blocked however, in=20 which direction to even approach this problem and especially what to=20 look at :-( From nobody Mon Aug 21 13:07:04 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTt77005yz4qldM for ; Mon, 21 Aug 2023 13:07:31 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTt764YSWz3HpM for ; Mon, 21 Aug 2023 13:07:30 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LD7E6d014072 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 15:07:20 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> Date: Mon, 21 Aug 2023 15:07:04 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTt764YSWz3HpM X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 14:21, Kaya Saman = wrote: > # zfs list -ro space zroot/ROOT > NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD > zroot/ROOT 720M 88.5G 0B 88K = 0B 88.5G > zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8K = 0B 0B > zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8K = 0B 0B > zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >=20 That last line seems to indicate there is 52.0 G used in snapshots of = zroot/ROOT/default and 36.5G in the dataset itself. Output of zfs list -o space -t snapshot |grep zroot/ROOT/default should = give a list of the snapshots and the sizes. Paul From nobody Mon Aug 21 13:14:31 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTtHG1qHgz4qm2Q for ; Mon, 21 Aug 2023 13:14:34 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTtHD62c1z3KMw for ; Mon, 21 Aug 2023 13:14:32 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=10MRuTZh; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 21A6615C2C73 for ; Mon, 21 Aug 2023 14:14:32 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id FzpCKyio4rD8 for ; Mon, 21 Aug 2023 14:14:31 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id C6C0B15C2E18 for ; Mon, 21 Aug 2023 14:14:31 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com C6C0B15C2E18 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692623671; bh=K8uHZtPcTiYeyWrgARn+P/3LbUnWSPuc1g7zCtJCJPA=; h=Message-ID:Date:MIME-Version:To:From; b=10MRuTZh2OAkefG1C/0YpX+OqFspAQ9wGqpqbL8IXB92fbx2uqFw/C95odzksYVRu Kxas17ezKJ29z3eIhKMHGB44obvHdzvFBz1nFp8tiK0HFgLi8ktM+Ag1DD8uYwVYmv Cx1giQJVa9qbiQFTv8ggXWHCFYePz4qGFG0HgEXMqKPKflG864Ep7nDkO0DWBRepGu m8vTCS1adginwOKYEXoDMkc6lhfztLtgwREJu6vQWDruGZXIy0+VrXMHR5KPiJBbBo SrTp3hHM3o56H0EnTZmmkRPADeGZLE3Qpdc0iTx2Ys0nIfhDenMLm97maO0v8esTeH TxmoNcIcayYQA== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id HZJxR97xfmAg for ; Mon, 21 Aug 2023 14:14:31 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id B391315C2C73 for ; Mon, 21 Aug 2023 14:14:31 +0100 (BST) Message-ID: Date: Mon, 21 Aug 2023 14:14:31 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> From: Kaya Saman In-Reply-To: <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTtHD62c1z3KMw On 8/21/23 14:07, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >> # zfs list -ro space zroot/ROOT >> NAME AVAIL USED USEDSNAP U= SEDDS USEDREFRESERV USEDCHILD >> zroot/ROOT 720M 88.5G 0B 88K = 0B 88.5G >> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8K = 0B 0B >> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8K = 0B 0B >> zroot/ROOT/default 720M 88.5G 52.0G 36.= 5G 0B 0B >> > That last line seems to indicate there is 52.0 G used in snapshots of z= root/ROOT/default and 36.5G in the dataset itself. > Output of zfs list -o space -t snapshot |grep zroot/ROOT/default shoul= d give a list of the snapshots and the sizes. > > Paul > > Thanks so much Paul.... I feel like I'm spinning around in circles=20 currently... There doesn't seem to be anything indicative of that space being used up? =C2=A0zfs list -o=C2=A0 space -t snapshot |grep zroot/ROOT/defaul zroot/ROOT/default@2022-11-28-06:08:26-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0=C2=A0 583M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2022-11-28-06:38:48-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 11.4M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2022-11-28-07:26:20-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.41M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 34.5M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.56M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - certainly not 52GB? From nobody Mon Aug 21 13:23:44 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTtV95zS3z4qmnM for ; Mon, 21 Aug 2023 13:24:01 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTtV94WVyz3Lkr for ; Mon, 21 Aug 2023 13:24:01 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LDNsBh014166 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 15:24:00 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: Date: Mon, 21 Aug 2023 15:23:44 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTtV94WVyz3Lkr X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >=20 >=20 > On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>=20 >>> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >>> # zfs list -ro space zroot/ROOT >>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>=20 >> That last line seems to indicate there is 52.0 G used in snapshots of = zroot/ROOT/default and 36.5G in the dataset itself. >> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default = should give a list of the snapshots and the sizes. >>=20 >> Paul >>=20 >>=20 >=20 > Thanks so much Paul.... I feel like I'm spinning around in circles = currently... >=20 >=20 > There doesn't seem to be anything indicative of that space being used = up? >=20 >=20 > zfs list -o space -t snapshot |grep zroot/ROOT/defaul > zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - > zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - > zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - > zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - > zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >=20 >=20 > certainly not 52GB? >=20 >=20 That=E2=80=99s definitely confusing. What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99 = and of 'zpool list -v zroot=E2=80=99=20 Paul From nobody Mon Aug 21 13:34:04 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTtjp3lBJz4qn79 for ; Mon, 21 Aug 2023 13:34:06 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTtjp2WP0z3Pfy for ; Mon, 21 Aug 2023 13:34:06 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 542B315C2C73; Mon, 21 Aug 2023 14:34:05 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id V8L5UEvspfQP; Mon, 21 Aug 2023 14:34:04 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id BD62615C2E18; Mon, 21 Aug 2023 14:34:04 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com BD62615C2E18 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692624844; bh=spjJzuRtNfrvfvicg0bsD3GlvDVHDU2rP90uyhpvxzE=; h=Message-ID:Date:MIME-Version:To:From; b=Ycl9FBbw7VcYC9vOM+iszPzFuBPlRttW/tM6MZtKVZ93AHreWld6jXJa6B5fcjfol OFZwEfpoRIS1oYjUh80y5qqW64rwe242QAn4g8GwEHRlLc5TJCPbp6fmrr5pO1Ts9H iYBgU/f6404aPalPsixcSHMAxP6M3aiDIZcZ9xPNaNL6bqmtGGDPafFrQb/lVz53t+ DznfegRyLvDhIhNiM2Q4ZUG+lWA7gocdw80i1U+k9wwcAsSeNE/HIgbwhYpVeoeP+V YqobPLaXdyOvvUYOfOstC9RMmciqJetNRxWPi4Y59RQUA+lhCkcdOUlWySWUKmkiCQ n+bVGNgYXU7bA== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id ZZ7tiwODt191; Mon, 21 Aug 2023 14:34:04 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id A14B215C2C73; Mon, 21 Aug 2023 14:34:04 +0100 (BST) Message-ID: <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> Date: Mon, 21 Aug 2023 14:34:04 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> From: Kaya Saman In-Reply-To: <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RTtjp2WP0z3Pfy X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 14:23, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >> >> >> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>> On 21 Aug 2023, at 14:21, Kaya Saman wrote: >>>> # zfs list -ro space zroot/ROOT >>>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>>> zroot/ROOT 720M 88.5G 0B 88= K 0B 88.5G >>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8= K 0B 0B >>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8= K 0B 0B >>>> zroot/ROOT/default 720M 88.5G 52.0G 3= 6.5G 0B 0B >>>> >>> That last line seems to indicate there is 52.0 G used in snapshots of= zroot/ROOT/default and 36.5G in the dataset itself. >>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default sho= uld give a list of the snapshots and the sizes. >>> >>> Paul >>> >>> >> Thanks so much Paul.... I feel like I'm spinning around in circles cur= rently... >> >> >> There doesn't seem to be anything indicative of that space being used = up? >> >> >> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >> >> >> certainly not 52GB? >> >> > That=E2=80=99s definitely confusing. > What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99 = and of 'zpool list -v zroot=E2=80=99 > > Paul > > Here are the outputs: zfs list -o space -r zroot NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 AVAIL=C2=A0=C2=A0 USED USEDSNAP=C2=A0=20 USEDDS=C2=A0 USEDREFRESERV=C2=A0 USEDCHILD zroot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0 107G 0B=C2=A0=C2=A0=20 2.20G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 105G zroot/ROOT=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 720M=C2=A0 88.5G 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 88.5G zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0=C2=A0 8K 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 8K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0 88.5G 52.0G=C2=A0=C2=A0=20 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/swap=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = 3.78G=C2=A0 6.19G 0B=C2=A0=C2=A0=20 3.11G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 3.08G=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/tmp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 720M=C2=A0=C2=A0 121M 0B=C2=A0=C2=A0=C2=A0=20 121M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/usr=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 720M=C2=A0 7.09G 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 7.09G zroot/usr/home=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0= =C2=A0 88K 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/usr/obj=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0= 4.75G 0B=C2=A0=C2=A0=20 4.75G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/usr/ports=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0 432K= 0B=C2=A0=C2=A0=C2=A0=20 176K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 256K zroot/usr/ports/distfiles=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 720M=C2=A0=C2=A0 168K 0B=C2=A0=C2=A0=C2=A0=20 168K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/usr/ports/packages=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 720M=C2=A0=C2=A0=C2=A0 88K 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/usr/src=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0= 2.35G 0B=C2=A0=C2=A0=20 2.35G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 720M=C2=A0 2.60G 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 2.60G zroot/var/audit=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0=C2=A0= 88K 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/backups=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0 141M 0B=C2=A0= =C2=A0=C2=A0=20 141M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/crash=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0=C2=A0= 88K 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/db=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2= =A0 1.69G 0B=C2=A0=C2=A0=20 1.59G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 94.8M zroot/var/db/pkg=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0 94.8M 0B=C2=A0= =C2=A0=20 94.8M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/empty=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0=C2=A0= 88K 0B=C2=A0=C2=A0=C2=A0=C2=A0=20 88K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/log=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0= =C2=A0 792M 0B=C2=A0=C2=A0=C2=A0=20 792M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/mail=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0 3.96= M 0B=C2=A0=C2=A0=20 3.96M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/run=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0= =C2=A0 248K 0B=C2=A0=C2=A0=C2=A0=20 248K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/var/tmp=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0= =C2=A0 672K 0B=C2=A0=C2=A0=C2=A0=20 672K=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B =C2=A0zpool list=C2=A0 -v zroot NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 SIZE=C2=A0 ALLOC=C2=A0= =C2=A0 FREE=C2=A0 CKPOINT=C2=A0 EXPANDSZ=C2=A0=C2=A0 FRAG=C2=A0=C2=A0=C2=A0= CAP=20 DEDUP=C2=A0=C2=A0=C2=A0 HEALTH=C2=A0 ALTROOT zroot=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 111G=C2=A0=C2=A0 104G=C2=A0= 7.22G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0 82%=C2=A0=C2=A0=C2=A0 93%=20 1.00x=C2=A0=C2=A0=C2=A0 ONLINE=C2=A0 - =C2=A0 mirror-0=C2=A0=C2=A0 111G=C2=A0=C2=A0 104G=C2=A0 7.22G=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0 82% 93.5%=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0 ONLINE =C2=A0=C2=A0=C2=A0 ada0p3=C2=A0=C2=A0 111G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=20 ONLINE =C2=A0=C2=A0=C2=A0 ada1p3=C2=A0=C2=A0 111G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2=A0=C2=A0=20 ONLINE From nobody Mon Aug 21 13:38:46 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTtqW5tvTz4qnDF for ; Mon, 21 Aug 2023 13:39:03 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTtqW4cFDz3QWC for ; Mon, 21 Aug 2023 13:39:03 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LDcufh014310 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 15:39:01 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> Date: Mon, 21 Aug 2023 15:38:46 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTtqW4cFDz3QWC X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 15:34, Kaya Saman = wrote: >=20 >=20 > On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>=20 >>> On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >>>=20 >>>=20 >>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >>>>> # zfs list -ro space zroot/ROOT >>>>> NAME AVAIL USED = USEDSNAP USEDDS USEDREFRESERV USEDCHILD >>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>>=20 >>>> That last line seems to indicate there is 52.0 G used in snapshots = of zroot/ROOT/default and 36.5G in the dataset itself. >>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default = should give a list of the snapshots and the sizes. >>>>=20 >>>> Paul >>>>=20 >>>>=20 >>> Thanks so much Paul.... I feel like I'm spinning around in circles = currently... >>>=20 >>>=20 >>> There doesn't seem to be anything indicative of that space being = used up? >>>=20 >>>=20 >>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>=20 >>>=20 >>> certainly not 52GB? >>>=20 >>>=20 >> That=E2=80=99s definitely confusing. >> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99 = and of 'zpool list -v zroot=E2=80=99 >>=20 >> Paul >>=20 >>=20 >=20 > Here are the outputs: >=20 >=20 > zfs list -o space -r zroot > NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD > zroot 720M 107G 0B 2.20G = 0B 105G > zroot/ROOT 720M 88.5G 0B 88K = 0B 88.5G > zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8K = 0B 0B > zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8K = 0B 0B > zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B > zroot/swap 3.78G 6.19G 0B 3.11G = 3.08G 0B > zroot/tmp 720M 121M 0B 121M = 0B 0B > zroot/usr 720M 7.09G 0B 88K = 0B 7.09G > zroot/usr/home 720M 88K 0B 88K = 0B 0B > zroot/usr/obj 720M 4.75G 0B 4.75G = 0B 0B > zroot/usr/ports 720M 432K 0B 176K = 0B 256K > zroot/usr/ports/distfiles 720M 168K 0B 168K = 0B 0B > zroot/usr/ports/packages 720M 88K 0B 88K = 0B 0B > zroot/usr/src 720M 2.35G 0B 2.35G = 0B 0B > zroot/var 720M 2.60G 0B 88K = 0B 2.60G > zroot/var/audit 720M 88K 0B 88K = 0B 0B > zroot/var/backups 720M 141M 0B 141M = 0B 0B > zroot/var/crash 720M 88K 0B 88K = 0B 0B > zroot/var/db 720M 1.69G 0B 1.59G = 0B 94.8M > zroot/var/db/pkg 720M 94.8M 0B 94.8M = 0B 0B > zroot/var/empty 720M 88K 0B 88K = 0B 0B > zroot/var/log 720M 792M 0B 792M = 0B 0B > zroot/var/mail 720M 3.96M 0B 3.96M = 0B 0B > zroot/var/run 720M 248K 0B 248K = 0B 0B > zroot/var/tmp 720M 672K 0B 672K = 0B 0B >=20 >=20 > zpool list -v zroot > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP = HEALTH ALTROOT > zroot 111G 104G 7.22G - - 82% 93% 1.00x = ONLINE - > mirror-0 111G 104G 7.22G - - 82% 93.5% - = ONLINE > ada0p3 111G - - - - - - - = ONLINE > ada1p3 111G - - - - - - - = ONLINE >=20 Those look quite normal. What about 'zfs list -r -t all -o space = zroot/ROOT/default=E2=80=99 ? Paul From nobody Mon Aug 21 13:41:49 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTttk6jSrz4qngY for ; Mon, 21 Aug 2023 13:41:50 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTttk5pqyz3RXn for ; Mon, 21 Aug 2023 13:41:50 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id DF60615C2E82; Mon, 21 Aug 2023 14:41:49 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id OqhNhlmJlrt9; Mon, 21 Aug 2023 14:41:49 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 677CE15C2EB5; Mon, 21 Aug 2023 14:41:49 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com 677CE15C2EB5 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692625309; bh=XtcwpOv/sT/UgzDHImF/4b2uaOzoqfxG/c92wK6jR98=; h=Message-ID:Date:MIME-Version:To:From; b=RNrfAKr7sdCnRUXW9xOssc0vmBQOZGdsEQ7oeFP9kdLCf3yP03KWggEBOcf9XJFUJ tNBpQ0fs9A/BtYmlxK9AOdoAqMVcA/LZ5i42Xd7KiBZlPdMTL9k4BN69OTVPO3ROXA thMss8tO55+4b7TINh5beWX6crgGCA2ksojMyXpkb8fqKFsyq9aO5N4o132Fk6emGJ /LmYsSVTsOs0HjvkaTPGqsKIEOyaBV9xkRk1P2HaYk7G74SQJYL5nYvCgc950v6RgO jS36rFo7ArdxgCJx0zEtb3tW7kkIMzxox/Ha07XDFDj6EB0uwf9sGuv6M9+lPwPSpr rhJEYBCIooqVA== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id cJ2rbmhgpw_E; Mon, 21 Aug 2023 14:41:49 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 4F7B015C2E82; Mon, 21 Aug 2023 14:41:49 +0100 (BST) Message-ID: Date: Mon, 21 Aug 2023 14:41:49 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> From: Kaya Saman In-Reply-To: <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RTttk5pqyz3RXn X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 14:38, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 15:34, Kaya Saman = wrote: >> >> >> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>> On 21 Aug 2023, at 15:14, Kaya Saman wrote: >>>> >>>> >>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>> On 21 Aug 2023, at 14:21, Kaya Saman wrote: >>>>>> # zfs list -ro space zroot/ROOT >>>>>> NAME AVAIL USED USEDSNA= P USEDDS USEDREFRESERV USEDCHILD >>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>>> >>>>> That last line seems to indicate there is 52.0 G used in snapshots = of zroot/ROOT/default and 36.5G in the dataset itself. >>>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default s= hould give a list of the snapshots and the sizes. >>>>> >>>>> Paul >>>>> >>>>> >>>> Thanks so much Paul.... I feel like I'm spinning around in circles c= urrently... >>>> >>>> >>>> There doesn't seem to be anything indicative of that space being use= d up? >>>> >>>> >>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>> >>>> >>>> certainly not 52GB? >>>> >>>> >>> That=E2=80=99s definitely confusing. >>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99= and of 'zpool list -v zroot=E2=80=99 >>> >>> Paul >>> >>> >> Here are the outputs: >> >> >> zfs list -o space -r zroot >> NAME AVAIL USED USEDSNAP U= SEDDS USEDREFRESERV USEDCHILD >> zroot 720M 107G 0B 2.20G = 0B 105G >> zroot/ROOT 720M 88.5G 0B 88K = 0B 88.5G >> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8K = 0B 0B >> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8K = 0B 0B >> zroot/ROOT/default 720M 88.5G 52.0G 36.= 5G 0B 0B >> zroot/swap 3.78G 6.19G 0B 3.11G = 3.08G 0B >> zroot/tmp 720M 121M 0B 121M = 0B 0B >> zroot/usr 720M 7.09G 0B 88K = 0B 7.09G >> zroot/usr/home 720M 88K 0B 88K = 0B 0B >> zroot/usr/obj 720M 4.75G 0B 4.75G = 0B 0B >> zroot/usr/ports 720M 432K 0B 176K = 0B 256K >> zroot/usr/ports/distfiles 720M 168K 0B 168K = 0B 0B >> zroot/usr/ports/packages 720M 88K 0B 88K = 0B 0B >> zroot/usr/src 720M 2.35G 0B 2.35G = 0B 0B >> zroot/var 720M 2.60G 0B 88K = 0B 2.60G >> zroot/var/audit 720M 88K 0B 88K = 0B 0B >> zroot/var/backups 720M 141M 0B 141M = 0B 0B >> zroot/var/crash 720M 88K 0B 88K = 0B 0B >> zroot/var/db 720M 1.69G 0B 1.59G = 0B 94.8M >> zroot/var/db/pkg 720M 94.8M 0B 94.8M = 0B 0B >> zroot/var/empty 720M 88K 0B 88K = 0B 0B >> zroot/var/log 720M 792M 0B 792M = 0B 0B >> zroot/var/mail 720M 3.96M 0B 3.96M = 0B 0B >> zroot/var/run 720M 248K 0B 248K = 0B 0B >> zroot/var/tmp 720M 672K 0B 672K = 0B 0B >> >> >> zpool list -v zroot >> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP= HEALTH ALTROOT >> zroot 111G 104G 7.22G - - 82% 93% 1.00x= ONLINE - >> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >> ada0p3 111G - - - - - - - = ONLINE >> ada1p3 111G - - - - - - - = ONLINE >> > > Those look quite normal. What about 'zfs list -r -t all -o space zroot/= ROOT/default=E2=80=99 ? > > Paul > > > zfs list -r -t all -o space zroot/ROOT/default NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 AVAIL=C2=A0=C2=A0 USED=C2=A0 USEDSNAP USEDDS=C2=A0=20 USEDREFRESERV=C2=A0 USEDCHILD zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 720M=C2=A0 88.5G=C2=A0=C2=A0=C2=A0=C2=A0 52.0G=20 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B zroot/ROOT/default@2022-11-28-06:08:26-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0=C2=A0 583M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2022-11-28-06:38:48-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 11.4M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2022-11-28-07:26:20-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.41M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 34.5M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.56M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - Strange! It shows a 52GB 'claimed' snapshot but where is it? From nobody Mon Aug 21 13:44:14 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTtxZ5rL6z4qnmt for ; Mon, 21 Aug 2023 13:44:18 +0000 (UTC) (envelope-from ipluta@wp.pl) Received: from mx4.wp.pl (mx4.wp.pl [212.77.101.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTtxZ2rqSz3SpD for ; Mon, 21 Aug 2023 13:44:18 +0000 (UTC) (envelope-from ipluta@wp.pl) Authentication-Results: mx1.freebsd.org; none Received: (wp-smtpd smtp.wp.pl 18967 invoked from network); 21 Aug 2023 15:44:14 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wp.pl; s=1024a; t=1692625454; bh=e0Erj2coYw3cx413VpN1AtjhmeY+HCm5LTKK7G7tN8E=; h=Subject:To:Cc:From; b=hmUYKEJnxIcRnPwHZIROGesIsehlLP0HfjiwDU5y0bNU5/aOCkaVkYEhobkuA5eC+ gHTtDKqhKIG+CJ4gxkXlmdY5kSITeFGyXeB6IJxyy+S494rSwUrbPl08lAlfGPLv8b IUCfOJTzhFjKM4R+Ei2VFwjr8oE5JuRB26Am+bK0= Received: from 78-11-36-98.cmr.net.pl (HELO [192.168.1.129]) (ipluta@wp.pl@[78.11.36.98]) (envelope-sender ) by smtp.wp.pl (WP-SMTPD) with ECDHE-RSA-AES256-GCM-SHA384 encrypted SMTP for ; 21 Aug 2023 15:44:14 +0200 Message-ID: <9d07a668-c876-2295-8234-95d1f9d5f5c2@wp.pl> Date: Mon, 21 Aug 2023 15:44:14 +0200 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: pl-PL To: Kaya Saman , freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> From: "Ireneusz Pluta/wp.pl" In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-WP-MailID: a0844dd1e0d613f1d868519f254f9df8 X-WP-AV: skaner antywirusowy Poczty Wirtualnej Polski X-WP-SPAM: NO 000000B [4UME] X-Rspamd-Queue-Id: 4RTtxZ2rqSz3SpD X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12827, ipnet:212.77.101.0/24, country:PL] W dniu 21.08.2023 o 15:41, Kaya Saman pisze: > It shows a 52GB 'claimed' snapshot but where is it? at "-o refer" From nobody Mon Aug 21 13:49:35 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTv4063W8z4qpBj for ; Mon, 21 Aug 2023 13:49:52 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTv404svgz3Tqb for ; Mon, 21 Aug 2023 13:49:52 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LDnjwq014396 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 15:49:51 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: Date: Mon, 21 Aug 2023 15:49:35 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTv404svgz3Tqb X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 15:41, Kaya Saman = wrote: >=20 >=20 > On 8/21/23 14:38, freebsd@vanderzwan.org wrote: >>=20 >>> On 21 Aug 2023, at 15:34, Kaya Saman = wrote: >>>=20 >>>=20 >>> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>>> On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >>>>>=20 >>>>>=20 >>>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>>> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >>>>>>> # zfs list -ro space zroot/ROOT >>>>>>> NAME AVAIL USED = USEDSNAP USEDDS USEDREFRESERV USEDCHILD >>>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>>>>=20 >>>>>> That last line seems to indicate there is 52.0 G used in = snapshots of zroot/ROOT/default and 36.5G in the dataset itself. >>>>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default = should give a list of the snapshots and the sizes. >>>>>>=20 >>>>>> Paul >>>>>>=20 >>>>>>=20 >>>>> Thanks so much Paul.... I feel like I'm spinning around in circles = currently... >>>>>=20 >>>>>=20 >>>>> There doesn't seem to be anything indicative of that space being = used up? >>>>>=20 >>>>>=20 >>>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>>>=20 >>>>>=20 >>>>> certainly not 52GB? >>>>>=20 >>>>>=20 >>>> That=E2=80=99s definitely confusing. >>>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80=99= and of 'zpool list -v zroot=E2=80=99 >>>>=20 >>>> Paul >>>>=20 >>>>=20 >>> Here are the outputs: >>>=20 >>>=20 >>> zfs list -o space -r zroot >>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>> zroot 720M 107G 0B = 2.20G 0B 105G >>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>> zroot/swap 3.78G 6.19G 0B = 3.11G 3.08G 0B >>> zroot/tmp 720M 121M 0B = 121M 0B 0B >>> zroot/usr 720M 7.09G 0B = 88K 0B 7.09G >>> zroot/usr/home 720M 88K 0B = 88K 0B 0B >>> zroot/usr/obj 720M 4.75G 0B = 4.75G 0B 0B >>> zroot/usr/ports 720M 432K 0B = 176K 0B 256K >>> zroot/usr/ports/distfiles 720M 168K 0B = 168K 0B 0B >>> zroot/usr/ports/packages 720M 88K 0B = 88K 0B 0B >>> zroot/usr/src 720M 2.35G 0B = 2.35G 0B 0B >>> zroot/var 720M 2.60G 0B = 88K 0B 2.60G >>> zroot/var/audit 720M 88K 0B = 88K 0B 0B >>> zroot/var/backups 720M 141M 0B = 141M 0B 0B >>> zroot/var/crash 720M 88K 0B = 88K 0B 0B >>> zroot/var/db 720M 1.69G 0B = 1.59G 0B 94.8M >>> zroot/var/db/pkg 720M 94.8M 0B = 94.8M 0B 0B >>> zroot/var/empty 720M 88K 0B = 88K 0B 0B >>> zroot/var/log 720M 792M 0B = 792M 0B 0B >>> zroot/var/mail 720M 3.96M 0B = 3.96M 0B 0B >>> zroot/var/run 720M 248K 0B = 248K 0B 0B >>> zroot/var/tmp 720M 672K 0B = 672K 0B 0B >>>=20 >>>=20 >>> zpool list -v zroot >>> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP = DEDUP HEALTH ALTROOT >>> zroot 111G 104G 7.22G - - 82% 93% = 1.00x ONLINE - >>> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >>> ada0p3 111G - - - - - - - = ONLINE >>> ada1p3 111G - - - - - - - = ONLINE >>>=20 >>=20 >> Those look quite normal. What about 'zfs list -r -t all -o space = zroot/ROOT/default=E2=80=99 ? >>=20 >> Paul >>=20 >>=20 >>=20 >=20 > zfs list -r -t all -o space zroot/ROOT/default > NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD > zroot/ROOT/default 720M 88.5G 52.0G 36.5G = 0B 0B > zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - > zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - > zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - > zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - > zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >=20 >=20 > Strange! It shows a 52GB 'claimed' snapshot but where is it? >=20 >=20 Can you give output of 'zfs get all zroot/ROOT/default=E2=80=99 as well = ? Maybe that gives a hint. Paul From nobody Mon Aug 21 13:51:03 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTv5P5R8rz4qp5n for ; Mon, 21 Aug 2023 13:51:05 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTv5N45Nlz3Vb8 for ; Mon, 21 Aug 2023 13:51:04 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=optiplex-networks.com header.s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997 header.b=Xi3FH9RQ; spf=pass (mx1.freebsd.org: domain of kayasaman@optiplex-networks.com designates 45.149.190.182 as permitted sender) smtp.mailfrom=kayasaman@optiplex-networks.com; dmarc=pass (policy=quarantine) header.from=optiplex-networks.com Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id AA74715C2E70 for ; Mon, 21 Aug 2023 14:51:03 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id NokccMFfQZi5 for ; Mon, 21 Aug 2023 14:51:03 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 4B3D015C2E7B for ; Mon, 21 Aug 2023 14:51:03 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com 4B3D015C2E7B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692625863; bh=3Bk7xWTK3+vIVGUtLVUIP22MPJ7NuqnU06tJ2WGAvvc=; h=Message-ID:Date:MIME-Version:To:From; b=Xi3FH9RQqddBh1V4IQ1Q0EDPuRlGXT8PfkOzrF0iCxrRImOZidva+9nqHu7yhO5B4 CXAJgDwHqSsLNDrN2b+ZuSbvtSqOckUSOrnL/fFLyX3se/4A9tn2q9FyDHSDroNVkl JO9oadUu+TKivV51seqp7evJLVXLIO1Cfg9uChzwHocb376br4p1glvtYms6eiOsN7 um/dbsNjNnaoBnEMB0gu/LRH0M+w+wbcrThzHTAvb8nf+9UKQJ9j7PYtbse/xw9MHB cdNbh4yUimaJwL80uyLrBVk5i0VFqdpxvRlCBnqT2r2WVssiRYVThxNeotzFWWb8lV /ijNCOmXw9NKA== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id mZicFgM-fxKT for ; Mon, 21 Aug 2023 14:51:03 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 372C915C2E70 for ; Mon, 21 Aug 2023 14:51:03 +0100 (BST) Message-ID: <46f0c9a4-b21a-8ed0-150b-285459101363@optiplex-networks.com> Date: Mon, 21 Aug 2023 14:51:03 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <9d07a668-c876-2295-8234-95d1f9d5f5c2@wp.pl> From: Kaya Saman In-Reply-To: <9d07a668-c876-2295-8234-95d1f9d5f5c2@wp.pl> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[optiplex-networks.com,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[optiplex-networks.com:s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[optiplex-networks.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; ARC_NA(0.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RTv5N45Nlz3Vb8 On 8/21/23 14:44, Ireneusz Pluta/wp.pl wrote: > > W dniu 21.08.2023 o=C2=A015:41, Kaya Saman pisze: >> It shows a 52GB 'claimed' snapshot but where is it?=20 > at "-o refer" Here is the output using the 'refer' switch: zfs list -r -t all -o space,refer zroot/ROOT/default NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 AVAIL=C2=A0=C2=A0 USED=C2=A0 USEDSNAP USEDDS=C2=A0=20 USEDREFRESERV=C2=A0 USEDCHILD=C2=A0=C2=A0=C2=A0=C2=A0 REFER zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 720M=C2=A0 88.5G=C2=A0=C2=A0=C2=A0=C2=A0 52.0G=20 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0B=C2=A0=C2=A0=C2=A0= =C2=A0 36.5G zroot/ROOT/default@2022-11-28-06:08:26-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0=C2=A0 583M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2= =A0=C2=A0=C2=A0 63.2G zroot/ROOT/default@2022-11-28-06:38:48-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 11.4M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2= =A0=C2=A0=C2=A0 63.1G zroot/ROOT/default@2022-11-28-07:26:20-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.41M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2= =A0=C2=A0=C2=A0 63.2G zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 34.5M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2= =A0=C2=A0=C2=A0 78.2G zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2= =A0 9.56M -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 -=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 -=C2=A0=C2= =A0=C2=A0=C2=A0 78.3G I still don't understand how to free this space up? I could delete the=20 snapshots dated from 2022 but will that clean anything from the=20 filesystem itself? Or will it just free up the few MB under the=20 'USEDSNAP' heading? From nobody Mon Aug 21 13:51:26 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTv605Wv4z4qnp9 for ; Mon, 21 Aug 2023 13:51:36 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Received: from smtp2-g21.free.fr (smtp2-g21.free.fr [212.27.42.2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTv603DgDz3Wr7 for ; Mon, 21 Aug 2023 13:51:36 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Authentication-Results: mx1.freebsd.org; none Received: from ravel.localnet (unknown [90.118.140.172]) (Authenticated sender: olivier.freebsd@free.fr) by smtp2-g21.free.fr (Postfix) with ESMTPSA id F1EA1200417; Mon, 21 Aug 2023 15:51:26 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=free.fr; s=smtp-20201208; t=1692625888; bh=f3Np9xNRJSiNNUlDUfqMLCXFdUyah+bYV3zAYs1+yOI=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=DqR/rCkcyRg0jkWk9O914tHSuXfKEyA7V8l3ukzDyLH7qcI1L99cbzo9aZuHeYYHY WBn4bMj16/nT6TJksILSWcrwjXE53tipWJeGOvoKewjENsRfahrH30NJwF2a0bDPg6 tldpp1b4t3t3TaWMkKvC0pNS3Ow6BGTjZyV2Dp63R8ePy1f4ra/glci/P8ZBF+KOQ3 hjLtvOGV+EAQQylUsnahsfhhJBIPuNtxIRx9Tg98ziPz1LHTThNz2GP+dgzj95wgTi yCzhhm8gg2AhCdtBEJLbI/hZRoBECN4p9MMrXAK+PNMwuaYg4ajucyUTenbZmDgJCy lEKOQ2mjTnqug== From: Olivier Certner To: questions@freebsd.org Cc: Kaya Saman Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Date: Mon, 21 Aug 2023 15:51:26 +0200 Message-ID: <2972906.hHqAuc6tWs@ravel> In-Reply-To: References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4RTv603DgDz3Wr7 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12322, ipnet:212.27.32.0/19, country:FR] Hi, > There doesn't seem to be anything indicative of that space being used up? Unfortunately, ZFS only reports in USED for snapshots the space that is *unique* to the corresponding snapshot, but not the space common to several ones of them, which could be freeable if it is not shared with the dataset itself. Use, e.g., "zfs list -o space " to see the amount of space taken by snapshots (USEDSNAP column). For something more granular, you can also use "zfs get written " to see the amount of new data since the previous snapshot (there is also written@, see zfsprops(7)). Regards. -- Olivier Certner From nobody Mon Aug 21 13:52:06 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTv6c26fFz4qnpF for ; Mon, 21 Aug 2023 13:52:08 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTv6c0pFrz3Xl1 for ; Mon, 21 Aug 2023 13:52:08 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 4395E15C2E70; Mon, 21 Aug 2023 14:52:07 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id Gqqd4Xi8fvQt; Mon, 21 Aug 2023 14:52:06 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 8216115C2E7B; Mon, 21 Aug 2023 14:52:06 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com 8216115C2E7B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692625926; bh=7V9ug6sFhFkMq+8EvZUQB+UGo/91CeRZAe1gSsGE3m4=; h=Message-ID:Date:MIME-Version:To:From; b=29WhF0byWpDbq1lgLGlZsFYgRYRu6uDFVDo6g0FHRhS310R681stPxCiFJrEHdRnW FThPZ0oSC3G+ecmm/vEGeT74/k7IRACasqnowwdSslvT96l2yztWcvjw31baW4jiDi ZoHCG2axWoiyaFUUTwEw5djfjyNHOxylShSG/s0SmYQwL7j3dAYD3BZ51zPjD6Wx8d LFrDIk5rUD7MypKhoqFHtbSWsjK7YcJK8F6HdrKc89461x+S/EjRNx+hp763n7b9e1 n6aNR4f+LJCTtavzzpsbYs3c+5nos+9sb6x+lxuha9IhPWdxcjpgV0eFc7JBM9v4MT 8JAyfBNJK6+Pg== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id 8SucVo4SSSvb; Mon, 21 Aug 2023 14:52:06 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 69B6915C2E70; Mon, 21 Aug 2023 14:52:06 +0100 (BST) Message-ID: Date: Mon, 21 Aug 2023 14:52:06 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> From: Kaya Saman In-Reply-To: <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RTv6c0pFrz3Xl1 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 14:49, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 15:41, Kaya Saman = wrote: >> >> >> On 8/21/23 14:38, freebsd@vanderzwan.org wrote: >>>> On 21 Aug 2023, at 15:34, Kaya Saman wrote: >>>> >>>> >>>> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>>>> On 21 Aug 2023, at 15:14, Kaya Saman wrote: >>>>>> >>>>>> >>>>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>>>> On 21 Aug 2023, at 14:21, Kaya Saman wrote: >>>>>>>> # zfs list -ro space zroot/ROOT >>>>>>>> NAME AVAIL USED USEDS= NAP USEDDS USEDREFRESERV USEDCHILD >>>>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>>>> zroot/ROOT/default 720M 88.5G 52.0G= 36.5G 0B 0B >>>>>>>> >>>>>>> That last line seems to indicate there is 52.0 G used in snapshot= s of zroot/ROOT/default and 36.5G in the dataset itself. >>>>>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/default= should give a list of the snapshots and the sizes. >>>>>>> >>>>>>> Paul >>>>>>> >>>>>>> >>>>>> Thanks so much Paul.... I feel like I'm spinning around in circles= currently... >>>>>> >>>>>> >>>>>> There doesn't seem to be anything indicative of that space being u= sed up? >>>>>> >>>>>> >>>>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>>>> >>>>>> >>>>>> certainly not 52GB? >>>>>> >>>>>> >>>>> That=E2=80=99s definitely confusing. >>>>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80= =99 and of 'zpool list -v zroot=E2=80=99 >>>>> >>>>> Paul >>>>> >>>>> >>>> Here are the outputs: >>>> >>>> >>>> zfs list -o space -r zroot >>>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>>> zroot 720M 107G 0B 2.20= G 0B 105G >>>> zroot/ROOT 720M 88.5G 0B 88= K 0B 88.5G >>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B 8= K 0B 0B >>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B 8= K 0B 0B >>>> zroot/ROOT/default 720M 88.5G 52.0G 3= 6.5G 0B 0B >>>> zroot/swap 3.78G 6.19G 0B 3.11= G 3.08G 0B >>>> zroot/tmp 720M 121M 0B 121= M 0B 0B >>>> zroot/usr 720M 7.09G 0B 88= K 0B 7.09G >>>> zroot/usr/home 720M 88K 0B 88= K 0B 0B >>>> zroot/usr/obj 720M 4.75G 0B 4.75= G 0B 0B >>>> zroot/usr/ports 720M 432K 0B 176= K 0B 256K >>>> zroot/usr/ports/distfiles 720M 168K 0B 168= K 0B 0B >>>> zroot/usr/ports/packages 720M 88K 0B 88= K 0B 0B >>>> zroot/usr/src 720M 2.35G 0B 2.35= G 0B 0B >>>> zroot/var 720M 2.60G 0B 88= K 0B 2.60G >>>> zroot/var/audit 720M 88K 0B 88= K 0B 0B >>>> zroot/var/backups 720M 141M 0B 141= M 0B 0B >>>> zroot/var/crash 720M 88K 0B 88= K 0B 0B >>>> zroot/var/db 720M 1.69G 0B 1.59= G 0B 94.8M >>>> zroot/var/db/pkg 720M 94.8M 0B 94.8= M 0B 0B >>>> zroot/var/empty 720M 88K 0B 88= K 0B 0B >>>> zroot/var/log 720M 792M 0B 792= M 0B 0B >>>> zroot/var/mail 720M 3.96M 0B 3.96= M 0B 0B >>>> zroot/var/run 720M 248K 0B 248= K 0B 0B >>>> zroot/var/tmp 720M 672K 0B 672= K 0B 0B >>>> >>>> >>>> zpool list -v zroot >>>> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DED= UP HEALTH ALTROOT >>>> zroot 111G 104G 7.22G - - 82% 93% 1.0= 0x ONLINE - >>>> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >>>> ada0p3 111G - - - - - - - = ONLINE >>>> ada1p3 111G - - - - - - - = ONLINE >>>> >>> Those look quite normal. What about 'zfs list -r -t all -o space zroo= t/ROOT/default=E2=80=99 ? >>> >>> Paul >>> >>> >>> >> zfs list -r -t all -o space zroot/ROOT/default >> NAME AVAIL USED USEDSNAP USEDD= S USEDREFRESERV USEDCHILD >> zroot/ROOT/default 720M 88.5G 52.0G 36.5G= 0B 0B >> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >> >> >> Strange! It shows a 52GB 'claimed' snapshot but where is it? >> >> > Can you give output of 'zfs get all zroot/ROOT/default=E2=80=99 as well= ? Maybe that gives a hint. > > Paul > Sure: zfs get all zroot/ROOT/default NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 PROPERTY=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 VALUE SOURCE zroot/ROOT/default=C2=A0 type=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 filesystem=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 creation=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Tue Aug=C2=A0 7=C2=A0 2:53 2018=C2=A0= - zroot/ROOT/default=C2=A0 used=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 88.5G=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 available=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 720M=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = - zroot/ROOT/default=C2=A0 referenced=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 compressratio=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 1.29x=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 mounted=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 yes=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 quota=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 reservation=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 recordsize=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 128K default zroot/ROOT/default=C2=A0 mountpoint=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 / local zroot/ROOT/default=C2=A0 sharenfs=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 checksum=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 compression=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 lz4 inherited from zroot zroot/ROOT/default=C2=A0 atime=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 devices=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 exec=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 setuid=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 readonly=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 jailed=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 snapdir=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 hidden default zroot/ROOT/default=C2=A0 aclmode=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 discard default zroot/ROOT/default=C2=A0 aclinherit=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 restricted default zroot/ROOT/default=C2=A0 createtxg=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 93=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 - zroot/ROOT/default=C2=A0 canmount=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 noauto local zroot/ROOT/default=C2=A0 xattr=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 copies=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1 default zroot/ROOT/default=C2=A0 version=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 5=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 utf8only=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 - zroot/ROOT/default=C2=A0 normalization=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 none=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 casesensitivity=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 sensitive=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 vscan=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 nbmand=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 sharesmb=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 refquota=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 refreservation=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 none default zroot/ROOT/default=C2=A0 guid=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 155097369179171= 71623=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 primarycache=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 all default zroot/ROOT/default=C2=A0 secondarycache=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 all default zroot/ROOT/default=C2=A0 usedbysnapshots=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 52.0G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 usedbydataset=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 36.5G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 usedbychildren=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 0B=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 usedbyrefreservation=C2=A0 0B=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 logbias=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 latency default zroot/ROOT/default=C2=A0 objsetid=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 58=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 - zroot/ROOT/default=C2=A0 dedup=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 mlslabel=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 sync=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 standard defaul= t zroot/ROOT/default=C2=A0 dnodesize=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 legacy default zroot/ROOT/default=C2=A0 refcompressratio=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1= .32x=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 written=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1.53G=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= - zroot/ROOT/default=C2=A0 logicalused=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 108G=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 logicalreferenced=C2=A0=C2=A0=C2=A0=C2=A0 46.0G=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 - zroot/ROOT/default=C2=A0 volmode=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 default default zroot/ROOT/default=C2=A0 filesystem_limit=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 n= one default zroot/ROOT/default=C2=A0 snapshot_limit=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 none default zroot/ROOT/default=C2=A0 filesystem_count=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 n= one default zroot/ROOT/default=C2=A0 snapshot_count=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 none default zroot/ROOT/default=C2=A0 snapdev=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 hidden default zroot/ROOT/default=C2=A0 acltype=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 nfsv4 default zroot/ROOT/default=C2=A0 context=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 fscontext=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 defcontext=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 rootcontext=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 relatime=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 redundant_metadata=C2=A0=C2=A0=C2=A0 all default zroot/ROOT/default=C2=A0 overlay=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 on default zroot/ROOT/default=C2=A0 encryption=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 off default zroot/ROOT/default=C2=A0 keylocation=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 keyformat=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 none default zroot/ROOT/default=C2=A0 pbkdf2iters=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 0 default zroot/ROOT/default=C2=A0 special_small_blocks=C2=A0 0 default From nobody Mon Aug 21 14:15:39 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTvf71JMtz4qqL1 for ; Mon, 21 Aug 2023 14:15:59 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTvf7057mz3ZKg for ; Mon, 21 Aug 2023 14:15:58 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LEFno5014574 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 16:15:54 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: Date: Mon, 21 Aug 2023 16:15:39 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTvf7057mz3ZKg X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 15:52, Kaya Saman = wrote: >=20 >=20 > On 8/21/23 14:49, freebsd@vanderzwan.org wrote: >>=20 >>> On 21 Aug 2023, at 15:41, Kaya Saman = wrote: >>>=20 >>>=20 >>> On 8/21/23 14:38, freebsd@vanderzwan.org wrote: >>>>> On 21 Aug 2023, at 15:34, Kaya Saman = wrote: >>>>>=20 >>>>>=20 >>>>> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>>>>> On 21 Aug 2023, at 15:14, Kaya Saman = wrote: >>>>>>>=20 >>>>>>>=20 >>>>>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>>>>> On 21 Aug 2023, at 14:21, Kaya Saman = wrote: >>>>>>>>> # zfs list -ro space zroot/ROOT >>>>>>>>> NAME AVAIL USED = USEDSNAP USEDDS USEDREFRESERV USEDCHILD >>>>>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>>>>> zroot/ROOT/default 720M 88.5G = 52.0G 36.5G 0B 0B >>>>>>>>>=20 >>>>>>>> That last line seems to indicate there is 52.0 G used in = snapshots of zroot/ROOT/default and 36.5G in the dataset itself. >>>>>>>> Output of zfs list -o space -t snapshot |grep = zroot/ROOT/default should give a list of the snapshots and the sizes. >>>>>>>>=20 >>>>>>>> Paul >>>>>>>>=20 >>>>>>>>=20 >>>>>>> Thanks so much Paul.... I feel like I'm spinning around in = circles currently... >>>>>>>=20 >>>>>>>=20 >>>>>>> There doesn't seem to be anything indicative of that space being = used up? >>>>>>>=20 >>>>>>>=20 >>>>>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>>>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>>>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>>>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>>>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>>>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>>>>>=20 >>>>>>>=20 >>>>>>> certainly not 52GB? >>>>>>>=20 >>>>>>>=20 >>>>>> That=E2=80=99s definitely confusing. >>>>>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80= =99 and of 'zpool list -v zroot=E2=80=99 >>>>>>=20 >>>>>> Paul >>>>>>=20 >>>>>>=20 >>>>> Here are the outputs: >>>>>=20 >>>>>=20 >>>>> zfs list -o space -r zroot >>>>> NAME AVAIL USED = USEDSNAP USEDDS USEDREFRESERV USEDCHILD >>>>> zroot 720M 107G 0B = 2.20G 0B 105G >>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>> zroot/swap 3.78G 6.19G 0B = 3.11G 3.08G 0B >>>>> zroot/tmp 720M 121M 0B = 121M 0B 0B >>>>> zroot/usr 720M 7.09G 0B = 88K 0B 7.09G >>>>> zroot/usr/home 720M 88K 0B = 88K 0B 0B >>>>> zroot/usr/obj 720M 4.75G 0B = 4.75G 0B 0B >>>>> zroot/usr/ports 720M 432K 0B = 176K 0B 256K >>>>> zroot/usr/ports/distfiles 720M 168K 0B = 168K 0B 0B >>>>> zroot/usr/ports/packages 720M 88K 0B = 88K 0B 0B >>>>> zroot/usr/src 720M 2.35G 0B = 2.35G 0B 0B >>>>> zroot/var 720M 2.60G 0B = 88K 0B 2.60G >>>>> zroot/var/audit 720M 88K 0B = 88K 0B 0B >>>>> zroot/var/backups 720M 141M 0B = 141M 0B 0B >>>>> zroot/var/crash 720M 88K 0B = 88K 0B 0B >>>>> zroot/var/db 720M 1.69G 0B = 1.59G 0B 94.8M >>>>> zroot/var/db/pkg 720M 94.8M 0B = 94.8M 0B 0B >>>>> zroot/var/empty 720M 88K 0B = 88K 0B 0B >>>>> zroot/var/log 720M 792M 0B = 792M 0B 0B >>>>> zroot/var/mail 720M 3.96M 0B = 3.96M 0B 0B >>>>> zroot/var/run 720M 248K 0B = 248K 0B 0B >>>>> zroot/var/tmp 720M 672K 0B = 672K 0B 0B >>>>>=20 >>>>>=20 >>>>> zpool list -v zroot >>>>> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP = DEDUP HEALTH ALTROOT >>>>> zroot 111G 104G 7.22G - - 82% 93% = 1.00x ONLINE - >>>>> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >>>>> ada0p3 111G - - - - - - - = ONLINE >>>>> ada1p3 111G - - - - - - - = ONLINE >>>>>=20 >>>> Those look quite normal. What about 'zfs list -r -t all -o space = zroot/ROOT/default=E2=80=99 ? >>>>=20 >>>> Paul >>>>=20 >>>>=20 >>>>=20 >>> zfs list -r -t all -o space zroot/ROOT/default >>> NAME AVAIL USED USEDSNAP = USEDDS USEDREFRESERV USEDCHILD >>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>=20 >>>=20 >>> Strange! It shows a 52GB 'claimed' snapshot but where is it? >>>=20 >>>=20 >> Can you give output of 'zfs get all zroot/ROOT/default=E2=80=99 as = well ? Maybe that gives a hint. >>=20 >> Paul >>=20 >=20 > Sure: >=20 >=20 > zfs get all zroot/ROOT/default > NAME PROPERTY VALUE SOURCE > zroot/ROOT/default type filesystem - > zroot/ROOT/default creation Tue Aug 7 2:53 2018 - > zroot/ROOT/default used 88.5G - > zroot/ROOT/default available 720M - > zroot/ROOT/default referenced 36.5G - > zroot/ROOT/default compressratio 1.29x - > zroot/ROOT/default mounted yes - > zroot/ROOT/default quota none default > zroot/ROOT/default reservation none default > zroot/ROOT/default recordsize 128K default > zroot/ROOT/default mountpoint / local > zroot/ROOT/default sharenfs off default > zroot/ROOT/default checksum on default > zroot/ROOT/default compression lz4 inherited from zroot > zroot/ROOT/default atime on default > zroot/ROOT/default devices on default > zroot/ROOT/default exec on default > zroot/ROOT/default setuid on default > zroot/ROOT/default readonly off default > zroot/ROOT/default jailed off default > zroot/ROOT/default snapdir hidden default > zroot/ROOT/default aclmode discard default > zroot/ROOT/default aclinherit restricted default > zroot/ROOT/default createtxg 93 - > zroot/ROOT/default canmount noauto local > zroot/ROOT/default xattr on default > zroot/ROOT/default copies 1 default > zroot/ROOT/default version 5 - > zroot/ROOT/default utf8only off - > zroot/ROOT/default normalization none - > zroot/ROOT/default casesensitivity sensitive - > zroot/ROOT/default vscan off default > zroot/ROOT/default nbmand off default > zroot/ROOT/default sharesmb off default > zroot/ROOT/default refquota none default > zroot/ROOT/default refreservation none default > zroot/ROOT/default guid 15509736917917171623 - > zroot/ROOT/default primarycache all default > zroot/ROOT/default secondarycache all default > zroot/ROOT/default usedbysnapshots 52.0G - > zroot/ROOT/default usedbydataset 36.5G - > zroot/ROOT/default usedbychildren 0B - > zroot/ROOT/default usedbyrefreservation 0B - > zroot/ROOT/default logbias latency default > zroot/ROOT/default objsetid 58 - > zroot/ROOT/default dedup off default > zroot/ROOT/default mlslabel none default > zroot/ROOT/default sync standard default > zroot/ROOT/default dnodesize legacy default > zroot/ROOT/default refcompressratio 1.32x - > zroot/ROOT/default written 1.53G - > zroot/ROOT/default logicalused 108G - > zroot/ROOT/default logicalreferenced 46.0G - > zroot/ROOT/default volmode default default > zroot/ROOT/default filesystem_limit none default > zroot/ROOT/default snapshot_limit none default > zroot/ROOT/default filesystem_count none default > zroot/ROOT/default snapshot_count none default > zroot/ROOT/default snapdev hidden default > zroot/ROOT/default acltype nfsv4 default > zroot/ROOT/default context none default > zroot/ROOT/default fscontext none default > zroot/ROOT/default defcontext none default > zroot/ROOT/default rootcontext none default > zroot/ROOT/default relatime off default > zroot/ROOT/default redundant_metadata all default > zroot/ROOT/default overlay on default > zroot/ROOT/default encryption off default > zroot/ROOT/default keylocation none default > zroot/ROOT/default keyformat none default > zroot/ROOT/default pbkdf2iters 0 default > zroot/ROOT/default special_small_blocks 0 default >=20 >=20 That looks consistent with the rest of the data. Man page for zfsprops mentions this for snapshots; The used space of a snapshot (see the = Snapshots section of zfsconcepts(7)) is space that is referenced exclusively by this snapshot. If = this snapshot is destroyed, the amount of used = space will be freed. Space that is shared by = multiple snapshots isn't accounted for in this metric. = When a snapshot is destroyed, space that was = previously shared with this snapshot can become unique = to snapshots adjacent to it, thus changing the = used space of those snapshots. The used space of = the latest snapshot can also be affected by = changes in the file system. Note that the used space of = a snapshot is a subset of the written space of = the snapshot. Note : Space that is shared by multiple snapshots isn't accounted for = in this metric. My theory is that the snapshots/boot environments share about 52G of = with each other but not with the parent dataset. As there is no data unique to one snapshot it does not show What you could do is delete all except one bootenvironment. The snapshot data used should then be unique to that last snapshot and = appear in the lists. Paul From nobody Mon Aug 21 14:17:52 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTvhS0tQnz4qr3K for ; Mon, 21 Aug 2023 14:18:00 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTvhR71NPz3d9g for ; Mon, 21 Aug 2023 14:17:59 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id F16CC15C2C73; Mon, 21 Aug 2023 15:17:52 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id 37wtKkBiP10k; Mon, 21 Aug 2023 15:17:52 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id A072715C2E7B; Mon, 21 Aug 2023 15:17:52 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com A072715C2E7B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692627472; bh=0eepOOku9PUp3Ljt8AODq7qisjrRAqqmVr394ceXPTc=; h=Message-ID:Date:MIME-Version:To:From; b=LJYPU/SMWO0LRNL2GovHzp6kDs2vv5x9nV6OwILGAB5DCMstV797XZguvpnyOvTf1 dx/xHVxXTTkBEKwPzvNgq2c7WpwUgTVHQkBJuN4L30kvOEc9dPobQvimI6eY2s1iLf gdcFauUuakdr+XAUrGTDdthibNE4BT+lmUxoj9M8quFqGh7aGwT4c4bbRtsC1gzRF5 IkKiZbj+swubyWmRh86gwahYb/OpxBSvAi4jfN+0PXKylmJJF7DrIXYnCVYvIGhXkB oUekIIttpfXsLZ3TZlStszC3trUXdR7pziA2rMU58boGiYpCpD4ybTiv3GcLzMC9VV dZCrap3rBKwPg== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id ChwrB-N22p-5; Mon, 21 Aug 2023 15:17:52 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 8B5D015C2C73; Mon, 21 Aug 2023 15:17:52 +0100 (BST) Message-ID: <3cddc02d-eb4c-f402-d073-7e5b98341b8f@optiplex-networks.com> Date: Mon, 21 Aug 2023 15:17:52 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: Olivier Certner , questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <2972906.hHqAuc6tWs@ravel> From: Kaya Saman In-Reply-To: <2972906.hHqAuc6tWs@ravel> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RTvhR71NPz3d9g X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 14:51, Olivier Certner wrote: > Hi, > =20 >> There doesn't seem to be anything indicative of that space being used = up? > Unfortunately, ZFS only reports in USED for snapshots the space that is= *unique* to the corresponding snapshot, but not the space common to seve= ral ones of them, which could be freeable if it is not shared with the da= taset itself. > > Use, e.g., "zfs list -o space " to see the amount of space tak= en by snapshots (USEDSNAP column). > > For something more granular, you can also use "zfs get written " to see the amount of new data since the previous snapshot (there is a= lso written@, see zfsprops(7)). > > Regards. > Thanks Olivier. This is definitely producing more interesting output now: zfs get written zroot/ROOT/default@2022-11-28-06:08:26-0 NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 PROPERTY=C2=A0 VALUE SOURCE zroot/ROOT/default@2022-11-28-06:08:26-0=C2=A0 written=C2=A0=C2=A0 63.2G=C2= =A0=C2=A0=C2=A0 - zfs get written zroot/ROOT/default@2022-11-28-06:38:48-0 NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 PROPERTY=C2=A0 VALUE SOURCE zroot/ROOT/default@2022-11-28-06:38:48-0=C2=A0 written=C2=A0=C2=A0 524M=C2= =A0=C2=A0=C2=A0=C2=A0 - zfs get written zroot/ROOT/default@2023-08-20-22:00:10-0 NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 PROPERTY=C2=A0 VALUE SOURCE zroot/ROOT/default@2023-08-20-22:00:10-0=C2=A0 written=C2=A0=C2=A0 23.0G=C2= =A0=C2=A0=C2=A0 - zfs get written zroot/ROOT/default@2023-08-20-22:45:34-0 NAME=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 PROPERTY=C2=A0 VALUE SOURCE zroot/ROOT/default@2023-08-20-22:45:34-0=C2=A0 written=C2=A0=C2=A0 114M=C2= =A0=C2=A0=C2=A0=C2=A0 - Maybe, would it be worth clearing the 2022 snapshots, or perhaps all of=20 the snapshots? From nobody Mon Aug 21 14:25:25 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTvsC2xHFz4qrL9 for ; Mon, 21 Aug 2023 14:25:35 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTvsC06zxz3fkD for ; Mon, 21 Aug 2023 14:25:35 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 9038315C2EE8; Mon, 21 Aug 2023 15:25:33 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id a5mRejJohq4D; Mon, 21 Aug 2023 15:25:32 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id C975415C2E70; Mon, 21 Aug 2023 15:25:29 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com C975415C2E70 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692627929; bh=+RYyes3PyMtv8oED7oWuDqswGaKSGWuvzdfl48wum/o=; h=Message-ID:Date:MIME-Version:To:From; b=ZRAGTIf+vPs+AabHDx8YZrLAq/IX1pJny8GC6V4BMNGTCD0i/ezMfhTOufOeUIxf1 PtvdP40tLaXOIz2bKa/SExF5dIlN9T41eYGFC+MpwcnPiwgEQiu7xi30bcbLYfW1TG IeTW/GtB9HOVHVBiQ2loIP+fTB2ywkQenSR8AddsRltYIYwF0xSloAKbpkhxIEUzL/ Btv9XUsQoJPu2IrPQM6HDf9VAZh62A7r/0T4s5XhFqKFgNkHhXH1cVoYWVPUNHUcnj 1791M+JheiocC0JNVOGrS5LO8SH5AUjF2dfuM+1mxbiNEWpMrktOSRgSTfqlSw/om3 THzYKO2bXoZWg== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id LPkAT1iieSim; Mon, 21 Aug 2023 15:25:29 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 8986215C2EE3; Mon, 21 Aug 2023 15:25:25 +0100 (BST) Message-ID: Date: Mon, 21 Aug 2023 15:25:25 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> From: Kaya Saman In-Reply-To: <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4RTvsC06zxz3fkD X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 15:15, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 15:52, Kaya Saman = wrote: >> >> >> On 8/21/23 14:49, freebsd@vanderzwan.org wrote: >>>> On 21 Aug 2023, at 15:41, Kaya Saman wrote: >>>> >>>> >>>> On 8/21/23 14:38, freebsd@vanderzwan.org wrote: >>>>>> On 21 Aug 2023, at 15:34, Kaya Saman wrote: >>>>>> >>>>>> >>>>>> On 8/21/23 14:23, freebsd@vanderzwan.org wrote: >>>>>>>> On 21 Aug 2023, at 15:14, Kaya Saman wrote: >>>>>>>> >>>>>>>> >>>>>>>> On 8/21/23 14:07, freebsd@vanderzwan.org wrote: >>>>>>>>>> On 21 Aug 2023, at 14:21, Kaya Saman wrote: >>>>>>>>>> # zfs list -ro space zroot/ROOT >>>>>>>>>> NAME AVAIL USED USE= DSNAP USEDDS USEDREFRESERV USEDCHILD >>>>>>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>>>>>> zroot/ROOT/default 720M 88.5G 52.= 0G 36.5G 0B 0B >>>>>>>>>> >>>>>>>>> That last line seems to indicate there is 52.0 G used in snapsh= ots of zroot/ROOT/default and 36.5G in the dataset itself. >>>>>>>>> Output of zfs list -o space -t snapshot |grep zroot/ROOT/defau= lt should give a list of the snapshots and the sizes. >>>>>>>>> >>>>>>>>> Paul >>>>>>>>> >>>>>>>>> >>>>>>>> Thanks so much Paul.... I feel like I'm spinning around in circl= es currently... >>>>>>>> >>>>>>>> >>>>>>>> There doesn't seem to be anything indicative of that space being= used up? >>>>>>>> >>>>>>>> >>>>>>>> zfs list -o space -t snapshot |grep zroot/ROOT/defaul >>>>>>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - -= - - >>>>>>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - -= - - >>>>>>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - -= - - >>>>>>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - -= - - >>>>>>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - -= - - >>>>>>>> >>>>>>>> >>>>>>>> certainly not 52GB? >>>>>>>> >>>>>>>> >>>>>>> That=E2=80=99s definitely confusing. >>>>>>> What=E2=80=99s the full output of 'zfs list -o space -r zroot=E2=80= =99 and of 'zpool list -v zroot=E2=80=99 >>>>>>> >>>>>>> Paul >>>>>>> >>>>>>> >>>>>> Here are the outputs: >>>>>> >>>>>> >>>>>> zfs list -o space -r zroot >>>>>> NAME AVAIL USED USEDSNA= P USEDDS USEDREFRESERV USEDCHILD >>>>>> zroot 720M 107G 0B 2.= 20G 0B 105G >>>>>> zroot/ROOT 720M 88.5G 0B = 88K 0B 88.5G >>>>>> zroot/ROOT/13.1-RELEASE-p5_2023-08-20_220010 720M 8K 0B = 8K 0B 0B >>>>>> zroot/ROOT/13.2-RELEASE-p2_2023-08-20_224534 720M 8K 0B = 8K 0B 0B >>>>>> zroot/ROOT/default 720M 88.5G 52.0G = 36.5G 0B 0B >>>>>> zroot/swap 3.78G 6.19G 0B 3.= 11G 3.08G 0B >>>>>> zroot/tmp 720M 121M 0B 1= 21M 0B 0B >>>>>> zroot/usr 720M 7.09G 0B = 88K 0B 7.09G >>>>>> zroot/usr/home 720M 88K 0B = 88K 0B 0B >>>>>> zroot/usr/obj 720M 4.75G 0B 4.= 75G 0B 0B >>>>>> zroot/usr/ports 720M 432K 0B 1= 76K 0B 256K >>>>>> zroot/usr/ports/distfiles 720M 168K 0B 1= 68K 0B 0B >>>>>> zroot/usr/ports/packages 720M 88K 0B = 88K 0B 0B >>>>>> zroot/usr/src 720M 2.35G 0B 2.= 35G 0B 0B >>>>>> zroot/var 720M 2.60G 0B = 88K 0B 2.60G >>>>>> zroot/var/audit 720M 88K 0B = 88K 0B 0B >>>>>> zroot/var/backups 720M 141M 0B 1= 41M 0B 0B >>>>>> zroot/var/crash 720M 88K 0B = 88K 0B 0B >>>>>> zroot/var/db 720M 1.69G 0B 1.= 59G 0B 94.8M >>>>>> zroot/var/db/pkg 720M 94.8M 0B 94= .8M 0B 0B >>>>>> zroot/var/empty 720M 88K 0B = 88K 0B 0B >>>>>> zroot/var/log 720M 792M 0B 7= 92M 0B 0B >>>>>> zroot/var/mail 720M 3.96M 0B 3.= 96M 0B 0B >>>>>> zroot/var/run 720M 248K 0B 2= 48K 0B 0B >>>>>> zroot/var/tmp 720M 672K 0B 6= 72K 0B 0B >>>>>> >>>>>> >>>>>> zpool list -v zroot >>>>>> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP D= EDUP HEALTH ALTROOT >>>>>> zroot 111G 104G 7.22G - - 82% 93% 1= .00x ONLINE - >>>>>> mirror-0 111G 104G 7.22G - - 82% 93.5% = - ONLINE >>>>>> ada0p3 111G - - - - - - = - ONLINE >>>>>> ada1p3 111G - - - - - - = - ONLINE >>>>>> >>>>> Those look quite normal. What about 'zfs list -r -t all -o space zr= oot/ROOT/default=E2=80=99 ? >>>>> >>>>> Paul >>>>> >>>>> >>>>> >>>> zfs list -r -t all -o space zroot/ROOT/default >>>> NAME AVAIL USED USEDSNAP USE= DDS USEDREFRESERV USEDCHILD >>>> zroot/ROOT/default 720M 88.5G 52.0G 36.= 5G 0B 0B >>>> zroot/ROOT/default@2022-11-28-06:08:26-0 - 583M - - = - - >>>> zroot/ROOT/default@2022-11-28-06:38:48-0 - 11.4M - - = - - >>>> zroot/ROOT/default@2022-11-28-07:26:20-0 - 9.41M - - = - - >>>> zroot/ROOT/default@2023-08-20-22:00:10-0 - 34.5M - - = - - >>>> zroot/ROOT/default@2023-08-20-22:45:34-0 - 9.56M - - = - - >>>> >>>> >>>> Strange! It shows a 52GB 'claimed' snapshot but where is it? >>>> >>>> >>> Can you give output of 'zfs get all zroot/ROOT/default=E2=80=99 as we= ll ? Maybe that gives a hint. >>> >>> Paul >>> >> Sure: >> >> >> zfs get all zroot/ROOT/default >> NAME PROPERTY VALUE SOURCE >> zroot/ROOT/default type filesystem - >> zroot/ROOT/default creation Tue Aug 7 2:53 2018 - >> zroot/ROOT/default used 88.5G - >> zroot/ROOT/default available 720M - >> zroot/ROOT/default referenced 36.5G - >> zroot/ROOT/default compressratio 1.29x - >> zroot/ROOT/default mounted yes - >> zroot/ROOT/default quota none default >> zroot/ROOT/default reservation none default >> zroot/ROOT/default recordsize 128K default >> zroot/ROOT/default mountpoint / local >> zroot/ROOT/default sharenfs off default >> zroot/ROOT/default checksum on default >> zroot/ROOT/default compression lz4 inherited from zroot >> zroot/ROOT/default atime on default >> zroot/ROOT/default devices on default >> zroot/ROOT/default exec on default >> zroot/ROOT/default setuid on default >> zroot/ROOT/default readonly off default >> zroot/ROOT/default jailed off default >> zroot/ROOT/default snapdir hidden default >> zroot/ROOT/default aclmode discard default >> zroot/ROOT/default aclinherit restricted default >> zroot/ROOT/default createtxg 93 - >> zroot/ROOT/default canmount noauto local >> zroot/ROOT/default xattr on default >> zroot/ROOT/default copies 1 default >> zroot/ROOT/default version 5 - >> zroot/ROOT/default utf8only off - >> zroot/ROOT/default normalization none - >> zroot/ROOT/default casesensitivity sensitive - >> zroot/ROOT/default vscan off default >> zroot/ROOT/default nbmand off default >> zroot/ROOT/default sharesmb off default >> zroot/ROOT/default refquota none default >> zroot/ROOT/default refreservation none default >> zroot/ROOT/default guid 15509736917917171623 - >> zroot/ROOT/default primarycache all default >> zroot/ROOT/default secondarycache all default >> zroot/ROOT/default usedbysnapshots 52.0G - >> zroot/ROOT/default usedbydataset 36.5G - >> zroot/ROOT/default usedbychildren 0B - >> zroot/ROOT/default usedbyrefreservation 0B - >> zroot/ROOT/default logbias latency default >> zroot/ROOT/default objsetid 58 - >> zroot/ROOT/default dedup off default >> zroot/ROOT/default mlslabel none default >> zroot/ROOT/default sync standard default >> zroot/ROOT/default dnodesize legacy default >> zroot/ROOT/default refcompressratio 1.32x - >> zroot/ROOT/default written 1.53G - >> zroot/ROOT/default logicalused 108G - >> zroot/ROOT/default logicalreferenced 46.0G - >> zroot/ROOT/default volmode default default >> zroot/ROOT/default filesystem_limit none default >> zroot/ROOT/default snapshot_limit none default >> zroot/ROOT/default filesystem_count none default >> zroot/ROOT/default snapshot_count none default >> zroot/ROOT/default snapdev hidden default >> zroot/ROOT/default acltype nfsv4 default >> zroot/ROOT/default context none default >> zroot/ROOT/default fscontext none default >> zroot/ROOT/default defcontext none default >> zroot/ROOT/default rootcontext none default >> zroot/ROOT/default relatime off default >> zroot/ROOT/default redundant_metadata all default >> zroot/ROOT/default overlay on default >> zroot/ROOT/default encryption off default >> zroot/ROOT/default keylocation none default >> zroot/ROOT/default keyformat none default >> zroot/ROOT/default pbkdf2iters 0 default >> zroot/ROOT/default special_small_blocks 0 default >> >> > That looks consistent with the rest of the data. > > Man page for zfsprops mentions this for snapshots; > The used space of a snapshot (see the Snaps= hots > section of zfsconcepts(7)) is space that is > referenced exclusively by this snapshot. I= f this > snapshot is destroyed, the amount of used s= pace > will be freed. Space that is shared by mul= tiple > snapshots isn't accounted for in this metri= c. When > a snapshot is destroyed, space that was pre= viously > shared with this snapshot can become unique= to > snapshots adjacent to it, thus changing the= used > space of those snapshots. The used space o= f the > latest snapshot can also be affected by cha= nges in > the file system. Note that the used space = of a > snapshot is a subset of the written space o= f the > snapshot. > Note : Space that is shared by multiple snapshots isn't accounted for = in this metric. > > My theory is that the snapshots/boot environments share about 52G of w= ith each other but not with the parent dataset. > As there is no data unique to one snapshot it does not show > What you could do is delete all except one bootenvironment. > The snapshot data used should then be unique to that last snapshot and = appear in the lists. > > Paul > > > I just responded to Olivier above but I have managed to free up the=20 necessary space by deleting all the snapshots: df -h Filesystem=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Size=C2=A0=C2=A0=C2=A0 Used=C2=A0=C2= =A0 Avail Capacity=C2=A0=20 Mounted on zroot/ROOT/default=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 89G=C2=A0=C2=A0=C2=A0=C2=A0 36G=C2=A0=C2=A0=C2=A0=C2=A0 53G 41%=C2=A0=C2= =A0=C2=A0 / For some reason some of the snapshots were automatically 'cloned' and=20 exactly as you suggested above there was a fair amount of space sharing=20 between snapshots. This of course resulted in data being removed from=20 the main snapshot but still remained on disk due another snapshot=20 referencing that data.... Very confusing for an automated process but anyway, I have space again :-= ) Thank you so much everyone for your help and input! Best Regards, Kaya From nobody Mon Aug 21 14:33:47 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTw306RlGz4qrSt for ; Mon, 21 Aug 2023 14:34:04 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Received: from mail2.paztec.nl (mail2.paztec.nl [IPv6:2001:1af8:4700:a116:1::42]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail2.paztec.nl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTw305F5dz4CTq for ; Mon, 21 Aug 2023 14:34:04 +0000 (UTC) (envelope-from freebsd@vanderzwan.org) Authentication-Results: mx1.freebsd.org; none X-Bogosity: No, tests=bogofilter Received: from smtpclient.apple (gaspode [IPv6:2a02:a461:283f:4:0:0:0:22]) (authenticated bits=0) by mail2.paztec.nl (8.17.2/8.17.1) with ESMTPSA id 37LEXvsV014679 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 21 Aug 2023 16:34:02 +0200 (CEST) (envelope-from freebsd@vanderzwan.org) X-Authentication-Warning: vps4.vanderzwan.org: Host gaspode [IPv6:2a02:a461:283f:4:0:0:0:22] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release From: freebsd@vanderzwan.org In-Reply-To: Date: Mon, 21 Aug 2023 16:33:47 +0200 Cc: questions@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> To: Kaya Saman X-Mailer: Apple Mail (2.3731.700.6) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on vps4.vanderzwan.org X-Rspamd-Queue-Id: 4RTw305F5dz4CTq X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:60781, ipnet:2001:1af8::/32, country:NL] > On 21 Aug 2023, at 16:25, Kaya Saman = wrote: >=20 >=20 > I just responded to Olivier above but I have managed to free up the = necessary space by deleting all the snapshots: >=20 >=20 > df -h > Filesystem Size Used Avail Capacity = Mounted on > zroot/ROOT/default 89G 36G 53G 41% / >=20 >=20 > For some reason some of the snapshots were automatically 'cloned' and = exactly as you suggested above there was a fair amount of space sharing = between snapshots. This of course resulted in data being removed from = the main snapshot but still remained on disk due another snapshot = referencing that data.... >=20 > Very confusing for an automated process but anyway, I have space again = :-) >=20 >=20 Not entirely automatic. I think they are leftovers from updating your = server. The freebsd-update tool automatically creates a new boot environment = when updating. That way you can roll back in case an update fails. If the update is successful and rollback is not needed any more you can = delete these, Paul From nobody Mon Aug 21 16:52:52 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTz7D3M52z4r1yK for ; Mon, 21 Aug 2023 16:52:56 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Received: from mail.optiplex-networks.com (mail.optiplex-networks.com [45.149.190.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTz7D07zHz4Rgh for ; Mon, 21 Aug 2023 16:52:55 +0000 (UTC) (envelope-from kayasaman@optiplex-networks.com) Authentication-Results: mx1.freebsd.org; none Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id 01D6915C2C73; Mon, 21 Aug 2023 17:52:53 +0100 (BST) Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10032) with ESMTP id rrmQpiLsNols; Mon, 21 Aug 2023 17:52:52 +0100 (BST) Received: from localhost (localhost [127.0.0.1]) by mail.optiplex-networks.com (Postfix) with ESMTP id A8BB915C2DA4; Mon, 21 Aug 2023 17:52:52 +0100 (BST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.optiplex-networks.com A8BB915C2DA4 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=optiplex-networks.com; s=AE93A2AC-7F67-11EA-90AE-8A1FE64F6997; t=1692636772; bh=DoiDJrkRjBgWsqpTXS4YXS+ML28pkGIF4qDBzHXp2hY=; h=Message-ID:Date:MIME-Version:To:From; b=oPm8Sn0CoabXkRHD9fF5ytTTLSAW+FU6L0wtPVqLj7e9MbJp3tkpEDudWQb4Rwiyg QZ9vKJTl2nC5gnBNBEXY0a2dg/0CH8T+zF8j3jfbtEWV+faeRjXI2vWBvhgT/RwAZY ZB3soRfC5zXQk1pPGE5fZtZiHlUx+StiNSmE/nkIPkeDprMLWACr+V0IiS9iYeKZK6 4fGfZwG9jB18sy/YhE520D4m7DznPvptER5+987fWNRj1fP9WHkQX38S/70WLfNVL2 tePG4k+CQXNIUuJbS+u/CdGQ7spma2N4yTEEzMk41xjoPJa+7TctG5kpIgadIBa/4T kOvf6Mr1uXt9A== X-Virus-Scanned: amavis at mail.optiplex-networks.com Received: from mail.optiplex-networks.com ([127.0.0.1]) by localhost (mail.optiplex-networks.com [127.0.0.1]) (amavis, port 10026) with ESMTP id cCgybZi-bgt6; Mon, 21 Aug 2023 17:52:52 +0100 (BST) Received: from [192.168.20.23] (unknown [192.168.20.23]) by mail.optiplex-networks.com (Postfix) with ESMTPSA id 927C915C2C73; Mon, 21 Aug 2023 17:52:52 +0100 (BST) Message-ID: <43134b2d-6a55-3b05-e5ea-7ab40e566e45@optiplex-networks.com> Date: Mon, 21 Aug 2023 17:52:52 +0100 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Content-Language: en-US To: freebsd@vanderzwan.org Cc: questions@freebsd.org References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> From: Kaya Saman In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4RTz7D07zHz4Rgh X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:202596, ipnet:45.149.188.0/22, country:GB] On 8/21/23 15:33, freebsd@vanderzwan.org wrote: > >> On 21 Aug 2023, at 16:25, Kaya Saman wrote: >> >> >> I just responded to Olivier above but I have managed to free up the necessary space by deleting all the snapshots: >> >> >> df -h >> Filesystem Size Used Avail Capacity Mounted on >> zroot/ROOT/default 89G 36G 53G 41% / >> >> >> For some reason some of the snapshots were automatically 'cloned' and exactly as you suggested above there was a fair amount of space sharing between snapshots. This of course resulted in data being removed from the main snapshot but still remained on disk due another snapshot referencing that data.... >> >> Very confusing for an automated process but anyway, I have space again :-) >> >> > Not entirely automatic. I think they are leftovers from updating your server. > The freebsd-update tool automatically creates a new boot environment when updating. That way you can roll back in case an update fails. > If the update is successful and rollback is not needed any more you can delete these, > > Paul > Most probably... at least there is no harm in deleting things in any case. Thanks so much again for all the help and assistance :-) Best Regards, Kaya From nobody Mon Aug 21 17:16:54 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RTzgF55SBz4r3xF for ; Mon, 21 Aug 2023 17:17:13 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from h1.out4.mxs.au (h1.out4.mxs.au [110.232.143.238]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RTzgD376Xz3JMf for ; Mon, 21 Aug 2023 17:17:11 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Authentication-Results: mx1.freebsd.org; none Received: from s121.syd3.hostingplatform.net.au (s121.syd3.hostingplatform.net.au [103.27.34.4]) by out4.mxs.au (Halon) with ESMTPS id 889ae3eb-4046-11ee-9c69-00163c87da3f; Tue, 22 Aug 2023 03:16:57 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=nimnet.asn.au; s=default; h=Message-ID:From:CC:To:Subject: Content-Transfer-Encoding:Content-Type:MIME-Version:References:In-Reply-To: Date:Sender:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=KYDm7pcBXxhmS9n/EunHINAqA6Ac54gjjcCpoChUcZc=; b=II9mZbFjurO4M78+r51O/fC7/j yu65lYYTGrTcANSZQuk7i7x+0VAdh9GvB+vv7kZ5AUUD3vPS6kz0bR51fDOAhD6KScWXNuoh3cBBl B2vfGyu/UbsAyVu+JeoqhZWh2UBn6vRcpJYUSCm2WcxhMP14OoLnzCGteZ25rN/aeyZ+gcKAqG8Pt v2KQuBawXHEaRaMydEBe55+/uGZhZ5MrgpGroBDqb/ehJGsmfff0ReoFuej5qZQ90CQ9ILFjrWpXE qwwLbOuHkeHvc4rq6pEJJLeeR3bXgDpwToYSEv2Vc+1j6WcGNuCzmYa1d7kVTnD2VaAbSlXPadqgV tw2c4bpA==; Received: from [1.145.108.185] (port=1701 helo=[10.236.35.140]) by s121.syd3.hostingplatform.net.au with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1qY8WP-003Qb6-2I; Tue, 22 Aug 2023 03:16:57 +1000 Date: Tue, 22 Aug 2023 03:16:54 +1000 User-Agent: K-9 Mail for Android In-Reply-To: References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release To: freebsd@vanderzwan.org,Kaya Saman CC: questions@freebsd.org From: Ian Smith Message-ID: <965F4191-AE0F-4714-A20F-0B64D228EC9C@nimnet.asn.au> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - s121.syd3.hostingplatform.net.au X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - nimnet.asn.au X-Get-Message-Sender-Via: s121.syd3.hostingplatform.net.au: authenticated_id: smithi@nimnet.asn.au X-Authenticated-Sender: s121.syd3.hostingplatform.net.au: smithi@nimnet.asn.au X-Source: X-Source-Args: X-Source-Dir: X-Rspamd-Queue-Id: 4RTzgD376Xz3JMf X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:45638, ipnet:110.232.143.0/24, country:AU] On 22 August 2023 12:33:47 am AEST, freebsd@vanderzwan=2Eorg wrote: > > On 21 Aug 2023, at 16:25, Kaya Saman wrote: > >=20 > >=20 > > I just responded to Olivier above but I have managed to free up the > necessary space by deleting all the snapshots: > >=20 > >=20 > > df -h > > Filesystem Size Used Avail > Capacity Mounted on > > zroot/ROOT/default 89G 36G 53G 41% =20 > / > >=20 > >=20 > > For some reason some of the snapshots were automatically 'cloned' > and exactly as you suggested above there was a fair amount of space > sharing between snapshots=2E This of course resulted in data being > removed from the main snapshot but still remained on disk due another > snapshot referencing that data=2E=2E=2E=2E > >=20 > > Very confusing for an automated process but anyway, I have space > again :-) > >=20 > >=20 > Not entirely automatic=2E I think they are leftovers from updating > your server=2E > The freebsd-update tool automatically creates a new boot environment > when updating=2E That way you can roll back in case an update fails= =2E > If the update is successful and rollback is not needed any more you > can delete these, >=20 > Paul s/can/definitely should/ ? I can't resist noting that despite showing off my extreme ignorance and la= ck of adventurousness, I'm once again relieved to have stuck with boring ol= d UFS - for me always reliable and uncontroversial=2E cheers, Ian From nobody Mon Aug 21 17:46:44 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RV0Kd3cPDz4r5xq for ; Mon, 21 Aug 2023 17:47:01 +0000 (UTC) (envelope-from 4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RV0Kc29RXz3b3n for ; Mon, 21 Aug 2023 17:47:00 +0000 (UTC) (envelope-from 4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=tx8YVMOe; spf=pass (mx1.freebsd.org: domain of 4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1692640020; x=1695232020; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:to:from:date:x-thread-info:subject:to:from:cc:reply-to; bh=Z9HlklR2HUcclWP96qyLLbGrX9Du6FUuMobvaBbSU8k=; b=tx8YVMOeHMrZaptQ5dz/kifkUBwfXVldhL8Tr9TLhVotBTtCupp9Jg2GQ+VHyJAfotQdtXrOQ2srJTj6/HOLA68WPgfEBbmKtsOfwNV3PcBP2CgN22dkPMum/7uWZKvbDHEuI1D3i0sL5aC/QYSGac9riHy5BZvDcZ4b7+B8ziE= X-Thread-Info: NDI1MC4xMi4xZDUwNDAwMDBjZDA4YmEucXVlc3Rpb25zPWZyZWVic2Qub3Jn Received: from r1.h.in.socketlabs.com (r1.h.in.socketlabs.com [142.0.180.11]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Mon, 21 Aug 2023 13:46:47 -0400 Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r1.h.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Mon, 21 Aug 2023 13:46:46 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qY8zG-000Dnr-Bt for questions@freebsd.org; Mon, 21 Aug 2023 18:46:45 +0100 Date: Mon, 21 Aug 2023 18:46:44 +0100 From: Steve O'Hara-Smith To: questions@freebsd.org Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Message-Id: <20230821184644.437e66cd461eaecf92784a81@sohara.org> In-Reply-To: <965F4191-AE0F-4714-A20F-0B64D228EC9C@nimnet.asn.au> References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> <20230821130132.50aeb96b51b2b71efa14cb94@sohara.org> <8dbe0d99-ca94-998d-0c4e-27642db1b11a@optiplex-networks.com> <362941E9-C354-4325-A691-6DC44E5F5AB6@vanderzwan.org> <0178E106-F136-44F6-BB36-D94ABEE4BEDE@vanderzwan.org> <3caba337-1d4c-4555-d3ba-7d36278a4c9b@optiplex-networks.com> <0E0B068F-C160-445F-BCED-828694122C8C@vanderzwan.org> <2842F607-E62B-4D83-95AE-B44AE769B77F@vanderzwan.org> <005285FF-8BCB-4C65-AFCF-61A06265C530@vanderzwan.org> <965F4191-AE0F-4714-A20F-0B64D228EC9C@nimnet.asn.au> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.1) X-Clacks-Overhead: "GNU Terry Pratchett" List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-2.70 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d5040000cd08ba.46350abf508d3498578c2679145d76be@email-od.com]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[email-od.com:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[sohara.org]; DWL_DNSWL_NONE(0.00)[email-od.com:dkim] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RV0Kc29RXz3b3n On Tue, 22 Aug 2023 03:16:54 +1000 Ian Smith wrote: > s/can/definitely should/ ? Only if space is tight -- Steve O'Hara-Smith From nobody Tue Aug 22 00:28:54 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RV9G21rswz4rTmS for ; Tue, 22 Aug 2023 00:29:30 +0000 (UTC) (envelope-from lain@fair.moe) Received: from mail.076.ne.jp (mail.076.ne.jp [45.76.218.69]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RV9G02Ym9z3QwK for ; Tue, 22 Aug 2023 00:29:27 +0000 (UTC) (envelope-from lain@fair.moe) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=076.ne.jp header.s=dkim header.b=h3RXKmYP; spf=none (mx1.freebsd.org: domain of lain@fair.moe has no SPF policy when checking 45.76.218.69) smtp.mailfrom=lain@fair.moe; dmarc=none Received: from mail.076.ne.jp (localhost [127.0.0.1]) by mail.076.ne.jp (Postfix) with ESMTP id 4RV9Fr1DgGzW0pZ for ; Tue, 22 Aug 2023 09:29:20 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=076.ne.jp; h= user-agent:in-reply-to:content-disposition:content-type :mime-version:references:message-id:subject:to:from:date; s= dkim; t=1692664159; x=1695256160; bh=kkEVJKbPnl+xAW0qcrxZ9B9oti4 9YJdEpUAv0KhwzAI=; b=h3RXKmYPPJL1HgticH7nABYjKyN1Avi9rVB0v0e5BV7 JIJOsHWnPOiQl0vuqCavaTKEnp4krJUAHC+fKEZJM322UFHb+IqgLikQYw6bvRjn fZu1GTo0lYNRAvOn1b8V9Ha/OZivuH9me5DvYUsOFA5Visr7pnxuOW2soyqivHaX F54Dj6iUxWTWe57E8VsYUR/K7s1/WGRaMjxx6v8yqTRzpQJt2U0PQ8plJKTFZifT qC2XAb7kINPZDTGlHNF8dQgnsfufCvzbU19So2JZR8Dk0HX8M1sZlw2AThh6jUlW kRz/oBD8fpCabfiWMB4cm3/4cz9Ycc0wOy0Biw4+JrQ== X-Virus-Scanned: Debian amavisd-new at guest.guest Received: from mail.076.ne.jp ([127.0.0.1]) by mail.076.ne.jp (mail.076.ne.jp [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 3FoBO4FDxJh4 for ; Tue, 22 Aug 2023 09:29:19 +0900 (JST) Received: from mail.fair.moe (KD106137200105.ppp-bb.dion.ne.jp [106.137.200.105]) by mail.076.ne.jp (Postfix) with ESMTPSA id 4RV9Fq1cHmzW0pS for ; Tue, 22 Aug 2023 09:29:19 +0900 (JST) Date: Tue, 22 Aug 2023 09:28:54 +0900 From: "lain." To: questions@freebsd.org Subject: Re: ZFS Root size keeps going down after upgrade to 13.2-release Message-ID: X-Location: =?utf-8?B?IkVhcnRoL+WcsOeQgyI=?= X-Operating-System: "GNU/Linux" References: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="kt7frapioq5v6lha" Content-Disposition: inline In-Reply-To: <8f3b445d-3f55-f359-ce5e-0d86c57755fe@optiplex-networks.com> User-Agent: NeoMutt/20230517 X-Spamd-Result: default: False [-4.90 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; R_DKIM_ALLOW(-0.20)[076.ne.jp:s=dkim]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MLMMJ_DEST(0.00)[questions@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[076.ne.jp:+]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DMARC_NA(0.00)[fair.moe]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:20473, ipnet:45.76.192.0/19, country:US]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_NA(0.00)[no SPF record]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4RV9G02Ym9z3QwK --kt7frapioq5v6lha Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable (Man, I keep fucking this up...) On 2023=E5=B9=B408=E6=9C=8821=E6=97=A5 11:06, Christos Chatzaras wrote: > There are security vulnerabilities in Intel and AMD processors. When do Intel and AMD processors not have security vulnerabilities? > It appears that changes are required both in the operating system code an= d microcode/bios updates. This is why Intel IME and AMD PSP were a mistake from the very beginning. > If I remember correctly, when Spectre and Meltdown vulnerabilities were d= isclosed in early 2018, there was significant controversy surrounding the n= otification process. Several entities, including certain Linux distribution= s and the +FreeBSD project, were not informed as early as some major tech companies. As usual. > I am aware that work is currently being done for upcoming FreeBSD 14 rele= ase and there may not be available human resources, but is there anyone wor= king on this? Seeing the lists AMD and Intel have provided, it seems like I've dodged the bullet pretty epically, but I'm sure far from everyone can claim the same. -- lain. --kt7frapioq5v6lha Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGzBAABCAAdFiEEozVhUpXECiNYIKIXtWNzC1Y29b0FAmTkAUYACgkQtWNzC1Y2 9b3nzAwAs9HBe+kvsWj9NWSZ5tXMv4eLI4/e4K3fxJvzqmnH3l9IiLVizwUQe4bT nv3Q0WQ1W3Xs7W2hJrUTud1a8pyCoB9AqwhkVWE232BDeLg0+Y6xzKDAhGH4lPRf bY+N6KKk8QJn6D/10F0Z5QZpcyxEPgIwlqjfVti2Ef6fjaogojUay0o6hZrxm44p GwfKg3MGtq95+BeucEZKsgoMSsL52cX7DGnbncFWx4tnSU/vKmzAvwFN/sT4Oxmq tCAQXRvrE7NdXlk+kngpNB7I5g6uH0J4xPnb1FnXTJMVkiTvMlndJr28jf6aKLJO JgORfeV82Cgoj+uMfhSTwNx5AnoJg6g1QximYCxkmAiT77qD3Vh2/0JYlwlx6SKw aunCSyEvs5DCZsDLqLVyv3y0BbyEtXdmpdbWHW8kyc4l13xCE5yjwQMm5JfAEd9r JdWsl+QXE8cGpgy30eIuFQRMj6+9V32UMekVMdiDkGWlf5aG+y77e5gszat8nGOb sBBY2Nvv =htLM -----END PGP SIGNATURE----- --kt7frapioq5v6lha-- From nobody Wed Aug 23 01:02:25 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RVnxq2GPCz4qjY6 for ; Wed, 23 Aug 2023 01:02:39 +0000 (UTC) (envelope-from iio7@tutanota.com) Received: from w1.tutanota.de (w1.tutanota.de [81.3.6.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.tutanota.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RVnxp3x3Tz3F0F for ; Wed, 23 Aug 2023 01:02:38 +0000 (UTC) (envelope-from iio7@tutanota.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tutanota.com header.s=s1 header.b=NropQo7n; spf=pass (mx1.freebsd.org: domain of iio7@tutanota.com designates 81.3.6.162 as permitted sender) smtp.mailfrom=iio7@tutanota.com; dmarc=pass (policy=quarantine) header.from=tutanota.com Received: from tutadb.w10.tutanota.de (unknown [192.168.1.10]) by w1.tutanota.de (Postfix) with ESMTP id F1BB1FBFB78 for ; Wed, 23 Aug 2023 01:02:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1692752545; s=s1; d=tutanota.com; h=From:From:To:To:Subject:Subject:Content-Description:Content-ID:Content-Type:Content-Type:Content-Transfer-Encoding:Content-Transfer-Encoding:Cc:Date:Date:In-Reply-To:MIME-Version:MIME-Version:Message-ID:Message-ID:Reply-To:References:Sender; bh=RODrSSEoN/kZoHcAN5aqo2oxBnUGbyjpwbZMiF6yDPc=; b=NropQo7nYuIS+FvDRThFFVsgmwc+BuC2XOiMipKqipzBGTacfNvBjLBkTC4Oj1u5 jalil9VBuzsi3lVIYnEZzq0Ru5AskczM7ZStpSmzDl/+F6pXMo8Tkkkl+nPgXx+BzFk xusOFtXWRCjPfjcYprM/uEHGZ669XVR1pvXjRwUrkn6cUmjOijnjuXIRvASHu+wOquJ yQS0uba3Il8KB02RhyUf9IxIdHDjMVNvZ6jfd9DXcsiT5W+3YvcebL1NDgTmWl7dRMY 4TO+WtyCEjYUQw3jJ3bAdZqbyQG+HGYqGKY9HfSSN5h2sIYr00Yqvx7+MralMTVZmQK RacdfWAWqQ== Date: Wed, 23 Aug 2023 03:02:25 +0200 (CEST) From: iio7@tutanota.com To: Freebsd Questions Message-ID: Subject: Is ZFS native encryption safe to use? List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.29 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; DMARC_POLICY_ALLOW(-0.50)[tutanota.com,quarantine]; RWL_MAILSPIKE_EXCELLENT(-0.40)[81.3.6.162:from]; R_DKIM_ALLOW(-0.20)[tutanota.com:s=s1]; R_SPF_ALLOW(-0.20)[+ip4:81.3.6.160/28]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:24679, ipnet:81.3.0.0/18, country:DE]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; DKIM_TRACE(0.00)[tutanota.com:+]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_NO_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RVnxp3x3Tz3F0F There seems to be a bit of open (and rather old) ZFS native encryption bugs which still haven't been fixed and it doesn't look like it is something that is being working on. Last night I was going to move some important files from an unencrypted dataset to a new encrypted (ZFS native) one, but then got my doubts about doing that (looking at all the different open GitHub issues on OpenZFS). There exist some rumors about the original company which did the ZFS native encryption work (the person doing the work left the company), and they haven't done more since. What is the general experience running with ZFS native encryption on FreeBSD? Is it better to use GELI for the whole pool instead? Thanks. Kind regards. From nobody Wed Aug 23 02:44:52 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RVrD054Rhz4qqV8 for ; Wed, 23 Aug 2023 02:45:04 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RVrCz4qq2z3NGB for ; Wed, 23 Aug 2023 02:45:03 +0000 (UTC) (envelope-from pete@nomadlogic.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=nomadlogic.org header.s=04242021 header.b=UB8ihj0b; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 66.165.241.226 as permitted sender) smtp.mailfrom=pete@nomadlogic.org; dmarc=pass (policy=quarantine) header.from=nomadlogic.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nomadlogic.org; s=04242021; t=1692758695; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=x8zJcnPQJT7gZwGQp25uXGC2fqavfRBoDww+4WdodME=; b=UB8ihj0b1fwjZP8v20fqv3hCsocCAPeVTEEjgOjRRKouAVbMsJ3J4ZosUzQRXmOeYVb0ed AI1up2t/faA8B1SYgYXFMMpTb4IDXPQYCxbFFWudYCbo9hzGWk64adnCHYRbZM6OyOdWgB ymN8ABp+wzMhLyIzv2QEYzQ9hVzjmsY= Received: from [192.168.1.160] (cpe-24-24-168-214.socal.res.rr.com [24.24.168.214]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 40586c03 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Wed, 23 Aug 2023 02:44:55 +0000 (UTC) Message-ID: Date: Tue, 22 Aug 2023 19:44:52 -0700 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Is ZFS native encryption safe to use? Content-Language: en-US To: questions@freebsd.org References: From: Pete Wright In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[nomadlogic.org,quarantine]; R_DKIM_ALLOW(-0.20)[nomadlogic.org:s=04242021]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[24.24.168.214:server fail,66.165.241.226:server fail]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; DKIM_TRACE(0.00)[nomadlogic.org:+]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US]; RCVD_TLS_ALL(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RVrCz4qq2z3NGB On 8/22/23 18:02, iio7@tutanota.com wrote: > There seems to be a bit of open (and rather old) ZFS native encryption > bugs which still haven't been fixed and it doesn't look like it is > something that is being working on. > > Last night I was going to move some important files from an unencrypted > dataset to a new encrypted (ZFS native) one, but then got my doubts > about doing that (looking at all the different open GitHub issues on > OpenZFS). > > There exist some rumors about the original company which did the ZFS > native encryption work (the person doing the work left the company), > and they haven't done more since. > > What is the general experience running with ZFS native encryption on > FreeBSD? Is it better to use GELI for the whole pool instead? > I am not familiar with the development status of OpenZFS native encryption, but I use both GELI and native encryption. IMHO they serve different use-cases. I tend to prefer GELI, it works really well on FreeBSD in my experience and performance has been a non-issue on both my workstation and server systems. I also think it tends to be well suited if you are trying to ensure 3rd parties are not able to access your data if they obtain a disk. For example, in a colo environment FDE is the way to go if you can't physically ensure your disks are being destroyed correctly. I use ZFS native encryption when GELI isn't suitable. For example I will use this for sensitive VM images on my servers. The attack vector I'm trying to protect myself against is someone gaining access to my hypervisor and trying to seal a VM image. Generally I feel like the utility of this is pretty minor - if someone has rooted my box they can just grab the info they want at run time since I'll already have decrypted the disk when mounting it. Having said all of that, I've had zero issues with both implementations in terms of perf and reliability. At the end of the day it comes down to what your use-case is. I've found 9 times out of 10 GELI is the way to go in my experience. -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From nobody Wed Aug 23 07:01:01 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RVxvP2DGFz4rCVj; Wed, 23 Aug 2023 07:01:05 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-vs1-xe35.google.com (mail-vs1-xe35.google.com [IPv6:2607:f8b0:4864:20::e35]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RVxvM5YZ0z4T7w; Wed, 23 Aug 2023 07:01:03 +0000 (UTC) (envelope-from grarpamp@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="r3yW5xB/"; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2607:f8b0:4864:20::e35 as permitted sender) smtp.mailfrom=grarpamp@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-vs1-xe35.google.com with SMTP id ada2fe7eead31-44768034962so1433032137.3; Wed, 23 Aug 2023 00:01:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692774062; x=1693378862; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=jbbumfMBS6kgzZySLkqvt+t5wpDn5ebO+ds+o1D2tOw=; b=r3yW5xB/WuYwmX0VRi0/S3hUHFJXST20hYGkVuB0k+WyLvVP5I3W8X+qNI7kwA/rFH BQg5ZpdLNfXS75YjxoiRaAkYjZ24qwJQUHMueWVpi7iet6v4arU5bXc11fpF3ugka7rm /1TInP3xoY/s2sz2qrIbkcMGyOZUZpLJFiQ98QttwXZ5cmorCYqLbfS4DK2R5pL4bv6r p8bE/N0StuUf0TbPRAVGkVSG8/wzwc69zbWT7zbMnYqt9378NL2hA5r7hiB0vgrTPkzI nwCDzWmbC42P+RKs36J+UvD5GbBR2y/fwAkZYOizG4l9erujP7Dv4o7CIMYdLGGPzJbA QsSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692774062; x=1693378862; h=cc:to:subject:message-id:date:from:references:in-reply-to :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=jbbumfMBS6kgzZySLkqvt+t5wpDn5ebO+ds+o1D2tOw=; b=CjgoKXgZYb5JqrbRUj5TT6l5eTx8qsixQhV/T+hKVjGw/XS7A0BG/SOZh28dtgWE0/ Wh9Ns6o2Daqn9f6r5wa07v1tZNu93ou8lytNq9Dz3obZpLPA5G4d8TgdN01vxHDCdLas T4EyrwAC4v05FnIHnirFjl17N5uRNbt4/gs7FbVpFknmNjBcspiL2hMTBjAdR9Z9h+sm jI3oHFGnQbrtWj4CPeirgghK+43MCNP4SIei4vq0rz4BUP430tbNMmqvFOeeaUs6O4+O QgDHzsK7P5sWB+opDhewvz8EgjOamDpFQ34WgFSJurXWZG0kyLJ8DnUvM3ga+krA5dN1 TobA== X-Gm-Message-State: AOJu0YzrVck+mOnCNkdkr+PEk5Thk0E2FJXraJ7VoQFILT4c58f/9h32 vYrF47cOmKXNPk/u+U/RJ4WqbZsJiHGfsCZtqZJ7vVkaoRA= X-Google-Smtp-Source: AGHT+IGVKx2OsrW+xipgtwwLv7uzPo49xY+xsWOasPVpaoegZm/NYYSDUcQIc+rzd1RViKzW2in3PBP9j1mIzb/jepA= X-Received: by 2002:a67:fd0f:0:b0:44a:c20a:ebb1 with SMTP id f15-20020a67fd0f000000b0044ac20aebb1mr6841243vsr.13.1692774062286; Wed, 23 Aug 2023 00:01:02 -0700 (PDT) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Received: by 2002:a59:9fc1:0:b0:3ed:209f:4d2d with HTTP; Wed, 23 Aug 2023 00:01:01 -0700 (PDT) In-Reply-To: References: From: grarpamp Date: Wed, 23 Aug 2023 03:01:01 -0400 Message-ID: Subject: Re: Is ZFS native encryption safe to use? To: freebsd-questions@freebsd.org Cc: freebsd-security@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [-2.81 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.81)[-0.810]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e35:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org,freebsd-security@freebsd.org]; REDIRECTOR_URL(0.00)[twitter.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RVxvM5YZ0z4T7w On 8/22/23, iio7@tutanota.com wrote: > There seems to be a bit of open (and rather old) ZFS native encryption > bugs which still haven't been fixed and it doesn't look like it is > something that is being working on. > > Last night I was going to move some important files from an unencrypted > dataset to a new encrypted (ZFS native) one, but then got my doubts > about doing that (looking at all the different open GitHub issues on > OpenZFS). > > There exist some rumors about the original company which did the ZFS > native encryption work (the person doing the work left the company), > and they haven't done more since. > > What is the general experience running with ZFS native encryption on > FreeBSD? Is it better to use GELI for the whole pool instead? Neither GELI, nor the rest of the crypto subsystem, nor the kernel, nor userland... has ever undergone anything close to a real security audit, let alone an independent one, let alone been formally verified. And agents, moles, malactors, bugs, and worse are running rampant across the entire computing spectrum... from fab, to shipping, to OS and crypto development, to magic packets, to telecom, to phones, to firmware, software, apps, and updates, BGP, your ISP, frontdoor, backdoor, back orifice, and more. Your use of any crypto, on any operating system, on any hardware platform, on any network, is entirely at your own risk. Still lots of fun yet to be had... #OpenFabs , #OpenHW , #OpenAudit , #FormalVerification , #CryptoCrowdFunding , #OpenTrust , #GuerrillaNets , #P2PFiber , #GNURadioRF , #PrivacyCoins , #DropGangs , ... -- https://www.youtube.com/watch?v=xWAwK2fHArc https://www.youtube.com/watch?v=_U3lEc-IFr8 https://duckduckgo.com/?ia=videos&iax=videos&q=voluntaryism https://odysee.com/@Anarchast:2 https://bitchute.com/ || https://rumble.com/ https://twitter.com/NameRedacted247 https://libertarianinstitute.org/books/voluntaryist-handbook/ From nobody Wed Aug 23 07:32:01 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RVybJ35TVz4rF35 for ; Wed, 23 Aug 2023 07:32:12 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RVybG1gZ2z4YBL for ; Wed, 23 Aug 2023 07:32:10 +0000 (UTC) (envelope-from ml@netfence.it) Authentication-Results: mx1.freebsd.org; dkim=fail ("headers rsa verify failed") header.d=netfence.it header.s=202304 header.b=WcnJkSIF; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it; dmarc=pass (policy=none) header.from=netfence.it Received: from [10.1.2.18] (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.17.2/8.17.1) with ESMTPSA id 37N7W1Ub010006 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Wed, 23 Aug 2023 09:32:02 +0200 (CEST) (envelope-from ml@netfence.it) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netfence.it; s=202304; t=1692775922; bh=i6C19o9/V2SRV6XeKYl3gq/l55rVmxanbvJ5fIxTdpY=; h=Date:Subject:To:References:From:In-Reply-To; b=WcnJkSIFbzdQxNrZDjgvZtKrBGQRaBV96ScD3fNjYW/5ufRltr/AnyJS1UOQeqjFe Yz58/kTcYMpMeefjlM6smJiLSUgSwLJnxfynCeAunDN+Ze4DF9kdjPSlMqFRimwnwc WZfllJJ2N3jWSx7+42pVcayyYGm4xAxKw5XQJAHE= X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be [10.1.2.18] Message-ID: <0e7d2657-f857-01a8-f764-33b9c62c11f1@netfence.it> Date: Wed, 23 Aug 2023 09:32:01 +0200 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Is ZFS native encryption safe to use? Content-Language: en-US To: questions@freebsd.org References: From: Andrea Venturoli In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-2.80 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW_WITH_FAILURES(-0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; DMARC_POLICY_ALLOW(0.00)[netfence.it,none]; R_DKIM_REJECT(0.00)[netfence.it:s=202304]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[netfence.it:-]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; HAS_XAW(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RVybG1gZ2z4YBL On 8/23/23 03:02, iio7@tutanota.com wrote: Hello. Just my 2c... > There seems to be a bit of open (and rather old) ZFS native encryption > bugs which still haven't been fixed and it doesn't look like it is > something that is being working on. > > Last night I was going to move some important files from an unencrypted > dataset to a new encrypted (ZFS native) one, but then got my doubts > about doing that (looking at all the different open GitHub issues on > OpenZFS). Could you please provide links to these discussions/bugs? > What is the general experience running with ZFS native encryption on > FreeBSD? I'm using it on three machines with no issues so far. > Is it better to use GELI for the whole pool instead? If possible, I prefer GELI. However, I want to be able to let the machine boot without having to type a passphrase, SSH in and activate the encrypted partitions/dataset. In the past I used to have two partitions (a "plain" one for a non encrypted pool and a GELI one for the encypted pool); however this fixes the sizes of the two pools and leads to some hassle when one might get full while the other still has space; so I'm moving to a single ZFS pool with some encrypted datasets. bye av. From nobody Wed Aug 23 07:34:56 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RVyfX4lrDz4rF4W for ; Wed, 23 Aug 2023 07:35:00 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RVyfW0z4Cz4Zb7 for ; Wed, 23 Aug 2023 07:34:59 +0000 (UTC) (envelope-from infoomatic@gmx.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.at header.s=s31663417 header.b=gqO7dJ0p; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.21 as permitted sender) smtp.mailfrom=infoomatic@gmx.at; dmarc=pass (policy=none) header.from=gmx.at DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.at; s=s31663417; t=1692776097; x=1693380897; i=infoomatic@gmx.at; bh=PrdNA715mp2FDFuXL52bwtu4cROnydH/Bl6K2yWufBY=; h=X-UI-Sender-Class:Date:Subject:To:References:From:In-Reply-To; b=gqO7dJ0pi5Z2qe3n8xLMhZH0p0/NCt3ozvt+y6YFiT9TZE76Y/n64Mzgz5Y4973LgIAL8nI bgoH7eQpXoAorIcWX2hAqVUfFdrkFqMVKuih92DRRV4n+wP1JB8WXLKh2l+/CHjEen4EtDNty Fh2W1qLzGagIJ7KRlQVY8Ylw/eDFv5kOUX/HgORUiukrFjspOmIvsg/Rs2NMXc1JIisRSS1Tc ql6qONhPJ2XeGD6y3M7u9CvJ/T/psjoPqWQwaUo+mThZ0DcjmtNuODkMJdAdjcVkr4LijI1cS bgx3rmAsrgSRlxyqexkPPd7YUfgZUVgB1xtfYCvbOGo1evH6EPFQ== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from [10.0.1.209] ([178.114.187.129]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1M2f9b-1qa5q21LRv-004Dsw for ; Wed, 23 Aug 2023 09:34:57 +0200 Message-ID: Date: Wed, 23 Aug 2023 09:34:56 +0200 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Is ZFS native encryption safe to use? Content-Language: en-US To: questions@freebsd.org References: <0e7d2657-f857-01a8-f764-33b9c62c11f1@netfence.it> From: infoomatic In-Reply-To: <0e7d2657-f857-01a8-f764-33b9c62c11f1@netfence.it> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:tJ+3+zukk46KnMK2K49n8HSRXP8MMitR9i47xuAd1w+SZUEBKAz 02yd1gv1jwmw3M7ggTm9JoP6IlUF0Lm5myjaetoWHH66RzEuOC3C4kXkFgU9soR8SDTcbKi ffJjS53K50K4Gu59gWS1gk7hMylmODE5olNIzpfTvsn/ri/xEbId+rEKMr3D1mzyYIHKH2s +0nkGKZ5TJh8u93jA/OIQ== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:mD9MP2dajQQ=;TKGdzF2pLjTBJwpbBh7FszC3CmH obqIVEQxB5atv4QbKPjAQHU2lPySN3l9wqlNF+w+Lwxq6NzMFIGXwIMWmfKueIbxypCoxoWGB Z2q8StT9WEFnB/GQ71uk50VD8gBU6NVD5lvE9GISeuDGzvUO0M4nfuy72pC3OOLVqjEDf0FhT S4QEAqMolItJB8Sq8uKn73SHQbJh+mVYNlWBVFAjQFIq6XTBvzo1EKdmdFlNmkyfAEeDuUAlZ SNAiBFk0Xh0PESUuyqMEGc8rVA+EItW6ChaSGfZa57NUPX5oysr/2Xuhk1qibSjNgOy0z0s7M UUyG4juAB6KS2ef+v/556F+Yal4KVv9PMbaJxodqD2UPlV9zNoCYRyetrTky50UBngw/JaPCD Ejb0mcNAk+xIr2qGEKrvVTWb8BgkX1WJw4BP5XYRiiEGl5eivFJuMlXrvSHFFDt5FiebQf6PY nS8+WuSeNnefwHwH8X8yUkEkM42MG384hkNSLcv0uWZXrUPS9uThaTz5ty1OKLwNhNDfw1sfB 2kP12obwP/RaMYZD8OXbEohljYWd5gTKx4Wzo8aN3MTUNLLrbIp0fQw4YZvCpbjyWdJ2CJ6nq 4c87fjsRHfy3frbJYWuOsVUhm12zQ1llztomSXXK+HOJzFgPLdt9ywM9UokuQiKG8Zufu6cwy WUX7dTWKdFWFUQnzb4pmdLRIJ/1GMyIPUEiGYoUTXsBfGE2Xbuyu/xFxsaGdSRPOOdnKwXVvw /fIKqAvTVfUgqpWQBtxK2JcIJjb03sPffFxbgJbxanPkiBq/VxmGR3p0zJLEw5gKgAWrT1zgG k+3r7h6WFi8XJasoCEaIbL7I7fez4Fn0+bNCZUOQYjUq9404L+aR+8DWOPdcFnLl1geNQaYD6 TrGz4vuNg1/v74JrGTmaoKDtdrArOHp80z8VsJ+BNadsLgcLpGBc6rpRD9EXjEZQzP5j09UXt C2ZVrg== X-Spamd-Result: default: False [-2.53 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.53)[-0.535]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; R_DKIM_ALLOW(-0.20)[gmx.at:s=s31663417]; ONCE_RECEIVED(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.21:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.21:from]; DKIM_TRACE(0.00)[gmx.at:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmx.at]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmx.at]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RVyfW0z4Cz4Zb7 last time (when 13.0 was released) I compared them: *) GELI + normal zfs was significantly faster than encrypted-zfs *) encrypted zfs to share files between Linux and FreeBSD did not work properly, resulting in Files non-readable on FreeBSD On 23.08.23 09:32, Andrea Venturoli wrote: > On 8/23/23 03:02, iio7@tutanota.com wrote: > > Hello. > Just my 2c... > > >> There seems to be a bit of open (and rather old) ZFS native encryption >> bugs which still haven't been fixed and it doesn't look like it is >> something that is being working on. >> >> Last night I was going to move some important files from an unencrypted >> dataset to a new encrypted (ZFS native) one, but then got my doubts >> about doing that (looking at all the different open GitHub issues on >> OpenZFS). > > Could you please provide links to these discussions/bugs? > > > > >> What is the general experience running with ZFS native encryption on >> FreeBSD? > > I'm using it on three machines with no issues so far. > >> Is it better to use GELI for the whole pool instead? > > If possible, I prefer GELI. > > However, I want to be able to let the machine boot without having to > type a passphrase, SSH in and activate the encrypted partitions/dataset. > In the past I used to have two partitions (a "plain" one for a non > encrypted pool and a GELI one for the encypted pool); however this fixes > the sizes of the two pools and leads to some hassle when one might get > full while the other still has space; so I'm moving to a single ZFS pool > with some encrypted datasets. > > =C2=A0bye > =C2=A0=C2=A0=C2=A0=C2=A0av. > From nobody Thu Aug 24 12:08:19 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWhh42FMzz4r5J9 for ; Thu, 24 Aug 2023 12:08:52 +0000 (UTC) (envelope-from infoomatic@gmx.at) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWhh30frVz3WNw for ; Thu, 24 Aug 2023 12:08:50 +0000 (UTC) (envelope-from infoomatic@gmx.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.at header.s=s31663417 header.b="BsJO/y6q"; spf=pass (mx1.freebsd.org: domain of infoomatic@gmx.at designates 212.227.17.20 as permitted sender) smtp.mailfrom=infoomatic@gmx.at; dmarc=pass (policy=none) header.from=gmx.at DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.at; s=s31663417; t=1692878903; x=1693483703; i=infoomatic@gmx.at; bh=xIHD0tcP8cM+YUZ+DayncsjmLgFOp8g3hmd9pGiPVBY=; h=X-UI-Sender-Class:Date:Subject:To:References:From:In-Reply-To; b=BsJO/y6qAI/C/595hsTl42svcX0a4ITGJ6ADoWV0Y79AA9exYtHyoHOicHGkY+BufzRARH7 /Y09okRQcNvlmUnssuAh3FVE7yHs8JFeap9oXH7yU2MhQSmfBsxjts0rdGsmQUJAsOFPGxBOB 898mlFQdzx5NqltqufsQ0CSr1soTWMYc0Z/FFa9fXXGauRicmqlhFgLuMPuVlnxMLT2a/cYsN vYP/JWE49Kjn4KCHRnkTbOt8eCkRrmFWzAA8ARvOppXw6BzY7itn7AJ2zo8ew9ZubMWLvKv5v HZ5ee266/H/NzklrVtz1qoByFC21HkBjtghvI5RvzAjV9+vpkDcw== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from [10.0.1.209] ([178.114.187.129]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1Mdvqg-1pyRXN1enG-00b7MY; Thu, 24 Aug 2023 14:08:23 +0200 Message-ID: <6b741e03-732e-f1b8-6340-0a8897fb8235@gmx.at> Date: Thu, 24 Aug 2023 14:08:19 +0200 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Is ZFS native encryption safe to use? Content-Language: en-US To: Dewayne , questions@freebsd.org References: <0e7d2657-f857-01a8-f764-33b9c62c11f1@netfence.it> From: infoomatic In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:4urUegSJrGQ4aiDiQVUZVX/IX4NZTIO1HvTvdgHnLheaqNN2IVQ 6aAR2oKrKXvfg3vB6mw4W4+RPHWGpY9sdiJMU9ez9Dtf2HcILeOCNwR6+ZFwlDnn0qbOuem SvKJie6roogNZoYN2sj3go4kkaTRqtnjLBl4inhgUVW3JJXIE3f5sH1Nl95JN/CjDY8vTVd avWsx6Qy2wb5hUzsDBLjA== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:fdesIm+z73w=;inSO3Y1yhqyln4FtqztgFQNOFSF NcSoc/rrNAL6weY/uOIVf/GZwvO8OYILFiIWaOoPmcd3Muc1OLdVNn+SZ3H95uLNQ/yrLMSzF 74q9Tmgs8kAl/opnKO2NelHDOHN+/1cOIyI5HLoJbFl8dhLAIAHYYaT5ktBCKJaP/1btaijeY u1u45U2Kag2IHEdyQ0nfaepz2lN14Zt6pmdR0ew2i++4uBWWfn4BhVZL6yTJQjsVoXkrEW2Tq 2V+ngoiMbOrxNFnb7n2eR/QEPUfKloF7jrTyqtZasJ03upcjzm6HcnWmro4jgJ2M8M/AScKLV kn28cOvcfs6V8BcPYgeQaYqOjyWVLGveAChjoqOzZaJifeNDT+eHeuZhSi3Fw+/in64/cFmlE mOuijmeTmv0OsbouUXI+QXSAsG5Ec9Gx1qjMK7t6U2RmwPk/lfMVQW4BC3F9DMhGWL57BLbaN 6rn873++Uj7F/BG7aX65mvIRRape91CqTEHzYhlYyR8zxGFthahshhrBjcnWmJ3d7rBkuMWM5 2mvB2ASOhU3rc2Wr2p2/PsKVfcmoSxBujc5oKcqQjPOzeFn3Iw8GDypkZg1+Qbj0KXe1Q3TyA pNFpsuT5N8KrUnS6HfYuWlyoHZ0j7IVDAcBB5UI+wds1QvjxHYL193abHgOekcKcs3AGjC0IE LpWFuqkl4SswA4FVgtPmnW7pDhbldlC1028zhujsM3W9tneOB8H1VjB28WahUQtXOSBbeVFQU 06PjQ4jGsb5dl2Qhl9Rsv6wybGiBosAK+TVKIezajusamh1hwAu53uEkfGOcgJa0aeW82MK3I 9DWxMtP6IwSxKJNdelQQM3uWBAXnfT80WYVQe9JQQ3PbIxJc+B3bcHD9ZSlZksAe+tH5HR8nK nJJxAKvKjnPrOg9X9fFs3w6l2+K+n8LtAZcfOUR27Sz2bo42v++c+G/cb00iHXCyV8Pc37FZ0 kxJlWA== X-Spamd-Result: default: False [-2.72 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.52)[-0.522]; DMARC_POLICY_ALLOW(-0.50)[gmx.at,none]; R_DKIM_ALLOW(-0.20)[gmx.at:s=s31663417]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; RWL_MAILSPIKE_VERYGOOD(-0.20)[212.227.17.20:from]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.20:from]; ONCE_RECEIVED(0.10)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; DKIM_TRACE(0.00)[gmx.at:+]; FREEMAIL_FROM(0.00)[gmx.at]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmx.at]; RCVD_TLS_ALL(0.00)[] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RWhh30frVz3WNw On 24.08.23 00:43, Dewayne wrote: > Thx for the performance hint.=C2=A0 Were you using the same cipher on ea= ch? Yes, I have tried various combinations, but the difference was so huge that I did not let the benchmarks finish cause I felt it was wasted time and resources! > On 23/08/2023 5:34 pm, infoomatic wrote: >> last time (when 13.0 was released) I compared them: >> >> *) GELI + normal zfs was significantly faster than encrypted-zfs >> *) encrypted zfs to share files between Linux and FreeBSD did not work >> properly, resulting in Files non-readable on FreeBSD >> From nobody Thu Aug 24 18:44:02 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWsSP31PPz4rShx for ; Thu, 24 Aug 2023 18:44:21 +0000 (UTC) (envelope-from mail@souji-thenria.net) Received: from alisa.souji-thenria.net (alisa.souji-thenria.net [188.68.37.165]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWsSJ6XHHz4c0j for ; Thu, 24 Aug 2023 18:44:16 +0000 (UTC) (envelope-from mail@souji-thenria.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=souji-thenria.net header.s=20220813rsa header.b="Wx/wUO3L"; spf=pass (mx1.freebsd.org: domain of mail@souji-thenria.net designates 188.68.37.165 as permitted sender) smtp.mailfrom=mail@souji-thenria.net; dmarc=pass (policy=quarantine) header.from=souji-thenria.net DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=souji-thenria.net; s=20220813rsa; t=1692902648; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=FpVjMXirfadyb+m7maPg6wzHhFr7OeD/e0FdNTr1JuM=; b=Wx/wUO3LKssuYyrSZi5pl3zuYQKMrzoP960DHXSjfRodDaCTPT8JF/SIctgETEGFByh9Pb EUVNpv3HlO78ctzhb7O7BzlOnDOeRVgZi0AfeFWgB5pRC2XQTRu8xkRmxoowhuAIR1Yz8W JWlBuVVAOqdWJJVz2wKIx76HOZLaI0yHJTeafEJYm8LoHl7IsAcO5ayXSpSKw2AxTGRjPJ o1nI77l4xes/sLdwLOQWtSQKIEgJVp4m+VqGWp2nC5vHP40khkZjAELc+e2mQYJX4wmmDC /MBYgt9sNWjw4hTXF2ciyUT5zsGwImcyN0AYZmsNKN4u+R2g9tt+bt4cKc+obQ== Received: by alisa.souji-thenria.net (OpenSMTPD) with ESMTPSA id 992e9216 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Thu, 24 Aug 2023 20:44:08 +0200 (CEST) Message-ID: <4bec0932-15b9-4f27-9194-21fbd37145b2@souji-thenria.net> Date: Thu, 24 Aug 2023 20:44:02 +0200 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US From: Souji Thenria Subject: Nextcloud - sem_get(): Failed for key To: freebsd-questions@FreeBSD.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.89 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[souji-thenria.net,quarantine]; R_DKIM_ALLOW(-0.20)[souji-thenria.net:s=20220813rsa]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; XM_UA_NO_VERSION(0.01)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:197540, ipnet:188.68.32.0/20, country:DE]; MLMMJ_DEST(0.00)[freebsd-questions@FreeBSD.org]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[souji-thenria.net:+]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RWsSJ6XHHz4c0j Hello, Currently, I am running Nextcloud 27.0.2, and there are a lot of errors like this one in my log: [PHP] Error: sem_get(): Failed for key 0xa11: Function not implemented at /usr/local/www/apache24/data/lib/private/Preview/Generator.php#272 These errors started showing up somewhere in the 26.x.x version. And are connected to a change in the thumbnail generation. It would be possible to comment out the code part responsible; however, that would most likely hinder a later update process. Because my logs are flooded with these errors, and seeing other log entries is impossible, I wanted to ask how others are dealing with this issue? Regards, Souji -- Souji Thenria From nobody Thu Aug 24 20:12:29 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWvQP6Dzyz4rX7k for ; Thu, 24 Aug 2023 20:12:45 +0000 (UTC) (envelope-from vl01@jens-carl.de) Received: from mx03.jens-carl.de (mx03.jens-carl.de [5.9.59.126]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWvQN432sz3KNp for ; Thu, 24 Aug 2023 20:12:44 +0000 (UTC) (envelope-from vl01@jens-carl.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=jens-carl.de header.s=y63fwr_1 header.b=zo8eCCkG; spf=pass (mx1.freebsd.org: domain of vl01@jens-carl.de designates 5.9.59.126 as permitted sender) smtp.mailfrom=vl01@jens-carl.de; dmarc=pass (policy=none) header.from=jens-carl.de DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=jens-carl.de; s=y63fwr_1; h=Content-Transfer-Encoding:Content-Type: In-Reply-To:References:To:Subject:From:MIME-Version:Date:Message-ID:Sender: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=O7BhujEzDpFwiLdNhjiBG41eW5U4zTvhp3bt6QZbERY=; b=zo8eCCkGESHmyvPlo9VhZcZOY3 H6jQLf3Ia9NKx74jtsmgb0eUvOf2s3t4gXsmV4KGNMfi/7sjCNOh9h6VBpKdhWiTo1dqaxnWNaohv Zo8+FTLQWmZXTzRbVgIrJgHLxPDIghaASY+smePU1NvIOXSSjMFRf2pt6tSlvgj4VIsY=; Received: from d99-199-40-194.bchsia.telus.net ([99.199.40.194]:42448 helo=[192.168.1.117]) by mx03.jens-carl.de with esmtpsa (TLS1.3) tls TLS_AES_128_GCM_SHA256 (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qZGh1-000Kyi-2i for questions@freebsd.org; Thu, 24 Aug 2023 20:12:36 +0000 Message-ID: <590f456b-9942-47de-a96a-6245a267af8d@jens-carl.de> Date: Thu, 24 Aug 2023 13:12:29 -0700 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Jens Carl Subject: Re: Nextcloud - sem_get(): Failed for key To: questions@freebsd.org References: <4bec0932-15b9-4f27-9194-21fbd37145b2@souji-thenria.net> Content-Language: en-US In-Reply-To: <4bec0932-15b9-4f27-9194-21fbd37145b2@souji-thenria.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.89 / 15.00]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[jens-carl.de,none]; R_DKIM_ALLOW(-0.20)[jens-carl.de:s=y63fwr_1]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; XM_UA_NO_VERSION(0.01)[]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:24940, ipnet:5.9.0.0/16, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; DKIM_TRACE(0.00)[jens-carl.de:+]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RWvQN432sz3KNp Hello, On 8/24/23 11:44, Souji Thenria wrote: > Because my logs are flooded with these errors, and seeing other log > entries is impossible, I wanted to ask how others are dealing with this > issue? You have to install the php extension php-sysvsem. For PHP8.2 it would be pkg install php82-sysvsem. Cheers, Jens