From owner-freebsd-current@freebsd.org Thu May 6 00:18:43 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 73F02629D1F for ; Thu, 6 May 2021 00:18:43 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-8.consmr.mail.gq1.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbDhM1CD1z4vWr for ; Thu, 6 May 2021 00:18:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620260320; bh=ZiDWzzUQ5JGaPQAwFI67YRJQ8dSeiC9IuLkpSr3tsF7=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jOKd7lSuWgi1VnBFjaATg4lI9oi9EQrYz4YNvc40H1vbBw1tVTqVCyNZsD8OplVHI5zzTDZi1TPArQ/zjrV3c89EhCjZ9iVJakzW2cT+UtrYiVvi4ei3NImHCGAkzYFfrlCfUqSDHPQMN5lKMveUYcSvMj+ibIt7Yc+x1GHdZi51dwCmFaLBgbuiDXw74hFDSEzLAKgEILDdk/iEY4GFCL8v/NNJW9ynJCTIWtsUUMJHDnQZPujlSX2Rdfx1XCjTMPXTr+bKAN93mrLz/s+/C3IEavc/KhlLACapYV+MtGl4CnTjcpTHi++oQDKSc4YShRqn5izt7dvoCde2Fskodg== X-YMail-OSG: wbPMNm4VM1kqLZSwpu4yohf_wMm5XPskZkQs5nb24C0Z0998yjaf9GMIzjUWRvs 54RnZcq_RVE0CrUYRMF3otKLO7m7e7imUAQ_MePtZPQOgxHwWI0nLG1H8mNj3eBQ2n4PI0z5tUG. RXCLOCC52YK5ACpVAtJCwEonEIhLbGkvOjQiNZD5E3vXnHZ9l28oo4LhvzR9sSkVXO0IqREaUbu6 dQDvSY9P1wigs8LY62BDiEVE8z5w.UT4pp1Jadv7jegpiropYb0MOAlGP6yU2fvEui7n_lJ21cFI dsm4ERoRn_tu.W2gODeGvikbulWbOCce0EqJTMXtqUtKdHZyam3GE5eUDtG6e2NW1muvmiqq7H7P Ns0_MdzRFmyXp_NSsbpvRz0Qdw_uektYay98Y5jRHqoHRnPeWm7F6YCatolUUAMHnjKp_3EyTAza YQYUxzApPsRdnQoIiUh24HkYK2DpsU9sM6CRtCk1ERLvcwQ5oHcAIa9QewcVNZnSJvBzDobtiwI5 Xk4R.W4dDPwRrmklAokSeDoqFFxTAj0vNiG7ljuVm94wD75XUvj42Bg_PVwO1vkbHQNfkbm9k8ig ARYxzZ8V8nuKCNinWCVuePOvP10KEnBkFCe6mC5FrDycD8NTIReFsx9qM1UnqZ_ZHCHM197jozr7 aSc84zRouj9snZxFiXSA7_EN9dS0N5TSZlOGzjhxSCbxRvkCLwZ5XEv1Kf6ZRjRIdSFVsD0MbZ.5 Vohf3vS11TrtF3ouqMzgJirXdpQkiRfyD30H0BN0LS_py3Vrdt4bWjipS2qUXSNM_O2.uN4OOKyx Aba9g0XQs0Fugccpeqj43lAigEa_MQNpimO2yPtfy0XeziT_CYF2Wh8vj2w5A9E8GYAXWDFxa6ql jALtHokjtjIEr1ivbCqQlH7gH7v3.BAfU4Y6prWvQYpll7ZDmiJUpxo.XxuxN_Ed8bpr1Sc5Z_lZ JGWH0rxuTJ0W5u9LP.98fBIVt4GJLzGSo8K7Pqb3fh3B5qF.V_.KQh2pAvmocsoK4vo0.ciGp8nV 47NfYwx_IpzZlI7va4sHQPBa4e3kHjQQ7RLs3fQGw5sNZ6LM3BpSEh8QsK_uCbc2PXYbs_gqSYGx 5LA0YCY2MnjW9i5_WO91lVCkS1LuH3Fb3i9krQI0GgIHr6Q_0.bhPMmoASip_4YGNLFwPSFbmOds 3.qS5.sGeODuFDSdwzsX7PA43gxAXBmRgGA3.SxB2CdCW97YMcM.TqwWWjLsvb6FBJH2vyzNnxCx dpqQ3EyS15jwqvx.6uhtlT7MPTenNQdlIVGXVIKcNpdDKHmGZkUlcfnoo_KCNxPiUFzOko_5Ot45 O68a_ePUu61kjHVpwxRDOHM7G_VyBg.R6C72OT9WxWK.NBQXoH.bAe4mjWSqnv6RyVgUUAQINQeA j_zm9X.8NUOm0mn0lUDGC0caTPrCLtnPLeM0uJWJyAC0MA3XHJZzVtKLBtuyeuarZCeHmncg35QJ pDZakK44PRYeIDZHq9MeS05D8dReIPIDtOMtcU9zGGPnfzV23ZYp_gpAeYmOQ71V.bbTxDrwTPg9 ZnxlLQ9SbXTGVzfqlOdxo5OsZarfX2L1cwe7bXQxRV2pmvt2CSesRc97KoIC7Lfk1tD4MogbDgb4 teTNheZm9KPyw2oaXegUyFcpG5RRBiZnD7h9GY6_WR_ilsa2bCiZERU9XsiZj7LzIKpvwJVpxcgm KugXpdiZHSseMxILt.5dIi9S3KOFdWRWIV.lR5z3blrGA4yIxrJxHOA0fQajxzLM.0QDPxBPCUdZ xqPu077pccKWKUyRuExFX0rO1VorqfsxbOFJqAWBOv.CfsOvGr8sVMI8XD3C_wxooiy89cNGfD5w V3U0iub2kbn94bEZdTZxkECl9K6MAgxh2LwjAvcbWcqlw2y6jpud2FZvDXB3v2_3E_Zepn91Ppph vRT1i44RIT.Mh0dZ61SiZOs78AmV4bg5F5pOCMfaqya05fLxYFvMwtuKdNhNB.m4M_thBeZBvRJP 8W04yP5y9z49cZRoC4ivQlVo9NEdZN7JO9y4E40qYJ6Z92DgrkiWsCJxtaVsUYzYkBKDmgfDZJdC um1Av24DoY4R4alXUZ82U8Iz31XnzhKKsAi4V3ht9h1jB2rhu25M0e09Vc6JQtITYkU2eBoQG5Xq SfZQPGAPivulETGl1B5WpZT7VAJpwPsPZYqE7m.YQP4J6kj6Lyj9EHP.K7hglWzBKmIxUBYZqRWF hiNvST962t235PEawNTaKlg1pmKytZetNUqj4IspPj0nF3TuGd_38eB1z1Nr7dLOOUvugjMnqHir 7gQQhm54wtJ9ES6mlDICz0RYbdoyFYioQ0w4lWctcE17Nv92xpJq1hCUe19p1M9S.soTJl2gHURj zT_C8yuFK1.vTxvowk0IOx5330bxd8uD0hzCGvw3qgf2Ahq.pDCRZuJfRzGbMxXjLMOLBfrReb6h IW0nfYdpQwvIlwtNtcyuSDC3LJ2JGoof6jv24CeiSrU_A07mim9smprUS8.oCF6Rfxgw1k6JMeZo Yhu.R1sSG1a8BRs9Xus3CrZ5juYKvQfzUJV5vPgW4q_cd1tRHSW63xi.h1jq4MXGXgY34NK4.Zpv 8fMix69_eel9oMx6Dbc5drR7NIX2WJGzd2rTnKcPbIVH82yAcI4fnING1Oapo.i7lvkd_Sjf0b8m y1JF1eATroiT24sDQP5zgS5kCM049QpiXnqshmjUDemnF2Z3G8oAp.59sZW6iD1MkO2at609olR2 mIj3xAgXEkLt34VMiYA-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Thu, 6 May 2021 00:18:40 +0000 Received: by kubenode544.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID ae539ec798e8ac8d2e9120c77e83a682; Thu, 06 May 2021 00:18:36 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: zpool list -p 's FREE vs. zfs list -p's AVAIL ? FREE-AVAIL == 6_675_374_080 (199G zroot pool) From: Mark Millard In-Reply-To: <34521f0b-a7a1-1743-244a-4149e72911a0@FreeBSD.org> Date: Wed, 5 May 2021 17:18:34 -0700 Cc: freebsd-current , FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <164F9986-FB9C-43A9-ABC0-0D091D2CFF3D@yahoo.com> References: <34521f0b-a7a1-1743-244a-4149e72911a0@FreeBSD.org> To: Yuri Pankov X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4FbDhM1CD1z4vWr X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 00:18:43 -0000 On 2021-May-5, at 17:01, Yuri Pankov wrote: > Mark Millard via freebsd-current wrote: >> Context: >>=20 >> # gpart show -pl da0 >> =3D> 40 468862048 da0 GPT (224G) >> 40 532480 da0p1 efiboot0 (260M) >> 532520 2008 - free - (1.0M) >> 534528 25165824 da0p2 swp12a (12G) >> 25700352 25165824 da0p4 swp12b (12G) >> 50866176 417994752 da0p3 zfs0 (199G) >> 468860928 1160 - free - (580K) >>=20 >> There is just one pool: zroot and it is on zfs0 above. >>=20 >> # zpool list -p >> NAME SIZE ALLOC FREE CKPOINT EXPANDSZ = FRAG CAP DEDUP HEALTH ALTROOT >> zroot 213674622976 71075655680 142598967296 - - = 28 33 1.00 ONLINE - >>=20 >> So FREE: 142_598_967_296 >> (using _ to make it more readable) >>=20 >> # zfs list -p zroot=20 >> NAME USED AVAIL REFER MOUNTPOINT >> zroot 71073697792 135923593216 98304 /zroot >>=20 >> So AVAIL: 135_923_593_216 >>=20 >> FREE-AVAIL =3D=3D 6_675_374_080 >>=20 >>=20 >>=20 >> The questions: >>=20 >> Is this sort of unavailable pool-free-space normal? >> Is this some sort of expected overhead that just is >> not explicitly reported? Possibly a "FRAG" >> consequence? >=20 > =46rom zpoolprops(8): >=20 > free The amount of free space available in the pool. By contrast, > the zfs(8) available property describes how much new data can = be > written to ZFS filesystems/volumes. The zpool free property is > not generally useful for this purpose, and can be substantially > more than the zfs available space. This discrepancy is due to > several factors, including raidz parity; zfs reservation, = quota, > refreservation, and refquota properties; and space set aside by > spa_slop_shift (see zfs-module-parameters(5) for more > information). Thanks for pointing to the reference material. 6_675_374_080/213_674_622_976 =3Dapprox=3D 0.03124 =3Dapprox=3D 1.0/32.0 and spa_slop_shift's description reports: QUOTE spa_slop_shift (int) Normally, we don't allow the last 3.2% (1/(2^spa_slop_shift)) of space in the pool to be = consumed. This ensures that we don't run the pool completely = out of space, due to unaccounted changes (e.g. to the MOS). = It also limits the worst-case time to allocate space. = If we have less than this amount of free space, most ZPL operations (e.g. write, create) will return ENOSPC. Default value: 5. END QUOTE So in my simple context, apparently not much else contributes and the figures are basically as expected. Thanks again. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)