From owner-freebsd-fs@freebsd.org Thu Nov 22 13:33:34 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 451781148E72; Thu, 22 Nov 2018 13:33:34 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 768FF76FD4; Thu, 22 Nov 2018 13:33:33 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 039851D06; Thu, 22 Nov 2018 16:33:31 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: Mark Johnston Cc: FreeBSD FS , FreeBSD stable References: <20181120204537.GB2630@raichu> From: Lev Serebryakov Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABzShMZXYgU2VyZWJy eWFrb3YgPGxldkBzZXJlYnJ5YWtvdi5zcGIucnU+wsGCBBMBCAAsAhsDBwsJCAcDAgEGFQgC CQoLBBYCAwECHgECF4ACGQEFAlKbP8wFCQlmJwEACgkQ6rA8WL/cR4/6VBAAjRMyyX3PBFx/ HxyiIZ698EfwlWUua8Ft4crtrdK52m0qNkbBB9BH8xQgBHG32A1CwyzQnzxHgZuoOWMjh+Qq WJv7dmpM/q/c1GCJHhlPgewXrciTwpAamZILN071u+1GCPWwGRPzfQ/U+k63KJWx9ozf4doM WTTom6Cqcssi4J1u5kkt52a5ZRhsCK9pEVGilk36XTP9BakGrnMSIxF/NK4xeZVX2q+Nuqvf RchyofKXVgLEDLwb1cd/baLtBpDzy0PTN2Zl2lX4kOA6jwTKsqRya9A1Vui1KXwPh2XViTQ1 7Y3l5qg/M+sR73DohezP6bO6huOnLhty17jAqHPNlD6RonDo+j8uIlEg4iMSTN3MhzkBAu0Q pe3ucQ0o1767JiXN3fsNvRzSFhLVNDqPLce4uKlMogsbreXWvdgHGTN1ybOHGbybZnP77yHz uNBacbmG3vL/OLXMqwLdL2JXoiec4DmXjjCdhTBl5xLV9Hz/6VWKqElteg8QFVvHB3tHWzJ4 /rpiVEixytCIII6DS33BXZ0h2EOkK/6AYA2SJxy1vgOH4SZBtDBHoezmHV2nFnq5O0c7AuAB 7WPWgQG0sEwHQPZmg/baRGitRJnaxf/Gvf1DeD1x1VrcoVke2vwBcgDM3kugP8L9hsqic2D3 dI+gP76haeuvNNZr3y9L9zvOwU0EUpsaSwEQALRr3B+OjY/cnJPstz5CVsVWyEZtJtrNviZr tBgbkhlkPm98sEWR4+gbpyeufdYJengDjeGzMDKcLB7h5fICS/j6A8XdlJ40TlbPfNgb6OHa ebaIYKTJpXKR9sD7ZyGivYMofm0em40wGUX7BIkdkomaWj+wUiS0CdXU0FWDj9wv73+Eim+X zZyXeFgIPv97v+pET7DfwKkADOfrkW9s4OfvGVjd+wm35wc8EngQEz0qdPBxx74X7vZFAxlA SXu8gDBJGYt2Bkc3QwULnfeXrZJWgqNPR5o44gGu96yaiOFaN/C6CJtev5ZEX+0ZxbvsHHB7 Z5AtsRURKpZ4w5HFHGhzHtDtoAKgeZ/gbhTVXPHvNQR818eN+Nl5BV8BRF/8yhR6VlJb8GYw h8oKDeVGVYC34+raHZQAM9WoBnN7jlt4T9zzPwtmw5mIahGFgvw1KDr7OItN2ZgtZ20UYC5m Go602nmHq0aPbU6SwGi1xohrliNsKaaciYiMaVIGRQq8iGr9Fe2HlvaA3BpB275i/gCVlUdG y5XLAv+yQMUvn5Z7XVsMroxDk/O+ae1ElyBvKiKyfWGJXTg5XUukkkyQmfWPxWUGoNA1P/P4 GMHSu7/Rqe/7m4uPu/RyTTqsSjjKJdP9kBwEzvqPtXsVoZuShtrptRQJDYflhgE4qmKSMKen ABEBAAHCwWUEGAECAA8FAlKbGksCGwwFCRLMAwAACgkQ6rA8WL/cR48RkA//SNzeW3CI8KHx rA0aeHW6Nb5ieoqVRBGLyjBM06RX6vHB9v4dJL6Z+yV2jGN2s+XZX2HILbuTOwcTxGkI3xTT e0cDXVaF5K8R/liigUjtwuC2v/sWgoWyUmK1Cy9CPYdcXmFq6nESfkUe8DYiGOUULdHq5w63 F53yOZ72iXRBQBZgkhPtRFu4lPYIzOsMag9DIJ9CthR1r0ziqU/keb94Qt3l+aXK7CwGdY7X T4zUIMHNYsuAuyX+NJIXfsN68TT6m7QmlUwxPs13nxmoVQzm4ruV+hlQKh1MtbsjWRkNgPxF IPiqoAEhy8QoddlSvRTwL5Z7zFQiwMdiXU7toL8pfzj/zJR1jELXKMipijrt5MLrV8XX3OPN yZZvh95VIl8mv+iAqwSZUufd2EJnvj5TObB0eH+a+34NWf/XqA3fPjE6KHzmdnw9PZjPEjlx JCPECSs+6gse1+GaEfKYuXzB/ENe2ctlcfx5iQJXFc+/+zG/uU/JX/pXJHA12CUfB5g7lH6X BZIHvRo3VTCDjXgbF5xxDAe5V4exf8d4oSNjQIFLYxxN7zkvH89EN6RPfRgsWN7bYArCwfS9 MOgs9pFeCOewR6qieK150aoqNENGfKFXJup+5VVl6I0mU+j0rgVDZDht2/QgP/Tb4lGBe+ai pOGaK/GYNR+Ad6bUmokKsx4= Organization: FreeBSD Message-ID: <6c41605a-81b4-c436-6114-98f1c802fbd3@FreeBSD.org> Date: Thu, 22 Nov 2018 16:33:26 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <20181120204537.GB2630@raichu> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO" X-Rspamd-Queue-Id: 768FF76FD4 X-Spamd-Result: default: False [1.48 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_LONG(0.48)[0.482,0]; NEURAL_SPAM_SHORT(0.34)[0.338,0]; NEURAL_SPAM_MEDIUM(0.66)[0.664,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 13:33:34 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO Content-Type: multipart/mixed; boundary="sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: Mark Johnston Cc: FreeBSD FS , FreeBSD stable Message-ID: <6c41605a-81b4-c436-6114-98f1c802fbd3@FreeBSD.org> Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. References: <20181120204537.GB2630@raichu> In-Reply-To: <20181120204537.GB2630@raichu> --sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 20.11.2018 23:45, Mark Johnston wrote: >> Where is other 11G of memory?! >> >> I've checked USED and FREE in "vmstat -z" output and got this: >> >> $ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n | >> tail -20 >> 23001088 9171456 MAP ENTRY >> 29680800 8404320 VM OBJECT >> 34417408 10813952 256 >> 36377964 2665656 S VFS Cache >> 50377392 53856 sa_cache >> 50593792 622985216 zio_buf_131072 >> 68913152 976896 mbuf_cluster >> 73543680 7225344 mbuf_jumbo_page >> 92358552 67848 zfs_znode_cache >> 95731712 51761152 4096 >> 126962880 159581760 dmu_buf_impl_t >> 150958080 233920512 mbuf_jumbo_9k >> 165164600 92040 VNODE >> 192701120 30350880 UMA Slabs >> 205520896 291504128 zio_data_buf_1048576 >> 222822400 529530880 zio_data_buf_524288 >> 259143168 293476864 zio_buf_512 >> 352485376 377061376 zio_buf_16384 >> 376109552 346474128 dnode_t >> 2943016960 5761941504 abd_chunk >> $ >> >> And total USED/FREE numbers is very strange for me: >> >> $ vmstat -z | tr : , | awk -F , '1{u+=3D$2*$4; f+=3D$2*$5} END{print u= ,f}' >> 5717965420 9328951088 >> $ One more datapoint: I needed to reboot system and right after reboot= ARC becomes 14GiB (what was expected) and now it slows defalate, though I didn't get more "Free" memory. So, ARC becomes smaller and smaller after first fill-up, but all memory is "Wired". --=20 // Lev Serebryakov --sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb-- --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlv2sCZfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R49uzQ/+OaCSQrUCF1+3crHJJqygHkvy3vdAplEpZJG3QfXOniLnX/9n3J95gGGm CXS1n2zTLy+KzEXTR3slNRqZsuK6rXYHfN6+7J4N2xmsMaYrEDudieAc10uhu2/8 fsjw19I5fPCEzVhu3cL6td2yvY/KndRCrUrCp1llTZ8WSumWty2oxG+e4YBsWLKb GWNP4sTb7ut4PthPm5ZGRnuFBIOjp7dGfSPp6BrN8+k0OVtLJqHt3F88ZHcaQ8nz s7KR0F7UzKcF2bI39NCfOW6zH8dOcUQzTt+oJ6C3G8YCgHKxZt77rclfZzfpQQLp arOGbHAcWq85+7kgyeBNKLUUO2PFnSXKTsO2rwH3ibUbCjmFZF0Cv5DlrUW/BLCd MZgohUewgPYU9j5TCx7XsCS1DwRPY9dDIUpavBgZRXfMDYq7KEsVlFpZT6c7bt/C NR6M1LIRCcq81XnlM2ur3fUlAOh2SUgHAWXwwgR7iI/tN+ZHJL3SXVpGYgTiZzpB JBnYkKaXbktK617HwmZKV2/OXDX4bwIHqhjMcxM/oWpdHRxDwKYuMEuZnwxVAxqX OVk3mhdOeTFVEvMYn/S2mr5S+m8jLwilh2qFDbtHsnMPAoETM6q73jIiVDfpkPzb T9AEiUrc7CKnXT3oXJEFLZZdhmdfePArn69X6IRPSpcHZ2LdHG4= =C1fk -----END PGP SIGNATURE----- --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO--