Date: Tue, 20 Nov 2018 15:42:24 +0300 From: Lev Serebryakov <lev@FreeBSD.org> To: FreeBSD stable <freebsd-stable@freebsd.org>, FreeBSD FS <freebsd-fs@freebsd.org> Subject: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. Message-ID: <e2422965-0890-2d15-4716-0a31426b0a66@FreeBSD.org>
next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu
Content-Type: multipart/mixed; boundary="3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP";
protected-headers="v1"
From: Lev Serebryakov <lev@FreeBSD.org>
Reply-To: lev@FreeBSD.org
To: FreeBSD stable <freebsd-stable@freebsd.org>,
FreeBSD FS <freebsd-fs@freebsd.org>
Message-ID: <e2422965-0890-2d15-4716-0a31426b0a66@FreeBSD.org>
Subject: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC,
but it is not used for it anymore.
--3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: quoted-printable
I have server which is mostly torrent box. It uses ZFS and equipped
with 16GiB of physical memory. It is running 11-STABLE (r339914 now).
I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago.
I was used to see 13-14GiB of memory in ZFS ARC and it was Ok.
Sometimes it "locks" under heavy disk load due to ARC memory pressure,
but it was bearable, and as ZFS is main reason this server exists, I
didn't limit ARC.
But new revision (r339914) shows very strange behaivor: ARC is no more
than 4GiB, but kernel has 15GiB wired:
Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free
ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other=
2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio
It is typical numbers for last week: 15G wired, 237M Free, but only
4252M ARC!
Where is other 11G of memory?!
I've checked USED and FREE in "vmstat -z" output and got this:
$ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n |
tail -20
23001088 9171456 MAP ENTRY
29680800 8404320 VM OBJECT
34417408 10813952 256
36377964 2665656 S VFS Cache
50377392 53856 sa_cache
50593792 622985216 zio_buf_131072
68913152 976896 mbuf_cluster
73543680 7225344 mbuf_jumbo_page
92358552 67848 zfs_znode_cache
95731712 51761152 4096
126962880 159581760 dmu_buf_impl_t
150958080 233920512 mbuf_jumbo_9k
165164600 92040 VNODE
192701120 30350880 UMA Slabs
205520896 291504128 zio_data_buf_1048576
222822400 529530880 zio_data_buf_524288
259143168 293476864 zio_buf_512
352485376 377061376 zio_buf_16384
376109552 346474128 dnode_t
2943016960 5761941504 abd_chunk
$
And total USED/FREE numbers is very strange for me:
$ vmstat -z | tr : , | awk -F , '1{u+=3D$2*$4; f+=3D$2*$5} END{print u,f}=
'
5717965420 9328951088
$
So, only ~5.7G is used and 9.3G is free! But why this memory is not
used by ARC anymore and why is it wired and not free?
--=20
// Lev Serebryakov
--3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP--
--2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlv0AThfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5
NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c
R48fbg//RdXbTqLsT62Wmp+HSbl8JMu2TYAyXJ10elr7nhm8wptE+xNoczvvXq9W
2iy8tFBB8vcpdUaMf4MKlioI3c/+IK8aFw7QhoPJi+C1TQ4OaDfMZ6nuwRS4uHF1
/j8x6HYxBEpO4TCacOM7tjzcKVkXdFnsKWyhbqJ2y6iycQTAGzqc+xbAiaHId62x
wIo1s0Y4lGpLZigWGKz90Z4IytwmUQYlQeTx14PTH8v9xf6ftpERKvzptirTRsyd
MeLL67VzOEKBPOg8RVpNAr9Ti/atc7ZmmbgVfo8MsisKgn9uJEAQSrS7GGebAx19
9Ss4aNbo4EYFlsPR3tULR/pO8mnN+3pMsVqUSEbML9Mu20QTsjHhQ2AP5MWzSDGA
471WHJIPJczOh7qwyx6K0ujQMrD+t/0PDWx8G5ulX0IJxRenNfFWRqfg4gU49jB5
NjyvfOzpcqRniZ+g/M0lJpHk6ZiDXTRSqT8gULPPx+ZJitFvhJHaD6pKr1Qcwu49
TMRTtcysnLxUuV3kXBhYCllGOc0Jxg3HkWkGj7HL7v7PJABGEUyD/FyF/Qjj0Bed
7DkVkGKCb/FqcYSLP3AI8St/KJgM06t7KiTXwIZZvfEdtjVuVWIDy6yU+a6ek99h
j2hn9EhsED8y2or5dGhV/jQOdoiuQcSAe+F3Q7yunjOXm4zHDv4=
=QkSG
-----END PGP SIGNATURE-----
--2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?e2422965-0890-2d15-4716-0a31426b0a66>