Date: Tue, 10 Jan 2017 21:01:47 +0300 From: Lev Serebryakov <lev@FreeBSD.org> To: Andriy Gapon <avg@FreeBSD.org>, freebsd-fs <freebsd-fs@FreeBSD.org> Subject: ARC consume more than 3 times of physical memory (Was: ZFS L2ARC checksum errors after compression). Message-ID: <76121882-03ef-9d1c-96df-223866caa966@FreeBSD.org> In-Reply-To: <1551133578.20170107152925@serebryakov.spb.ru> References: <921575537.20161029143626@serebryakov.spb.ru> <3dae7691-fcd1-b3b9-445c-b81d6f0cdc52@FreeBSD.org> <fe4962d6-75c3-32c0-8d28-c99661e5161f@FreeBSD.org> <3bd7cb79-ec5a-3b7c-0642-24a7b1f001e6@FreeBSD.org> <5826F293.7020408@FreeBSD.org> <5695c647-9250-703d-35d8-8b125dbcd61b@FreeBSD.org> <1551133578.20170107152925@serebryakov.spb.ru>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf
Content-Type: multipart/mixed; boundary="KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0";
protected-headers="v1"
From: Lev Serebryakov <lev@FreeBSD.org>
Reply-To: lev@FreeBSD.org
To: Andriy Gapon <avg@FreeBSD.org>, freebsd-fs <freebsd-fs@FreeBSD.org>
Message-ID: <76121882-03ef-9d1c-96df-223866caa966@FreeBSD.org>
Subject: ARC consume more than 3 times of physical memory (Was: ZFS L2ARC
checksum errors after compression).
References: <921575537.20161029143626@serebryakov.spb.ru>
<3dae7691-fcd1-b3b9-445c-b81d6f0cdc52@FreeBSD.org>
<fe4962d6-75c3-32c0-8d28-c99661e5161f@FreeBSD.org>
<3bd7cb79-ec5a-3b7c-0642-24a7b1f001e6@FreeBSD.org>
<5826F293.7020408@FreeBSD.org>
<5695c647-9250-703d-35d8-8b125dbcd61b@FreeBSD.org>
<1551133578.20170107152925@serebryakov.spb.ru>
In-Reply-To: <1551133578.20170107152925@serebryakov.spb.ru>
--KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
On 07.01.2017 15:29, Lev Serebryakov wrote:
>>>> because of the confusing variable names I made a mistake in the patc=
h that I
>>>> offered you. Could you please try a new slight different patch?
>>>> Also, I think that there could be another problem in addition to the=
one that I
>>>> see. But I am quite busy at the moment, no time to investigate. Ma=
ybe on the
>>>> weekend or some time next week.
>>>
>>> Nope. Second version of patch doesn't help either. Still unrealistic=
>>> high compression ratio (ALLOC/SIZE, slightly less than 2 on mostly
>>> uncompresseable data), 16.0E of FREE since ALLOC becomes greater than=
>>> SIZE and lot of checksum errors since the same moment.
>=20
>> I see.
>> Could you please send me full output of the following commands?
>> zpool status -v
>> zpool list -v
>> zdb -CC $pool
> Any news on this issue? Should I file formal PR?
I've got this:
output from zfs-stats:
ARC Size: 274.09% 39.83 GiB
Target Size: (Adaptive) 100.00% 14.53 GiB
Min Size (Hard Limit): 12.50% 1.82 GiB
Max Size (High Water): 8:1 14.53 GiB
"screenshot" of top:
Mem: 103M Active, 875M Inact, 13G Wired, 12M Cache, 1448M Free
ARC: 40G Total, 141M MFU, 10G MRU, 1568K Anon, 65M Header, 249M Other
Swap: 8192M Total, 8192M Free
This box has only 16G of physical memory.
--=20
// Lev Serebryakov
--KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0--
--nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQJ8BAEBCgBmBQJYdSGSXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePGQAP/RFGOO5it8JOV7pF1bPsjety
loaeecQCG+ImVC7pAgdgW6Wo1sMNOqvDYaQH6WEcogJxbK9LpUJrA2VjjVU4nZ8R
JwdY6mTcEpBR/V4ZUVoPheE0yk+uPiL0tMOqyK4WJw4yp752LS0n6eA0f3NoYaZg
CsBeJjUlBZX0HQOoM8sMSmOqZ5IMCPSRHSxqQ4RbznaDw2VzjtLnKf00tls1kphl
HMyMopCMSW7lMvWHCVYUK2elzDkCYaycRIOVXBziwRLjwOPPAoXkL2AozKAYsjxO
jWhihY7i7GPKWxb3heQbBjd8H486r46uhpEIi+Uy+NBJDPl49RQNsPZRsmTJsiMF
R2t0nW23g/3CPZq0OoRmh0BXgiiMjHucXwXohyLp3wC2sgGMMDhU8IiqM1COX8y0
0EGtCR6ETaqnhj+X7djv7CWsSfE3ZlFMbX5+Gbg9Z9m8vJlUuGIfH1UmwfVcjxqs
EXA8kyrD6feyqyjcW5pMDfTBNvv8IF6zBTUZmhQz9qqL11pTX79FEtNAfoYnNMUZ
zIrY/Lsd1+wty9yihJW+77j2lUmBYaIVH7cpAhY9MNYKTrY96o+5HoEEUGZY0MZn
jpQ8X6tlG57dStNXOl7GOphh+ZJPDG06AsoZ0DBdEC7E3bw/L6yGJWzTb75rzTwz
YFPpZJc8cOHXWFUYe+YX
=icwt
-----END PGP SIGNATURE-----
--nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?76121882-03ef-9d1c-96df-223866caa966>