From owner-freebsd-fs@freebsd.org Tue Jan 10 18:01:58 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E98ECCAA69B for ; Tue, 10 Jan 2017 18:01:58 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 7DC0A1A6D; Tue, 10 Jan 2017 18:01:58 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.17.133] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPSA id 42370B64; Tue, 10 Jan 2017 21:01:56 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: ARC consume more than 3 times of physical memory (Was: ZFS L2ARC checksum errors after compression). References: <921575537.20161029143626@serebryakov.spb.ru> <3dae7691-fcd1-b3b9-445c-b81d6f0cdc52@FreeBSD.org> <3bd7cb79-ec5a-3b7c-0642-24a7b1f001e6@FreeBSD.org> <5826F293.7020408@FreeBSD.org> <5695c647-9250-703d-35d8-8b125dbcd61b@FreeBSD.org> <1551133578.20170107152925@serebryakov.spb.ru> To: Andriy Gapon , freebsd-fs From: Lev Serebryakov Organization: FreeBSD Message-ID: <76121882-03ef-9d1c-96df-223866caa966@FreeBSD.org> Date: Tue, 10 Jan 2017 21:01:47 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <1551133578.20170107152925@serebryakov.spb.ru> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jan 2017 18:01:59 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf Content-Type: multipart/mixed; boundary="KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: Andriy Gapon , freebsd-fs Message-ID: <76121882-03ef-9d1c-96df-223866caa966@FreeBSD.org> Subject: ARC consume more than 3 times of physical memory (Was: ZFS L2ARC checksum errors after compression). References: <921575537.20161029143626@serebryakov.spb.ru> <3dae7691-fcd1-b3b9-445c-b81d6f0cdc52@FreeBSD.org> <3bd7cb79-ec5a-3b7c-0642-24a7b1f001e6@FreeBSD.org> <5826F293.7020408@FreeBSD.org> <5695c647-9250-703d-35d8-8b125dbcd61b@FreeBSD.org> <1551133578.20170107152925@serebryakov.spb.ru> In-Reply-To: <1551133578.20170107152925@serebryakov.spb.ru> --KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 07.01.2017 15:29, Lev Serebryakov wrote: >>>> because of the confusing variable names I made a mistake in the patc= h that I >>>> offered you. Could you please try a new slight different patch? >>>> Also, I think that there could be another problem in addition to the= one that I >>>> see. But I am quite busy at the moment, no time to investigate. Ma= ybe on the >>>> weekend or some time next week. >>> >>> Nope. Second version of patch doesn't help either. Still unrealistic= >>> high compression ratio (ALLOC/SIZE, slightly less than 2 on mostly >>> uncompresseable data), 16.0E of FREE since ALLOC becomes greater than= >>> SIZE and lot of checksum errors since the same moment. >=20 >> I see. >> Could you please send me full output of the following commands? >> zpool status -v >> zpool list -v >> zdb -CC $pool > Any news on this issue? Should I file formal PR? I've got this: output from zfs-stats: ARC Size: 274.09% 39.83 GiB Target Size: (Adaptive) 100.00% 14.53 GiB Min Size (Hard Limit): 12.50% 1.82 GiB Max Size (High Water): 8:1 14.53 GiB "screenshot" of top: Mem: 103M Active, 875M Inact, 13G Wired, 12M Cache, 1448M Free ARC: 40G Total, 141M MFU, 10G MRU, 1568K Anon, 65M Header, 249M Other Swap: 8192M Total, 8192M Free This box has only 16G of physical memory. --=20 // Lev Serebryakov --KmENO3QJ9uH8aDD6TURioRjgENrb7BKI0-- --nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQJ8BAEBCgBmBQJYdSGSXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePGQAP/RFGOO5it8JOV7pF1bPsjety loaeecQCG+ImVC7pAgdgW6Wo1sMNOqvDYaQH6WEcogJxbK9LpUJrA2VjjVU4nZ8R JwdY6mTcEpBR/V4ZUVoPheE0yk+uPiL0tMOqyK4WJw4yp752LS0n6eA0f3NoYaZg CsBeJjUlBZX0HQOoM8sMSmOqZ5IMCPSRHSxqQ4RbznaDw2VzjtLnKf00tls1kphl HMyMopCMSW7lMvWHCVYUK2elzDkCYaycRIOVXBziwRLjwOPPAoXkL2AozKAYsjxO jWhihY7i7GPKWxb3heQbBjd8H486r46uhpEIi+Uy+NBJDPl49RQNsPZRsmTJsiMF R2t0nW23g/3CPZq0OoRmh0BXgiiMjHucXwXohyLp3wC2sgGMMDhU8IiqM1COX8y0 0EGtCR6ETaqnhj+X7djv7CWsSfE3ZlFMbX5+Gbg9Z9m8vJlUuGIfH1UmwfVcjxqs EXA8kyrD6feyqyjcW5pMDfTBNvv8IF6zBTUZmhQz9qqL11pTX79FEtNAfoYnNMUZ zIrY/Lsd1+wty9yihJW+77j2lUmBYaIVH7cpAhY9MNYKTrY96o+5HoEEUGZY0MZn jpQ8X6tlG57dStNXOl7GOphh+ZJPDG06AsoZ0DBdEC7E3bw/L6yGJWzTb75rzTwz YFPpZJc8cOHXWFUYe+YX =icwt -----END PGP SIGNATURE----- --nGc4uHIFvwV2aG9r2qniqH2FVRhAAqtuf--