From owner-freebsd-current@freebsd.org Fri Sep 28 03:00:43 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90AC6109F3D3 for ; Fri, 28 Sep 2018 03:00:43 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2A38981EED for ; Fri, 28 Sep 2018 03:00:42 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id E0C591C2C4 for ; Fri, 28 Sep 2018 03:00:35 +0000 (UTC) Subject: Re: 12.0-ALPHA5 - ZFS default ARC max apparently forcing system to run out of memory To: freebsd-current@freebsd.org References: From: Allan Jude Openpgp: preference=signencrypt Autocrypt: addr=allanjude@freebsd.org; prefer-encrypt=mutual; keydata= xsFNBFVwZcYBEADwrZDH0xe0ZVjc9ORCc6PcBLwS/RTXA6NkvpD6ea02pZ8lPOVgteuuugFc D34LdDbiWr+479vfrKBh+Y38GL0oZ0/13j10tIlDMHSa5BU0y6ACtnhupFvVlQ57+XaJAb/q 7qkfSiuxVwQ3FY3PL3cl1RrIP5eGHLA9hu4eVbu+FOX/q/XVKz49HaeIaxzo2Q54572VzIo6 C28McX9m65UL5fXMUGJDDLCItLmehZlHsQQ+uBxvODLFpVV2lUgDR/0rDa0B9zHZX8jY8qQ7 ZdCSy7CwClXI054CkXZCaBzgxYh/CotdI8ezmaw7NLs5vWNTxaDEFXaFMQtMVhvqQBpHkfOD 7rjjOmFw00nJL4FuPE5Yut0CPyx8vLjVmNJSt/Y8WxxmhutsqJYFgYfWl/vaWkrFLur/Zcmz IklwLw35HLsCZytCN5A3rGKdRbQjD6QPXOTJu0JPrJF6t2xFkWAT7oxnSV0ELhl2g+JfMMz2 Z1PDmS3NRnyEdqEm7NoRGXJJ7bgxDbN+9SXTyOletqGNXj/bSrBvhvZ0RQrzdHAPwQUfVSU2 qBhQEi2apSZstgVNMan0GUPqCdbE2zpysg+zT7Yhvf9EUQbzPL4LpdK1llT9fZbrdMzEXvEF oSvwJFdV3sqKmZc7b+E3PuxK6GTsKqaukd/3Cj8aLHG1T1im1QARAQABzSJBbGxhbiBKdWRl IDxhbGxhbmp1ZGVAZnJlZWJzZC5vcmc+wsF/BBMBAgApBQJVcGXGAhsjBQkSzAMABwsJCAcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQGZU1PhKYC34Muw/+JOKpSfhhysWFYiRXynGRDe07 Z6pVsn7DzrPUMRNZfHu8Uujmmy3p2nx9FelIY9yjd2UKHhug+whM54MiIFs90eCRVa4XEsPR 4FFAm0DAWrrb7qhZFcE/GhHdRWpZ341WAElWf6Puj2devtRjfYbikvj5+1V1QmDbju7cEw5D mEET44pTuD2VMRJpu2yZZzkM0i+wKFuPxlhqreufA1VNkZXI/rIfkYWK+nkXd9Efw3YdCyCQ zUgTUCb88ttSqcyhik/li1CDbXBpkzDCKI6I/8fAb7jjOC9LAtrZJrdgONywcVFoyK9ZN7EN AVA+xvYCmuYhR/3zHWH1g4hAm1v1+gIsufhajhfo8/wY1SetlzPaYkSkVQLqD8T6zZyhf+AN bC7ci44UsiKGAplB3phAXrtSPUEqM86kbnHg3fSx37kWKUiYNOnx4AC2VXvEiKsOBlpyt3dw WQbOtOYM+vkfbBwDtoGOOPYAKxc4LOIt9r+J8aD+gTooi9Eo5tvphATf9WkCpl9+aaGbSixB tUpvQMRnSMqTqq4Z7DeiG6VMRQIjsXDSLJEUqcfhnLFo0Ko/RiaHd5xyAQ4DhQ9QpkyQjjNf /3f/dYG7JAtoD30txaQ5V8uHrz210/77DRRX+HJjEj6xCxWUGvQgvEZf5XXyxeePvqZ+zQyT DX61bYw6w6bOwU0EVXBlxgEQAMy7YVnCCLN4oAOBVLZ5nUbVPvpUhsdA94/0/P+uqCIh28Cz ar56OCX0X19N/nAWecxL4H32zFbIRyDB2V/MEh4p9Qvyu/j4i1r3Ex5GhOT2hnit43Ng46z5 29Es4TijrHJP4/l/rB2VOqMKBS7Cq8zk1cWqaI9XZ59imxDNjtLLPPM+zQ1yE3OAMb475QwN UgWxTMw8rkA7CEaqeIn4sqpTSD5C7kT1Bh26+rbgJDZ77D6Uv1LaCZZOaW52okW3bFbdozV8 yM2u+xz2Qs8bHz67p+s+BlygryiOyYytpkiK6Iy4N7FTolyj5EIwCuqzfk0SaRHeOKX2ZRjC qatkgoD/t13PNT38V9tw3qZVOJDS0W6WM8VSg+F+bkM9LgJ8CmKV+Hj0k3pfGfYPOZJ/v18i +SmZmL/Uw2RghnwDWGAsPCKu4uZR777iw7n9Io6Vfxndw2dcS0e9klvFYoaGS6H2F13Asygr WBzFNGFQscN4mUW+ZYBzpTOcHkdT7w8WS55BmXYLna+dYer9/HaAuUrONjujukN4SPS1fMJ2 /CS/idAUKyyVVX5vozoNK2JVC1h1zUAVsdnmhEzNPsvBoqcVNfyqBFROEVLIPwq+lQMGNVjH ekLTKRWf59MEhUC2ztjSKkGmwdg73d6xSXMuq45EgIJV2wPvOgWQonoHH/kxABEBAAHCwWUE GAECAA8FAlVwZcYCGwwFCRLMAwAACgkQGZU1PhKYC34w5A//YViBtZyDV5O+SJT9FFO3lb9x Zdxf0trA3ooCt7gdBkdnBM6T5EmjgVZ3KYYyFfwXZVkteuCCycMF/zVw5eE9FL1+zz9gg663 nY9q2F77TZTKXVWOLlOV2bY+xaK94U4ytogOGhh9b4UnQ/Ct3+6aviCF78Go608BXbmF/GVT 7uhddemk7ItxM1gE5Hscx3saxGKlayaOsdPKeGTVJCDEtHDuOc7/+jGh5Zxpk/Hpi+DUt1ot 8e6hPYLIQa4uVx4f1xxxV858PQ7QysSLr9pTV7FAQ18JclCaMc7JWIa3homZQL/MNKOfST0S 2e+msuRwQo7AnnfFKBUtb02KwpA4GhWryhkjUh/kbVc1wmGxaU3DgXYQ5GV5+Zf4kk/wqr/7 KG0dkTz6NLCVLyDlmAzuFhf66DJ3zzz4yIo3pbDYi3HB/BwJXVSKB3Ko0oUo+6/qMrOIS02L s++QE/z7K12CCcs7WwOjfCYHK7VtE0Sr/PfybBdTbuDncOuAyAIeIKxdI2nmQHzl035hhvQX s4CSghsP319jAOQiIolCeSbTMD4QWMK8RL/Pe1FI1jC3Nw9s+jq8Dudtbcj2UwAP/STUEbJ9 5rznzuuhPjE0e++EU/RpWmcaIMK/z1zZDMN+ce2v1qzgV936ZhJ3iaVzyqbEE81gDxg3P+IM kiYh4ZtPB4Q= Message-ID: <73c9d4f4-02db-1db2-419b-04167ed9216e@freebsd.org> Date: Thu, 27 Sep 2018 23:00:31 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="iaQ1FsEl9pQo3aWqwguVBQt1iw54maDBe" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Sep 2018 03:00:43 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --iaQ1FsEl9pQo3aWqwguVBQt1iw54maDBe Content-Type: multipart/mixed; boundary="CSE4p3KCS2x1crVq3GR87aHhInRw2zyaB"; protected-headers="v1" From: Allan Jude To: freebsd-current@freebsd.org Message-ID: <73c9d4f4-02db-1db2-419b-04167ed9216e@freebsd.org> Subject: Re: 12.0-ALPHA5 - ZFS default ARC max apparently forcing system to run out of memory References: In-Reply-To: --CSE4p3KCS2x1crVq3GR87aHhInRw2zyaB Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2018-09-27 18:01, Rebecca Cran wrote: > I'm running 12.0-ALPHA5 on a laptop which has 32GB RAM and 2GB swap. > I've found it running out of memory when building ports via synth: I > think I've also seen it when running a buildworld. Johannes on > FreeBSDDesktop suggested it might be related to ZFS, and setting > vfs.zfs.arc_max to 8GB *does* appear to have resolved the problem. >=20 >=20 > Shortly after running out of memory (with |"swap_pager_getswapspace(32)= : > failed" messages)|, the first few lines of 'top' were: >=20 >=20 > Mem: 4335M Active, 4854M Inact, 7751M Laundry, 9410M Wired, 48K Buf, > 5332M Free >=20 > ARC: 5235M Total, 4169M MFU, 497M MRU, 172K Anon, 97M Header, 471M Othe= r >=20 > =C2=A0=C2=A0=C2=A0=C2=A0 3479M Compressed, 5930M Uncompressed, 1.70:1 R= atio >=20 > Swap: 2048M Total, 2009M Used, 39M Free, 98% Inuse >=20 >=20 >=20 > I've not seen this happen before on ZFS systems, so is it a regression > in 12? >=20 >=20 It doesn't appear like ZFS is dominating memory usage there. Using less than the 8GB you indicated that setting the max to solved the problem... --=20 Allan Jude --CSE4p3KCS2x1crVq3GR87aHhInRw2zyaB-- --iaQ1FsEl9pQo3aWqwguVBQt1iw54maDBe Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJbrZlTAAoJEBmVNT4SmAt+6EMP/1CTPP4aS8NsMSmBSPLsCNfv wfPt2i4nkkNkdwaXIByzssZdaklS73pBAdJQv1jdSq5TnyNcp/JVhM4PWTZ37Ceq 24W70n94NCgjUHqCM0iF8GHFh3MwfNKuszo2fRDTZgkLZctXkhcy3QQmiRgxw1Ji k0hjIC6854hhm/e6BPPmK8XfojHZDbFES2Jgo4jdQCvOKHfmA3JCB1/eW7NLx+a7 O3+0+yozUHEND/8wCVUbOyEu0qt0xCh3nLkUl2TcVQxJ1PIPFE3i0K8J6xnXQ6Zi Lgrna+t1JQVWuh5z/r1oJrCs/KL8LyqxGyAYCceWuWARBwfRwOEJHKBfo//uz0PH BOZdBaEAAYx0gj514c/35cL4oVcCSPfavYRiy8Wq7kl0XAnOIolEujBnCNVpKEnN qvVgWJt0fBdoOGEHedsYjZmHkWHFc4s58sWMCpnY7i/R84DLFCkh5UqpOV7bSq3d cIDR/O1H64jERuA6GE5KzfTAg1ZYXPc6PsnABHpuX5q719/5HMNPFyBXjoCHB8ok KaoB9LwyeoDMCX2Y6qXmeM8Q4t8mi11AmzeLDdrxLNsBLZOm0PKyfxEup2L9VKQC KtNT7USpJsSeO/d68dL8WZQEug0ZDUybLFy4zirNwPuExgPjCLTxY8HcQz4gFPEK s4jWPRQIzJ7Mler8yaOm =Nj26 -----END PGP SIGNATURE----- --iaQ1FsEl9pQo3aWqwguVBQt1iw54maDBe--