From owner-freebsd-fs@freebsd.org Wed Jul 15 20:38:44 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E29479A23EA for ; Wed, 15 Jul 2015 20:38:44 +0000 (UTC) (envelope-from karl@denninger.net) Received: from fs.denninger.net (wsip-70-169-168-7.pn.at.cox.net [70.169.168.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "NewFS.denninger.net", Issuer "NewFS.denninger.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A6B4B1B2B for ; Wed, 15 Jul 2015 20:38:43 +0000 (UTC) (envelope-from karl@denninger.net) Received: from [192.168.1.40] (localhost [127.0.0.1]) by fs.denninger.net (8.14.9/8.14.8) with ESMTP id t6FKcZfd016568 for ; Wed, 15 Jul 2015 15:38:35 -0500 (CDT) (envelope-from karl@denninger.net) Received: from [192.168.1.40] [192.168.1.40] (Via SSLv3 AES128-SHA) ; by Spamblock-sys (LOCAL/AUTH) Wed Jul 15 15:38:35 2015 Message-ID: <55A6C4BD.5090500@denninger.net> Date: Wed, 15 Jul 2015 15:38:21 -0500 From: Karl Denninger User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Re: FreeBSD 10.1 Memory Exhaustion References: <55A3A800.5060904@denninger.net> <55A4D5B7.2030603@freebsd.org> <55A4E5AB.8060909@netlabs.org> <1436989410.1427298.324703241.421E814B@webmail.messagingengine.com> <55A6C0A4.1030300@digiware.nl> In-Reply-To: <55A6C0A4.1030300@digiware.nl> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha1; boundary="------------ms090206030707000801090107" X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Jul 2015 20:38:45 -0000 This is a cryptographically signed message in MIME format. --------------ms090206030707000801090107 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 7/15/2015 15:20, Willem Jan Withagen wrote: > On 15/07/2015 21:43, Mark Felder wrote: >> >> On Tue, Jul 14, 2015, at 10:10, Sean Chittenden wrote: >>> I think the reason this is not seen more often is because people >>> frequently >>> throw limits on the arc in /boot/loader.conf: >>> >>> vfs.zfs.arc_min=3D"18G" >>> vfs.zfs.arc_max=3D"149G" >>> >>> ZFS ARC *should* not require those settings, but does currently for m= ixed >>> workloads (i.e. databases) in order to be "stable". By setting fixed= >>> sizes >>> on the ARC, UMA and ARC are much more cooperative in that they have t= heir >>> own memory regions to manage so this behavior is not seen as often. >>> >>> To be clear, however, it should not be necessary to set parameters li= ke >>> these in /boot/loader.conf in order to obtain consistent operational >>> behavior. I'd be curious to know if someone running 10.2 BETA withou= t >>> patches is able to trigger this behavior or not. There was work done= >>> that >>> reported helped with this between 10.1 and now. To what extent it >>> helped, >>> however, I don't have any advice yet. >>> >> I was about to email "I have 12TB at home and 4GB of RAM with a very >> erratic workload and never run into any issues" and then I looked at >> /boot/loader.conf and saw vfs.zfs.arc_max=3D"2G" >> >> Now I'm too scared to turn it off... :-) > Same here. > Just a leftover of all the advise to limit arc in the past. > Just bit the bullit: installed BETA1, killed the settings and rebooted.= > We'll see what comes of it. > > --WjW If you get bit I have refactored the patch for 10.2-BETA1 to get rid of the fudges and i386 linker problem and uploaded it, so if you run into trouble try applying that and see if that fixes it. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D187594 --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms090206030707000801090107 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGXzCC BlswggRDoAMCAQICASkwDQYJKoZIhvcNAQELBQAwgZAxCzAJBgNVBAYTAlVTMRAwDgYDVQQI EwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG9w0BCQEWE0N1ZGEg U3lzdGVtcyBMTEMgQ0EwHhcNMTUwNDIxMDIyMTU5WhcNMjAwNDE5MDIyMTU5WjBaMQswCQYD VQQGEwJVUzEQMA4GA1UECBMHRmxvcmlkYTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1zIExMQzEe MBwGA1UEAxMVS2FybCBEZW5uaW5nZXIgKE9DU1ApMIICIjANBgkqhkiG9w0BAQEFAAOCAg8A MIICCgKCAgEAuYRY+EB2mGtZ3grlVO8TmnEvduVFA/IYXcCmNSOC1q+pTVjylsjcHKBcOPb9 TP1KLxdWP+Q1soSORGHlKw2/HcVzShDW5WPIKrvML+Ry0XvIvNBu9adTiCsA9nci4Cnf98XE hVpenER0qbJkBUOGT1rP4iAcfjet0lEgzPEnm+pAxv6fYSNp1WqIY9u0b1pkQiaWrt8hgNOc rJOiLbc8CeQ/DBP6rUiQjYNO9/aPNauEtHkNNfR9RgLSfGUdZuOCmJqnIla1HsrZhA5p69Bv /e832BKiNPaH5wF6btAiPpTr2sRhwQO8/IIxcRX1Vxd1yZbjYtJGw+9lwEcWRYAmoxkzKLPi S6Zo/6z5wgNpeK1H+zOioMoZIczgI8BlX1iHxqy/FAvm4PHPnC8s+BLnJLwr+jvMNHm82QwL J9hC5Ho8AnFU6TkCuq+P2V8/clJVqnBuvTUKhYMGSm4mUp+lAgR4L+lwIEqSeWVsxirIcE7Z OKkvI7k5x3WeE3+c6w74L6PfWVAd84xFlo9DKRdU9YbkFuFZPu21fi/LmE5brImB5P+jdqnK eWnVwRq+RBFLy4kehCzMXooitAwgP8l/JJa9VDiSyd/PAHaVGiat2vCdDh4b8cFL7SV6jPA4 k0MgGUA/6Et7wDmhZmCigggr9K6VQCx8jpKB3x1NlNNiaWECAwEAAaOB9DCB8TA3BggrBgEF BQcBAQQrMCkwJwYIKwYBBQUHMAGGG2h0dHA6Ly9jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDALBgNVHQ8EBAMCBeAwLAYJYIZIAYb4QgENBB8W HU9wZW5TU0wgR2VuZXJhdGVkIENlcnRpZmljYXRlMB0GA1UdDgQWBBTFHJQt6cloXBdG1Pv1 o2YgH+7lWTAfBgNVHSMEGDAWgBQkcZudhX383d29sMqSlAOh+tNtNTAdBgNVHREEFjAUgRJr YXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAE9/dxi2YqjCYYhiybp4GKcm 7tBVa/GLW+qcHPcoT4dqmqghlLz8+iUH+HCJjRQATVGyMEnvISOKFVHC6aZIG+Sg7J8bfS4+ fjKDi9smRH2VPPx3bV8+yFYRNroMGHaPHZB/Xctmmvc+PZ9O2W7rExgrODtxIOB3Zs6wkYf+ ty+9r1KmTHlV+rRHI6timH1uiyFE3cPi1taAEBxf0851cJV8k40PGF8G48ewnq8SY9sCf5cv liXbpdgU+I4ND5BuTjg63WS32zuhLd1VSuH3ZC/QbcncMX5W3oLXmcQP5/5uTiBJy74kdPtG MSZ9rXwZPwNxP/8PXMSR7ViaFvjUkf4bJlyENFa2PGxLk4EUzOuO7t3brjMlQW1fuInfG+ko 3tVxko20Hp0tKGPe/9cOxBVBZeZH/VgpZn3cLculGzZjmdh2fqAQ6kv9Z9AVOG1+dq0c1zt8 2zm+Oi1pikGXkfz5UJq60psY6zbX25BuEZkthO/qiS4pxjxb7gQkS0rTEHTy+qv0l3QVL0wa NAT74Zaj7l5DEW3qdQQ0dtVieyvptg9CxkfQJE3JyBMb0zBj9Qhc5/hbTfhSlHzZMEbUuIyx h9vxqFAmGzfB1/WfOKkiNHChkpPW8ZeH9yPeDBKvrgZ96dREHFoVkDk7Vpw5lSM+tFOfdyLg xxhb/RZVUDeUMYIE4zCCBN8CAQEwgZYwgZAxCzAJBgNVBAYTAlVTMRAwDgYDVQQIEwdGbG9y aWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBMTEMxHDAa BgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG9w0BCQEWE0N1ZGEgU3lzdGVt cyBMTEMgQ0ECASkwCQYFKw4DAhoFAKCCAiEwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAc BgkqhkiG9w0BCQUxDxcNMTUwNzE1MjAzODIxWjAjBgkqhkiG9w0BCQQxFgQUTWU8hGAivyHM Vnw22QEhQJwA5hMwbAYJKoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJYIZIAWUDBAEC MAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzAN BggqhkiG9w0DAgIBKDCBpwYJKwYBBAGCNxAEMYGZMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBAgEpMIGpBgsqhkiG9w0BCRACCzGBmaCBljCBkDELMAkGA1UE BhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQ Q3VkYSBTeXN0ZW1zIExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqG SIb3DQEJARYTQ3VkYSBTeXN0ZW1zIExMQyBDQQIBKTANBgkqhkiG9w0BAQEFAASCAgAl+pFu /06vAB31ivchq8G4UzUkbFUWqtcKuYdm4CZeV5n5nFgjB3roI0WYqAKxq5HuvmqN5UpOmOJt Ve//qUt83aEDIMf5Y1RqKtJd+aty3omx7czllLn/eMU2J2QXjj0QptefcudTVb4Uop/BKqQq nY8Xd8bK91fn+58FKlHx/oekojosUkAmWPt8bZIo47aktuGTx0EvKup9g0nzZTZPl2PrE5AH dx8whKC3Ttir/VjTI9A65yBqa3jDyQwZPGEe6Mo2gyeMxX3I3ZgcG+RTHRYA0IgsZ7VASNV/ 1qBgPcVbvfybERiWWmNurYN9P7+W+pJeIV3MVr9jZm/2QiHAfWIX17Nd2fx4a3zEmMPO4TMp Uyb5f0h0C7dkyD4NWCWM0lVxrQAWuGxoVnmYEKpBI95W89GydgFQ5kA28Zz13Qi+22D0qg3e 08a6fll1xvJ8vFm6k7jYu4qbAxYG9sZEU5LWb8Eo9Mpd/xZwc6jzXJvikd+TcpElJMqMqq5x HgW23vDD1lMEC/NjzALmKyvM9OE6kTF0lXl3fySfCZwS71Ed5HdCTUyRD8GchzhidhN0ir0t KJoEdWbz2N91cCXzjQ0vf7A9DZI52RurxPBmOaJhfG6TEBx3ntd3SzaGjVUleK3KQhC9rCbB i26J48FS9W1vizsLmqVXOwc/XBEQbwAAAAAAAA== --------------ms090206030707000801090107--