From owner-freebsd-fs@freebsd.org Tue Mar 12 22:47:31 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 655B7154102B for ; Tue, 12 Mar 2019 22:47:31 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from ipmail01.adl2.internode.on.net (ipmail01.adl2.internode.on.net [150.101.137.133]) by mx1.freebsd.org (Postfix) with ESMTP id A7DC289BEC for ; Tue, 12 Mar 2019 22:47:28 +0000 (UTC) (envelope-from FreeBSD@shaneware.biz) Received: from ppp118-210-25-169.adl-adc-lon-bras31.tpg.internode.on.net (HELO leader.local) ([118.210.25.169]) by ipmail01.adl2.internode.on.net with ESMTP; 13 Mar 2019 09:17:19 +1030 Subject: Re: ZFS memory use (arc limit) To: freebsd-fs@freebsd.org, matt.churchyard@userve.net References: <29f05a02-7218-e142-7ecd-baf344b2e594@osfux.nl> From: Shane Ambler Message-ID: Date: Wed, 13 Mar 2019 09:17:18 +1030 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.2 MIME-Version: 1.0 In-Reply-To: <29f05a02-7218-e142-7ecd-baf344b2e594@osfux.nl> Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: A7DC289BEC X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [4.06 / 15.00]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RECEIVED_SPAMHAUS_PBL(0.00)[169.25.210.118.zen.spamhaus.org : 127.0.0.11]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.96)[0.959,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[ShaneWare.Biz]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.98)[0.983,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mx.superb.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.99)[0.991,0]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[133.137.101.150.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4739, ipnet:150.101.0.0/16, country:AU]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.24)[ipnet: 150.101.0.0/16(0.93), asn: 4739(0.32), country: AU(-0.04)]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Mar 2019 22:47:31 -0000 On 28/2/19 7:27 pm, Ruben wrote: > Hi, > > On 2/27/19 11:29 PM, Miroslav Lachman wrote: > > Stuff snipped > >> I have the very same experience as you. On ZFS on FreeBSD from the >> beginning, installed new machine 11.2 amd64 and try not to limit the >> ARC max. Just running rsync over the remote server to replicate data >> to new machine causes many processes to get killed. Even ssh was killed! >> >> https://lists.freebsd.org/pipermail/freebsd-fs/2019-February/027280.html >> > > More stuff snipped. > > It might be worth checking out this report: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=231457 > > Perhaps your experiences have been induced by the OOM killer. This is my related report - https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=229764 While max_wired is 30% ram, arc_max should not be more than 70% of ram. ARC memory is wired, there is also another pool of wired memory and the two values do not appear to be combined in any checking, which allows more than all physical ram to be wired. Wired ram cannot be swapped, when all physical ram is wired we get out of swap errors when there is swap space available. -- FreeBSD - the place to B...Storing Data Shane Ambler