From owner-freebsd-fs@freebsd.org Tue Nov 20 19:30:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 517AD113B2BA; Tue, 20 Nov 2018 19:30:40 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D99097E42E; Tue, 20 Nov 2018 19:30:33 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [192.168.243.12] ([192.168.243.12]) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTP id wAKJUTL6064413; Wed, 21 Nov 2018 00:30:30 +0500 (+05) (envelope-from emz@norma.perm.ru) Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: freebsd-fs@freebsd.org References: From: "Eugene M. Zheganin" Cc: freebsd-stable@freebsd.org Message-ID: <29d0ab29-c967-ba5e-785e-5cb1ae670c8e@norma.perm.ru> Date: Tue, 20 Nov 2018 22:30:27 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: ru X-Rspamd-Queue-Id: D99097E42E X-Spamd-Result: default: False [-0.46 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.12)[-0.124,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[perm.ru]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[mail-backup.norma.perm.ru,mail.norma.perm.ru]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.19)[0.186,0]; NEURAL_HAM_SHORT(-0.21)[-0.212,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 19:30:40 -0000 Hello, 20.11.2018 15:42, Lev Serebryakov пишет: > I have server which is mostly torrent box. It uses ZFS and equipped > with 16GiB of physical memory. It is running 11-STABLE (r339914 now). > > I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago. > > I was used to see 13-14GiB of memory in ZFS ARC and it was Ok. > Sometimes it "locks" under heavy disk load due to ARC memory pressure, > but it was bearable, and as ZFS is main reason this server exists, I > didn't limit ARC. > > But new revision (r339914) shows very strange behaivor: ARC is no more > than 4GiB, but kernel has 15GiB wired: > > Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free > ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other > 2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio > > It is typical numbers for last week: 15G wired, 237M Free, but only > 4252M ARC! > > Where is other 11G of memory?! > > [...] > And total USED/FREE numbers is very strange for me: > > $ vmstat -z | tr : , | awk -F , '1{u+=$2*$4; f+=$2*$5} END{print u,f}' > 5717965420 9328951088 > $ > > So, only ~5.7G is used and 9.3G is free! But why this memory is not > used by ARC anymore and why is it wired and not free? I'm getting pretty much same story on recent 11-STABLE from 9th November. Previous versions didn't have that much questions about memory usage (and I run several 11-STABLEs). Eugene.