From owner-freebsd-fs@freebsd.org Wed Nov 21 14:03:28 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 904501139E61; Wed, 21 Nov 2018 14:03:28 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 1A498816CA; Wed, 21 Nov 2018 14:03:28 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:310b:1d84:68df:8590]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 5E7D21A8C; Wed, 21 Nov 2018 17:03:26 +0300 (MSK) Date: Wed, 21 Nov 2018 17:03:25 +0300 From: Lev Serebryakov Reply-To: Lev Serebryakov Organization: FreeBSD Message-ID: <228548325.20181121170325@serebryakov.spb.ru> To: Eugene Grosbein , Mark Johnston CC: FreeBSD FS , FreeBSD stable Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. In-Reply-To: References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> <123493949.20181121143445@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1A498816CA X-Spamd-Result: default: False [0.43 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE]; NEURAL_SPAM_SHORT(0.23)[0.231,0]; NEURAL_HAM_LONG(-0.23)[-0.233,0]; NEURAL_SPAM_MEDIUM(0.43)[0.433,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 14:03:28 -0000 Hello Eugene, Wednesday, November 21, 2018, 4:23:29 PM, you wrote: >> And here top consumers. I don't like that most of te memory is in FREE >> abd_chunks - 8GB! >> >> USED (b) FREE (b) NAME >> 531902464 8392536064 abd_chunk > This may be a leak. Can you monitor this value for longer run? No problem. But I don't think it is "true" leak, when memory is NEVER freed, as uptime of this box is 11 days already, and sometimes ARC is much larger than 2GiB. For example, now it is inflated to 8GiB. Ok, and now it is: USED (b) FREE (b) NAME 35445924 3639276 S VFS Cache 37336376 1067704 arc_buf_hdr_t_l2only 47760912 2670336 sa_cache 51531120 55440 VM OBJECT 55574528 30408704 zio_data_buf_1048576 56183040 21365760 256 61734912 50331648 zio_buf_131072 70467584 2375680 mbuf_cluster 72028160 3895296 mbuf_jumbo_page 87561672 4856808 zfs_znode_cache 110448640 32768 4096 124137120 158133600 dmu_buf_impl_t 150976512 7188480 mbuf_jumbo_9k 156588360 8539896 VNODE 208290960 1040 UMA Slabs 247484416 280662016 zio_buf_512 275775488 96993280 zio_data_buf_524288 361406864 314169856 dnode_t 417366016 1015808 zio_buf_16384 7307493376 2383060992 abd_chunk It is more likely that there is a bug in "priority" for memory distribution: abd FREE memory has higher priority than ARC somehow. -- Best regards, Lev mailto:lev@FreeBSD.org