From owner-freebsd-fs@freebsd.org Wed Jul 3 23:05:50 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AFA7D15E3429 for ; Wed, 3 Jul 2019 23:05:50 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8635B6EF9F for ; Wed, 3 Jul 2019 23:05:49 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id x63MqN5X016427; Wed, 3 Jul 2019 17:52:24 -0500 (CDT) Date: Wed, 3 Jul 2019 17:52:23 -0500 (CDT) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: "Nagy, Attila" cc: freebsd-fs@freebsd.org Subject: Re: ZFS exhausts kernel memory just by importing zpools In-Reply-To: <78882cea-c1aa-0d08-d2e8-7f7ae7131bb6@fsn.hu> Message-ID: References: <820ceee3-95aa-9925-066d-5d22884ce001@sentex.net> <78882cea-c1aa-0d08-d2e8-7f7ae7131bb6@fsn.hu> User-Agent: Alpine 2.20 (GSO 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Wed, 03 Jul 2019 17:52:26 -0500 (CDT) X-Rspamd-Queue-Id: 8635B6EF9F X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of bfriesen@simple.dallas.tx.us designates 65.66.246.90 as permitted sender) smtp.mailfrom=bfriesen@simple.dallas.tx.us X-Spamd-Result: default: False [-1.30 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.66)[-0.660,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-0.96)[-0.959,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dallas.tx.us]; NEURAL_SPAM_SHORT(0.60)[0.600,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[smtp.simplesystems.org]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.03)[asn: 7018(0.22), country: US(-0.06)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7018, ipnet:65.64.0.0/13, country:US]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2019 23:05:50 -0000 On Wed, 3 Jul 2019, Nagy, Attila wrote: > > I think this is related to how ZFS stores pool metadata in memory. I don't > think these scales with the number of the files, but maybe with the number of > stored blocks. There should be a zfs tunable to disable zfs metadata caching. This would make repeated access slower due to more reads, but might allow importing the pool. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt