Date: Mon, 4 Apr 2016 19:26:22 -0700 From: Freddie Cash <fjwcash@gmail.com> To: Miroslav Lachman <000.fbsd@quip.cz> Cc: FreeBSD Filesystems <freebsd-fs@freebsd.org>, Wim Lewis <wiml@omnigroup.com> Subject: Re: ZFS pool with a large number of filesystems Message-ID: <CAOjFWZ6MNFiiDFYMu-Q-e%2B1V7E0z7-x1YWR94BN%2Bt5JaVyjpHw@mail.gmail.com> In-Reply-To: <CAOjFWZ4uwFTbiQg7a=Y%2BYNTJ7xP9Ki=V%2Bw_WVFQvo8PrOsjRJw@mail.gmail.com> References: <34DB45E8-7E1F-4D7C-96FF-E0A403EE8000@omnigroup.com> <570311C5.4010702@quip.cz> <CAOjFWZ4uwFTbiQg7a=Y%2BYNTJ7xP9Ki=V%2Bw_WVFQvo8PrOsjRJw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Apr 4, 2016 6:16 PM, "Miroslav Lachman" <000.fbsd@quip.cz> wrote: > > Wim Lewis wrote on 04/05/2016 02:38: >> >> I'm curious how many ZFS filesystems are reasonable to have on a single machine (in a single zpool). We're contemplating a design in which we'd have tens of thousands, perhaps a couple hundred thousand, filesystems mounted out of the same pool. Before we go too far into investigating this idea: Does anyone have real-world experience doing something like that? Is it a situation that ZFS-on-FreeBSD is engineered to handle with good performance? Is there a rough estimate of the resources consumed per additional filesystem (in terms of kernel VM and disk space)? >> >> Thanks for any insight or advice (even, or especially, if the answer is "that's crazy, don't do that" :) ) > > > I donn't know about how many filesystems but I know that few hundereds of snapshots can make a noticeable slowdown for some zfs operations. > I think that basic "zfs list" will be painfully slow with tens of thousands of filesystems. > > Miroslav Lachman Adding "-o <property1>,<property 2>,etc" to limit what you query via "zfs list" really makes a difference. Especially on FreeBSD. PHK did a lot of work optimising that a release or two ago. "zfs list -o name -r -t all pool/fs" is many many many times faster than "zfs list -r -t all pool/fs" Cheers, Freddie Typos courtesy of my phone.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOjFWZ6MNFiiDFYMu-Q-e%2B1V7E0z7-x1YWR94BN%2Bt5JaVyjpHw>