Date: Wed, 3 Apr 2013 17:16:49 -0700 From: Mehmet Erol Sanliturk <m.e.sanliturk@gmail.com> To: Rick Macklem <rmacklem@uoguelph.ca> Cc: freebsd-fs@freebsd.org Subject: Re: zfs home directories best practice Message-ID: <CAOgwaMuuWJwwxWB59MGHE993AXuzmmJrz0GkVc_j794ZELjq7w@mail.gmail.com> In-Reply-To: <238802714.483457.1365033407086.JavaMail.root@erie.cs.uoguelph.ca> References: <515B84E8.2090202@physics.umn.edu> <238802714.483457.1365033407086.JavaMail.root@erie.cs.uoguelph.ca>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Apr 3, 2013 at 4:56 PM, Rick Macklem <rmacklem@uoguelph.ca> wrote: > Graham Allan wrote: > > We're building a new NFS home directory server on FreeBSD with ZFS. > > The > > Solaris ZFS Best Practices docs say to create a separate filesystem > > for > > each user home directory. My instinct is to ask "Are you serious???". > > My > > gut feeling isn't entirely logical but the idea of getting 1000+ lines > > of output from a simple "df" just feels wrong... > > > > Can anyone comment about how well this approach actually works, > > specifically on FreeBSD? (we're running 9.1) Obviously it has some > > nice > > features, such as quota controls, snapshots directly available to > > users > > within their home, etc, but it leaves me concerned. I chatted with > > some > > neighbors who have a larger, Solaris-based shop, and they said that > > with > > 10,000 user home filesystems, their server could take an hour to boot > > (at least using the default startup scripts). They reverted to having > > one big shared filesystem for all, but would like to revisit the > > per-user approach with fewer users per server. > > > > Ours wouldn't be so large, but we could easily have around 1000 user > > filesystems. I haven't tested yet what effect that would have on boot > > time, though hope to test it over the next week. Perhaps it implies > > other resource usage besides the boot time issue (is there any limit > > to > > number of filesystems mounted or NFS-exported?). I wonder if anyone > > here > > has built a system along these lines and has experiences to share. > > > Well, there isn't any limit to the # of exported file systems afaik, > but updating a large /etc/exports file takes quite a bit of time and > when you use mountd (the default) for this, you can have problems. > (You either have a period of time when no client can get response > from the server or a period of time when I/O fails because the > file system isn't re-exported yet.) > > If you choose this approach, you should look seriously at using > nfse (on sourceforge) instead of mountd. > > You might also want to contact Garrett Wollman w.r.t. the NFS > server patch(es) and setup he is using, since he has been > working through performance issues (relatively successfully > now, as I understand) for a fairly large NFS/ZFS server. > You should be able to find a thread discussing this on > freebsd-fs or freebsd-current. > > rick > > > Thanks for any comments, > > > > Graham > > -- > > ------------------------------------------------------------------------- > > Graham Allan > > School of Physics and Astronomy - University of Minnesota > > ------------------------------------------------------------------------- > > > >From Google , the following link is found , but it is giving error here : http://sourceforge.net/projects/nfse/ Thank you very much . Mehmet Erol Sanliturk
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOgwaMuuWJwwxWB59MGHE993AXuzmmJrz0GkVc_j794ZELjq7w>