Date: Thu, 04 Apr 2013 08:28:49 -0500 From: Graham Allan <allan@physics.umn.edu> To: Sami Halabi <sodynet1@gmail.com>, freebsd-fs@freebsd.org Subject: Re: ZFS in production enviroments Message-ID: <515D8011.9050806@physics.umn.edu> In-Reply-To: <CAEW%2BogaUkiiTw%2BVgZ0J6ey9MMD6EOv7sZD6FcqBq4=wU6z6w7w@mail.gmail.com> References: <CAEW%2BogaUkiiTw%2BVgZ0J6ey9MMD6EOv7sZD6FcqBq4=wU6z6w7w@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Like you, we watched for a long time before jumping in. We ran ZFS for quite a few years doing it the "wrong" way - having a filesystem on a single volume (mapped from our SAN). This was on a fairly low-capacity data-backup server (4TB or so) and although this misses a lot of the features of ZFS, it did give us some basic experience using it as a filesystem. More recently we run a couple of "bulk data" servers for compute clusters, with between 40-120 drives each. We used: Dell R710 or R720 as head node, 48-64GB RAM, starting from FreeBSD 9.1-RC1. multiple LSI SAS 9205-8e HBAs (should probably have looked at -16e) Intel 10GBe ethernet (old-style CX4 adapters, we are cheapskates :-) Supermicro SC847 E16-RJBOD1 45-bay SAS chassis (this is just the single-channel model) WD 3TB Red drives Intel 313 SSD log cache mirror randomly-selected L2ARC SSD (currently some mind of Samsung) each zfs pool made of four 10-drive raidz2 vdevs plus associated SSD drives (fits self-contained into one JBOD chassis). This has performed really well even though we have barely done any NFS tuning yet. For home directories for which I've have been asking advice on this list, for building in the next few weeks, we will probably use dual-path chassis and gmultipath, WD RE-series SAS drives, and some variety of mirroring rather than raidz. None of these are meant to be high-availability, we'd just swap connections to a different head unit in case of failure. Graham On 4/4/2013 1:01 AM, Sami Halabi wrote: > Hi, > I've registered the last year to the list in order to get more involved in > ZFS filesystem. > I must admit i didn't install it yet in any prod machine, rather than in a > VM for testing that I installed lately. > > I see a lots of bugs/patches/stability issues regarding ZFS, what makes me > think: > 1. is it really ready for production enviroments? > 2. Is there anyone that installed it in prod and can give some feedback > about stability, config? > 3. from all the mails about reccomendations I've seen, is someone in > fbsd-team taking the reccomendations and putting them somewhere in a > one-document that describes all the suggestions rather than mailing lists?
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?515D8011.9050806>