Date: Wed, 17 Aug 2016 10:37:57 -0500 From: Joe Love <joe@getsomewhere.net> To: krad <kraduk@gmail.com>, FreeBSD FS <freebsd-fs@freebsd.org> Subject: Re: MooseFS on FreeBSD (was: HAST + ZFS + NFS + CARP) Message-ID: <B7E6B76A-38C9-40CF-8AD9-C0E77B92EA5D@getsomewhere.net> In-Reply-To: <CALfReye_f0_3kFF08KS0fCB5wbTKdZ5=ymh8WM5S18YEfbHqNg@mail.gmail.com> References: <20160704183643.GI41276@mordor.lan> <AE372BF0-02BE-4BF3-9073-A05DB4E7FE34@ixsystems.com> <20160704193131.GJ41276@mordor.lan> <E7D42341-D324-41C7-B03A-2420DA7A7952@sarenet.es> <20160811091016.GI70364@mordor.lan> <1AA52221-9B04-4CF6-97A3-D2C2B330B7F9@sarenet.es> <472bc879-977f-8c4c-c91a-84cc61efcd86@internetx.com> <20160817085413.GE22506@mordor.lan> <465bdec5-45b7-8a1d-d580-329ab6d4881b@internetx.com> <20160817095222.GG22506@mordor.lan> <20160817113339.GH22506@mordor.lan> <CALfReye_f0_3kFF08KS0fCB5wbTKdZ5=ymh8WM5S18YEfbHqNg@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Aug 17, 2016, at 8:33 AM, krad <kraduk@gmail.com> wrote: > > What are peoples experiences on running something like moosfs on top of > zfs? It looks really compelling on certain levels, but i'm not sure about > the reality in a production network yet. > I did some experimenting with MooseFS on a test cluster (using ZFS as the local storage on the nodes). That was nearly a year ago, when I decided it wasn’t a good fit as a storage backend to vmware (primarily because of the overhead involved with traversing from vmware over nfs to moosefs). They did a bunch of tweaking back then as I kept prodding a bit for better operations on FreeBSD, but they ultimately ran into a stumbling block with I/O caching in FreeBSD. Here is their analysis of what they ran into, and the solution they came up with for higher throughput: https://sourceforge.net/p/moosefs/mailman/message/34483159/ <https://sourceforge.net/p/moosefs/mailman/message/34483159/>; I’d love to get around to testing MooseFS as a backing store for bhyve, but I currently lack the power & network ports to connect up my test nodes again. -Joe
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?B7E6B76A-38C9-40CF-8AD9-C0E77B92EA5D>