Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 17 Aug 2016 10:37:57 -0500
From:      Joe Love <joe@getsomewhere.net>
To:        krad <kraduk@gmail.com>, FreeBSD FS <freebsd-fs@freebsd.org>
Subject:   Re:  MooseFS on FreeBSD (was: HAST + ZFS + NFS + CARP)
Message-ID:  <B7E6B76A-38C9-40CF-8AD9-C0E77B92EA5D@getsomewhere.net>
In-Reply-To: <CALfReye_f0_3kFF08KS0fCB5wbTKdZ5=ymh8WM5S18YEfbHqNg@mail.gmail.com>
References:  <20160704183643.GI41276@mordor.lan> <AE372BF0-02BE-4BF3-9073-A05DB4E7FE34@ixsystems.com> <20160704193131.GJ41276@mordor.lan> <E7D42341-D324-41C7-B03A-2420DA7A7952@sarenet.es> <20160811091016.GI70364@mordor.lan> <1AA52221-9B04-4CF6-97A3-D2C2B330B7F9@sarenet.es> <472bc879-977f-8c4c-c91a-84cc61efcd86@internetx.com> <20160817085413.GE22506@mordor.lan> <465bdec5-45b7-8a1d-d580-329ab6d4881b@internetx.com> <20160817095222.GG22506@mordor.lan> <20160817113339.GH22506@mordor.lan> <CALfReye_f0_3kFF08KS0fCB5wbTKdZ5=ymh8WM5S18YEfbHqNg@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Aug 17, 2016, at 8:33 AM, krad <kraduk@gmail.com> wrote:
>=20
> What are peoples experiences on running something like moosfs on top =
of
> zfs? It looks really compelling on certain levels, but i'm not sure =
about
> the reality in a production network yet.
>=20

I did some experimenting with MooseFS on a test cluster (using ZFS as =
the local storage on the nodes).  That was nearly a year ago, when I =
decided it wasn=E2=80=99t a good fit as a storage backend to vmware =
(primarily because of the overhead involved with traversing from vmware =
over nfs to moosefs).

They did a bunch of tweaking back then as I kept prodding a bit for =
better operations on FreeBSD, but they ultimately ran into a stumbling =
block with I/O caching in FreeBSD.

Here is their analysis of what they ran into, and the solution they came =
up with for higher throughput:
https://sourceforge.net/p/moosefs/mailman/message/34483159/ =
<https://sourceforge.net/p/moosefs/mailman/message/34483159/>;

I=E2=80=99d love to get around to testing MooseFS as a backing store for =
bhyve, but I currently lack the power & network ports to connect up my =
test nodes again.

-Joe




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?B7E6B76A-38C9-40CF-8AD9-C0E77B92EA5D>