From owner-freebsd-fs@freebsd.org Sun Sep 6 05:20:02 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 177149CB986 for ; Sun, 6 Sep 2015 05:20:02 +0000 (UTC) (envelope-from jordanhubbard@icloud.com) Received: from pv33p03im-asmtp001.me.com (pv33p03im-asmtp001.me.com [17.143.180.10]) (using TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4F24634 for ; Sun, 6 Sep 2015 05:20:01 +0000 (UTC) (envelope-from jordanhubbard@icloud.com) Received: from [10.20.30.60] (75-101-82-48.static.sonic.net [75.101.82.48]) by pv33p03im-asmtp001.me.com (Oracle Communications Messaging Server 7.0.5.35.0 64bit (built Mar 31 2015)) with ESMTPSA id <0NU800IXHPH3RD40@pv33p03im-asmtp001.me.com> for freebsd-fs@freebsd.org; Sun, 06 Sep 2015 05:19:55 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2015-09-06_02:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 kscore.is_bulkscore=3.23174820238137e-12 compositescore=0.994460221061599 phishscore=0 kscore.is_spamscore=0 rbsscore=0.994460221061599 recipient_to_sender_totalscore=0 spamscore=0 urlsuspectscore=0.994460221061599 adultscore=0 kscore.compositescore=0 circleOfTrustscore=0 suspectscore=0 recipient_domain_to_sender_totalscore=0 bulkscore=0 recipient_domain_to_sender_domain_totalscore=0 recipient_to_sender_domain_totalscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1412110000 definitions=main-1509060099 Content-type: text/plain; charset=utf-8 MIME-version: 1.0 (Mac OS X Mail 9.0 \(3093\)) Subject: Re: CEPH + FreeBSD From: Jordan Hubbard In-reply-to: <100306673.40344407.1441279047901.JavaMail.zimbra@uoguelph.ca> Date: Sat, 05 Sep 2015 22:19:50 -0700 Cc: freebsd-fs@freebsd.org, Rakshith Venkatesh Content-transfer-encoding: quoted-printable Message-id: <1564D4FA-9BE1-4E37-8E91-F14A009D6B62@icloud.com> References: <100306673.40344407.1441279047901.JavaMail.zimbra@uoguelph.ca> To: Rick Macklem X-Mailer: Apple Mail (2.3093) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Sep 2015 05:20:02 -0000 > On Sep 3, 2015, at 4:17 AM, Rick Macklem wrote: >=20 > Slightly off topic but, btw, there is a port of GLusterFS and those = folks do seem > interested in seeing it brought "up to speed". I am not sure how = mature it is at > this point, but it has been known to build on amd64. (I don't have an = amd64 machine, > so I haven't gotten around to building/testing it, but I do plan to = try and use > it as a basis for a pNFS server, if I can figure out how to get the FH = info out of it. > I'm working on that;-) There are at least two distributed (multi-node) object stores for = FreeBSD that I know of. One is glusterfs, for which I=E2=80=99m not even really clear on the = status of the ports for. I don=E2=80=99t see any glusterfs port in the = master branch of https://github.com/freebsd/freebsd-ports (or = https://github.com/freebsd/freebsd-ports/tree/branches/2015Q3 for that = matter). Our FreeNAS ports tree (https://github.com/freenas/ports), in which we = have a bit more latitude to add and curate our own ports, has both a = net/glusterfs and sysutils/glusterfs, from separate sources (looks like = we need to clean things up) - net/glusterfs lists = craig001@lerwick.hopto.org as the MAINTAINER and is at version 3.6.2. = The sysutils/glusterfs port lists bapt@FreeBSD.org as the MAINTAINER and = is at version 20140811. I=E2=80=99m not really sure about the provenance since we were simply = evaluating glusterfs for awhile and may have pulled in interim versions = from those sources, but obviously it would be best to have an official = maintainer and someone in the FreeBSD project actually curating a = glusterfs port so that all users of FreeBSD can use it. It would also = be fairly key to your own efforts, assuming you decide to pursue = glusterfs as a foundation technology for pNFS. The other object store, which is pretty mature and is currently leading = the pack (of two :) ) for inclusion into FreeNAS is RiakCS from Basho. = There is a port currently in databases/riak but it=E2=80=99s pretty out = of date at version 1.4.12 (the current version is 2.0.1, with 2.0 being = a major upgrade of RiakCS). We are very interested in investigating various ways of shimming RiakCS = to NFS, using RiakCS a back-end store. Is that something you=E2=80=99d = be amenable to discussing? I=E2=80=99d be happy to send you an amd64 = architecture machine to develop on. :) - Jordan