From owner-freebsd-hackers@FreeBSD.ORG Wed Oct 1 01:10:21 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2382AAF6 for ; Wed, 1 Oct 2014 01:10:21 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 074F1F1D for ; Wed, 1 Oct 2014 01:10:20 +0000 (UTC) Received: from [192.168.1.172] (pool-173-52-87-124.nycmny.fios.verizon.net [173.52.87.124]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: ryao) by smtp.gentoo.org (Postfix) with ESMTPSA id 3214334003C; Wed, 1 Oct 2014 01:10:09 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: cluster FS? From: Richard Yao X-Mailer: iPad Mail (11D257) In-Reply-To: Date: Tue, 30 Sep 2014 21:10:07 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: <201409300845.s8U8jUTa079241@mech-as221.men.bris.ac.uk> To: Wojciech Puchar Cc: "freebsd-hackers@freebsd.org" , "mexas@bristol.ac.uk" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Oct 2014 01:10:21 -0000 On Sep 30, 2014, at 7:04 AM, Wojciech Puchar wrote: >>=20 >> It seems to me (just from reading the handbook) >> that none of NFS, HAST or iSCSI provide this. >=20 > none of following are filesystems at all. NFS is remote access to filesyst= em, the rest presents raw block device. >=20 >> My specific needs are as follows. >> I have multiple nodes and a disk array. >> Each node is connected by fibre to the disk array. >> I want to have each node read/write access >> to all disks on disk array. >> So that if any node fails, the >> data is still accessible >> via the remaining nodes. >=20 > as disk array presents block devices, not files it is not possible to have= filesystem read write access with more than one computer to the same block d= evice. > There is no AFAIK filesystems that can communicate between nodes to synchr= onize state after writes and prevent conflict. Linux tends to have most of the work in this area. In specific, Lustre, Ceph= and Gluster. Gluster is FUSE-based and the server will run on FreeBSD: https://wiki.freebsd.org/GlusterFS The client likely can run on FreeBSD too, but it might be that no one has te= sted it because the FreeBSD support was done before FreeBSD supported FUSE.=