From owner-freebsd-hackers@FreeBSD.ORG Wed Oct 1 08:13:57 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6CB4F6A7 for ; Wed, 1 Oct 2014 08:13:57 +0000 (UTC) Received: from eu1sys200aog104.obsmtp.com (eu1sys200aog104.obsmtp.com [207.126.144.117]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BD95CB10 for ; Wed, 1 Oct 2014 08:13:56 +0000 (UTC) Received: from mail-wi0-f180.google.com ([209.85.212.180]) (using TLSv1) by eu1sys200aob104.postini.com ([207.126.147.11]) with SMTP ID DSNKVCu3wpPgNln48l5JfLhTGG76+P0hCBqY@postini.com; Wed, 01 Oct 2014 08:13:56 UTC Received: by mail-wi0-f180.google.com with SMTP id em10so947979wid.1 for ; Wed, 01 Oct 2014 01:13:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:message-id:to:subject:cc:reply-to :in-reply-to; bh=7vg4c7WR0eKID4OszivvJskEQvYPYDMHTGRwgtJTTEE=; b=WHp3Vet45NR7wXpGHRgZZ9H92GpaItLFFbmgS6b8LaqyCulNAAYla0VxYYd1iQpLM4 gqwbfU8fg3IgfbUrz95JAe5vSPmHmGpG72l4fg8+/nVVTm8+gGmRRjUfLHtZwQFlM1Uq 5+gywVyOUfiA9OZBR40A+Ho5XjNyHOp2wDe5ABBHTIy6iBh4JHVfwwr+FZZqkuTVJQdj xKAEcDVFys4Xkf3l/tllshwxmDQk6EhTRXXCnb6Gfv/xFFZN7IsJWsoZd9h4t3sUmWCT nMsmNUBhUfPkG0JlJf7uN0m2aABuNJ5AyC0eHGPle2opcyI7EhKapX7YWx7roZRG0iCR kPxQ== X-Received: by 10.180.83.103 with SMTP id p7mr12010340wiy.67.1412150902463; Wed, 01 Oct 2014 01:08:22 -0700 (PDT) X-Gm-Message-State: ALoCoQnCpkBeGo8E+XtE+2kzgmueepPCvkUjU27Hj84aWxy7kAEMNwkK5QL3ul2sxZMblej5X2wo1kcrrgDJuepkuVDjmEnvzMdHhCBj+RVyLkokpIG5f8OKzzknoK1hoJI3lHjeXIYcnAPL8cNTWBXVEMeYNNchZw== X-Received: by 10.180.83.103 with SMTP id p7mr12010322wiy.67.1412150902335; Wed, 01 Oct 2014 01:08:22 -0700 (PDT) Received: from mech-as221.men.bris.ac.uk (mech-as221.men.bris.ac.uk. [137.222.187.221]) by mx.google.com with ESMTPSA id ny6sm17678031wic.22.2014.10.01.01.08.21 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 01 Oct 2014 01:08:21 -0700 (PDT) Received: from mech-as221.men.bris.ac.uk (localhost [127.0.0.1]) by mech-as221.men.bris.ac.uk (8.14.9/8.14.9) with ESMTP id s9188KNW083914 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 1 Oct 2014 09:08:20 +0100 (BST) (envelope-from mexas@mech-as221.men.bris.ac.uk) Received: (from mexas@localhost) by mech-as221.men.bris.ac.uk (8.14.9/8.14.9/Submit) id s9188KVc083913; Wed, 1 Oct 2014 09:08:20 +0100 (BST) (envelope-from mexas) Date: Wed, 1 Oct 2014 09:08:20 +0100 (BST) From: Anton Shterenlikht Message-Id: <201410010808.s9188KVc083913@mech-as221.men.bris.ac.uk> To: allanjude@freebsd.org, m.e.sanliturk@gmail.com Subject: Re: cluster FS? Reply-To: mexas@bristol.ac.uk In-Reply-To: Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Oct 2014 08:13:57 -0000 >From owner-freebsd-hackers@freebsd.org Wed Oct 1 03:25:08 2014 > >On Tue, Sep 30, 2014 at 9:14 PM, Allan Jude wrote: > >> On 2014-09-30 04:45, Anton Shterenlikht wrote: >> > Hello >> > >> > Not sure if this is the right list... >> > I wanted to ask about a cluster file system. >> > Is there something like this on FreeBSD? >> > >> > It seems to me (just from reading the handbook) >> > that none of NFS, HAST or iSCSI provide this. >> > >> > My specific needs are as follows. >> > I have multiple nodes and a disk array. >> > Each node is connected by fibre to the disk array. >> > I want to have each node read/write access >> > to all disks on disk array. >> > So that if any node fails, the >> > data is still accessible >> > via the remaining nodes. >> > >> > I want to have all nodes equal, i.e. no master/slave >> > or server/client model. Also, the disk array >> > provides adequate RAID already, so that is not >> > needed either. >> > >> > In the archives I see that the demands for >> > a cluster FS support on FreeBSD have been expressed >> > periodically over a very long time, but seems >> > there's never been any resolution. >> > Some people mention GFS, but I've no idea >> > if this what I'm trying to describe. >> > >> > So is what I'm describing a cluster FS at all? >> > Is there something like this on FreeBSD already? >> > Is there someting in ports that can be used >> > to achive this? >> > >> > Thanks >> > >> > Anton >> > >> > _______________________________________________ >> > freebsd-hackers@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> > To unsubscribe, send any mail to " >> freebsd-hackers-unsubscribe@freebsd.org" >> > >> >> What you are describing doesn't really seem to be a 'cluster' FS. >> >> In a cluster, the disks would reside in multiple machines, and the 'file >> system' would withstand any one of those machines going down. That is >> quite a bit different than just wanting a bunch of clients to have >> concurrent access to a single disk array. >> >> If you explain your use-case in more detail, we may be able to guide you >> in the right direction. >> >> -- >> Allan Jude >> >> > >The following pages and their associated pages may be useful for >definitions of terms and available capabilities : > >http://en.wikipedia.org/wiki/Parallel_Virtual_Machine >http://en.wikipedia.org/wiki/Linda_%28coordination_language%29 > >http://en.wikipedia.org/wiki/Category:Parallel_computing >http://en.wikipedia.org/wiki/Category:Concurrent_computing >http://en.wikipedia.org/wiki/Category:Distributed_computing > > >http://en.wikipedia.org/wiki/Network-attached_storage >http://en.wikipedia.org/wiki/Clustered_file_system >http://en.wikipedia.org/wiki/Category:Shared_disk_file_systems >http://en.wikipedia.org/wiki/Category:Network_file_systems > > >http://en.wikipedia.org/wiki/Ceph_%28software%29 >http://en.wikipedia.org/wiki/XtreemFS > > > >The above problem seems to be "Network-attached_storage" . Now I'm even more confused. I think what I have is called SAN. The disk array is HP MSA1000: http://www8.hp.com/h20195/v2/GetDocument.aspx?docname=c04324510 *quote* The HP StorageWorks Modular Smart Array 1000 (MSA1000) is a 2 Gb Fibre Channel storage system designed for the entry-level to mid-range Storage Area Network (SAN). *end quote* The disk array has 8-port 2 Gb Fibre Channel Fabric Switch. At present I connect 3 FreeBSD 10 nodes to the disk array via fibre. However, only one node at a time is able to mount disks. What I'm looking for is the solution to be able to mount the disks on the disk array for read/write access from all nodes, up to 8. So that if a node fails, the data is still accessible via the other nodes. The model that I'm describing is a VMS cluster model. I'm not sure if it makes sense for FreeBSD. Thanks Anton