From owner-freebsd-fs@freebsd.org Fri Jul 1 13:44:44 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9698B88557 for ; Fri, 1 Jul 2016 13:44:44 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6B0C520F0 for ; Fri, 1 Jul 2016 13:44:44 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id 2C67645FC0E5; Fri, 1 Jul 2016 15:44:41 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Y63CvrDQ8ijk; Fri, 1 Jul 2016 15:44:37 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 3E4184C4C87E; Fri, 1 Jul 2016 15:44:37 +0200 (CEST) Subject: Re: HAST + ZFS + NFS + CARP References: <71b8da1e-acb2-9d4e-5d11-20695aa5274a@internetx.com> <20160630153747.GB5695@mordor.lan> <63C07474-BDD5-42AA-BF4A-85A0E04D3CC2@gmail.com> <20160630163541.GC5695@mordor.lan> <50BF1AEF-3ECC-4C30-B8E1-678E02735BB5@gmail.com> <20160701084717.GE5695@mordor.lan> <47c7e1a5-6ae8-689c-9c2d-bb92f659ea43@internetx.com> <20160701101524.GF5695@mordor.lan> <20160701105735.GG5695@mordor.lan> <3d8c7c89-b24e-9810-f3c2-11ec1e15c948@internetx.com> <93E50E6B-8248-43B5-BE94-D94D53050E06@getsomewhere.net> To: Joe Love , freebsd-fs@freebsd.org Reply-To: jg@internetx.com From: InterNetX - Juergen Gotteswinter Message-ID: Date: Fri, 1 Jul 2016 15:44:36 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <93E50E6B-8248-43B5-BE94-D94D53050E06@getsomewhere.net> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Jul 2016 13:44:44 -0000 Am 01.07.2016 um 15:18 schrieb Joe Love: > >> On Jul 1, 2016, at 6:09 AM, InterNetX - Juergen Gotteswinter wrote: >> >> Am 01.07.2016 um 12:57 schrieb Julien Cigar: >>> On Fri, Jul 01, 2016 at 12:18:39PM +0200, InterNetX - Juergen Gotteswinter wrote: >>> >>> of course I'll test everything properly :) I don't have the hardware yet >>> so ATM I'm just looking for all the possible "candidates", and I'm >>> aware that a redundant storage is not that easy to implement ... >>> >>> but what solutions do we have? It's either CARP + ZFS + (HAST|iSCSI), >>> either zfs send|ssh zfs receive as you suggest (but it's >>> not realtime), either a distributed FS (which I avoid like the plague..) >> >> zfs send/receive can be nearly realtime. >> >> external jbods with cross cabled sas + commercial cluster solution like >> rsf-1. anything else is a fragile construction which begs for desaster. > > This sounds similar to the CTL-HA code that went in last year, for which I haven’t seen any sort of how-to. The RSF-1 stuff sounds like it has more scaling options, though. Which it probably should, given its commercial operation. rsf is what pacemaker / heartbeat tries to be, judge me for linking whitepapers but in this case its not such evil marketing blah http://www.high-availability.com/wp-content/uploads/2013/01/RSF-1-HA-PLUGIN-ZFS-STORAGE-CLUSTER.pdf @ Julien seems like you take availability really serious, so i guess you also got plans how to accomplish network problems like dead switches, flaky cables and so on. like using multiple network cards in the boxes, cross cabling between the hosts (rs232 and ethernet of course, using proved reliable network switches in a stacked configuration for example cisco 3750 stacked). not to forget redundant power feeds to redundant power supplies. if not, i whould start again from scratch. > > -Joe > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >