From owner-freebsd-fs@freebsd.org Fri Jul 1 15:02:30 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C6A9B8ED61 for ; Fri, 1 Jul 2016 15:02:30 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22c.google.com (mail-wm0-x22c.google.com [IPv6:2a00:1450:400c:c09::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 902302CFD for ; Fri, 1 Jul 2016 15:02:29 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22c.google.com with SMTP id f126so30137970wma.1 for ; Fri, 01 Jul 2016 08:02:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=Yi0xbIPfxZzwToNcO62ei1Tb1jROk4RR4IRvEMb/Eyk=; b=cdjQMki7oG0lw0P8/0dt78hJl0vhfkAmEGshGvH6FH3L+aHvDFkwS9DxtD+XJzJq2k A5Ozh/P/rih7RexVIpdq6PKpEEkO24e1eqmUfUtzzkmwZQ/t9zHqHku3kDILHnXbsv0X 5tFSTga47L4IgEAYGMB5Y4TVnvVacj97MWN0SPnxUBlmzQ97Ltn8to4JaTpn8K7NFJWt /BBdlZEObwNlPd5BMufO+FedJUtY+cbxGFoE9ELu/xBmwpAJqqzre2uEppMIDQqczfpT VtQLJbfIIVfa1CJOYfPLs57KpTIwLotWNjblnFhQ83BlHtIwJicIp8Rbo8LyBidS0Ty3 5apg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=Yi0xbIPfxZzwToNcO62ei1Tb1jROk4RR4IRvEMb/Eyk=; b=Q8inYi2j2LUW/VCQcVCQSPS6fPH+bb59YBt/rl7t+o1uO5+5Q3PN9vigq4k14hDKAd sR37TKVWQ6vb59Y+vQkohC72KGfIafzNjC5shHxTP3fwZ2w0EDY/9FsrCAt8jxri7hTO VqQTNYQBOcOwhSaR6/qIBFQ+eKhgQuG2dVIOt4JU3hKQLkNdvm1X087Ev/GFq6VfD72l YUQqo7b+3cHMNQ1PJIax8+JraYx8shWwEnW+UK5HIKURsR4KNDJUidMTM1coy4FtLJRK x34Tmo0X+SSNPtyQzaWWeSwQccdBEJMabxMXBxuc+fGA6k/OfcL0exJaQcdfyDM9Y26b Ug8A== X-Gm-Message-State: ALyK8tIJgVhEJ9L4LuanWzefMnYT4GsRK5Bd+4OItA5+VMxYxl4gp+4J4359dBcGwDnuKA== X-Received: by 10.194.165.138 with SMTP id yy10mr4595041wjb.92.1467385347810; Fri, 01 Jul 2016 08:02:27 -0700 (PDT) Received: from macbook-air-de-benjamin-1.home (LFbn-1-7077-85.w90-116.abo.wanadoo.fr. [90.116.246.85]) by smtp.gmail.com with ESMTPSA id kc8sm2481396wjb.0.2016.07.01.08.02.26 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 01 Jul 2016 08:02:27 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: HAST + ZFS + NFS + CARP From: Ben RUBSON In-Reply-To: <4d13f123-de18-693a-f98b-d02c8864f02e@internetx.com> Date: Fri, 1 Jul 2016 17:02:25 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20160630163541.GC5695@mordor.lan> <50BF1AEF-3ECC-4C30-B8E1-678E02735BB5@gmail.com> <20160701084717.GE5695@mordor.lan> <47c7e1a5-6ae8-689c-9c2d-bb92f659ea43@internetx.com> <20160701101524.GF5695@mordor.lan> <20160701105735.GG5695@mordor.lan> <3d8c7c89-b24e-9810-f3c2-11ec1e15c948@internetx.com> <93E50E6B-8248-43B5-BE94-D94D53050E06@getsomewhere.net> <20160701143917.GB41276@mordor.lan> <01b8a61e-739e-c41e-45bc-a84af0a9d8ab@internetx.com> <4d13f123-de18-693a-f98b-d02c8864f02e@internetx.com> To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Jul 2016 15:02:30 -0000 I think what we miss is some kind of this : http://milek.blogspot.fr/2007/03/zfs-online-replication.html http://www.compnect.net/?p=3D16461 Online replication built in ZFS would be awesome. > On 01 Jul 2016, at 16:44, InterNetX - Juergen Gotteswinter = wrote: >=20 > dont get me wrong, what i try to say is that imho you are trying to > reach something which looks great until something goes wrong. >=20 > keep it simple, stupid simple, without much moving parts and avoid > automagic voodoo wherever possible. >=20 > Am 01.07.2016 um 16:41 schrieb InterNetX - Juergen Gotteswinter: >> Am 01.07.2016 um 16:39 schrieb Julien Cigar: >>> On Fri, Jul 01, 2016 at 03:44:36PM +0200, InterNetX - Juergen = Gotteswinter wrote: >>>>=20 >>>>=20 >>>> Am 01.07.2016 um 15:18 schrieb Joe Love: >>>>>=20 >>>>>> On Jul 1, 2016, at 6:09 AM, InterNetX - Juergen Gotteswinter = wrote: >>>>>>=20 >>>>>> Am 01.07.2016 um 12:57 schrieb Julien Cigar: >>>>>>> On Fri, Jul 01, 2016 at 12:18:39PM +0200, InterNetX - Juergen = Gotteswinter wrote: >>>>>>>=20 >>>>>>> of course I'll test everything properly :) I don't have the = hardware yet >>>>>>> so ATM I'm just looking for all the possible "candidates", and = I'm=20 >>>>>>> aware that a redundant storage is not that easy to implement ... >>>>>>>=20 >>>>>>> but what solutions do we have? It's either CARP + ZFS + = (HAST|iSCSI),=20 >>>>>>> either zfs send|ssh zfs receive as you suggest (but it's >>>>>>> not realtime), either a distributed FS (which I avoid like the = plague..) >>>>>>=20 >>>>>> zfs send/receive can be nearly realtime. >>>>>>=20 >>>>>> external jbods with cross cabled sas + commercial cluster = solution like >>>>>> rsf-1. anything else is a fragile construction which begs for = desaster. >>>>>=20 >>>>> This sounds similar to the CTL-HA code that went in last year, for = which I haven=E2=80=99t seen any sort of how-to. The RSF-1 stuff sounds = like it has more scaling options, though. Which it probably should, = given its commercial operation. >>>>=20 >>>> rsf is what pacemaker / heartbeat tries to be, judge me for linking >>>> whitepapers but in this case its not such evil marketing blah >>>>=20 >>>> = http://www.high-availability.com/wp-content/uploads/2013/01/RSF-1-HA-PLUGI= N-ZFS-STORAGE-CLUSTER.pdf >>>>=20 >>>>=20 >>>> @ Julien >>>>=20 >>>> seems like you take availability really serious, so i guess you = also got >>>> plans how to accomplish network problems like dead switches, flaky >>>> cables and so on. >>>>=20 >>>> like using multiple network cards in the boxes, cross cabling = between >>>> the hosts (rs232 and ethernet of course, using proved reliable = network >>>> switches in a stacked configuration for example cisco 3750 = stacked). not >>>> to forget redundant power feeds to redundant power supplies. >>>=20 >>> the only thing that is not redundant (yet?) is our switch, an HP Pro=20= >>> Curve 2530-24G) .. it's the next step :) >>=20 >> Arubas, okay, a quick view in the spec sheet does not seem to list >> stacking option. >>=20 >> what about power? >>=20 >>>=20 >>>>=20 >>>> if not, i whould start again from scratch. >>>>=20 >>>>>=20 >>>>> -Joe >>>>>=20 >>>>> _______________________________________________ >>>>> freebsd-fs@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>>> To unsubscribe, send any mail to = "freebsd-fs-unsubscribe@freebsd.org" >>>>>=20 >>>> _______________________________________________ >>>> freebsd-fs@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>> To unsubscribe, send any mail to = "freebsd-fs-unsubscribe@freebsd.org" >>>=20 >>=20 >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >>=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"