From owner-freebsd-fs@freebsd.org Fri Jul 1 14:39:23 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6256BB8E467 for ; Fri, 1 Jul 2016 14:39:23 +0000 (UTC) (envelope-from julien@perdition.city) Received: from relay-b03.edpnet.be (relay-b03.edpnet.be [212.71.1.220]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "edpnet.email", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 12BED2F92 for ; Fri, 1 Jul 2016 14:39:22 +0000 (UTC) (envelope-from julien@perdition.city) X-ASG-Debug-ID: 1467383957-0a88181ce6677820001-3nHGF7 Received: from mordor.lan (213.219.165.225.bro01.dyn.edpnet.net [213.219.165.225]) by relay-b03.edpnet.be with ESMTP id 7rkGYjFHQ8qeil4q (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 01 Jul 2016 16:39:18 +0200 (CEST) X-Barracuda-Envelope-From: julien@perdition.city X-Barracuda-Effective-Source-IP: 213.219.165.225.bro01.dyn.edpnet.net[213.219.165.225] X-Barracuda-Apparent-Source-IP: 213.219.165.225 Date: Fri, 1 Jul 2016 16:39:17 +0200 From: Julien Cigar To: InterNetX - Juergen Gotteswinter Cc: Joe Love , freebsd-fs@freebsd.org Subject: Re: HAST + ZFS + NFS + CARP Message-ID: <20160701143917.GB41276@mordor.lan> X-ASG-Orig-Subj: Re: HAST + ZFS + NFS + CARP References: <20160630163541.GC5695@mordor.lan> <50BF1AEF-3ECC-4C30-B8E1-678E02735BB5@gmail.com> <20160701084717.GE5695@mordor.lan> <47c7e1a5-6ae8-689c-9c2d-bb92f659ea43@internetx.com> <20160701101524.GF5695@mordor.lan> <20160701105735.GG5695@mordor.lan> <3d8c7c89-b24e-9810-f3c2-11ec1e15c948@internetx.com> <93E50E6B-8248-43B5-BE94-D94D53050E06@getsomewhere.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="mxv5cy4qt+RJ9ypb" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.6.1 (2016-04-27) X-Barracuda-Connect: 213.219.165.225.bro01.dyn.edpnet.net[213.219.165.225] X-Barracuda-Start-Time: 1467383957 X-Barracuda-Encrypted: ECDHE-RSA-AES256-GCM-SHA384 X-Barracuda-URL: https://212.71.1.220:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 2942 X-Virus-Scanned: by bsmtpd at edpnet.be X-Barracuda-BRTS-Status: 1 X-Barracuda-Bayes: INNOCENT GLOBAL 0.5000 1.0000 0.0000 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=6.0 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.30923 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Jul 2016 14:39:23 -0000 --mxv5cy4qt+RJ9ypb Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jul 01, 2016 at 03:44:36PM +0200, InterNetX - Juergen Gotteswinter = wrote: >=20 >=20 > Am 01.07.2016 um 15:18 schrieb Joe Love: > >=20 > >> On Jul 1, 2016, at 6:09 AM, InterNetX - Juergen Gotteswinter wrote: > >> > >> Am 01.07.2016 um 12:57 schrieb Julien Cigar: > >>> On Fri, Jul 01, 2016 at 12:18:39PM +0200, InterNetX - Juergen Gottesw= inter wrote: > >>> > >>> of course I'll test everything properly :) I don't have the hardware = yet > >>> so ATM I'm just looking for all the possible "candidates", and I'm=20 > >>> aware that a redundant storage is not that easy to implement ... > >>> > >>> but what solutions do we have? It's either CARP + ZFS + (HAST|iSCSI),= =20 > >>> either zfs send|ssh zfs receive as you suggest (but it's > >>> not realtime), either a distributed FS (which I avoid like the plague= =2E.) > >> > >> zfs send/receive can be nearly realtime. > >> > >> external jbods with cross cabled sas + commercial cluster solution like > >> rsf-1. anything else is a fragile construction which begs for desaster. > >=20 > > This sounds similar to the CTL-HA code that went in last year, for whic= h I haven=E2=80=99t seen any sort of how-to. The RSF-1 stuff sounds like i= t has more scaling options, though. Which it probably should, given its co= mmercial operation. >=20 > rsf is what pacemaker / heartbeat tries to be, judge me for linking > whitepapers but in this case its not such evil marketing blah >=20 > http://www.high-availability.com/wp-content/uploads/2013/01/RSF-1-HA-PLUG= IN-ZFS-STORAGE-CLUSTER.pdf >=20 >=20 > @ Julien >=20 > seems like you take availability really serious, so i guess you also got > plans how to accomplish network problems like dead switches, flaky > cables and so on. >=20 > like using multiple network cards in the boxes, cross cabling between > the hosts (rs232 and ethernet of course, using proved reliable network > switches in a stacked configuration for example cisco 3750 stacked). not > to forget redundant power feeds to redundant power supplies. the only thing that is not redundant (yet?) is our switch, an HP Pro=20 Curve 2530-24G) .. it's the next step :) >=20 > if not, i whould start again from scratch. >=20 > >=20 > > -Joe > >=20 > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > >=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --mxv5cy4qt+RJ9ypb Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAABCgAGBQJXdoCRAAoJELK7NxCiBCPATMoQAN5O8PPvvyN2S03MbK8e0Ax0 5QHW9gkECXeQ7UqMbu8HVo4IQIh+od4YhrNrLnTn59Ouv2B95D/tbRO6rsrASEGg 4yIoLUEsDS2B/XzAtOlBkTcwn8/mawrjBG9VjVZrTGHVEGUPX1bvfItDsioT0eRb 0t36vDadycjw+igfs77cnxvEW/SqnNboXlrgfQb1KIpxncpQ6xc0JiqdnmsBtscB ZBd593ADpsO+wjRj1DYeEJOibLdTnhrFwRDLTtcAH0PdM1EKk0BCrEdRwxUdNUKF YVR7f0ZUWv0gNRkePqg7Ag8Wbcbn/Uwc9vl9gDVrkxyXZQ5LU0hwrEAU7BlPPbra FCn6yyfW6r00boskOoNvg5hMOzdO5lzE38Yv9TTs0Y41qSL9q1Hyy+jqjfPI2XvJ U/34dbtuTejWQ/Xno3RHel4OWqKAfLgebhXwIrQHtFFgROnRvFi2gBb80A6bbSO7 Nv1hjFm3+HayLB4sGI2r1+Nq6YN3VZc/NHCoW+xQ3Y2p65fH/k0VAi5iNuIV660n fxTzWo7R8FYN79u7WsjSoCzjBhVHiDJRwtmcB/ijClzbLIafKtGfIOpilrpL63PM hDcg+6MUonkUeweJt0RUjjmdvJA8U+K2u9PvUkNdEaWjeGpe+1Gb3GlF9DeCDprC hKiGTl2UQ9qkZDf9iSL0 =z/8C -----END PGP SIGNATURE----- --mxv5cy4qt+RJ9ypb--