Date: Fri, 1 Jul 2016 14:38:00 +0200 From: Julien Cigar <julien@perdition.city> To: Ben RUBSON <ben.rubson@gmail.com> Cc: freebsd-fs@freebsd.org Subject: Re: HAST + ZFS + NFS + CARP Message-ID: <20160701123800.GA41276@mordor.lan> In-Reply-To: <5F99508D-7532-468A-9121-7A76957A72DB@gmail.com> References: <63C07474-BDD5-42AA-BF4A-85A0E04D3CC2@gmail.com> <20160630163541.GC5695@mordor.lan> <50BF1AEF-3ECC-4C30-B8E1-678E02735BB5@gmail.com> <20160701084717.GE5695@mordor.lan> <47c7e1a5-6ae8-689c-9c2d-bb92f659ea43@internetx.com> <20160701101524.GF5695@mordor.lan> <f74627e3-604e-da71-c024-7e4e71ff36cb@internetx.com> <20160701105735.GG5695@mordor.lan> <5776569B.3050504@quip.cz> <5F99508D-7532-468A-9121-7A76957A72DB@gmail.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] On Fri, Jul 01, 2016 at 01:58:42PM +0200, Ben RUBSON wrote: > > > On 01 Jul 2016, at 13:40, Miroslav Lachman <000.fbsd@quip.cz> wrote: > > > > Julien Cigar wrote on 07/01/2016 12:57: > > > >>>> why...? I guess iSCSI is slower but should be safer than HAST, no? > >>> > >>> do your testing, please. even with simulated short network cuts. 10-20 > >>> secs are way enaugh to give you a picture of what is going to happen > >> > >> of course I'll test everything properly :) I don't have the hardware yet > >> so ATM I'm just looking for all the possible "candidates", and I'm > >> aware that a redundant storage is not that easy to implement ... > >> > >> but what solutions do we have? It's either CARP + ZFS + (HAST|iSCSI), > >> either zfs send|ssh zfs receive as you suggest (but it's > >> not realtime), either a distributed FS (which I avoid like the plague..) > > > > When disaster comes you will need to restart NFS clients in almost all cases (with CARP + ZFS + HAST|iSCSI) and you will lose some writes too. > > And if something bad happens with your mgmt scripts or network you can end up with corrupted ZFS pool on master and slave too - you will need to recovery from backups. For example in some split brain scenario when both nodes will try to import pool. > > Of course you must take care that both nodes do not import the pool at the same time. > For the slave to import the pool, first stop iSCSI targets (ctld), and also put network replication interface down, to be sure. > Then, import the pool. > Once old master repaired, export its pool (if still imported), make its disks iSCSI targets and give them the old slave (promoted master just above). > Of course it implies some meticulous administration. I was thinking something like this also.. and I definitively think that the switch from old save (promoted master) to "old master repaired" MUST be done manually! > > > With ZFS send & receive you will lose some writes but the chance you will corrupt both pools are much lower than in the first case and the setup is much simpler and runtime error proof. I think losing some writes is somewhat unavoidable, corruption on the other hand is unacceptable > > Only some ? > Depending on the write throughput, won't you loose a lot of data on the target/slave ? > How do you make ZFS send/receive quite realtime ? > while [ 1 ] do ; snapshot ; send/receive ; delete old snapshots ; done ? > > Thanks ! > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAABCgAGBQJXdmQkAAoJELK7NxCiBCPAK2oQAOhKqx3mmjsfU7CPpQqym8zY NYMwPXKPOCYPZOe8jiq10j26JTdWgnjR+mXgEjuf8TioH7Xwk+O18w4i8P3X6XlX gvpxF2smrhf0ujV/roQh/8MUW3zl6EbC/MQl65pZPotiMFCeWzi6CUcFPXXBr8/9 GxRU9TTQMET3z/wAED/iFvehJIIHu97u+imRp3hmEIAJuWJBqdU9NkucQSsLjmWA 1PYUHjm9VVtvazrDG59UGSRp7vmQMf3v0vhMkTz1iFR2U1lHekySp5xfPQ2NvFar PaUGjN7oEsHYv0vLI5v3urfMirCa/WSIbvQM1xNuLFSitNwAzJCV1bK/0ORXwkca VjZ8x+dt0LIFUOFtQ1A32dtebJMSDZC/XWOBgyFv4hysUUhtcs1cUK510UzMDPmA lTz101Fs2mGTHlMXohTLHMV9vqDPBiCBw/b35APIy9be0ggtErHySCsha2cWIPU8 xTSAO2Sojn0JuzLIj04Qwfy9UGHtmj4PKF2XaRlQhdcLiOfQCFevJKo7c8PqqOhc q1fDmpVd/fRU7OQW3O4rvM5e5oCN/+yCUY6mBoBcTJaQvKT/Ayu/NYLptnN+Dh15 8t78F18hYJdf+2B2ZeB4XiLJU94vWjd2W7sc6IZS+jHEX2JmQpo2O7+4l4LzHyKP tUnBLu0eIaWdRkS1KlIU =RNKE -----END PGP SIGNATURE-----help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20160701123800.GA41276>