From owner-freebsd-fs@freebsd.org Tue Apr 24 15:45:28 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E49A2FA9B45 for ; Tue, 24 Apr 2018 15:45:27 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from mail.inparadise.se (h-112-105.A444.priv.bahnhof.se [158.174.112.105]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 62B8F856EF for ; Tue, 24 Apr 2018 15:45:26 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 6FE644320B; Tue, 24 Apr 2018 17:45:24 +0200 (CEST) Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id cfGMu9tnwUXe; Tue, 24 Apr 2018 17:45:22 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 9F623431FF; Tue, 24 Apr 2018 17:45:22 +0200 (CEST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.inparadise.se 9F623431FF X-Virus-Scanned: amavisd-new at inparadise.se Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id SAh3HJQalEu8; Tue, 24 Apr 2018 17:45:22 +0200 (CEST) Received: from nexus6p.inparadise.se (nexus6p.inparadise.se [172.16.1.122]) by mail.inparadise.se (Postfix) with ESMTPSA id 709E9431FA; Tue, 24 Apr 2018 17:45:22 +0200 (CEST) Date: Tue, 24 Apr 2018 17:45:21 +0200 User-Agent: K-9 Mail for Android In-Reply-To: <56E4773F-4EAD-47EB-A803-38BFCD8C63F8@yahoo.com> References: <4cb4aa83-bd49-0c20-4e41-c11c682b0570@sentex.net> <1e1e7cd5-0797-c168-fbce-a36edc6a432e@sentex.net> <1524550160.1130.6.camel@inparadise.se> <615DFFBB-239A-4350-B961-FD10D0C9A8DD@yahoo.com> <1524567621.9560.65.camel@inparadise.se> <1524567842.9560.66.camel@inparadise.se> <56E4773F-4EAD-47EB-A803-38BFCD8C63F8@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: ctl_isc_lun_sync: Received conflicting HA LUN To: Mikhail Zakharov CC: "freebsd-fs@freebsd.org" From: =?ISO-8859-1?Q?Karli_Sj=F6berg?= Message-ID: X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2018 15:45:28 -0000 Mikhail Zakharov skrev: (24 april 2018 13:27:38 CE= ST) >Ah, and unfortunately CTL HA is two-node cluster, as I remember, there >is no possibility to add the third one=2E So the third node is an >external arbiter in that case=2E Yes, Arbiter, exactly the term I was looking for:) So it would be up to th= e Arbiter to decide whether it really is a node problem or a network proble= m- a tie-breaker=2E Would that be feasible in your software? /K > > >> 24 =D0=B0=D0=BF=D1=80=2E 2018 =D0=B3=2E, =D0=B2 14:04, Karli Sj=C3=B6be= rg >=D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB(=D0=B0): >>=20 >>> On Tue, 2018-04-24 at 13:00 +0200, Karli Sj=C3=B6berg via freebsd-fs >wrote: >>>> On Tue, 2018-04-24 at 12:32 +0300, Mikhail Zakharov wrote: >>>> Hi Karli, >>>>=20 >>>> Thank you, I=E2=80=99m just exploring the storage abilities of my pre= ferred >>>> OS - FreeBSD=2E=20 >>>>=20 >>>> Three nodes are preferable to choose the quorum for sure, but my >>>> idea >>>> was not to establish contacts between nodes=2E Instead of it, BQ uses >>>> a >>>> small partition for the =E2=80=9Cquorum=E2=80=9D on the same space wh= ere data >>>> volume >>>> is located=2E=20 >>>=20 >>> Yes, of course=2E But there=C2=B4s nothing you from having three nodes >>=20 >> 's/nothing you/nothing stopping you/' >>=20 >>> connected to the same partition and being able to make more accurate >>> choices on when to take over? >>>=20 >>> If one node stops updating stamps, take over=2E If two nodes stops >>> updating, then the problem is likely network-related and _must not_ >>> take over to avoid split brain=2E Something like that? >>>=20 >>> /K >>>=20 >>>> And if a node looses access to the quorum it means, it looses >>>> access >>>> to the data volume too=2E Now, BQ runs on both nodes and both BQ >>>> instances write stamps to the quorum partition=2E If for any reason >>>> BQ >>>> on one node detects, the other node stops updating it=E2=80=99s stamp= s, it >>>> performs failover procedure=2E It=E2=80=99s quite a questionable, rud= e way, I >>>> can agree, and that=E2=80=99s why I always write a warning to use the= BeaST >>>> for testing only purposes=2E=20 >>>>=20 >>>> Best regards, >>>> Mike >>>>=20 >>>>> 24 =D0=B0=D0=BF=D1=80=2E 2018 =D0=B3=2E, =D0=B2 9:09, Karli Sj=C3=B6= berg >>>>> =D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB(=D0=B0): >>>>>=20 >>>>>>> On Mon, 2018-04-23 at 13:11 -0400, Mike Tancsa wrote: >>>>>>> On 4/23/2018 12:59 PM, Mikhail Zakharov wrote: >>>>>>>=20 >>>>>>> Hello Mike, >>>>>>>=20 >>>>>>> Thank you for your interest to my paper=2E I appreciate it very >>>>>>> much! >>>>>>> Your error may be a consequence of the initial HA >>>>>>> misconfiguration=2E >>>>>>> What is in your /boot/loader=2Econf? Although the described >>>>>>> config is >>>>>>> quite simple, I can recheck the instruction in my paper in a >>>>>>> couple >>>>>>> of weeks only, unfortunately I=E2=80=99m on vacation right now=2E >>>>>=20 >>>>> [snip] >>>>>=20 >>>>> I read your articles on CTL HA, BQ and BeaST, and just wanted to >>>>> say >>>>> they are amazing, good job! >>>>>=20 >>>>> One thing I=C2=B4m wondering about though is if you can claim HA wit= h >>>>> just >>>>> two nodes, usually you need at least three, where the third is a >>>>> tie- >>>>> breaker=2E Otherwise with your current setup, both systems may >>>>> loose >>>>> contact with each other while both still being powered on, >>>>> leading >>>>> to >>>>> potential split brain situations=2E What are your thoughts about >>>>> that? >>>>>=20 >>>>> /K --=20 Skickat fr=C3=A5n min Android-enhet med K-9 Mail=2E Urs=C3=A4kta min f=C3= =A5ordighet=2E