Date: Wed, 17 Apr 2024 11:16:47 +0200 From: Alejandro Imass <aimass@yabarana.com> To: FreeBSD virtualization <freebsd-virtualization@freebsd.org> Subject: Corosync and Pacemaker with Jails. Is it worth the effort? Message-ID: <CAHieY7Q=Gpob2Ss%2Bh90UzCPO7hxGbMf8JqySQhYJERKY8xR%2Bww@mail.gmail.com>
next in thread | raw e-mail | index | archive | help
--00000000000008889e061647515e
Content-Type: text/plain; charset="UTF-8"
Hello,
Are these cluster tools actually usable on FBSD and in Jails?
I got a 3 way PostgreSQL cluster with floating IPs to _mostly_ work across
3 Bastille-based jails but the whole process has been very painful, so I'm
wondering if this stuff is actually usable on FBSD or am I just wasting my
time, and this port is just a curiosity ?
I have noticed that several of the resource agents are very Linux oriented,
for example, requiring the ip command, and some of the very basic
clustering logic seem to depend on things like systemd.
So far I have discovered that you have to use VNET jail and I have had to
add:
allow.mlock = 1;
sysvmsg = new;
sysvsem = new;
sysvshm = new;
As well as this to corosync:
system {
qb_ipc_type: shm
sched_rr: no
stonith-enabled: false
}
Not sure if there are other things I haven't noticed because even though I
finally got the cluster to run, the promotion and demotion seems very
unstable still.
Also, I cannot get rid of these warnings in every command:
WARNING: could not get the pacemaker version, bad installation?
WARNING: list index out of range
I am happy to continue the calvary if it's worthwhile and there are other
people using and/or interested in this, but the lack of information seems
to suggest that maybe this is just a waste of time, and these tools are
nowhere near a usable state without heavy lifting.
If the latter is the case, are there any other stable HA/Clustering
solutions that are mature for FBSD+Jails, and that include resource
managers such as databases (namely Pg and MariaDB) and floating IPs ?
This is the environment:
FreeBSD 14.0-RELEASE
Bastille: 0.10.20231125
Pacemaker 2.1.6
Corosync 3.1.7
Many thanks in advance, for any pointers or comments.
--
Alex
--00000000000008889e061647515e
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div>Hello,</div><div><br></div>Are these cluster tools ac=
tually usable on FBSD and in Jails?<div><br></div><div>I got a 3 way Postgr=
eSQL cluster with floating IPs to _mostly_ work across 3 Bastille-based jai=
ls but the whole process has been very painful, so I'm wondering if thi=
s stuff is actually usable on FBSD or am I just wasting my time, and this p=
ort is just a curiosity ?<br></div><div><br></div><div>I have noticed that =
several of the resource agents are very Linux oriented, for example, requir=
ing the ip command, and some of the very basic clustering logic seem=C2=A0t=
o depend on things like systemd.<br></div><div><div></div></div><div><br></=
div><div>So far I have discovered that you have to use VNET jail and I have=
had to add:</div><div><br></div><div>allow.mlock =3D 1;</div><div>sysvmsg =
=3D new;<br>sysvsem =3D new;<br>sysvshm =3D new;<br></div><div><br></div><d=
iv>As well as this to corosync:</div><div>system {<br>=C2=A0 =C2=A0 =C2=A0 =
=C2=A0qb_ipc_type: shm<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0sched_rr: no<br>=C2=A0=
=C2=A0 =C2=A0 =C2=A0stonith-enabled: false<br>}<br><div><br></div><div>Not=
sure if there are other things I haven't noticed because even though I=
finally got the cluster to run, the promotion and demotion seems very unst=
able still.</div><div><br></div><div>Also, I cannot get rid of these warnin=
gs in every command:</div><div>WARNING: could not get the pacemaker version=
, bad installation?<br>WARNING: list index out of range<br></div><div><br><=
/div><div><div>I am happy to continue the calvary if it's worthwhile an=
d there are other people using and/or interested in this, but the lack of i=
nformation seems to suggest that maybe this is just a waste of time, and th=
ese tools are nowhere near a usable state without heavy lifting.<br></div><=
div><br></div><div>If the latter is the case, are there any other stable HA=
/Clustering solutions that are mature for FBSD+Jails, and that include reso=
urce managers such as databases (namely Pg and MariaDB) and floating IPs ?<=
/div><div><br></div><div>This is the environment:</div><div><div>FreeBSD 14=
.0-RELEASE</div><div>Bastille:=C2=A00.10.20231125<br></div><div>Pacemaker 2=
.1.6<br></div><div>Corosync=C2=A03.1.7</div></div><div><br></div><div>Many =
thanks in advance, for any pointers or comments.</div><div><br></div><div>-=
-=C2=A0</div><div>Alex</div><div><br></div><div><br></div><div><br></div><d=
iv><br></div><div></div></div></div></div>
--00000000000008889e061647515e--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAHieY7Q=Gpob2Ss%2Bh90UzCPO7hxGbMf8JqySQhYJERKY8xR%2Bww>