Date: Tue, 17 May 2016 18:19:54 +0200 From: Palle Girgensohn <girgen@FreeBSD.org> To: Joe Love <joe@getsomewhere.net> Cc: freebsd-fs@freebsd.org, Julian Akehurst <julian@pingpong.net> Subject: Re: Best practice for high availability ZFS pool Message-ID: <7D4449E9-5875-45EB-8559-3B43F2E5E3B0@FreeBSD.org> In-Reply-To: <5DA13472-F575-4D3D-80B7-1BE371237CE5@getsomewhere.net> References: <5E69742D-D2E0-437F-B4A9-A71508C370F9@FreeBSD.org> <5DA13472-F575-4D3D-80B7-1BE371237CE5@getsomewhere.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--Apple-Mail=_7087E43E-6579-48E7-BFA5-610E1B270D42 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > 17 maj 2016 kl. 18:13 skrev Joe Love <joe@getsomewhere.net>: >=20 >=20 >> On May 16, 2016, at 5:08 AM, Palle Girgensohn <girgen@FreeBSD.org> = wrote: >>=20 >> Hi, >>=20 >> We need to set up a ZFS pool with redundance. The main goal is high = availability - uptime. >>=20 >> I can see a few of paths to follow. >>=20 >> 1. HAST + ZFS >>=20 >> 2. Some sort of shared storage, two machines sharing a JBOD box. >>=20 >> 3. ZFS replication (zfs snapshot + zfs send | ssh | zfs receive) >>=20 >> 4. using something else than ZFS, even a different OS if required. >>=20 >> My main concern with HAST+ZFS is performance. Google offer some = insights here, I find mainly unsolved problems. Please share any success = stories or other experiences. >>=20 >> Shared storage still has a single point of failure, the JBOD box. = Apart from that, is there even any support for the kind of storage PCI = cards that support dual head for a storage box? I cannot find any. >>=20 >> We are running with ZFS replication today, but it is just too slow = for the amount of data. >>=20 >> We prefer to keep ZFS as we already have a rather big (~30 TB) pool = and also tools, scripts, backup all is using ZFS, but if there is no = solution using ZFS, we're open to alternatives. Nexenta springs to mind, = but I believe it is using shared storage for redundance, so it does have = single points of failure? >>=20 >> Any other suggestions? Please share your experience. :) >>=20 >> Palle >>=20 >=20 > I don=E2=80=99t know if this falls into the realm of what you want, = but BSDMag just released an issue with an article entitled =E2=80=9CAdding= ZFS to the FreeBSD dual-controller storage concept.=E2=80=9D > https://bsdmag.org/download/reusing_openbsd/ >=20 > My understanding in this setup is that the only single point of = failure for this model is the backplanes that the drives would connect = to. Depending on your controller cards, this could be alleviated by = simply using multiple drive shelves, and only using one drive/shelf as = part of a vdev (then stripe or whatnot over your vdevs). >=20 > It might not be what you=E2=80=99re after, as it=E2=80=99s basically = two systems with their own controllers, with a shared set of drives. = Some expansion from the virtual world to real physical systems will = probably need additional variations. > I think the TrueNAS system (with HA) is setup similar to this, only = without the split between the drives being primarily handled by separate = controllers, but someone with more in-depth knowledge would need to = confirm/deny this. >=20 > -Joe >=20 This is actually very interesting IMO. It is simple and easy to understand. Problem is I didn't find any proper = controller cards for it. I think this is what Nexenta does as well as = TrueNAS, with their HA versions. I'll check out the article, thanks! Palle --Apple-Mail=_7087E43E-6579-48E7-BFA5-610E1B270D42 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBCAAGBQJXO0SrAAoJEDQn0sf36UlsInYIAMPaUZ8Fw5YYy0Zqk3/1JpL0 q4KLG8+iCMuagZWJyarF5EdmEJAw+hEuWRbG8uAH1gr7XS8BEN58QutxI6zKKdVm LSKgpXCxlOQdR3M/fJuE09t+YWepcs+MmAbR8ns5YoceURZU1rXNdjTwGdhqPvk3 PfFVhPX6CiFG3YlqsGcfAKfqVBbhkzmh5bvg7rHGH+TIZDx3qTsOhnW97j86Rr5V rV2Egf6vEOCuJN8GvzQAmE4E7X2+o+kS2EugUtbWCAurmK0/kM3qTC2+7BpQW2vn dgUmXX6wElNSTIOyBzksLMlq7L4fxi0Gdv2p1EOWP1LU9AKDInNMDrfpkogN/Ls= =4d2V -----END PGP SIGNATURE----- --Apple-Mail=_7087E43E-6579-48E7-BFA5-610E1B270D42--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?7D4449E9-5875-45EB-8559-3B43F2E5E3B0>