From owner-freebsd-questions@freebsd.org Sat Jun 22 14:58:49 2019 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C0C1015D664D for ; Sat, 22 Jun 2019 14:58:49 +0000 (UTC) (envelope-from freebsd-lists@gromit.dlib.vt.edu) Received: from gromit.dlib.vt.edu (gromit.dlib.vt.edu [128.173.49.70]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gromit.dlib.vt.edu", Issuer "Chumby Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C2E3780C82 for ; Sat, 22 Jun 2019 14:58:48 +0000 (UTC) (envelope-from freebsd-lists@gromit.dlib.vt.edu) Received: from mather.gromit23.net (c-98-244-101-97.hsd1.va.comcast.net [98.244.101.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gromit.dlib.vt.edu (Postfix) with ESMTPSA id 7D45D1BA; Sat, 22 Jun 2019 10:58:42 -0400 (EDT) Content-Type: text/plain; charset=us-ascii; delsp=yes; format=flowed Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: ZFS replication suggestions From: Paul Mather In-Reply-To: Date: Sat, 22 Jun 2019 10:58:41 -0400 Cc: mike tancsa Content-Transfer-Encoding: 7bit Message-Id: <40958EDD-E330-4071-9145-2AA7A390FC4F@gromit.dlib.vt.edu> References: To: freebsd-questions@freebsd.org X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: C2E3780C82 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dmarc=fail reason="" header.from=vt.edu (policy=none) X-Spamd-Result: default: False [-3.16 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.99)[-0.995,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; IP_SCORE(-0.75)[ip: (-1.90), ipnet: 128.173.0.0/16(-0.95), asn: 1312(-0.85), country: US(-0.06)]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[vt.edu : No valid SPF, No valid DKIM,none]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[chumby.dlib.vt.edu,gromit.dlib.vt.edu]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.91)[-0.905,0]; R_SPF_NA(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[97.101.244.98.zen.spamhaus.org : 127.0.0.10]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:1312, ipnet:128.173.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Jun 2019 14:58:49 -0000 mike tancsa wrote: > I have a new project coming up with replication.? In the past, I have > used various scripts out of ports, but was wondering what people are > using these days to sync their ZFS files systems between servers ?? It > will be about 10-40G in daily diffs.? Would like to send every 5-10 min > or so. Files being slightly out of sync for a short period of time is > not a big deal eg. in case of total failure on one box (e.g both power > supplies die) missing some data for a period of short time is tolerable > > ??? ---Mike I have been using sysutils/zrepl for replicating ZFS filesets from several systems to a backup machine. It is very flexible, supporting several transports; several job types (push, pull, etc.); several pruning options; separate pruning schedules for sending and receiving sides. It is designed to tolerate downtime on both the sending and receiving side. Underlying synchronisation is via ZFS snapshots and ZFS send/recv. It appears to be under active development. A possible downside is that it might be seen as more involved to set up (due to flexibility), but the documentation is good and examples are provided. Cheers, Paul.