From owner-freebsd-questions@freebsd.org Sun Oct 3 18:57:07 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0BA1766CF0A for ; Sun, 3 Oct 2021 18:57:07 +0000 (UTC) (envelope-from office@klepp.biz) Received: from vie01a-dmta-at52-2.mx.upcmail.net (vie01a-dmta-at52-2.mx.upcmail.net [62.179.121.143]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HMtPZ1HRZz3sn2 for ; Sun, 3 Oct 2021 18:57:06 +0000 (UTC) (envelope-from office@klepp.biz) Received: from [172.31.216.41] (helo=vie01a-pemc-psmtp-at50) by vie01a-dmta-at52.mx.upcmail.net with esmtp (Exim 4.92) (envelope-from ) id 1mX6fR-00FQuA-VE for freebsd-questions@freebsd.org; Sun, 03 Oct 2021 20:56:57 +0200 Received: from neo.lan ([85.126.97.210]) by vie01a-pemc-psmtp-at50 with SMTP @ mailcloud.upcmail.net id 1Wws2600t4YLlkt0BWwsle; Sun, 03 Oct 2021 20:56:52 +0200 X-SourceIP: 85.126.97.210 X-CNFS-Analysis: v=2.2 cv=O6RJhF1W c=1 sm=2 tr=0 cx=a_idp_f:a_exe a=/Ac8Q0O/YFE5LOLfUiYZVw==:117 a=/Ac8Q0O/YFE5LOLfUiYZVw==:17 a=IkcTkHD0fZMA:10 a=GoSab2XrPUu1muOEGIMA:9 a=QEXdDO2ut3YA:10 From: "Dr. Nikolaus Klepp" To: freebsd-questions@freebsd.org Subject: Re: zfs q regarding backup strategy Date: Sun, 3 Oct 2021 20:56:52 +0200 User-Agent: KMail/1.9.10 References: In-Reply-To: X-KMail-QuotePrefix: > MIME-Version: 1.0 Content-Type: Text/Plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <202110032056.52130.office@klepp.biz> X-Rspamd-Queue-Id: 4HMtPZ1HRZz3sn2 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of office@klepp.biz has no SPF policy when checking 62.179.121.143) smtp.mailfrom=office@klepp.biz X-Spamd-Result: default: False [-0.20 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RWL_MAILSPIKE_POSSIBLE(0.00)[62.179.121.143:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[klepp.biz]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_CONTAINS_FROM(1.00)[]; FROM_NAME_HAS_TITLE(1.00)[dr]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6830, ipnet:62.179.0.0/17, country:NL]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_IN_DNSWL_LOW(-0.10)[62.179.121.143:from] X-Mailman-Approved-At: Sun, 03 Oct 2021 20:05:00 +0000 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Oct 2021 18:57:07 -0000 Anno domini 2021 Sun, 3 Oct 19:45:22 +0100 tech-lists scripsit: > On Sun, Oct 03, 2021 at 02:46:47AM -0700, David Christensen wrote: > >On 10/2/21 16:21, tech-lists wrote: > > > >> OK. if I think I understand correctly then if we need to keep everything > >> then I'll need to keep every incremental snapshot. > > > > > >ZFS is novel and complex. It requires different thinking than > >traditional partitions/ slices, volumes, filesystems, etc.. > > Yep I hear you. Someone else mentioned bacula which keeps track of files > in a database. Maybe thats the path I'll need to go down. > > I'm looking for a recent (say from 2020 on) book about ZFS and OpenZFS > on FreeBSD with some worked examples. The Mastery books which I think > you mentioned earlier, the latest I can find is from 2016 and a lot has > happened to zfs in five years. It's a problem with all technology books > where the technology changes rapidly. > > I'm familiar with zfs for my own use. It's saved data from broken disks > several times. Just unfamiliar in this particilar use case: > > [1] offsite backup over ssh or tls > > [2] *all* changes to live site must be roll-backable [?] from backup, > for all time. If a file disappears from the live site I should be able > to restore it from backup. > > [3] backup must be searchable. Doesn't have to be searchable all the > time, it just has to be if something needs to be restored. > > Basically if the system gets set up, runs for a couple of years say. > Then I get asked to restore the site into the state it was a year and a > half ago. Then three months on from that restore point, restore it somewhere > else like another test system. I need to be able to do that reliably. > > But yeah, in the abscence of a book I really need to do testing. That's waht zfs allows you to do - well, if your disk is big enough to hold all snapshots :) Nik -- Please do not email me anything that you are not comfortable also sharing with the NSA, CIA ...