Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 03 Jul 2013 16:00:25 +0300
From:      Daniel Kalchev <daniel@digsys.bg>
To:        freebsd-fs@freebsd.org
Subject:   Re: EBS snapshot backups from a FreeBSD zfs file system: zpool freeze?
Message-ID:  <51D42069.5060409@digsys.bg>
In-Reply-To: <87ppuz51os.wl%berend@pobox.com>
References:  <87li5o5tz2.wl%berend@pobox.com> <CA%2BtpaK1jQuKneQsxkVfxJGzXdPdLZfqBM1QWQ0e19nK5t71t1Q@mail.gmail.com> <87ehbg5raq.wl%berend@pobox.com> <20130703055047.GA54853@icarus.home.lan> <6488DECC-2455-4E92-B432-C39490D18484@dragondata.com> <CADBaqmihCB5JP01hLwXTWHoZiJJ5-jkT-Ro=oDwOcKZT_zvEKA@mail.gmail.com> <A5A66641-5EF9-454E-A767-009480EE404E@dragondata.com> <14A2336A-969C-4A13-9EFA-C0C42A12039F@hostpoint.ch> <87zju43sxl.wl%berend@pobox.com> <FF386ED5-5E9D-4073-9E67-F835BCF5D816@hostpoint.ch> <87ppuz51os.wl%berend@pobox.com>

next in thread | previous in thread | raw e-mail | index | archive | help

On 03.07.13 14:21, Berend de Boer wrote:
> And after you have done your zfs snapshot, you're not done either! You 
> have to transfer it somewhere, probably compressed, so your (p)bzip2 
> dominates your CPUs, your network bandwidth is gone, etc. 

The idea that was proposed was to create an local ZFS snapshot, that is 
not being sent anywhere. Because the ZFS snapshot is a ZIL commit, it 
can be very fast. Well, how fast, depends on some conditions - I have an 
system that sometimes takes minutes for a snapshot, but .. I am really 
torturing ZFS there.

With the local ZFS snapshot, you then trigger an EBS snapshot of your 
disks. That is more or less identical to your server losing power and 
then coming back -- you only are sure there is a consistent snapshot of 
the filesystem available.

However, whether this suits you or not is another matter. Do you want to 
essentially emulate power loss/restart of the server when you revert to 
use those snapshots? If so, then you are ok. ZFS has you covered. 
Perhaps even without making the snapshot in the first place. But, if you 
want your application data consistent on disk, then temporarily stopping 
the applications is the only safe way -- FreeBSD/ZFS, Linux or what you 
have won't make any difference.

> So a backup starts to becomes a really high impact event, while an EBS 
> snapshot today isn't a big deal. Slightly degraded performance 
> perhaps, but not much.

It seems, Amazon uses some sort of ZFS (volume) snapshots in order to 
implement the functionality of EBS. Why it would take hours to complete 
is hard to understand, perhaps they are actually backing it up somewhere 
too, using ZFS send/receive (or equivalents if they don't use ZFS).

Daniel



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?51D42069.5060409>