From owner-freebsd-stable@FreeBSD.ORG Mon Mar 28 14:31:16 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B77B9106564A for ; Mon, 28 Mar 2011 14:31:16 +0000 (UTC) (envelope-from jhellenthal@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 654E38FC0C for ; Mon, 28 Mar 2011 14:31:16 +0000 (UTC) Received: by iwn33 with SMTP id 33so4552924iwn.13 for ; Mon, 28 Mar 2011 07:31:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:sender:date:from:to:cc:subject:in-reply-to :message-id:references:user-agent:x-openpgp-key-id :x-openpgp-key-fingerprint:mime-version:content-type; bh=GmJjFzWnsUJ5WUybe5dkksWg4HRxgpI3VHk7KP7Tfys=; b=rsFSTlTWiziabrDgHfvg0rSM3FkWiBaLOsj1E5clRTDSNbuuerfBewDIxpSbeRpRVS 6zJYKmKIs3TqkmIoA0icfOQoN6RImAkOeIDv3msJJS+TDclvpym/hG0eHl+HUTlswKy0 IFIitjBdGL++IA28FJe8R9cJsnFNkQkEXQCNE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:date:from:to:cc:subject:in-reply-to:message-id:references :user-agent:x-openpgp-key-id:x-openpgp-key-fingerprint:mime-version :content-type; b=mXtMzwStFEYXLOxuqrANstllrM/GoyJOCBRUM5tWTQDZmME5QPcy4bLo/zZGmDvbcr XdeyA/McisgFs+Ef4DLtckRfcfLmnzIX3Y4u7rqIgX9unIfCiU3iyHPknKniiUYorKGl /SscDwo98Xvct8Ou+KbaNLmFw0M0mw8ipwIL8= Received: by 10.43.64.132 with SMTP id xi4mr6911027icb.165.1301322674321; Mon, 28 Mar 2011 07:31:14 -0700 (PDT) Received: from disbatch.dataix.local (adsl-99-181-153-110.dsl.klmzmi.sbcglobal.net [99.181.153.110]) by mx.google.com with ESMTPS id hc41sm1437406ibb.64.2011.03.28.07.31.11 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 28 Mar 2011 07:31:12 -0700 (PDT) Sender: "J. Hellenthal" Date: Mon, 28 Mar 2011 10:30:59 -0400 From: "J. Hellenthal" To: Lev Serebryakov In-Reply-To: <895726715.20110328112007@serebryakov.spb.ru> Message-ID: References: <895726715.20110328112007@serebryakov.spb.ru> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) X-OpenPGP-Key-Id: 0x89D8547E X-OpenPGP-Key-Fingerprint: 85EF E26B 07BB 3777 76BE B12A 9057 8789 89D8 547E MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Backup tool fot ZFS with all "classic dump(8)" fetatures -- what should I use? (or is here any way to make dump -L works well on large FFS2+SU?) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Mar 2011 14:31:16 -0000 On Mon, 28 Mar 2011 03:20, lev@ wrote: > Hello, Freebsd-stable. > > Now I'm backing up my HOME filesystem with dump(8). It works > perfectly for 80GiB FS with many features: snapshot for consistency, > levels, "nodump" flag (my users use it a lot!), ability to extract > only one removed file from backup without restoring full FS, simple > sctipy wrap-up for levels schedule, etc. > > On new server I have huge HOME (500GiB). And even if it is filled > up only with 25GiB of data, creating snapshot takes about 10 minutes, > freeze all I/O, and sometimes FAILS (!!!). > > I'm thinking to transfer GOME filesystem to ZFS. But I can not find > appropriate tools for backing it up. Here is some requirements: > > (1) One-file (one-stream) backup. Not directory mirror. I need to > store it on FTP server and upload with single command. > > (2) Levels & increment backups. Now I have "Monthly (0) - Weekly > (1,2,3) - daily (4,5,6,7,8,9)" scheme. I could afford other schemes, > but if they doesn't store full backup every day and doesn't need full > backup more often than weekly. > > (3) Minimum of local metadata. Storing previous backups locally to > calculate next one is not appropriate solution. "zfs send" needs > previous snapshots for incremental backup, for example. > > (4) Working with snapshot (I think, it is trivial in case of ZFS). > > (5) Backup exclusions should be controlled by users (not super-user) themselves, > like "nodump" flag in case of FFS/dump(8). "zfs send" can not > provide this. I have very responsible users, so full backup > now takes only up to 10GiB when all HOME FS is about 25GiB, so it > is big help when backup is sent over Internet to other host. > > (6) Storing of ALL FS-specific information -- ACLs, etc. > > (7) Free :) > > Is here something like this for ZFS? "zfs send" looks promising, > EXCEPT item (5) and, maybe, (3) :( > > gnu tar looks like everything but (6) :( > There is information all over the place for this. I would suggest that you take the time and go over the required reading to understand ZFS and its concepts before you jump into conclusions. Here is some docs to start with. http://download.oracle.com/docs/cd/E19253-01/819-5461/index.html http://hub.opensolaris.org/bin/view/Community+Group+zfs/faq http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide -- Regards, J. Hellenthal (0x89D8547E) JJH48-ARIN