From owner-freebsd-questions@FreeBSD.ORG Thu Apr 4 21:06:51 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id A8C8E735 for ; Thu, 4 Apr 2013 21:06:51 +0000 (UTC) (envelope-from joar.jegleim@gmail.com) Received: from mail-we0-x229.google.com (mail-we0-x229.google.com [IPv6:2a00:1450:400c:c03::229]) by mx1.freebsd.org (Postfix) with ESMTP id 2B49DD7D for ; Thu, 4 Apr 2013 21:06:51 +0000 (UTC) Received: by mail-we0-f169.google.com with SMTP id x43so2412934wey.0 for ; Thu, 04 Apr 2013 14:06:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=YB/FUMkEMSPwlE1cCI/k+tX2+fMpjeFMvjuXJNT6UA4=; b=q/WwdLf5abcMrXdHbWkyQHBqzg/l7ujpS7W07JwgZbGYLf+zbYIkZ9rGc60KqXMisI GVDRDV31RMk223ATXiJu4fCuFBUu+NU5PMOC4EfiIeWzM1xmWgkwEFgGuwjGBuwhd2ZK st0V4UkTcsWhB4k7kx4yiue6ZXkPKYROlpXQI9HBeaxDw44Z0KuhF9TCLMDrRNMJEb9n gTNC3Pdmv8PlWm9hgTUtFnp+72dyMPW9zAiKr0PZe5aUC/g00wcbXfaSRg/sJpBj7mrw UUqbv6WHIUGUUY5yO8tPH08dHVJIA+Q43VTtfexziTF8ahiYqhWMW3NMVPYWP3TmiNmR KEtQ== MIME-Version: 1.0 X-Received: by 10.194.109.35 with SMTP id hp3mr12126211wjb.15.1365109610176; Thu, 04 Apr 2013 14:06:50 -0700 (PDT) Received: by 10.216.34.9 with HTTP; Thu, 4 Apr 2013 14:06:50 -0700 (PDT) In-Reply-To: References: Date: Thu, 4 Apr 2013 23:06:50 +0200 Message-ID: Subject: Re: Regarding zfs send / receive From: Joar Jegleim To: Terje Elde , freebsd-questions Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Apr 2013 21:06:51 -0000 Hi Terje ! sorry for late reply, I've been checking my mail, forgetting that all my mailing list mail are sorted into their own folders skipping inbox :p the zfs sync setup is a huge advantage over rsync simply because incremental rsync of the volume takes ~12 hours, while the zfs differential snapshot's usually take less than a minute . Though it's only ~1TB of data, it's more than 2 million jpegs which rsync have to stat ... I'm guessing my predecessor who chose this setup, over for instance HAST, didn't feel confident enough regarding HAST in production ( I'm looking into that for a future solution) . There's no legacy stuff on the receiving end, old pools are deleted for every sync. I haven't got my script here but google pointed me too https://github.com/hoopty/zfs-sync/blob/master/zfs-sync which look like a script very similar to the one I'm using . In fact, I'm gonna take a closer look at that script and see what differs from my script (apart from it being much prettier :p ) I didn't know about zpool.cache, gonna check that tomorrow, thanks. -- ---------------------- Joar Jegleim Homepage: http://cosmicb.no Linkedin: http://no.linkedin.com/in/joarjegleim fb: http://www.facebook.com/joar.jegleim AKA: CosmicB @Freenode ---------------------- On 2 April 2013 14:40, Terje Elde wrote: > On 2. apr. 2013, at 13.44, Joar Jegleim wrote: > > So my question(s) to the list would be: > > In my setup have I taken the use case for zfs send / receive too far > > (?) as in, it's not meant for this kind of syncing and this often, so > > there's actually nothing 'wrong'. > > I'm not sure if you've taken it too far, but I'm not entirely sure if > you're getting any advantage over using rsync or similar for this kind of > thing. > > First two things that spring to mind: > > Do you have any legacy stuff on the receiving machine? Things like > physically removed old zpools, that are still in zpool.cache, seems to slow > down various operations, including creation of new stuffs (such as the > snapshots you receive). > > Also, you don't mention if you're deleting old snapshots on the receiving > end? If you're doing an incremental run every 15 minutes, that's something > like 3000 snapshots pr. month, pr. filesystem. > > Terje > >