From owner-freebsd-ports@freebsd.org Mon Oct 17 13:52:13 2016 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 50EA8C12FD9 for ; Mon, 17 Oct 2016 13:52:13 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qt0-f173.google.com (mail-qt0-f173.google.com [209.85.216.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 10B44881; Mon, 17 Oct 2016 13:52:12 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qt0-f173.google.com with SMTP id q7so122000635qtq.1; Mon, 17 Oct 2016 06:52:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=AvhTR7sj5Clu0Ebo3n1L7GjQP1xBBaIvmPg+D/8DcKI=; b=Bgfwf1eeZTRv4/lb5hK2JI1uU88/dBVDL0G3Rp9b6y5mA1xz22qfrwdvA3ASfgyMVR 7r3Kf1d9JqyAnziVAzVMmN6nypC5PJqR0bo+cjEapi+Yiamo8iw8DSrBLl8G0NIuLzRB FW6Pa6bw/A2orJ8G35VTgpK25whf3d0Ly3Rn7xd6l30y1mZ8XmVKO1X4227EXXQ5I6lz IxOW+GDgfESgLiriP63QCa4kbXPAYLX8FZ7HUkyw6wJb3C4NoO2pYlCaHcerCOetKZE8 u1GZ4on4lHCTj/tmzU8npiTUlWzqFnYzxcyxSF2bFHQqMK6S37MX1o5nzy+wFmoQCfmn Wx1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=AvhTR7sj5Clu0Ebo3n1L7GjQP1xBBaIvmPg+D/8DcKI=; b=k6sBz7KJiRDOriKx9MrtpQKtU2B30n04k1KnWYyNmcV61NrlxJ6ji7qZiturIn0CcY 9xZS/7VcOPX9Rq4O2DTRSUVFYROXqtIK+IumlhM+syqjd1Vc1gvticYbAsw8mlg6BoyY 1xQE6FIS60Hku4ViTuUz9DBbwMYnwJUCXf+XdPsm/ZxRF3lcPrKwg+Xeg2Bk8WwYHHmW WR5N3QWK16p5XTRmPxL3IwTQzlb4/TUUPsEt/JsiOFLIgT83yl0X9bedF+yasC2SW22B 3NglLqnS61Y/k9EqqQe3MPK5CK+Wah2uVXS08c7lIAdHyRqEwphJv3hv/0x7N9qZcqXN 6LHw== X-Gm-Message-State: AA6/9RmWoDC0Fw2zghA/1FWSlQjlH+YCk+teyl1zTbc28hNSlDH2dd7LHUPavBjv3HeU/vxJ7a976ufb6QBO+g== X-Received: by 10.237.53.42 with SMTP id a39mr25676672qte.4.1476712265778; Mon, 17 Oct 2016 06:51:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.149.53 with HTTP; Mon, 17 Oct 2016 06:51:05 -0700 (PDT) Received: by 10.12.149.53 with HTTP; Mon, 17 Oct 2016 06:51:05 -0700 (PDT) In-Reply-To: <20161017082117.GO65573@e-new.0x20.net> References: <0F5C36816EB64D09B42932E21FBC6269@RIVENDELL> <20161016224631.GK20041@eureka.lemis.com> <20161017082117.GO65573@e-new.0x20.net> From: Freddie Cash Date: Mon, 17 Oct 2016 06:51:05 -0700 Message-ID: Subject: Re: Alternatives to rsync To: Lars Engels Cc: freebsd-ports , "Greg 'groggy' Lehey" , reko.turja@liukuma.net Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Oct 2016 13:52:13 -0000 On Oct 17, 2016 1:21 AM, "Lars Engels" wrote: > > On Mon, Oct 17, 2016 at 09:46:31AM +1100, Greg 'groggy' Lehey wrote: > > On Friday, 14 October 2016 at 8:01:51 +0300, reko.turja--- via freebsd-ports wrote: > > > > > > Greg, I've actually put some thought in making a local port of > > > rsync2. I've done some research on it and it seems to be fairly > > > usable and security patched still. > > > > Even simpler, use the old version of the current rsync port. Check > > out with svn, which (svn log) can also tell you when the last rsync 2 > > version was. > > rsync 2 has a different algorithm for checking if a file changed. The > new one is much faster. Rsync 2 also spent a long time building a list of changes files first, before transferring any data. Rsync 3 starts building the file list, then starts transferring data while it continues to build the file list. This drops the total time spent by a large factor. Our backup times dropped by about an hour per server switching from 2 to 3. Something else to consider when looking at resurrecting version 2.