From owner-freebsd-stable@FreeBSD.ORG Sun Mar 31 11:29:05 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id CDD4C49C for ; Sun, 31 Mar 2013 11:29:05 +0000 (UTC) (envelope-from markiyan.kushnir@gmail.com) Received: from mail-ea0-x22e.google.com (mail-ea0-x22e.google.com [IPv6:2a00:1450:4013:c01::22e]) by mx1.freebsd.org (Postfix) with ESMTP id 628A089A for ; Sun, 31 Mar 2013 11:29:05 +0000 (UTC) Received: by mail-ea0-f174.google.com with SMTP id m14so737417eaj.33 for ; Sun, 31 Mar 2013 04:29:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=Tl+2q6GmHeKwo9n0Kq8LbtUyxfuuNJJKm+EJr4fO8MI=; b=vEk/l2bfPAbeQ57qQwgxtcdO9d3EGKF1wf/Y3FFykMTlZoSntTV5YHj4oomGSTvo8h IwaAa4NxjbETqX/23vfuV5hHg3uWo7cXKI8PuQEtAPE8tjXbT2aML9btGI5MxDSXL8z4 28q55YjNAas39jvqbYyZyUKnmgDT/3SbdtLSeTqgvGVLrP2RAKbKo2iaAeayduhG4u/O XcNGPD7Oy9sPSOgZIG85x1dIATsRs+ZVg+dvocJMHzKjC+LBd1yErD57YMAXT4SaVu9s HDzQ0ztdcd8AbXlhCYMFggKjJKsV5lnd1oRJOc7ujfdhgA63B0eCNG1NfYlN+5cnPRRX g66A== X-Received: by 10.14.219.129 with SMTP id m1mr26574998eep.16.1364729343791; Sun, 31 Mar 2013 04:29:03 -0700 (PDT) Received: from mkushnir.zapto.org (159-73-132-95.pool.ukrtel.net. [95.132.73.159]) by mx.google.com with ESMTPS id f47sm14989126eep.13.2013.03.31.04.29.02 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 31 Mar 2013 04:29:03 -0700 (PDT) Message-ID: <51581DA8.7040106@gmail.com> Date: Sun, 31 Mar 2013 14:27:36 +0300 From: Markiyan Kushnir User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:16.0) Gecko/20121119 Thunderbird/16.0.2 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Subject: Re: svn - but smaller? References: <513E2DA5.70200@mac.com> <514E7927.2010901@gmail.com> <51580718.1010501@gmail.com> <51580AD1.1070704@gmail.com> In-Reply-To: <51580AD1.1070704@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 31 Mar 2013 11:29:05 -0000 On 31.03.2013 13:07, Markiyan Kushnir wrote: > Hi John, > > I also measured svnup basic process resource usage, attaching a complete > plot (measurements were taken each 2 seconds based on ps(1) and > procstat(1)). Hopefully it will help you as well. > (in case it's not available through the list) https://docs.google.com/file/d/0B9Q-zpUXxqCnRVVMTkk1blVfZzA/edit?usp=sharing -- Markiyan. > -- > Markiyan. > > On 31.03.2013 12:51, Markiyan Kushnir wrote: >> On 25.03.2013 02:55, John Mehr wrote: >>> >>> >>> >>> On Sun, 24 Mar 2013 05:55:19 +0200 >>> Markiyan Kushnir wrote: >>>> Hello John, >>>> >>>> Tested svnup for a while, and I can say it does its job well, and >>>> works basically as I would expect, so thanks for your initiative. >>>> Although it appears to be quite resource greedy. Most of the time it >>>> showed something like: >>>> >>>> PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU >>>> COMMAND >>>> 22270 mkushnir 1 102 0 44944K 31804K CPU0 1 6:22 97.56% >>>> a.out >>>> >>>> >>>> I looked at the source code, and found that it uses svn commands that >>>> are known as the "main command set". The program is implemented around >>>> get-dir and get-file. I think there is significant room for resource >>>> and performance improvement. >>>> >>>> Have you considered an approach to use what svn folks call the editor >>>> command set? I mean acting as a trivial svn client: we might ask the >>>> server to drive our checking out or updating. The server will be >>>> telling us only diffs. Checking out a full tree would be just another >>>> diff, although bigger than usually. We would also benefit from >>>> compression on the wire. >>>> >>>> Another advantage would be to always have consistent repo more-or-less >>>> guaranteed by the svn server. >>>> >>>> I've done some proof of concept recently, and the results look >>>> encouraging to me. For example, a do-nothing update really does >>>> nothing. A two-or-three revisions update takes a couple of seconds. >>>> And a full checkout of the base/stable/9 takes ~7m30s at 530kB/s to me. >>> >>> Hello, >>> >>> The results I was getting from testing out the svn protocol's editor >>> command set were unpleasant enough to put it into the "come back to this >>> later" category while I worked on implementing the http/https side. The >>> good news it that the http side is *much* easier to work with in this >>> respect and getting a report with filenames and MD5/SHA-1 signatures for >>> all of the files in the repository can be obtained all at once. I >>> should have a new and improved version ready to go this weekend or early >>> next week at the latest. >> >> Hi again! >> >> Yes, I agree that svn editor needs quite a bit of effort. I was actually >> encouraged to break this challenge, and made my own svnup based on >> svndiff. If you are interested in details, you may find it on github.com >> under mkushnir/mrksvnup. It's a complete app, although you may use or >> re-use (parts of) it if you want. >> >> I also tested your svnup more and found that it doesn't handle symbolic >> links well. (May be you have already been aware of it.) >> >> I would suggest to test svnup against official svn client. Here is >> briefly what I'm doing to test my own svnup: >> >> # svn co -r NNNNNN svn://svn.freebsd.org/base/head head.svn >> # svnup -u svn://svn.freebsd.org/base/head -r NNNNNN -l head.svnup >> # diff -r head.svnup/ head.svn | egrep -v 'FreeBSD|\-\-\-|^diff >> \-r|^[0-9]+c[0-9]+' >> >> The diff output must be clean. >> >> >> -- >> Markiyan. >> >> >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to >>> "freebsd-stable-unsubscribe@freebsd.org" >> >