From owner-freebsd-current@FreeBSD.ORG Tue May 11 19:31:39 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C72071065673 for ; Tue, 11 May 2010 19:31:39 +0000 (UTC) (envelope-from shuvaev@physik.uni-wuerzburg.de) Received: from mailrelay.rz.uni-wuerzburg.de (mailrelay.rz.uni-wuerzburg.de [132.187.3.28]) by mx1.freebsd.org (Postfix) with ESMTP id 48ED28FC1F for ; Tue, 11 May 2010 19:31:39 +0000 (UTC) Received: from virusscan.mail (localhost [127.0.0.1]) by mailrelay.mail (Postfix) with ESMTP id 2611621A73 for ; Tue, 11 May 2010 21:31:27 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by virusscan.mail (Postfix) with ESMTP id 1F75749093 for ; Tue, 11 May 2010 21:31:27 +0200 (CEST) X-Virus-Scanned: by amavisd-new at uni-wuerzburg.de Received: from mail.physik.uni-wuerzburg.de (wthp192.physik.uni-wuerzburg.de [132.187.40.192]) by mailmaster.uni-wuerzburg.de (Postfix) with ESMTP id EFB265CFEB for ; Tue, 11 May 2010 21:31:26 +0200 (CEST) Received: from wep4035 ([132.187.37.35]) by mail.physik.uni-wuerzburg.de (Lotus Domino Release 8.5.1FP2HF71) with ESMTP id 2010051121312537-63123 ; Tue, 11 May 2010 21:31:25 +0200 Received: by wep4035 (sSMTP sendmail emulation); Tue, 11 May 2010 21:31:25 +0200 Date: Tue, 11 May 2010 21:31:25 +0200 From: Alexey Shuvaev To: freebsd-current@freebsd.org Message-ID: <20100511193125.GA59928@wep4035.physik.uni-wuerzburg.de> MIME-Version: 1.0 Organization: Universitaet Wuerzburg User-Agent: Mutt/1.5.20 (2009-06-14) X-MIMETrack: Itemize by SMTP Server on domino1/uni-wuerzburg(Release 8.5.1FP2HF71 | April 5, 2010) at 05/11/2010 09:31:26 PM, Serialize by Router on domino1/uni-wuerzburg(Release 8.5.1FP2HF71 | April 5, 2010) at 05/11/2010 09:31:26 PM, Serialize complete at 05/11/2010 09:31:26 PM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Subject: Addition of lzma/xz compression to HEAD X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 May 2010 19:31:40 -0000 Hello! Just FYI: noticed addition of lzma directory to BSD.include.dist mtree file. Well, now it seems to work! /* Test file size 264 MiB */ [wep4035] ~> ll /usr/local/tinderbox/jails/9-amd64/9-amd64.tar -rw-r--r-- 1 root wheel 277209600 Apr 20 20:58 /usr/local/tinderbox/jails/9-amd64/9-amd64.tar /* Cache file in memory */ [wep4035] ~> cat /usr/local/tinderbox/jails/9-amd64/9-amd64.tar > /dev/null /* 30 seconds to gzip it */ [wep4035] ~> time tar -cvzf 9-amd64.tar.tar.gz /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 30.043u 0.541s 0:15.32 199.6% 37+2093k 0+747io 0pf+0w /* 64 seconds to bzip2 it */ [wep4035] ~> time tar -cvjf 9-amd64.tar.tar.bz2 /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 63.454u 0.686s 0:32.09 199.8% 37+2108k 0+650io 1pf+0w /* And 140 seconds to xz it */ [wep4035] ~> time tar -cvJf 9-amd64.tar.tar.xz /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 277.625u 0.857s 2:19.26 199.9% 37+2092k 0+432io 0pf+0w /* Resulting sizes :)))) */ [wep4035] ~> ll 9-amd64.tar.tar.* -rw-r--r-- 1 lexx lexx 84830128 May 11 21:07 9-amd64.tar.tar.bz2 -rw-r--r-- 1 lexx lexx 97667581 May 11 21:07 9-amd64.tar.tar.gz -rw-r--r-- 1 lexx lexx 56366908 May 11 21:10 9-amd64.tar.tar.xz /* 3.5 seconds to gunzip the file (mostly IO-limited) */ [wep4035] ~> cat 9-amd64.tar.tar.gz > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.gz x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 2.721u 0.747s 0:03.54 97.7% 42+2365k 3+2116io 0pf+0w [wep4035] ~> rm -R usr/ /* 18 seconds to bunzip2 it */ [wep4035] ~> cat 9-amd64.tar.tar.bz2 > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.bz2 x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 18.136u 0.999s 0:09.59 199.3% 37+2110k 1+2116io 0pf+0w [wep4035] ~> rm -R usr/ /* And only 10 seconds to xzdec it */ [wep4035] ~> cat 9-amd64.tar.tar.xz > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.xz x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 10.304u 0.771s 0:05.59 198.0% 38+2164k 3+2116io 0pf+0w [wep4035] ~> rm -R usr/ Thanks to all involved in bringing it to HEAD! Alexey. P.S. I'm not claiming any statistical validity of provided timings nor that the testing procedure is correct. It is just to show that tar in HEAD now works with lzma/xz compression.