Date: Tue, 11 May 2010 21:31:25 +0200 From: Alexey Shuvaev <shuvaev@physik.uni-wuerzburg.de> To: freebsd-current@freebsd.org Subject: Addition of lzma/xz compression to HEAD Message-ID: <20100511193125.GA59928@wep4035.physik.uni-wuerzburg.de>
next in thread | raw e-mail | index | archive | help
Hello! Just FYI: noticed addition of lzma directory to BSD.include.dist mtree file. Well, now it seems to work! /* Test file size 264 MiB */ [wep4035] ~> ll /usr/local/tinderbox/jails/9-amd64/9-amd64.tar -rw-r--r-- 1 root wheel 277209600 Apr 20 20:58 /usr/local/tinderbox/jails/9-amd64/9-amd64.tar /* Cache file in memory */ [wep4035] ~> cat /usr/local/tinderbox/jails/9-amd64/9-amd64.tar > /dev/null /* 30 seconds to gzip it */ [wep4035] ~> time tar -cvzf 9-amd64.tar.tar.gz /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 30.043u 0.541s 0:15.32 199.6% 37+2093k 0+747io 0pf+0w /* 64 seconds to bzip2 it */ [wep4035] ~> time tar -cvjf 9-amd64.tar.tar.bz2 /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 63.454u 0.686s 0:32.09 199.8% 37+2108k 0+650io 1pf+0w /* And 140 seconds to xz it */ [wep4035] ~> time tar -cvJf 9-amd64.tar.tar.xz /usr/local/tinderbox/jails/9-amd64/9-amd64.tar tar: Removing leading '/' from member names a usr/local/tinderbox/jails/9-amd64/9-amd64.tar 277.625u 0.857s 2:19.26 199.9% 37+2092k 0+432io 0pf+0w /* Resulting sizes :)))) */ [wep4035] ~> ll 9-amd64.tar.tar.* -rw-r--r-- 1 lexx lexx 84830128 May 11 21:07 9-amd64.tar.tar.bz2 -rw-r--r-- 1 lexx lexx 97667581 May 11 21:07 9-amd64.tar.tar.gz -rw-r--r-- 1 lexx lexx 56366908 May 11 21:10 9-amd64.tar.tar.xz /* 3.5 seconds to gunzip the file (mostly IO-limited) */ [wep4035] ~> cat 9-amd64.tar.tar.gz > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.gz x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 2.721u 0.747s 0:03.54 97.7% 42+2365k 3+2116io 0pf+0w [wep4035] ~> rm -R usr/ /* 18 seconds to bunzip2 it */ [wep4035] ~> cat 9-amd64.tar.tar.bz2 > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.bz2 x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 18.136u 0.999s 0:09.59 199.3% 37+2110k 1+2116io 0pf+0w [wep4035] ~> rm -R usr/ /* And only 10 seconds to xzdec it */ [wep4035] ~> cat 9-amd64.tar.tar.xz > /dev/null [wep4035] ~> time tar -xvf 9-amd64.tar.tar.xz x usr/local/tinderbox/jails/9-amd64/9-amd64.tar 10.304u 0.771s 0:05.59 198.0% 38+2164k 3+2116io 0pf+0w [wep4035] ~> rm -R usr/ Thanks to all involved in bringing it to HEAD! Alexey. P.S. I'm not claiming any statistical validity of provided timings nor that the testing procedure is correct. It is just to show that tar in HEAD now works with lzma/xz compression.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100511193125.GA59928>