From owner-freebsd-current@FreeBSD.ORG  Sun Mar 11 22:22:34 2007
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
X-Original-To: current@freebsd.org
Delivered-To: freebsd-current@FreeBSD.ORG
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id 6FE3A16A401
	for <current@freebsd.org>; Sun, 11 Mar 2007 22:22:34 +0000 (UTC)
	(envelope-from kientzle@freebsd.org)
Received: from kientzle.com (h-66-166-149-50.snvacaid.covad.net
	[66.166.149.50])
	by mx1.freebsd.org (Postfix) with ESMTP id 5294113C448
	for <current@freebsd.org>; Sun, 11 Mar 2007 22:22:34 +0000 (UTC)
	(envelope-from kientzle@freebsd.org)
Received: from [10.0.0.222] (p54.kientzle.com [66.166.149.54])
	by kientzle.com (8.12.9/8.12.9) with ESMTP id l2BMMQ24096128
	for <current@freebsd.org>; Sun, 11 Mar 2007 14:22:30 -0800 (PST)
	(envelope-from kientzle@freebsd.org)
Message-ID: <45F48122.7030309@freebsd.org>
Date: Sun, 11 Mar 2007 15:22:26 -0700
From: Tim Kientzle <kientzle@freebsd.org>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060422
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: current@freebsd.org
References: <200703111036.l2BAaha6031394@repoman.freebsd.org>
	<45F46291.4090209@freebsd.org>
In-Reply-To: <45F46291.4090209@freebsd.org>
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Cc: 
Subject: Bsdtar performance
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>, 
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sun, 11 Mar 2007 22:22:34 -0000

Tim Kientzle wrote:
>> kientzle    2007-03-11 10:36:43 UTC
>>   FreeBSD src repository
>>   bsdtar 2.0.23:
>>      * read.c now relies on security checks in libarchive instead
>>        of trying to do its own...
> 
> Bsdtar should now be considerably faster than before.
> I put a lot of effort over the last few months into
> streamlining the code in libarchive to recreate objects
> on disk.

Here are some initial test results for bsdtar 2.0.22.
This test extracts an uncompressed ustar version of
"base.tgz" from a 5.3 distribution CD to a blank
300MB malloc-backed disk on a single-processor i386 system
with 1G physical RAM.

bsdtar -xPf:  1.53 seconds
gtar-1.13.25: 1.57 seconds
gtar-1.15.1:  1.58 seconds
bsdtar -xf:   1.59 seconds
gtar-1.16.1:  1.61 seconds
star:         1.82 seconds

I used /usr/bin/time <program> -xf ~/base.ustar and
ran each program at least 10 times, discarded the outliers
and averaged the rest.  (The user time varied quite
a bit, interestingly enough.)

Obviously, these results should vary dramatically
depending on the hardware ane the archive being tested
(mix of dirs, small files, large files, etc), so I'm
very eager to see results from other people (especially
any where bsdtar performs poorly).

Tim Kientzle

P.S. to create a ustar version of the 5.3 distribution,
use bsdtar as a format-conversion filter:
cat base.?? | bsdtar -cf ~/base.ustar --format=ustar @-