From owner-freebsd-hackers@FreeBSD.ORG  Mon Oct  8 10:22:09 2012
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id 5779A1065673
	for <freebsd-hackers@freebsd.org>; Mon,  8 Oct 2012 10:22:09 +0000 (UTC)
	(envelope-from wojtek@wojtek.tensor.gdynia.pl)
Received: from wojtek.tensor.gdynia.pl (wojtek.tensor.gdynia.pl [89.206.35.99])
	by mx1.freebsd.org (Postfix) with ESMTP id AA82F8FC12
	for <freebsd-hackers@freebsd.org>; Mon,  8 Oct 2012 10:22:08 +0000 (UTC)
Received: from wojtek.tensor.gdynia.pl (localhost [127.0.0.1])
	by wojtek.tensor.gdynia.pl (8.14.5/8.14.5) with ESMTP id q98ALxHI004680;
	Mon, 8 Oct 2012 12:21:59 +0200 (CEST)
	(envelope-from wojtek@wojtek.tensor.gdynia.pl)
Received: from localhost (wojtek@localhost)
	by wojtek.tensor.gdynia.pl (8.14.5/8.14.5/Submit) with ESMTP id
	q98ALx0w004677; Mon, 8 Oct 2012 12:21:59 +0200 (CEST)
	(envelope-from wojtek@wojtek.tensor.gdynia.pl)
Date: Mon, 8 Oct 2012 12:21:59 +0200 (CEST)
From: Wojciech Puchar <wojtek@wojtek.tensor.gdynia.pl>
To: Peter Pentchev <roam@ringlet.net>
In-Reply-To: <20121008083814.GA5830@straylight.m.ringlet.net>
Message-ID: <alpine.BSF.2.00.1210081219300.4673@wojtek.tensor.gdynia.pl>
References: <5069C9FC.6020400@brandonfa.lk>
	<alpine.BSF.2.00.1210071859430.15957@wojtek.tensor.gdynia.pl>
	<324B736D-8961-4E44-A212-2ECF3E60F2A0@kientzle.com>
	<alpine.BSF.2.00.1210080838170.3664@wojtek.tensor.gdynia.pl>
	<20121008083814.GA5830@straylight.m.ringlet.net>
User-Agent: Alpine 2.00 (BSF 1167 2008-08-23)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7
	(wojtek.tensor.gdynia.pl [127.0.0.1]);
	Mon, 08 Oct 2012 12:21:59 +0200 (CEST)
Cc: freebsd-hackers@freebsd.org, Brandon Falk <bfalk_bsd@brandonfa.lk>
Subject: Re: SMP Version of tar
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
	<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>, 
	<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
	<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Oct 2012 10:22:09 -0000

> Not necessarily.  If I understand correctly what Tim means, he's talking
> about an in-memory compression of several blocks by several separate
> threads, and then - after all the threads have compressed their

but gzip format is single stream. dictionary IMHO is not reset every X 
kilobytes.

parallel gzip is possible but not with same data format.


By the way in my opinion grzip (in ports/archivers/grzip) is one of the 
most under-valued software. almost unknown. compresses faster than bzip2, 
with better results, it is very simple and making parallel version is 
trivial - there is just a procedure to compress single block.

Personally i use gzip for fast compression and grzip for strong 
compression, and don't use bzip2 at all