Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 13 Mar 2001 10:45:15 -0600
From:      Christopher Farley <chris@northernbrewer.com>
To:        Mike Tancsa <mike@sentex.net>
Cc:        questions@freebsd.org
Subject:   Re: 2GB limit on gzip?
Message-ID:  <20010313104513.A85546@northernbrewer.com>
In-Reply-To: <dd7sat4ke5rqbbc78f3h7ofmj0mguom82n@4ax.com>; from mike@sentex.net on Tue, Mar 13, 2001 at 08:23:34AM -0500
References:  <20010312165812.A82168@northernbrewer.com> <20010312173441.A25752@dan.emsphone.com> <20010312195330.A82645@northernbrewer.com> <20010312213743.A7606@dan.emsphone.com> <20010312223210.A83134@northernbrewer.com> <SEN.984465737.22594891@news.sentex.net> <dd7sat4ke5rqbbc78f3h7ofmj0mguom82n@4ax.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Mike Tancsa (mike@sentex.net) wrote:

> On 13 Mar 2001 01:42:17 -0500, in sentex.lists.freebsd.questions you wrote:
> 
> Does
> which gzip
> which gunzip
> give the same hard linked files ?

Yes. 

> This is a 3.6G file
> 
> b2# md5 dump-c-u2 ;gzip -2 dump-c-u2 ;gzip -d dump-c-u2.gz ; md5 dump-c-u2 
> MD5 (dump-c-u2) = 8cde4cf999407ab959b1355bd62bb94d
> MD5 (dump-c-u2) = 8cde4cf999407ab959b1355bd62bb94d
> b2# 

On *very* large files (4GB), I can not even get the files to
finish decompressing before gunzip returns 'invalid compressed
data--format violated'

On smaller files (100mb - 1gb), gunzip complains of 'invalid compressed
data--crc error', but returns a file of the correct size. If I gunzip
the same .gz file twice, the resulting files have different md5 hashes.

On files between 100 and 500mb, the problem occurs only sporadically.
I've never been able to reproduce this problem on a file under 100mb.

I made world last night, so my gzip/gunzips were built on March 13th.
Because this problem also occurs with bzip2/bunzip2, I know this isn't a
problem with gzip per se. 

I will probably try and compile the GENERIC kernel to see if that
changes anything... I've got another 4.3 BETA machine, but it doesn't
really have the storage capacity to run tests!

-- 
Christopher Farley
www.northernbrewer.com

To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010313104513.A85546>