From owner-freebsd-current@FreeBSD.ORG Wed Dec 31 10:59:55 2008 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 67EA0106566B; Wed, 31 Dec 2008 10:59:55 +0000 (UTC) (envelope-from simon@benji.nitro.dk) Received: from mx.nitro.dk (zarniwoop.nitro.dk [83.92.207.38]) by mx1.freebsd.org (Postfix) with ESMTP id 1AF448FC08; Wed, 31 Dec 2008 10:59:55 +0000 (UTC) (envelope-from simon@benji.nitro.dk) Received: from benji.nitro.dk (unknown [192.168.3.39]) by mx.nitro.dk (Postfix) with ESMTP id 6D3111E8C07; Wed, 31 Dec 2008 10:59:54 +0000 (UTC) Received: by benji.nitro.dk (Postfix, from userid 2000) id 34959FD12; Wed, 31 Dec 2008 11:59:54 +0100 (CET) Date: Wed, 31 Dec 2008 11:59:53 +0100 From: "Simon L. Nielsen" To: Tim Kientzle Message-ID: <20081231105952.GB964@zaphod.nitro.dk> References: <200812301616.11132.max@love2party.net> <200812302213.07155.max@love2party.net> <20081231094159.GA964@zaphod.nitro.dk> <200812311109.57955.max@love2party.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200812311109.57955.max@love2party.net> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Max Laier , freebsd-current@freebsd.org, cperciva@freebsd.org Subject: tar/libarchive gzip problem [was: portsnap corrupted] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Dec 2008 10:59:55 -0000 Hey Tim, I think one of the recent changes to tar or libarchive broke gzip handling in some cases. See more below. [portsnap extract fails with gzip error] I'm not sure why I didn't run into it in my tests, but I think the problem is in tar / libarchive's handling of gzip files. Taking one random "broken" file [1] it fails with tar's build in decompression, but works using external zcat. [1] http://portsnap1.freebsd.org/f/19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz http://people.freebsd.org/~simon/tmp/19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz Broken system: [simon@eddie:/tmp] tar --version bsdtar 2.5.903a - libarchive 2.5.903a [simon@eddie:/tmp] uname -a FreeBSD eddie.nitro.dk 8.0-CURRENT FreeBSD 8.0-CURRENT #1: Tue Dec 30 22:28:33 CET 2008 simon@eddie.nitro.dk:/FreeBSD/obj/FreeBSD/system-CURRENT/sys/EDDIE i386 [simon@eddie:/tmp] tar tvf 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz > /dev/null tar: Error opening archive: Invalid GZip header (saw 99 at offset 1) [simon@eddie:/tmp] zcat 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz | tar tf - > /dev/null [simon@eddie:/tmp] zcat 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz | sha256 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d OK system: [simon@benji:/tmp] tar --version bsdtar 2.5.5 - libarchive 2.5.5 [simon@benji:/tmp] uname -a FreeBSD benji.s 7.1-RC2 FreeBSD 7.1-RC2 #0: Tue Dec 23 15:18:30 UTC 2008 root@logan.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC i386 [simon@benji:/tmp] tar tvf 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz > /dev/null [simon@benji:/tmp] zcat 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz | sha256 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d Another OK system: [simon@ref8-amd64:files] tar --version bsdtar 2.5.5 - libarchive 2.5.5 [simon@ref8-amd64:files] uname -a FreeBSD ref8-amd64.freebsd.org 8.0-CURRENT FreeBSD 8.0-CURRENT #2 r184542:185402: Fri Nov 28 19:14:40 UTC 2008 peter@ref8-amd64.freebsd.org:/scratch/src/sys/amd64/compile/REF8-AMD64 amd64 [simon@ref8-amd64:files] tar tvf 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz > /dev/null [simon@ref8-amd64:files] zcat 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d.gz | sha256 19faa3b8bd15bb8f4cd9f665a7623887729f3bd834d780e8b069df979f228e8d -- Simon L. Nielsen