From owner-freebsd-stable@FreeBSD.ORG Tue Apr 9 14:58:21 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 5C30C3B5 for ; Tue, 9 Apr 2013 14:58:21 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-wg0-f44.google.com (mail-wg0-f44.google.com [74.125.82.44]) by mx1.freebsd.org (Postfix) with ESMTP id ED202FA7 for ; Tue, 9 Apr 2013 14:58:20 +0000 (UTC) Received: by mail-wg0-f44.google.com with SMTP id z11so311665wgg.11 for ; Tue, 09 Apr 2013 07:58:14 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:x-originating-ip:in-reply-to:references :date:message-id:subject:from:to:content-type:x-gm-message-state; bh=3D8BHbjFuXuoQwDgfnnYiJ1+wsoLTQuAfTOJPZ4KWGk=; b=E0hD/rtZB4P3gWReoTGJrq9cHt3c6zNnTrL2bfUgTTZ3FS5yXgjinQqaet11DurUjR 4n5CzvAOkS8MX8+7YNVMEGiuZb0Oek8lI2zZU/Yn7lauReDXsIzi5BPz8Det24kSHuJi RNY23cL+rwYinqXjrw5WNtJVhgAyU+bIaLjPuhKwvdZEfcjmmionGU/d+P13+sUZtaEl Q9yc+XCKOwHIeNb79qWwRR3FN9NnY1gSfveS7LO84HB7Ab9mPFqZQ09ElE8Sp8x7G7ZG OK+9hGOr7ecY0vP6FMesB6DK87j6LKbJQWkBHAuwFJfEB3go9wK2wzWtQgB2Im+mkdSI IT+A== MIME-Version: 1.0 X-Received: by 10.180.189.17 with SMTP id ge17mr20471607wic.17.1365519494124; Tue, 09 Apr 2013 07:58:14 -0700 (PDT) Received: by 10.216.194.196 with HTTP; Tue, 9 Apr 2013 07:58:14 -0700 (PDT) X-Originating-IP: [209.66.78.50] In-Reply-To: <5FD2125C-678B-4DCB-B9ED-33C0D3AB2B81@longcount.org> References: <5163F4D4.1090505@rdtc.ru> <5FD2125C-678B-4DCB-B9ED-33C0D3AB2B81@longcount.org> Date: Tue, 9 Apr 2013 10:58:14 -0400 Message-ID: Subject: Re: Release ISO images have broken RockRidge data From: Mark Saad To: FreeBSD Stable Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQnH+tZakOOcO0VirYullMnGkbjLzT65Ebn8sHJhl941nkg/4REBOmeSqpWGfETC0rXXOZ1c X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Apr 2013 14:58:21 -0000 On Tue, Apr 9, 2013 at 9:21 AM, Mark Saad wrote: > > > On Apr 9, 2013, at 7:00 AM, Eugene Grosbein wrote: > >> Hi! >> >> Release ISO images located at ftp://ftp.freebsd.org/pub/FreeBSD/releases/amd64/ISO-IMAGES/ >> were generated with mkisofs until switch to makefs. For example, >> ftp://ftp.freebsd.org/pub/FreeBSD/releases/amd64/ISO-IMAGES/8.2/FreeBSD-8.2-RELEASE-amd64-livefs.iso >> was generated with mkisofs and has correct RockRidge extended attributes. >> >> # isoinfo -d -R -i FreeBSD-8.2-RELEASE-amd64-livefs.iso >> System id: FreeBSD >> Volume id: FreeBSD_LiveFS >> Volume set id: >> Publisher id: The FreeBSD Project. http://www.freebsd.org/ >> Data preparer id: >> Application id: MKISOFS ISO 9660/HFS FILESYSTEM BUILDER & CDRECORD CD-R/DVD CREATOR (C) 1993 E.YOUNGDALE (C) 1997 J.PEARSON/J.SCHILLING >> Copyright File id: >> Abstract File id: >> Bibliographic File id: >> Rock Ridge signatures version 1 found >> Rock Ridge id 'RRIP_1991A' >> Eltorito validation header: >> Hid 1 >> Bootid 88 (bootable) >> >> This image may be unrolled correctly with respect to hardlinks using xorriso command from ports: >> >> # xorriso -for_backup -load volid \* -indev ../FreeBSD-8.2-RELEASE-amd64-livefs.iso -osirrox on -- -extract / livefs -rollback_end >> >> Newer images (8.3 and later) were generated using makefs that seem to produce incorrect RockRidge data: >> >> # isoinfo -d -R -i FreeBSD-8.4-BETA1-amd64-livefs.iso | grep id >> System id: NetBSD >> Volume id: FREEBSD_LIVEFS >> Volume set id: >> Publisher id: >> Data preparer id: >> Application id: >> Copyright File id: >> Abstract File id: >> Bibliographic File id: >> Rock Ridge signatures version 1 found >> Rock Ridge id 'IEEE_P1282' >> Eltorito validation header: >> Hid 1 >> Bootid 88 (bootable) >> >> Same xorriso command produces tons of following error messages and unrolls the image >> without respect to hardlinkg increasing size in nearly 3 times: >> >> libisofs: WARNING : Invalid TF entry >> Caused by: Wrong or damaged RR entry >> >> bsdtar from 8.3-STABLE shows lots of errors too, while extracting FreeBSD-8.4-BETA1-amd64-livefs.iso >> mdconfig breaks hardlinks too. >> >> Is it possible to unroll this image respecting hardlinks? >> >> Eugene Grosbein >> > > While not the same you can always do this > > mdconfig -a -t vnode -f yourfreebsd-version.iso > > mount -t cd9660 /dev/md0 /cdrom > > Then use pax, cpio , cp, rsync etc to copy the data off the image . > > Also if memory serves me right libarchive may be able to unpack an iso much like a tar or cpio archive . Double check that . > > Also makefs was imported from netbsd I would see if netbsd's isos have the same issues . > > Hope this helps > --- > Mark saad | mark.saad@longcount.org > So I did some testing and NetBSD's isos, which are generated much the same way as FreeBSD's , have the same issue . # xorriso -for_backup -load volid \* -indev ../NetBSD-6.1_RC2-amd64.iso -osirrox on -- -extract / netbsd -rollback_en ....... libisofs: NOTE : > Caused by: Wrong or damaged RR entry libisofs: WARNING : Invalid TF entry libisofs: NOTE : > Caused by: Wrong or damaged RR entry libisofs: WARNING : Invalid TF entry libisofs: NOTE : > Caused by: Wrong or damaged RR entry xorriso : UPDATE : 2004 nodes read in 1 seconds libisofs: WARNING : Found hidden El-Torito image. Its size could not be figure out, so image modify or boot image patching may lead to bad results. xorriso : NOTE : Detected El-Torito boot information which currently is set to be discarded Drive current: -indev '../NetBSD-6.1_RC2-amd64.iso' Media current: stdio file, overwriteable Media status : is written , is appendable Boot record : El Torito Media summary: 1 session, 169279 data blocks, 331m data, 194g free Volume id : 'NETBSD_61_RC2' Copying of file objects from ISO image to disk filesystem is: Enabled xorriso : UPDATE : 16 files restored ( 97911k) in 1 seconds , 63.7xD xorriso : UPDATE : 22 files restored ( 173.5m) in 2 seconds , 52.2xD xorriso : UPDATE : 30 files restored ( 252.6m) in 3 seconds , 53.3xD xorriso : UPDATE : 458 files restored ( 297.2m) in 4 seconds , 33.8xD xorriso : UPDATE : 1486 files restored ( 328.4m) in 5 seconds = 50.0xD Extracted from ISO image: file '/'='/opt/home/XXXX/Storage/extract/netbsd' Also for what its worth, tar does work at extracting an iso as well # tar -zxvf ../FreeBSD-7.4-RELEASE-i386-disc1.iso -C out x . x 7.4-RELEASE x 7.4-RELEASE/base x 7.4-RELEASE/catpages x 7.4-RELEASE/manpages x 7.4-RELEASE/games x 7.4-RELEASE/proflibs x 7.4-RELEASE/dict x 7.4-RELEASE/info x 7.4-RELEASE/doc x 7.4-RELEASE/kernels x 7.4-RELEASE/ports x 7.4-RELEASE/src x floppies x boot x boot/zfs x boot/firmware x boot/kernel x boot/modules x boot/defaults x packages x packages/All x packages/converters x packages/devel x packages/gnome x packages/emulators x packages/linux ...... So , what issues does this cause ? Have your filed a pr with FreeBSD or NetBSD ? -- mark saad | nonesuch@longcount.org