Date: Tue, 03 Oct 2023 18:24:36 +0200 From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= <des@FreeBSD.org> To: freebsd-current@freebsd.org Subject: Re: something magic about the size of a ports tree Message-ID: <86y1gjhdx7.fsf@ltc.des.no> In-Reply-To: <ZRw8x58bxtp26A8e@c720-1400094.fritz.box> (Matthias Apitz's message of "Tue, 3 Oct 2023 18:09:43 %2B0200") References: <ZRw8x58bxtp26A8e@c720-1400094.fritz.box>
next in thread | previous in thread | raw e-mail | index | archive | help
Matthias Apitz <guru@unixarea.de> writes: > I have on my poudriere build host a ports tree and wanted to move it to > the host where the resulting packages are installed: > > root@jet:/usr/local/poudriere/ports # du -sh ports20230806 > 397M ports20230806 > root@jet:/usr/local/poudriere/ports # tar cf p.tar ports20230806 > root@jet:/usr/local/poudriere/ports # ls -lh p.tar > -rw-r--r-- 1 root wheel 672M Oct 3 18:00 p.tar > > already the size of the tar file is somewhat magic; but if you un-tar it > on the other host I will get: > > [guru@c720-1400094 ~]$ ls -lh p.tar > -rw-r--r-- 1 guru wheel 672M 3 oct. 18:00 p.tar > [guru@c720-1400094 ~]$ tar xf p.tar > [guru@c720-1400094 ~]$ du -sh ports20230806 > 1,2G ports20230806 > > How this is possible? Most files in the ports tree are very small. On disk, each file gets rounded up to the nearest multiple of the filesystem block size, which could be as small as 512 bytes or as large as 8 kB (or even more in pathological cases). In a tarball, they get rounded up to the nearest multiple of 512 bytes plus an additional 512 bytes per file for metadata. For instance, your average distinfo file (of which there are 30k in the ports tree) is only 200-250 bytes long, but it occupies 512 bytes on an FFS filesystem, 1 kB in a tarball, and 4 kB on a typical ZFS filesystem. Note that if the target system is FreeBSD 14 or newer, you can simply mount the tarball (`sudo mount -rt tarfs p.tar /usr/ports`). DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?86y1gjhdx7.fsf>