From nobody Sat Dec 14 01:58:16 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y98W556Y7z5gTR0 for ; Sat, 14 Dec 2024 01:58:25 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y98W53hC9z4QWW; Sat, 14 Dec 2024 01:58:25 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1734141505; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0KtQgwlc75aRGfTr4XmtVI69I2vMpR+CgiTLzNN94jo=; b=e5EzD/L5czx/MEr2N0CWgLReWnO7RX0S3NVeIHGOE/TI538x3g7jiB94wERxEEZIU8CGnK 3zKy7Ho+d9LakPhgI9cq9NmrPsLJowdwVKRy9hL2T/UvH9BUGwtr3wSrwHEZJaYS2BTG0z HrTzQYXHN0RZEY62zp+y8XjGQD98kJAxq1moEBFGoIyxX4OHdN+gH+Ti5DOkakpqMnAx/m qfwKwwtHlct5phFMw8cpD2CfZsHqLqRSjxtJc9qIHY4T8rQXWPMHe5BvN+BP9CdSj0VwiF EeCDSim47XLzurwPK7lpjjsYwsimdyPq76wdXqzoS43d5XQoxT/hNYsIbbR4aQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1734141505; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0KtQgwlc75aRGfTr4XmtVI69I2vMpR+CgiTLzNN94jo=; b=lerfHOPyC7BHBti4f5euuZ7Xw1+vQy4usTWkYI3j64Y+aH264KXY3d6FbJ8A5KWG82dB1J 2RQ9/jDPBxhyZ736Q6bUsAG1ioOhHMhXLF1eyZsgStJsF86ZDCWM90Q6bY0SnpV7GkA5u8 4yNdDBxNT8aFW4sdhxQUbRzoXTCeNR1sVFadsJYyXAaPrwapS/2aTuqmSusIoNrQmJFUWG MtJrxaFW3rCfH/goBfPqd97MUf8/reRif9e4Hei34A1s14Up/+2/zLOVntDH/vkZGH/CbM huCqT2yGg1m56fTbSNxX1KK4s7oJ12RH3XQqoZkS9DbM6AC0isiJh3mlNoL75g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1734141505; a=rsa-sha256; cv=none; b=Ku+fzIwoHEn7FTjutj6DSuPzgJRFJ/irJkQQDd1RlReXdmeyxK3scF6GbjTAO2p53bYYme Jerx5vuIVYJ8hEfgrIftA1nVdOcuRkLJlVX7T1lTKsVQIjU1U/+aNoYXGwx0vBHh630Ur0 k8CJjhCNtVa/fFQF2QPjYDXdsII4WxvT04pUYjwovAzEfI6O4csmEXNWv1Dgo/eS+GvMMo 8qtdH3qH11a1TtsLfeqZGF1OUbYaQivFEV1ZfXgrDOVS3GtSmA2s0t+BJ+ZWsesIusP90L 7lsKe1Egg9Ukdkzv4l5N//kHqHus9uz+S+MgOL2OM5IpnFsdPqce+8fDAIdHAA== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Y98W44pTjz16TZ; Sat, 14 Dec 2024 01:58:24 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.10\)) Subject: Re: Switching release media dist sets to .tzst (tar + zstd)? From: Zhenlei Huang In-Reply-To: Date: Sat, 14 Dec 2024 09:58:16 +0800 Cc: FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Ed Maste X-Mailer: Apple Mail (2.3696.120.41.1.10) > On Dec 14, 2024, at 5:15 AM, Ed Maste wrote: >=20 > I have been reviewing parts of the release artifact build process, > including ISO and memstick images, and came across the distribution > sets (e.g., base.txz, src.txz) used by the installer to populate new > file systems. I=E2=80=99d like to discuss switching these to .tzst = (tar + > zstd) compression. >=20 > While I haven=E2=80=99t yet conducted detailed benchmarks comparing = zstd and > xz specifically for this use case, here are some initial > considerations: >=20 > Pros of zstd: > - Faster compression and decompression speeds. > - Aligns with the compression method used for FreeBSD packages. >=20 > Cons of zstd: > - Somewhat larger compressed file sizes. > - Requires updates to tools that interact with distribution sets. > - May have limited availability on some other operating systems (?). >=20 > I have a review open to demonstrate the extent of the change in the > build system & installer: https://reviews.freebsd.org/D48042 >=20 > It might be that this is not worth pursuing, as dist sets will most > likely go away with the migration to pkgbase, but I would like to > discuss and make an explicit decision. We can separately consider > compression on the release media images themselves. >=20 > Feedback Requested: >=20 > Is there support for this idea? Are there objections to pursuing this? > Are there other factors I should consider, especially compatibility = concerns? >=20 I have slow internet, I'd always prefer xz than zstd, as the decompress = speed does not matter much. For the compression, I'm not member of RE, but I guess that ( the slow = speed of=20 compression ) is affordable, as the releasing is not frequent. One good example usage of zstd is compressed kernel ( it seems we do not=20= support that yet ). OCI images may also have benefit with that as those = images typically not large, xz saves a little more spaces then zstd but the = decompress speed is much slower. It is good to have fast startup speed of = containers. Best regards, Zhenlei