From owner-freebsd-pkgbase@freebsd.org Wed Mar 2 23:54:31 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58C43AC12E8; Wed, 2 Mar 2016 23:54:31 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 4AA7D1E2B; Wed, 2 Mar 2016 23:54:31 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by freefall.freebsd.org (Postfix) with ESMTP id BEF2C1A3A; Wed, 2 Mar 2016 23:54:30 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Wed, 2 Mar 2016 23:54:29 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-pkgbase@freebsd.org Subject: [CFT] packaging the base system with pkg(8) Message-ID: <20160302235429.GD75641@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="MIdTMoZhcV1D07fI" Content-Disposition: inline X-Operating-System: FreeBSD 11.0-CURRENT amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Mar 2016 23:54:31 -0000 --MIdTMoZhcV1D07fI Content-Type: multipart/mixed; boundary="d9ADC0YsG2v16Js0" Content-Disposition: inline --d9ADC0YsG2v16Js0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline For those who have missed the initial email surrounding this topic, we are planning on packaging the base system with pkg(8) for 11.0-RELEASE. https://lists.freebsd.org/pipermail/freebsd-pkgbase/2016-January/000000.html At this time, I believe the major blockers and critical issues have been resolved where it is time for an official call-for-testing. Please note, as with any development branch, this is not yet intended for production environments. Testing on virtual machines or dedicated testing machines is strongly encouraged. Also note (as repeated below), running 'pkg delete -a' will implicitly remove base system packages after they are installed. To obtain the sources for testing, please use the projects/release-pkg branch: # svn co svn://svn.freebsd.org/base/projects/release-pkg /usr/src The projects/release-pkg branch is (at this time) in sync with head revision r296327. After checking out the project branch, build the userland and kernel as normal with the 'buildworld' and 'buildkernel' targets. Afterward, packages can be created with the 'packages' target. # cd /usr/src # make [make flags] buildworld # make [make flags] buildkernel # make packages At present, the base system consists of 755 packages with the default build (empty src.conf(5) and make.conf(5)) for amd64. The number of packages depends on several factors, but for most cases a runtime binary is split into several components. In particular, most shared libraries are individually packaged, in addition to debugging symbols, profiling libraries, and 32-bit packaged separately. The package repository will be created within /usr/obj/usr/src/repo by default. To enable the repository, create /usr/local/etc/pkg/repos/base.conf with the following contents: # FreeBSD base system repository FreeBSD-base: { url: "file:///usr/obj/usr/src/repo/${ABI}/latest", mirror_type: "none", enabled: yes } To initially bootstrap the 'FreeBSD-*' packages, they must be forcibly installed. Package registration is not performed during 'installworld' or 'installkernel', and there are no immediate plans to do this. This can be done by running: # pkg update -r FreeBSD-base # pkg install -g 'FreeBSD-*' Please note the following: 1) The pkg(8) binary is required for this to work, however an additional patch against the ports-mgmt/pkg port is required to properly track base system shared libraries. The patch against the ports-mgmt/pkg port is attached. In my testing, excluding this patch has not caused anything horrible to happen, however applying both patches is suggested at this point. The main noticeable effect of excluding the patch is system binary packages and their dependent library packages are not directly linked, which makes it possible to delete a library package that is required by a runtime binary. 2) At present, running 'pkg delete -a' will implicitly remove the 'FreeBSD-*' packages, leaving the system in an unusable state. There are valid use cases for removing all packages, such as test chroot(8) or jail(8) environments, so a solution to avoid accidental foot shooting is still being investigated. 3) With the attached patch, /lib32 and /usr/lib32 shared libraries are not tracked. Since they are optional and do not affect the default running userland, this should not prevent testing, however it is worth noting. 4) For kernel packages, the first listed kernel in KERNCONF is installed as /boot/kernel, and subsequent kernels in KERNCONF are installed as /boot/kernel.${KERNEL}. Building GENERIC is not required, as each kernel package is named with the kernel name included. For example, if 'KERNCONF=MYLOCALKERNEL' is set in make.conf(5), the resulting kernel package will be 'FreeBSD-kernel-mylocalkernel-release', and the debug symbols as 'FreeBSD-kernel-mylocalkernel-debug'. 5) There are still a few outstanding issues with configuration file merging, which is still being investigated. Please follow up on the freebsd-pkgbase@ mailing list with problems (and successes). Many suggestions were made, such as further granularity between runtime binaries and daemons (rwho(1) and rwhod(8) is one example I recall off-hand), that have not been implemented yet (and also not forgotten). Thank you in advance to everyone that can test this, so we can get this completed in time for 11.0-RELEASE. Glen --d9ADC0YsG2v16Js0 Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="pkgpatch.diff.txt" Content-Transfer-Encoding: quoted-printable Index: ports-mgmt/pkg/files/patch-libpkg_pkg__config.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- ports-mgmt/pkg/files/patch-libpkg_pkg__config.c (nonexistent) +++ ports-mgmt/pkg/files/patch-libpkg_pkg__config.c (working copy) @@ -0,0 +1,15 @@ +--- libpkg/pkg_config.c.orig 2016-01-26 23:32:05 UTC ++++ libpkg/pkg_config.c +@@ -390,6 +390,12 @@ static struct config_entry c[] =3D { + "VALID_URL_SCHEME", + "pkg+http,pkg+https,https,http,ftp,file,ssh", + }, ++ { ++ PKG_BOOL, ++ "ALLOW_BASE_SHLIBS", ++ "NO", ++ "Enable base libraries analysis", ++ }, + }; +=20 + static bool parsed =3D false; Index: ports-mgmt/pkg/files/patch-libpkg_pkg__elf.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- ports-mgmt/pkg/files/patch-libpkg_pkg__elf.c (nonexistent) +++ ports-mgmt/pkg/files/patch-libpkg_pkg__elf.c (working copy) @@ -0,0 +1,40 @@ +--- libpkg/pkg_elf.c.orig 2015-09-21 08:53:23 UTC ++++ libpkg/pkg_elf.c +@@ -85,23 +85,28 @@ static int + filter_system_shlibs(const char *name, char *path, size_t pathlen) + { + const char *shlib_path; ++ bool packaging_base =3D pkg_object_bool(pkg_config_get("ALLOW_BASE_SHLIB= S")); +=20 +- shlib_path =3D shlib_list_find_by_name(name); +- if (shlib_path =3D=3D NULL) { +- /* dynamic linker could not resolve */ +- return (EPKG_FATAL); ++ if (!packaging_base) { ++ shlib_path =3D shlib_list_find_by_name(name); ++ if (shlib_path =3D=3D NULL) { ++ /* dynamic linker could not resolve */ ++ return (EPKG_FATAL); ++ } + } +=20 +- /* match /lib, /lib32, /usr/lib and /usr/lib32 */ +- if (strncmp(shlib_path, "/lib", 4) =3D=3D 0 || +- strncmp(shlib_path, "/usr/lib", 8) =3D=3D 0) +- return (EPKG_END); /* ignore libs from base */ ++ if (!packaging_base) { ++ /* match /lib, /lib32, /usr/lib and /usr/lib32 */ ++ if (strncmp(shlib_path, "/lib", 4) =3D=3D 0 || ++ strncmp(shlib_path, "/usr/lib", 8) =3D=3D 0) ++ return (EPKG_END); /* ignore libs from base */ ++ } +=20 + if (path !=3D NULL) + strncpy(path, shlib_path, pathlen); +=20 + return (EPKG_OK); +-}=20 ++} +=20 + /* ARGSUSED */ + static int --d9ADC0YsG2v16Js0-- --MIdTMoZhcV1D07fI Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJW1301AAoJEAMUWKVHj+KT+rwP/3NogwgInBqdjhcsfjE8mCVa ZfrIm8JB6Rrlq53W3T6TTvcGMCZSzSowXL7l5doxJO9FbToU9md1A0iELv0VTQks lgSzQOuArYzRINI9H/PLlmIaMlCJPvk4KJyvZkIj9QgY8Bhmr1AQKNG3KvXBzxo+ NvaKET8GDnbriALn4zaAWNxquPIWCmjsvTg+/B8C40yvyr0roEZbMCH7MFP//lBv B3Ah3UYp8jdtQ5x7d5tCVy919W4cZsHSWWxMdSA6GPbdbxvScVT14v6fTi/jWdQP WaewRsOK22vmoZj0F/oVaQmg9tBCHTiSN5J7cXd7zWNO6LQr+Rfk5xQBgi2SRYdq l5bkr3XmJC3TggYecPNqUDw+CAq/U+KkVqw4Zc8I2aZJW/e1EqMO8fTKUu5Ce8L9 iYKkymHjTPgye/o3rAfHWb7iK3N0vNtdUEShyYStAK3UMOD0NJwDsjrhuQy8P453 2tXxm9JZ2Sdo+Psnf62NgzBwEprkZdENhuFnvYxIOYbij3x5Sf6R0CYgw0TodF6f 9M4J4iINh7fuNORhutjmroSTfGffx5SNQ9fjtk1YV4txRCVi6NsLqedePEQ1S5K0 lEH2ozwr4nv/UNb4RPN/YanbPXOjlbQltDN+3OqWBNwyWM/966zR4KKlCHN9yKnx iR5GzudtG3KrxSAdBUAu =HWlk -----END PGP SIGNATURE----- --MIdTMoZhcV1D07fI-- From owner-freebsd-pkgbase@freebsd.org Thu Mar 3 08:35:45 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7D6A2A92BBE; Thu, 3 Mar 2016 08:35:45 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 43B2D6BE2D; Thu, 3 Mar 2016 08:35:45 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1abOjP-000MPz-MN; Thu, 03 Mar 2016 11:35:35 +0300 Date: Thu, 3 Mar 2016 11:35:35 +0300 From: Slawa Olhovchenkov To: Glen Barber Cc: freebsd-current@freebsd.org, freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) Message-ID: <20160303083535.GG11654@zxy.spb.ru> References: <20160302235429.GD75641@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160302235429.GD75641@FreeBSD.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Mar 2016 08:35:45 -0000 On Wed, Mar 02, 2016 at 11:54:29PM +0000, Glen Barber wrote: > For those who have missed the initial email surrounding this topic, we > are planning on packaging the base system with pkg(8) for 11.0-RELEASE. > > https://lists.freebsd.org/pipermail/freebsd-pkgbase/2016-January/000000.html > > At this time, I believe the major blockers and critical issues have been > resolved where it is time for an official call-for-testing. > > Please note, as with any development branch, this is not yet intended > for production environments. Testing on virtual machines or dedicated > testing machines is strongly encouraged. > > Also note (as repeated below), running 'pkg delete -a' will implicitly > remove base system packages after they are installed. > > To obtain the sources for testing, please use the projects/release-pkg > branch: > > # svn co svn://svn.freebsd.org/base/projects/release-pkg /usr/src > > The projects/release-pkg branch is (at this time) in sync with head > revision r296327. > > After checking out the project branch, build the userland and kernel as > normal with the 'buildworld' and 'buildkernel' targets. Afterward, > packages can be created with the 'packages' target. > > # cd /usr/src > # make [make flags] buildworld > # make [make flags] buildkernel > # make packages > > At present, the base system consists of 755 packages with the default 755! :(((( What purpose of this? At time of split Xorg to multiple packages talk about individual update single package and don't touching rest. In reality we have un-obvious garbage fully rebuild on every update. Also, list of packagess too long and badly mantained on rescue console (for see and for control). From owner-freebsd-pkgbase@freebsd.org Thu Mar 3 09:33:47 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 96AE4A93CF4 for ; Thu, 3 Mar 2016 09:33:47 +0000 (UTC) (envelope-from vermaden@interia.pl) Received: from smtpo.poczta.interia.pl (smtpo.poczta.interia.pl [217.74.65.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5B764BA5 for ; Thu, 3 Mar 2016 09:33:47 +0000 (UTC) (envelope-from vermaden@interia.pl) Date: Thu, 03 Mar 2016 10:18:09 +0100 From: vermaden Subject: [CFT] packaging the base system with pkg(8) To: freebsd-pkgbase@freebsd.org X-Mailer: interia.pl/pf09 X-Originating-IP: 195.38.12.250 Message-Id: MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interia.pl; s=biztos; t=1456996690; bh=l3V3aGvY1NhBEbzI1jQBVgddWX4Z/lARcRHxtXl8B/k=; h=Date:From:Subject:To:X-Mailer:X-Originating-IP:Message-Id: MIME-Version:Content-Type; b=siTNO7L+0GqrWjUlPhJryC7OvPg9odYIQ6BoJSc1Fo5Pzac1SCBeJh5ddPrrYhFaO +VqkQrZYueIQC0Oqj1rvWvMTgmSRtqNjB/FSe27RpjcYQBg84JbNCE4m4/5R2xtsnh NeUZ3fOn6GOl5+WF9nFFrGzFMzppFNDy+ZFMpe2M= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Mar 2016 09:33:47 -0000 Hi,having base system components handled in pkg(8) style is good idea, but PLEASE keep FreeBSD's base system SEPARATED from PORTS/PACKAGES ... this is one of THE BEST FreeBSD features.IMHO there should be DIFFERENT COMMAND nad SEPARATE SQLITE database for FreeBSD's base sytem packages/components handling.Regards,vermaden From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 00:58:08 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D5828A94D93 for ; Fri, 4 Mar 2016 00:58:08 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (khavrinen.csail.mit.edu [IPv6:2001:470:8b2d:1e1c:21b:21ff:feb8:d7b0]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "khavrinen.csail.mit.edu", Issuer "Client CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9A29EC83; Fri, 4 Mar 2016 00:58:08 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (localhost [127.0.0.1]) by khavrinen.csail.mit.edu (8.14.9/8.14.9) with ESMTP id u240w6xI033349 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL CN=khavrinen.csail.mit.edu issuer=Client+20CA); Thu, 3 Mar 2016 19:58:07 -0500 (EST) (envelope-from wollman@khavrinen.csail.mit.edu) Received: (from wollman@localhost) by khavrinen.csail.mit.edu (8.14.9/8.14.9/Submit) id u240w6dK033348; Thu, 3 Mar 2016 19:58:06 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <22232.56734.691784.696540@khavrinen.csail.mit.edu> Date: Thu, 3 Mar 2016 19:58:06 -0500 From: Garrett Wollman To: Glen Barber Cc: freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) In-Reply-To: <20160302235429.GD75641@FreeBSD.org> References: <20160302235429.GD75641@FreeBSD.org> X-Mailer: VM 8.2.0b under 24.5.1 (amd64-portbld-freebsd9.3) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (khavrinen.csail.mit.edu [127.0.0.1]); Thu, 03 Mar 2016 19:58:07 -0500 (EST) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 00:58:08 -0000 < said: > After checking out the project branch, build the userland and kernel as > normal with the 'buildworld' and 'buildkernel' targets. Afterward, > packages can be created with the 'packages' target. > # cd /usr/src > # make [make flags] buildworld > # make [make flags] buildkernel > # make packages Since I don't have any 11-current machines yet, I tried cross-building this on my 10.2 build server, and it seems to work just fine, although pkg(8) whines copiously about "Major OS version upgrade detected. Running "pkg-static install -f pkg" recommended". I note also that "make packages" doesn't work with -jN, but "make release" never worked in parallel either, and I suspect they break in the same place for the same underlying reason. I did this build as myself with -DNO_ROOT and everything went fine; a spot check of the packages shows the correct file ownership. > At present, the base system consists of 755 packages with the default > build (empty src.conf(5) and make.conf(5)) for amd64. The number of > packages depends on several factors, but for most cases a runtime binary > is split into several components. In particular, most shared libraries > are individually packaged, in addition to debugging symbols, profiling > libraries, and 32-bit packaged separately. I was prepared to freak out at this, but with half the packages consisting of debugging symbols for binaries that ship stripped in 10.x anyway (so most users would never need nor install those packages), the number isn't so unreasonable. I get 531 non-"-debug-" packages here, which is still more than I'd like but tolerable given how many of them will never be installed. (Could some of those library packages be consolidated? I'm not convinced that it makes much sense to have all the different -lib32-* variants given the normal use case is runtime-only. And I don't see the profit in having separate libusb, libusbhid, libutil, libvmmapi, libwrap, libxo, liby, libypclnt, libz, etc. packages, either.) Also, for the "FreeBSD-kernel" package, why is the kernel configuration name downcased, and why is the opposite of "-debug-" "-release-" as opposed to "" like all the other packages. Maybe all of the CDDL-licensed stuff should be in a (meta)package of its own? -GAWollman From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 01:09:52 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB801A930FC for ; Fri, 4 Mar 2016 01:09:51 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id CEAF0FA4; Fri, 4 Mar 2016 01:09:51 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by freefall.freebsd.org (Postfix) with ESMTP id 608481450; Fri, 4 Mar 2016 01:09:51 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Fri, 4 Mar 2016 01:09:49 +0000 From: Glen Barber To: Garrett Wollman Cc: freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) Message-ID: <20160304010949.GC48568@FreeBSD.org> References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="m51xatjYGsM+13rf" Content-Disposition: inline In-Reply-To: <22232.56734.691784.696540@khavrinen.csail.mit.edu> X-Operating-System: FreeBSD 11.0-CURRENT amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 01:09:52 -0000 --m51xatjYGsM+13rf Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Mar 03, 2016 at 07:58:06PM -0500, Garrett Wollman wrote: > < said: >=20 > > After checking out the project branch, build the userland and kernel as > > normal with the 'buildworld' and 'buildkernel' targets. Afterward, > > packages can be created with the 'packages' target. >=20 > > # cd /usr/src > > # make [make flags] buildworld > > # make [make flags] buildkernel > > # make packages >=20 > Since I don't have any 11-current machines yet, I tried cross-building > this on my 10.2 build server, and it seems to work just fine, although > pkg(8) whines copiously about "Major OS version upgrade detected. > Running "pkg-static install -f pkg" recommended". This is expected. > I note also that > "make packages" doesn't work with -jN, but "make release" never worked > in parallel either, and I suspect they break in the same place for the > same underlying reason. Until the 'install' targets are '-j' safe, 'make packages' will not be. > I did this build as myself with -DNO_ROOT and > everything went fine; a spot check of the packages shows the correct > file ownership. >=20 > > At present, the base system consists of 755 packages with the default > > build (empty src.conf(5) and make.conf(5)) for amd64. The number of > > packages depends on several factors, but for most cases a runtime binary > > is split into several components. In particular, most shared libraries > > are individually packaged, in addition to debugging symbols, profiling > > libraries, and 32-bit packaged separately. >=20 > I was prepared to freak out at this, but with half the packages > consisting of debugging symbols for binaries that ship stripped in > 10.x anyway (so most users would never need nor install those > packages), the number isn't so unreasonable. I get 531 non-"-debug-" > packages here, which is still more than I'd like but tolerable given > how many of them will never be installed. (Could some of those > library packages be consolidated? This was intentional. If, for example, there is a libxo bug that requires an EN or SA, we do not want the binary upgrade to exceed more than required. > I'm not convinced that it makes > much sense to have all the different -lib32-* variants given the > normal use case is runtime-only. For those who have no need for lib32 stuff, we do not want to enforce its existence. > And I don't see the profit in having > separate libusb, libusbhid, libutil, libvmmapi, libwrap, libxo, liby, > libypclnt, libz, etc. packages, either.) >=20 The underlying reason for this is noted above. > Also, for the "FreeBSD-kernel" package, why is the kernel > configuration name downcased, and why is the opposite of "-debug-" > "-release-" as opposed to "" like all the other packages. >=20 It's how the awk script generates the resulting plist and ucl file, which I forgot to fix. > Maybe all of the CDDL-licensed stuff should be in a (meta)package of > its own? >=20 Yes. Good catch. Glen --m51xatjYGsM+13rf Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJW2OBdAAoJEAMUWKVHj+KT7UoP/RZ3a14gOROFuEHSFCaeOwOd doD7I4WXUDBR6fAEf3Q7ibXmfspyythniJoO8vLnh2rgXtVtF8EBt6kMgkbE6HW/ rpjUEOZBCkn80CJpueTagqU4MhRFiB9wxUUWdon/6pSI/iYXVOikl9lQIC33eQvW m//sBOxx8F/3WIl19eQnPa5bVFzzv2oTNFbzgHs7vYCT3K3n42uxGRUuzTHAYUwV SpOMsZE9QW+7hJjD4/6zGAWvqGdx0ARAUDOGFf85Ilt/flsTHLw2hbpnhJa59FKS vdYeHBu2kANaS9vNsYPyL8g7hfC7EO3nzJvGiZO6MDO4h5h50Tcm2E5J0kg53mKl cQ1gHvgJ8gl0vw/a7+gWn+dsRg7phhnn5IKBApD7ZFXmOOaTZMNj/CQr71kjOJ4t S/jp3RoeKTMKzpv0DDIbjvoeVg6XjLnobI1ybkjRbVR0CSpo5HbfsiNk0s3bVz9z oWiHun0yizW2CkPc/Ym53p8v5G+fQD6hlovr/R3kWz4qXF94zEi63vPnDSTR8A32 GuPSZFee7qyyvZDvNOcWu0HUC8OQR4Da3TDrXcKrIL4RFqYz/yexzJDeG3pt1abi dfkpooB38MA9FBeftirDkSWdaZXNYrheIIxp+/sNQM4e3D1ptuwgVRl4At/cDzmG U0xi1ZyaZM5A/3J33FYx =5FGx -----END PGP SIGNATURE----- --m51xatjYGsM+13rf-- From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 08:13:13 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A3249DA4B6 for ; Fri, 4 Mar 2016 08:13:13 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [81.2.117.100]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CD22337D for ; Fri, 4 Mar 2016 08:13:12 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from liminal.local (liminal.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3636:3bff:fed4:b0d6]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: m.seaman@infracaninophile.co.uk) by smtp.infracaninophile.co.uk (Postfix) with ESMTPSA id 287FBD096 for ; Fri, 4 Mar 2016 08:13:03 +0000 (UTC) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none header.from=FreeBSD.org Authentication-Results: smtp.infracaninophile.co.uk/287FBD096; dkim=none; dkim-atps=neutral Subject: Re: [CFT] packaging the base system with pkg(8) To: freebsd-pkgbase@freebsd.org References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> From: Matthew Seaman Message-ID: <56D94384.5030901@FreeBSD.org> Date: Fri, 4 Mar 2016 08:12:52 +0000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <20160304010949.GC48568@FreeBSD.org> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="fUaPTfc54NoRMtGhk7tR0NKjd9KViQ7xt" X-Virus-Scanned: clamav-milter 0.99 at smtp.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=1.0 required=5.0 tests=SPF_SOFTFAIL autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on smtp.infracaninophile.co.uk X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 08:13:13 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --fUaPTfc54NoRMtGhk7tR0NKjd9KViQ7xt Content-Type: multipart/mixed; boundary="jI9KsCSdheEGsP0DFc4SjsIapAVasOGjO" From: Matthew Seaman To: freebsd-pkgbase@freebsd.org Message-ID: <56D94384.5030901@FreeBSD.org> Subject: Re: [CFT] packaging the base system with pkg(8) References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> In-Reply-To: <20160304010949.GC48568@FreeBSD.org> --jI9KsCSdheEGsP0DFc4SjsIapAVasOGjO Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 04/03/2016 01:09, Glen Barber wrote: >> I was prepared to freak out at this, but with half the packages >> > consisting of debugging symbols for binaries that ship stripped in >> > 10.x anyway (so most users would never need nor install those >> > packages), the number isn't so unreasonable. I get 531 non-"-debug-= " >> > packages here, which is still more than I'd like but tolerable given= >> > how many of them will never be installed. (Could some of those >> > library packages be consolidated? > This was intentional. If, for example, there is a libxo bug that > requires an EN or SA, we do not want the binary upgrade to exceed more > than required. Bapt's presentation at BSDCan last year explained the reasoning behind how the base was divided up into packages. He said at the time that it was impossible to do in a way that wouldn't get complaints from someone, so he opted for maximum flexibility -- meaning a lot of fine-grained packages plus a heirarchy of meta-packages to make it easy to install and manage package sets in commonly used combinations. So, for instance, there might be a 'FreeBSD-debug' that would depend on 'FreeBSD-library-debug', 'FreeBSD-application-debug' etc. and 'FreeBSD-library-debug' would depend on the individual 'FreeBSD-libfoo-debug' packages that actually install the symbol files. (So you could strip all the debug symbols from your install by 'pkg delete -fR FreeBSD-debug') I'm not seeing any of those meta packages in the base repo built following Glen's instructions -- is there some other step necessary to generate them? Cheers, Matthew --jI9KsCSdheEGsP0DFc4SjsIapAVasOGjO-- --fUaPTfc54NoRMtGhk7tR0NKjd9KViQ7xt Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQJ8BAEBCgBmBQJW2UOKXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ2NTNBNjhCOTEzQTRFNkNGM0UxRTEzMjZC QjIzQUY1MThFMUE0MDEzAAoJELsjr1GOGkATK+MQAKxs8GIA+ID9XC3zYaqMwAtk VFC6E9W32pLXUZKvCSHY9bdqRqsLQWUm6HLcc+Zm+cTF/TaMO0C7HkyDeu7vRd+q Ba2I4uO4EEf8EpGsMu8GA0pV8pz/GueiSwscc5vBP/kbsOpc68gw3leNg23djoUh J2cBeyAy/sQz/MZ0L1+acf+DL72MuYs6fSjwct7rQ9u+IceZVUJIa97UoSU+bmMA +IajZsiYskjZ/1sw21vV1+DEKefXFmmiHGqQr6jQJUcIU+1wqzmLnwq2Mc+ZLWXL iHicn+ptifW2TTrPfg9rHl2YeUnal0DKRcDpjPz7U4XuHemAqd31dPuVhXe19x8a jsKg2KJKgTyepLMeAwEEVQSfTMGDQIW+peKZh5mT5z8xXU/xVp0seqqu1hR1YG4+ 4+Fgu2QHrpaW0YMPPLPFQqMh/DT53jXwkPESW6qWxjxEmzy1tbmMkO2k4zI8kghv STd/VO9sa3wGqBz7MGUH6BNCck8D1L9/5ZhxhjWA9HmeGYDPEWsiV78Zf/rNx2Mb +r2MEpbc+qXiKXDMcEMcfIgF3hWt5XTc7PJbByeQ4Sj0ZrD+PUhkUZwVxdTicoxq yKznrFdJYI8zuvroHmYQFx659j0vN/cTm/9w/8P4iJXkou7A/HBnUxO4YXzrdl9Z mQZcGrOxuXhrnA3D3Lgp =EYby -----END PGP SIGNATURE----- --fUaPTfc54NoRMtGhk7tR0NKjd9KViQ7xt-- From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 14:05:18 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A10D49DA765 for ; Fri, 4 Mar 2016 14:05:18 +0000 (UTC) (envelope-from lifanov@mail.lifanov.com) Received: from mail.lifanov.com (mail.lifanov.com [206.125.175.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F52DA36; Fri, 4 Mar 2016 14:05:18 +0000 (UTC) (envelope-from lifanov@mail.lifanov.com) Received: by mail.lifanov.com (Postfix, from userid 58) id 5E4AC239742; Fri, 4 Mar 2016 09:05:12 -0500 (EST) X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail.lifanov.com X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=3.4.1 Received: from [127.0.0.1] (vnat600.ejoco.com [166.108.32.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.lifanov.com (Postfix) with ESMTPSA id 7D07D239424; Fri, 4 Mar 2016 09:05:10 -0500 (EST) Subject: Re: [CFT] packaging the base system with pkg(8) To: Glen Barber References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> Cc: freebsd-pkgbase@freebsd.org From: Nikolai Lifanov Message-ID: <56D99614.5050401@mail.lifanov.com> Date: Fri, 4 Mar 2016 09:05:08 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <20160304010949.GC48568@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 14:05:18 -0000 On 03/03/16 20:09, Glen Barber wrote: >> I note also that >> > "make packages" doesn't work with -jN, but "make release" never worked >> > in parallel either, and I suspect they break in the same place for the >> > same underlying reason. > Until the 'install' targets are '-j' safe, 'make packages' will not be. > The 'install' targets are '-j' safe and have been for many months now. I run "make installworld installkernel" with '-j4', '-j16', and '-j32' on some machines. I very rarely stumble on an issue, and it tends to be promptly fixed. - Nikolai Lifanov From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 18:02:57 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53F349DAD77 for ; Fri, 4 Mar 2016 18:02:57 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (khavrinen.csail.mit.edu [IPv6:2001:470:8b2d:1e1c:21b:21ff:feb8:d7b0]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "khavrinen.csail.mit.edu", Issuer "Client CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 19DBB1A9; Fri, 4 Mar 2016 18:02:56 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (localhost [127.0.0.1]) by khavrinen.csail.mit.edu (8.14.9/8.14.9) with ESMTP id u24I2tC3039623 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL CN=khavrinen.csail.mit.edu issuer=Client+20CA); Fri, 4 Mar 2016 13:02:55 -0500 (EST) (envelope-from wollman@khavrinen.csail.mit.edu) Received: (from wollman@localhost) by khavrinen.csail.mit.edu (8.14.9/8.14.9/Submit) id u24I2tFX039622; Fri, 4 Mar 2016 13:02:55 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <22233.52687.99532.689186@khavrinen.csail.mit.edu> Date: Fri, 4 Mar 2016 13:02:55 -0500 From: Garrett Wollman To: Glen Barber Cc: freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) In-Reply-To: <20160304010949.GC48568@FreeBSD.org> References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> X-Mailer: VM 8.2.0b under 24.5.1 (amd64-portbld-freebsd9.3) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (khavrinen.csail.mit.edu [127.0.0.1]); Fri, 04 Mar 2016 13:02:55 -0500 (EST) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:02:57 -0000 < said: >> I'm not convinced that it makes >> much sense to have all the different -lib32-* variants given the >> normal use case is runtime-only. > For those who have no need for lib32 stuff, we do not want to enforce > its existence. You may have missed my point: I was suggesting that the lib32 stuff be packed into fewer packages, because the places where it is needed are less likely to want fine-grained selection. So just having a single package with all the "runtime" packages would be closer to what most people needed (and likewise for the "development" etc. libraries which are almost never useful). -GAWollman From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 18:20:27 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C5C2A09457 for ; Fri, 4 Mar 2016 18:20:27 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id F22B9C1F; Fri, 4 Mar 2016 18:20:26 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by freefall.freebsd.org (Postfix) with ESMTP id 75A3E1D47; Fri, 4 Mar 2016 18:20:26 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Fri, 4 Mar 2016 18:20:24 +0000 From: Glen Barber To: Garrett Wollman Cc: freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) Message-ID: <20160304182024.GK53848@FreeBSD.org> References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> <22233.52687.99532.689186@khavrinen.csail.mit.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="5dNcufZ4prhark0F" Content-Disposition: inline In-Reply-To: <22233.52687.99532.689186@khavrinen.csail.mit.edu> X-Operating-System: FreeBSD 11.0-CURRENT amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:20:27 -0000 --5dNcufZ4prhark0F Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Mar 04, 2016 at 01:02:55PM -0500, Garrett Wollman wrote: > < said: >=20 > >> I'm not convinced that it makes > >> much sense to have all the different -lib32-* variants given the > >> normal use case is runtime-only. >=20 > > For those who have no need for lib32 stuff, we do not want to enforce > > its existence. >=20 > You may have missed my point: I was suggesting that the lib32 stuff be > packed into fewer packages, because the places where it is needed are > less likely to want fine-grained selection. So just having a single > package with all the "runtime" packages would be closer to what most > people needed (and likewise for the "development" etc. libraries which > are almost never useful). >=20 You're right, I did miss your point. I see what you mean now. It's not impossible to do, but will require a bit of tweaking to the script that generates the metadata files. Thank you for the suggestion. Glen --5dNcufZ4prhark0F Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJW2dHoAAoJEAMUWKVHj+KT8kgP/iholeMoI6eHOKQdvyAUxLAH HQ4UB1XeJ1DCu7ciNshj7/9q6ztKRUolqMuhyJzxEIB8PjihzScqByhCga/2Wily 1zA3xnQyMaHFV+GHKFWCWuOZZ7t4kOkO15jgdgKlNwaiCl20E84RZZfuN0sobPyb oJY+7dXOwSPg7me5IgSPqsNrHD8Sd3ToI0aJYE1NCiF3znuyaALuc6tBeiIOCHuq UnOUC2KhPv8Z3XqjJkV3FPyHYOc7vI2AhMQUcyIlTsNzo+28iD6CHs7pPs4xU+Ps oL3aIVjRYtVlDTGgCxABXqo/G6zpCyDImOWijTsp/JBGEfZ1zDeKT2fSHa+j3e4a V6wLFhrY1zBaDPesR5SBac7Jlgtwp8yP5HvIzIjMqcbxzOlOA5VYtjDXG7cKP2zX mxI5g4oPPvy9EFZMJKWZ4/3HR76IvNMnBA5joAm4SPPoBy7KrSBZIqocs4sERDij zaT5KqzKO+Hoyj+sNZ+qB6KdjF4joK75zUlzPvZR+dZHVhdzEd/RzavtY/U2I47K z7ubo1XWI7x1Zj/etw4lKkabuW53O9nZSBF4QW4uCinNDbXwUehSkWx8oUESsfEW IZXUZd+BWG01sVk0iy98/ZVgc6OmaiyCRWhQKPSs6cueHiyZliaVhH7ymKLRKFc/ fHr+fwOb0IPtGfGaMmi4 =oq9R -----END PGP SIGNATURE----- --5dNcufZ4prhark0F-- From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 18:21:36 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B2AAA09573 for ; Fri, 4 Mar 2016 18:21:36 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 5D221DA5; Fri, 4 Mar 2016 18:21:36 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by freefall.freebsd.org (Postfix) with ESMTP id E12C61D66; Fri, 4 Mar 2016 18:21:35 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Fri, 4 Mar 2016 18:21:34 +0000 From: Glen Barber To: Nikolai Lifanov Cc: freebsd-pkgbase@freebsd.org Subject: Re: [CFT] packaging the base system with pkg(8) Message-ID: <20160304182134.GL53848@FreeBSD.org> References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> <56D99614.5050401@mail.lifanov.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="m+jEI8cDoTn6Mu9E" Content-Disposition: inline In-Reply-To: <56D99614.5050401@mail.lifanov.com> X-Operating-System: FreeBSD 11.0-CURRENT amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:21:36 -0000 --m+jEI8cDoTn6Mu9E Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Mar 04, 2016 at 09:05:08AM -0500, Nikolai Lifanov wrote: > On 03/03/16 20:09, Glen Barber wrote: > >> I note also that > >> > "make packages" doesn't work with -jN, but "make release" never work= ed > >> > in parallel either, and I suspect they break in the same place for t= he > >> > same underlying reason. > > Until the 'install' targets are '-j' safe, 'make packages' will not be. > >=20 >=20 > The 'install' targets are '-j' safe and have been for many months now. > I run "make installworld installkernel" with '-j4', '-j16', and '-j32' > on some machines. I very rarely stumble on an issue, and it tends to > be promptly fixed. >=20 Hmm, last I tried 'installworld -jNN', it fell over. Admittedly, it was not very recently. Glen --m+jEI8cDoTn6Mu9E Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJW2dIuAAoJEAMUWKVHj+KThScQAImfpoocxhaLJRTmGXTCbARM Eaf1lrmAwAdKhHWtrprc+6a06iUQ1XxcQ+odVh0yCoNp6wABl9BDYwqTzlQRFBR1 R2eloNhziRVnhbU7fOYK9vzRVuB0IQQa5ptMLq3XA9CyBtqSgOwjipX67ddBtWUn jO2R/Z8VfUHw8k3O/wvVYse4EmDQpjh57ERCJYULf2L32lBbdTZut+9h0IPAW8ZU RvVVQ0aOM6g7wv2K1z8jahtz3wZl9vqA5v2/Iu/FWttMhVG3SMb1H3h9IsbT8w6I vaQTrCDxOyO6RK/zGILMuuzmwBDUAHezPBMke1Gb/sP2GbenwKOklYq3yQ5rd+vA 6JUDJKJVbz8LRPW8LwKZbsZg2CY08myC77MI8xe/+SQzmfReedjMxNfCOKFqNhko 8sDKI04WsDNUS5WobEZg2g1OT0suTRQl8ekAdkuTJwSGyK6NPN7UGav+waFmET17 vvZGBhIE23WvjWj1um8kRENGVMiTWLjPWtNo7U8bNtZ5n86p0+iUa/M+YR1zQbbG mJF/zA/GiHMgr7S/FyqR9rCl0gX6m52znucDoGb8Op1jA1NKZfgJTMjOU6MnisaW 0uU0RRMeUkewnOp+HVR6supg61p6Pc1dKnv3pf/B1Z22xv5gA2bIsP+JihvrfMjM xigzXLRGug0FZecnIocG =ART2 -----END PGP SIGNATURE----- --m+jEI8cDoTn6Mu9E-- From owner-freebsd-pkgbase@freebsd.org Fri Mar 4 18:28:06 2016 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 82824A09717 for ; Fri, 4 Mar 2016 18:28:06 +0000 (UTC) (envelope-from lifanov@mail.lifanov.com) Received: from mail.lifanov.com (mail.lifanov.com [206.125.175.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6FCFDF54; Fri, 4 Mar 2016 18:28:06 +0000 (UTC) (envelope-from lifanov@mail.lifanov.com) Received: by mail.lifanov.com (Postfix, from userid 58) id E94D7239744; Fri, 4 Mar 2016 13:28:05 -0500 (EST) X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail.lifanov.com X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=3.4.1 Received: from [127.0.0.1] (vnat600.ejoco.com [166.108.32.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.lifanov.com (Postfix) with ESMTPSA id 70C49239424; Fri, 4 Mar 2016 13:28:03 -0500 (EST) Subject: Re: [CFT] packaging the base system with pkg(8) To: Glen Barber , Garrett Wollman References: <20160302235429.GD75641@FreeBSD.org> <22232.56734.691784.696540@khavrinen.csail.mit.edu> <20160304010949.GC48568@FreeBSD.org> <22233.52687.99532.689186@khavrinen.csail.mit.edu> <20160304182024.GK53848@FreeBSD.org> Cc: freebsd-pkgbase@freebsd.org From: Nikolai Lifanov Message-ID: <56D9D3B2.7030906@mail.lifanov.com> Date: Fri, 4 Mar 2016 13:28:02 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <20160304182024.GK53848@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:28:06 -0000 On 03/04/16 13:20, Glen Barber wrote: > On Fri, Mar 04, 2016 at 01:02:55PM -0500, Garrett Wollman wrote: >> < said: >> >>>> I'm not convinced that it makes >>>> much sense to have all the different -lib32-* variants given the >>>> normal use case is runtime-only. >> >>> For those who have no need for lib32 stuff, we do not want to enforce >>> its existence. >> >> You may have missed my point: I was suggesting that the lib32 stuff be >> packed into fewer packages, because the places where it is needed are >> less likely to want fine-grained selection. So just having a single >> package with all the "runtime" packages would be closer to what most >> people needed (and likewise for the "development" etc. libraries which >> are almost never useful). >> > > You're right, I did miss your point. > > I see what you mean now. It's not impossible to do, but will require > a bit of tweaking to the script that generates the metadata files. > > Thank you for the suggestion. > > Glen > During BSDCan 2015, bapt@ said that there would be meta-packages for this: http://www.bsdcan.org/2015/schedule/attachments/321_packaging-base.pdf It would satisfy this type of use with: # pkg remove FreeBSD-lib32 <-- removes meta-package # pkg autoremove <-- removes dependencies Then there can be tweaking with "pkg set -A ..." for these that want a specific library gone or present. - Nikolai Lifanov