From owner-freebsd-pkgbase@freebsd.org Fri Jul 5 21:30:51 2019 Return-Path: Delivered-To: freebsd-pkgbase@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A413915D51A4 for ; Fri, 5 Jul 2019 21:30:51 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: from mail-yb1-xb2f.google.com (mail-yb1-xb2f.google.com [IPv6:2607:f8b0:4864:20::b2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B92438AC1D for ; Fri, 5 Jul 2019 21:30:50 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: by mail-yb1-xb2f.google.com with SMTP id u9so2619919ybu.6 for ; Fri, 05 Jul 2019 14:30:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems-com.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:mime-version:thread-index :content-language; bh=XikcPEZuvXJN5VHIuMvqo6/k6trnQPX0HnCbdnet1i0=; b=tislPVhKYW3Y8/gLapYkjayOBzZhhoyirq9C/ZHcr5/thaB5iLRL2mDmIozXfHwepW CQLJYTwyw58EjzZ6v6cRkWXJDqC7oDbOcfct1ztQ35SUU8lCew/pFkcN+wQcQ42UlcvR eoaMiqg+A7VM1AaIh9NlPbRU9lDX1uL2DaP8r6lF4ORBg3216K9v11BSqrJk6Ylz0Pxp JH7Ic5cJy4wdGCNl8NJqSfsVZIy/JMnk5bTCnWyCzTJdtiRSYymttzSdqdwk5JG+cAAp cM+Zgz8zZJGqJWLVuO6V6lGJ1FwmgTBWALULcTcB/2Pta/bw7IzhEUlDvwpCwkl0cDBS wRcA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :thread-index:content-language; bh=XikcPEZuvXJN5VHIuMvqo6/k6trnQPX0HnCbdnet1i0=; b=KwDV2SsA5ZNfCp0siSJwxT9XMD11FH+nvuw9Ap7E9WS44ztOP4+eJS8Im/Xy5P4CWY b//bXhMk5NIk/bkT5qJIv/pjb15L4bqNVTkafCCG41fjEcnQRPTCNDkM1yh/L0E3fQ9G 4OQ7uCQFueLynl4n56dUFlq8Wh/86oJlp/h2H+gbeyUOTdt5CHDO6oJJYaLshs/vCbt4 K2UAk+y1cggic7EzQJdx72KmarLPCDo66g822tBipcz/bF7LjMrvXggya4iUVa6zAORw qiunp0whEK0R5jt9tu5nNOvGYW/skbcoBPbGwu3MofVfQcL98q+Kt7uXvyHDydzKTVuX 0ARA== X-Gm-Message-State: APjAAAU4Y+zHLOYrJmIT3zd1+jRRfYyWa+6HCk9Hh+S8aHmq64beH4zQ wRNjEBTh4GI9R5Ai8nq+AsksL1Px43H7wle7V/uRdCzVzrwWohdz5PEUqp1rHEwluamTnbw0urM BL9y9wmFXN8B/Oi22tdlwKE+Fk7WsGVwUcHeCULzde0rnXgZQPVuNOG9++Ef/m5/oE7l+XJIb3Q == X-Google-Smtp-Source: APXvYqwR57xrhoJD9ipk91nPcEdK/w9acw2pvxIlPkP5TLo2IEHqQ13XLu6icM5jRLYvksaNUO6UtQ== X-Received: by 2002:a25:aa8b:: with SMTP id t11mr3525919ybi.4.1562362249512; Fri, 05 Jul 2019 14:30:49 -0700 (PDT) Received: from KrisWindows (71-136-150-27.lightspeed.knvltn.sbcglobal.net. [71.136.150.27]) by smtp.gmail.com with ESMTPSA id q63sm4085231ywq.17.2019.07.05.14.30.48 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 05 Jul 2019 14:30:48 -0700 (PDT) From: To: Subject: CFT - Out of Tree Package Base (Round 2) Date: Fri, 5 Jul 2019 17:30:49 -0400 Message-ID: <00e201d53378$ea3399c0$be9acd40$@ixsystems.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 16.0 Thread-Index: AdUycDikE3vSLLY6TrSG7EkuBTKVLQ== Content-Language: en-us X-Rspamd-Queue-Id: B92438AC1D X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ixsystems-com.20150623.gappssmtp.com header.s=20150623 header.b=tislPVhK; dmarc=pass (policy=none) header.from=ixsystems.com; spf=pass (mx1.freebsd.org: domain of kris@ixsystems.com designates 2607:f8b0:4864:20::b2f as permitted sender) smtp.mailfrom=kris@ixsystems.com X-Spamd-Result: default: False [-6.96 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[ixsystems-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; IP_SCORE(-2.99)[ip: (-9.34), ipnet: 2607:f8b0::/32(-3.16), asn: 15169(-2.40), country: US(-0.06)]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkgbase@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[ixsystems-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT3.ASPMX.L.GOOGLE.com]; RCVD_IN_DNSWL_NONE(0.00)[f.2.b.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; FROM_NO_DN(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[ixsystems.com,none]; NEURAL_HAM_SHORT(-0.96)[-0.956,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-pkgbase@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Packaging the FreeBSD base system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Jul 2019 21:30:52 -0000 Developers, =20 It=E2=80=99s been a few months since our earlier CFT. Since then = we=E2=80=99ve had a Working Group at BSDCan, as well as feedback from = different parties on our implementation of base-packages into the ports = tree. Much of this feedback has been helpful, and we=E2=80=99ve = incorporated it into a patch that=E2=80=99s in review: =20 https://reviews.freebsd.org/D20394 =20 =20 Download 13-CURRENT (Updated weekly with full ports tree build) https://pkg.trueos.org/iso/freebsd-pkgbase/ =20 Download 12-STABLE (Updated weekly with full ports tree build) https://pkg.trueos.org/iso/freebsd12-pkgbase/ =20 =20 Here=E2=80=99s a quick recap of what=E2=80=99s changed since the initial = CFT: =20 - Broken out critical libs - =20 (rtld/libc/libm/etc) into a =E2=80=98-bootstrap=E2=80=99 package, to = minimize the risk that a crashed/aborted update will result in a = non-bootable system =20 - Added FLAVORS support (Currently generic/minimal/nozfs) - =20 The testing images also show a =E2=80=9Copenzfs=E2=80=9D option, which = uses the =E2=80=98nozfs=E2=80=99 flavor to install, and loads = sysutils/openzfs as the base system ZFS =20 - Added a =E2=80=98freebsd-update=E2=80=99 replacement, = =E2=80=98base-update=E2=80=99. - =20 This utility handles the update process, similar to = =E2=80=98freebsd-update=E2=80=99. If kernel updates are present, it will = do those as stage 1 (Along with installed *-kmod packages) and prompt = for a reboot. On next run, the -bootstrap and other userland packages = will be updated in the correct order. Additionally there is a = =E2=80=9Cmerge=E2=80=9D option, which will interactively walk the user = through a mergemaster-style update of files in /etc which could not be = automatically updated by pkg.=20 =20 - Split userland package into smaller subset, allowing for small = download sizes on slow connections, especially when only issuing updates = - =20 When dealing with updates, and especially on smaller devices such as a = RPI, this will make the initial update / download much more manageable. = For security updates to libraries, (on amd64) the package tops out at = about 8MB. (More details in the Phab review if you are curious) =20 So what=E2=80=99s next? =20 Still on our TODO is adding a script which will allow you to convert = your existing FreeBSD installation over to managed by base packages. = Additionally we intend to spin up a new weekly build for 12.0-RELEASE = images/packages, allowing users to try out the migration / update = process from 12.0 -> 12.1 and more real-world usage. =20 Lastly, we=E2=80=99re still trying to work through some issues with = Portmgr to see about bringing this patch into the project in some form. = Hopefully we can reach some sort of agreement on a path forward for this = work, but in the meantime we=E2=80=99ll keep publishing updated images / = packages weekly, since right now its nice to be using base packages in = the real-world =F0=9F=98=8A =20 Thanks for reading. Appreciate feedback / review! =20 =20 --=20 Kris Moore =20