From nobody Sun Sep 8 20:00:45 2024 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4X216t1h9fz5VyJM for ; Sun, 08 Sep 2024 20:00:54 +0000 (UTC) (envelope-from rwp@proulx.com) Received: from havoc.proulx.com (havoc.proulx.com [198.99.81.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4X216s3JkNz4FJk for ; Sun, 8 Sep 2024 20:00:53 +0000 (UTC) (envelope-from rwp@proulx.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proulx.com header.s=dkim2048 header.b=E6hxsFCc; dmarc=pass (policy=none) header.from=proulx.com; spf=pass (mx1.freebsd.org: domain of rwp@proulx.com designates 198.99.81.74 as permitted sender) smtp.mailfrom=rwp@proulx.com Received: from joseki.proulx.com (localhost [127.0.0.1]) by havoc.proulx.com (Postfix) with ESMTPS id 12554446 for ; Sun, 8 Sep 2024 14:00:46 -0600 (MDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proulx.com; s=dkim2048; t=1725825646; bh=o5gu0xRntcIsQQV5571JzXpbYE7AEzlcos83aXbqTXk=; h=Date:From:To:Subject:References:In-Reply-To:From; b=E6hxsFCcg7faqqnVbBAdyq+5h+lRhlBSeyOIExvwQZmZHQWBWEzq+JxiUiVAOiGjm +bQQ/Vcv/kc5yEaR/llOi8Bss8WdorzTSqGv4/TJhMuxaB1kGPHJcsoYQx7E5Kx70G w87qZi0OgUsP/lUzjjLZsUg0WIQh9XDzveLOX9Ya+uwnzXNVpdflq9ssz7xWv5n8bu T8nwF0OQ60FrzzLNsSiVei//hGC4DLZGyXmFWQ36vNDRkEjaCUttN4PY9rNH88GMc+ qUs46FV0/ZINjKNkwOi+UQ7GbtpX4BmFY0F4Fvb5y/bd6Kc/le46wgPHxiG/IXREl3 pLtVnEKpkSNHw== Received: from madness.proulx.com (madness.proulx.com [192.168.230.122]) by joseki.proulx.com (Postfix) with ESMTP id AA5407A05F for ; Sun, 8 Sep 2024 14:00:45 -0600 (MDT) Received: by madness.proulx.com (Postfix, from userid 1000) id A086BD229F; Sun, 08 Sep 2024 14:00:45 -0600 (MDT) Date: Sun, 8 Sep 2024 14:00:45 -0600 From: Bob Proulx To: freebsd-questions@freebsd.org Subject: Re: building a 14.1 workstation Message-ID: <20240908134405694174552@bob.proulx.com> Mail-Followup-To: freebsd-questions@freebsd.org References: List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-questions@freebsd.org Sender: owner-freebsd-questions@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.68 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.982]; DMARC_POLICY_ALLOW(-0.50)[proulx.com,none]; FORGED_SENDER(0.30)[bob@proulx.com,rwp@proulx.com]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[proulx.com:s=dkim2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; ASN(0.00)[asn:397142, ipnet:198.99.80.0/22, country:US]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; FROM_NEQ_ENVFROM(0.00)[bob@proulx.com,rwp@proulx.com]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[proulx.com:+] X-Rspamd-Queue-Id: 4X216s3JkNz4FJk Doug Denault wrote: > Not to bury the headline I can not build a 14.1 workstation and can not > believe I am the only one, but have seen nothing on this list. > > 1. Installing from pkg > This installs 384 packages with the following problems: > * there is no chromium > * firefox will not run, ending with an error loading a dynamic > library This is a routine problem every time a point release happens. I see this routinely and it is routinely reported in the IRC channels. At the time of a point release the auto-builders start building the latest commit of all ports. There might be failures due to the upgrades. Recently x265 failed to build. This causes a lot of dependent packages to be skipped in the build cycle. Everything dependent upon it is then skipped. Including firefox and chromium. The build might take several days to complete. The result is that the pkg repositories both current and quarterly might be missing major cones of dependent packages such as recently both firefox and chromium were unavailable for several days. The ports will be updated. Upon the next auto-build cycle the updated ports will build. This again might take several days. If the fixes were good then those missing ports will become available. Again this happened recently with firefox and chromium. This was quite the topic of discussion in the IRC channels at the time. This is a problem for anyone installing a new system. Because the new system has nothing and needs to install all of it from the pkg repositories. This problem is not usually seen on existing systems. I as a desktop user rarely notice these build failures because I have a running firefox/chromium installed and running and available to me. It's only seen as a delay in the availability of the next version. I have a working web browser and eventually when the repositories become available I have an update to one. I have multiple machines. I can share my /var/cache/pkg/*.pkg local cache directory among them. Again it's not a problem seen then because these other machines can install the previous versions from the site local cached files. For the users installing using pkg (like me) this is just a routine problem usually seen when the entire world is rebuilt every point release. It's not usually a problem for mer personally because I have a populated /var/cache/pkg/*.pkg directory of previous versions and I am usually upgrading not installing. But for the community asking for help in the IRC channels this is a routine occurrence. For me this is one of the motivators to build from source locally. So as to be able to locally set the priority of build in order to build what I need at ahead of other things. To be able to apply local ports fixes in order to be able to keep moving while the project global auto builders are catching up. Which to be clear is a huge compute intensive task for the project. > To attempt to get around this we are using poudriere to build the packages > required. The results so far > > 1. 382 packages were build taking considerably more time than 49 hours. > We did not know to save this number but think is was more than 60 > hours. Our build system building about 400 packages is comparable to > the 14.1 build, I think, because it is a 3.40GHz with 8 CPUs and 16GB > ram. We are running with the poudriere defaults > > 2. First run built all pkgs except highway and rust. We fetched the > correct version of highway, 1.2.0 and restarted. This built highway > and failed on rust. Fetching rust to the correct version, 2.58.1 > fixed this. All built okay from that point > > We have not built and tried this repository yet, but I can not believe other > have not encountered some of the problems we did getting to this point. You are definitely not the only one to see this problem. Bob