From nobody Fri Mar 29 15:52:55 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V5lMT64DHz5Dc7H for ; Fri, 29 Mar 2024 15:54:13 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4V5lMT0D7Sz4N4v; Fri, 29 Mar 2024 15:54:13 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=TTbwRGXt; dmarc=pass (policy=quarantine) header.from=leidinger.net; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 89.238.82.207 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1711727629; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=gZftsw/W+dDARuHQ0w/mt9mb8A6HbPFPraUTyNBlP8k=; b=TTbwRGXtMHnEiUG2ELIbBrCwYqy+d3me4cRcclCoUn+/tQhRTDR7zlpccpn/aB5pcosCZb 5OirVfDHcNQzIsCznJ8RNUV7QnY9sN8GjPzlCQNqBjt/yjUPA2IWYdv186MrBX6yUpZagY NDt/CXHhXCrzjtXajNv9IbWIHvCbJ1TBZm7MLlm1/WWs3rd4+ksKLL5TINrj/BFbmvaNxf Dur7QDb3JTyMeliYT/BhhXP7BdP+koWqIJA09BZS97CMpeHkcb6ja9BKyWHaBEcv3MTyd7 vM5o6hOe9SczIF+vSMy2Reh0kVw6LcjAwjCnfSLSChVpOIom7Xc1sg2J4I++nA== Date: Fri, 29 Mar 2024 16:52:55 +0100 From: Alexander Leidinger To: Current , bnovkov@FreeBSD.org Subject: Multiple issues with current (kldload failures, missing CTF stuff, pty issues, ...) Message-ID: <09ef22679b76cb2dbeace8e78bf9f80e@Leidinger.net> Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_14c9a787fb6275db952b576fe533277e"; micalg=pgp-sha256 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.06 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.961]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; HAS_ORG_HEADER(0.00)[]; HAS_ATTACHMENT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MISSING_XM_UA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[current@freebsd.org]; DKIM_TRACE(0.00)[leidinger.net:+] X-Rspamd-Queue-Id: 4V5lMT0D7Sz4N4v This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_14c9a787fb6275db952b576fe533277e Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Hi, sources from 2024-03-11 work. Sources from 2024-03-25 and today don't work (see below for the issue). As the monthly stabilisation pass didn't find obvious issues, it is something related to my setup: - not a generic kernel - very modular kernel (as much as possible as a module) - bind_now (a build without fails too, tested with clean /usr/obj) - ccache (a build without fails too, tested with clean /usr/obj) - kernel retpoline (build without in progress) - userland retpoline (build without in progress) - kernel build with WITH_CTF / DDB_CTF (next one to test if it isn't retpoline) - -fno-builtin - CPUFLAGS=native (except for stuff in /usr/src/sys/boot) - malloc production - COPTFLAGS= -O2 -pipe The issue is, that kernel modules load OK from loader, but once it starts init any module fails to load (e.g. via autodetection of hardware or rc.conf kld_list) with the message that the kernel and module versions are out of sync and the module refuses to load. I tried the workaround to load the modules from the loader, which works, but then I can't login remotely as ssh fails to allocate a pty. By loading modules via the loader, I can see messages about missing CTF info when the nvidia modules (from ports = not yet rebuild = in /boot/modules/...ko instead of /boot/kernel/...ko) try to get initialised... and it looks like they are failing to get initialised because of this missing CTF stuff (I'm back to the previous boot env to be able to login remotely and send mails, I don't have a copy of the failure message at hand). I assume the missing CTF stuff is due to the CTF based pretty printing (https://cgit.freebsd.org/src/commit/?id=c21bc6f3c2425de74141bfee07b609bf65b5a6b3). Is this supposed to fail to load modules which are compiled without CTF data? Shouldn't this work gracefully (e.g. spit out a warning that pretty printing is not available for module X and have the module working)? Next steps: - try a world without retpoline (bind_now and ccache active) - try a kernel without CTF (bind now, ccache, retpoline active) - try a world without bind_now, retpoline, CTF, CPUFLAGS, COPTFLAGS If anyone has an idea how to debug this in some other way... Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_14c9a787fb6275db952b576fe533277e Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmYG4+sACgkQEg2wmwP4 2IZ9Aw//XUOLP9lAu3PuQEHkvcRr/lz+AZsLxxaWNWlBDEXexLnIMRe0Yc0N0J2l wQwtLUKSBkxHFLYb6zvb4fnnt5ydKiUo1P/BRhf3UtNFw2hiuX7/9uEf+QRTpsmF MHnqsHkg1gRFOrH2D/iVPwmsllnlMWe7D7AP57Cck2ZCmFc/PX+d4B8nMlRTTjOJ phEsfY7izcQTX4jymrx+OhKV2wLXExLKDeuzRRKYuGY1hUp3HmA28EMduClndqVB 64xVoqWwgW4XlzFpRFLoAOOOw02ZFmKcEVBBNNUfbogT6mxOWWp7lpOMj/dtaatl hE0dS5i4sDU8U5atFFK6agnyEC46osCUNtu51l8mv41qKzq+8fg8HaDZllUnpkyt ffh4BLYPY1MKms6mla+6pOG5pVlF+IZZMH3cimCCkc2ub+pmlLQtRJ7ewp8aDyx1 aWlEREB2k5XxcRbQFPbOhPcxq52P8oIUTnj+8mbOLnZbDSDHaZyZowg/nYYjnXc+ Xnu/YwCSvvFzZ9zj6KbsaGDXqPcGOCq51vNP7wxneQO1QxiOHBVwvCCiZKDHtvfT 1YvfT7d+5OREkeolJH4mHMrMOgzJ/dezV8TCDPI2IADWTBluxzjU+3tf35APDJNx nKfDZZ/0f9TMrQm9FQqR6IkjL6tH0szMM8cXV/H5dSQvuBOKR28= =x0qD -----END PGP SIGNATURE----- --=_14c9a787fb6275db952b576fe533277e--