From owner-freebsd-toolchain@freebsd.org Fri Jan 3 22:35:09 2020 Return-Path: Delivered-To: freebsd-toolchain@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5ACFA1F1AAD for ; Fri, 3 Jan 2020 22:35:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47qKV42xDVz4S8j for ; Fri, 3 Jan 2020 22:35:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: KmEFpL4VM1nygK5Vavt1gvuisdl3Ia97LGvvZRAP8NFYKLYYGwRwnN_jLc1CQPD RWatfVZ04LqATPc4J2cpUAEccmrp1hDRl.eo9jaTGUnAVmAmJ8veksbiRfwxrr4PVjTATWzTnJRh Kzw4jXXeRXmK_jXi60OF.u_Rjz74T3YnTvW_yD._CYjW6NeeSJRSmqrIO6ivW8dkjOlqkh23Jq0. zzqsFOl2z9nDtFPpq0xaHfi2OHPVdrymApaG01Y.lD5Q_OZbCMeNqBIvhvmb69uBY_CcpzaHUjV. MxftyNTqSljD108rmRpU3W4TH3c2rPb.zY1.8oB2rUj01E5t1u5FK1wq9g1xQzvsrVAKMNoDI5.v ga.hkDfYsh32vjb.gZaK_T7hQYv8cy96LX3pxT0vtyDXsgNK8TwC6hTnInXsaIeTxo4hqCSsCHia cS0crqFMEDrWHVgdEpQ.CcJoeKKw8Z9MlEhh48rOTZ7qdWbfB1d5HiHanas3kydCBHoOYIrUhT1Y w6n.M1pARTTZcB23o7ucBZRYOXR27KiV5tzOn71DPcEN0yITaeazFhD1frdZXDd.2p1cZRiNkR22 qwaB630hNYrIp4uX1VJxp2TCC_BvekfLjSJVvqMtENxu3_jKb88A9l60P5Bl66zu9v7XMTs2r07o lOmq1OayplKyHpBjVEXzWGHDLOP07mPz5knLGcOQu4IoVf9eP0vQjlk4GTXLOuT2L_RIXplEOF2l WFNps._hyLmb9BKHJSGaqheoHzAvtaxQXuQ7xI3JqQ0Jf9o4c9569nepB2NFt0aiugbEaFNEnk5f JpB4vuNf4ZFMfLqUvC51MY9FIFD_t6QTTagpte8cO0X6oMpuWM4L1DSFuoDQgbrqnmJmEV8cQC4d 289vKOkkZcZ4SFGpBNvGx_ulJv6xRUL_bbuCEGprCEMimk5YMBxOx3yD.7A9Riuzc9XVjFoYiJpj QkoSfouaYPBOyHjoC29RCIrX56cc_dcdWgaSrUlBOhfC0tKKscqfNOSR6epbpCJU9aSF6fJ_WSCk Abl2XCWH0yVmw4NMYXZbus2eqXtT8IpjJfvWJ51NkxO_iOYQKkvU6mmyxSMKpc689ifSufeD_uEX e35Ufi4rq7yO1YwMf5zXbGN0AFSs02Rzr05KEmmJKS4o0I54aXdRwRcECTZOlOKabWd8h4C92hZj 0DxqScKERWR2Z74zQqbrlO5ZApdlK.KR9m7_NdYDamsotkwTKVxcgees5toBMFcLfXY2pHLR.bpQ aXTooBIv4l.ogJMFvqYBLde5i_v2G1SjoPLawpYIa_Ub50SPCE2n3VRnGn8m18Bdmepr2fhMu0hb o821pcFIBMwof0j_9l_TEKwAyww7VvnK0ZaYlpBDyGJyTx5InwUZIYKnwTvZBgSbpJuGsHGeiEUz rkspE6gOdhxkiOQj1n4ZHd.3_QS5kO.t1kA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Fri, 3 Jan 2020 22:35:05 +0000 Received: by smtp405.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID b7e99f74f31230abbb73da5ba5ff0a3b; Fri, 03 Jan 2020 22:35:02 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3608.40.2.2.4\)) Subject: The 32-bit powerpc FreeBSD early-boot "tfo_ccache_bucket panic" on (2 socket?) G5s: visible at -r356118, not happening at -r356109 Message-Id: <157118DA-71A7-4085-987D-CD659370B9CA@yahoo.com> Date: Fri, 3 Jan 2020 14:35:01 -0800 To: Justin Hibbits , "bdragon@freebsd.org" , FreeBSD PowerPC ML , FreeBSD Toolchain X-Mailer: Apple Mail (2.3608.40.2.2.4) References: <157118DA-71A7-4085-987D-CD659370B9CA.ref@yahoo.com> X-Rspamd-Queue-Id: 47qKV42xDVz4S8j X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.48 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (0.02), ipnet: 98.137.64.0/21(0.88), asn: 36647(0.70), country: US(-0.05)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.984,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-0.996,0]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.69.137.98.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Jan 2020 22:35:09 -0000 This is based on testing artifact.ci.freebsd.org 32-bit powerpc materials on some (2 socket) G5s. It is the later FreeBSD head revision that causes an earlier boot-failure than the other one that I recently reported. There are no 32-bit powerpc artifacts between -r356109 and -r356118 (non-inclusive of either end). This limits how specific the evidence is -- but also avoids getting my personal builds involved as a potential problem source. I'll note that -r356111 was for: Use LLVM as default toolchain for all PowerPC targets and -r356014 was for: [PowerPC] enable atomic.c in compiler_rt and do not check and forces lock/lock_free decisions in compiled time (and would start to be put to use by -r356111 and later). This suggests the possibility of atomic-activity that is insufficient on the example G5 machines. (I only have access to dual socket G5s.) But I've no specific evidence about the llvm generated code leads to the tfo_ccache_bucket panic. The crashes look like (typed from a screen shot): . . . Timecounters tick every 1.000 msec firewire0: w nodes, maxhop <= 1 cable IRM irm(1) (me) firewire0: bus manager 1 . . . (1 or 2 lines that only sometimes show up, then) . . . panic: lock "tfo_ccache_bucket" 0xd2858008 already initialized cpuid = 0 time = 1 KDB: stack backtrace 0xd00048b0: at kdb_backtrace+0x64 0xd0004910: at vpanic+0x200 0xd0004980: at panic+0x64 0xd00049c0: at lock_init+0x200 0xd00049d0: at _mtx_init+0x7c 0xd00049f0: at tcp_fastopen_init+0x1e8 0xd0004a20: at tcp_init+0x234 0xd0004a50: at protosv_init+0x1d4 0xd0004a60: at vnet_domain_init+0x5c 0xd0004a80: at vnet_register_sysinit+0x154 0xd0004ab0: at mi_startup+0x280 0xd0004af0: at btext+0x74 KDB: enter: panic [ thread pid 0 tid 100000 ] Stopped at kdb_enter+0x74: addi r3,r0,0x0 db> === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)