From nobody Wed Oct 2 14:39:32 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XJcsJ34KJz5XcM0 for ; Wed, 02 Oct 2024 14:39:48 +0000 (UTC) (envelope-from dsdqmzk@hotmail.com) Received: from APC01-TYZ-obe.outbound.protection.outlook.com (mail-tyzapc01olkn20826.outbound.protection.outlook.com [IPv6:2a01:111:f403:280c::826]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XJcsH6pGDz4ndZ for ; Wed, 2 Oct 2024 14:39:47 +0000 (UTC) (envelope-from dsdqmzk@hotmail.com) Authentication-Results: mx1.freebsd.org; none ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=sPUPD0/EIGVODiVBOcnYp/LYywJkyyZ1pOCWM6+77RIJPmYM0fsnp0OQJbTE7FtxaV+eEzHwsWNSZMoIx4Iq5yqibbECjgqgzOKlFK8bt+VS0bdjT7QxHloVeXIZAOhpyf/lMAsfXoZOedT3M4EZHVUNUEdvVLxcVP3lGtdRqtAc1JppsklgMrq3d5AokYaXQQEoSkWLVMZL5xbl2kNCkon/8AWguZy0SANu6rPTX635dcc0yzsyTZQAzgIUCFP4FboMz1CehMsZBNOig6vTJtTJyxe8rZ5VrCTnJmO4Wqdao6VB2sD230B0A5G9cY38h2aFWMJGyWc0Ag89YXjmPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=s3Ndanpkhopy6ml3GSSrVwAKuKuz4+l+2m7FcJQVK2s=; b=eQalAV0XTy7+DRhjpFX3ZpzGIhboB68tofgODABHqDECgSI/IPGu8uri3rQHtWaxG9rxOX75HfqymgLvaa3j2674oEBpU6OOJdm3PKK2IldYQhHok2dVVSOhwb9IY6dvZk8KIluw3wEDjFkuM0gEDnfR/cSKLZSqUPGVQr2zu6GBfkZsrHVFnSoh81A/z4fbcRQLW1Yc1Zs3kALSkUXxSFIDlUI6FaTzBK+jNptw9p6ygdodS667rYcoSA/AEuf01PoDDNM5NTwFuQurYFZ8Xu7ZTnPM8xkJwT3D/e6oCzaZV8DxUdMY2PhlPjqK3hqm6Xpe9lkb1Pv4kiOyupaxBw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=s3Ndanpkhopy6ml3GSSrVwAKuKuz4+l+2m7FcJQVK2s=; b=hREZbEneV5ntnb6gz7G192wwm3ouSHF7ZQ4iQVJi4jSiMWV4VqonbF39MxKjiOdfr7d0lgJ+cCLU4nk1SeCHOpyMZxpY3NAFryN2/jVgUcfITZ3NYOuqMZwJ2BIcPTjtIxediAd/BDQlPccABOUXDJYjZdyeib7iCo/0t9CVXqZBf3G9GIOABZF3rN8SUJ0RBe+dMvqjwOC8auGI05gCBuxwLDGWnBotVh1Ptoj7wA0iEY8InFracmXs1JWI2pSlgWmOXeRZVRqSD8/JBXsWp0tmzbMQ1zcm9FISrw/op3xysFxfKVRlwVRj+uSeufFQt1H0At6/Our6aRntKQcorw== Received: from SEYPR02MB5821.apcprd02.prod.outlook.com (2603:1096:101:5e::9) by SG2PR02MB5723.apcprd02.prod.outlook.com (2603:1096:4:1cf::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7982.32; Wed, 2 Oct 2024 14:39:43 +0000 Received: from SEYPR02MB5821.apcprd02.prod.outlook.com ([fe80::ca37:e2cb:31c9:9d60]) by SEYPR02MB5821.apcprd02.prod.outlook.com ([fe80::ca37:e2cb:31c9:9d60%3]) with mapi id 15.20.7982.022; Wed, 2 Oct 2024 14:39:43 +0000 Message-ID: Date: Wed, 2 Oct 2024 21:39:32 +0700 User-Agent: Mozilla Thunderbird Subject: Re: FYI: make's "max_jobs" needs to be separated from -j (now?) To: Dan Mack Cc: freebsd-current@freebsd.org References: Content-Language: en-US From: dsdqmzk@hotmail.com In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ClientProxiedBy: CY5PR16CA0002.namprd16.prod.outlook.com (2603:10b6:930:10::23) To SEYPR02MB5821.apcprd02.prod.outlook.com (2603:1096:101:5e::9) X-Microsoft-Original-Message-ID: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SEYPR02MB5821:EE_|SG2PR02MB5723:EE_ X-MS-Office365-Filtering-Correlation-Id: 937b643f-894f-4f8f-85b7-08dce2f00d9d X-Microsoft-Antispam: BCL:0;ARA:14566002|15080799006|19110799003|9112599006|461199028|6090799003|5072599009|8060799006|3430499032|3420499032|440099028|3412199025; X-Microsoft-Antispam-Message-Info: uSHrBWnN5u5al4dvPODcW+pqXHtI3Q7YWuITqjaSmshR/5b1bW2l4ehKkrWjnW8R4adiFYNsN9XZyN/6ETCHJe7pwupgeh9BnRPe0fn/FLUsmS8CKl02pA7e3D6lIVaUut8wWOcA1Sre7NFHA9VVYQKf33DKlX7ypTWDRM99HrVaz1uebiHffONVdFyD/6VcR5ceeDjONJtWI1PjVNWxs20aOR8B4rqZMtF5DrijYHKLlQUro3j/KXIi2ms91Bse7BXaAgV3jKLVTEkpZ1rQiwa/sQso+vVWWxzovYZx0JngdF51HUVPjQFEsj1ymMFve7Z2r6/WNDDVsu1u3nGcfHMlfObgs4rxUqPQK7u8X19Tb8AuCIPM2kPRc/mUBzLzgkPzOi8COi4ubQTHUbOMPxT9PQedL+o3PQsgMKxf9MR2sPIY7kpWxJS3rtYc90rrZxLlPqh5i81lL4isl/T8x9UQQZmG5326zaJ1aQifuTH+RcLbpTKbKslPtwTsS3A2A8/Gu9dFfFxFy5dWD6ZhDvzVpun4kfGsDyXn2ubmHxWz0s3GeVL0jy0AKX+dKp7py+v7zaV48LFedmY8UaRqPJmac/y76RXNkOPIxqtHSt3uhxumfEFhlNIgAeawCeXHArCuug7a1QZmQZw3adgtS85mg6Jafl7tknGEI7ehk1rTCyV3NQizn6l5HvsnuL4HS5PAjxwRbmesmcAbVTcVvhOVxGUSt2dFZOPEJw8hkQsAE2dHnlDJXWilfV1Ff8a4HzzSjbs1lgrVp9u9aqfFgQ== X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?dlJSdU5iSHRMV0JuRjhLMTROci91UkVObUJ5NXA0UktmS0l6WElDTjdSMXli?= =?utf-8?B?OG5xaFVIVTFxQjZTeHVhUzd2WlYvOE9EUWtGcW9LVDg4NGJhWWxUb1NYcGF1?= =?utf-8?B?VTBCQ2VpdEQyZWV1Z0xTMXdCcXlZUWVPcit1WFlPdjJQa2tScjZocmY1VFVa?= =?utf-8?B?MjBKSkZuL3A2VW1SdUQwVVNtV0h6TmxHWFFFbVNDT1BnNFlLRnhnYk55NWk5?= =?utf-8?B?ckE5a1Z3WVdmQTgyMkJVMVFUL2JSTUhXWHY4VzlRL0lZYzhCa2RySURwSXMw?= =?utf-8?B?ZWFlWnlZZnpPdXo3VjA5bm1iRHppRTFsMi9IaDl3eXZ3MG9VY1FGQUFaZ0hl?= =?utf-8?B?KzZwcHZNNkRlMVpRaUluR1Z1VllVV1RQRVZHU2FyOHYzUnpuWHRYMGppOGVF?= =?utf-8?B?U25XcXNCZFREelhQQjkxdk9rVVdqbGE5YmRxbE85Q05LQmxTT2lBd29lOURR?= =?utf-8?B?RlhWbWgvWVowaWNoa05Yb01KVyswdExQWnhnR1k5a2JScWtDeW5uNTFKYUJZ?= =?utf-8?B?Z0UxLzhXU21KMGlISHJZSlE0Nm5iZE5ybXlRK1BXNk5xY1RSR1cxSGViZjEr?= =?utf-8?B?Q0ZnaWV3ejEvZmloZ0VSR2JUZDNZUHFFRTRNWGo3UWFMMFBWa2NaK3lCcEw5?= =?utf-8?B?ZmlWUU84bTZnK2phb2FvQlVJMk1QWTZ1aUYzVTV6OGNPalpGQytUYkRjS29W?= =?utf-8?B?MVY0MEtjdUtQSFY3dHFad05oY002RWE0c2F3b0RPdWc5QVRES09nY2NkVzVQ?= =?utf-8?B?Z2J0d2VnK0xDYks0ZVVxYXlId3RDcVdVUTlCSFN1TGhEZW16U04vWWpLdjRx?= =?utf-8?B?Rldya1I2U1I0Mk45UWhWbm0yY2NFbjNOODdFT0pPb3d2dmpZZzl4N2o0QURr?= =?utf-8?B?aXdaTUhnbHgzVDRKaE92cEVkWmM1a3BCaW4rRm9SNGhLQitMQVBNanF4REp3?= =?utf-8?B?djhSSlh1VXRGSzNNMEI2OUJVblFpUENiRDBYZXFpWEdrMG9qZTFLbCtROWhx?= =?utf-8?B?RGx2TitKYXFvbnhsaXplV0lBMGcya25NVHRQVnllZVdNOXd4cC9MUzVsamE3?= =?utf-8?B?OEUyQ1YxaGl2SnhVTFVrRFBiai9QN2JYdFgzOW5oZDNZTWluS2FxNjJ1allK?= =?utf-8?B?bjUxRHRxNjViVVpVdEtiSHd5YUJsdGtCZ3luVXEweXZYbll3QmpSaGNQRHls?= =?utf-8?B?TlNlRnlyaDNpcmZRaHdSN1dUWkdtaUlFaVNiM0dUeXRIRXlTdkZFK1pMRlNW?= =?utf-8?B?Q0NKaHlEejZkNFZwbm5FenJwY3NGK1JtUTErdHhOWldiVGYrS1hOOUg3aVFV?= =?utf-8?B?VVRmN2pDQUdGd21lWG5vTktySTJSakpNT3ZhYk8wK3RqWVBTWVZmbThFSnls?= =?utf-8?B?RkxQSFpGb09LT1o1SytrcW1Cc2E0RVU0ZFZ4QUJYeC85RWY3M3UyYk9XeXgz?= =?utf-8?B?N2NmclhEb1NySGtmbXRsODFxRWdlREcvZUpUTVlyUHRUL29sVEh3Wno0eWlB?= =?utf-8?B?bnlmc0VZZ21mZjNxOGlUcVNIVWQzWHJrNEpuM21tY1IxUkFXRWU3QzY1MHIw?= =?utf-8?B?dEp5bllXYm9EckxrSVlDTFQyS21DcU9PZ1l2RjVnMEFSSWliTkJOekMyMHQ5?= =?utf-8?Q?Kaxv8teAiHTCw/ie1WH0bYjEec2aJhsxnAG1ngOOeo+M=3D?= X-OriginatorOrg: sct-15-20-7719-20-msonline-outlook-00f13.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 937b643f-894f-4f8f-85b7-08dce2f00d9d X-MS-Exchange-CrossTenant-AuthSource: SEYPR02MB5821.apcprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Oct 2024 14:39:43.0956 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2PR02MB5723 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US] X-Rspamd-Queue-Id: 4XJcsH6pGDz4ndZ X-Spamd-Bar: ---- Dan Mack wrote: > On Wed, 2 Oct 2024, dsdqmzk@hotmail.com wrote: > >> David Wolfskill wrote: >>> I have been tracking stable/ and head (daily, with a few exceptions) for >>> many years, now.  Over time, I set up a set of ([t]csh) aliases to >>> simplify the exercise for me. >>> >>> Until yesterday, the "make -j${max_jobs} buildworld" construct had >>> worked without issue, but (yesterday), the invocation failed quite >>> quickly: >>> >>> | Tue Oct  1 11:54:18 UTC 2024 >>> | --- buildworld --- >>> | make[1]: "/usr/src/Makefile.inc1" line 362: SYSTEM_COMPILER: >>> Determined that CC=cc matches the source tree.  Not bootstrapping a >>> cross-compiler. >>> | make[1]: "/usr/src/Makefile.inc1" line 367: SYSTEM_LINKER: >>> Determined that LD=ld matches the source tree.  Not bootstrapping a >>> cross-linker. >>> | -------------------------------------------------------------- >>> | >>> World build started on Tue Oct  1 11:54:18 UTC 2024 >>> | -------------------------------------------------------------- >>> | >>> Deleting stale files in build tree... >>> |         0.14 real         0.23 user         0.10 sys >>> | *** [_cleanworldtmp] Error code 6 >>> | >>> | make[1]: stopped making "buildworld" in /usr/src >>> | .ERROR_TARGET='_cleanworldtmp' >>> | .ERROR_META_FILE='' >>> >>> On a bit of a whim, I tried adjusting the "max_jobs" values (downward), >>> which didn't help, but removing the "-j14" entirely did not produce a >>> failure. >>> >>> On the other hand, rebuilding clang/llvm with a single core on a laptop >>> (when I actually want to be able to use the laptop later in the day >>> while I'm at work) didn't seem productive. >>> >>> A bit more rather randomly "trying stuff" yielded the result that while >>> >>>     make -j14 buildworld >>> >>> failed (as described above), >>> >>>     make -j 14 buildworld >>> >>> carries on as before -- it's building lib/clang (and using multiple >>> cores to do so)....  :-} >> >> Just got the same error, but both invocations didn't work, and I noticed >> that bootstrapped version of mtree failed to run because of (now) >> missing libmd.so.6.  I think it's not really related to whitespace >> between -j and jobs number, rather you had to (re)build the bootstrap >> tools. > > I have been building current twice daily for a while and didn't notice > this regression but I do have the space after "-j" > >   #!/bin/sh >    make -j 16 buildworld              > /logs/bw.$$ 2>&1 && \ >    make -j 8 kernel KERNCONF=GENERIC  > /logs/bk.$$ 2>&1 && \ >    sync && reboot Do you also do `make delete-old-libs`? > I grepped all my logs across 3 servers and did not see a single instance > of [_cleanworldtmp] Error code ... in any of the logs.  What was the > hash of the build you were on there, I can try to reproduce it quickly > (but it might only trigger with your builddir state I guess) If I understand the problem correctly, it should be as easy as: 1. build on pre-e7a629c851d system 2. install/reboot 3. make delete-old-libs 4. try to build world/kernel that fail as above, and, I think, make kernel-toolchain was the one failing because mtree failed to run (because of libmd.so.6 gone now) In any case, wiping out /usr/obj solved it for me.