From nobody Tue Dec 13 04:02:10 2022 X-Original-To: ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NWPw64N3yz4jhRN for ; Tue, 13 Dec 2022 04:02:30 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sgaapc01olkn2065.outbound.protection.outlook.com [40.92.53.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4NWPw544mdz423d for ; Tue, 13 Dec 2022 04:02:29 +0000 (UTC) (envelope-from tatsuki_makino@hotmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=n98JRFlE; spf=pass (mx1.freebsd.org: domain of tatsuki_makino@hotmail.com designates 40.92.53.65 as permitted sender) smtp.mailfrom=tatsuki_makino@hotmail.com; dmarc=pass (policy=none) header.from=hotmail.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MG00kyri1ZEO4eFxHQvBPFaz1swmiFztmQtCD8fC6OMlb3cbTLRDsiYrXYaHrVZgnu+zIwUmKqUE3wpwtJVdIggndn8SE9pg+7/IgOb7ldn1RkLYbwehZiljRg+Ypef/ochDSK5Sgul5zmOQ9kbhN9a/QhIJ8hVWkhgURRysO8p1CS+4EmpckpDW5FyruKfIgrS2RXCCZVi0jfj6W2LCRfnTqorERnWPa1rGKGmh7Zv3y56vqN7OfHgmYuL/i+liMnMDWSNppbzVBdcjW2t+kiIEjGuqEfqFSJsaLBljj/BnWrqMQepWQZsIUjAH5cxpsYsThdOHSE90dS1cHYvO3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PFFyD9Gs22z/y6CbKLhhcIGMl9H41X1Vkjr0VBEHuL4=; b=KxqXB7ErudOeUZc9vGyNp10mejMN/xNxDrUAA75m5/t+Ascc++yI4UupXkqBQnnl/rDqyem8MG8nIFT0vIAs8kyula0UvoW8eFLT2Q2N3BuYSJzU0lALD3niz45Ed2hpt52OjsOP24UaK8Xo2a8PiQfK91G7cPK6F52zVjuvk5gwD+hiJLOEy9vJgnQ0oGFloVzHBbLqoDzh/5Wv1tyTsFjIx1KCcG8ktbeHTDBcgzk1X/M07l3KvtuJibH1/RzkI48Pnh891nXbMnCncxxIZhCFTrbLPJg1Cvl/r+A/hDhCqhwKr8EiAJLw8gM1CdLui4VljbZPxwCLBLgZvlNU0g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PFFyD9Gs22z/y6CbKLhhcIGMl9H41X1Vkjr0VBEHuL4=; b=n98JRFlEtb0nCZ9wVvp8uHSBeVMBiUXHe+84V+dNuWTFKGJzQceC4yMGJp9MMaDcvEnkImPNYATwhnBVGXnDx6pEFSUTvdK2pv0UrjyqnaGyNRWJzA4ATMejnGDNh+in4f3dOkcZds6xJqHW5GPRnqr/65ZcYB3yib8RgFriqDTnEIIC/tNO79Zkouy4X/cLB5AQnVMs0UZyZPqhqcO00prp5uLf0Djs2t32nh2SK0+mPJKCmb8C/vzGpxFD1EStsvKhqsIlA6R83CnQrtv6RbxF/9x7sgI2tgdC9m2RDDO0oFGygI8G4wY2frD3gHAVewOE4XQJO3TyqbhaeYkooQ== Received: from PSAPR03MB5639.apcprd03.prod.outlook.com (2603:1096:301:66::13) by KL1PR03MB5555.apcprd03.prod.outlook.com (2603:1096:820:52::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5880.19; Tue, 13 Dec 2022 04:02:24 +0000 Received: from PSAPR03MB5639.apcprd03.prod.outlook.com ([fe80::cfcf:c96:dd73:132]) by PSAPR03MB5639.apcprd03.prod.outlook.com ([fe80::cfcf:c96:dd73:132%4]) with mapi id 15.20.5880.019; Tue, 13 Dec 2022 04:02:24 +0000 Subject: Re: lang/rust is super slow to build From: Tatsuki Makino References: To: ports@freebsd.org Message-ID: Date: Tue, 13 Dec 2022 13:02:10 +0900 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.4 In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-TMN: [LLZZZloaVUCHN9ItOyNnslzxq67HPdyk] X-ClientProxiedBy: TYAPR01CA0074.jpnprd01.prod.outlook.com (2603:1096:404:2c::14) To PSAPR03MB5639.apcprd03.prod.outlook.com (2603:1096:301:66::13) X-Microsoft-Original-Message-ID: List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PSAPR03MB5639:EE_|KL1PR03MB5555:EE_ X-MS-Office365-Filtering-Correlation-Id: 690ad6a5-205f-4e18-054f-08dadcbed70c X-MS-Exchange-SLBlob-MailProps: bHQ38DpbEWCsqvPjDa8aPCLAprvFY242eJnsf9zInKnb0gsUfxiZpWBMqc9BOKyVsA4Y5w7i67YAFlWlr4wVojWQSmEh8OdUeZU8Fy4rQ7YjJkYxjC21LRWJ9bckr0cxqomukQedKpmtuxTc4AmQgcPrB+jbU42SohzxxPKhOpol2vjOmF6jYihzCJnptX0nwKE+g4YIboTO0SHnKACUPaI+KUW263myzEhuv7/H4hCY5uwReQA07CzHVLEv5Zce1gxTJDqYJuDwJXWuzlUSNKoIjg/HdrncqqQJTl9RrnydD9jR+Nm3UUof5G4kUekrV8zgKjexSf1tW9mPPAXdK2IgFlZYqKrm0ml00tCGC03wsNrvtxWQF0D4qbJ7XgnA3dPJbSl5ctuPKrMHQyheQFbwL4wA3/NM9BhSSYARcRw5C6JojtYBeL3L05bAdCKBfyg6pCYvsf+VIk9cWaBDDh649AgrQTSEavYf6x2uvphoo5qaRFTx6bWbs7WnY0yQiVtzAmrWE8k/gfVsl9d6NS5ojqr2i7/otpSTH7AjVWv0eO7CmNlh2jLEgMVdViWvSONavxLLGJ1x0/rduGZQAnbR6WnfU3/C/7Mrvail+Cl3m+Oo8arquPnl2vW0OIy5JsqrHdX4EkB4ZeQXNJLjs89EysKjit/RwAqxmwH8RbISAlcFRCTA/g== X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: VytecvQ5eDuh453x078R1nmuVfBlPYGDVEx7xSDPe4gJjDzGWFJscHIi3T9RKJheF9VbgFWuB2mejixPJRjfb/Ydx1MbwTe3+72oRDRDu1hrLg9AkrI9LKgVAHl1QvjHilzLZCjfpLAQJEBa5J4nSXjemg9URlRZ8NKNw6OvN8XI74HkufOeS/A+hCOpEoaup+HRwnXS9rqDVruyIWP15Oh4PvrarasmeHrEMxGseOIjFrhOBWo/27JiGAPhTW9l0TsmpPgncoi4N2oNSkrEC5P/+ylPXE0aMZJ6oj73/IQ5ImOQZ5NbzcpyV0v6EKHSZ0Ab9E7pWU0e4JKSuOyYBPQIvHgfyy0pTj7ACyNNvLwVd8/pSLXt/x89AyIA/2cnN3B4nwCO20SNJtrAxW0hZYgVed+DCxXdtdbHMdZ60Mm6mc4hcYqvwP/GBgEhJCXZ1m5qgMslt4mjIU3xeUsWjWN7cgMAFKOoRDc9wPl8McRctPmwPWQ/IG5tUgZeh5qJ3nCHkVxckDkCBdPxavDi6k67eDXTY2fafl1uwDKvRk0HWDlI4e2HtfAf/7pq2J/jYVkO1LnUsfmTrs8aTajAZCJCuDG0JKt6+WOh4VJBvRKzGBElV48PO25CcFVPwH+Z73L1ujpFkjaRzBcp+pPdZMKJfeAT3XtGSQnrYHbXFVwK9ymBJI06/wDhaqYPHQDO X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SHlrSGdveFdtRTRDbk9UQUsxdlZPRStiRmpzVk5HU0tyQzE2ZVN6OG5RWmRC?= =?utf-8?B?anJJcnN3Q2tYRWdJUDBFakRBbmgwUkI0d2c0aitDSTNMTHFsUFpQcEdmeVlq?= =?utf-8?B?QkUxMHFxL3Q2cXNhWGEvdVVLbGNtbXR0SlZJRHd4UGxabkJhbEMzUnhoTUhC?= =?utf-8?B?QlZuVHY1RzZia0lhcUhleDRtU2RTRjVRWTdnRlUxK29qU1VmcjVkVldVUFpi?= =?utf-8?B?bFpTNTMvUU9SUEd4Y0NCT1JvdWdjRklveTArcEV2S2IvQ3piY00xdjY4Q3hL?= =?utf-8?B?WENUNWNDWHMzeWRkK0g4bEppbEZSMzhramtpalVWb1B1UlZXYS91ZnpJSFVk?= =?utf-8?B?OStIVnQ2TjJIMGpXdi9qVlFIaS8vTjRwNmkxR292aC9BOCs4cUprRDVHWVBK?= =?utf-8?B?cUt3K2kyN2c3aFltRlV1TlR4UmJ6UjF2cm52bDUyN1dnTzloMGUwNVc3Si9O?= =?utf-8?B?alNaVUxmQUdPU1BsaCt6WkdybVNtOVlobXV6Y2p4M3BUWXBPa0xhT2g4dWVY?= =?utf-8?B?Z2hOUVNVdTVDaDJERU84RnBOdkFrTi82cFZpUDN3bkhlR0J1QnFiOFlvRHlq?= =?utf-8?B?bTc3VjhiRk1OakVXV1hMSCt4MkRtbkN3SmFaeldXNWJNRGtoTWxzT0g3Z25k?= =?utf-8?B?c3dPVjlwZFUyZlhZZEJkcGJwZjJJQzY2TFhtZFNZQW1aRTRZV2N6OS9FOVJH?= =?utf-8?B?MU9HeS9GK0RYMFdkalN5VEVZa2I3Wlc0UjBpUmhmVlQzSGE5cm0wSlNoRnJX?= =?utf-8?B?N1N0L3ROeGhod3VUYkNzYTk1dmpXbWRyVUpkbW1UNlJsN1NnNFIrdUYxZ3h2?= =?utf-8?B?cFF4c2prQmluR3JDd2RCaUxjOGl1c2lSVC9Qd3dpVEt4MXBFbXJxeG12NUdU?= =?utf-8?B?MnJobUxtcWhocmExVFdmQ3pUdFVCQWN5ZnhjVUpSNGducGcraWJjM1AwbVd2?= =?utf-8?B?Z2R3YXdVc1FZQlFSdk1nRzJmcG1YUGhTS3d0Ynp4VlJIcGg4REhkT3ZyWThx?= =?utf-8?B?Z2gyWXFLa2kyTlFVYVFTMWlyQjMrQ21XazZvUzdMd1g0OGZ2b1JDVytMdDk2?= =?utf-8?B?c1Q4em5sL09ycGJqa1N1SWtMZnZ2bS9EcEh1WDY0RXZEbGhBWFB6bkMzQjZ1?= =?utf-8?B?Y0tDWkRBaWttaytFTW1ZbHJaWFRIbEYrR096c1h5cHh4bTZSUnVoWWl5WTlO?= =?utf-8?B?R2ltZDVESExHaXpmcFp0ekVJYzJ4QmIrV2d5RkdydmVGM1dXaVlmeW5kdVBS?= =?utf-8?B?bDBIdjEzYkl6UXpMaWFyZEREY0c3dUw5RkI5L1M1bW1VRlpvWFQvWUFTWnZ5?= =?utf-8?B?TTNHemZqU0tsTUEvYVE3S1I0dVR0dGFCSThMdnBmMTZ4b01EV3hBbzQ0Q2c0?= =?utf-8?B?b0JtRTI5RHhXVER1Z2VBVWRHS1g2TnRuN3p1ZnNhNVlQQnBZeDNUNTRlVjY5?= =?utf-8?B?YmVOTnlscy9SNU9MY2tnczl4MHphQmh0TndDREM1Tjc2TmRDSGtLS2FwWlR6?= =?utf-8?B?Uk1Dd25uWFI2TW90dW9vNVkrWUNJYVpjdlNuc2pyZ2UrNy9DRW56SGQwRkph?= =?utf-8?B?aVpNQXNUd0tIdFJmNnBhM05DZzlLcyttR0dIUTZyVVZoaytmaGRybVozMVZM?= =?utf-8?B?N3E3UU1xaW9VV056YlBucEZScSs2QVZaMys2dWhmb1FoWDZrT215TFpacTYz?= =?utf-8?B?Sml2dkpMYWpUempIUkR0ZTBNLzY4SGVIeUpodE96ckNLTzQ0MW95d3RuTHlW?= =?utf-8?Q?QhdoS2Udz31W/rsTT8=3D?= X-OriginatorOrg: sct-15-20-4734-24-msonline-outlook-c0b75.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 690ad6a5-205f-4e18-054f-08dadcbed70c X-MS-Exchange-CrossTenant-AuthSource: PSAPR03MB5639.apcprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Dec 2022 04:02:24.0975 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: KL1PR03MB5555 X-Spamd-Result: default: False [0.86 / 15.00]; FORGED_MUA_SEAMONKEY_MSGID_UNKNOWN(2.50)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_LONG(-0.83)[-0.829]; NEURAL_SPAM_MEDIUM(0.65)[0.645]; NEURAL_SPAM_SHORT(0.55)[0.546]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[ports@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.92.53.65:from]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.80.0.0/12, country:US]; TO_DN_NONE(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.92.53.65:from]; DKIM_TRACE(0.00)[hotmail.com:+]; FREEMAIL_FROM(0.00)[hotmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DWL_DNSWL_NONE(0.00)[hotmail.com:dkim] X-Rspamd-Queue-Id: 4NWPw544mdz423d X-Spamd-Bar: / X-ThisMailContainsUnwantedMimeParts: N Actually, I recently created a spell to automate how to find packages that are taking a long time to create because of ALLOW_MAKE_JOBS* :) This is finding out what will be needed for more than 3 minutes. #!/bin/sh find -- /usr/local/poudriere/data/logs/bulk/latest-per-pkg/ -iname \*.log\  -exec grep -l --null -e 'DISABLE_MAKE_JOBS=poudriere' {} + |  xargs -0 -- grep -L --null -e 'build time: 00:0[0-2]:' |  xargs -0 -- grep -h -e 'package name: ' |  sed -e 's,^[^:]*: ,,; s,-[^-]*$,,;' It seems that 3.3.7_1 of poudriere does not save distfiles, so it is necessary to download distfiles in DISTFILES_CACHE beforehand. It is a spell to find the one that downloads distfiles every time the package is created. This is where it can take a long time :) #!/bin/sh find -- /usr/local/poudriere/data/logs/bulk/latest-per-pkg/ -iname \*.log\ -exec grep -l --null -e 'doesn'\''t seem to exist in /portdistfiles/.*\.' {} + | xargs -0 -- grep -h -e 'port directory: ' | sed -e 's,^[^:]*: ,,;' Did you find anything good? :)