From nobody Fri May 30 14:13:40 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4b84wg68qNz5xjcZ for ; Fri, 30 May 2025 14:13:55 +0000 (UTC) (envelope-from wschnr@googlemail.com) Received: from mail-wr1-f54.google.com (mail-wr1-f54.google.com [209.85.221.54]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4b84wg0YzMz3Jkf for ; Fri, 30 May 2025 14:13:55 +0000 (UTC) (envelope-from wschnr@googlemail.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of wschnr@googlemail.com designates 209.85.221.54 as permitted sender) smtp.mailfrom=wschnr@googlemail.com Received: by mail-wr1-f54.google.com with SMTP id ffacd0b85a97d-3a4e742dc97so2076082f8f.0 for ; Fri, 30 May 2025 07:13:55 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1748614432; x=1749219232; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=fsYPHZ+KnzZ+7a9gF/hkZ6ahmqaf7Icfo3YMw83Dnss=; b=f7JVFw83JlU1zN9XPCMROwQpC99HeqSN30uyobqJya2/q9vvnEQ4If15eUtABZ00o+ tWzwAytP6mSLCUlAo3uMnqqkHv345RqcXNV5sXeucMErDlyyzTee1j2vS9TtiHrZWDGM Sbiw0nYmYd8VSDeVTR6gtOGSnxfDAAvUavGizAMinisi9N1dtcsi7NSJHfnA1oAKBHnO wvluVXCF/83Xe1AWG1Ig9m8mxCmXKc55ZCKUxkiuDbSIA6jueeL/sV1XIxNn9aV++VPe 6+L9IVATFnE7xzZJJtKlENSk6yMGKSvOnooWq5H3sSQDq+28MpNV3dF7DDDQjA/kBZFC zIRA== X-Gm-Message-State: AOJu0YycAm3jl6437FdqIKD50ly6IV5AGz8iQykOJFZ+B+1Cwo8K4DzO VtV5o0hN/wp+o/PhjTQcGmExyKJmoIZ+C+GYCSK7id9NE4Df9qwRba5vVDrm7TwYYSLRsbqj+Y9 yRGrD7a7nf7kcJdzQ7viXUmIYlL5JLlxlz5O1 X-Gm-Gg: ASbGncsoue30N/fPXNzkSM+O0MsgOUYD5eFIVM9lGb77OqDXEbg+4n0sLOohvE3bIwI rkPci3hy3iXoZ9blFV5uQuUcJcAbHYwBq8Vo0MtWZefh/ts4sl/NYTxGtkadblwvB4gewZy62A4 KR7DqR2HkTEg2A1yotBXj47QdtpvPwhKw= X-Google-Smtp-Source: AGHT+IH5iRm2a0q7Vj5IjIByUcyky3cuvB2gIfXmYGqZhj+YgDLhzKcybDCZV2T4schb7JnAbdLxEzpsxtkPgFEzxe8= X-Received: by 2002:a5d:5f47:0:b0:3a4:d685:3de7 with SMTP id ffacd0b85a97d-3a4eed9562dmr6902143f8f.8.1748614432461; Fri, 30 May 2025 07:13:52 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 From: Wolfram Schneider Date: Fri, 30 May 2025 16:13:40 +0200 X-Gm-Features: AX0GCFthDk5gEISqPp5V0zMit2bEQ2TlMvzwuSp6I-8_rouvgxB6-ku27KShEbk Message-ID: Subject: fine granular buildworld time statistic by stages and subdirs To: freebsd-current Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [2.08 / 15.00]; NEURAL_SPAM_LONG(1.00)[1.000]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; FORGED_SENDER(0.30)[wosch@freebsd.org,wschnr@googlemail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_SHORT(-0.02)[-0.021]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[googlemail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.221.54:from]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.221.54:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[wosch@freebsd.org,wschnr@googlemail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_ALL(0.00)[]; R_DKIM_NA(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Queue-Id: 4b84wg0YzMz3Jkf X-Spamd-Bar: ++ For the `make buildworld' we log the time spent in each stage (bootstrap tools, building libraries, everything etc), as documented in https://www.freebsd.org/status/report-2021-07-2021-09/#_current_compilation_time_analysis It would be great if we have more fine granular statistics based on the subdir targets. It turns out that is pretty easy with a wrapper shell script. apply the patch from https://reviews.freebsd.org/D50534 $ chmod 755 ./tools/build/time-buildworld* build the world $ make buildworld > buildworld.log The generated CSV has ca. 2800 lines $ ./tools/build/time-buildworld-csv.awk buildworld.log > buildworld.csv output example: https://people.freebsd.org/~wosch/build-time/buildworld/buildworld.csv https://people.freebsd.org/~wosch/build-time/buildworld/buildworld.log.gz The statistics will be generated as CSV, because this is a very simple format and runs on a base system without ports installed. Comments are welcome, Wolfram -- Wolfram Schneider https://wolfram.schneider.org