From owner-freebsd-stable@freebsd.org Mon Jun 22 15:45:46 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F085330AA5 for ; Mon, 22 Jun 2020 15:45:46 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: from mail-lj1-x232.google.com (mail-lj1-x232.google.com [IPv6:2a00:1450:4864:20::232]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49rDJn5qdzz3X27 for ; Mon, 22 Jun 2020 15:45:45 +0000 (UTC) (envelope-from dwilde1@gmail.com) Received: by mail-lj1-x232.google.com with SMTP id y11so19881109ljm.9 for ; Mon, 22 Jun 2020 08:45:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=/6juimptoMMtP48zI2c4D0+m851jP3ciHVUpHlrbuFM=; b=sbgSLSYi3t9NNmP2zwkOe83dh0KiT+KHH3zibcWhPJ39SGKIryecZ/qRdJZeJXYR1B Jyli6LVn6K3e4Ej5YiVNTy5iGle/tPD0uP3sQR2SV2R93WLpbNh4m2kmnhzr7epDfvSN PYX+kN4njk7nmnZUQKNSz9qJmuwbecW2j9kRcWWH3IX6QdUsvSQNej6fOJ6L/48SPaWV zVsz4SFFkj9sRsXxgyodFd5JSlIGy/dvVN+cm5ckMIBZ4KB+WB0WedTja2uWHY3WV89Q doJY3eiroaFlMRs954X1Iwk9vZVTCUzeA8zjVvcGhY6FlNIOsCHgzLx9i7sfQTXB+ZNj BYEQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=/6juimptoMMtP48zI2c4D0+m851jP3ciHVUpHlrbuFM=; b=uP7yupRMyGYKWF6XYmU+rUFB2zMVAroQXT3NqRcykFle7idOfx5m9zEDEHrOU6DNLy ZWhlpqnmSKD0A3Z50+ZGlkQ62lgRqb4VR3l19DXCh79Lxkn4q/95as+Vqo/8rLUs2qB2 qIbruaUofbSJj7Q/M6adE1/QfiBoiqI2GCjK9I2moAv6ky6fj8hPD5sGhlt15hRCplso WuPpAXhBWKZBkvDveIaXHFto8q3ufhTdYXUpTnwmQklWBk4PLPx51bsPlBW9YvB2Ok7P yEUEQKoeyCZF/Vt0gXcE6iz3QfRXybwLpVMu1TGVpo8BfmzxzFs5ELbSZlduZPJzEIJP AIiw== X-Gm-Message-State: AOAM531bihtj+S0QIXnAkZXKIT+lgPohsAE4a4AbP/NVRntUOj3Kpxbd P2HtCxbuGYRassVpqCFw+9PZji3qicnlfgtfWYt1JGAE X-Google-Smtp-Source: ABdhPJwPizZrmXRsjq+JFFJp5ySKUGjZPuivakX3TD/Jtfl/o0DF5iXKKYjEWuwJSYNZw2qz5LQddC9FGxdBdq3d+70= X-Received: by 2002:a05:651c:1126:: with SMTP id e6mr8773112ljo.123.1592840742623; Mon, 22 Jun 2020 08:45:42 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:4703:0:0:0:0:0 with HTTP; Mon, 22 Jun 2020 08:45:41 -0700 (PDT) Reply-To: dwilde1@gmail.com In-Reply-To: <22433b0e-b951-346d-d902-fb608c0c5c7b@grosbein.net> References: <2D4CD117-99D0-4A03-8FBC-002CDFFE64F9@ellael.org> <5403888.XOh7uYVVfo@behemoth.lan> <22433b0e-b951-346d-d902-fb608c0c5c7b@grosbein.net> From: Donald Wilde Date: Mon, 22 Jun 2020 08:45:41 -0700 Message-ID: Subject: Re: Buildworld and buildkernel with very slow compilation, recently To: Eugene Grosbein Cc: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49rDJn5qdzz3X27 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=sbgSLSYi; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of dwilde1@gmail.com designates 2a00:1450:4864:20::232 as permitted sender) smtp.mailfrom=dwilde1@gmail.com X-Spamd-Result: default: False [-3.12 / 15.00]; HAS_REPLYTO(0.00)[dwilde1@gmail.com]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; REPLYTO_ADDR_EQ_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.10)[-0.096]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.012]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.015]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::232:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 15:45:46 -0000 On 6/22/20, Eugene Grosbein wrote: > 22.06.2020 3:56, Dimitry Andric wrote: > >> One of the upstream problems is that there is not really any >> authoritative performance regression log being built up, so it is hard >> to see where such regressions were introduced. Somebody then has to >> spend a lot of time tracking down each and every regression, and then >> attempt to untangle it from the dozens of commits made around the same >> time. :) > > Such project as FreeBSD could become valuable source of information to track > such an issue > and it's easy to obtain, for example: > > make buildworld 2>&1 | logger -t buildworld -p user.info > > This generates timestamps for every line called in process with help of > syslogd. > It should be easy to compare outputs obtained with same FreeBSD revision > but different clang versions, calculate time diffs and sort by diffs > descending :-) Eugene, I have noticed (though quite anecdotally) a real slowdown, so I'd like to help. My mule is not busy at this time so if you have a place to put these output files, I'll be glad to crunch some over the next few days. My mule is only an i3 with 4GB with 40G of swap and an active ccache, but I should be able to run any variant of tests you need to see. I'm on 12-STABLE and I now am doing a fresh base/stable/12 pull. I have _not_ deleted my /usr/src.bak copy, although I didn't stash a copy of the old ports tree before updating it. I use tcsh everywhere, but I should be able to do what you intend (hey, it's been a loooong time since I tried to speak csh!) and if you'd like me to do deltas with LLVM80 vs LLVM90 vs. LLVM100, etc, I can do this. Just tell me exactly what you want to see. -- Don Wilde **************************************************** * What is the Internet of Things but a system * * of systems including humans? * ****************************************************