From nobody Tue May 18 03:49:00 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 18A75533D38 for ; Tue, 18 May 2021 03:49:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FkhnS04YCz4XhJ for ; Tue, 18 May 2021 03:49:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DF84F1880D for ; Tue, 18 May 2021 03:48:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 14I3mxcf058685 for ; Tue, 18 May 2021 03:48:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 14I3mxDL058684 for freebsd-arm@FreeBSD.org; Tue, 18 May 2021 03:48:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-arm@FreeBSD.org Subject: [Bug 255961] RPI 3B+ single user mode locks up Date: Tue, 18 May 2021 03:49:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: arm X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: day1234@hotmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-arm@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255961 Bug ID: 255961 Summary: RPI 3B+ single user mode locks up Product: Base System Version: 13.0-RELEASE Hardware: arm64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: arm Assignee: freebsd-arm@FreeBSD.org Reporter: day1234@hotmail.com I installed FreeBSD-13.0-RELEASE-arm64-aarch64-memstick.img to a new RPI 3B= +. I added packages, users, etc. and ran for a couple of days for burn-in. Everything went well until I tried to boot single user. It froze during the boot and the only keyboard sequence I found that worked was . I re-booted to multi-user and tried "# shutdown now" to get to single user = and had the same result as booting directly to single user mode. Any suggestions? JJ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed May 19 05:26:39 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4D5A85FDE47 for ; Wed, 19 May 2021 05:26:53 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FlLvw3cqqz3s85 for ; Wed, 19 May 2021 05:26:52 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: by mail-wr1-x42e.google.com with SMTP id p7so8795096wru.10 for ; Tue, 18 May 2021 22:26:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=SrjBl9AkIDAEnkasBxKnZTROPKin1xIci5qOnF0DEV0=; b=KPeARasxgkCrT1Ms3Xwzk0Fp3mO3B5VOdgq45uzt8QddOeBr2Ov/g8IV5vMQcy51GW tq1WWCMLrUNaFegPXSAo35uxiUF18dL0T1+y6MlPQEFhE5tfYBWVWWJGIfYw5AWf0Qua B67hbSjvyAKy2CACx8Lrf3osj35Ojf7gh11bR5blF1i7PYcTURT23uEbX5XQ+UIH85Wm JfanCDfT8f+/k35RyZbXejDtcnkgsrl5QQyNMEij7FQwCRK6jD5qaidKhLPM/N4qWleI ghysk/a/DBktJVU8mrJmGzy28axhCbgm6mn2A64mHVUo89u7k5XoBea7L6wAM6RJgG9g QcKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=SrjBl9AkIDAEnkasBxKnZTROPKin1xIci5qOnF0DEV0=; b=ZgzqhFH+q9wschL/QuSbItluieN1j5GScbG0KNOMHysNiJ7kxHw/msTNBSzTS/equp Ezs7wa8dIso/BKYHipg+XWDhSZyi5RBWPWDA4B3sV87qENJlEird49N8k3KOc6Kk2/I9 kPB/UVRvbwl6ZJSv3afDEXFWJ/kOvl2Yn6hrWuCl7YSwhVz6JkHWhsLDggQV4QNKeFwd h+J27Bv2vN9ydyGTXI1wxvZ3zkmQWQYh7V8cnrtAUVWLYv9Jo2B6+FN24ysAp2EnQ61/ IiGPPc2TStPxPTXR4yg4OZ7hdY0QQQZzP0CG2ZtdgamT/ueNmU9dCw385l0cY6caqHVj CaBg== X-Gm-Message-State: AOAM532P8F2qmjGPwz+mExx3R0TgoovMhP9DZU6/KzTRE0tqdCQxJkvq 8MliccVmI4FJpHsPS58DvwWKok9KtHl4APKenIHOIeAPRpfJ X-Google-Smtp-Source: ABdhPJw790PUtquSFiP0iWVgmFs8KhQt+wk+K1+Csdhc/3OTHBY+LtwYFVEeLl9GusJHNl0DGlAPszKaEpPdutV71Ag= X-Received: by 2002:a5d:4ed1:: with SMTP id s17mr12297612wrv.204.1621402010707; Tue, 18 May 2021 22:26:50 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Reply-To: kamalpr@gmail.com From: "Kamal R. Prasad" Date: Wed, 19 May 2021 10:56:39 +0530 Message-ID: Subject: bcm2835 To: freebsd-arm@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FlLvw3cqqz3s85 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=KPeARasx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kamalpr@gmail.com designates 2a00:1450:4864:20::42e as permitted sender) smtp.mailfrom=kamalpr@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; HAS_REPLYTO(0.00)[kamalpr@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; REPLYTO_ADDR_EQ_FROM(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::42e:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_REPLYTO(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::42e:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42e:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] hello, in file sys/arm/broadcom/bcm2835/bcm2835_sdhci.c there is a constant SDHCI_QUIRK_BROKEN_TIMEOUT_VAL can someone tell me why this was introduced and does it correspond to anything in the datasheet? thanks -kamal From nobody Wed May 19 12:38:18 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id AEC6886BF40 for ; Wed, 19 May 2021 12:38:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FlXTz4ZXSz3mWD for ; Wed, 19 May 2021 12:38:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qk1-f172.google.com (mail-qk1-f172.google.com [209.85.222.172]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 811A5D16A for ; Wed, 19 May 2021 12:38:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qk1-f172.google.com with SMTP id 124so184463qkh.10 for ; Wed, 19 May 2021 05:38:31 -0700 (PDT) X-Gm-Message-State: AOAM532twaJtMms9k6cMC7zpyfxgVMky9XsWemtOeyhwiuu7vetc1uFR 5K+MlGtDCb2zdAilDqLQwRZrpMZNPOKIlBgL9mk= X-Google-Smtp-Source: ABdhPJy+MVtALtlECwacJmOzCPWrqxeDkrMNnkCvLrW8Kd+x1yogx+SKkfzZ7xikOTqyajqEFqz5zO/ZhJOPAS5ucKE= X-Received: by 2002:a05:620a:164e:: with SMTP id c14mr11457967qko.103.1621427911158; Wed, 19 May 2021 05:38:31 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Kyle Evans Date: Wed, 19 May 2021 07:38:18 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bcm2835 To: kamalpr@gmail.com Cc: freebsd-arm Content-Type: text/plain; charset="UTF-8" On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad wrote: > > hello, > > in file > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c > > there is a constant > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL > can someone tell me why this was introduced and does it correspond to > anything in the datasheet? > Hi, This was added by gonzo@ back in r242321. It doesn't really correspond to anything in the datasheet, but before I committed r354560 that moved it around I did try to remove it and observed that it was still a problem with either the RPi3 or RPi4. Thanks, Kyle Evans From nobody Wed May 19 13:12:08 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BBC2D841426 for ; Wed, 19 May 2021 13:12:21 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FlYF14nR8z4Vr1; Wed, 19 May 2021 13:12:21 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: by mail-wm1-x331.google.com with SMTP id z19-20020a7bc7d30000b029017521c1fb75so3438185wmk.0; Wed, 19 May 2021 06:12:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:reply-to:from:date:message-id :subject:to:cc; bh=T8hweBnjN8HJULwuhfWyjcYEBvOINVvdWnIRajHs2s8=; b=V0q3wvt+T0EXBAPcAPMR1/dQDccp7AIioOo5J0MGiGU0S/LLhr6bcfJG9WuxdMhwZ5 BytRiHt+ItINOxc78yMy/l1tioDEHPMaND04Cdm53tmlpPu708xcsBB71kpeA3FVyhc0 uS1llXUHu7rkSde1w0derjckMcVsYAA9LIK7FtMF9pbkS9gWXYUI+e583S0CKxtk6kst 9acCtzSmIiI8g//iWXVZcEWTwLBkLJaFQtseJXoMFEDn+iGk7ywng1ZVuTu801munRQw fy+KJ3KcFcDle0xNQaCAHd3GpdTgLWGbmpraiiUu7DDJ/rB82bxEq1zxcwiZjPyBBnyP tlYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc; bh=T8hweBnjN8HJULwuhfWyjcYEBvOINVvdWnIRajHs2s8=; b=cjaTlvdA6E1WPrybCSN+pEx5UynvVmtXyXPH6TZL/Yjg/5c+IR29gU2dta4rV2rmuL mqimVpg7zoRrd0m9HDPXzwWjGJ5nnCbY8idl7b67cshQzTfVueB179dC/ZQuNBxls3Cr rq2FZ8k0juUH5tHUmeDmuxJjo9QxQr5dMyJ+cZ1MM5Yf6yGC7aNiQbvwG3SJts5DeYDm iHhW96bmiVNsN2rPu2n2R0BSg+FLitfX5O2kzK0puVT2PgRCTtjtAYRMcz/H2c6fH96V Kpk+PIfKVV1R49GEcMuw2+06cN5jmBAwuy5LAZegsX9ZEI6BDg1bejeje71DiYtaTNG4 4HmA== X-Gm-Message-State: AOAM531ScpDG4PYk8Z0uBMte9sTTw6x1bicbyAQuGR0U1N0nfUZv9XHn x9m13GgOq0VAw9zYgE0y+kLbyKK85SWH4KakzDbLfVk+gDK4 X-Google-Smtp-Source: ABdhPJwuyBkQKY7sCtyB3pxkTtzFFNuZAV8klxW3eS5zIw5785/tDll2DLuHNJspjcVKW8m2tmLPreiiXEONoyJiQaY= X-Received: by 2002:a1c:e907:: with SMTP id q7mr11052207wmc.1.1621429939537; Wed, 19 May 2021 06:12:19 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: Reply-To: kamalpr@gmail.com From: "Kamal R. Prasad" Date: Wed, 19 May 2021 18:42:08 +0530 Message-ID: Subject: Re: bcm2835 To: Kyle Evans Cc: freebsd-arm Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FlYF14nR8z4Vr1 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Hi! can you tell me more on why removing it was a problem for rpi3 or rpi4? i am trying to understand the significance of this #define. thanks -kamal On Wed, May 19, 2021 at 6:08 PM Kyle Evans wrote: > > On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad wrote: > > > > hello, > > > > in file > > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c > > > > there is a constant > > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL > > can someone tell me why this was introduced and does it correspond to > > anything in the datasheet? > > > > Hi, > > This was added by gonzo@ back in r242321. It doesn't really correspond > to anything in the datasheet, but before I committed r354560 that > moved it around I did try to remove it and observed that it was still > a problem with either the RPi3 or RPi4. > > Thanks, > > Kyle Evans From nobody Wed May 19 13:20:16 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 285AA846A8E for ; Wed, 19 May 2021 13:20:30 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FlYQQ0bh9z4Yg5 for ; Wed, 19 May 2021 13:20:30 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qt1-f178.google.com (mail-qt1-f178.google.com [209.85.160.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id E7C6CE0D1 for ; Wed, 19 May 2021 13:20:29 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qt1-f178.google.com with SMTP id y12so9992222qtx.11 for ; Wed, 19 May 2021 06:20:29 -0700 (PDT) X-Gm-Message-State: AOAM5301AdOqyY4/I6OlYw288joGpmGatKyLfSoAArCVrK6c4YS1Lo8W zuKznp6W3xbrI41iC1PjOr7khicFsvVDArRNEfU= X-Google-Smtp-Source: ABdhPJzbGnQBEP4qIW9yaLMTiXRDjLCI/IO5ma9laSe+TUQ+UYrLDoJSOTkLbQd9uE3m+F9IBl30l5sO5sAbfRvMwu0= X-Received: by 2002:ac8:6b0a:: with SMTP id w10mr11032993qts.60.1621430429515; Wed, 19 May 2021 06:20:29 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Kyle Evans Date: Wed, 19 May 2021 08:20:16 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bcm2835 To: kamalpr@gmail.com Cc: freebsd-arm Content-Type: text/plain; charset="UTF-8" On Wed, May 19, 2021 at 8:12 AM Kamal R. Prasad wrote: > On Wed, May 19, 2021 at 6:08 PM Kyle Evans wrote: > > > > On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad wrote: > > > > > > hello, > > > > > > in file > > > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c > > > > > > there is a constant > > > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL > > > can someone tell me why this was introduced and does it correspond to > > > anything in the datasheet? > > > > > > > Hi, > > > > This was added by gonzo@ back in r242321. It doesn't really correspond > > to anything in the datasheet, but before I committed r354560 that > > moved it around I did try to remove it and observed that it was still > > a problem with either the RPi3 or RPi4. > > > > Thanks, > > > > Kyle Evans > > Hi! > > can you tell me more on why removing it was a problem for rpi3 or > rpi4? i am trying to understand the significance of this #define. > > thanks > -kamal > You'll find better insight from the comment at its definition and implementation: http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.h#60 http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.c#1814 My very vague recollection is that the advertised timeout is too low, but it's probably an implementation issue. Thanks, Kyle Evans From nobody Wed May 19 14:40:38 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3A4C0622ACA for ; Wed, 19 May 2021 14:40:51 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FlbC70yX1z3jdG; Wed, 19 May 2021 14:40:50 +0000 (UTC) (envelope-from kamalpr@gmail.com) Received: by mail-wm1-x331.google.com with SMTP id y184-20020a1ce1c10000b02901769b409001so3486346wmg.3; Wed, 19 May 2021 07:40:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:reply-to:from:date:message-id :subject:to:cc; bh=SKXeLOqNAqldujgdoaq0WFDfzFmETOzyPHoagLrTaYA=; b=cqEXnfYH+GeT2I8W+aLtEXbGP6VYlXnFLRK153sAHi/9Xi6kHLnF5FEuIAtzZt/xAX OdidStp2x7iVvjluKXtktGuaJD+0//J9pSFBQENQEqibniWrysrCut8JqJbKx6FVIhMT jSu4VswzTe5w5vaFof5Mx+aWGzXCWuA4SyDGPjDRZbh+Ry2OCbJyqJeBm7U4n+Vscxnn 9+o3vUuKgDpppDJ69C50M2nb4wDXJUZDXj8uh1NdAscywdbjVN0lKDSLX+8HOM+zwYx6 oHJ4Hz7RU4Akxj0oDTSoKeEgEwVo0lYEIfO1/KEchwplQTFdHrz6WlyMjgIAAA9LG8I+ BDng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc; bh=SKXeLOqNAqldujgdoaq0WFDfzFmETOzyPHoagLrTaYA=; b=FN2AJRLn/OdlaxLMfnC39Fp4xPiqeDwmxis7bQedzEWb3N5O5xa3OsuI+5j0G6QbBj Sus0a/Zg4ytmlBC+x7ehPQRCHXx0ber0aTipUKuJS0O6fP/tIVAU7L1m5lAtvXKu5KEd +akoIxM/JCbfPqnGdOThIa1IS9krJXS4omaBhp88aNf7UPGsWlPH0io+NBH+fdaEFigp 71FyhOLUccIomUn2w09OC/F9SnF44Z6ZlMBN+nvYabBFYUMsHEeQ2iUWlRj6bZHjKcVB Fvij41RD4AbZYiZOa7oSUYcfQCJVXL4Ud2nmh8bkCM0hZzLRv3fwJGMi/rc235HPtPUC 24mw== X-Gm-Message-State: AOAM533/rlU21OT2TLJUJOg0wYxKzfXoWKyF4wI4YwmPsEX8ltoUBH+C DA3oEiwVAxVDBc2ljyo2yptFhHMpmhSCx5kWOLDHpcr14l1I X-Google-Smtp-Source: ABdhPJyE+BrpIQ9flh05KE7aiJuZ/H/9vaIOKjljXerRO8TqqPDT4DgIAxQwza85GtBWbHmOEShuhVGvNJMQXOAsIG8= X-Received: by 2002:a1c:e907:: with SMTP id q7mr11537154wmc.1.1621435249433; Wed, 19 May 2021 07:40:49 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: Reply-To: kamalpr@gmail.com From: "Kamal R. Prasad" Date: Wed, 19 May 2021 20:10:38 +0530 Message-ID: Subject: Re: bcm2835 To: Kyle Evans Cc: freebsd-arm Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4FlbC70yX1z3jdG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] the comment indicates that timeout value is too low. surely, there must be some place where the timing constraint is indicated because of which this quirk was put in. or is it that the datasheet doesn't require this -but in practice, the timeout needs to be increased? if someone else has added it -maybe they can tell me. thanks -kamal On Wed, May 19, 2021 at 6:50 PM Kyle Evans wrote: > > On Wed, May 19, 2021 at 8:12 AM Kamal R. Prasad wrote: > > On Wed, May 19, 2021 at 6:08 PM Kyle Evans wrote: > > > > > > On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad wrote: > > > > > > > > hello, > > > > > > > > in file > > > > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c > > > > > > > > there is a constant > > > > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL > > > > can someone tell me why this was introduced and does it correspond to > > > > anything in the datasheet? > > > > > > > > > > Hi, > > > > > > This was added by gonzo@ back in r242321. It doesn't really correspond > > > to anything in the datasheet, but before I committed r354560 that > > > moved it around I did try to remove it and observed that it was still > > > a problem with either the RPi3 or RPi4. > > > > > > Thanks, > > > > > > Kyle Evans > > > > Hi! > > > > can you tell me more on why removing it was a problem for rpi3 or > > rpi4? i am trying to understand the significance of this #define. > > > > thanks > > -kamal > > > > You'll find better insight from the comment at its definition and > implementation: > http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.h#60 > http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.c#1814 > > My very vague recollection is that the advertised timeout is too low, > but it's probably an implementation issue. > > Thanks, > > Kyle Evans From nobody Thu May 20 00:20:32 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 075AA8C0F71 for ; Thu, 20 May 2021 00:20:43 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (1.212.52.36.ap.yournet.ne.jp [36.52.212.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp", Issuer "smtp" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Flr496RfZz3KYn for ; Thu, 20 May 2021 00:20:41 +0000 (UTC) (envelope-from kiri@truefc.org) Received: from kx.truefc.org (kx.truefc.org [36.52.212.1]) by kx.truefc.org (8.16.1/8.16.1) with ESMTP id 14K0KW61063682; Thu, 20 May 2021 09:20:32 +0900 (JST) (envelope-from kiri@kx.truefc.org) Message-Id: <202105200020.14K0KW61063682@kx.truefc.org> Date: Thu, 20 May 2021 09:20:32 +0900 From: KIRIYAMA Kazuhiko To: freebsd-arm Cc: kiri@truefc.org Subject: Could not boot with u-boot Levono Chroebook S330 User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL/10.8 MULE XEmacs/21.4 (patch 24) (Standard C) (amd64--freebsd) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4Flr496RfZz3KYn X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kiri@truefc.org has no SPF policy when checking 36.52.212.1) smtp.mailfrom=kiri@truefc.org X-Spamd-Result: default: False [1.97 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[36.52.212.1:from]; FREEFALL_USER(0.00)[kiri]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[truefc.org]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.89)[0.894]; SPAMHAUS_ZRD(0.00)[36.52.212.1:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.98)[0.975]; RCVD_COUNT_ONE(0.00)[1]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:10013, ipnet:36.52.208.0/21, country:JP]; MAILMAN_DEST(0.00)[freebsd-arm]; ONCE_RECEIVED(0.10)[] Hi, all I'm trying to boot Levono Chroebook S330 [1]. I've made FreeBSD USB image in accordance with [2] as follows : # gpart destroy -F /dev/da0 da0 destroyed # gpart create -s GPT da0 da0 created # gpart add -b 1m -s 15m -t \!fe3a2a5d-4f32-41a7-b725-accc3285a309 da0 da0p1 added # gpart add -b 17m -s 15m -t \!fe3a2a5d-4f32-41a7-b725-accc3285a309 da0 da0p2 added # gpart add -t freebsd-ufs da0 da0p3 added # dd if=nv_uboot-snow-simplefb.kpart of=/dev/da0p1 bs=1m 0+1 records in 0+1 records out 696320 bytes transferred in 0.297577 secs (2339966 bytes/sec) # newfs_msdos /dev/da0p2 /dev/da0p2: 30656 sectors in 3832 FAT12 clusters (4096 bytes/cluster) BytesPerSec=512 SecPerClust=8 ResSectors=1 FATs=2 RootDirEnts=512 Sectors=30720 Media=0xf0 FATsecs=12 SecPerTrack=63 Heads=255 HiddenSecs=0 # mdconfig -a -t vnode -f FreeBSD-14.0-CURRENT-arm64-aarch64-20210429-daa5350d0e0c-258262-memstick.img md0 # gpart show md0 => 3 1646232 md0 GPT (804M) 3 66584 1 efi (33M) 66587 1579648 2 freebsd-ufs (771M) # mount /dev/md0p2 /mnt # mount_msdosfs /dev/da0p2 /mnt1 # cp /mnt/boot/kernel/kernel.bin /mnt1 # umount /mnt1 # newfs -U /dev/da0p3 /dev/da0p3: 1880.0MB (3850200 sectors) block size 32768, fragment size 4096 using 4 cylinder groups of 470.00MB, 15040 blks, 60160 inodes. with soft updates super-block backups (for fsck_ffs -b #) at: 192, 962752, 1925312, 2887872 # mount /dev/da0p3 /mnt1 # tar -cf - -C /mnt . | tar -xf - -C /mnt1 # umount /mnt # umount /mnt1 # mdconfig -d -u md0 # gpart show da0 => 40 7864240 da0 GPT (3.8G) 40 2008 - free - (1.0M) 2048 30720 1 chromeos-kernel (15M) 32768 2048 - free - (1.0M) 34816 30720 2 chromeos-kernel (15M) 65536 7798744 3 freebsd-ufs (3.7G) # and then mark the FreeBSD USB device bootable : # cgpt add -P 12 -T 5 -S 1 -i 1 /dev/sda # reboot confirmed partition 1 attributes changed to : # cgpt show /dev/sda ... Attr: priority=12 tries=5 successful=1 ... # shutdown -P now and insert USB device and power the machine on and press CTRL+U at the "OS verification is OFF" screen, but screen blackout and nothing has happened ;-( How the machine go forth to boot with u-boot ? Best regards [1] https://www.lenovo.com/jp/ja/kakaku/notebooks/lenovo/lenovo-n-series/Lenovo-Chromebook-S330/p/88LGCS31095?vc_lpp=MSY5ZWQ2NGNhNzc2JjYwYTIxZTdhJmRhJjYwZjEzODc5JllLSWVlUUFISUNja05OUUJ3S2hwQ2NDb2FTZTZodyY0CVlLSWVlUUFISUNja05OUUJ3S2hwQ2NDb2FTZTZodwkwODc4ODc5MDgwMDIwOTYwNjAyMTA1MTcwNzQyNDkJCQk&cid=jp%3Aaffiliate%3Ag2ospo [2] https://wiki.freebsd.org/action/show/arm/Chromebook?action=show&redirect=FreeBSD%2Farm%2FChromebook --- Kazuhiko Kiriyama From nobody Thu May 20 23:15:33 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CCA26627D35 for ; Thu, 20 May 2021 23:15:46 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x736.google.com (mail-qk1-x736.google.com [IPv6:2607:f8b0:4864:20::736]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmQZp0Mq8z3td5 for ; Thu, 20 May 2021 23:15:45 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x736.google.com with SMTP id o27so17993920qkj.9 for ; Thu, 20 May 2021 16:15:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=mXzyOhcuTWhVvZmkYO9dodFjQA2EQVKkwz0zGiTGtDQ=; b=u/MmqJ+6fosRHQl+BUg4jaC7+T6C99uYf8ixx7pVsLT7RFKiXzbezZH2UZL7owyeAV yPytzjHm8xs26tJA9jKXufy54ynamtt7HZp7DaY+JqOnG2RU/pxflu1ZiYMxUxdh9/t7 t8UmwiZhR/Rsm6y2sq1tyEKq11n4eQqS39d7LCAziRego3y5UKYpoetwmpTQURtfMlvU Xde1GaJWUva27tBGzdi9hiGCXx9Dj/we+zAJKjEt+ZaEtsMgzBUUZ03I6nrD3zibDmVZ URl5lRSK31s8pgmRlsPgg3tZvpBOYJ5OX8dezr3lHl6UJyYXPc1U/rApM2S01ppP/wDn 8vIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=mXzyOhcuTWhVvZmkYO9dodFjQA2EQVKkwz0zGiTGtDQ=; b=qCPIkbMG9HUJS5MPt2bgMlczUVZpamEjBtBWKLN6aWSjVEdGxt4dkNFjyBzbAEsR8c Z6j+80ODJ6DGCJsUOJBLulZs5nEa3BL9SvPLHrwFWpXQl6CDNAxZ8L6iK40i6ZGOsefN IK8Zmkxxvm4HJMe+ycnNrvCG9ilTsfpbKH1GOFfZGGqHjev7tQwV7+P6n2+dqTXe+Xtr lXeh0h/7rDuk9FoauhUQ6Xt5H3Oc3aFlqm+BFOaWFdbNs99X+147Pe7ZETbwAeosmaJM geKyQdkteSeZvSd5LfpM1vUTja43UmIi3wYq5HT0pQIlGSbc8DWmCVLo2DBo7TwFJLLk 2SQQ== X-Gm-Message-State: AOAM533Y/JTxq7pV8E7I3nUZ/cg8x9qo+O/DWZ4CnslV/x/StmLuql/j w9+edK0YJ2J/eKCwr0z58Xv4EO+ZDsl1dGx8scoJEA== X-Google-Smtp-Source: ABdhPJxoGprtXJVPelQMoMt2a0ztO9hnq1WQgZh6JnxdH5FfbGdZAewrz4Uq1QBYDto698UrBi5IfdtcOth3Z3vQjcU= X-Received: by 2002:a05:620a:a:: with SMTP id j10mr8552692qki.195.1621552545328; Thu, 20 May 2021 16:15:45 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Thu, 20 May 2021 17:15:33 -0600 Message-ID: Subject: Re: bcm2835 To: Kamal Prasad , Oleksandr Tymoshenko Cc: Kyle Evans , freebsd-arm Content-Type: multipart/alternative; boundary="00000000000073062d05c2cb1fc6" X-Rspamd-Queue-Id: 4FmQZp0Mq8z3td5 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=u/MmqJ+6; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::736) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.80)[-0.799]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::736:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::736:from]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::736:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_COUNT_TWO(0.00)[2] --00000000000073062d05c2cb1fc6 Content-Type: text/plain; charset="UTF-8" In general, for the RPi stuff, if it isn't in the commit messages, it will be hard to know why things were added. The datasheets' completeness and availability in the past has been spotty, and it's entirely possible the code was written with an old version that indicated a longer timeout. A bit of digging shows this was moved recently by Kyle, but the original dates back to gonzo@'s original commit in 2012. I've cc'd Oleksandr to see if he can recall why that was added... Warner On Wed, May 19, 2021 at 8:41 AM Kamal R. Prasad wrote: > the comment indicates that timeout value is too low. surely, there > must be some place where the timing constraint is indicated because of > which this quirk was put in. or is it that the datasheet doesn't > require this -but in practice, the timeout needs to be increased? if > someone else has added it -maybe they can tell me. > > thanks > -kamal > > On Wed, May 19, 2021 at 6:50 PM Kyle Evans wrote: > > > > On Wed, May 19, 2021 at 8:12 AM Kamal R. Prasad > wrote: > > > On Wed, May 19, 2021 at 6:08 PM Kyle Evans wrote: > > > > > > > > On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad > wrote: > > > > > > > > > > hello, > > > > > > > > > > in file > > > > > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c > > > > > > > > > > there is a constant > > > > > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL > > > > > can someone tell me why this was introduced and does it correspond > to > > > > > anything in the datasheet? > > > > > > > > > > > > > Hi, > > > > > > > > This was added by gonzo@ back in r242321. It doesn't really > correspond > > > > to anything in the datasheet, but before I committed r354560 that > > > > moved it around I did try to remove it and observed that it was still > > > > a problem with either the RPi3 or RPi4. > > > > > > > > Thanks, > > > > > > > > Kyle Evans > > > > > > Hi! > > > > > > can you tell me more on why removing it was a problem for rpi3 or > > > rpi4? i am trying to understand the significance of this #define. > > > > > > thanks > > > -kamal > > > > > > > You'll find better insight from the comment at its definition and > > implementation: > > http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.h#60 > > http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.c#1814 > > > > My very vague recollection is that the advertised timeout is too low, > > but it's probably an implementation issue. > > > > Thanks, > > > > Kyle Evans > > --00000000000073062d05c2cb1fc6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
In general, for the RPi stuff, if it isn't in the= commit messages, it will be hard to
know why things were added. = The datasheets' completeness and availability
in the past has= been spotty, and it's entirely possible the code was written
with an old version that indicated a longer timeout.

<= div>A bit of digging shows this was moved recently by Kyle, but the origina= l dates back
to gonzo@'s original commit in 2012. I've cc= 'd Oleksandr to see if he can recall
why that was added...

Warner

On Wed, May 19, 2021 at 8:41 AM Kamal R. Pras= ad <kamalpr@gmail.com> wrote= :
the comment in= dicates that timeout value is too low. surely, there
must be some place where the timing constraint is indicated because of
which this quirk was put in. or is it that the datasheet doesn't
require this -but in practice, the timeout needs to be increased? if
someone else has added it -maybe they can tell me.

thanks
-kamal

On Wed, May 19, 2021 at 6:50 PM Kyle Evans <kevans@freebsd.org> wrote:
>
> On Wed, May 19, 2021 at 8:12 AM Kamal R. Prasad <kamalpr@gmail.com> wrote:
> > On Wed, May 19, 2021 at 6:08 PM Kyle Evans <kevans@freebsd.org> wrote:
> > >
> > > On Wed, May 19, 2021 at 12:27 AM Kamal R. Prasad <kamalpr@gmail.com> w= rote:
> > > >
> > > > hello,
> > > >
> > > > in file
> > > > sys/arm/broadcom/bcm2835/bcm2835_sdhci.c
> > > >
> > > > there is a constant
> > > > SDHCI_QUIRK_BROKEN_TIMEOUT_VAL
> > > > can someone tell me why this was introduced and does it= correspond to
> > > > anything in the datasheet?
> > > >
> > >
> > > Hi,
> > >
> > > This was added by gonzo@ back in r242321. It doesn't rea= lly correspond
> > > to anything in the datasheet, but before I committed r354560= that
> > > moved it around I did try to remove it and observed that it = was still
> > > a problem with either the RPi3 or RPi4.
> > >
> > > Thanks,
> > >
> > > Kyle Evans
> >
> > Hi!
> >
> > can you tell me more on why removing it was a problem for rpi3 or=
> > rpi4? i am trying to understand the significance of this #define.=
> >
> > thanks
> > -kamal
> >
>
> You'll find better insight from the comment at its definition and<= br> > implementation:
> http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.h#60
> http://bxr.su/FreeBSD/sys/dev/sdhci/sdhci.c#181= 4
>
> My very vague recollection is that the advertised timeout is too low,<= br> > but it's probably an implementation issue.
>
> Thanks,
>
> Kyle Evans

--00000000000073062d05c2cb1fc6-- From nobody Fri May 21 08:05:16 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 987908C6E52 for ; Fri, 21 May 2021 08:05:22 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-23.consmr.mail.gq1.yahoo.com (sonic312-23.consmr.mail.gq1.yahoo.com [98.137.69.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmfKs3MxBz3q1Z for ; Fri, 21 May 2021 08:05:21 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621584319; bh=BLmF3Qbb1zZeFqnnYO26K7BFVOyHbJHD5pemJAh8c4I=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=gQomzcIApBFhLfyPlhxcb4PoZY2P47JyplyPo1efR/91HVLg3ZI9g7M4g8YcY45p8yti7odZKrBkj0smUJoKCk+dkHAPjidAkc7guubCZmHLqSTLSqF6V0O6Wy42A4kSPf2DYbTapA1U5LtgVH6KckL7T7MBkwrpRqKnmMQ358AgyOlGBTaMcn2DNAdO9Hws5r6mpax23Lsl/ReanK/nbfmpGCi6AF+OvRo/x27V6BgjuGqKf+uoY2YuLDNoeUgQukqxT2psgAW1w67F8YCJKVgU5uEapVUSfWlDZ8pjoYDlY23IZKhSWTh/GOfAritoqk8cVo2D/w01diRJps9IeA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621584319; bh=/7z8v0Ir2IBtGU56b7L9goDGLQV8nyim0PlDN1nMRaB=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=ohb7kaf0jeWyvkyjQosBH9t+FrKjJJj7FvCF6zWn2F+5iVpWKPyoGRY2UVhciwIZHC13IuFBsfHZpWJ5fdVaINCASEQxEa9zxqQ9bAkiDjcbc4HgHH5Edka8ALabXsCe7WPN6bZ+//W8tbxGjTkj3NZAgeD83pCLynI0HkcamdnJ8r1U4EilBhuSDSS2bnvxskjapFHJ03pTUZgLDA3kuMC6MueXuIK5o2fwbQti3Bf6pJW3a4MmyjJ8yhj5N6lg7PXONz+q6Yc6vBaZPQwgLKIhHJppjJQDrahCqS9m3+IHXKPi/EtU3acCi9yl1vf/x//8WbveNcYVXZ5t5RWBTA== X-YMail-OSG: LjJ3wSEVM1nOKQrgjOdp15uiqkyiKn5u_j9V1zn7nkMJu8B_6GADD5DSkWdjfWf U1wdFTBStUTZgEjrzOlSMnaIjvxOvjpNRtlc6vOETV_WSEmkH8IsFbvUiIhKQhrIfmWPo70oxOKf ik66KxW8Iby_CoTxwzSvh43aaA.1p6Qx4lZFihAPYZL8Pzf.Elh8Z2E1EIod8bSQTrsAipApNPhq C9YucrW3GebkpvtJjtpFPMsxR_YhEUZ7wXgtFMLDgMSpaSxY0NwDxjodBY3d_oTaW_T4zQmUfGFo 9RVeQ6vqTJNwSwheOazz_ntZGZ_4mrS1ETgHgR6ELPueSVxU956fgt2mDGeCvxXwfDnvzNEWlUSw 2bjJFMrxAB67IZkGEoFcJTcbaSXGwUTrguxIl85HPQZT2q4x8DcK.ZlP8M03zwe1scNSwJ_4Q.kj kHRDXR1_1PfKGdTegkRFs1ubIJKhbR2_CJekUfKtQp_JCrJiuQ5BTSWIfbT.15T9_Gh1dGqMZZxa cUjWL67GqTlgxEm3.3nRAmOznyq8Vw5wEsfzdbTHAjL9fSlo.MO0Id0vu2ks_0bdQQBrvtaqTUyt SJTUCx5n32A3ZZ6dPaTAwLxFnYWUejqtbu8Sb_tuZ0oKLoaA4wqjuqWe_35vQ35eCt1m_m0kI8d6 cvuR.AXmsM43BZqEBZD31odkDhnT32f9zp01qdcgSosQUArVnlapvJJnshcDU05cx4SeSnpw2g5X Ba0Zp3IszojQexHlmyPW.xTMxDUmweEs.STEpAdQWRMfaSNtVjqlNlJV9fkGs3zkhK2lXQvmfnA4 QJIdaECOpnBRCIjNcYwAtnvwMCg8mwXfUkYXZtfKz8e.T43km9tfwQtrkZCnHf1KWfnXiiMX_EwS 1zy.yPGp0n4TGqJZ0OfN..4BbiaWX4OMT9__I4r6wuGDrF8m8YtZOF6XvKjYgM39ddF9iNDqgJw1 p_2cR.9icP.Ub5fhRRsd3Cq39ptKKcDmCOWlwvScjGfjaCqq10hJ8naxspsOzra1PHehUf9TD7wq GUzdWQ7wGkSZxWDhR9MkQuR0IXnFGgFidSKQ3fE.Zx25hq8frKUAzh_HiLmiCqCABs9Dc2yMDTXk sJx.tr_8PLjAFKdQ5I8.iGrX439haSRzhi_woaa9r4HLXgHKThAR_VFsiA3dQTr_1EUQU7VaqldG MY1fw7SlqUccyM13SQ0uDz6HvzyYOArnf9KBjhWyvF07qbsOH7EpdqYa_y5tw.JRo3helislkShh ccR4E8r3clZ3qH8dsKtkldktTkij_eX_VZLNkGlqCKUQJqKK0RsM4CUY5JzFbihtFOET1hyluAxH I6rAFFFzD0CHgbJJrvqgRW448MqQMLSCW1cdSA.ASfGLEJD3jvUqhCJ_l_IbDc2t9nHVXJwIvcPI c3L_tS5GAQN7HV_b5y3S_yIS00S4dBMDdHE2KFCyZPkqKtlzIXCskmfvpT.Dqz6pyQYcTgytemCP ZaZH9Qho2DnO8bV.YVnobpbAtlTuv_xfkMJPif9Zcp0nGIaarjjkBmQjLXAzdKEuaRNtcbHS5JVq bVyj8iFlgCLihuty2E5nTQT5WE_BrUr5ePFIzD4n8yUDPse4kOkSXmwWEJnMz5QTz8odIczBctM_ BdTp1i5_h29s.xwPWstmkrgnRAk6CjeRHjbJ0L_uMfg44A_pvu4qDSnp4tg3Nn3Rfglbloz0VHFL N6ZOcuxHFt95ii9dOGjBrWfWL26xpHmNlyNNinsxuWhqVm7EYNoFKhQnUyAe0kcwSi6A2ok6VCtQ WNTsYUbDiuRKBEeixrxpiX_0YIljt3nrpDNBxJTBRgMbzeqd89rochsLB.p1_IHCLfnk5lRnm5.. vH276C6UV7dhxcUnEwUrVvggLvddxw0.WcXi_Wa430RyhQLDHrtr4atLQ4lVGNnegxnWvF.qxZpG 4bb5OppMC16bbWqlFBfV31.dT1iv5N0_pYTXnMDEsxKkWZakUYuqfZXboZ2jYkLDh9HUTyQ7_N5H n5AWMwGXE8CG0nFdQqtjol99BeGB11phXckKEZilBd6O17XK.Ucl6XzxZcs03qsQpul58Dx5QNBS GAXyjET.4rgDSccTm1KPBGWVZGVV3ONxBEiWwlx6CgGltK042S3MPsg4g2rSqslrv5KK4F6eixnl ch5lmscAQ3_xkVn2r91gaFzLRZInGK8._hE8O9ewdoMvEDx8xIyTHDBArHQD.xIlUPqF8mKejwIS uu1P.HDAohBnP_RXceq__e4qy0eFyjnmifNxIKW59NjIVZBgam5vFWxpr56rLPXRkpCn24RskqoR q0UDL0WrRHPfymPCuKM3TZ7km4veOEjyDGp_1BrowSxlaom26xXAIrR9aTzpAzVB0f5SRz98xDQh 7KcqiWYzFv3NF6_gtXfngHDehj7hvwmmAZnQbPmYB6CGD1.MV43LHQraPXl.zuu_FtJX3b0zyTWh Hk1spgNI8P7LCP1YwTjWEJbUjp1WIdTzqLMzjrU3giD5xEWfkoAOGTF8sJGlBQYV_.ThBn2JIWGN Tp3IJVWdLpTwlKjws7HuHg117ZR8e0klDQpI6tzHN_rj185Uvc_hVudhlzk97BrbEtfvtheZ1hkI tEEtSBxcpkHzpU21voa4kA.wps6R7ie4V7uWKVUbieic_LfkMosyxD2JWrxOWVCimv.0EDtoO1T. 75RDzhbIIJ3HGWhAln.hg58U- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 08:05:19 +0000 Received: by kubenode570.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID e69a3eda63cf7b281caebbeeb868b41b; Fri, 21 May 2021 08:05:17 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: releng/13 release/13.0.0 : odd/incorrect diff result over nfs (in a zfs file systems context) [RPi4B genet0 involved in problem] In-Reply-To: Date: Fri, 21 May 2021 01:05:16 -0700 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <93DB4EE5-6505-4D41-BFB5-E66BE16EF00E@yahoo.com> References: <623369D9-5EE5-4FEF-B9AD-56499E8F1C09.ref@yahoo.com> <623369D9-5EE5-4FEF-B9AD-56499E8F1C09@yahoo.com> <04D7264A-206B-4281-B452-779B01EA3327@yahoo.com> <34E915B3-30DF-408C-A931-C39188F3EB0F@yahoo.com> To: Rick Macklem , freebsd-arm X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FmfKs3MxBz3q1Z X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=gQomzcIA; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.204:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.204:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.204:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard [Looks like the RPi4B genet0 handling is involved.] On 2021-May-20, at 22:56, Mark Millard wrote: >=20 > On 2021-May-20, at 22:19, Rick Macklem = wrote: >=20 >> Ok, so it isn't related to "soft". >> I am wondering if it is something specific to what >> "diff -r" does? >>=20 >> Could you try: >> # cd /usr/ports >> # ls -R > /tmp/x >> # cd /mnt >> # ls -R > /tmp/y >> # cd /tmp >> # diff -u -p x y >> --> To see if "ls -R" finds any difference? >>=20 >=20 > # diff -u -p x y=20 > --- x 2021-05-20 22:35:48.021663000 -0700 > +++ y 2021-05-20 22:39:03.691936000 -0700 > @@ -227209,10 +227209,10 @@ = patch-chrome_browser_background_background__mode__mana > patch-chrome_browser_background_background__mode__optimizer.cc > patch-chrome_browser_browser__resources.grd > = patch-chrome_browser_browsing__data_chrome__browsing__data__remover__deleg= ate.cc > +patch-chrome_browser_chrome__browser > patch-chrome_browser_chrome__browser__interface__binders.cc > patch-chrome_browser_chrome__browser__main.cc > patch-chrome_browser_chrome__browser__main__linux.cc > -patch-chrome_browser_chrome__browser__main__posix.cc > patch-chrome_browser_chrome__content__browser__client.cc > patch-chrome_browser_chrome__content__browser__client.h > patch-chrome_browser_crash__upload__list_crash__upload__list.cc >=20 > # find /usr/ports/ -name 'patch-chrome_browser_chrome__browser*' = -print | more > = /usr/ports/devel/electron12/files/patch-chrome_browser_chrome__browser__ma= in__linux.cc > = /usr/ports/devel/electron12/files/patch-chrome_browser_chrome__browser__ma= in.cc > = /usr/ports/devel/electron12/files/patch-chrome_browser_chrome__browser__ma= in__posix.cc > = /usr/ports/devel/electron12/files/patch-chrome_browser_chrome__browser__in= terface__binders.cc > = /usr/ports/www/chromium/files/patch-chrome_browser_chrome__browser__main__= posix.cc > = /usr/ports/www/chromium/files/patch-chrome_browser_chrome__browser__main.c= c > = /usr/ports/www/chromium/files/patch-chrome_browser_chrome__browser__main__= linux.cc > = /usr/ports/www/chromium/files/patch-chrome_browser_chrome__browser__interf= ace__binders.cc >=20 > find /mnt/ -name 'patch-chrome_browser_chrome__browser*' -print | more > = /mnt/devel/electron12/files/patch-chrome_browser_chrome__browser__main__li= nux.cc > = /mnt/devel/electron12/files/patch-chrome_browser_chrome__browser__main.cc > = /mnt/devel/electron12/files/patch-chrome_browser_chrome__browser__main__po= six.cc > = /mnt/devel/electron12/files/patch-chrome_browser_chrome__browser__interfac= e__binders.cc > /mnt/www/chromium/files/patch-chrome_browser_chrome__browser > /mnt/www/chromium/files/patch-chrome_browser_chrome__browser__main.cc > = /mnt/www/chromium/files/patch-chrome_browser_chrome__browser__main__linux.= cc > = /mnt/www/chromium/files/patch-chrome_browser_chrome__browser__interface__b= inders.cc >=20 > So: patch-chrome_browser_chrome__browser appears to be a > truncated: patch-chrome_browser_chrome__browser__main__posix.cc > file name and find also gets the same oddity. >=20 > (Note: This had /usr/ports in a main context and /mnt/ > referring to a release/13.0.0 context.) >=20 >> ps: I do not think that r367492 could cause this, but it would be >> nice if you try a kernel with the r367492 patch reverted. >> It is currently in all of releng13, stable13 and main, although >> the patch to fix this is was just reviewed and may hit main soon. >=20 > Do you want a debug kernel to be used? Do you have a preference > for main vs. stable/13 vs. release/13.0.0 based? Is it okay to > stick to the base version things are now based on --or do you > want me to update to more recent? (That last only applies if > main or stable/13 is to be put to use.) >=20 >> . . . old history deleted . . . I reversed the roles of the faster vs. somewhat slower machine and so far my diff -r attempts for this found no differences. The machines were using different types of EtherNet devices. So I've substituted a different EtherNet device onto the slower machine: the same type of USB3 EtherNet device in use on the faster machine (instead of using the RPi4B's builtin EtherNet). So the below testing is with both machines having a: ugen0.6: at usbus0 ure0 on uhub0 ure0: = on usbus0 miibus1: on ure0 rgephy0: PHY 0 on miibus1 rgephy0: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, = 1000baseT-FDX, 1000baseT-FDX-master, auto in use. I rebooted with this connected instead of the genet0 interface. Mounting the slower machine's /usr/ports/ as /mnt/ from the faster = machine: No differences found by diff -r this way (expected result). Mounting the faster machine's /usr/ports/ as /mnt/ from the slower = machine: No differences found by diff -r this way (expected result). Doing diff -r's from both sides at the same time: No differences found by diff -r this way (expected result). So it looks like genet0 or its supporting software is contributing to the problems that I had reported. It is interesting that there were no examples of the content of files reporting a mismatch, just some file names/paths not finding matches, some with truncated names or obvious-garbage bytes in names. Note: The faster machine is a MACCCHIATObin Double Shot. The slower machine is a RPi4B 8 GiByte. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Fri May 21 20:07:35 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1368A8C1B40 for ; Fri, 21 May 2021 20:08:59 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmyNn5kX9z4rff for ; Fri, 21 May 2021 20:08:57 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) by mxa.khramtsov.org (Postfix) with ESMTP id 2ED8F125EC1 for ; Fri, 21 May 2021 20:06:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=khramtsov.org; s=rsa; t=1621627615; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=qLNePR3GoUaRsPgfOrjj9xyPk2R84fFwgGE0rXwT1pk=; b=KerCtlb8mh2TYuriaHe3AB+bCQo43pv9gHf53eGtbGmgOmesRgzdN42tpg3nE50JF+bZaY oSYk/R3mMbKXl4v6ubHImA6Kwh+HbB1rPZBRqbS6IqA2i5p21eBrAEJqmH7YGLFof7IEzE kaYrj7zSoEohX4ADWYkBZTVwmUfFm/JIA66l0C6DUAZjL3AH45FGQsR+73GWKE3rgw0s8C PkzWQftzuEw1Y921jDPA7oXJPai2idKwX7v0L7+WmG1Pd7BFnd6j53tVKmv1wKP22ilckT SKBIjgXIjqqNiPM2YYRtL0QheixVJBLpYvNG8oavv1N7+1RnSAn0OVddx0obGA== Date: Fri, 21 May 2021 23:07:35 +0300 To: freebsd-arm@freebsd.org Subject: RPi 4 build time Message-ID: List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4FmyNn5kX9z4rff X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=khramtsov.org header.s=rsa header.b=KerCtlb8; dmarc=pass (policy=reject) header.from=khramtsov.org; spf=pass (mx1.freebsd.org: domain of evgeniy@khramtsov.org designates 2a0a:e5c0:2:10f::f as permitted sender) smtp.mailfrom=evgeniy@khramtsov.org X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[khramtsov.org:s=rsa]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a0a:e5c0:2:10f::f]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a0a:e5c0:2:10f::f:from:127.0.2.255]; DKIM_TRACE(0.00)[khramtsov.org:+]; DMARC_POLICY_ALLOW(-0.50)[khramtsov.org,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a0a:e5c0:2:10f::f:from]; ASN(0.00)[asn:207996, ipnet:2a0a:e5c0:2::/48, country:CH]; MAILMAN_DEST(0.00)[freebsd-arm]; ONCE_RECEIVED(0.10)[] Reply-To: evgeniy@khramtsov.org From: Evgeniy Khramtsov via freebsd-arm X-Original-From: Evgeniy Khramtsov Hi. How long are compile times for aarch64 8 GB RPi? It is especially interesting to know about overclocked results. I guess buildworld time would describe it well, but any heavy port (ex. rust) would also be great. From nobody Fri May 21 20:58:36 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F2D858C97DF for ; Fri, 21 May 2021 20:58:49 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmzVK4y88z3q8c for ; Fri, 21 May 2021 20:58:49 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621630728; bh=vZHeOt8/82xBTZW5NXt+kuuH2tMlj4ClpJX6JyQH9qw=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=FaqgK80ahrl9RyOg89nVXYBpRdo1INHiev+QKVhioYUKCjnIToVnBolOMFXzb+yABA4MGiS0rYzsHPa21M51S/NIMt3eRC/Q3MVF0P5LihpDaUWdqzzUgd7FPsoC6BF43Is4tqILf47SIwTVM0vTM+6ExL/1i1Jz62z6PTqI+x/W+ZQwvmYMbIPVXWw1xT5YXhdb4aKpv/E1vSudTG2mPfxnsbti0jKZcMd/fiTy/GTSQW0fT5C7DpFlO60b0En27C2ZLlJv7tUNdps2elmsGvA5grqeWjYoo7rw3OczW/NJevA71gVe1uykKfDOF7Vlp/8bZMfYndd/Gg023GYpvA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621630728; bh=QQ+4cxXEfWhPnMeMOF3ryQPbq6q3tuxHZpQnUu/85DZ=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=P/+k1Mq11Js9t6q3cMuJZnEZ8MWUTLQe9YfcvbdkD5lP6djRY3oiR6/B4TCoz6h7yPWE2k4uHCdIML2NiQkm2rorwAEwKg8pQ9RzOV3x0FDIdEJFKhbVWjYurYykeMVe0JOBCuKRfZD7FRRJ2w9MqbuWCITvrvt4QTdCzjWMvb3RLGqn7MapEwek7ntGlEfKOryw/hO9RTerSJN7u+jw2hL7BqQJ65zjCAGKNY1Q6vhLr3YapZ6BV8XL4nbYMxK0qbGL1MzAdDhjU7y81biLqg6yIn05uOQeF/JyyNyi9ZRT0N8+8N1gfa5Zw1+4F6Nq+OpMIV/PnvJi5+gLbnQwFw== X-YMail-OSG: S8mvlc0VM1lWasusLr5GykLrGe5VZmEokFJ7MPe5DIFt7FedsnntUHFgZVj1yxz V6mmb5u2JDAUfKlrejYLhLZMIaYH9CuUbmF2NTLPuTERb7me1bxdBYYWGSiDYRsOFlQrg7Ntg2gN 8AMAjdM59UTixl7Fqen9jVmOKRMgaa11Xy8VqBw.1bEvgmWDPUnJAq4NW4U5Hw4e3DW8bx1ZRbjS 6ha37vBGY.9_mAdLuPFB8BCcXur7rqzOC0sC1FRCJYD1vnMemzfxmHxgBfphD50I3Y61HlcvzQsI WYN_f5hy9FHnYvVrUo3CNuDYaT1wdp7o8v6cJz68kuTklsbglafRC21jsNFZXzRvqE9xBeHW9Ya4 lXRg6A8MDoE8qMrPqC1kd7HtPbs.bYhFYL0w78gle_5VBUANr8zQRDTbpY5k.6fcvUPgxkULT4s0 vbMvjOkdUC.aBBu9IJlY5hD04MLkWtzNcnjW9hzQO1btICqklep_73BZhdzfDKxJBlku.C_XQX3I G0aXtq2zkbp7EeSQmpYG9Lol9Ak.YksLjEdQOHns3Cg6VOwfzMNWZpCUEmp_HvzlPF1k8fAhT8nf HuflRVl7pY..RFUKrWSkZSsJHL2XfCq9NHNVSmKbqVpZWbfj27MreX1dIiCA56nWNosWm7sbe86V ydXM_1S9H_ajedtZpYampnEQ8UMxhe_yB7BdKnCTk6iiUZ6MNolVI9LsBnuaSflMX8yIZjDuoEdL 8ip1aXGmhapqnF6qGD_Z25kDvsWnrvflDMMNOVbey6UQaOTST18Xahp7fD6_Btaq0j.q4U2w7upy cMz_YQqAZ8jYFAr8OJZdoz1icjGp7rstGXsWoXJBPceckLbXOfgAmzQIH2PUL9zG1GYVPrWzjMAT HtKzny7fIjK_30_AKR.sODt7MSLiEcn8bIRtExIPVJKTeqR6PMwJ98qssxe7oJv6wQ1W56XGAlg0 HO.4Y6M8ecr1ujF9LNcW64mRD7uazrlnnTxDw8ujyU4hxrQIqxFDptw8MEcmu.fn2XwtIMnazAi0 aVl7U6F3m1bughObwk13FrFQWA9IthEqdf7h3fYbdxbxTM5rr1jJEijxjz44YIpfm4U8N37yJUVG iVerlURdKeEWG7bf3eYqIn2uEirKt6uJF1bIfNaNVZ.mIiU8o.gzZigqg_FdUSktNkplAsJxEagN kx08YLvRTLVI40mIQgctlTDjgNltoV7g2svCS49gjccUObkLEN1dgFza12IKKlQj.wCV0F2eoxw6 XKykZtGnugo6.r6IVeMGmfE3Zedq9Vo9dskcWXxMqPQlx2SavioDO5RByuFFfan5UTe_3NwgKjF1 Zb0WkS_ur3jMuxBfWu77ovG05D1odHd.3S4KRbDFHAOnxMzgSqpUlRR61UVtYuPTo8H_ShpLQBdw FqgHPdQssKFddvACP8A7UFGK8N2koJz15HzliGZ4CnhAZwzXIQBAANIX1gSX2IEFmldTGT53Kb5g sM5WmP.svUCPsiwlGXnUUa1YzO75v1lNmpeOKmLNMQKVaAzd1xmx6p5t1y8jtsrN9FZVX7GyX80C d92w47ZLvFv7thl3ePYI3290bHAiWc89ryyOeja9pIKnrtSz8Fz588rs7.Naaju092fg7Uo5E2HV Wjdwzv60xCvwXDBJPRUqmBkM0fraNYnveKRXhfgIG6zz8PFEiaGJKeUEovx6daJnowFjDWjpKFD3 KC3a9RHzaqKZEdAfu6aGrFkszo.MLuWd6tF2mvntYNbCPHyMYPIAp46dF0tYLasrmARPib.RMIoU eZSNO6QhX12JZWiID4I7ic02_t2cJVt7D8RELZAGmx1xQMg9Bz0XGW0omMKmVnRTolC56Oz2KwX. x.oTvttPmb_7H6hjLlxZqWVdjtD.zAceCMuNbuQW84i6GR3rbik0tItgAqQEybERFzQ4oJYFwry9 fOU5tWvcQBcm7LvlzseER07ZEJGZQgvQ0y.iJAkBpUVQXvb5nHmaNF.YESHY9rcCmoFzatQqX5J_ xQEUrcqVTVSa_gnvwPPb5_I2ZAC5Hla0k1l3L6cga2iUYpdGf3SbWegmmS1rEilnKhSGJt7VYzN3 IwOXPUIdGRS2KjSAkTSW1y0f8FNqI_luRJpFlaDgFRGk0vVWArltGa4WwU2peAwenxsZSuQIM7SI 8VC.mm6IvFZ4IDVZlf8PhYYtw5jNrlJe7_uozgG2T_Q0KXjsyuNWFuvYHVAjGcsEknJ1GwRe.zRV GEH6T6xM6MlUABwaoVzTpbuB6yqebf7CuKG60kATnY8s9paVkOaYZqUF657s48hzNkrOv9mO0z7q QwfiFEQKLZ8zqOWharBmSpoD0sgUyk9eMuWDKjE4UJKHC0plHR8dzSw8FbKBtDnFQi5sLPO4Y7yS 402G1xBffwowmgnUCn2vtM4PezpeLYdv20O5FUZRJtCegsYxTRH0EG9LTscDDtFsV0alAhlEjgU6 ZgHw7lv6wAvNbN28- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 20:58:48 +0000 Received: by kubenode518.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 26263a749e938c58cc95aec45d385ee3; Fri, 21 May 2021 20:58:42 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Fri, 21 May 2021 13:58:36 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: evgeniy@khramtsov.org X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FmzVK4y88z3q8c X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-21, at 13:07, Evgeniy Khramtsov via freebsd-arm wrote: > How long are compile times for aarch64 8 GB RPi? It is especially > interesting to know about overclocked results. I guess buildworld time > would describe it well, but any heavy port (ex. rust) would also be = great. To get useful figures may require specification of more context. For example, building rust uses over 17 GiBytes of temporary file space. This suggests that its build time may be very dependent on the media in use. Also the configuration of building ports in parallel and/or allowing a port builder to potentially have an ready-to-run process for each of the 4 cores makes for large differences. Also, for buildworld, there is a large difference for when a bootstrap set of clang/llvm materials is built vs. when that extra clang/llvm material does not build (even if the normal llvm material are built). There are also issues like if ccache is in use and is providing a signficant amount of hot-cache results. (I do not use ccache.) The same sort of thing apply to META_MODE use and rebuilds: was the build "from scratch" vs. just a partial rebuild? (I do use META_MODE.) I've not done lang/rust builds on a RPi4B. (And, for ports, I normally allow multiple ports to build at once, each allowed to have a ready-to-run process per core.) As for buildworld/buildkernel "from scratch", that I have done and recorded some figures: Context: make[1]: "/usr/fbsd/mm-src/Makefile.inc1" line 339: SYSTEM_COMPILER: = Determined that CC=3Dcc matches the source tree. Not bootstrapping a = cross-compiler. make[1]: "/usr/fbsd/mm-src/Makefile.inc1" line 344: SYSTEM_LINKER: = Determined that LD=3Dld matches the source tree. Not bootstrapping a = cross-linker. I use a USB3 SSD to hold the UFS file system, swap space, and the msdos file system used in booting. No microsd card use at all. The USB3 SSD seems to be fairly effective at making the storage-I/O performant for the RPi4B context. And oddity of my context is I have the code generation set up to tune for cortex-a72 specifically. Both the system doing the build and the built system were based on such tuning. ENVIRONMENT: -mcpu=3Dcortex-a72 RPi4B @ 2000 MHz, hw.physmem:8464072704 = : ( arm_freq=3D2000, sdram_freq_min=3D3200, force_turbo=3D1 ) World build completed on Fri Mar 26 19:10:11 PDT 2021 World built in 22491 seconds, ncpu: 4, make -j4 Kernel build for GENERIC-NODBG completed on Fri Mar 26 19:38:33 PDT 2021 Kernel(s) GENERIC-NODBG built in 1702 seconds, ncpu: 4, make -j4 So World+Kernel took somewhat under 6 hrs 45 min to build. # ~/fbsd-based-on-what-freebsd-main.sh=20 merge-base: 7381bbee29df959e88ec59866cf2878263e7f3b2 merge-base: CommitDate: 2021-03-12 20:29:42 +0000 def0058cc690 (HEAD -> mm-src) mm-src snapshot for mm's patched build in = git context. 7381bbee29df (freebsd/main, freebsd/HEAD, pure-src, main) cam: Run all = XPT_ASYNC ccbs in a dedicated thread FreeBSD RPi4B 14.0-CURRENT FreeBSD 14.0-CURRENT = mm-src-n245445-def0058cc690 GENERIC-NODBG arm64 aarch64 1400005 1400005 I've gotten very similar time frames from builds that used a ZFS file system on a USB3 SSD of the same type instead. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Fri May 21 21:16:50 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F0A746279F2 for ; Fri, 21 May 2021 21:17:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmzvJ0DVrz4Smr for ; Fri, 21 May 2021 21:16:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621631818; bh=A7ZgUi4ycwi25hj0zUGYcEX44nvTAeQgKsUrUvTK6Nw=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Lk71JUdDuWk5mfqEcjmkRXsB3wySmphW9BquSKxQjMGbC1uA5nB7Tdk3/4M2fe/7+cTBD0kmzy/25pMP6+Os/YGS0DF4gpmhhtAzIX0ubxzLHynQ6metivCgw7HGRHRDFDj+X2tcmuulOMK205H8Ll7j0HK8iea8T4ZcanzedZjniDkK+MS+fnhCB78Anc+dyFsZyapfP4OuMjmu9fB2PtyH7s2gawOFe/1xbmb5yOEhmBV5ylB7UaOb6/ucZslm127p/n8SSTsm4RYTdPTUzul9dvhUPUN4+MjMizQ+/x1T0EQYRX1uxTt2IZ5WPUcZ/I3ZHLbE2SshD6r7BTTu9g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621631818; bh=usEw1MrXZ7Av6znkkrNfK+hXmm6TjoK43xOgswvlV8Z=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=l7i4Q1Xb/mzd6S/9Zv2zI/Th6nAaocNYHW3RUtFAfrI/3nQEtAcN+qB4bXMHExSx2xpqUG9oDX11Rn5mVBHYohwdudQ67zArlb0ssR5QcuxsKp82zIqGfeh3PrZWWjaaNHzy+uM9sI5xIA7IAKJTbSegfBK/Sg8nOVKe+ENqlNk1XCfy44NdHfVvZhcwS6XSFCNjOUaMeNurte7uTNcmcQSc+y3LEK9PWJCYWevow8/IWyUvObjkqT1Gdy7vcUpvZKju4Y1RaXHQIwqheCy0Wi+lHCqsAk4WivXSORaEcpi+JfsnUuKFGu2HkIMZP+BqYVRlXV99k17kEzKlBsE3dA== X-YMail-OSG: Vu0SgH4VM1kt3KE4jnzCKPWQaQNVuOkfqTO0sn4mOdrdrR6acX5huQTYDTRe252 WcWPE4rcgM.HaOFPc.vcy.QaohIiM2e8W.oJ9wq3o3ZLbTCoQ2_7ag6v3lH7KemrW2J1MMBhoyzL wNd7QirviqU76AiWO0hYfDEWLN6i3_GZ8bp.NGfR9mtUf2AAnZrifgZNZYoycQM8UXovN7n0TRf6 NGFF8T7ZF4Pnba0FPEfh.TlkZvEDbaVy2xLvdspM2P3odWqpQOMt3p1xg9dgIG6O2ynrVogf5lRt bDEBtNX57bxa6YYyRquh.lEGiRjMNHdMG_G9OVZijn3aux9uupOiL2Wu0eg0NsrYnBpuf7yxavaX sZmiugkJw0EDAW1FBHy.dSPgfYuV2a16WMITYJU5TrRkHyeLPn_Is58NL_PH7udxN.auY4fMoDji KZQjfuiiFaZ.Y8AIGtNNmoL0plyfkL_KHtWoyQp4LTB3ILF5o0I03ZYz7ZDGqnzafBTNM22Shxg_ MKHeiwHLC8ccy6uiszMZJez1xltpIJaRBNTznLnuWMZ91sD.h7vdKxoJ.X9P_K.R2MFmjzm2kaKM nsh_iDow4RfExnfKGMlHfQ1Mi3wVH3nusuGG_HxPiR.pBkhSjY9N4w9ssgzR5.RYPcII.mAfAq6u IM_BRnqRhGhTlDirBOnT8ZdVB3mvgRt.fFSjeOeGQGoOWpTxBBLtBp1DlUin7R5iGaoig4EVnN28 iGgDJXXogRok2SGL3UvK_M8FnMWEMImZ0LwmfMK07zyXTXwVdgvROJm.mPdM2g1iNPKHv.flqR0u tnB8_XJjOoXjgpfMUlkrtWz0TwdMNcgRbVkpmgI2Q6Vbuk03BnECNxPU1BeDi.UxaW07tKABBCOd zZymbSB73_mA7CuaGYloEaA4GNl_MGTNf45F8vZXdj0253hMbgQZt80ZkOoSPZ3KQSI3Tzzse0V5 cKAkDqXEV3RSZqSYGkp5y2iu1eFkGkStJMiUzlJX78NdWfHvHpvG_Ocs9sjJoE7xM4nBAWh0CZGW qmPn7Wfdd7zI.j0kl8zYlUM2UC5ie3PF21lfAOtSKmaERgWoLFAv3T7WGsXaZWdxXsPGKr82p96f K_nlXKLdB8uajMNvJHuzcvAO815XM4k437aNlhBsFr2M74KXoNn4DqmXoCiCLx7ZyT6uDx7ZbCPB 9sA6._6VdugwkTLbh4EHiqOFTDAn7s6vrFk7ngTOIfJd4KPGjEipyqdrMX4RgyK9oOG7Wvv.H_an NojAUJsfAjAJwAgm8FbHwj7mxf_J2YisDt4F6JWtYMMq4r2IhOgbp2kI60L9uY_TDxzr9SoQbNAb 9.npYq33GjwI3SjNgDpUzIvBcRvzIpKk0w10dM31VSIvCHup0Py8UhDShX7gpid2m04Hz3q.wQV4 1Aj5dKV2Cs_R7h3yzkrh8snZM4dSf2.6p9Hb.71sdlpwc_HqclmvpYFKCOyYARyA6oQ7_ID0xVh. 3AwOjPYcZH3SQT3U4q508RQguj90EAVA0QD8sx_iMtedvfWXyeomGsvZviOEQlA.qBopijlnIRWf vq0SrYW3.zWFdA.hS.h6ywjmSAl80iGT7P_hm_XvK7zNdCbWWNV2M5VzJ3kGcnWJTB.LwYBbGyXq yWQXtL90Yaw4wASNxHoC6JmP3FqAua8KVnyq4DQvaJXgKVCDbifanQFecoSxR4.SH7d9taslGVNW 1Xic4F.K7wzy9j_pV2hRCjoFxgtdTtkqvlaheqrfM__CipE760am_9Qug5j_70B3ft7ieTY1aNxN AWlecRmEOIPDJTtVQfz7VXM83Jp9Z_d5JimVKooofdvtQMrbokDZffvw2gB9x_Qcak9pdVFam5tK OaD4apqAbrf5T5VVRTzath5LWpAbvn5DEMLSUYc7q8A.xQx6zW8y6gCQ6tSl4FwiPl8S1RknELao 3lWqc0pVkzr509I35eSF9zklFUC3OfaNQGwFRE02StWZK0Sz0S4YSUbqzz6lbXbWiwcc2bPTiCqy UlFHnAgDZ0Im2Y4LJCEwe0fuXMrC1We8N9sABZ9kU9LMNpBWECJp6SK9yhj1ETRzK_YepN7gzpj1 J.yFiQ3WQ9EL_gPEEjrM2gcdVAg97Z8rzkADusziswxju5L1lVIiZb7D5Wtt985QVvbx5bY26i9x bY.3tmA9KfqBiP6CxfpefKBjU1MLjPZ5Kak5ymywr60a3y7FjU3BySkKgDlosU7vn8xRC4Z5G.GR 4HB1z5bQ6cwVkxV3w_qf9ZqnAwA02Mvq8SRNfADbUFd9jQm.fzIoEMLSVFPGwcqydCIL_f4QgY5M yAMeDUlVsziITPshzsObj0zUpGII0DRLqqqnQYHPgXInqVq26dIo1uYV.y6.92Bg9hhxfLavtfJK Nnzb9Om6kamWNiG0e9TdYH66czN6bCh3bdxuwJORJbkFMrFBb9xs0x4qgBYgWCs.wCN24zpuzFQX 8LjmwYqXLAck.7zKxY6H0s4WVNsoDp0YVRgwuHLi4oMC2FGYRv5qUCPTZVKKfVbkTAmDnGQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 21:16:58 +0000 Received: by kubenode547.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b985bbaa9cc8dfecb26500052ed29546; Fri, 21 May 2021 21:16:53 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Fri, 21 May 2021 14:16:50 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <65CF6930-03B1-4FF0-B05E-9731A6820582@yahoo.com> References: To: evgeniy@khramtsov.org X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FmzvJ0DVrz4Smr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Lk71JUdD; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.84:from]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.84:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-21, at 13:58, Mark Millard wrote: > On 2021-May-21, at 13:07, Evgeniy Khramtsov via freebsd-arm = wrote: >=20 >> How long are compile times for aarch64 8 GB RPi? It is especially >> interesting to know about overclocked results. I guess buildworld = time >> would describe it well, but any heavy port (ex. rust) would also be = great. >=20 > To get useful figures may require specification of more context. > For example, building rust uses over 17 GiBytes of temporary file > space. This suggests that its build time may be very dependent on > the media in use. Also the configuration of building ports in > parallel and/or allowing a port builder to potentially have an > ready-to-run process for each of the 4 cores makes for large > differences. >=20 > Also, for buildworld, there is a large difference for when a > bootstrap set of clang/llvm materials is built vs. when that > extra clang/llvm material does not build (even if the normal > llvm material are built). >=20 > There are also issues like if ccache is in use and is providing > a signficant amount of hot-cache results. (I do not use ccache.) > The same sort of thing apply to META_MODE use and rebuilds: was > the build "from scratch" vs. just a partial rebuild? (I do use > META_MODE.) >=20 > I've not done lang/rust builds on a RPi4B. (And, for ports, I > normally allow multiple ports to build at once, each allowed > to have a ready-to-run process per core.) >=20 > As for buildworld/buildkernel "from scratch", that I have done > and recorded some figures: >=20 > Context: >=20 > make[1]: "/usr/fbsd/mm-src/Makefile.inc1" line 339: SYSTEM_COMPILER: = Determined that CC=3Dcc matches the source tree. Not bootstrapping a = cross-compiler. > make[1]: "/usr/fbsd/mm-src/Makefile.inc1" line 344: SYSTEM_LINKER: = Determined that LD=3Dld matches the source tree. Not bootstrapping a = cross-linker. >=20 > I use a USB3 SSD to hold the UFS file system, swap space, > and the msdos file system used in booting. No microsd card > use at all. The USB3 SSD seems to be fairly effective at > making the storage-I/O performant for the RPi4B context. >=20 > And oddity of my context is I have the code generation set > up to tune for cortex-a72 specifically. Both the system doing > the build and the built system were based on such tuning. >=20 > ENVIRONMENT: -mcpu=3Dcortex-a72 RPi4B @ 2000 MHz, = hw.physmem:8464072704 : > ( arm_freq=3D2000, sdram_freq_min=3D3200, force_turbo=3D1 ) >=20 > World build completed on Fri Mar 26 19:10:11 PDT 2021 > World built in 22491 seconds, ncpu: 4, make -j4 > Kernel build for GENERIC-NODBG completed on Fri Mar 26 19:38:33 PDT = 2021 > Kernel(s) GENERIC-NODBG built in 1702 seconds, ncpu: 4, make -j4 >=20 > So World+Kernel took somewhat under 6 hrs 45 min to build. >=20 > # ~/fbsd-based-on-what-freebsd-main.sh=20 > merge-base: 7381bbee29df959e88ec59866cf2878263e7f3b2 > merge-base: CommitDate: 2021-03-12 20:29:42 +0000 > def0058cc690 (HEAD -> mm-src) mm-src snapshot for mm's patched build = in git context. > 7381bbee29df (freebsd/main, freebsd/HEAD, pure-src, main) cam: Run all = XPT_ASYNC ccbs in a dedicated thread > FreeBSD RPi4B 14.0-CURRENT FreeBSD 14.0-CURRENT = mm-src-n245445-def0058cc690 GENERIC-NODBG arm64 aarch64 1400005 1400005 >=20 > I've gotten very similar time frames from builds that used > a ZFS file system on a USB3 SSD of the same type instead. I forgot to mention that for the buildworld/buildkernel both the running system and the built materials were non-debug builds, despite the build being of main [so: 14]. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Fri May 21 21:45:13 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 69EB68C42B7 for ; Fri, 21 May 2021 21:46:39 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fn0YV5Gm8z4g8c for ; Fri, 21 May 2021 21:46:38 +0000 (UTC) (envelope-from evgeniy@khramtsov.org) Received: from mxa.khramtsov.org (mxa.khramtsov.org [IPv6:2a0a:e5c0:2:10f::f]) by mxa.khramtsov.org (Postfix) with ESMTP id EF1BB125EC1 for ; Fri, 21 May 2021 21:44:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=khramtsov.org; s=rsa; t=1621633470; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=WtT3fzYrhnpd5LA+g5dcPSI+q3TVnJNVuzwvZHsbyQ0=; b=A4IlgipHQhCRCWvIE4Lj25AgLYUFrqfc9mvoXcewt7BlrBDVzUEctcSPRbGH/oRlwylAEK tlrVFCl9Iq8DU0RM/F3HFs892nJ35f+WGsmKFAz5GGnwcJQxFo2034/+FOE2RnQcwvolru Uh+EClbwNYm8ogVJJMl91rV360FaOgnVAEqDctESVYFYqR9ZT8R71aKlodffSompAbccdz aEG1B3fCCDNjUOqrLXLq+MHy9pEBuiFeApDgBBfGJbNI70f1HvFTXvoinRITz9+igsf0sF 5kmeNqkdQLkfgf5U0gz+AsyprqQ2/Qs5L2zo81oKf3gPJP8YlxPowkzJpucINQ== Date: Sat, 22 May 2021 00:45:13 +0300 To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: References: List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Fn0YV5Gm8z4g8c X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=khramtsov.org header.s=rsa header.b=A4IlgipH; dmarc=pass (policy=reject) header.from=khramtsov.org; spf=pass (mx1.freebsd.org: domain of evgeniy@khramtsov.org designates 2a0a:e5c0:2:10f::f as permitted sender) smtp.mailfrom=evgeniy@khramtsov.org X-Spamd-Result: default: False [-3.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[khramtsov.org:s=rsa]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a0a:e5c0:2:10f::f]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a0a:e5c0:2:10f::f:from:127.0.2.255]; DKIM_TRACE(0.00)[khramtsov.org:+]; DMARC_POLICY_ALLOW(-0.50)[khramtsov.org,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_COUNT_ONE(0.00)[1]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a0a:e5c0:2:10f::f:from]; ASN(0.00)[asn:207996, ipnet:2a0a:e5c0:2::/48, country:CH]; MAILMAN_DEST(0.00)[freebsd-arm]; ONCE_RECEIVED(0.10)[] Reply-To: evgeniy@khramtsov.org From: Evgeniy Khramtsov via freebsd-arm X-Original-From: Evgeniy Khramtsov > World built in 22491 seconds, ncpu: 4, make -j4 > 6 hours 45 minutes This is impressing considering that one old Athlon 64 space heater took more than 9 hours to build FreeBSD 12 in 2017 when CC=cc, LD=ld matched the src tree. Thanks for these results. Couldn't reply directly to your mail directly because of some issue. From nobody Fri May 21 22:13:01 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6663D8C0C52 for ; Fri, 21 May 2021 22:13:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fn18310Q7z4tG6 for ; Fri, 21 May 2021 22:13:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621635185; bh=eprukXqwOOMbUtJGL2N86rxToDe8LYB6WRDu+K0SL3o=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=CCiiYZ585Zg4atDoq32eXmNX8jUf/34mOnFuPAgFpGcrBvMw8UpFjTMhmIVPxN9HMQgupOd23fhBeLvDfH/yAQp8XFTMXe+pabg9XtL/KbjAG8M15nzP/Wb17onc0VbsA2A7SmQI4x/SBQqq4p7UfpI/N+gIgrB0DYhtz+unJPrG23cwGrXWaCaL9JGwSQYmYChNvUcJJFmj/hHIawgnMdbLR+12dQmPo+l495/FkfTgoIEQZHMl0xwxKLj0DdN3gyTb26pBxj8piRmZ5/a9D6juDPktiG+BRCpbxsQOlwETU3vvwL0auHykAwF4ivSM35Z2kKcif+KUZ86q37+CAg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621635185; bh=EGs8dHRRGHFisz4dq5tLyAgMgFR6Jknj5bajtgNVRZP=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=jjr4BUfEe48zVFGigEyFOYQ+XTRbbwXtwNa5rYJK4tGIeYuOGpIwboNIlnX8rcmiFjaz1RSflgo81duBRn0uApKuSMVV2FLQQaTmuUqV9wm1KxDNiv0t0c351xnkhFh/aC4QyAYDhjySWJpM/LDagb8ydD5ZXpmQMWI44ClPPZrNLdFZgcr6BBsov85wHEYHJ2d2nRLi0ec85q+lXSf5sYq4x2jQv4Izf2Z+MOEq6ifQ9hI7RW86LoBTSQ91SrPagTS3eS5VKsS8xblcFxFjXosazR4CGz725Ci5KfGVPLjP+fZqWxouEuDgvxRC50hGn9d7DFj5QhAkvlcpXaanQw== X-YMail-OSG: jTdFRuoVM1lnEyl7yt6Ze25Etxdqw05sc5EnXz0OQAEGFarZtXOtCXyIQxy8tyj dckNHwpkSR6KHuvPr89FInkzf35XGdt3ZzwHJWQADKPck2Xtp9JCxZgOumFbCfT2AKcV4qKBdtmd R2q0AukYnVTRD2OAPmiKVXCctcMp.y0ppYu9Qyj2B2s6IEH9rJfN0DcvR3LAhJfloNkp9StY9cOt sRgnRYGjmnv_Q6JY8G83KSYsb2Vy_2hJ9h7tL3pbKhJtJDsegbb9Z7o8.Y7fAJ0X7d_rmXS.gKfy KcP768bwV4uukvtmy_v.qD3hzm2Gi4ZeqJ.tnl5tyIaby2bZyUCR4DbMfLmKSz.KXWWD8IxvRuPn 2IxKUaC.k5TJGAcSwSQoQhFOLpfAAtplrM0uNPTZWFxFP4PVK6abNRP7Gj2SeteZyWRxJ4L95nBm _L67XfnsBsXo04wsfBZj5fyIiqpydJbjaA1KyIcbZ2kRhvnrQJ6ZeR5LoLYQvwDjkWg8e8K5tW7F olcScwdVziCoSwHWtCI8wsZCZ_I2ovHWEufeaI5i7nCV1wwog9QRwW9JEjVkpnJXl3.FYlJCJb0u _5UP0DiaQ4LnlagAuJbTUsJbJcxUQT8QcgFuIzTdN9KDyfeXROYMCuzICTxCr7S66ayhIhMo4Tcu 2F2TU5yOY6suyB.KBzbRQzTtr0TGXTznBGsJnnRkQWplr7jaseaYWu3Vzr67I77IVpOI4xll6pmd I8_Ckt2oWNvKLSWjsSylfDGor36dN396SYz3SYDj_uOE.pKmtL667l2VOvyDDMqVo.WH2zWsUYcd uFL4fPC1EB5YV7EI0BTUdUtXitKR3h7PiT6yhb7eDEG9wsghyjQ3UeWDU8tXBaXpZqHnav99AAuo PmQyOReP0bdlziZTWF8pHQ9_pfYg4.WwdhgYaHp4Tkrp4AxJtD8RfgPitGExDoz48ykaU9waNmYE YqQ8DrlLHrk09nhN6DdDn_aISX_4o9_OqRag.g.aqyUu4p2.IQOUGyr1uLDKc7jg3cSKd4SHFAng EWfRsvMPcIXfdDrCWdjozZxP0WgOxXFJFnCjQSFeJL7d5TljTVV51dnsMGFYVG0iNxhrDX.YyncU _4Klf2owufP8F55OrmuXwy18q_03g8XBp3oV_WA0ceC4NnENWM0opZ1q3V0S6ORoD9iy4_80tbAD a9CNLHCYLKREvSs_vIv7J2GX58Z2aHPniDANVZHlYSr6rO4wloZ40.k498Bl9ZeOlecZUSpr_HFz v4CbPcsmLJmyF0IQWdRNwu.dfEk5hgXoQt41Q0gA00BuI9Dp3RAIahrM4EWME6GDJ5z7NaizIydy 6BZDVBmMWL8qyw1ofajYwtcbEtaMb7jWHP_adJb2k.DlzQA8PCytNjIAJgcwQ9z4XA3OdVKx9uAk 7nBUQ77LtZMOjznUwr7i.msqUJV1QRmUr9o49eKXaXfmA4XQuTTUk6TLSTe6HyXDKMaY8QuE_w83 bK3o.hWpwMOs3x87a9Suxq5tzGUEUyYgG21hLwEyXdkGyhHli5_r74aBDb5dqkGLct5jVaub1x5o B5R03m.XdOr40EG7kl9HVR.2xWpopMOPE4VkAeDnOiyTyWwuITvhHZ6j0jkmHXbQc5RAHfA4kYUc 66BrRVzwMoOXa9Gp5ubLJVgvDaNkKb94jOS0GKSxPDor1c41ULahqPuxDo2V.rn9xw5Fu..KAW2G Ok.W6NHhZ3CGhV7feyo2lnw294JCBvJWMjhh1zZs04TO_3waH6X3lg94AdxCYned8AVdsK1LF52z VZU7JS59jWO0s.uX0XP5aJcUgJZEtz79xWM7umTiClepiGNUsx4Q62EjNG4tUTBjUaG1xe_D21hy M2V4OwWPKvU6xDV4hKt4DhcbOvptEmbspaN5bof5CF9323RHBxjB4z1BNyZcX5zNAjbJaM1djE8. 60KUmGDxZaJfFrkkqjlYI0VRNmvtQXaBik_5iL47T7PuBgTUSkww_.TC4Ag3e9lRbSBhZ0DQ4iQ0 8rR0AeH_st8f6G24c8rc1NWRWqf_xIEwBW25E_RbMh0uxmJSnK3HvAcKfxdLzTtYDJQO595hNZKx ZAaz61MaWaPYATb76xqh1wycHwpUJtUO_tUvRzFy5zmKokGWQx4VVxMsdx3ukQwQiYhP0u1FpFDr WeizohcL9tbGKqmX1hEPEyLS6rH6hqDyHtoGQSyVKBYMdYi.ls1RNfi6o.mt1zCuibrT3P.LNbFP nTYgOZkNy2qRKRlPpWrwMVrmzdoFpq98m4DJoDxJL5NFWe0pNfqTqZBlq4HQmmlvh1XlXjbM1c6i 0ABR5FIA6hMh_Z6OmIAdNRhhxCGz59A_EC5CFhbJtVMU1LyetlhWf9EsabVHzYU2y8uB3gDasETq qNVCqLqpWC6jNn33Q8Y1nITU1R_CUL9bmyhCZ2uBMXTGAMG8HsIiqC7oqh5b7vBw2OMgFQAoW6rH hhzvfjHKwNbeiXy8Lnbay3bDjPomXYs_QY6su2gwNqEyPxDdp2IQEDhr1j568PhybSw90Xg-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 22:13:05 +0000 Received: by kubenode559.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 087ef06073910fcc05bb584646ec6aec; Fri, 21 May 2021 22:13:01 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Fri, 21 May 2021 15:13:01 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <15C28068-AE5F-49C4-A0E3-5E02622F8790@yahoo.com> References: To: evgeniy@khramtsov.org X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4Fn18310Q7z4tG6 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-21, at 14:45, Evgeniy Khramtsov via freebsd-arm wrote: >> World built in 22491 seconds, ncpu: 4, make -j4 >> 6 hours 45 minutes >=20 > This is impressing considering that one old Athlon 64 space heater = took more > than 9 hours to build FreeBSD 12 in 2017 when CC=3Dcc, LD=3Dld matched = the src tree. >=20 I probably should have noted that to use: arm_freq=3D2000 sdram_freq_min=3D3200 force_turbo=3D1 reliably, I also use: over_voltage=3D6 (I've not tried to identify the minimum, just a sufficient figure.) I'll also note that: = https://www.raspberrypi.org/documentation/hardware/raspberrypi/revision-co= des/README.md documents in its note 2 that: "Warranty bit is never set on Pi4." So, even more extreme combinations of force_turbo=3D1 and over_voltage would not invalidate the warranty. The 7 or so RPi4B's that I've had access to (four 8 GiByte, the rest 4 GiByte) all worked well with the combination indicated. I've not tried to optimize to individual machine limits. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Fri May 21 22:26:00 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 37D1B8C7FC8 for ; Fri, 21 May 2021 22:26:04 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fn1Qz36SMz3F6h for ; Fri, 21 May 2021 22:26:03 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id BC6715C0193 for ; Fri, 21 May 2021 18:26:02 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Fri, 21 May 2021 18:26:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=hl8lO+tlXthUQBM0Wi1M9OVyxQb cEcE+kiYfwx84/Ck=; b=nKFbThDAP+kdWDFJZ0fZBnmhI3jAub67PuZP1apGs8E 3S1LwRK4UjxfB/saCzaLAyJYOdSWglIctAPBrxj9CUANEW4rZCxz1d3vhHL1pmtg v1IKo1RhCZmC53x5TmLaFQWgjc2iXJFp3t7sZVk3iv5Aug3rJtEoFQvPlJeC03je c54CIJWcvpdOX5XkJ02q6Ooqp+Qpm2OAnCv1xerZvtwzP4dbGN8TSrjzAXSf0d6u eR8HNPbqatvvpHwukjmAtmQ1sJfKFO9oFlIJTD810/BBS0kKCZMOEJTdL7w5n8Ht tbxORO7DiMypsoTqGP4SDNJTDG0F6cuNi3SkaOy9yxQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=hl8lO+ tlXthUQBM0Wi1M9OVyxQbcEcE+kiYfwx84/Ck=; b=WL0zTz3yefi6f3Cny6482n j1Kdm40reInzvizDEAFnoyjgxumbSimUTeiO8nxVnmsiCpt+4idX/5gfuMij37lN YiDnHZqQCCaAXcba/mRN0pfYYpJ4xWCv/yboB/Q59tZ8eLkN7hy221UZ/4UhCFPX cRm1mqkWQEKHkny3ek4Ui0K0cw7OXAjd2aBCyeBGiEAjZwPhJp19b+tSp23FL41t A3sLchFA3PYnxPbwIxfoCMeqnm4dBCZGF4q2xkBMRjfskTXlbG/QMAL5TO9BpxB8 VbHKjS1JyPR/Dzp046eXYNp5GVEMerjGikZb0mihXDDyVVerFMCB3uh57RJs4gtA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejgedgtdelucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtro ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpeeivedtleeitdeiteevueelhfegte eujefggedvledthffhfedugfeuudeikeeijeenucfkphepkedvrdejtddrledurddutddt necuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtg hhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 21 May 2021 18:26:02 -0400 (EDT) Date: Fri, 21 May 2021 23:26:00 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="rIzJ7odczJHmMVk+" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Fn1Qz36SMz3F6h X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=nKFbThDA; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=WL0zTz3y; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-arm] --rIzJ7odczJHmMVk+ Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Fri, May 21, 2021 at 11:07:35PM +0300, Evgeniy Khramtsov via freebsd-arm= wrote: >How long are compile times for aarch64 8 GB RPi? It is especially >interesting to know about overclocked results. I guess buildworld time >would describe it well, but any heavy port (ex. rust) would also be great. It depends. I've got it down to about 4 1/2 hrs for the buildworld/buildkernel steps. But this is after all this has been done: for stable/13: 1. configuration and use of devel/ccache-static 2. clocking to 2.0 GHz with the following config.txt: [...] % less /boot/msdos/config.txt=20 arm_control=3D0x200 dtparam=3Daudio=3Don,i2c_arm=3Don,spi=3Don dtoverlay=3Dmmc dtoverlay=3Dpwm dtoverlay=3Ddisable-bt device_tree_address=3D0x4000 kernel=3Du-boot.bin over_voltage=3D6 arm_freq=3D2000 sdram_freq_min=3D3200 *make SURE you have good cooling!!!!!* I have a flirc rpi4 case on this one. 3. /usr/obj /usr/src and /var/cache/ccache on zfs on usb3-connected spinning rust 4. /tmp as tmpfs (512mb) 5. make -j6 buildworld && make -j6 buildkernel (after make -j10 cleanworld= =20 && make -j10 cleandir && make -j10 clean) 6. having *already built* a new world and kernel and installed it all and rebooted, which had been built with the following /etc/src.conf : [...] WITH_MALLOC_PRODUCTION=3D WITHOUT_DEBUG_FILES=3D WITH_CCACHE_BUILD=3D WITH_OPENSSL_KTLS=3D WITHOUT_APM=3D WITHOUT_ASSERT_DEBUG=3D WITHOUT_BLUETOOTH=3D WITHOUT_CUSE=3D WITHOUT_DICT=3D = =20 WITHOUT_DMAGENT=3D = =20 WITHOUT_FLOPPY=3D = =20 WITHOUT_FREEBSD_UPDATE=3D = =20 WITHOUT_HAST=3D = =20 WITHOUT_IPFILTER=3D = =20 WITHOUT_IPFW=3D = =20 WITHOUT_ISCSI=3D = =20 WITHOUT_KERNEL_SYMBOLS=3D = =20 WITHOUT_LLVM_TARGET_ALL=3D = =20 WITH_LLVM_TARGET_AARCH64=3D = =20 WITH_LLVM_TARGET_ARM=3D WITHOUT_LPR=3D WITHOUT_NDIS=3D WITHOUT_NETGRAPH=3D WITHOUT_NIS=3D WITHOUT_OFED=3D WITHOUT_PORTSNAP=3D WITHOUT_PPP=3D WITHOUT_RADIUS_SUPPORT=3D WITH_RATELIMIT=3D WITHOUT_RBOOTD=3D WITHOUT_ROUTED=3D WITH_SORT_THREADS=3D WITH_SVN=3D WITHOUT_TALK=3D WITHOUT_TESTS=3D WITHOUT_TFTP=3D WITHOUT_UNBOUND=3D # CFLAGS.clang+=3D -mcpu=3Dcortex-a72 CXXFLAGS.clang+=3D -mcpu=3Dcortex-a72 CPPFLAGS.clang+=3D -mcpu=3Dcortex-a72 ACFLAGS.arm64cpuid.S+=3D -mcpu=3Dcortex-a72+crypto ACFLAGS.aesv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto ACFLAGS.ghashv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto (and afterwards, make check-old (then) yes | make delete-old then yes| make delete-old-libs) then=20 7. with the following in /etc/sysctl.conf : vfs.read_max=3D128=20 With regard to building ports (I use poudriere-devel) with jobs=3D4 I see the following build times for the largest five ports built subsequently: rust-1.51.0 took 7hrs 46mins doxygen-1.9.1,2 took 1hr 36mins texlive-texmf-20150523_4 took 1hr 36mins llvm10-10.0.1_5 took 1hr 4mins binutils-2.33.1_4,1 took 57mins 37s The poudriere jail instance for this rpi4 uses the same /usr/src as what has built the OS. This means it was built with the same /etc/src.conf parameters. My other rpi4 (runs main/14, currently I'm testing it) will clock to 2.1GHz= =2E=20 I've not thoroughly tested buildtimes there yet. I forgot to mention both my stable/13 rpi4 and main/14rpi4 run powerd with these lines in /etc/rc.conf: powerd_enable=3D"YES" powerd_flags=3D"-r 1" --=20 J. --rIzJ7odczJHmMVk+ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCoM28ACgkQs8o7QhFz NAU0Ig//TUV/8RGRhH1No8N6Ux/LQzdJF7ow9qMCB+XLH8JfNO7ZbfJdgBsmd9ct YjRWkZa2Azaxdu8Kk9XXciY7i9O7kV5MJAsCpagOngXDC8E4jC+H2Yy8mCVAudjJ j1Tqx8YHTh8INBk36nCDKGkG9yn/IcIvF6PFieRAoNFHGS7FXGiJ/qZil+6duJdK GTgf+aiwn29L3Y6XfF5XNgR7FRvnBSY4aL2+Yme+hLfAyYWea+0eXSbFKE4XmbSt hnPPE5sCII4hAsRqEpVwcQw58pej9fvLCSGq35G6TEFrhP5ec3QRq2kbHGq6jpSF MwjAbLYk49Jb+gMophB+fy9sbaWCW2Px79hzieszQPoKDpWugAxm/nWq0OpVEAmo mlFtio6Jl3Jya1fac75PIbJ+9xXrg9Dczx6ZfEBfe5lXTrHzyhwAsw2iFaN8000x nv6XRrUhw4cv21OsXEMzLHIQJyZJsv/ce8duwsmGwhpcRY1NZvY5W8ihvg6CGXJN zYMrDbpK5RBnyxpgjM+OBlFM/h1YCND2LWFJFHcLU+S/hWjPNo0aTu216hmGe4yO y2JkYlNMIVXhPicnxAQTNe0f8+sN0EfDxTRzoTHQBoPwKUv/RAGDcGfee65i5BCt dCP/Lhvj5pmFz1yJvkoONEuYBSfsmutgho3YE/SVYRgJPQwNHUA= =DFQv -----END PGP SIGNATURE----- --rIzJ7odczJHmMVk+-- From nobody Fri May 21 22:51:35 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 467F78B37E0 for ; Fri, 21 May 2021 22:51:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-8.consmr.mail.gq1.yahoo.com (sonic307-8.consmr.mail.gq1.yahoo.com [98.137.64.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fn20Y6tzfz3hdB for ; Fri, 21 May 2021 22:51:41 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621637500; bh=OHf+Ub60Q47OhWiHkDHodUS4jCTV/qnQ15hMYMCU69M=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=mkYAHEFRQN9DsqoDVvSLvl/ntGK9jM/cBIEqXfzRgKmPQlLfYAtVI58S8/IADJR7dvYjbnum7LyR37SVKCPKX2mwZZNY04EAtJ6QYBAZ29biUVH3pi0YmGILcls7Y8ThXwRv9FVidewCiIof34bvxufnIg66nka0UYd+GsPwLygQqhBcTv1ekJ6gy2l14A2j4gPyUIhgagyizR0Zk88e9lc5f4sYPuFnNJNBnSWCRIBN5CpfBABWFsqbasVdPUUmf9LzG91L4VeX2+ii6x6Os8lfta8dQsLfWt5KdGW0zA8yQ+Av59im+Az7IXQNyok0K2em0lkseYTz1qTB5bFqcw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621637500; bh=XI0png3O8atGvknThj0lX1koNhuEeFbo+tqofYODQ3K=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=ZME/fXBxyRQM9gbVamE/s+guVqXVZ/OyMD3Ecixg+oYkp+KIDax1B2YeGN1JPmT5TdhKza2Dc2kuUwzWeC1LYONt/6galrt5Z+XESoIzU0fj2sr5dhXcM+nA0btKStCExctuh6is064tInsWSxbCAmkCCt6TsJ00Xm3fFwUsny7RaeEX8TYZjkfl7biihA2gUVuWDV8DVhik63COwnk2EXjKZYZswtV3mwY+6tEDEPpj1J0+oA2YpVKX7dzC0gWDMxhUsXJ846YI2r9K/QH0YXaiOTAHuPrwETesjdT1FbWbA5us70By6I3+OHMfe9Pkwobdb/wQl9Beso/lyCbc6g== X-YMail-OSG: PUAVD5AVM1man.KPHDCzUUsg9DzVsGoSVehIiOoogyAoeVGSu5eVQ0hu3oJHr0x hmbLB0BdV5czJ3QIjCt0zvg2_b.udUjuqb89geR5G3U3tpC0nQStEPDVgh_b3D8vpBC6deHCV0uu SOBPkM7aGMFBY3dEOY08wo6gnTRpoC8TlWTzxTxDtARKzNmKX4XFvCbMAZs1IbWvD.9ZVDrddAzZ pp0UQlhFB_1XB0L4.W39LRBRHpeJUzRutjTAaE2.kEaEywXBZbmHOSfXQxGu2FEAxPWWTMwrTx7. TMk3SJs8YfwVD2BWswfzaCrnwyZFZ77.mZjlOpGjIsNZAaqrE6A0ErEGPinN_nRKFHWyXxDDVXmL iuzPfRW1tdfCM0pMNvDXzLE7YMIqO9P_c7eq4UKalVt8B6Mb1BmSoiOc0gyvu5ZmVL5OEp0uvw6U 2fe.kIr1xgFCyrlG7H5KooxHliNT2DSMgroaScSFd1fKu27qw8HPcI.ThvAtOglolFTxtcKIqOkT wlu8bb9.0pIeEMl0SBozXrJlqVvkFE6RZP44W2iBSq2k_yLV0.YkHz4TWP5zVODQeg4fg_aIdmv6 9O5fdAjYN8.M5Qo1OSzCyErnjU1imIEYwS4Z1Vs32hiIXZdRnbLmPTZ73VGlvxkYXRTm4Tuwi6Or XTghKBz.FekDVpxO3L9JANuHW24ltvUwHJYhSHb9Zhky17DEFK3rHYCg_9DHV188KuCSkNcX_oTy i2lb.2DiQU6lFd3aqzeiRkVb5i7JlKuo6qT4LtP44oYhF.1.UMVWi6mC15ZnxY9HZ18zYfHGeM_P 0XAxu8lPOKE.WmLV2AvmJWTOuubFrRXun1oltuhbIDzbXTIdUzZR.QFuNaElge4Wtc86L.9vNDNk jL.TnI7ec5Ae4Ag.Pz8SR4YfGhuWfOOK02gs7W_ONnEwAsRUB1DA.0yaIkWhjXAc5GuD6xbyALJ1 02_j6zwWMqPJCtPcAoYBCeWfI0hmco9N.nziaCUzIcdlCUbDrQVCTpgJO0wrY.Btda1MRM5HSifd e9bBw6tHXffSh6cJU5WZeY3hMTroL9qDCizFzeiawsqFo6sICTpG_G6j_PpocoK2SbaECPmYipj1 FnVUFXaJuhEZQap4dmPhV98jVxeOE6wlZVwzOrGAlIFLtqtxOXAO8OVB9DUtEjBjoeFEH9suytA5 kJGo_CR59dF8WDosJH8BV9Vlx4ep5sUkVi3txoSUdr6mWjYQWSSCNn8Zm2nZRfIt2u_yPjjrseB1 rFu4bp1e8gGEIVqg_zqN7P9Uy0P3iZriEQnrM_DvFneCl3yq80ejXiBW2htMFn.dNjaQu0nQkwUF 2eaLcgH716tHWG9Ek0eDEsI_2IFIVT_cjhFLDPBqxC2uLFebH2g5uSDYGYh1LJd6Pby5_zF4eXhX IL1R7k9L8W5m1s4C55S7qF2gQUVt0MULdsIcYkmJMtBESNlOPh8hKeLA_7KAE1BTOIwfUdZVflBS J88oDqRvJckJGTX5zaMNQTUcjUiKMvLbT2CqcHzsMZ9InvhxO42WNsOST8SZ7bbTjwQnoXhVEs7N EstS6kntv4txrjv2upQP5VpTpI_Xj6ivj2w5VLsTLgzlVRPO5CiCuH9OwXQqom1LdF_ITRXVCuf. buscPp0t.fgC.FLMHWkWrDWKvX.se5jL0zP6azGe9uc8sfCYz74WgQF65_h6H_cp5gz_ZBHHvHb7 BYYxlCVMUJLA9bkF.pZcaV7TzS8.kw1isy30YMRSO2K6PEP6eEdMLvP43DtZZACckoja0Kl6QWoN ._2BflEgYsZTsyuaaqnZnWHlhRnYFAOK942DIQ8g8sPWT2jf6fK_rkJC3XUtCTAAHs9_apfR4nBJ FKoF4mOPHIsGdzfSJpIaFNm2GrAt.nd_GGixr7zj39IIhWDq0pviipMRTnilFEkyJ9CETY3rQ3p5 qtMHfZMCMX6aNFr5LR9wjZyXFVKqjEr04eUxrpJVplqBaxTDeCtxwGZjodgveD5YctluLXu3xndN XharMjzpsLT6kA2n2A1_GVcJQ8QmQ_ekGJunD1gYoz3p9GAvftaEWjlORIUJ3G5AmPAMIpY4XaNv 2hRBxu3CMkxQVf_CPWHbZRArMwbE2xJ2OHUCNkIAXYzfYwRcwteOBLaCkYi3idgl63v2YcIPp4nj 8IUBtBLKLJzWFJFQfmF24HsWud_IQ58kAO9c.3kAFSktPfZFbi8LEsiE.BN1.U26935CMz2jTuSD OTVp53XZbwXmdfm6BaHYPKYQE45yHVpDf3Qfc390fW2a55ANfrsFxJ6ELyZVnZuO32f_ylsSPRot oVwzoaCaFin_yQUWTuJiVcUNzQ0QYf8QomE2whYPDWYRGAxpzJ.CUFXpNo1CrE.jI6aOF4x1JyxR KKuPWiAgLpNgLGEXk4YFLuL4RZcjE0ofLviIv6IlXDWvs.QCI1ccCdvqFSR4poyC.J5TBe53eVm9 SfD3tcvZ9LBBwuca3Sjsjwe8qFjYuTdXF1_p51SR92I7kTAK6Zss- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 22:51:40 +0000 Received: by kubenode564.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1cafb59a94ad28391df4473ae16d62b2; Fri, 21 May 2021 22:51:35 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Fri, 21 May 2021 15:51:35 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> References: To: tech-lists , evgeniy@khramtsov.org X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4Fn20Y6tzfz3hdB X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-21, at 15:26, tech-lists wrote: > On Fri, May 21, 2021 at 11:07:35PM +0300, Evgeniy Khramtsov via = freebsd-arm wrote: >=20 >> How long are compile times for aarch64 8 GB RPi? It is especially >> interesting to know about overclocked results. I guess buildworld = time >> would describe it well, but any heavy port (ex. rust) would also be = great. >=20 > It depends. I've got it down to about 4 1/2 hrs for the > buildworld/buildkernel steps. But this is after all this has been = done: >=20 > for stable/13: >=20 > 1. configuration and use of devel/ccache-static > 2. clocking to 2.0 GHz with the following config.txt: >=20 > [...] > % less /boot/msdos/config.txt arm_control=3D0x200 > dtparam=3Daudio=3Don,i2c_arm=3Don,spi=3Don > dtoverlay=3Dmmc > dtoverlay=3Dpwm > dtoverlay=3Ddisable-bt > device_tree_address=3D0x4000 > kernel=3Du-boot.bin > over_voltage=3D6 > arm_freq=3D2000 > sdram_freq_min=3D3200 >=20 > *make SURE you have good cooling!!!!!* I have a flirc rpi4 case on = this > one. >=20 > 3. /usr/obj /usr/src and /var/cache/ccache on zfs on usb3-connected > spinning rust >=20 > 4. /tmp as tmpfs (512mb) >=20 > 5. make -j6 buildworld && make -j6 buildkernel (after make -j10 = cleanworld && make -j10 cleandir && make -j10 clean) >=20 > 6. having *already built* a new world and kernel and installed it all = and > rebooted, which had been built with the following /etc/src.conf : So, if I read this right, you are reporting 4.5 hrs for a "hot ccache" result, which I had mentioned as one of the things leading to large variations in reported build times. But I've not done those experiments and so could not report examples. Thanks for doing so. > [...] > WITH_MALLOC_PRODUCTION=3D > WITHOUT_DEBUG_FILES=3D > WITH_CCACHE_BUILD=3D > WITH_OPENSSL_KTLS=3D >=20 > WITHOUT_APM=3D > WITHOUT_ASSERT_DEBUG=3D > WITHOUT_BLUETOOTH=3D > WITHOUT_CUSE=3D > WITHOUT_DICT=3D = WITHOUT_DMAGENT=3D = = WITHOUT_FLOPPY=3D = WITHOUT_FREEBSD_UPDATE=3D= = WITHOUT_HAST=3D = WITHOUT_IPFILTER=3D= = WITHOUT_IPFW=3D = = WITHOUT_ISCSI=3D = WITHOUT_KERNEL_SYMBOLS=3D = = WITHOUT_LLVM_TARGET_ALL=3D = WITH_LLVM_TARGET_AARCH64=3D= = WITH_LLVM_TARGET_ARM=3D > WITHOUT_LPR=3D > WITHOUT_NDIS=3D > WITHOUT_NETGRAPH=3D > WITHOUT_NIS=3D > WITHOUT_OFED=3D > WITHOUT_PORTSNAP=3D > WITHOUT_PPP=3D > WITHOUT_RADIUS_SUPPORT=3D > WITH_RATELIMIT=3D > WITHOUT_RBOOTD=3D > WITHOUT_ROUTED=3D > WITH_SORT_THREADS=3D > WITH_SVN=3D > WITHOUT_TALK=3D > WITHOUT_TESTS=3D > WITHOUT_TFTP=3D > WITHOUT_UNBOUND=3D > # > CFLAGS.clang+=3D -mcpu=3Dcortex-a72 > CXXFLAGS.clang+=3D -mcpu=3Dcortex-a72 > CPPFLAGS.clang+=3D -mcpu=3Dcortex-a72 > ACFLAGS.arm64cpuid.S+=3D -mcpu=3Dcortex-a72+crypto > ACFLAGS.aesv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto > ACFLAGS.ghashv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto And the above points out that I also forgot to mention the configuration selections as a source of large variations --and to report on what I used. I'll list that after the rest of your message. I do avoid building the llvm material for targeting MIPS, POWERPC, RISCV, and X86. That is another fairly large block of time avoided to get my "no hot ccache" times that I reported. > (and afterwards, make check-old (then) yes | make delete-old then yes| > make delete-old-libs) then=20 > 7. with the following in /etc/sysctl.conf : > vfs.read_max=3D128=20 > With regard to building ports (I use poudriere-devel) with jobs=3D4 I = see > the following build times for the largest five ports built = subsequently: >=20 > rust-1.51.0 took 7hrs 46mins > doxygen-1.9.1,2 took 1hr 36mins > texlive-texmf-20150523_4 took 1hr 36mins > llvm10-10.0.1_5 took 1hr 4mins > binutils-2.33.1_4,1 took 57mins 37s >=20 > The poudriere jail instance for this rpi4 uses the same /usr/src as = what > has built the OS. This means it was built with the same /etc/src.conf > parameters. >=20 > My other rpi4 (runs main/14, currently I'm testing it) will clock to = 2.1GHz. I've not thoroughly tested buildtimes there yet. >=20 > I forgot to mention both my stable/13 rpi4 and main/14rpi4 run powerd > with these lines in /etc/rc.conf: >=20 > powerd_enable=3D"YES" > powerd_flags=3D"-r 1" My build configuration file content: # more ~/src.configs/src.conf.CA72-nodbg-clang.aarch64-host=20 TO_TYPE=3Daarch64 # KERNCONF=3DGENERIC-NODBG-CA72 TARGET=3Darm64 .if ${.MAKE.LEVEL} =3D=3D 0 TARGET_ARCH=3D${TO_TYPE} .export TARGET_ARCH .endif # WITH_SYSTEM_COMPILER=3D WITH_SYSTEM_LINKER=3D # WITH_ELFTOOLCHAIN_BOOTSTRAP=3D #Disables avoiding bootstrap: WITHOUT_LLVM_TARGET_ALL=3D WITH_LLVM_TARGET_AARCH64=3D WITH_LLVM_TARGET_ARM=3D WITHOUT_LLVM_TARGET_MIPS=3D WITHOUT_LLVM_TARGET_POWERPC=3D WITHOUT_LLVM_TARGET_RISCV=3D WITHOUT_LLVM_TARGET_X86=3D WITH_CLANG=3D WITH_CLANG_IS_CC=3D WITH_CLANG_FULL=3D WITH_CLANG_EXTRAS=3D WITH_LLD=3D WITH_LLD_IS_LD=3D WITH_LLDB=3D # WITH_BOOT=3D # # WITHOUT_WERROR=3D MALLOC_PRODUCTION=3D WITH_MALLOC_PRODUCTION=3D WITHOUT_ASSERT_DEBUG=3D WITHOUT_LLVM_ASSERTIONS=3D # # Avoid stripping but do not control host -g status as well: DEBUG_FLAGS+=3D # WITH_REPRODUCIBLE_BUILD=3D WITH_DEBUG_FILES=3D # # Use of the .clang 's here avoids # interfering with other CFLAGS # usage, such as ?=3D usage. CFLAGS.clang+=3D -mcpu=3Dcortex-a72 CXXFLAGS.clang+=3D -mcpu=3Dcortex-a72 CPPFLAGS.clang+=3D -mcpu=3Dcortex-a72 ACFLAGS.arm64cpuid.S+=3D -mcpu=3Dcortex-a72+crypto ACFLAGS.aesv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto ACFLAGS.ghashv8-armx.S+=3D -mcpu=3Dcortex-a72+crypto NOTE: in the above file, sometimes the notes have not been checked for a change of status in a long time. They just report what lead to the way things were done at the time they were first done that way. FYI: I do not run powerd. I've had heat sinks, fans, cases, and good 5.1V 3.5A power supplies for all the RPi4B's that I had access to. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sat May 22 16:01:10 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 27AE78CFBCA for ; Sat, 22 May 2021 16:01:15 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnSrV2FmHz3nfF for ; Sat, 22 May 2021 16:01:13 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 6FDE25C01A1 for ; Sat, 22 May 2021 12:01:13 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Sat, 22 May 2021 12:01:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=94HLiicYoSBPWt/KnDVIdy9ETmJ +2r/PyVrVtalos38=; b=KGijS4MbAKTIMaWemxcOnTue6TuG0+ZcGMabSfi0J8D je6GyQEjhpx743R7ZUXulEA3XSSfr6WJ1xnzDMOkQsy6baB4ErZrYpwo1zvdGGIl C5RWd9kMip3y235rhPkdk57RDY64jfQlIVAg8MnQJCvOhmuyhC8FH0cC5f8FsB+0 rydy3r1+RC1Fykely0nLkcHda46A10kmIj0yvcUrLON5j4jcP8ukMCMaCMy8WACG HZbFISurArruBJQgGTFnUmC30orI4JCDBHyN0XAird31ZsphOntl45mBAq4QDGne GTBNawGEYErPJ6+Ufeg36KRKUU+Gi8AEs4r/ii8rmTw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=94HLii cYoSBPWt/KnDVIdy9ETmJ+2r/PyVrVtalos38=; b=O6H591/xcZKWE4rrJ39a+l BA2asAADmgCdFcvhv/w9XbFjs86wWzWvey3ZrHoCVCLFtSQhkJIfUBkHeI3ZdZvH ZRoOQN/dR9SmO1MElDKGr7Yd2Tsq2z3RH/83Y8nqeNJwT2qa0mqqmkGD/v8cdRyF sXwaUY6E5OUD4m42j+J/CAEl1zoOJJlEXTYmMfi5KvStnAUHEPHloDOx7GoHJPI2 sSU1xwHstm2knZbGu5gN/X6svKZcuCNpfLi4wNxjac3x1Hlpr2+v91/VUOBkUX04 Xg3VQvqLQ4Cnn6nXaTFdwJWgZV8po5aHtBpKsXlmM4BvyvFrYjd5H/GP2ovlP3yg == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejhedgleejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpefghffgjeeuheefleevffduveelhe efveehuefffeekgfeljeehhffgjedtudekkeenucffohhmrghinhepiiihgihsthdrnhgv thenucfkphepkedvrdejtddrledurddutddtnecuvehluhhsthgvrhfuihiivgeptdenuc frrghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 22 May 2021 12:01:12 -0400 (EDT) Date: Sat, 22 May 2021 17:01:10 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="Fkz7UvI/hIn2nsgu" Content-Disposition: inline In-Reply-To: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> X-Rspamd-Queue-Id: 4FnSrV2FmHz3nfF X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=KGijS4Mb; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=O6H591/x; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.28 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.28:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.28:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-arm] --Fkz7UvI/hIn2nsgu Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, May 21, 2021 at 03:51:35PM -0700, Mark Millard via freebsd-arm wrot= e: >So, if I read this right, you are reporting 4.5 hrs >for a "hot ccache" result, which I had mentioned as >one of the things leading to large variations in >reported build times. Hi, not sure what you mean by "hot cache" - I always use devel/ccache-static as have tended to build from source throughout my time of using freebsd. It provides tremendous speedups and generally i'll disable it only if a problem arises and am debugging it, or crossing a version boundary like =66rom stable to current. What I'm saying is I don't know when ccache was last used for building anything. 1. rpi4 here is clocked to 2.0GHz 2. ccache is in use and /var/cache/ccache has *not* been previously cleared (i'll clear it for next test) 3. make cleanworld cleandir clean has been run on /usr/src 4. sources are at 246839 5. this rpi4 has the following properties for its disk: [i] root-on-zfs [ii] boot-to-usb3 [iii] 4k sectorsize forced [iv] encrypted swapspace [v] entire filesystem encryption /etc/src.conf is https://cloud.zyxst.net/~john/FreeBSD/rpi4-main/src.conf make -j10 cleanworld started on Sat May 22 15:41:58 BST 2021 make -j10 cleanworld completed on Sat May 22 15:43:23 BST 2021 make -j10 cleandir started on Sat May 22 15:43:23 BST 2021 make -j10 cleandir completed on Sat May 22 15:43:50 BST 2021 make -j10 clean started on Sat May 22 15:43:50 BST 2021 make -j10 clean completed on Sat May 22 15:44:11 BST 2021 make -j6 buildworld started on Sat May 22 15:44:11 BST 2021 make -j6 buildworld completed on Sat May 22 16:20:48 BST 2021 make -j6 buildkernel started on Sat May 22 16:20:48 BST 2021 make -j6 buildkernel completed on Sat May 22 16:49:18 BST 2021 --=20 J. --Fkz7UvI/hIn2nsgu Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCpKr0ACgkQs8o7QhFz NAUzVw//VGFg8kQkZqbWJo1+uTv3WFtJIVLaElDSxJma/nDR6Rhheo1BggkG8Vsf IZHVAosNhI0i3FMFN+WqCX2kEfB1HBU0Tlz2A5fXopWdq6d08HBKuSeD4qFo46ZL ItSezZPNQzgh5QTxKeJb3KTS6RLa7dGvZxOnB5/GJxLjLBqXehEL7FDrT7YfJe2t 3Xrm3m7z6Ay6SgxTk3GVUJEMM8nqT5ubSlCxTKQ5jsTdMdlnH2T62rZPAh5FAlB6 zPWkP9+yFGrfn/fSQV+6t/mV0hVzL/bhdGGV5YGT8q+tMhlXUL5IrUaKA9Zx+1Zx U3KxS6NmYHlHUziNJDl6kYQnZ9JVYiwDoytz2aJzzL39bQn58bZw9Oc6F/HxxU41 kja6f6mWmslu49OA/L14PUy5pd5jgzJZvmAUZtxsb5mrKMp7EUT//qUdCCn6lQ4Y KVZ/zT2FXKiquwub8kyokiZz64vdjsa182jOrl6mpqYVPGeMVk39vs9bloxiEjoB OrPiqO7tA/7IpWjL5e5a+tUi5nhk6FgiS1AUEKFw0fTpkLaQb77NeGx3o6t5R5IL gOZDjTnKPVhdwEbo5JN4sKGg6S7PTNOU+//m32wyzIYgPbf9yAUdtDaP6Gqz/Dr7 hdHdDoIJ+pld3GklpZYB885jB8YZNpAnwfTdJ8XoKzo6OC+gK64= =Fhs2 -----END PGP SIGNATURE----- --Fkz7UvI/hIn2nsgu-- From nobody Sat May 22 20:12:23 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3A2408D5DEF for ; Sat, 22 May 2021 20:12:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnZQN6rLhz3sr0 for ; Sat, 22 May 2021 20:12:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621714346; bh=j2RCrJR9f61jdZ4i53+wJsJPPp40SSljb4MuM4Si99w=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=eFXd7aURXK6FDFLDvQsjyuoS5T4ZiirCsBBYkahNl4wEe6xKw+ebiqbJWixnN3nnoxOI1BHHWYTZwEBxnqj2jJVg0wjmGxIGoIDMnV+9nNrpqzLhBzHoz8Dsarh3F9jd5gSBJmsrR5DiH0RohWP/loeXUhhRhfzPdR4Uv/f7nkVEzeTRXyKPUIMG1GG8KJ7hDkHEZNs0Kjq4dtT8ng805aMT+0ryGbf1lU5WE7Sg/W7D3F8XWmPwpbR8Q8bxRDVHNbc5XM0sPs2cWiex7zxCjm0BQoXtJ0NpkP+qWgBTkQAPtrP5n9w3RaP3s714vekzw4Mb8PCq3/P12rGHkHoYPg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621714346; bh=KYt0VyAhzLTbEuQ47umMG9wByPzQNxWN2afgoe50gJ7=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Xkegx2hn5omLAOt6tPsjN10i5Zc/mdTq/j4oKCB20qC0CBeQvelCov+sTqQbzwS5y1UxB0ckkp9X1ZHYWb2Pox0mWbbtk4elTqpSBfsrkBvakGAusPKaBUZvktruGY3egLK0KnQu5FpeMoftOc9ZfBe92Hw2bgRxr4DMw5rwNkGx5n4d2+hMnsg8rwJdG5XnEJY0J966+j4Ja64i9bEQGdAttfzkp9chgxAwwe+2UuXO/BNskBn0o/Y5p0zLHAFuu36NwZ3xe1iIZNCLMiWAqNrUHeWnFkdsY3KP3DX9A4/gkmzX6Hm+yVRXgocLPzAeA+brNnfNqNUaAxRpxkJyJg== X-YMail-OSG: Omu02e8VM1lIBRE.ztaBsnEmGq7VIHTl.GD0ANQK0j0Z7XZrnDvk_6hIvK9FF84 EOUonpqHC2Vqnel07g3RqYN.JLidSLxrfozB8_5qmJYruj0NZJ8d7ywue2EF97Z7ia5B0LrRt5lY wchoBlE4uIbZAGMSTxOmED1LSpIOp4OMzsm2L9pDB9rmBEkDDCwSr0joAHtAi_BtmlUhf0iNkvzz uYAnWpZE7Skh5mGRy6ZBz6A9I_Fs9OXLUS8QaONof62Z07Ps9kIOJDcCZ7etLrjhQ.X1IPLKyyqR d2fyfwh_.8jHV.k4lidX_WNw.NXEaD5vY7dhTTda4Sd9Cp6EzO7zzpjzY6SA4ZOzs0uWyJSMRwL9 fBkuVgjACaz9fwOs5IjwS5uO5OnNuYfMlZ9V6mByaZQBe2o8aj._3VTC._8HIc4NjJMNLM2xQDEm IxIA6S9TrgAjsRiRbErNPNtLOSP07I7NBAzTlgFml0rzif1nfa673WLUva9oKyVFS1BmH4E7KfNW Y1x0iZyQDI6IGkFVf2rXQoVgiqruXp.NCmU3_3OusJPm7jpWQ2n0opSpIk20dF_nmhugnjAkejmY 3XYFAfadwcYosl4mg9UlB2i91caRVVknx91c30EjF8vQo41pd5hw3Q4rm3t_fGxMvSJDJpI_DA.Q nUxxFuuepnwIjTrKHYM4r022XVIFmEsd9NcmEA1XLEUFCvVStf_0qgbYUI1beXYpm3mjmHoIxX1d uwfVXB67cPdIBIbu6BTx0wIZ6BqQ5reo1myt5IINHtVg8TJVGHoFhM0N1mpLkjZWc.p23u5v9cza vB25u6lO942qY3YREbYQJ2kjPQEyJSSqQ.JGAU7XjnQJcM17BZJhEze_5xLT4tVkJzx8GqFcpEBZ FZ.gOdBQtL9NEFtJ8tlkze2aE9W6T9LoSzqmIr3JKQ2f3EKqSZjuVXXRNQzuXG4gJXMT1tkeIwQX LC6JUVDEDeBLkfa6Kwv53K9esDvqXC_vCEavZVTwGsxRk.SfzqhevdhCcvCJfrmfyNV9FOVNkzPg la4OBU_ENAUP9yRFvJOWQLVsq48XV3Kvc9_kI6dTmozZdVb00ZVtfvj2gG_exfFUpcKTKcDsYbr. LkZc7ZvSHqFnt_BjM37PPaDk5ffq8KtgefmItIuIOIXVlrHwbvjWD.iw08zTuPjMhU8snCPupoyh 6FDypDSgEuV0L7zQRP3STdA6WCCGvVnCXRYOqyqshvU.kkGdXHEBq9RPjtsFKIo37FhD1yhefne4 PcS8XMNQahuofOMen_1EjSPoXxeT92u3PEwru2.oqz1BNc8yBZilz4uUKDMVIxzC3Gc1Bpakk3TC MRnbqj7rDWASZiHiLtGG385xubPGdeeKH_x1V5bRy9S4r898nmkRFktu_u90BHv1ABmQD9SvyDVy r1X6jQr6BR8XHmSy9B_Fv7Hpxy2SZ7BZ2OkLGwmIQyp9vlt8nFmvdLKA7590jwasbsNSKilA0Sy_ RG_QucAlFbqTfW1TOgfziVynLzcskn7zJd9.QWr4aMuRw6qRqrzcSkyo3GCzNnNWYUQn3SumdNvi y0F4npT7KGh4MXFYb4RbD_edGgCbyqYy3poy8JdGaIfjEZ1I6nlGral23_pOjOWsfaXXTI6QR_j3 _nuehi4Tz5ZqLxLc2SU0RbJfVeYNPSRzXHqisKXvLqjaHCxh2dIQZvpRIfQp036vNbEAj99aW9wx .c1DpOqvvLQHubg8FHXmLejU0JYFlnD85dD0fqVdheiHwxQLBLyzSWH98n8mkwHmWO5goTi6YDBs KM0X5nS8rpnAz4p2MMDeh7VTluw21TwdF9Za21HiwKIWKl20jpP1kOeKUsQZX5zkHAT0naCOtGEu WrVhJ1RgvZGThB5_RcsRyOwAuCguxo11vCelp1gFb18GLPa9zEcEGGDI.1N6NhN85GJ1kR.gFJcq EfyDz1EOHwzPq8qA0.lnWJVpVPIsBB71Ol5PBZVUS0sV4n6u9RdduedQyXp81mZgEMCh22LAdIGq QyOK5Pjz088DwaMZUEJlPrWnfaidc65h.dhx7A7wWY0R0ns9mMf2IaLD5UTjUoteLv4.CJKpJqj9 cHWZvrNANrQUbVq4.bzrqUxxY9Dg6aGvNMkOlV9lOMipb9_vLNjzYdPMNKvc8w2J3W_uEgMGzHCi d53bjADVZ6ctKO.BRdXskOw7MWldaOTrEv2.brgJ1IrFfBM3R1sQxhOY1TMR4D5KAW8cP8B8R4Vs PuKcjScbkRdyjokLrO5OgG.G.vk7MerD1QzeZGrNNWiGX9KT1FvIWJPAgZXr4AsnZHF_.XeKtSb_ 3sE75DiNVf3Fa2E8AJie.2pK3.Pq8PBb2tlyJaScyKuXYP594kZNS2i4ng6._08ZVe0MxAZekCEK bTnvA4n7T05_2ewcgrH2pA4.hw3aQqgiB0ShiAHEHVfDfdHp1jfS.sZpP.2V3VnQRf5T2gHMSLJt VJN5HISxueMJ7z3qK X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sat, 22 May 2021 20:12:26 +0000 Received: by kubenode569.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID f1bfd44ac7e09a60b4546e237124c58f; Sat, 22 May 2021 20:12:24 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: http://lists.freebsd.org/arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Sat, 22 May 2021 13:12:23 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FnZQN6rLhz3sr0 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-22, at 09:01, tech-lists wrote: > On Fri, May 21, 2021 at 03:51:35PM -0700, Mark Millard via freebsd-arm = wrote: >=20 >> So, if I read this right, you are reporting 4.5 hrs >> for a "hot ccache" result, which I had mentioned as >> one of the things leading to large variations in >> reported build times. >=20 > Hi, >=20 > not sure what you mean by "hot cache" The first time ccache is used it has no prior results to use to avoid compiles/links: an empty cache (a form of "cold" cache). Another form of "cold" cache could result from changing compiler options that would change the code generated for (nearly) every file produced so that the cache becomes ineffective. "hot" refers to having a significant amount of "effective/used cache content" that makes a notable difference in the build times. I'm not that impressed with the terminology but it is was I've seen used the most frequently for ccache. So I used it. > - I always use devel/ccache-static > as have tended to build from source throughout my time of using = freebsd. > It provides tremendous speedups and generally i'll disable it only if = a > problem arises and am debugging it, or crossing a version boundary = like > from stable to current. What I'm saying is I don't know when ccache = was > last used for building anything. I'm confused how you can know it "provides tremendous speedups" while simultaneously not knowing "when ccache was last used for building anything". It sounds like you think the 4.5 hr build might have not have been from having a notable speed up from ccache? Remember that when comparing to my "from scratch" build times: in my build everything was compiled and linked, no prior build materials around to be reused. So I'm reporting a context where I know how to interpret the result and I'm presenting enough history to establish a repeatable context. > 1. rpi4 here is clocked to 2.0GHz > 2. ccache is in use and /var/cache/ccache has *not* been previously = cleared > (i'll clear it for next test) >=20 > 3. make cleanworld cleandir clean has been run on /usr/src > 4. sources are at 246839 >=20 > 5. this rpi4 has the following properties for its disk: > [i] root-on-zfs > [ii] boot-to-usb3 > [iii] 4k sectorsize forced > [iv] encrypted swapspace > [v] entire filesystem encryption FYI: My build-experiment boot media are never encrypted for the file system or swap/paging space. Another thing I'd not thought to comment on. As I've reported, my UFS based and ZFS based experiments get only minor variations in build times (variations of minutes for from- scratch builds that take hours). > /etc/src.conf is > https://cloud.zyxst.net/~john/FreeBSD/rpi4-main/src.conf >=20 > make -j10 cleanworld started on Sat May 22 15:41:58 BST 2021 > make -j10 cleanworld completed on Sat May 22 15:43:23 BST 2021 >=20 > make -j10 cleandir started on Sat May 22 15:43:23 BST 2021 > make -j10 cleandir completed on Sat May 22 15:43:50 BST 2021 >=20 > make -j10 clean started on Sat May 22 15:43:50 BST 2021 > make -j10 clean completed on Sat May 22 15:44:11 BST 2021 >=20 > make -j6 buildworld started on Sat May 22 15:44:11 BST 2021 > make -j6 buildworld completed on Sat May 22 16:20:48 BST 2021 So between 36 min and 37 min to rebuild the same version with the same build options and compiler/link command lines (near[?] maximal effective-ccache content that leads to near[?] maximal avoidance of rebuild activity). Cool. For META_MODE builds, seeing how long it takes to go through and discover that little or nothing needs to be rebuild would be the build times for 2nd build from doing back-to-back builds (not even an install to the live system between). The META_MODE use would then prevent most rebuild activity. I've not done such a timing in a long time and it does not approximate any normal build time for my typical rebuild patterns. So I do not normally time that. I'm not claiming META_MODE is similarly effective to ccache. In fact, I know of issues where META_MODE rebuilds files that ccache would avoid rebuilding the same file: for example, doing an install of a build to the live system between the rebuilds has side effects that lead META_MODE to rebuild far more things. > make -j6 buildkernel started on Sat May 22 16:20:48 BST 2021 > make -j6 buildkernel completed on Sat May 22 16:49:18 BST 2021 So between 28 min and 29 min to rebuild the same version with the same build options and compiler/link command lines (near[?] maximal effective-ccache content). Total between 64 min and 66 min overall for buildworld buildkernel for the near[?] maximal effective-ccache content and needing all the files. Good to know. Thanks. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sat May 22 23:51:31 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C05DF8F629A for ; Sat, 22 May 2021 23:51:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-25.consmr.mail.gq1.yahoo.com (sonic303-25.consmr.mail.gq1.yahoo.com [98.137.64.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FngHF5sYCz3LLw for ; Sat, 22 May 2021 23:51:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621727496; bh=+MHLveNFMCOmwaNw1XB3Ay3wqtauade2uZZo4VYhtMc=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=AK6HPXaXwUR5JlyFCP4FEM9gQ71sDvtCiI8ktI0n9UdobzezKWvAb+XUO/NZOzbfXhkjMENQzr5mBTwuAlbbFXsL2ayLwDGy32K2TmsZJIxpsbcZLMbCJmjD7avN3wMo8I9uk/xkwjaYc5Hte9RLdKtxXOX4GQV+5Ja+EW7uJH5KYqZXxC78lzopG2HrsuZ4+t4rZFPDY40usvnVoLrOBNbOfDA2qhax4kPzfjWjGgaPem5PD64HXQ+/RAlJ8bbxIyHZJl0jai8UqzDxdC5mVk+hNHzYdBCT/EsplxQIRL0n3EAbcb0drth8EQkK+jRjFEsgCPdLckkq1mdGQLh6oQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621727496; bh=B2G63Oztf0RI01FzCS4fZiXJOAdQZYOJrCD0q1Wc2x/=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=YCDDZgJepLvDRnYoyeaYNL5hBQ7WrvQcOnxMRH8Gfx/qSV1uV0DuDILzV78PjKFB6yUGDOwPmCl+Secjo21LhjVUiD/aLYyuvT7ERHrr/YRebvdt1UA//EKGWEJA14/Gz+TL2V6lb09zc8yOxEvpoUI+bQBCVqjFvG66a5I4O0vSwOopwzg3K6Ub0FmGtsEJ1xrQiSzEjUsLEMf/GOohJR9VF8Q5VFj150IDT+ZmJUQBOX8M6V3IbuvCEKTru+3TQ+PuG8qLeXQrsAWGhWKlUpBwyEv37cvlx3OCKJiFDLzsdZQexS5/Ob31Nt1UFWvz7mODlnqzXV8qU6qrfKFUsw== X-YMail-OSG: e8MpwAoVM1kdJqOtHkHcN7Opg5jSLKrs0w2Ha.7RMqVb9nPC5U9EIMoMi9IuqTj pC2QjWwjnrS9cFhbmAkshsTK89UZ2n6ulwCZW2Jz_UDroFvXpPeYqcOYJs0l.HLkiPBMBkB4TiiS 7pgJgkT6yLsYjyNNN8W1p9mg4VxrC_S6mRG5iVNJSYPtZUU47Ye45Rwt0K_6n7Ng8F4K0zVCz8.W Xl7syCk_.HqLHL8I9sP.reK6zDcI91e5PZ7.Hm441DFcu_4izdwXDEJwcVcMYAR1FFF2ER17N1vm VN7kfo8LAPXD4D7JZASbblhNcw9yAKXJnOrQerX06opPqPgGo44ouD2TOaQ2UEs4JyU7OTYsvDrs 3RJmrRE59vqANJ_MHVl4u3rQ1APoc4941SO4OgH_3A2wM9DMbyf_dP5k_62PfJtpDlKCNH0v0HjP u6ljXskkNj6uVC97taDnGV13Fa2rd3lSBVonFZlF297sE3h4Yg.Pv3lo4bJjg._ouJHpsq3Vi181 iPuR16tAJ9wvMjJt82hCctAP_9lc9mC0jOVp1OCLN79SVZsM7Pmj8N3tdSyUQ2TXcD_0M2B83GJt CDl1v2xrJ_GGQu3uMlhp7R4JzV4WTQwD9bf7dBRykFxBIKL0EwlMlSXZtJX3TpP.l5kDYBcd37Wp w_zb0enOWBKaLU9iOXVWvsSg0VbnUYOefiew4jglpbGUXiLvHD6zCqT8rJmASUiim2PUhkFsoUaj _S4_iRsBCMsXKvIWVNaenF8SLav8ZgLhBxGS0PMOPVpp2HGsKDrtZlPKCrLIbDXrLk8DM7488CIJ 6U3uyfpSgBJ7KSScpWW4vLY1eL8giVd1RYwLVamBjvvrAC9Ze9TiqUzB.ehMZlC5s5jHlHBgIjGg eRxadQoLDj9RErbZqC9ekPLEuciAMq5cy_7PrGV1RNwgxIElvxJnShFBg6BL7P4SzYHjxVx4m8Ma fmWsbi0a_RzDvIsHsN2tT_gQtArxLuZRyANpjtvR7VhwKPmVZosoEBQc2Vz.KBJWtO.ii31SLjSb AhYkqGGh5yQXFQcqAzNs.56vSg7NNo_nxbcSVihHtn7cN_Enq6ZwTp4qOHOVIzELFhbaUZT.cdkk n1C77cUWccDbnFnyQV3ffnA_6GNF4tM0BXi3DTqCRvCuISfnFZQ2.cBjdAMGS4Z.ol58ndaimPZg xMmGswxBcvSKnBGjD93uztaCauB3Rl1rVWUF3Jn3Vbuh5MmFRoLBWh4A_9OYk15X6NQXerF0sMcz 3wZAtMZ86NgYhVSWqceU5l163raaRx7Ux.G4ummOiE4P33Gsv4pqau.94SJgsPoDAguZvwH3..l. Zes7KBUZg7HvXQEMJQ2T1FjbMY.YN1Js4E9.emobVzvR850ctJwq50orisaiwfBJfceQFtn7dy70 2qpFCyfaUgT5Kjz19RWw_bN9rihG6jcKfzWF8XzZp2ghz202_tkhXyydlwkU7JTH13rMSjPk6ng7 yrH9vKLNCdWj3RC25Mw5f_K.RIf4oRjh3.rBmHn1jZu0lTp_CwXGSb5OSU02TZJxj5Ew8k6R.nwh WrIqPXE3c4p3MwhFUYpPYodryJFVVQgJhuBZZDZGTEuOg5QUFkqk_ENedyCt.iftNmQGCYF_r7AH 5utt9KnbyveJubt0QibK60gknobjJoAIkiJ5dlXC9gdEybEyzNMWjVccRU.KEbyAmgc7hSrnDD_I Sg1DLn7rMg1_W3MAb9IWwM0pfiFJ3w9gOlq3LA3foX0mRSdN2ZpIRs7gzFD2ePkv2d2cL7m1GKi8 Ee4srOo2NFEqNS.e4mPKJvyswYP7kPopIQp4CMzvJaKdrGQafNSB2axkb4e8kOwz8oJUcO6f.xm1 QWW3SXRaurz8mouaSVMJIb5hRMfMGOs7xKfPGuc46rekvoW1NDdCIxv3i6iqqconppGrXQR.ThHa Z2can1UP9njbJ8V7rgLc6zjKboflAjB5ki4N3OSrTdH1RQOD0g48XkH1V_TJidwSOrqZ2gg.BB1a Ap4fOezynSwyJH5F9q_CnFGJ7P9HELpDVL53aIwvJkluXkxfgBczPaptRJagh8HJN1T.oNZSX.dZ henWjj6fx94mjV4aD41neLCKpjixIrIusQNwUkqeqR48cDauHAFFjnzn3NBY4yvkpFi03tJvKAxD 2ztuNuzNG_oeyTDa3ayYfwWHro0nIeKIfYvSY3P9_aIggUzJ5b_X4mPvvRJVnA0z4NLTMA3ltMCq g6g9DYsUfuOWfxIARlk3VFZ2p68XYKNbklD1KeoquXTUS5IYojCcgIDXDZPkdtbqu6PfWme1skG6 6BUd35l1dfgATaSYoWrZiRP7NQQg8HbotaLxkGlMEkevxDpoBUrEqU7Iv3hUerBWwefZ_tG6knw6 m9MrwHnFo4OjVO5SnYRHRObrxW1BrO3UV.RzUxZbudKklvUt4N7pnpXzjosqD1D_KSuPOLryDh6H 9jqiQOO7CvXyt3Rl.VsyDk.XzTHowSfaPWlCEiFNVf2Sgn0pHV7vc2TcwF7dVK48XLChr X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Sat, 22 May 2021 23:51:36 +0000 Received: by kubenode502.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID e7c8dc3bdf483806204b6c6af9e0e23c; Sat, 22 May 2021 23:51:33 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Sat, 22 May 2021 16:51:31 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <9A949E36-FDF2-40B3-A126-5538E41964D3@yahoo.com> References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FngHF5sYCz3LLw X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=AK6HPXaX; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.206:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.206:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.206:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-22, at 13:12, Mark Millard wrote: > On 2021-May-22, at 09:01, tech-lists wrote: >=20 >> On Fri, May 21, 2021 at 03:51:35PM -0700, Mark Millard via = freebsd-arm wrote: >>=20 >>> So, if I read this right, you are reporting 4.5 hrs >>> for a "hot ccache" result, which I had mentioned as >>> one of the things leading to large variations in >>> reported build times. >>=20 >> Hi, >>=20 >> not sure what you mean by "hot cache" >=20 > The first time ccache is used it has no prior results > to use to avoid compiles/links: an empty cache (a form > of "cold" cache). Another form of "cold" cache could > result from changing compiler options that would change > the code generated for (nearly) every file produced so > that the cache becomes ineffective. >=20 > "hot" refers to having a significant amount of > "effective/used cache content" that makes a notable > difference in the build times. I'm not that impressed > with the terminology but it is was I've seen used the > most frequently for ccache. So I used it. >=20 >> - I always use devel/ccache-static >> as have tended to build from source throughout my time of using = freebsd. >> It provides tremendous speedups and generally i'll disable it only if = a >> problem arises and am debugging it, or crossing a version boundary = like >> from stable to current. What I'm saying is I don't know when ccache = was >> last used for building anything. >=20 > I'm confused how you can know it "provides tremendous > speedups" while simultaneously not knowing "when ccache > was last used for building anything". It sounds like you > think the 4.5 hr build might have not have been from > having a notable speed up from ccache? >=20 > Remember that when comparing to my "from scratch" > build times: in my build everything was compiled > and linked, no prior build materials around to be > reused. So I'm reporting a context where I know > how to interpret the result and I'm presenting > enough history to establish a repeatable context. >=20 >> 1. rpi4 here is clocked to 2.0GHz >> 2. ccache is in use and /var/cache/ccache has *not* been previously = cleared >> (i'll clear it for next test) >>=20 >> 3. make cleanworld cleandir clean has been run on /usr/src >> 4. sources are at 246839 >>=20 >> 5. this rpi4 has the following properties for its disk: >> [i] root-on-zfs >> [ii] boot-to-usb3 >> [iii] 4k sectorsize forced >> [iv] encrypted swapspace >> [v] entire filesystem encryption >=20 > FYI: My build-experiment boot media are never > encrypted for the file system or swap/paging > space. Another thing I'd not thought to comment > on. As I've reported, my UFS based and ZFS based > experiments get only minor variations in > build times (variations of minutes for from- > scratch builds that take hours). >=20 >> /etc/src.conf is >> https://cloud.zyxst.net/~john/FreeBSD/rpi4-main/src.conf >>=20 >> make -j10 cleanworld started on Sat May 22 15:41:58 BST 2021 >> make -j10 cleanworld completed on Sat May 22 15:43:23 BST 2021 >>=20 >> make -j10 cleandir started on Sat May 22 15:43:23 BST 2021 >> make -j10 cleandir completed on Sat May 22 15:43:50 BST 2021 >>=20 >> make -j10 clean started on Sat May 22 15:43:50 BST 2021 >> make -j10 clean completed on Sat May 22 15:44:11 BST 2021 >>=20 >> make -j6 buildworld started on Sat May 22 15:44:11 BST 2021 >> make -j6 buildworld completed on Sat May 22 16:20:48 BST 2021 >=20 > So between 36 min and 37 min to rebuild the same version > with the same build options and compiler/link command lines > (near[?] maximal effective-ccache content that leads to > near[?] maximal avoidance of rebuild activity). >=20 > Cool. >=20 > For META_MODE builds, seeing how long it takes to go through > and discover that little or nothing needs to be rebuild would > be the build times for 2nd build from doing back-to-back builds > (not even an install to the live system between). The META_MODE > use would then prevent most rebuild activity. I've not done > such a timing in a long time and it does not approximate any > normal build time for my typical rebuild patterns. So I do not > normally time that. >=20 > I'm not claiming META_MODE is similarly effective to ccache. > In fact, I know of issues where META_MODE rebuilds files that > ccache would avoid rebuilding the same file: for example, > doing an install of a build to the live system between the > rebuilds has side effects that lead META_MODE to rebuild far > more things. >=20 >> make -j6 buildkernel started on Sat May 22 16:20:48 BST 2021 >> make -j6 buildkernel completed on Sat May 22 16:49:18 BST 2021 >=20 > So between 28 min and 29 min to rebuild the same version with > the same build options and compiler/link command lines > (near[?] maximal effective-ccache content). >=20 > Total between 64 min and 66 min overall for buildworld buildkernel > for the near[?] maximal effective-ccache content and needing all > the files. >=20 > Good to know. Thanks. >=20 I happen to have ended up with an opportunity to do (no cleanout of old results after the first rebuild, no installationa of any of the builds): rebuild world reboot rebuild world The 2nd rebuild of world got: World built in 354 seconds, ncpu: 4, make -j4 So a little under 6 minutes via META_MODE. META_MODE does end up causing some rebuild activity, just not much. Much of it is re-linking. I did another "rebuild world" without a new reboot and got: World built in 293 seconds, ncpu: 4, make -j4 So, somewhat under 5 minutes for more context cached in RAM. A similar sequence for a debug build instead of non-debug build (building machine running non-debug) got: World built in 526 seconds, ncpu: 4, make -j4 So, somewhat under 9 minutes. Then (no reboot between): World built in 296 seconds, ncpu: 4, make -j4 So, somewhat under 5 minutes again. In general these figures are approximations of the low bound on a buildworld that is a (near) no-op but is not frequently approached in my normal activity. But it is rare for me to update the source tree again and rebuild after only a few source commits after what was originally rebuilt. For such, sub-half hour rebuilds can certainly occur via META_MODE use. The context happened to be the ZFS based one in all cases. Still no ccache use. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 01:12:23 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1A2D18E42C7 for ; Sun, 23 May 2021 01:12:27 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fnj4V39jnz4hPt for ; Sun, 23 May 2021 01:12:26 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id E90835C00F7 for ; Sat, 22 May 2021 21:12:25 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Sat, 22 May 2021 21:12:25 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=To1MseanGyeu4ZsidYJ8CW9JZi4 g51hNglztW54FMj0=; b=R1DbGdP3XnpBL1uU5v6n0xZn7SV/OM6GEiKXhDj1WHp 4Y9qIFBsnD3Yw5EvSwye6wyyQ+9HLGhb2dew8qw3nsIZTvC+pd4W6XLHJ0u0m0I9 +jNf5t+LbPWZr3uPWLZnjJPQX1GZlPHwz07jU/ceMhx8yx6V9HkG0kUIp7n0Ex6y 44oMmiwyOY6mGyYDGQH96N5PmBEb+ggI9hpgNTxHfWeqJes2sKu+YQr3zmDHrvwo rdp4FVjdB+BOzGimjYZGRkK3kHFQwAXuXPmLexpQMrshnMkcddYXoz485HFfng7m BEnuT4rPXHFap/FZ9r8/vbsDKYYq4LnnpolymhD6wwQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=To1Mse anGyeu4ZsidYJ8CW9JZi4g51hNglztW54FMj0=; b=uBXvSOxXgETQ7kQAF2tnSQ TFKP+R1pkGwtsQGO53rq3YylOC3gCICCUJ7OfgpMNfWyfRVVbPx6t0sYqbCbgIP1 20KNfCLpLke/iu8VVuZrriqAZDK3zBolz3kyr0IZivtZtL4+VwIlgNvgy+QXROUl w8BvOngFlB7WwgA3AMAfaUEeuTtxYTtT+0IqxRn1dpHG3akqd2VmqrnwZa48FxDD ZPIxzZPm9y6r6kq0BFSLCxhLQUmh4fCg7C8uD7a7RRzYLqotWYqqHkMmo7Thakdu U+MIOQm5lSkXIfk/Ow0nBPO9ID/NiuLSgmlRp79OUJLLJFpjGfeIIwP8fdUFCQYw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejiedggeegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucfkphepkedvrdejtddrledurddutddt necuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtg hhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 22 May 2021 21:12:25 -0400 (EDT) Date: Sun, 23 May 2021 02:12:23 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="HsVeFn8hjdwcpdOo" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Fnj4V39jnz4hPt X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=R1DbGdP3; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=uBXvSOxX; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.25:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25:c]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.25:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.25:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-arm] --HsVeFn8hjdwcpdOo Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, May 22, 2021 at 01:12:23PM -0700, Mark Millard via freebsd-arm wrot= e: >of "cold" cache). Another form of "cold" cache could >result from changing compiler options that would change >the code generated for (nearly) every file produced so >that the cache becomes ineffective. > >"hot" refers to having a significant amount of >"effective/used cache content" that makes a notable >difference in the build times. I'm not that impressed >with the terminology but it is was I've seen used the >most frequently for ccache. So I used it. OK >I'm confused how you can know it "provides tremendous >speedups" while simultaneously not knowing "when ccache >was last used for building anything".=20 what I meant was "I'm not sure of the last time I built anything that used ccache" or, more accurately, "I can't remember the last time I built anything on that machine" because some building uses ccache, others not. But I know that buildworld and friends use ccache. >Remember that when comparing to my "from scratch" >build times: in my build everything was compiled >and linked, no prior build materials around to be >reused. So I'm reporting a context where I know >how to interpret the result and I'm presenting >enough history to establish a repeatable context. OK I ran another build. Same sources. 1. rm -rf /usr/obj && mkdir /usr/obj 2. rm -rf /var/cache/ccache && mkdir /var/cache/ccache then: make -j10 cleanworld started on Sat May 22 19:10:02 BST 2021 make -j10 cleanworld completed on Sat May 22 19:10:02 BST 2021 # make -j10 cleandir started on Sat May 22 19:10:02 BST 2021 make -j10 cleandir completed on Sat May 22 19:10:37 BST 2021 # make -j10 clean started on Sat May 22 19:10:37 BST 2021 make -j10 clean completed on Sat May 22 19:10:58 BST 2021 # make -j6 buildworld started on Sat May 22 19:10:58 BST 2021 make -j6 buildworld completed on Sun May 23 00:47:03 BST 2021 # make -j6 buildkernel started on Sun May 23 00:47:03 BST 2021 make -j6 buildkernel completed on Sun May 23 01:20:31 BST 2021 so buildworld took 5hr 36min 5s and buildkernel 33min 28s from cold. earlier, I wrote: >> make -j6 buildworld started on Sat May 22 15:44:11 BST 2021 >> make -j6 buildworld completed on Sat May 22 16:20:48 BST 2021 >> make -j6 buildkernel started on Sat May 22 16:20:48 BST 2021 >> make -j6 buildkernel completed on Sat May 22 16:49:18 BST 2021 36min 37s for make buildworld and 28min 30s for make buildkernel. This is what I meant by "tremendous speedups". Other things get built on this machine; it has a poudriere instance. So I guess anything using C or C++ will use the ccache when building. I might not know exactly *when* unless I also know (when whatever the machine was compiling), it used something that ccache could be used for. --=20 J. --HsVeFn8hjdwcpdOo Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCpq+8ACgkQs8o7QhFz NAVzpQ/9GrP6LnIXJ1lrXrwZIp+CDbwXYST7wHeLahuLzIRTLaRG1Jpv4bas0Bxi b80M+G8cJ1zvOTaClAVoS4+L6KZ4qkkTyPf2dxa8YrZd5llFp4GGYZyw80bB2rMs P8ntYUlbTT6UhpYdTuSC159mFfLSY6ldMQFfIeB+ga3R+kzlXpyB+nab0R2JSz+9 +ibOlJQKyHLmMpnZZ54w5fmH+8gIbapLvSeiAqxHjvyqYIY/7RVXOwnHAskLWvsp kYnO/qwvyvN+DolMyBvKWYuOOYgsv37pRzQcpr0BFaDPQnMXMw/ZDRLwgU/Ba7Qd 2OHZV3EaFlIpOoKIt13zmkH7q4Pon7317m4ePNkTFljOAVP1zxg4jx+v90voCl+E 7ISgYxGOXSAQ/e1K/gYhPk4pIzk5m2lJYwsrCCOKpXFKFPzWRz0Zr/FWyxcYkl1y edc57QdkW8KjUOapXkMviWkc3qoMJyhvKsVPwczbCUB/hLgdgx6H7vT3BsIZo/aC tOxKC4w1npNkS7HMXCHEhSYIYQgOAiPYd5hGMQdzm1QDbLbyHfFQpF3wXD/+4WmK n60KgVXyE1BO68LTV3X372+chd6iJ7gZimYKEUmjaOx9oFzVZGoRyhJ4TQEE+rYe H9anSJlTa7+8EFPcM5DLzHqNDMSSkXDZfETVvgRr4kF+8vY+JUo= =OIBY -----END PGP SIGNATURE----- --HsVeFn8hjdwcpdOo-- From nobody Sun May 23 01:23:31 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 120288EC636 for ; Sun, 23 May 2021 01:23:35 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnjKK4v8Mz4nWn for ; Sun, 23 May 2021 01:23:33 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 772DC5C00C2 for ; Sat, 22 May 2021 21:23:33 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Sat, 22 May 2021 21:23:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=hkEcen9CY47G+IBK/GGZjm1t4Og OWT6T7uvWNdiPQoc=; b=w/We0glHvyKJ0dyIjRt88WUXQmxThADWYAXs7ZW/YAX D6ZPNDo3KIT4nZRKSgVsp9S98er/hVFYhtWGbddYYXF82WdlTpVnTfH7cYqZy5sY go3VGsfNJW4p7MOUznZ+eNr7NJGcT5BfweuyMQjYd/GTJtFiIIg/iUYpeNixXMAx FL9btoMnqErbGC7l4x7bwa/K2nhppv2HDz/XlYGx5T9RgRxO0D6X5ibJcC0mqkWM vxzYKbbtx//dB2qRqCDNpwnDnlLtdhRInbmUl8NVfhxh4ogsqvQZ0AqjqFv8Q6dt YkTOhF1qpKbN7HltYKN//1Y556gLuEu+Khb/+8CBcUg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=hkEcen 9CY47G+IBK/GGZjm1t4OgOWT6T7uvWNdiPQoc=; b=VngkZeKlS+OvxCS8c/lQ/C F7MN6hf1LzmBlY3LhrCjEW4pXPjH6hcFvgmI/OUcjFFpFrRbfrap+7TEAHozMV/B qPxVK7w5KNKpls9B1HvzWSur8gPheisx6w1TQJ/V7jMJnklYr2EpdYX42GgJu6K6 bZIvbc5ngVdOhb+sn545NCaUbxVFoEn2TzNemIFfMni5GotvP0lvu/1+ZZ76SchT YyrDWl1aOTFSGfV5NSnUqMbM2/hd/aJXxXjbYImgu2VQNaxvaHPNnimGs6G+TB0R ygJSCFQatR+yMHqDY+1MEZ8v3HvpXHM5V+kFllNQ2ZUm9GCtKT3lukXJHYf1jlBw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejiedggeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucfkphepkedvrdejtddrledurddutddt necuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtg hhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 22 May 2021 21:23:32 -0400 (EDT) Date: Sun, 23 May 2021 02:23:31 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> <9A949E36-FDF2-40B3-A126-5538E41964D3@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="3XUR+HEEvHHWpLaz" Content-Disposition: inline In-Reply-To: <9A949E36-FDF2-40B3-A126-5538E41964D3@yahoo.com> X-Rspamd-Queue-Id: 4FnjKK4v8Mz4nWn X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=w/We0glH; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=VngkZeKl; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.25:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25:c]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[66.111.4.25:from]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[66.111.4.25:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-arm] --3XUR+HEEvHHWpLaz Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, May 22, 2021 at 04:51:31PM -0700, Mark Millard via freebsd-arm wrot= e: >In general these figures are approximations of the low >bound on a buildworld that is a (near) no-op but is >not frequently approached in my normal activity. But >it is rare for me to update the source tree again >and rebuild after only a few source commits after >what was originally rebuilt. For such, sub-half hour >rebuilds can certainly occur via META_MODE use. > >The context happened to be the ZFS based one in all >cases. Still no ccache use. That's wild. I have to look at meta mode.=20 My use case though mostly involves building/updating ports with poudriere, and I'm happy it can use ccache. Am I right in thinking meta mode is a buildworld/kernel thing only? I've only heard of it; I know nothing about it. --=20 J. --3XUR+HEEvHHWpLaz Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCprokACgkQs8o7QhFz NAUVhg/+NAmKW2+dEpl++P/qEAOrc2rsbu6P8J0HUS4MmV7rv3jbM1rqMPMKU+Lq JiMi91SsiwdELnJQKIxm9dp7I2WMVI0yyZOAzj+IFSpmiFUiCqhswOYTb0caSwpl W2g8XMa5D2rWjgaKeAXZlkd9NRHK+mYLuU+law+C/92h7+9IfAkplxmfKC93gnmF aYjYP4y+YB44wTc3h3KdEBhUHsqXparoui8xXK3tSbLQ9Bq3jVOn8jbUOTYnJrrz YsIlvrm0tqIiLohQNpajTcXLTaYhPF/PcMNjFUMAJ1YF0kobsEd6KFbH1tx3d/jj xvguUS6XkjY51+Qp/NTHnjnF0Jo56woDOSr0gJchB+6jOuVCzugBT+xpcMmeIllu 1xHluOgDE0PdmGu73bherDHqBfKMvDozB+mCacqsDziYX/4iUgYdKfW+qddH3xDN Vi504Cnw9HDmOp5nc+UG2xHFNsHbj6zuLrh17StiHxasaoRsA9H4ahy0VxeYRt4j Ws0eW4iX8rucQAWJYdrk8kte7gbZU2A37u+Nb4MBgc1Oq6lRwuapothnGbCVLBD1 tvyBSNaYgPJEGo46f4QxtH2TvmgK7ke4J0VJSNVys0MxQJQ1gvfdXn9WH368Br3R msHM0MmZnxvP2sSVJDuiIB9l9xknW8DzcbbdBBtLLb6cDHLKXY4= =yURe -----END PGP SIGNATURE----- --3XUR+HEEvHHWpLaz-- From nobody Sun May 23 01:29:03 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 450B18F2842 for ; Sun, 23 May 2021 01:29:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnjRn6Ymkz4slS for ; Sun, 23 May 2021 01:29:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621733348; bh=LDsGSQIIODYQOFWEHbcFOGdvewn3VYRv+puHNQJ8RZs=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=m8lW6X50oN3JBFXGNLxNfpDlAZSo5TbDPQizsJslvZWC19nphSORR+NjKDamFlDKWd1VjGrdSbx10zoq5LTRbI1/ARssjKXOdvYXwXM7R57HBYcTDutmrzd1LPrgqk+FijCu/06K7FEgAAFiQgNjJYX8x2uEZZzSNkdr/ZjBSGMcNwBnN7kDA5ULx0i3GVfIzMLdRgK3yNvgsOU0UKjcRssvJb5QlmG1qTm/bJk9hjUChRg7yODq7oNxayMlZCwO3gStDzIEClz9mpngI+9DcTRjb5VDSmehCf9DF2IYCkQCWsrizACHihprcEys+a9QDeTvRyS1qU4xtQBHU3X7Kg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621733348; bh=vsD1ZFnRrEajCV8yRXYDNg5QqvlfQHo2e2eK0jXZRR0=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=CXJ2g1FSW+gG5yKHIWkfS2j6Sd2mzX98T1c493KGUYN1S6w5e/BLvSX6j3z20p5GnfNKverZ1Dd95I/4rk57RfDN+limh3hSe8XtArtt0h/7ibqIMDZ+PTdPQuD1kvn9wBNmbXgLrB/p6Z5AHu6aLkQpJIyzk7l6YpEt2dfXy+ncU9w0ySzl+C+EbK+wxE5NMKda0aR0OwZLccMcFrVUBkaZrTc4LbJ2audeS4c9jED2gy0ZQFXJBpmUBVJZ51vUtWgECAG055rPyUCRS441gnoKwGLD+YL3Mwvg1QSjrZcdevuoox3cMbFwI+75TxOhuLA6eNvgwDZJzPNCNm14uA== X-YMail-OSG: 0olL1NcVM1mSSQi.Nnvb99qkZnl_LcbKHt89Ser3CD8VqPCoP.eU0Q9SoZmfc67 Z5M0EU_cODcdV0p2BY.9ILjhMozWMLkJfMnys4HhIH.rjKcfWfK1F0qnyM.iLTiqs92EDjHqGjwO r6qfeWhlXa1Rew.9PRHAC4mkzSRMffnVyMtuYERgvqypJ_S8YIXPs6dMelsXq4txg9l1SxbxLpwI 84xQQ85rwyf55GT7x2biaQj3gFQ3eQdEIjiI.XQnlnvmocJ0UQHoQocZuzgb_xClyTKyxKRH2s45 LY3OBbI5j4zR6bVw.iLpwgN8EIp3T3ZgvjQNp0F6Ej396wnFxA.lFIYTTBsTj0e8X.jFt0gd4ulj .KrNUbOB95fK3mboxwUCZiziHsY3EPZo5CGaRADBkYvRk6RtIC3UjRY1YF_GiOcVI2fcD5rNBJmX B2O3zij8LELlEBjbJ0yXv6wdPh8pYTXFtlzKULh8svTXoWWf5ILkrlZ53QKmrLsRtVSPyQ1ueCJr Fodw7cSWkgL.Q8LhccNliaPUjA0rCtOBeJilFCvgexz_w62jaS.oZB3Fn1FTUr16DIr5WNMhq5iH op0ZnGrYhM134qCXTsgPTCEjPc8znnEik3sqAgy0_S7DJcARmyzmRMFh7Rcbh.vChx9T.SoUziUi WDuoJVySYijo2DB11J4jQP2gb96UVyqcrWdifGk1ThqEhnpAwvhiu24UuyLj3MazHUDwbCUi4wzM XVBnjVL_pmpRfRCj3ji41EgYPyQwwfaJednC3.K3Q8cZh53PZcr2yTaCQLM4acBFNm4G7f45eSQ6 ia2.OvOEVsY6VqivXEUlrc9PDxj5.nXHzeAb3SQGvbL6yMUas.b0StFqRopvbsdLZReyGEDjNiFQ lN7E5Grv1uOXdm2nByQZX0awWal_F2c0pP6iMX3.x3f2QvZoz12hQFZjbnrrOmWp3WDwbBPXbI2N JjL.P4izKyrE6l6tF0adjz5C1H06BBxkXoHVboKeSC8rzMyEt08YRQ4rMAKkH7jphw_zEn5LDaeR o_b2zEzOcQU5ym.zaOZb5pI63R0z21_l_5_ZBlgHvbpmRxYXxJxhK9b1tig_Hu8f0J50ybWmGZhs GFlDOM3fa4nbnNkXHmSzB3BPPnbnYN7LLtzszOzJ2u.QifOees27uMGNfSK7PZ.Z0znrxzwoDHKC vkcwxxPxGoBIEoM3bafazXo7tPd1SZW3waL.NSZCZmFfbYMj_dlgmrUenxQ0xZqsA462tidX9d2E kJNYjQeM9Eh9m7FqQlrYqfr4cV9Y_A.2hnD7d1tn0xITiyITeldqjUN.xlUh5jcrgAlzG8tFDOCL _E8MBq6oQGMrvi6uKeMHN7NIbS38wHsQAwrbpwAenOXyF1Ucfo_Dz_bpnuE.tZGeoplBlga1rJuL KmVMzvQSp1Vl6QcCdy_cD57Gg77oHTe4xfcprTL4oLfjO9Du49IdLwyIaJ0Igod0e0okB6zdHFzC MRhtVyaHIlJMT7NMQbg5zutvFe3DtSNF8gHdRF3_h3VyktODvjAlNxGSZnYQZYbAzisG36p4fDLw _X0nYQmwLf4eBjWTjVaVFe8KQHc2amp4ct5G78Wqs2MesrESB2j_hLYDcy5A1yxFmVzI8rGCADb1 dMSyc.7_fBI_lAqz8bglpRdTLp7tfynQlFdss32sx3izrfqq332pXXGIj.AYtOAgxA62sd9jJRCO Ih0XKks1Y9dvXYHY6FvZoDGakLOj1eBDb3MYLyTsYJZlmn3SPu.mIr_1opzBpx3.6rpREfFE5rCu dOigqkSqOzlxyKwqFBL8JrI5mlvyc98W_6Wr1E4IkQJN3DZYu_3QWP1fCOT0dyiixVAgZ72neBtW uG6aF.WTvBZNPF4mI0TPj4KEkSoS_0VKGKQBpTFKgjqcw3O98ctBEuq8_hOVfbbaxe.Yiu2XemEJ oo22Sa0B4QsheD6CvGHm7bmJ0lGFdgYBspvJtgxgGvEExW6O7tJaEYixhEpNuqU3Ngmi7t._5KuE Ncmg5rqlglnE9zy87n6a71jOXnYVqv3FOnaMpVs38DuJEe4pHVkCRUB1272fVAyTtPH1pWShVcYb cWfyc5IukajPWvzLmDgjsXvpJwariYZS85PfyQ3Bes9XGqKgepmeZM_Pn6Pe5.FPMCq1r6.Ev.vI Yz4rq81X1pnXIgLeqE.fG29i.lkg_x1Uc.B5w_Ls9WlhodY2EAVMmCeDzKll.aQyTKxPJZIsQuZl ahqrFlko3YCty9m2O76BZuXEyAhKq.O0cjQye0UK_mdbY2wBxqr6JANLv1agjkXEFk8rJOxtJPaM eky1SX8n.8vB.DG3Rr5gCJxdKzfxDMQrGm.g0DxEMMY_Si.AmQd3qITWGNDfMCPe.5tycpRpZ.Oq gpK_MvZ_.QqVj_uLhOHskCsNMc02hCodDibIO20MqTGAF8t3dtlItkBwfBXbbyOOkyTZSmsA63AR YLcZAi2XGCWik X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 01:29:08 +0000 Received: by kubenode527.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 312327ac9f8620bc9b9aac902ce1ead2; Sun, 23 May 2021 01:29:03 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Sat, 22 May 2021 18:29:03 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <7F7918BB-CDA4-433C-87DD-99EC4C7C68BA@yahoo.com> References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FnjRn6Ymkz4slS X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-22, at 18:12, tech-lists wrote: > On Sat, May 22, 2021 at 01:12:23PM -0700, Mark Millard via freebsd-arm = wrote: >> of "cold" cache). Another form of "cold" cache could >> result from changing compiler options that would change >> the code generated for (nearly) every file produced so >> that the cache becomes ineffective. >>=20 >> "hot" refers to having a significant amount of >> "effective/used cache content" that makes a notable >> difference in the build times. I'm not that impressed >> with the terminology but it is was I've seen used the >> most frequently for ccache. So I used it. >=20 > OK >=20 >> I'm confused how you can know it "provides tremendous >> speedups" while simultaneously not knowing "when ccache >> was last used for building anything".=20 >=20 > what I meant was "I'm not sure of the last time I built > anything that used ccache" or, more accurately, "I can't remember the > last time I built anything on that machine" because some building uses > ccache, others not. But I know that buildworld and friends use ccache. >=20 >> Remember that when comparing to my "from scratch" >> build times: in my build everything was compiled >> and linked, no prior build materials around to be >> reused. So I'm reporting a context where I know >> how to interpret the result and I'm presenting >> enough history to establish a repeatable context. >=20 > OK I ran another build. Same sources. >=20 > 1. rm -rf /usr/obj && mkdir /usr/obj > 2. rm -rf /var/cache/ccache && mkdir /var/cache/ccache >=20 > then: >=20 > make -j10 cleanworld started on Sat May 22 19:10:02 BST 2021 > make -j10 cleanworld completed on Sat May 22 19:10:02 BST 2021 > # > make -j10 cleandir started on Sat May 22 19:10:02 BST 2021 > make -j10 cleandir completed on Sat May 22 19:10:37 BST 2021 > # > make -j10 clean started on Sat May 22 19:10:37 BST 2021 > make -j10 clean completed on Sat May 22 19:10:58 BST 2021 > # > make -j6 buildworld started on Sat May 22 19:10:58 BST 2021 > make -j6 buildworld completed on Sun May 23 00:47:03 BST 2021 > # > make -j6 buildkernel started on Sun May 23 00:47:03 BST 2021 > make -j6 buildkernel completed on Sun May 23 01:20:31 BST 2021 >=20 > so buildworld took 5hr 36min 5s and buildkernel 33min 28s from cold. So, in your kind of context, if it is sigifnicantly faster than those figures, you can infer that buildworld and/or buildkernel was using cache. (Presumes you are not also using META_MODE or other such. Otherwise there would be multiple possibilities for sources of avoiding some of the rebuild activity.) > earlier, I wrote: >=20 >>> make -j6 buildworld started on Sat May 22 15:44:11 BST 2021 >>> make -j6 buildworld completed on Sat May 22 16:20:48 BST 2021 >=20 >>> make -j6 buildkernel started on Sat May 22 16:20:48 BST 2021 >>> make -j6 buildkernel completed on Sat May 22 16:49:18 BST 2021 >=20 > 36min 37s for make buildworld and 28min 30s for make buildkernel. This > is what I meant by "tremendous speedups". Other things get built on = this > machine; it has a poudriere instance. So I guess anything using C or = C++ > will use the ccache when building. I might not know exactly *when* > unless I also know (when whatever the machine was compiling), it used > something that ccache could be used for. Nice to have examples of both numbers. Thanks. poudriere has /usr/local/etc/poudriere.conf.sample which contains material about configuring poudreire for ccache use: # ccache support. Supply the path to your ccache cache directory. # It will be mounted into the jail and be shared among all jails. # It is recommended that extra ccache configuration be done with # ccache -o rather than from the environment. #CCACHE_DIR=3D/var/cache/ccache # Static ccache support from host. This uses the existing # ccache from the host in the build jail. This is useful for # using ccache+memcached which cannot easily be bootstrapped # otherwise. The path to the PREFIX where ccache was installed # must be used here, and ccache must have been built statically. # Note also that ccache+memcached will require network access # which is normally disabled. Separately setting RESTRICT_NETWORKING=3Dno= # may be required for non-localhost memcached servers. #CCACHE_STATIC_PREFIX=3D/usr/local and: # List of packages that will always be allowed to use MAKE_JOBS # regardless of ALLOW_MAKE_JOBS. This is useful for allowing ports # which holdup the rest of the queue to build more quickly. #ALLOW_MAKE_JOBS_PACKAGES=3D"pkg ccache py*" and: # Define to yes to build and stage as a regular user # Default: yes, unless CCACHE_DIR is set and CCACHE_DIR_NON_ROOT_SAFE is = not # set. Note that to use ccache with BUILD_AS_NON_ROOT you will need to # use a non-shared CCACHE_DIR that is only built by PORTBUILD_USER and = chowned # to that user. Then set CCACHE_DIR_NON_ROOT_SAFE to yes. #BUILD_AS_NON_ROOT=3Dno and: # A list of directories to exclude from leftover and filesystem = violation # mtree checks. Ccache is used here as an example but is already # excluded by default. There is no need to add it here unless a # special configuration is used where it is a problem. # Default: none #LOCAL_MTREE_EXCLUDES=3D"/usr/obj /var/tmp/ccache" (Not that I've used such.) If I read that right, ccache is not automatically used just because cache is installed. Instead /usr/local/etc/poudriere.conf needs to be adjusted. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 01:32:06 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 092B68F2FDE for ; Sun, 23 May 2021 01:32:10 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnjWF2tNdz4tVs for ; Sun, 23 May 2021 01:32:09 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id EFAB65C0095 for ; Sat, 22 May 2021 21:32:08 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Sat, 22 May 2021 21:32:08 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=RM5qMJl53t7o60GnRPVaoybS6XU W9OUVrMpLf6R5ZrY=; b=tWyhs8kvpKqrHN851w3NZ6z+Yh4dKYzHd/HZSPnJ5xB qrtkvCiPbFv4MQpmNsPmKgvzfs/xzbu5GuZ7mHiPQKYgHGsY/D3kS2iPuNz7edMa tuU0oc+xDDvOBPAbfKQzEI5uoRlWT06vO0S86+VBU2ldnvy4sf1QdUOl6ybLdt2q gvZs7OmpKoouiCpe0b+3KN4rOEgO5qYlOtD+N8ppoByUy41HmgnjHbkdvbFqm9bE nztl5Njtk8hqdotla3qEJ+5p7/L/ikv3JnNES/IFfFUkYHLv3kZQPgimhXwhF4om /NfmOT640OQ5bDRB6RIRMWmMSTxBVfVd9ZnSnDbmzNA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=RM5qMJ l53t7o60GnRPVaoybS6XUW9OUVrMpLf6R5ZrY=; b=wtFNhKC3dZF4pja3ugZT1+ qskO9gdn+j/ZrjNrZuW3LlxrvXTxp3TgS/vptcpCDsyGnaI8rgTrF60WyE9UlagP 30fduj6MrGihFpu+C4Gm3QW/f9vF5HisKMpdprq+ajFwa56KFTKpDYmSTdMbKIc0 SsBMPndPep47mr/IzCOlYI47pa7IhrUvVAzCUS3LpD7B7BiExNCjCxRAl8xkeOTt yOmVH3zaXGoTic3IVLyui3zMvU/tco9Xu/DRqf2PTVrcPo6/Nogv4r1vZ5FWuhg4 US+CRG9d+DoZrcx0KEOQTMCYgrrcQk6YOYxuvJET2HQ3y7VfgIieEHFyPpW/kSog == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejiedggeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtre ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpedtheeigfdvudefkeekvddtfedvte dttdekuddvgeevlefftdekffdujedvhfduteenucfkphepkedvrdejtddrledurddutddt necuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepthgvtg hhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 22 May 2021 21:32:08 -0400 (EDT) Date: Sun, 23 May 2021 02:32:06 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: RPi 4 build time Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> <7F7918BB-CDA4-433C-87DD-99EC4C7C68BA@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="7c4dYfUQrGIadiy4" Content-Disposition: inline In-Reply-To: <7F7918BB-CDA4-433C-87DD-99EC4C7C68BA@yahoo.com> X-Rspamd-Queue-Id: 4FnjWF2tNdz4tVs X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=tWyhs8kv; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=wtFNhKC3; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.27 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[66.111.4.27:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from] --7c4dYfUQrGIadiy4 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, May 22, 2021 at 06:29:03PM -0700, Mark Millard via freebsd-arm wrot= e: >(Not that I've used such.) If I read that right, ccache is >not automatically used just because cache is installed. >Instead /usr/local/etc/poudriere.conf needs to be adjusted. That's correct. My poudriere instance is configured to use it. --=20 J. --7c4dYfUQrGIadiy4 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCpsJYACgkQs8o7QhFz NAXC0g/8DobVDD6rOpOj6hAcRTFcvBzJg65ijaHW6opn4Yhndg4g5v1pRFyB2b+J 2hGk1nVux1pU34s2vMthkW2nxuSUtzIk5Voxxx6iVFjbjHzu1TbcMn0hK/cbM8UT Qf0LtqBQn+WB9J7cWO2l3W5taY6tRcoNNpwW40hH68XsZsiVkIyjueUbYS0a/CjD 3EzmFm92jnaOollf2xLk7KdBBzr9uaYfJb0a4anWw9Z1dVC8jwjOgfEQlD2xKF28 hweIqcaJAU0/Qt9Fof4hvPv7dNKQkTU4JzJCBQyrj/fOJ29cNVtNFaqX/OIMrnAw EJ9r+RhSRYE3D8lM2HgUuWfjFJsIkSYZJSK3ZltDqJamRlOTmlYO17Wa4tlvGHiG fi1FKXGrQRmDgzfee+2/XoFwoykguXaNH+BesitK7kz4JK/33Rps7xXs/mmGN2TQ Dn0lsivHjykeeOjNVAehrtTsrRgi3F2Z+4BkAwRVi2bbmo9wkClAAnXLzqVKfiZ1 iHy4v7mSU1BRc7GwYS7MGXZYQEGP+2bWGoK2qer/kEGnHiG3fN27mxtFSDiutXNl uG557mBznRT7iPBaj00Q11OR4UWNTJRO5It7b5FbJNObqwMI1M9LjkPl8Y43SIsP HwAapi1aam5fTw2t6Di2cK1mv400hkNwTPsxseFypli0h3GnnfI= =Rcm1 -----END PGP SIGNATURE----- --7c4dYfUQrGIadiy4-- From nobody Sun May 23 01:36:43 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7F8258F7267 for ; Sun, 23 May 2021 01:36:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fnjcc1FNWz3CxD for ; Sun, 23 May 2021 01:36:47 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621733806; bh=H6aX4aD/AjJyw8N0jk9KqzrXTcapxFBc5hBWmHRyoNI=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=O5QDOhg33h6tl2tT/awxMGFq9wdTz1K6basdLSSr0847U2NaFZnGD086/1A73At74yy29dV416ziOvYXuGRzdmer9thk78nBb9DvJdpjgK8yqIbeL6a9tPjfjdw/w/ocYwJCiC95jAETv1vI42r2ENV6T91x/zx+d1DBi4xxXaSqQJmlAlL4rWER4Gn2fevptsU0TvVVlRRXj4H14cfgRrlKc5Vn9KlH3BkdJny4qMCSiKefVb9K6l/aIFywPX5gDEfltIqMeeVvy/QyL8z/iRgsIG8NbPVP7VLpvT4NqkQfskpxnclQCR8hmumSykkmCQP1JPzfBYgvRaA3JZZA8A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621733806; bh=pP1dvz4uTxIL1XH2eFkUw4gshdw/y25JlOjpxkQMmhb=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=B7i6AKsLBYOcWmOiahdruqo+8iWB6g6vV+9RE5jum2tdeIBM1Rqmb9GeSr2ARuTrIjXJEw6lcHv6Acf/QUcCQqlbDvfA5aW8EPYxO1uR48nzNlggM7Op3ppluN2FFAiHBtYElOUoxTHuqToBwsJLi/+VlTP2oyn2ogTPG6ZOTjEGPvG97A0PhXvhvnpKvMxQ3+qz8B1AXL6Tg8O7i8WytAHpglhuQp/6AcQtQoHyMjKHf8eNLYN+zZHf8NbsFsNgIYZePK61IihuCUZIpVc1iRN7PyKsNUdL8dPwcnGs3oQo3xDY4pO+xd+tgHLer3+uQpYCrSc/HFV9Bxq1zjb5ig== X-YMail-OSG: D85rf_YVM1kUxZFP5lcWcl3QAFRuNQCJ89kH5MCzUw7.6qd_0jveVbWzutI1OoR UHOA9BWuqn.PaClMFwo0IE24q_YWDyPIiGYdsGZov3TCw0fi6NPMyEkLsDHSyLQoWgYTjf55DPh6 4VxjlFRt3TQCy80jE9A2NK.zg6l8cWQWXG2ww5QlgO2EZbpj3inEgueARirEIyjuGX1kHVqER4Lt XuZaxnR8s7wsQcf0ZL4L5QDfWUnTdwNKHNlSYZs1mgeHSyITxqcE0rDDUkPUKrrHsIFyGuDJxk7a KHJtnW.lcwv0MdDut6VTOnrru8UXdil3ojrzTYzT2.P6eAHy_214GXz_irLTbMG_nR.psZHe5w.G vagnU4.825JoQHMptmeMXJw1XbI7XdKS143nD6m1GapSLFCKvUCy98vxbUvEq5G_Ze73q0QDTrDN HOX1.8pwvoBJuXBwBIAsEm4VOyhFlnH2Skd7xC5cekIkbqdMGiSypFGsMrFJL3pb_e6TUflTFNIX AtBTuvTE81u3J7jzR2dluzsEfdCXyWJvhXbgdXzMJsm1W.123Xb9_ctDrAoEm4CyvrOoanmOsFb8 3PXZmioKRF74Sj6j2FjJMRdOljZLGuhVCAAfQDNBxnPUAInPKEHrGY2_FKi0KDNHrRlgg8YUKHDq 7M_Llq4PAdAf1yODhzkfStzppDxWob5fQ1C1rXMqQqYNxLxseKeSVGDm78BjOU5aMUt1XECix5s7 DO8PN9nHaLl0yZqxui52rSPDZS0M4zx46SwN0PeSSTVtHs1yObfvzcGiouK0Fp3qGxJAnztfTZV_ pBTZilRJwlfJCsiSm8Af78Bg71xnZVPa7a1U.DF8_g67IlavnorY7g_kJdR5duwnT2Cw6NZi2HLD o_cxQtCZipQzPpMc0NmrzLuDQDp632P7gZWOd7Oz.yCAigF8FQu__Hn25Ycp4BoO6vpAFE8LZVNd Wi7jQN72ZkFly5nwcjpyg.SBMDVdQdMf1mMgsD.5GIUg6IfYvpQgmbFWsZuYQhlpEkC1__Zpw66k hBDewWs7NjwlvcbLFopNm14UzCxRdRZV_5YDgminIdaRbfauHqQ9G5vEQc67TcF7wm5CWBKz3e9M Dsb8xE73ve8dLyDUTBS2IQaT7WPRyC6XxQjXk3ouc4T0acj1TAaj0aD8gIqEfn_n1oD63r3ul9y4 3Om0dzduHnpyn2z0wRMEolbyfEUz5UgjlFDU71eceHtrJVV.HQ3Lt5Im0OBP9R0J3hQ_Hyb317l8 JEgOukIUJsfbLxNzdtInsdzYfmnoDyNr117U2uY.eq79SajeBrskFEJG2nAPyLX2fZXmjT8m9_2F leSiuN2mNpgOBKjG.T50c35Z0fTr7C2VTNTSIULgXDVp6CUqkDaa66WTN52NQ_TfaBmNeNYDRh9q r88ILlSy0oPLClVcWhiJvJ8jNuyCaqelUJUx8XW52wi9lzFP5MvLEWO1OTXRDHr3oPmDo72YcCh8 gij4ccJlXwEEUl7o_A_ddyMqv9QNFB5yniRaDtKIvegT0VPhdJo1MyN30yu5ytaAI4wh38V3dteP kLQC_e6lneySVnojKeWw8axMlJgdmTHl3_GIS9qaBjrjNvlgStI6RIHY2S3hDo0eQLgCidiI1IeW A9djXdg5vrG27Pem6xTLRgtXKN2iuW0WfgDdKxmFV19.evexRSmp4Xre6IFnmx9D7cCRUTe0E7xU Yrbbn8Z7h3xRrkhDi_IxIHPHOZ9kWlW1JLg65EHvxTsng.JjYV0vDw2MVGLrsgvBuG5XUpUb3pBE OTTAs0CT7YSF8RPFPP5UVqxzvXFHQjdRsKB0G6if0dcKuv0F0k2Wp6zrnFY2Lzc24SICdtgo_83a rozmXOwbRpRwONHVh8QtgOs_kGyIFMID8QEmvMM9BFrrp4AVAp2aFCd8rC2qDa1edX2fmplsS8fE BKvKyL48Pxvn6rKfxGKM_a1ln4ZS_zL1jgHNLOl_gZQsKacFG5hf5Mm_PEZyvKaXIHhfWEQsD2xd LLMXC1ppoHBV3ziT7pw45tq8fDDGB.FO0w.AGSQ0Q53bFGQ0Y9UGNAuPVy31tnhGcf56dOcS33ad YedXQAKIYMsl6jIasEkOhGiV9KMuMLqzr67VsEhXN80ZE_fdR8WvGmuM1XPtzhFNF_kV3YO0mnqi bmtlXzoHutBKaqnYH7P3qFZUMcn0AscVGupV7GcHqsyDkbyIxmEK3vfrWoOGa3soXbXjFWaJW46p b1f1b8wiO609uftfmh9eouT3HlW1lhgDqUd7jfXI3NVnR6OoKHsSHZVhV7NFp4w_dBtXj2tQukQg 6qL8_9ebLdPD7u9s84vyBd5sBV1k4KRWf6SYPNBCq4RwSBBB2RyH_I7x2yzGERL26QW1O6i6n8eF NNIvIcOCoNYs3Hj3U7VinJM50fdKJIsqm8VzpSZ_tg9jrWuyfPYIStWd9NSJvkIOuiIKGv56Aj5m n8HulkAvGpg8Q X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 01:36:46 +0000 Received: by kubenode570.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 6253f60a58afd2e93d882a89748de4ab; Sun, 23 May 2021 01:36:44 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Sat, 22 May 2021 18:36:43 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> <9A949E36-FDF2-40B3-A126-5538E41964D3@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4Fnjcc1FNWz3CxD X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-22, at 18:23, tech-lists wrote: > On Sat, May 22, 2021 at 04:51:31PM -0700, Mark Millard via freebsd-arm = wrote: >=20 >> In general these figures are approximations of the low >> bound on a buildworld that is a (near) no-op but is >> not frequently approached in my normal activity. But >> it is rare for me to update the source tree again >> and rebuild after only a few source commits after >> what was originally rebuilt. For such, sub-half hour >> rebuilds can certainly occur via META_MODE use. >>=20 >> The context happened to be the ZFS based one in all >> cases. Still no ccache use. >=20 > That's wild. I have to look at meta mode.=20 > My use case though mostly involves building/updating ports with > poudriere, and I'm happy it can use ccache. >=20 > Am I right in thinking meta mode is a buildworld/kernel thing only? = I've > only heard of it; I know nothing about it. Yep: buildworld buildkernel only. META_MODE does not help for after a "rm -rf /usr/obj/*" sort of clean-out. It just attempts to avoid rebuilding materials already present that are sufficient. (It still builds more than is strictly necessary: Some of the dependency tracking tracks things that do not actually imply needing a file rebuild. This is why installworld to the live system ends up leading to a larger rebuild later.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 02:05:56 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C4803933873 for ; Sun, 23 May 2021 02:06:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnkGM0yvRz3hfV for ; Sun, 23 May 2021 02:06:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621735561; bh=oLvKZobZjADSW25zISis9qBDMD2QuQXtNdL6Hhf+xjY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=bhfGvPQoECz8T2VyjKV06LQrmI8wuhIMkBPEiWDRfz6zr747wjgwW200hpU0wp4QR41kVwqTL/wTDR1N1TLlm/JacSIXndgv4sNi99WGQRjeDRe+EFIawRA8MXx1cONryywafTOOEpDwjsbUa+C86ZW9bXsPUgbUfpz35p6q84+WTLMe9lCLkZ7YSjxVaW2ggTTqgxrI6NIGUQpkHiWap7P6BFenZR6kAnIKf9myXTQ70CDA0r6bJ6kM5h42xpnxH5j9AAwSkRZGxg1xVMsY1uwWo0wk5MfQF2dPYdhER0K9yqSekfHh23x6X6wbA614RtRs0ga3pVjupbzPYXUo1A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621735561; bh=e2Mr4vO1VXsB0QLSjnJZsR7CTTJFP9JVTcpUjg+ts68=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=WhIJPaPem+vL2kwTiknAdMhLpNMERm8QFdKoHFctNQ1DBPbg9nP1i47AbpyBlXWEA0wKo3JUIlaYhdZnABTAiwxJiMTdXVqhQ9jWxPkJTaZ/HWmOKV9HpJhrisG09WPB+d31+D5MAZE2CYvhjWHFVL2oFab+DmCuySJ1U7bXV6hFnZS1QEZEwCRWNqBZSXuwrO3N+H3wmkZwF8edlVIzY4mOwAPeeZQA9Gbeq/6LTX3aICHw/n1Ozvs0L7DrtcxdecpW3iwqjBii7jS1SNjzhllCRsoAgG7FE+kZSv8jU6/FdkA8hjm2lwyQBGnFFVbMyLWTMoO+ndoCkmj1COcQyQ== X-YMail-OSG: cWpcy2gVM1nw9weotxCh0KxFYsJSX_tf10kvXoMNFyyAVcEch165GXLiR9.UQ17 fZ_oy29KWf7UbBOIjeKVWxmJyTfL1VyQttDYjyr9aODuItvZ_bsL4XX.NXhg9PwDDfBCgfS6o741 VBc1MTFYWxUM7_cF5QEGW8WPt8C6SfecFMduNMMQLi4UYP1ekFOd7dcXqmpKEWZ.HvzIsRNTfsDt ONwjHhmW8nLZr0mPpDl6OZvwplMv5tpUWp5X84r.Z1d6hxp08zqCB1x4_gkzGZ2yUtKbCjQ8.LC5 N3.jshUY4gl.oP7C4HvCDLwAVx5RdRB3qWRS8ebGwwvjAeCBNDW0jUIcfX4.zxNDPBL3dLItSVis ysVh.0zhBp30A3tCXuJH4HPURH10kfb9TG3tiv0jlrKAFEq1tc1k7fjoRMYbmDAmHOq6SqLEgELh N662wAkkdaHidst.2SnT6o4JvxqzfQCfwXwKqkhaF0nnFYMrBbw12nAZwuq5FiYRTmN0nTCU.2WL M2feie2Ns3m0iIUAIQIk_Sa94jY45NpWAIOrQrKsOrPP5M3zZwUZd2rCfdC5unZantctLxQLBFCr zwpEh6KgQCmMKvsWp21UMDr5XxVOS41cp4..2hAndRQ2jpQuZEwN01IEMfzVSfDTVJxIuyZ2Ed3r cMA.8vJ12I3GKZaEZOGyBqqeDmLzItZmznuBu0qlsE4_kvsddWXHBUBkPpMEcpqgbNKDiD_eSyZf f5t8LGrLr3ofqJagmvCkknGxQpC1K4DaSFxUHp5zNdp7AkTooMGNAusD07765PXA0UjZuZol8hMR 8om6oj6WSCKfJcfAce4ixmf_BamynvNYKfkhAwMlzxaef4brjpAyRZa83GTPUHEGOAdntsA5m96L LFm6STFa3NuNw.Pro6Wp_WUQAggUfWjX.hhwrIc01LXrf628fVLQnC1TRKNAEzk2L5GiJ96Jei.F ht5TisKC58PU3NCf1LZDZEr8Pfm98CSrgVZ4NViIshy2Iham49GdHk2Dt.PCtePIck_AviP3wSBr zJFKbn.cu1BUUxZWN0RiWtm9csBYTaWc3bfuppaOqQtkxWlo71aKNTovnoDxmyer8LbFwFXhPelo Rj_mxcdIP5NIMhVULOblBChuoWreDuPxM1lVmas31Y0XiP6.5jWZe4WCLINWu4kgPRce9r2jVagn uLP3MUbL4RG70THiipUfAB36xB3hlGNEQ3eYeo3lAQBD5r20yI4Kf2UT75uyaMay7.VJIrOg6f8p g0IiTodDwoZVTdzFEfRJBQ7isDNBthzP9P28YHf8qx0LWGdVS43vkGxAdViWjxQB_Jmvzz5kU86Y O2yHbFo2udZHcAajOiFUWv5yMDD_U740ue.fgpvS_R5cSZzVsERW2.h4uIJJvTsGyd7lAGoZ6MYE ssNcQK.o5GuEHajwCtKMiEqk2kCiDTK5EJOhAOdRjq5R.1MylCDBnrfMBcIICUqwxYuubaaOlqFa zIqLtUWpcNlaapyzpWLJ9R.hDhSG8CSgRMiZEmhXh2hhjmFXoBHCHkxWU2jjmUuh324ui.b2iQZZ WDOXAtLXqrj1mM6E_BbIBmWsR5qk7GY9WhgDyAI6FISerN7IraXovhek0xCJoyPxY8PKapsMJPu8 rzjUpUzweO1ZRNNzbIvgnCJqTZ2TntT0O6N9cHd_yRIBAsKj0RbTUqZPs_R7JQZvJYhSkF4HHA_A c6my6JHQ2uaSjBYaf_q3J0cBNI_26ugU.ysHpqWayXQ4Qyc9Qk8iKgAmkHWBweakXxxKw98LAfNo d90mMXb9FhL9OuUIoifwNsXbR_JPdQ3sP0ZF8FLpIwjjORWmMwKXTemGGCuhX8G4VKxxhC3rCzyY DVeIkV6Wx89LnQqRvOSBpnG3MqpuF32abLPAx0e03lNYC8NDpZ4Y_L4a4yNHmBRgxHeuPb.sx1ic JJu7Eoo9U7hXDuXACV2xbPWKzb57ZdbN_luKpaB9vso7BUtEhysKY9V8eFu8PGrXgqxYr5gQJFBz .fEB5hgpuZYQH0oDb05kGXEUWOjyQ6uTTFsyiuXrMU8OmcMvkL2T_v0fEdQjcylI9bhpAkmceMKS brXVqKyaf8urX4C3yUXZGSWYd5k5Xj7_SvGDZjzzIp4ROVaKn6em16vDw53TxwFqhIfjmX8r3VAr uqDT1cP_CmMzYxziPml7D4Aw0eW7MU1aTjvS2Nwo3HbRoK71A_AYXPphxOgfTyK95hBDa4CSObXt USPCoO5uxoAN75qb8mayKljtQjmmlhQ80pQ1rRQOlhTuaXUaf9fr27z8jY5PexriRavfYYfgZCmQ NuRZtCxWXvTnzPh14gmLU4t3hdNMd6JqkxTHwIbImKRqtAI6vEVG0RHzxsnksiSxJ2zOUv.kNxpq TEOqMeRsYfi1z_Wvk1SIVQli1YSFyHUX3dy33zUyxZtYCBqHJOXunPT9k1BoajjhPSk49tDe67Sw S0tOppQxAsH6GlV.D0KQ5ww.AWFpfKvKgmXNf3inMs_vU5PKbeETCP.N9JKFD70DHPYSogtcGiUB DrVBy9Amz X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 02:06:01 +0000 Received: by kubenode527.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1979a7c1b62c85a0311f011e8d5216de; Sun, 23 May 2021 02:05:57 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: RPi 4 build time In-Reply-To: Date: Sat, 22 May 2021 19:05:56 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <508F89DF-5CA5-4608-91E7-B232708BDC7C@yahoo.com> References: <0299DFBF-5497-4A06-978D-13E4FBD8B5F0@yahoo.com> <9A949E36-FDF2-40B3-A126-5538E41964D3@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FnkGM0yvRz3hfV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=bhfGvPQo; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.31:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard On 2021-May-22, at 18:36, Mark Millard via freebsd-arm wrote: > On 2021-May-22, at 18:23, tech-lists wrote: >=20 >> On Sat, May 22, 2021 at 04:51:31PM -0700, Mark Millard via = freebsd-arm wrote: >>=20 >>> In general these figures are approximations of the low >>> bound on a buildworld that is a (near) no-op but is >>> not frequently approached in my normal activity. But >>> it is rare for me to update the source tree again >>> and rebuild after only a few source commits after >>> what was originally rebuilt. For such, sub-half hour >>> rebuilds can certainly occur via META_MODE use. >>>=20 >>> The context happened to be the ZFS based one in all >>> cases. Still no ccache use. >>=20 >> That's wild. I have to look at meta mode.=20 >> My use case though mostly involves building/updating ports with >> poudriere, and I'm happy it can use ccache. >>=20 >> Am I right in thinking meta mode is a buildworld/kernel thing only? = I've >> only heard of it; I know nothing about it. >=20 > Yep: buildworld buildkernel only. >=20 > META_MODE does not help for after a "rm -rf /usr/obj/*" > sort of clean-out. It just attempts to avoid rebuilding > materials already present that are sufficient. (It still > builds more than is strictly necessary: Some of the > dependency tracking tracks things that do not actually > imply needing a file rebuild. This is why installworld > to the live system ends up leading to a larger rebuild > later.) >=20 I should have also mentioned the other side of META_MODE: It is there to also be sure to rebuild things that do need to be rebuilt. Its rebuilding more than necessary generally avoids ending up with insufficient/inaccurate rebuilds. Between ending up with false positives vs. false negatives, it has a definite bias. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 03:19:28 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6ABCD9F7085 for ; Sun, 23 May 2021 03:19:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-8.consmr.mail.gq1.yahoo.com (sonic307-8.consmr.mail.gq1.yahoo.com [98.137.64.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fnlv92Tvfz4n3v for ; Sun, 23 May 2021 03:19:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621739971; bh=wUY3/6aAX3+Q6fMpgT7Txfl9Vm/01PaaLwwPa+cYaBA=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=dQBC0XQ+wIB/JksaSfjccBrTmSFsPoWnQrzOcmaFt3U0LX9hBb8QHv8QtpQHlwjGFxxoRDB1dWt5UhZIomQJO3OzHmTygftrRycyUCmuiVWjLR8YjRgpyZYa/SYP8dwLxVZG8d3IDrXeVQxkxxPx6tAUjN08+zpxw5Dx85iYw8YHvIkYzYkRA+ivXpcHgxSor7sFqE/Ho3Sr5FZYCZinS2Z0Ra+9bAeNOifnecn+I1OqEkmeS6ADoyDUFW8cLONCRZ0eptu0W5Vw94X26TUp1aP1r7J9s7NgPcMGlX+GS0awVAUY18pGejLo3BF6uxb+tT1xykAtNUDRk6gCz3AlJg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621739971; bh=9suy/MIR9OWjNMozuHUqKJpbQPf1XnmsZUDfGSnUZDt=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=itsjZEBjLBC2CG3OIS69eQRyJ8cl0e2ZaN6sconMzmVcJ8ZZdp7SmPlnR3Y9SeMQAR1OQgAs17fxbo8ds1lDdwOW5zBKBDGHPkkZt5dOkKkvV+bElsgyOgQ6mY9AkwGSgOETNFfkRPES2BSqMcKFWBMfvxJL443BGlIqmyTlmE+wp6I4kEyboYai4tAgqQ4jzeGe9cigcPJ+SMvbZUFAcRSCpprbFm6f+qn28uA1maheyxr9+1w/60NEpNrdDypKq79qfKED9BRvifTYFQNV6TVkOf+niZDYLL8XczJZNm9R3Q/dvGChsIEzdH0ZQDQHrxYEJ8//Wbz4eRIUcQAuOA== X-YMail-OSG: Ub5py1EVM1ki6nhAVEnCf75pxhLMgfv5PHBN83pG5oQ1XtthugeySGccLPVgm5X qqL4CnxEJVJvWQXRnwU0Gp4mdO72QfleX1ecgc9LM56W.DwVTiSyVr.WnzxivjzIQ9sqFRxUcbmG wyj47VpLe8PFRufWJEh6f5iOgIyRJ1bZjkODWa.kRAjQ2jFZkuKfkBWkST4hay_gHo6E0m2ZHS1P 48ve.lR1aLKdxdo0lBHjgr7sIthwsEajODSdkgXniUQwFJC.r6SAR9bh1xV0BCITdHXmamEc_O0D iD9VKh3O5N05d0i2Y98W2JSL9rIZ2RMuR5.NRzzmh64mfBLa2OUhG9OFzmvx2GbAU1tDZT16DNyI 54kgKJqsALbwZM92uO2UlIRMaPQ_2hRoxOjlRHcdRFtgk8MkPSCNzE2gvB1N3OMq07rdb6l0NBIl I5.y_FJLM4ZnEpHWyrbYBXuU9AfIWxritk2ggJBJcLi8Q9PeU0B7SPpcQ.V4EwBdWR2.Hz4D2zjC Jmfcdr_sbvgOEx9SMGamRdQ_S97DplpE8os9zphHDobwHh2LcxcBdzvAsieT9_vDI9fBODFuOyru EZkrAb7dxHfX1dOQMiesm_8l1SF5VJPqBa8.n6b98kJCvjnW72_v82ZFQ_aaxHNQlXcbQ985wrH2 onH8HStBhr3iFz1FzcQdTDeUC7wfHYDxUHAQtoY8UUt1RKUGnKOq9GfjkxgQYjAzRVkw.RoyGqmD F1fXqKJLvRPVHBtIGJvefUY3qSmKdhkfzEioQGmHiOQ_Lf1Xzi6Ca2lTDJuuPZXg6B1K3p0n669W qQT78EicZUtjkfTYf84HbS57kJoUV.SbG6_mFfPBJin35hyNeXj8mEJYInkGksMVfNXZt1Cf49pU ZToB6PMS7FrxUcJEtJawG0vhHxUQj.nLBqdoXCvX1Z2CXPOezPHCOmR7023XyvBzWQqOErvcqlhG UrRoZbq01QjVB4A8.Gw7DpxB3vJt2DlJp8sOhnZrIRNFvo5MsuMImBlgQxy08OxYsGUfcc1esPGC zKfMfmKB4HgqaXx06FTZx02Z4cA2Osvhikif4k4.jZghW4e6zC_IpkzLeewKgxdgrQ7Sk.LBrdLN iYhXmKNLhDEZCoKm1eOD_LBtz5A70GBx4XFfYNb9.Q1dB.bUVas9YrU0U_8M9eVsQtg8FSSz3t_h L0ahHA4pb9cCL.ddJcOHAaFwHimLLJeMig1A5km4HpwPd1ztvphyg.ttZtjisTABks9WcFUf89QD o3u9YDQsu6FKyEIXL2tqRL7SjsxbDjqUN06Bw224BVTUYnR83r_cLFxR7yJMUovvZirA04bxR.a_ epE5PD9UW.hUBFYoq6hqeqft7hlOD_U0WjyRyVnE9O44RG7bNol2_r5R707x9WWpMPPphATaS0PL BIE_7xHJWlgetGlSlvvFAbMtyl7netbb10oniBkFTv8eLmlYfVLtAU3WQyo1CxM95KXa2aXK2TR9 B5N7PCF94LJuQuQwhd1ZivMNQOxLhjogScNY2jUpc5q4MaoyAE49vYD0SwgExUmn9VNvin_XZTJo BqawhqFrMnW5qri1b9ENf6dz67NhZRKnj8jjOWbmz8TsI2ubX0OIrb8ahp801H010M5KcVrOZXwM JoiN0VEHXT5Ka.IsRYhRQmj0fCBZo16YYxzaRdhgVfwY_lIq4Ta4QjnjoiFKf3tnNAo6_SI4O0o9 88u7wwkASBvbpUhdA1LXKAYfPRBhXAg47MRG_T2Qx28CgbWq4Rwy33fCx0C2iyCEPtd1Byw4p4Bp 9nOGBO5bL3sdVL9BpfMUJNkeikxuFp3.j9cWZFdr0PDEFJG9UHJTyhfT9Vxk2IVl0NskARjvaOFI ZkwSANmOloCsQAtsF93CaNM1om_D4xFEcijaiSTI.3jfr.tL8xQ2Pk9wMgOApDN5kCx.tfNX8oPT Tb.eCmTuiMyAn.DLwEdBJgAOHHt4MysDxAkaIO4OfOME78iKekJQqsf5nIKCM5yYhfnq8CZpHF0t s_GdTe8LRFQ_AjJo9ZqKfV3jUKNW.5uYWmeb6GDzMCnPy9dJQAaaZqZfy7wf.d7y0cTJSvE_RG1f _4gE7flmZTY9_Lj7RtriDl_vspERppZmDasXprHOUSmjc5t6MVNRMb.LzU9m2W7irH_7DH8tnBiv cKwheFQxzy4fMzgprllEiUAZnjbWODok1uR.GkbNu7Py7cl3Gx8pRteFyr7R_diI829m6bChapPt C6bXU_tAXe660m.CxrK1qSdIbE319QhQkxmJ4_G0MFUzBvayDjOQJVPOWL7opPxjY0gJto2LtcmH MxJH_mxcv7WOW0J3tCVfCm52C7DSKWlvcmPgg59BDPdzG8eiBkCrsTWzKq2K5ZbGiHk7hFiRXPce sv8XhqC8ApUFCqaSDTvMuTQ31UKILdhMMxa33n9aAw.0HEQg_lJvRaQsPdLZAtnUOL0HZs5SZ0zJ QWS1UvOdNfgVXGzKWOl5P_0XxDJuncB6Vy4Ni5QkQH5qjq327HEozcnC5BGpARSqBvqWLzqayVKj 1eZcaEA9VKCGs8.Vq5_wIP59QBay53xOUd8Bz.q_YyjBbSvfWx8H44nPMKDVM_wrytZbL_1vEiNF EIv0tSyuSm_Ym3sU2eunQTqul1xn_97CsW6xljUiSrZr0538e2r5uWkwArGq0cYY- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 03:19:31 +0000 Received: by kubenode564.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 8998ddda55011afceec6dd27b123cce3; Sun, 23 May 2021 03:19:29 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: FYI: Example USB3 boot failure on RPi4B ZFS-on-root system booting main: uhub_reattach_port notices involved Message-Id: <681FD1BA-2796-45E2-897A-28C749E80261@yahoo.com> Date: Sat, 22 May 2021 20:19:28 -0700 Cc: freebsd-arm To: freebsd-current X-Mailer: Apple Mail (2.3654.80.0.2.43) References: <681FD1BA-2796-45E2-897A-28C749E80261.ref@yahoo.com> X-Rspamd-Queue-Id: 4Fnlv92Tvfz4n3v X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=dQBC0XQ+; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.32:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.32:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.32:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.32:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard In upgrading from (grabbed from a system not updated yet): # uname -apKU FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 = main-n246411-a6ca7519f89c-dirty: Sat May 1 19:07:50 PDT 2021 = root@CA72_4c8G_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400013 1400013 to (using a debug-build variant here): # uname -apKU FreeBSD CA72_4c8G_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 = main-n246854-03b0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.= aarch64/sys/GENERIC-DBG-CA72 arm64 aarch64 1400013 1400013 I was initially unable to boot. It seems to trace back to getting the uhub_reattach_port notices in the below sequence: Root mount waiting for: usbus0 CAM Root mount waiting for: usbus0 CAM uhub_reattach_port: port 3 reset failed, error=3DUSB_ERR_TIMEOUT uhub_reattach_port: device problem (USB_ERR_TIMEOUT), disabling port 3 Root mount waiting for: CAM Root mount waiting for: CAM Root mount waiting for: CAM Root mount waiting for: CAM Root mount waiting for: CAM Solaris: NOTICE: Cannot find the pool label for 'zroot' Mounting from zfs:zroot/ROOT/main-CA72-dbg failed with error 5; retrying = for 10 more seconds Solaris: NOTICE: Cannot find the pool label for 'zroot' Solaris: NOTICE: Cannot find the pool label for 'zroot' . . . mountroot> ? List of GEOM managed disk devices: =20 mountroot>=20 The USB3 SSD was the only storage media present. Port 3 apparently had the USB3 SSD boot media (the same media that the FreeBSD loader got the kernel from before the above). Cutting power and starting over did not get the problem again (so far). =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 04:44:22 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F1D4D9F47F1 for ; Sun, 23 May 2021 04:44:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnnnC01Bvz4X5Q for ; Sun, 23 May 2021 04:44:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621745068; bh=h8lhi9VGQFjMSKJ5Ij48BLy+oq8s24/zGTS5U8Frm78=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=QQxXOyubuym9H+rTMU6H3m97AImFhIjNGF1RjKGyY6DZMw/s98t6lr3lpC+Bb6Ps0q9MuojiqQv050qaq9tcx24lqBaM7VCgDy5+Gmds7YTdruIH9nEEIEOteqAvaDeksHYimdKXjZqlSZV/MlOUicRK0D5bvYqFtihiI5IPq9S1TVcYr05T2JPZezLZnsznIMtUTqnAi3Sk9Jns1hEtDFo+TA6uW2jKEB3pxKBOHWc/+MVQPifunoptQugVZn6BVdGByzlLjVEiFAAblfFo07rV8XB3p4DjNTb2SyaZyn+4vGnHMFG+pBRApGiOcNj0a7vZ+wdL/GVwyHARR1/R1w== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621745068; bh=01ACMmVdFqqr89Qh2xkFkgBWXK+0Aqbaz1vhYbkcF4m=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=pY/mFZLDK1XvsQY5EKv8LvcpMaUT9COiZMt2sLaowf8ZOxBDqcFjJUOuJvldf8ikWrz4kwPa7Afs7gd7xEy9BAf5qtmn01p22uDb7jD5AWRNQB9n1E7AIqAEiy8IzHpMJhQUUJTvkI+fq68WtwBwHvxPup0OjJyiLHoYB5Bw+ia1GJVZ0gFlYSh+/JFAEuepNqZsdr2Pw/nTdcjisGnK7PisWfuGLSqtNBDtF8nlBe2EVS2ZEh8ASiSzSvraT8mSa8LOzaLNyK4kIv+b0LIMNlbGhF3KMKWBFG8v9GU1ryc1MQGwbGb+HqgWvkDiE8M4SzoO0/KyEPX96WrcTTL3KQ== X-YMail-OSG: DesjV4UVM1kUlzOqr2KFNY.61tK3Rx1KxyCLHr3naUZBNEvNjVbmEDg00zTiC0x ux_iKmaLFDau0CIaudKnSrgbpZ8VDZ_m7dNQFQCmC_bbNNJrjPaxCwAoZfy4AXYf4tHjz6sMbeci TAvbJztRh7P3CY_Wl1VFn27hosBkXd8AR3DdMIneMN4eUh_tGAAAXwE0PHCYP8VJHVu.FmPfSOvn Zpmd7plLXUpo57qoeNQlD50RVQ8HtPVRbMn_U48U74laC6D.RiTWvCuZUzDqhkKIw_AjJxH73HZJ DOMUqqYbVoncNECe0r.yzAhWgb4RjuhOmyVdhQ.CQywUBpXMIScKEk5vE6K_FI2gEIO3gPVyeOHo 65sN.ZzvKRDU5js2Ux53_hMfkTR0X7I_.1v3oxB_OFSw8I93OvO4ia5cL6j.Tk7vVI5pjO52BVAN Yr6uiclEKdXKVS4HY2z9sY.vkhmlZLIG3XZfeAVhWdsjQu6F201MzrkLNd5f9PPnQkTYSyNr.z4Z m8bLODEqg1jC7bha65y8vZH2sBGVIICOk362B8k1d5GxIOXBPzluIYDqZKTUgN978pWptaz_8rxM zbF_wc0Ap0ZflKkjy5j5QIwFgvkMpFwqQ7Q5hG5HhiwnhpgjpJjky6._Us65.40kSPqB.zY4Honq _H8IWA5h80Tu5WMTWwEi.vXHnVIsO0Nhd683uL_J28Z00OzC1vJvAlWUZcCO3CNTiEmNovmRRC.W TQQfZZXHwMYZZT.YvXJ6YAJ_ZoIGJY5.WJX6lD.DxeUQ_k0ia.alEBwgw.Jr_1B3KNQpAKEJMgfQ y6hIIYrdFKOVBnqD83i49E0AUTB5gfi1EnSwpSkdVLoNZPw8ExfoOzM3918CYH0x8jB2.PS8KGgw R.RHVQrAJBXv6NEgCczQKgFE6wO0FK19MW7o68VOcFtcjIFFo5l5aVWgRqGaT4czzX_QhKNki0YC eu7KTtIDjTY_tEub5vGLlwrpHINwGiOVTjv8NjREnWsND2uSXRqUBUeHMuTc_ptop2aFmIvNDN6s K7tFVx5._REviDUwXAYvzYTuCh6CvZy3zGovX9siNgGBwnHLS4rrEl0Emy6La23P7xRY5Miw3iNU gWXM3Wj8i5h7iH1oZ3EFUWIdzf3BkR1Ml_n97KsR.x99EJstMcqU3Pvbmn4S64HRB6eern.78gQ4 qmQQzdHltTSJ6UA9YCwWUEFzzI1qI_jDIPqtPNo.8PVERs96oeBqIb2uf5y_dScjyU3GFTIaB2Yn vnTm9oVNWi1tk.WcJjjyDwibWaJXQ6FOfTHgcu3I7G72nUqBTcjmuWZgNFS3Wp9Zsvpp6mONmklr BbSCP_UpxF5Mk35h9z3xNb6KZA3X1nx5gwr.ot8dhShSJiqT0e.7BmJMpYvuWQ8_7Qcyxto.0vXf IRKJf9O8a9c0fAx_t7qQzUXNSKioO2rfoCsRORqcs0.1W72Ypmi1gmQ1gdfzZZhY9XDijxBt9IWn hfGfhM6u5vUkR3ZDg6w.QHPO7wTjhI.ii1TdMjjuxWp1CJgoTDKGLsrqjadlz4jtdVCI12fSWt1y Nt4qD7joDpzjNr2o6fQSwWI9s9E6_seDmTzN8YSAF_CMfIAgpLOTm0n.XJpo0AxlHyKXIjLUdPNq JEgIXJ_.UbkfTAoOtwDw_c5HhgcD2bOBQT2HVOvvg2aGTEstgxoU5MWAy82M5d2HjTFHjD0yEgmo HbJ8c83EKTpRHSiT_PUEekHZO2c5Jri9hyfynaPaeXITUXlYEEvrtlLMj8..uVw22U9fi2GaUOcM aaOuJIn30NY4KLiqz8Kk9WSD80KxppzzG9DO6ijhgmxtoeKCXgrDv.J3Y97q46O75WfWTGB_.ezr 0eWZrZDrbfZcljs9mjgSPfUrS5MNIP3VpobcYRru2LoMcAv3VPuW50R5Upg6cYTR3lvm.tKNOtUU X4pw5SaD31apmEDOcVkD0X9CgFdfLVyOMdKMSWbWG0zxui96kLUq3DgzDNnvGtk3bqFeFiht7q2a 7Xx3PWsri77Qq_GNxlY0RGWdFm57uaOyyH_AkfIu.juDputhDseFedi2wBtFolHWOeUl_Pj7eog9 wyZU.yNMM41cbTztzkXuB1djQ2P7VpjyZN0NtK47VO_i.XZT0MeWlFWrwV821CtJtKIc855oVDIp SGBrkAXL2RjAf9h9ksWEWdCueB2AVhf1fMQhE5v_4uojVzoWP4VStsE8iOGvN5Y9BeQNbJTdNCIs 7VwJ.EXR2FtBTf4fR1rbEwS1C8xWjcTD3UClD6yebrGziuQ_gvyvTXt5uIkHSeNHgj8c2vsDS7TV mtF.1hjIt8_BnP95KO3uZ6oFqH66m4KkawCZpxqqe_rLUNzUI_X0PMjNz5FIATyKI.WuFH0Sgfy6 OCnnOjfKBZcQUS15OgW1WJMFv6TfSY1EVnA4Z4FslPfauWkasOmgDS2SHcApX3n7gE7dEZKmwX0o 6itUj4gAE6p35DTasn.evBv2FJ6ftwtlHX1kOVj9BFEdBw15LJaqNI8hG5WL8jaBHQKnLg9J7RNh vovq7mS4T5nMY4FGQBFtRc9VodqatQY9tHBykPSOHDdc6otlDqqAuVwua5zj42A-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 04:44:28 +0000 Received: by kubenode524.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 7c16d8f57e0774362519e50201b7eb51; Sun, 23 May 2021 04:44:23 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: I got a panic for "nvme0: cpl does not map to outstanding cmd" on a MACHIATObin Double Shot Message-Id: <063D5E36-126F-497C-97AF-827BADC1ED2F@yahoo.com> Date: Sat, 22 May 2021 21:44:22 -0700 Cc: freebsd-arm To: freebsd-current X-Mailer: Apple Mail (2.3654.80.0.2.43) References: <063D5E36-126F-497C-97AF-827BADC1ED2F.ref@yahoo.com> X-Rspamd-Queue-Id: 4FnnnC01Bvz4X5Q X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=QQxXOyub; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.84:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.84:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-arm X-Original-From: Mark Millard # mount -onoatime 192.168.1.187:/usr/ports/ /mnt/ # diff -r /usr/ports/ /mnt/ | more nvme0: cpl does not map to outstanding cmd cdw0:00000000 sqhd:0020 sqid:0003 cid:007e p:1 sc:00 sct:0 m:0 dnr:0 panic: received completion for unknown cmd cpuid =3D 3 time =3D 1621743752 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x188 panic() at panic+0x44 nvme_qpair_process_completions() at nvme_qpair_process_completions+0x1fc nvme_timeout() at nvme_timeout+0x3c softclock_call_cc() at softclock_call_cc+0x124 softclock() at softclock+0x60 ithread_loop() at ithread_loop+0x2a8 fork_exit() at fork_exit+0x74 fork_trampoline() at fork_trampoline+0x14 KDB: enter: panic [ thread pid 12 tid 100028 ] Stopped at kdb_enter+0x48: undefined f904411f db>=20 Based on the "nvme" references, I expect this is tied to handling the Optane 480 GiByte that is in the PCIe slot and is the boot/only media for the machine doing the diff. "db> dump" seems to have worked. After the reboot, zpool scrub found no errors. For reference: # uname -apKU FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 = main-n246854-03b0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.= aarch64/sys/GENERIC-DBG-CA72 arm64 aarch64 1400013 1400013 =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 05:16:02 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 874139E2869 for ; Sun, 23 May 2021 05:16:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x82e.google.com (mail-qt1-x82e.google.com [IPv6:2607:f8b0:4864:20::82e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnpTp3CZ2z4nJp for ; Sun, 23 May 2021 05:16:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x82e.google.com with SMTP id k19so18390689qta.2 for ; Sat, 22 May 2021 22:16:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=SvAMoHMEhRAJ8ppLYI+d4H+hpNUZbR1nIyYxsviDHYw=; b=u0QacXdc47LNhYULjhq03U4Sk5T8dBvpsSSgDN0rG3xUy6ofvZsB2RfGwc2nmHOVT0 yV8D4YCM+H6ToUyPLCI/eoiV/rVKKCHwRAqQ+FjjEMfzBiR7nk1CL4wP0QQCmJgJPJyI iqq9/ucN8AFtcvBHFmIH5OFDse6ZROqf69ssIKo2yUirvdoRsFcxHKNvwnYT882BoM2g 17tJehrN80JagRHUkt4hwMImlo8WhF8OjphqcBHcL7as/KbLBWOu8IB7Xss23uUiZNOU afTdz9z2lsfGK8u+S3/zYfPQ74CI2afQur/S/aG0FEagCaWgmHK7VFgponhvMzruNNd6 1IBg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SvAMoHMEhRAJ8ppLYI+d4H+hpNUZbR1nIyYxsviDHYw=; b=UQAA4WUIuCbe2HbsYRAPrnIRvHzx/NvUA+ReGzd3h0QrVPFAlyNZAWp4NX8zUyRbeQ KfBBSTiK68PFtZiasW4/Jzv0/oxa1EKua4ORY+YjGwICCfjlwyffFaeMPsItrCxHHAkp Eq/8+ARfG24CHbP6R2w+fJJVzUon9ZpJSQjl/xLWq2qaMzEApDIqEG5ocEa8nXiliLpS 6ssoN1XH1rf4z+N5szRvKTbMMMGt3CSu0vWuS4spnJ3gwYfrbQ6vNrXziPJ2th/HV0SG Ub2UBsvcvR71qAvYE0Hi+kwm9ApRV3tC7a6AzTTCqzil+CV4clN/0AW6q9z0qQqlBwos HDtA== X-Gm-Message-State: AOAM531tPEeuo9m0McQjhYkExY4T23kO3O6dSvCJQK9atyt4ZRtD2eyu MUFuUG0JlLcGC45lJ2gP2JfbwGhCOyYOzJrOQz8YeQ== X-Google-Smtp-Source: ABdhPJwBiXieBiGdGe56bKJR7j0tD3HXlMl7talNfyMNUVHpYnJV7ehZUnbJ7ls/3RZ2bXsFFAZEvKAImpqMjQ7NRCE= X-Received: by 2002:ac8:580b:: with SMTP id g11mr20068335qtg.244.1621746973337; Sat, 22 May 2021 22:16:13 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <063D5E36-126F-497C-97AF-827BADC1ED2F.ref@yahoo.com> <063D5E36-126F-497C-97AF-827BADC1ED2F@yahoo.com> In-Reply-To: <063D5E36-126F-497C-97AF-827BADC1ED2F@yahoo.com> From: Warner Losh Date: Sat, 22 May 2021 23:16:02 -0600 Message-ID: Subject: Re: I got a panic for "nvme0: cpl does not map to outstanding cmd" on a MACHIATObin Double Shot To: Mark Millard Cc: freebsd-current , freebsd-arm Content-Type: multipart/alternative; boundary="00000000000042ff8605c2f864e8" X-Rspamd-Queue-Id: 4FnpTp3CZ2z4nJp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] --00000000000042ff8605c2f864e8 Content-Type: text/plain; charset="UTF-8" On Sat, May 22, 2021 at 10:44 PM Mark Millard via freebsd-arm < freebsd-arm@freebsd.org> wrote: > # mount -onoatime 192.168.1.187:/usr/ports/ /mnt/ > # diff -r /usr/ports/ /mnt/ | more > nvme0: cpl does not map to outstanding cmd > cdw0:00000000 sqhd:0020 sqid:0003 cid:007e p:1 sc:00 sct:0 m:0 dnr:0 > panic: received completion for unknown cmd > cid 0x7e has no currently active command. The cid is used by the driver to map completions back to requests. So, there's usually 3 possibilities that I've seen this with. (1) There's a missing cache flush so you get a bogus cpl back because something stale was read. It's unlikely to be this one because the rest of this look like a successful command completed: sc = 0 is successful completion and sct is a generic command queued. (2) We're looking at the completion record twice because we failed to properly update the head pointer and we've already completed the command. I've only ever seen this in a panic situation where we interrupt the completion routine because something else paniced. (3) There's something that's corrupting the act_tr array in the qpair. I've not seen this, but if something else smashes that area (zeroing it in this case), then that could cause an error like this. Or it could be something new I've not seen nor thought about before. > cpuid = 3 > time = 1621743752 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > vpanic() at vpanic+0x188 > panic() at panic+0x44 > nvme_qpair_process_completions() at nvme_qpair_process_completions+0x1fc > nvme_timeout() at nvme_timeout+0x3c > softclock_call_cc() at softclock_call_cc+0x124 > softclock() at softclock+0x60 > ithread_loop() at ithread_loop+0x2a8 > fork_exit() at fork_exit+0x74 > fork_trampoline() at fork_trampoline+0x14 > KDB: enter: panic > [ thread pid 12 tid 100028 ] > Stopped at kdb_enter+0x48: undefined f904411f > db> > > Based on the "nvme" references, I expect this is tied to > handling the Optane 480 GiByte that is in the PCIe slot > and is the boot/only media for the machine doing the diff. > > "db> dump" seems to have worked. > > After the reboot, zpool scrub found no errors. > > For reference: > > # uname -apKU > FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 > main-n246854-03b0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021 > root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.aarch64/sys/GENERIC-DBG-CA72 > arm64 aarch64 1400013 1400013 > If you have the dump, I suggest starting to make sure that the act_tr array looks sane. Make sure all the live pointers point to a sane looking tr. Make sure that tr is on the active list, etc It will take a fair amount of driver reading, though, to see how we got here. I'd also check to make sure that qpair->num_enttries > cpl.cid (0x3e in this case). Warner --00000000000042ff8605c2f864e8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sat, May 22, 2021 at 10:44 PM Mark= Millard via freebsd-arm <fre= ebsd-arm@freebsd.org> wrote:
# mount -onoatime 192.168.1.187:/usr/ports/ /mnt/
# diff -r /usr/ports/ /mnt/ | more
nvme0: cpl does not map to outstanding cmd
cdw0:00000000 sqhd:0020 sqid:0003 cid:007e p:1 sc:00 sct:0 m:0 dnr:0
panic: received completion for unknown cmd

<= div>cid 0x7e has no currently active command. The cid is used by the driver=
to map completions=C2=A0back to requests.

So, there's usually 3 possibilities that I've seen this with.

(1) There's a missing cache flush so you get a b= ogus cpl back because something=C2=A0stale
was read. It's unl= ikely=C2=A0to be this one because the rest of this look like a successful
command completed: sc =3D 0 is successful completion and sct is a = generic command queued.

(2) We're looking at t= he completion record twice because=C2=A0we failed to properly update the
head pointer and we've already completed the command. I've = only ever seen this in a
panic situation where we interrupt the c= ompletion routine because something else
paniced.

<= /div>
(3) There's something that's corrupting the act_tr array = in the qpair. I've not seen this,
but if something else smash= es that area (zeroing it in this case), then that could cause
an = error like this.

Or it could be something new I= 9;ve not seen nor thought about before.
=C2=A0
cpuid =3D 3
time =3D 1621743752
KDB: stack backtrace:
db_trace_self() at db_trace_self
db_trace_self_wrapper() at db_trace_self_wrapper+0x30
vpanic() at vpanic+0x188
panic() at panic+0x44
nvme_qpair_process_completions() at nvme_qpair_process_completions+0x1fc nvme_timeout() at nvme_timeout+0x3c
softclock_call_cc() at softclock_call_cc+0x124
softclock() at softclock+0x60
ithread_loop() at ithread_loop+0x2a8
fork_exit() at fork_exit+0x74
fork_trampoline() at fork_trampoline+0x14
KDB: enter: panic
[ thread pid 12 tid 100028 ]
Stopped at=C2=A0 =C2=A0 =C2=A0 kdb_enter+0x48: undefined=C2=A0 =C2=A0 =C2= =A0 =C2=A0f904411f
db>

Based on the "nvme" references, I expect this is tied to
handling the Optane 480 GiByte that is in the PCIe slot
and is the boot/only media for the machine doing the diff.

"db> dump" seems to have worked.

After the reboot, zpool scrub found no errors.

For reference:

# uname -apKU
FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 main-n246854-03b= 0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021=C2=A0 =C2=A0 =C2=A0root@CA72_= 16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.aarch64/sys= /GENERIC-DBG-CA72=C2=A0 arm64 aarch64 1400013 1400013
=
If you have the dump, I suggest starting to make sure that t= he act_tr array looks sane. Make
sure all the live pointers point= to a sane looking tr. Make sure that tr is on the active list, etc

It will take a fair amount of driver reading, though, to = see how we got here. I'd also check to
make sure that qpair-&= gt;num_enttries > cpl.cid (0x3e in this case).

= Warner
--00000000000042ff8605c2f864e8-- From nobody Sun May 23 07:08:20 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 682C89F353E for ; Sun, 23 May 2021 07:08:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-22.consmr.mail.gq1.yahoo.com (sonic317-22.consmr.mail.gq1.yahoo.com [98.137.66.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnrzL0vZBz4jyj for ; Sun, 23 May 2021 07:08:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621753707; bh=dfqgXuvHxnuPMlMWAPzNRSFYX3iYoITQFa7ZPJ8CGWQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=hSxC4pk3+qaYK5xCmPwyCCMf1jxKwlIAviSd10nTNDHki2aVRCKSKGCrdaDSbcJ55oObFaxvh5SSAgBZ2ZTEpI5PzCHLp+BPZYc/y43f0Pb9cqW7Sj3G1C94bHQZRm2/42WnXrYvj/e8IF0jQg+Zh5odvWgkYXmcS+uGHjhXr3B6q/e9x2oTpCzwZkBtI5MIBOkaUNEspoXz2ONd5ndACKU41Mmvpa1RtIRLK/bSEsdNrsdE2ysr3bZAP9DLp5EFqsiCFnrsfX7mgFGUYlFL5WzpioD/SlBe+ggiyzA1AW2KWGnIg1G0Ppv/k/OvvUVIMN+HGSkjoMO0VSJpJUCJwA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621753707; bh=oxG3yZspplSSsK28SGXBV0DV1myF73kfbkVZQJgvpr0=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=orYivNPTDvEbFUKVp0txicBK3XWxqG6t4rGdP6OM6JNVOq3ZuFTaDMBn/SB9Tww9G/T4jD1NpLJ6wWJuYlLkQTbjwn0Lyr2FnFWF6kpwNOwIjP+oP9qIk7O0E4YKYXjrBKSFtfNGF7LRVB3p/dnONEJVix/MuQcjpUHiKQ5lK5sXqy428IsfbrxEaZtl1+idPmTAQmqyYGIVFzNqtyRAWjOVJdusJ1LSKjErr6etdBpV9d8PpIpkiirtr9X8PdQDNOi1rJC0nUc2EJkcdvNuHNSXCxKWyGo8RdFxfijYCbNxvA9pRevEnl+WYr23u/CPOoPwedaH1JcyjgTXD628rg== X-YMail-OSG: gRRWeLUVM1nHnkOqq9slDvoggcPHOQnBKuVv53T1qF1ioylaYmfd.BbuFDU6kKc xXZFDqZjIeChIFLAZr10DhE2wx04XhZLI_nQE7NgRvxpJlVsW7DfQU72QN2fAPMHHOzyijV2mqPn iyrWxGpoZGBBTUapElUsNDlFXzhl6aJ3q_.kShHq5T9vfNAkW20dqIg40o2WjpSi.xDj1kQjVWYf gE1oWuOQJQ2KK5TeOp2zGhYdbIyY2ZBjC4sClFO3bN9eMWmoYksrM_dgvTfq_qGL3uSx4eLoaCn4 7TJiVTX2WODD3sAIrRU8xljQIkxxujhx93ei1i.wNmAIAmPeV7xLiQvXZI_LLdsi8UEUvh3nD_W0 MBP95Qc_kho_3lnncfN5JtFXiQi13zElC5gTh7lGm7TE5s7LkditphleDWITmgqOFF4KCGvlzAYy wITONi79R3kc3Q.Ed4VTQb5bYQSzX27nEQuaI9o7KwhaoMMeX8A710ynEuMxobB7aVCqXYVSY9x6 B1u5t3WSxeZC5EArEcKvSV4XuhcD.S3PCMuvST.JwNmiPw.z6s09iUrHErigbBe6IgJdL1y99SKm vnNqzQb9yFs66_RdsVCyrN63lpeCn6t6_RYmzC.f5WsaSRJok73fKJmeQc3hqM5w8YUqmTtw8Bu6 M4BP4Dma4N1WXSnVy4M3AM6JHloJrU.pZOku9RPo8tEns2k58SfFDujamnVMXK5J5WAegI7gTMng kojQKl9CpGrenc8JsO1g.Y75pVkWFkM3VkqccNEobKstgl7FvLOTV1XKnxF0EolVBGDDcjTWbhMq 7QZOMVvwKtSLVT_RNDsQlfmF_isg5HECll4r4Dp2AoEKOEAU84O3kGf_JBPyN1ldqUX04vpasf_o KBlofympcAu4oiBa57RuQmyR0sQ1C54CaQMqe3BSQUXXO03khVBlZXlHBAI_GGJ6NVRXAFCwZRzz lMYu56Ns7D1rtc.k0Ujln0cxRClYk7ic5.p9Y4SCkA5ApzItrbnnDbRDkiYnbGB6ms8KWxuWxvXy 8AziY0y4rYzzdKLmnFFe_zGqaaC5U57th6ukyTk2CAe4KwOmTfvEs_Puxlf1mTevXr19rBKcr_OG Xl_iMVGAzqOEhLLVcd45kDGH.PA7X08P7bkFCxiWpI8HDJtKOjNgLV13YC8Bjy5.0k63Ip_vEzA4 tp2gf1KDDWAOIEfVRX8cCdJB0UM57B2Anddd0dIhxt03GgJAN0R.B6vKGOAFfLk3xXZE_Rk8iVp. J6xhsdC65qH3ScyYnsyENWst6ihrVXv._Bn50jl6MSvPFB8aWeG0jGMoKxpusyuLIe35JQTV10lh KBlSMlj44cj_6P_QZcWNot0pO.V_21x47nCPnowvf8j3QwkMbP9JE0fLliZRr_MoJ55ZJ0e3Siyi 3Qsxzni_Y5IKTyiKmc23OLZqoIX5HWR64TCM7hd3bgenxmy_G1EW4dJN6kZtDxYLFoAtSX7Cpnrc k9qNsz84o4mlxRs6LGQGhOjEGpYBkW8GJsKoUeJYgJOgIAivJ9QO4fGX8aLATwZpGeoy8e9SmBt3 Ziex4_wkdO1dqsbuSxxpN0.9ucxiGjv723JywuDMBMTzHfYvedrvN.0oGJto_akN0VhFM3_Oehed ruLiGg61hAwXoVDy9xew0_iBxBC3EJU12ZzDcQ04wrH1UBV7oB1n1PqBrG_zDqAQofaAZUJ5Infm r8C3v69Glm_Ize2Up1YtiVqBAS6Hgsg7JIzgK1AgTqsR1tAPLbtPuUcvtDErY.Sl.mCCxcRvbhaT 37In5yauADSlK3RQhpbJGiHCvwseuwVnHfN_0ddQPS76qTCnIeZ_detYJm02NjUA3hD2HQhDFNRr P2vqt.He0bk_VhJXYenbZUggPxtksCLD4UA.nYbS27RjO2F2rfr7lEcrD6kqHX3saHSt1P2rIYj1 uQmt4tupoJMEAFRpMDVAFe7ykIIN3zulQaDij652t1OKZoNgbQ9yqlb3L90wxKwXEaDoz3mAfgBs PSqB4BTSBBFa0ITT0iFmM.nvvlve0pt1OSiXRc3lmnle_GakIvWhx2Ldb8tdsbuBT3J1K3K5IuiH 7sZIDE6C0GLuxSfhm6v5VYKMH8O6A55CgWRQz.puCZHf8HcMaBB.manN6Ckp2fKg0XsqZae4x2de o7tVfXaoaqFSqvwG8JmERP0aa7aHLcSwDSFkn2ddjoxTlwkEmqyS.ZV7V8yTFNJ9xNqjkpcKSirv G0hZUHOWfdyXLKjxLJQwLifNslchpiNS1GUmxTsnOUVa7RfLZ5fK3.erTLG1oErHEbB.nGlniI6z e5wTi8O9Jir7I5NcG8b3QBGWx7sIRdq_MDMzVJKQeYzjnTJK4fSeGZEFZouC1KXDR9FDE1XAno8Z DTEMc7.Xk7sL1xR1mUt3Pj_14YJ15wCZXoDdSbcQJifp31x8uHu31i_noSbjyDvcg45bPrhvk_Ci iQCwccJAwi3o9OKtFMd8MM1J7X.HYV.gG7drFJzqQg_yAomW2RDbfrANAQtXx0LN4RPGJbee0PVU u0dVfOK5Bhfaj75SLxW5vCtEYG.NDSYEYv2JCgN2SA2FdAk1UGMeakA6nAUkjWj2UvT9WFZLOMl1 1OsypSFj8X8wzYK4ctMV7XpzUGMVg9GnLxZQ25_Yek47x_aFYzweIg7_WZ8gQO3bGh.F49kQYZCd 321dRjaZ3VqN4fU2Aeuy9qSDrKW_UZEejuNk5XwxWoCfvyANUlq4- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 07:08:27 +0000 Received: by kubenode542.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 0d27a10593e268a16525731768bc367d; Sun, 23 May 2021 07:08:22 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: I got a panic for "nvme0: cpl does not map to outstanding cmd" on a MACHIATObin Double Shot In-Reply-To: Date: Sun, 23 May 2021 00:08:20 -0700 Cc: freebsd-current , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <063D5E36-126F-497C-97AF-827BADC1ED2F.ref@yahoo.com> <063D5E36-126F-497C-97AF-827BADC1ED2F@yahoo.com> To: Warner Losh X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FnrzL0vZBz4jyj X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-current X-Original-From: Mark Millard On 2021-May-22, at 22:16, Warner Losh wrote: > On Sat, May 22, 2021 at 10:44 PM Mark Millard via freebsd-arm = wrote: > # mount -onoatime 192.168.1.187:/usr/ports/ /mnt/ > # diff -r /usr/ports/ /mnt/ | more > nvme0: cpl does not map to outstanding cmd > cdw0:00000000 sqhd:0020 sqid:0003 cid:007e p:1 sc:00 sct:0 m:0 dnr:0 > panic: received completion for unknown cmd >=20 > cid 0x7e has no currently active command. The cid is used by the = driver > to map completions back to requests. >=20 > So, there's usually 3 possibilities that I've seen this with. >=20 > (1) There's a missing cache flush so you get a bogus cpl back because = something stale > was read. It's unlikely to be this one because the rest of this look = like a successful > command completed: sc =3D 0 is successful completion and sct is a = generic command queued. >=20 > (2) We're looking at the completion record twice because we failed to = properly update the > head pointer and we've already completed the command. I've only ever = seen this in a > panic situation where we interrupt the completion routine because = something else > paniced. >=20 > (3) There's something that's corrupting the act_tr array in the qpair. = I've not seen this, > but if something else smashes that area (zeroing it in this case), = then that could cause > an error like this. Of note may be that I buildworld and buildkernel with extra tuning enabled, targeting the cortex-a72. In one past example this lead to finding a missing synchronization related to XHCI handling that was fixed. (The fix was not aarch64 specific at all.) For that: A cortex-a53 did not show the problem with or without that tuning. A cortex-a72 showed the problem only with the cortex-a72 tuning, not with targeting a cortex-a53 tuning or generic armv7, for example. Not that I've any evidence specifically suggesting such would be involved here. But it might be good to keep in mind as a possaibility. > Or it could be something new I've not seen nor thought about before. > =20 > cpuid =3D 3 > time =3D 1621743752 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > vpanic() at vpanic+0x188 > panic() at panic+0x44 > nvme_qpair_process_completions() at = nvme_qpair_process_completions+0x1fc > nvme_timeout() at nvme_timeout+0x3c > softclock_call_cc() at softclock_call_cc+0x124 > softclock() at softclock+0x60 > ithread_loop() at ithread_loop+0x2a8 > fork_exit() at fork_exit+0x74 > fork_trampoline() at fork_trampoline+0x14 > KDB: enter: panic > [ thread pid 12 tid 100028 ] > Stopped at kdb_enter+0x48: undefined f904411f > db>=20 >=20 > Based on the "nvme" references, I expect this is tied to > handling the Optane 480 GiByte that is in the PCIe slot > and is the boot/only media for the machine doing the diff. >=20 > "db> dump" seems to have worked. >=20 > After the reboot, zpool scrub found no errors. >=20 > For reference: >=20 > # uname -apKU > FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 = main-n246854-03b0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.= aarch64/sys/GENERIC-DBG-CA72 arm64 aarch64 1400013 1400013 >=20 > If you have the dump, I suggest starting to make sure that the act_tr = array looks sane. Make > sure all the live pointers point to a sane looking tr. Make sure that = tr is on the active list, etc >=20 > It will take a fair amount of driver reading, though, to see how we = got here. I'd also check to > make sure that qpair->num_enttries > cpl.cid (0x3e in this case). >=20 Okay. I got this while trying to test an odd diff -r over NFS issue with the more recent software. So the two will potentially compete for time. As investigation will be exploratory for me, not familiar, I'll probably publish periodic notes on things as I go along looking at stuff. My first is that the /var/crash/core.txt.0 has a gdb backtrace: . . . #10 0xffff00000047900c in panic ( fmt=3D0x12 ) at /usr/main-src/sys/kern/kern_shutdown.c:843 #11 0xffff0000002226b4 in nvme_qpair_process_completions ( qpair=3Dqpair@entry=3D0xffffa00008724300) at /usr/main-src/sys/dev/nvme/nvme_qpair.c:617 #12 0xffff000000223354 in nvme_timeout = (arg=3Darg@entry=3D0xffffa0000b053980) at /usr/main-src/sys/dev/nvme/nvme_qpair.c:938 #13 0xffff000000495bf8 in softclock_call_cc (c=3D0xffffa0000b0539a0,=20 cc=3Dcc@entry=3D0xffff000000de3500 , direct=3D0) at /usr/main-src/sys/kern/kern_timeout.c:696 #14 0xffff000000495fb0 in softclock (arg=3D0xffff000000de3500 = ) at /usr/main-src/sys/kern/kern_timeout.c:816 #15 0xffff0000004356dc in intr_event_execute_handlers (p=3D,=20 ie=3D0xffffa000058bc700) at /usr/main-src/sys/kern/kern_intr.c:1168 #16 ithread_execute_handlers (p=3D, = ie=3D0xffffa000058bc700) at /usr/main-src/sys/kern/kern_intr.c:1181 #17 ithread_loop (arg=3D, arg@entry=3D0xffffa000058aef60) at /usr/main-src/sys/kern/kern_intr.c:1269 #18 0xffff000000431f6c in fork_exit ( callout=3D0xffff000000435430 , arg=3D0xffffa000058aef60,= =20 frame=3D0xffff0000eb7cc990) at = /usr/main-src/sys/kern/kern_fork.c:1083 #19 So via kgdb . . . (kgdb) up 11 #11 0xffff0000002226b4 in nvme_qpair_process_completions = (qpair=3Dqpair@entry=3D0xffffa00008724300) at = /usr/main-src/sys/dev/nvme/nvme_qpair.c:617 617 KASSERT(0, ("received completion for = unknown cmd")); (kgdb) print/x cpl.cid $4 =3D 0x7e (kgdb) print/x qpair->num_entries $5 =3D 0x100 Based on also seeing the code: qpair->act_tr =3D malloc_domainset(sizeof(struct nvme_tracker *) = * qpair->num_entries, M_NVME, DOMAINSET_PREF(qpair->domain), M_ZERO | M_WAITOK); (kgdb) print qpair->act_tr $6 =3D (struct nvme_tracker **) 0xffffa00008725800 (kgdb) x/256g 0xffffa00008725800 0xffffa00008725800: 0x0000000000000000 0x0000000000000000 0xffffa00008725810: 0x0000000000000000 0x0000000000000000 . . . 0xffffa00008725fe0: 0x0000000000000000 0x0000000000000000 0xffffa00008725ff0: 0x0000000000000000 0x0000000000000000 It was all zeros (null pointers). No "live" pointers and, so, no tr's to inspect. As none of this is familiar context beyond general programming concepts, it may be some time before I find anything else potentially of interest to report. If you have other specific things you would like me to look at, let me know. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 07:46:28 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5A64C9EFE28 for ; Sun, 23 May 2021 07:46:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-23.consmr.mail.gq1.yahoo.com (sonic303-23.consmr.mail.gq1.yahoo.com [98.137.64.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FnsqF20fsz3Lld for ; Sun, 23 May 2021 07:46:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621755991; bh=jpUAxwPUKV4YRVE0U49BwtDYeq4DS9TcdHFLKPAKesk=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=O/e+9MhOI/b8U8L5XEeZv5jvwD/KUvzkjwLe6xFDnqGOfUknaoadrtohZR/HwIhMiDMir0Fp35FTNbQWzErMlA2NJRRYJ4MEBQvt0mi7z3igcCAvF/F0CjLXj0xGU9LJmioV9unMp901vAZd8iA0XEYvBI4/cHrlsvKmezhy0OXjuChnbKNi9GNALaiPRrkj51mEXvXKM4b8PUDhTqD0SgcyqzVv530yIZdHuOmWqjWEUodXL2Tgu0MJUO0C85X35HK/XxoBtKlQd2dFMvWcLyuhR0/gFfUg5cOeU7+C/nSgVeb7Z+kzR84ccuQkV+Zm3GCWt4AWN0f3i0bGov5hOQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621755991; bh=tRQ7LHWu2ZNkmjYX7h2hfbGSXVFlPGZ+t/+IbA+MPvQ=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=MYUqKJ+gJ372GzRfpNeolpKfT8gmApa4Ypt8Ia5iHMqcnr1Wm4PLgC4InOlVrYU/72E6NcAqqujZ3CkoALGaykZVWGMRiNI6wILe1rbu7iMbw9f7kkKKlJ7mEKfgR2R0F52aZxpYo2ER2SQ1TJPo8Q2wXWK54NYR1nIP2BgKQesoxd8RwzkLw5ynU7BWmG5/7zPymJo6KH9biwojj4Y2NbutiyQifi5SYqrwxy+00gB4j5/ct/W9b1Y9j3KLd1htz1JkBEdixfC+TrAUXaJ046w9Rm0MbP0jpaWtHMiBLgLTXDgCVdkCsSyO9iiM3DI9PEwysK6THVBC3qW796NbDw== X-YMail-OSG: OO.S77gVM1k1eVFVErNFy7UFSFZPII9OzbZgAJ6MXYI4ZNF51ulTg2zuDncEkIA tQs3PxAwX5nfL5EmB4rytdMu8bUV6qwPs0qpwiwZS1sCmprzYAWM75MeWydAl1_tFgUoWI6_bP3j 7z2WUZyZBFTM686.kZ8sIkryRhG2R4CdynlHRQIzNREkfmMsGAV4U0bBH6wMkp2VfnG3Ft3_7e_e OSkLNpv.u6Zvrh9HEg6Cnuy331jQM_YydwQX_B..OAIm1sigNtXdJL3zifCP1.7vQg_TseCDfDfj YGplvWuUcVbchs5P6aCDo8SzAyQYIQRb9t2o2xRD.jVgud83Mjt1JcEy0lDN6Z_sG9nnNmgjC3NB 24abP.k_xamk_B1lIbXcw2hzXyrRJtrsrqCsz8Rh89tGTC3vUti6zHhpsAssnnN.816VecNlQCjx mJP5uoBvPWRTgqMSRLz2J0.VOiVsLQbG5YZE6U6AwKGBHgdqAUFQnrUgQ_n48HenO6geEYAJPV6u JXeBe01S2QSw.juPyAXh8KXhhEs2tvpJM.BmTlxtrYHIDnIb6EkKO26fMKgtW2hB.8azTGsP159v UzF3yEeibmwrLp3XBR.TdHC5yVCv4.FSEfkavvcVMqb1Erdx5zaWhChWvcxdtBFdBZwHon3tDJLM Hyhd9mr8_.rJ9rjLI2PVeAlAR5UPfeXsvTvh2R71dpDS2tturrdpUU_z5M2TzTfqq6rS81MuId0g wOnMj.KAjtfpiyOXLHJ9Cn.qH9.fkZCI.Gc5IFXNPhj672xjGLu2DhvsEHgsRizwE68.1s2TRSVo xOl2SCeOQCxV3J.WilT9Kma2phMmgRek0vOCvAxyulQY.w3MTHlqE49P9B.cl9xfqy2RkiKi3Ypn BJ8aQmMAVHVBPF4.u_pgHJEpCfrBo6yrTIFt_Cc73aSbApvddSL4Qp9GSXksdw1lUrvdsYHACFLT 4gHTcQ1i5skuHYDwkD55r0uHZMoATWvdFUcYqFQ4gO7mzDIDYl3W9XYFquuxd8sKOtvYVIGalt5a yEycWbVTIEuTXWqwtoA4IMtUSKXWDBNI1brXv5IvOnIuVasSRKJkgmW89C3RtiZaxnzoNycFMMkU TYGSSGKA9NIhmSZ6K5aOVaCqT7GCFMT54Yj8cuiRUubR6XjTTxewzIICvF3q7UtR9W2PTmz.5QLB n_.Mu34aCgWmyApA.uZBpFi8mPUNN5.Vj8k5krE3Ee4Imip8KrIlQ6zJV63Ph4lxZRsaqNDJg4BX oCxFU6y1n0dnySLtbBPrWn.adSyPviN.RgIUQ4Ri_bXSu2aAjXLVV6k7aCLrpSO7Y.Ps6UiXYIFE aY.COP8AFq17YCOqtXvsWCsreLhvrXS7LrgK3jewshYvNgA81OcjVEMlTn2imnz0Zfo3aVj7NqW9 ZNhoY6U8T1_U963g4nBKR0G6LK5zPgYrkocmPSKszAjN5JwgBImvf2p8OK93m7JaTslGnFI6ex3V 9rt1RwywM7fHS7RkOwIUO10np6t.bp4uy059QXXONG1zIokDp85zYY4ohMFEVlK4b6f6J87XCA0B 14ifCuowhBEHjcEWEzjtqXxfSDcGAiEIIDta3DJ9iF.406HkQUFx6VnACbunXcW2wYHGT_oq8j6M plcs.eK1UdUSlLneNID0n1oSgnDi2OQPi7jGkGRLeEW9vSAhxpOCCZvfl7zhT88Nb8Fy.ixiYjkz adQXu5qfaDyn32PcWX7Psf0s_50EG1r2AP1p2dC96r0AxQjs.EYMYlY8b88ejF6bvuuk5eKER9UT 5lLVC_zahhSepFRnpfWMYeZcjUxuTGOZrllp5b043RrClfCFlNj2t11pybY9ZRWJrbTSnAGAASBh PZbHlungGSj9RNFOlQ4mB2OcX_3_tPcln05P4lmHTQOWT2xaJgMqqngOh1Gp1Dsz0sIW.wzBIMKG R5o5sSNcEagYMvAEDbI4iRL5Cnr2UfEMGo10kZd8HIP3ASV9CgdC7VZIrU9I1xDFMF3F0X4lXD2d nz69gtJ8F.odpm7udJhzVhr4XuUylrFnGvBd1CZi5oWe5HTK_0dfrcrHjcZNqUfhxs0PNDXNRIqx FgK2R93TTC26woyi7TNzb08g5as_hySn44sn5P1_NiPlxpwYdlJFz.nMjkNCjOXBlgRDZyqF2kZG bHZJARAYpzWio8EoC7wFlyBkTSsPFAd17vUKjSAHNxfA7QUolMqCKy0E2XNXIuEafnAKjHGmy_x6 aSafPYrHoAcfoIeh0Hc25jO0O1SMDZ0mss0zlCNuN8lT9YLVaVnErZvkCX5xAzSw9SnyZhc9CeFI blvIvQ_O5MJdAY50K5qKQt18fXfdHKcuxiSzABgS5mxNjuR5ADWM8V1ypPOeJAxN5irh1vS6WXWb OG7MutxqGNfJrqk1eOfQ6kYLYYHM1t0Z4760cDYUAR88OqSYY1nPFr_n4BnCWwLYzZCWIg15WQd1 ni69K39MLap31HeVvRqzRc3fmen2Rh6PsoHO6.c1SLHX0_xBXuMtdi62fmpTIef4OpXnnPxGXDDZ gMFV38X4_iY.d2cCFEmFn8lioevpLrROEdpUNMPiT_uoF9Eo2x5_KyvCv6P5Byh0TtSoR7NFmxka WzEQuuEcGv71MisPmHqUd3pbkRKvR90ALd0xIn2tZ1NpWQAS.AqQ79qcxlVOgbWSHcsRlGVIOXlw - X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Sun, 23 May 2021 07:46:31 +0000 Received: by kubenode559.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 27ea3b9f74aa48c6aeada5591ab1e273; Sun, 23 May 2021 07:46:29 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: I got a panic for "nvme0: cpl does not map to outstanding cmd" on a MACHIATObin Double Shot In-Reply-To: Date: Sun, 23 May 2021 00:46:28 -0700 Cc: freebsd-current , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <90A23579-61B7-4619-AFD7-68439FCC16F3@yahoo.com> References: <063D5E36-126F-497C-97AF-827BADC1ED2F.ref@yahoo.com> <063D5E36-126F-497C-97AF-827BADC1ED2F@yahoo.com> To: Warner Losh X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FnsqF20fsz3Lld X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=O/e+9MhO; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.64.204:from]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.64.204:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.204:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.204:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-current X-Original-From: Mark Millard On 2021-May-23, at 00:08, Mark Millard via freebsd-current = wrote: > On 2021-May-22, at 22:16, Warner Losh wrote: >=20 >> On Sat, May 22, 2021 at 10:44 PM Mark Millard via freebsd-arm = wrote: >> # mount -onoatime 192.168.1.187:/usr/ports/ /mnt/ >> # diff -r /usr/ports/ /mnt/ | more >> nvme0: cpl does not map to outstanding cmd >> cdw0:00000000 sqhd:0020 sqid:0003 cid:007e p:1 sc:00 sct:0 m:0 dnr:0 >> panic: received completion for unknown cmd >>=20 >> cid 0x7e has no currently active command. The cid is used by the = driver >> to map completions back to requests. >>=20 >> So, there's usually 3 possibilities that I've seen this with. >>=20 >> (1) There's a missing cache flush so you get a bogus cpl back because = something stale >> was read. It's unlikely to be this one because the rest of this look = like a successful >> command completed: sc =3D 0 is successful completion and sct is a = generic command queued. >>=20 >> (2) We're looking at the completion record twice because we failed to = properly update the >> head pointer and we've already completed the command. I've only ever = seen this in a >> panic situation where we interrupt the completion routine because = something else >> paniced. >>=20 >> (3) There's something that's corrupting the act_tr array in the = qpair. I've not seen this, >> but if something else smashes that area (zeroing it in this case), = then that could cause >> an error like this. >=20 > Of note may be that I buildworld and buildkernel with extra > tuning enabled, targeting the cortex-a72. In one past example > this lead to finding a missing synchronization related to XHCI > handling that was fixed. (The fix was not aarch64 specific at > all.) For that: A cortex-a53 did not show the problem with or > without that tuning. A cortex-a72 showed the problem only with > the cortex-a72 tuning, not with targeting a cortex-a53 tuning > or generic armv7, for example. >=20 > Not that I've any evidence specifically suggesting such would > be involved here. But it might be good to keep in mind as a > possaibility. >=20 >> Or it could be something new I've not seen nor thought about before. >>=20 >> cpuid =3D 3 >> time =3D 1621743752 >> KDB: stack backtrace: >> db_trace_self() at db_trace_self >> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >> vpanic() at vpanic+0x188 >> panic() at panic+0x44 >> nvme_qpair_process_completions() at = nvme_qpair_process_completions+0x1fc >> nvme_timeout() at nvme_timeout+0x3c >> softclock_call_cc() at softclock_call_cc+0x124 >> softclock() at softclock+0x60 >> ithread_loop() at ithread_loop+0x2a8 >> fork_exit() at fork_exit+0x74 >> fork_trampoline() at fork_trampoline+0x14 >> KDB: enter: panic >> [ thread pid 12 tid 100028 ] >> Stopped at kdb_enter+0x48: undefined f904411f >> db>=20 >>=20 >> Based on the "nvme" references, I expect this is tied to >> handling the Optane 480 GiByte that is in the PCIe slot >> and is the boot/only media for the machine doing the diff. >>=20 >> "db> dump" seems to have worked. >>=20 >> After the reboot, zpool scrub found no errors. >>=20 >> For reference: >>=20 >> # uname -apKU >> FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #1 = main-n246854-03b0505b8fe8-dirty: Sat May 22 16:25:04 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-dbg-clang/usr/main-src/arm64.= aarch64/sys/GENERIC-DBG-CA72 arm64 aarch64 1400013 1400013 >>=20 >> If you have the dump, I suggest starting to make sure that the act_tr = array looks sane. Make >> sure all the live pointers point to a sane looking tr. Make sure that = tr is on the active list, etc >>=20 >> It will take a fair amount of driver reading, though, to see how we = got here. I'd also check to >> make sure that qpair->num_enttries > cpl.cid (0x3e in this case). >>=20 >=20 > Okay. I got this while trying to test an odd diff -r over NFS > issue with the more recent software. So the two will potentially > compete for time. >=20 > As investigation will be exploratory for me, not familiar, I'll > probably publish periodic notes on things as I go along looking > at stuff. >=20 > My first is that the /var/crash/core.txt.0 has a gdb backtrace: >=20 > . . . > #10 0xffff00000047900c in panic ( > fmt=3D0x12 ) > at /usr/main-src/sys/kern/kern_shutdown.c:843 > #11 0xffff0000002226b4 in nvme_qpair_process_completions ( > qpair=3Dqpair@entry=3D0xffffa00008724300) > at /usr/main-src/sys/dev/nvme/nvme_qpair.c:617 > #12 0xffff000000223354 in nvme_timeout = (arg=3Darg@entry=3D0xffffa0000b053980) > at /usr/main-src/sys/dev/nvme/nvme_qpair.c:938 > #13 0xffff000000495bf8 in softclock_call_cc (c=3D0xffffa0000b0539a0,=20= > cc=3Dcc@entry=3D0xffff000000de3500 , direct=3D0) > at /usr/main-src/sys/kern/kern_timeout.c:696 > #14 0xffff000000495fb0 in softclock (arg=3D0xffff000000de3500 = ) > at /usr/main-src/sys/kern/kern_timeout.c:816 > #15 0xffff0000004356dc in intr_event_execute_handlers (p=3D,=20 > ie=3D0xffffa000058bc700) at /usr/main-src/sys/kern/kern_intr.c:1168 > #16 ithread_execute_handlers (p=3D, = ie=3D0xffffa000058bc700) > at /usr/main-src/sys/kern/kern_intr.c:1181 > #17 ithread_loop (arg=3D, arg@entry=3D0xffffa000058aef60)= > at /usr/main-src/sys/kern/kern_intr.c:1269 > #18 0xffff000000431f6c in fork_exit ( > callout=3D0xffff000000435430 , = arg=3D0xffffa000058aef60,=20 > frame=3D0xffff0000eb7cc990) at = /usr/main-src/sys/kern/kern_fork.c:1083 > #19 >=20 > So via kgdb . . . >=20 > (kgdb) up 11 > #11 0xffff0000002226b4 in nvme_qpair_process_completions = (qpair=3Dqpair@entry=3D0xffffa00008724300) at = /usr/main-src/sys/dev/nvme/nvme_qpair.c:617 > 617 KASSERT(0, ("received completion for = unknown cmd")); >=20 > (kgdb) print/x cpl.cid > $4 =3D 0x7e > (kgdb) print/x qpair->num_entries > $5 =3D 0x100 >=20 > Based on also seeing the code: >=20 > qpair->act_tr =3D malloc_domainset(sizeof(struct nvme_tracker = *) * > qpair->num_entries, M_NVME, DOMAINSET_PREF(qpair->domain), > M_ZERO | M_WAITOK); >=20 > (kgdb) print qpair->act_tr > $6 =3D (struct nvme_tracker **) 0xffffa00008725800 > (kgdb) x/256g 0xffffa00008725800 > 0xffffa00008725800: 0x0000000000000000 0x0000000000000000 > 0xffffa00008725810: 0x0000000000000000 0x0000000000000000 > . . . > 0xffffa00008725fe0: 0x0000000000000000 0x0000000000000000 > 0xffffa00008725ff0: 0x0000000000000000 0x0000000000000000 >=20 > It was all zeros (null pointers). No "live" pointers and, so, > no tr's to inspect. >=20 > As none of this is familiar context beyond general programming > concepts, it may be some time before I find anything else > potentially of interest to report. If you have other specific > things you would like me to look at, let me know. >=20 A fairly obvious thing I should have provided: (kgdb) print/x *qpair $15 =3D {ctrlr =3D 0xffff0000fe154000, id =3D 0x3, domain =3D 0x0, cpu =3D= 0x2, vector =3D 0x3, rid =3D 0x4, res =3D 0xffffa000086ded80, tag =3D = 0xffffa0000877b780, num_entries =3D 0x100, num_trackers =3D 0x80,=20 sq_tdbl_off =3D 0x1018, cq_hdbl_off =3D 0x101c, phase =3D 0x1, sq_head = =3D 0x1f, sq_tail =3D 0x20, cq_head =3D 0x20, num_cmds =3D 0x420, = num_intr_handler_calls =3D 0xe66c, num_retries =3D 0x0, num_failures =3D = 0x0,=20 cmd =3D 0xffff000100ebb000, cpl =3D 0xffff000100ebf000, dma_tag =3D = 0xffffa0000b093e00, dma_tag_payload =3D 0xffffa000059ef000, queuemem_map = =3D 0xffffa00005a07700, cmd_bus_addr =3D 0xacbb000,=20 cpl_bus_addr =3D 0xacbf000, free_tr =3D {tqh_first =3D = 0xffffa0000b053a80, tqh_last =3D 0xffffa0000869da80}, outstanding_tr =3D = {tqh_first =3D 0xffffa0000b053980, tqh_last =3D 0xffffa0000b053980}, = queued_req =3D { stqh_first =3D 0x0, stqh_last =3D 0xffffa000087243c8}, act_tr =3D = 0xffffa00008725800, is_enabled =3D 0x1, lock =3D {lock_object =3D = {lo_name =3D 0xffff00000090321f, lo_flags =3D 0x1030000, lo_data =3D = 0x0,=20 lo_witness =3D 0xffffa0043fd96080}, mtx_lock =3D 0x0}} Looks like I need to boot into the non-debug builds for the other problem I'm testing for repeatability after a commit. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From nobody Sun May 23 13:36:02 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9D7799FA43F for ; Sun, 23 May 2021 13:36:08 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fp1Zb3NQtz4hRR for ; Sun, 23 May 2021 13:36:07 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id 47C2013C9 for ; Sun, 23 May 2021 09:36:05 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Sun, 23 May 2021 09:36:05 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=l/zO/DNas42DFPNIZxF423MoWlE ABdapHZ5/s24hDGk=; b=PEfbepLxiffy4tuynEubWvDhh1R/icpic+7OIfiY5Qu rCG04a73RsWMiW29urN/ZONp5ay3y19xOLq0ELfYSVc2mxHqTjGl9hzvd6AqizwA GfobQgOm8hfOgoQTaBU72bY5jVbCMqgJqq6Nr4DT2QcciRHHXasRJUYzIutQktVG OQdU3RACNFdK3AgF444fVxrguyZ92PiXKIzKjiGzD/jv5mM6pzIqOjoWTojdHLGp l5I6zKq2WDh6YeKy97NsI2U6uBqMpWzbfSSmqZw81eV8+Qa0HmsyJ4oulq4y9rqX AYowsGTuTX4koKV3PgA5XKJO8G5kct3CYKX1HMtqGgQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=l/zO/D Nas42DFPNIZxF423MoWlEABdapHZ5/s24hDGk=; b=cwCfjOTMpyH7pcjvLOs08f vCafugdu3Xu6xTVmnMrcgnvS5m5XNObD3ngBM3GsYft+n7Q9GXLINIRg7o8tb8JX 1YrfNLpkEbYGsIv1Wfd1QXZ9r0I7y84gq8rgYiuMVD7IWSzmczpU8BTS1kpqFUe2 UEmi5XrJEvFCj8QIgaoDKeQsWp/z4mN1tWoZH8+kUvs5HVILpdVZb9MbbFsE70pk rtQOWcxv7eq3lBFbVBCtZYn0HjbKddCL3kRbeXyFfAeFFcef0Lq+EI68O6IODd7l z98KrPMK5x9hl94f1/rNPvrKny6dng8PSYdtPx8j+GSNlZQVljaWaya1BntTwLGA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrvdejjedgudejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesghdtro ertddtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucggtffrrghtthgvrhhnpeekgeehveeuledvgfevudegheekgf eiteekueejjeegtdelgfdugfdutdeikedugfenucffohhmrghinhepfhhrvggvsghsugdr ohhrghenucfkphepkedvrdejtddrledurddutddtnecuvehluhhsthgvrhfuihiivgeptd enucfrrghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhn vght X-ME-Proxy: Received: from ceres.zyxst.net (ceres.zyxst.net [82.70.91.100]) by mail.messagingengine.com (Postfix) with ESMTPA for ; Sun, 23 May 2021 09:36:04 -0400 (EDT) Date: Sun, 23 May 2021 14:36:02 +0100 From: tech-lists To: freebsd-arm@freebsd.org Subject: Re: FYI: Example USB3 boot failure on RPi4B ZFS-on-root system booting main: uhub_reattach_port notices involved Message-ID: Mail-Followup-To: freebsd-arm@freebsd.org References: <681FD1BA-2796-45E2-897A-28C749E80261.ref@yahoo.com> <681FD1BA-2796-45E2-897A-28C749E80261@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="zqAFQSfRtF6ey+hz" Content-Disposition: inline In-Reply-To: <681FD1BA-2796-45E2-897A-28C749E80261@yahoo.com> X-Rspamd-Queue-Id: 4Fp1Zb3NQtz4hRR X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=PEfbepLx; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=cwCfjOTM; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 64.147.123.25 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-5.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[64.147.123.25:from]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from] --zqAFQSfRtF6ey+hz Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Sat, May 22, 2021 at 08:19:28PM -0700, Mark Millard via freebsd-arm wrot= e: >The USB3 SSD was the only storage media present. >Port 3 apparently had the USB3 SSD boot media (the >same media that the FreeBSD loader got the kernel >from before the above). https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D237666 might be relevant --=20 J. --zqAFQSfRtF6ey+hz Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmCqWjoACgkQs8o7QhFz NAWKoA/9GgZpXyfg3dRUUiFcs3EVM8RzgxC2pEeF2BK+afdsLJbJGiW1WfL1e4/a IWY166xv8Q7TUTesphtvjnupzh9bEvpZrcZmZETqcgb8FZYJaDgsvAQXudNuVXUV g8+WQUQCtIXaCYqzvE2gX0+iRHhwyaTGbJOvpx7fOI5C7MJLBmk3Iv3e+gQFwhQY 3SF7URTu2K3C4y3Zg3IZne97m3SddoNB2RqbfjhsLNOLL59+1MtcIWBMYOgDsIZA aZOMwJNYlFBq8l6hpC7ow84XMBgWs0OsfDew6TgfPg5npbrrkvDBzrGlDSFelD9I bx1GqFq8xjIdI93o7RNIPdauPiGVXS6L0JLGwWiFps9EGnyWcBSpRcEqRoizjBOJ 6jPKSWtwLXVLUrtvXltnAnjKf38zJNQMKz07yN/xAoJ6hSDnef6ktc3l0hVbnZ4i HKoGH1vO98YRAonyoyLTewAwgZ3PPvhTrshOIyfdwflSFvgUzpnV/qDW9gX72unG IqL9JXGMRph25dsfVZ9vcF+WTf0bnBA8ajq3Hj6PUyklbaC1qD2oTSFyLuPQeQ3N ggEnxy3uHI5RA750CZ0Ur7zsm+DSw2Dfa3+qMMgF9vRfpSKPwuS+pNMGWJfI+H+d UdcHA/aO18dkPz22APHebssQ8Gteu3utK99rIXML8aSl6p+08FU= =MA3J -----END PGP SIGNATURE----- --zqAFQSfRtF6ey+hz-- From nobody Sun May 23 21:00:10 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BF53E9E3DBB for ; Sun, 23 May 2021 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FpCQz1CTHz3r8W for ; Sun, 23 May 2021 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E9CBF1E098 for ; Sun, 23 May 2021 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 14NL0ADL037776 for ; Sun, 23 May 2021 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 14NL0Auk037775 for freebsd-arm@FreeBSD.org; Sun, 23 May 2021 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202105232100.14NL0Auk037775@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-arm@FreeBSD.org Subject: Problem reports for freebsd-arm@FreeBSD.org that need special attention Date: Sun, 23 May 2021 21:00:10 +0000 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="16218036107.e55Db9.37373" Content-Transfer-Encoding: 7bit --16218036107.e55Db9.37373 Date: Sun, 23 May 2021 21:00:10 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off Open | 239673 | Spurious Interrupt message from /dev/led/led1 2 problems total for which you should take action. --16218036107.e55Db9.37373 Date: Sun, 23 May 2021 21:00:10 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
Open        |    238576 | Raspberry Pi 3B+ "shutdown -p" does not shut off 
Open        |    239673 | Spurious Interrupt message from /dev/led/led1

2 problems total for which you should take action.
--16218036107.e55Db9.37373--