From owner-freebsd-current@freebsd.org Sat Dec 19 08:13:17 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 11D184C06E9 for ; Sat, 19 Dec 2020 08:13:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-19.consmr.mail.gq1.yahoo.com (sonic306-19.consmr.mail.gq1.yahoo.com [98.137.68.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cydlc0N1bz4t2f for ; Sat, 19 Dec 2020 08:13:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1608365591; bh=BsVGUhYE8HdcLMNg71xRI5gfa/lAH/gad5IHv4jWGLB=; h=From:Subject:Date:To:From:Subject; b=ECK/rWgoU9wlwHXxWsE54oZt3hEFlNb1QuzpAHq3a2voD50nz8+kpxdx0la8rs7QE3i7i4bMtKlgYpVXUYTxLN0f6GYk/2cf5Eoi5Ju0xC0+mvdMurZpLBbM15Z3wvfpYQ8QjsqG3QpHyeN8bm+8g+E1bUh6aiJzesu0VGGrlgnwwzAQldZOsxcwH4buoxAAr75U+ECmpMzpuxx0UR3YiLfBKYivfei8WdRmkWgGVf1rnPyi0SjsaqVlRkDJJ++H7OU2HngvXpq9su31mODLynCN3YzE50cEN1ZjnS5OLY0RMrYlHzwQmsAkVcs+GrGhgfFTnXHuluu5bEKejJsqrg== X-YMail-OSG: 3aMcrOcVM1nmk7WwZ7q_WvmwYgPcZNpV1j5xwysIrdoD3Z0hJK0YqTzMcBleMLA ZpOLwWCg5HPYgNTNnJDyxFodcmrxwYfD.g_j79kw6bDPqnxoXi5KBSxZUPvsQiYLpvIMohUALVvd KLNZ1O07ChKCIxTpvSnPnoJfrajpdVZHzcUGuTUDVGZxbpgu0yunIOqvcUUfwBwN9p4Z22zJELmZ jSKLZOQzkFF9GnSaN_NT.BV0.ppSjRRrkD95cgxdUU1aNJRg.BxDqMrVy7jWiB65fx.1TUGZXd_p tIVWNTa84EBr6J8aoffVBRbXMKfI8afTKAa207ZSmrBXyFuZIsq_SAIKVUgUZlNMuTOtsSgAxZKb 5jKw1ETk0ET4Stj_6it0H.21sy1SFM4wuen3516a1AjpOk26kWWlalbuKVMLVRlopKKccdLwopYW 9U5V0oVFjJoFJOojTcdRblKt1lQ34hkJYXPAH6GsfhdKdpUQMXw7y95od.hfgqpNveao_U2qxUZ3 jGNeAm6AKtKHh7UyTRtdkCRJe2lRFhUPhJPcFjLfJ8XQzCE5BqxgkNvgxhJCidVBHcVk5CMN_g2M BW2WFbVC_fIBWy366e63BafrqvtK27O1hYQ3Hyk55T.DlV1OZ0lfJHUkVAcGFn9AjiIhUMJeX7Yz esYxrp2XuQr3l0kyJiFswoALhj.r4XpSfEW8gg9.EdOtUKuEwa9tHHpflsjyYJcSmNENQvrzqqe2 5mb5RQKljKG_OJAGYVN1FZBaFqocnvJgpkd3mnQEkhkA0W7vidqrBNGGmbunGcgB4zXDkV21Za8E PdkZpGJWxD2a_dt..8CrqGCF4pPyx8zDlOkOdr4ObDsp0xz.sM6Wm1BM_XCKbFHa.Kj7Q7J2yjHD UDjWaQc7o0vEQQj_ksDEqu6EaFWTpy_FKS57Xv_QPZI36MwBWG9wrjD4PyUkmNd.BHFvJHCOQhGS QnNEvLO7hv8lG9O0oQzhLVeETOf995n02gPmN6XRuLGpws5rpcd50_eMrAeLvFuPnFdJNn4pVCsy SyPqDaOYfDp9Y0PEMiyVazRBSlv4EpKsoY6Pk73BZX8iT8SqDmLcKibM6lO83u58xocXRpX952k_ Qf8FzOsC83hinq9FQkoPsBgp4w5ZkDGQuX_6lQaBD2e4dZV.WKmGo31B_6jRUwCJu3MoajPL4Sr_ 1BQX42t6RWcPYhG6RunVjaviahSCuF0S7wK6pF1f9zr4jshCtXtDQpyFhaY1zWL1edyDC6ozcOWd wXyuT9eFnRYR_aVP1SyxUKTKZHy79zSSbiqC3eBf8T0WwkkHdURq5WIR7rqa6tpsqGruCoFdPeEr v69tT1JVnCM8SvDyKHcbf4ptqkj4o_mUdIJLrGqWb_MfPc5JcPeMLbuWXVJNyAHj5VB9x6.fXVOI I6.tk0uqn88iaO7ZB1mBGfxIw.XplFmbejNA3U2QrvvhlTM4clCL6SX9.cUL8EpGEXQ3QJOu8WMU eyuTz_i7aRhzJIs2vP3EhJgePy_yoYaUMmfmgwGfjIUrsGG9HHsYQ0PWTrlxRmmltxD75yUXi1Xf rilJBldjjG34b9mSu.lwrjQm_YEHGSLzZuCCP2_d72iuSALywvHJJOG15uy73IeGqyLN6bp5Rc4D hKADnwJAXVqv0fLcfPgQ8mfEL6vcpCjCBcMJoDDGPv.qVsV5sp.QwtEr2qoKRx8YCJbDd4H6KWzo YLzVBWIQj6E8Z7OE6m2RJ3HYdzYxLTgKIoSe0dgQ.pzYgr4UG6ppgZYr8ch9x5c7EwAD10sVU95c TgRzwntcbahPjT9fFzf9v9q9DDwFhE8bJvYW2gtiS.bcKSGmHdsV95_tMnWnNQWKiHW_hstvYfzV pJnV.zg61YWa0IfnhahmcwvxqIa3P9HCFs5oiYG7a7ZvUuzs5aPgL6nOKpYzDNDzT49jtCcUDwBD cz3.CuH1bQ0RWreHrOUdDkXS_RtXw9i2auWYyh0P2FYwE8iUmqt5EDDNZAXsm2qni11Egjf4bQtP I0L73BMAieLquX_gqi_Fp8W.CJ8M_4lH3iiS7VwhqGyNGDZmA2muxLDXYruKAKaHvif_SO9La_uE LDHqVCZKC33mcTKOfa6Z.3wH2bOpnAVBPV40KokwWr_tPSbqZ9XqZ2gKjFlEmSq4khNqNQtNQqqD CkLrnCMyRBVOkoB3KAq4Z.geoCRCDZpTXUMF12TgFfLW4C9B1ZVGQuayo1c8sarWsyb_RvqR7c2m 7w70vVFCgfa5B2i6a3PnTkXUuYRNtkarDy0A6Gnzcmszl6t1YBFpB_8txMGZ3iIJcElQVsxFalZJ EzTJra2ln4iIC_j6RofdYapXmsuHI5GATpbcBUiNdF5NgeRkkv0U2LUuszYHINlOy.MXECsXZhF1 b4gx4P5QjccoqvLtfoWdjA0TKrVeW797xKdWx6njX8LEiTw1D27J_bEB2rSm5wnyDacc1Q5y_CKa bwh_MfFDNFOrj3Q5PSqtxXuScL3y9AKP_E8EM0eNyXaErIbLms97EBnWbqyHPn9rh4rTZXidtH65 pKq1nf2.2mju5C_i0EtDG3uMAmdgPBxK_qJPl.KqtkqVhO53RgqczZc8ZCDDrXgyefoFus4QoPuT m0G73iXz7iRWwaEbBiUBfQMDZbsK.MKwehRl6 Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Sat, 19 Dec 2020 08:13:11 +0000 Received: by smtp412.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID f127ff6c62797251a4bc6c4fed893dac; Sat, 19 Dec 2020 08:13:08 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.20.0.2.21\)) Subject: RPi4 (8 GiByte) example: non-debug head -r368500 kernel fails to mount root where artifact debug kernel works fine (uefi/ACPI boot) Message-Id: <4D39055C-A0B8-4E2C-AA2C-F703D5061771@yahoo.com> Date: Sat, 19 Dec 2020 00:13:06 -0800 Cc: Hans Petter Selasky To: freebsd-arm , FreeBSD Current X-Mailer: Apple Mail (2.3654.20.0.2.21) References: <4D39055C-A0B8-4E2C-AA2C-F703D5061771.ref@yahoo.com> X-Rspamd-Queue-Id: 4Cydlc0N1bz4t2f X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.68.82:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.68.82:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.82:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.82:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Dec 2020 08:13:17 -0000 The boot attempts were via uefi/ACPI using https://github.com/pftf/RPi4 v1.21 materials, directly booting from the USB3 SSD, no microsd card involved. Non-debug kernels built for cortex-A72 and for cortex-A53 both got the behavior that leads mount root failure. (This tends to eliminate some = types of missing synchronization as a potential issue: in the past the = cortex-a72 style of build caught a problem that cortex-a53 builds did not show. So = my original thought to cc hps may have been a waste.) Still, the below is based on my usual cortex-a72 based kernel being used as the non-debug = kernel example. The artifact debug kernel from: = https://artifact.ci.freebsd.org/snapshot/13.0-CURRENT/r368500/arm64/aarch6= 4/kernel.txz does not get the problem. The prior RPi4 context was back at head -r365932 or so and back then the combination worked. The FreeBSD upgrade is recent. In the failing contexts (i.e., non-debug contexts), the following never shows up: da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number REPLACED da0: 400.000MB/s transfers da0: 228936MB (468862128 512 byte sectors) da0: quirks=3D0x2 and the message: Root mount waiting for: usbus0 repeats indefinitely, unlike historically for my configuration. Capturing and diffing boot -v output did not show much interesting but here is the range with usbusN and the like (+: for artifact debug kernel, -: for non-debug -mcpu=3Dcortex-a72 kernel): @@ -197,18 +198,18 @@ vlan: initialized, using hash tables with chaining IPsec: Initialized Security Association Processing. tcp_init: net.inet.tcp.tcbhashsize auto tuned to 32768 -AcpiOsExecute: enqueue 1 pending tasks usbus0: 5.0Gbps Super Speed USB v3.0 usbus1: 480Mbps High Speed USB v2.0 -Release APs...Trying to mount root from ufs:/dev/gpt/RPi4Broot []... -done -Root mount waiting for: usbus0CPU 0: ARM Cortex-A72 r0p3 affinity: 0 - usbus1 Cache Type =3D <64 byte D-cacheline,64 byte = I-cacheline,PIPT ICache,64 byte ERG,64 byte CWG> - CAM - Instruction Set Attributes 0 =3D - Instruction Set Attributes 1 =3D <> - Processor Features 0 =3D - Processor Features 1 =3D <> +AcpiOsExecute: enqueue 1 pending tasks +Release APs...done +CPU 0: ARM Cortex-A72 r0p3 affinity: 0 +Trying to mount root from ufs:/dev/gpt/RPi4Broot []... + Cache Type =3D <64 byte D-cacheline,64 byte = I-cacheline,PIPT ICache,64 byte ERG,64 byte CWG> +Root mount waiting for: Instruction Set Attributes 0 =3D + usbus0 Instruction Set Attributes 1 =3D <> + usbus1 Processor Features 0 =3D + CAM Processor Features 1 =3D <> + Memory Model Features 0 =3D Memory Model Features 1 =3D <8bit VMID> Memory Model Features 2 =3D <32bit CCIDX,48bit VA> @@ -219,12 +220,13 @@ CPU 1: ARM Cortex-A72 r0p3 affinity: 1 CPU 2: ARM Cortex-A72 r0p3 affinity: 2 CPU 3: ARM Cortex-A72 r0p3 affinity: 3 +WARNING: WITNESS option enabled, expect reduced performance. regulator: shutting down unused regulators ugen1.1: at usbus1 ugen0.1: at usbus0 uhub0 on usbus1 -uhub0: on = usbus1 uhub1 on usbus0 +uhub0: on = usbus1 uhub1: on = usbus0 uhub0: 1 port with 1 removable, self powered uhub1: 5 ports with 4 removable, self powered @@ -233,15 +235,28 @@ uhub2: on = usbus0 Root mount waiting for: usbus0 CAM uhub2: 4 ports with 4 removable, self powered -Root mount waiting for: usbus0 CAM ugen0.3: at usbus0 Root mount waiting for: usbus0 CAM Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 CAM -Root mount waiting for: usbus0 -Root mount waiting for: usbus0 -Root mount waiting for: usbus0 +ugen0.4: at usbus0 +umass0 on uhub1 +umass0: on = usbus0 +umass0: SCSI over Bulk-Only; quirks =3D 0x0100 +umass0:0:0: Attached to scbus0 +Root mount waiting for: CAM +Root mount waiting for: CAM +Root mount waiting for: CAM +Root mount waiting for: CAM +Root mount waiting for: CAM +GEOM: new disk da0 +pass0 at umass-sim0 bus 0 scbus0 target 0 lun 0 +pass0: Fixed Direct Access SPC-4 SCSI device +pass0: Serial Number REPLACED +pass0: 400.000MB/s transfers +da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 +da0: Fixed Direct Access SPC-4 SCSI device +da0: Serial Number REPLACED +da0: 400.000MB/s transfers +da0: 228936MB (468862128 512 byte sectors) +da0: quirks=3D0x2 +da0: Delete methods: (I did not include more of the waiting-for messages for the non-debug kernel ("-"). I see no reason to have later text from the debug kernel case ("+").) I do have a working u-boot 2020.10 based, microsd card first-stages boot for the same USB3 SSD that mounts the same root file system just fine. The kernel is a copy of the same non-debug kernel that the the above used, but the used copy is on the microsd card for this type of booting. (The u-boot is not ready to deal with USB-based booting of 8 GiByte RPi4's.) So it seems that having both ACPI-boot-style and non-debug kernel use combined are somehow involved to get the problem. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)