From owner-freebsd-arm@freebsd.org Mon Jun 22 04:33:01 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D711533F9E7 for ; Mon, 22 Jun 2020 04:33:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-23.consmr.mail.gq1.yahoo.com (sonic304-23.consmr.mail.gq1.yahoo.com [98.137.68.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49qxNX5SWWz47Bx for ; Mon, 22 Jun 2020 04:33:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 1Un28zUVM1lXmmDuHNHpUnQ0GeL8GRzDQ22MkrC.XJIjiFuc0S8spBRa6c1bMco xve3BRhg85wncsa5ZNW2BnysTDZSjuu4fRB1vF3pZOGv8yo1nJ1TIsnKcgXqhZtd6XxeSGrUQHFV G9Ie9pOzRWSDSNxgHAOV3RBmKxqFIgVwPcKorv6TOlXsi0VVv8ITcXvvlAJvH9iaklg9OXe.WeWP pNOgsGBdSF5B3v4_PrWE9zI34gFXUH4q_Q6R3ESLUCa247x5HJVSvejZkV9o_oHXOnOh0ORVnZrS a_vsaNcdI1aTqCXnrPWDU.K5s0WpG7fkeLajzUKTIhj9I3X.XdKOBcSdNShn4k3VuOXIN41moquA zUFcaXjrU7d9ysM67m0Og4iB8AKavYB7ak65Od8GSnucYAXkvczPgfSAUMglQaM2cxk2J3Kvp0EB Nr1hPWzl5HLjd_cUl0vwBxJ4esmZA5hVPMr14W_U2mO0AbrNBbdi7Mny010P6aO5fr0hv7o6Ai59 10.NzlntqtKBWBDl2tLJhQkp6V8J77Xt4bPuVd5Ale47MDhnff5dhS_isVF194cfvVke1PgOAJC2 NWv_NM0ADgtA.rSxcyXrieiBCoMA3WN22c.ONAF4D7TxhFyrkzUZ1DTrJ5108i18xSwoyflrixww htQnTbMZDjb3VA.StfuYajebsp50IHVdgSABm4yhAWzTkDcQLASmBL.8LmLJoaLLiMQS2x6n9mEZ s._T8PLgO4NqUeIPnJSr6XznvLcdwSb.gjoOsl5KGkh_nI2TtzeeSfnvV7o3SwX12Hnp1UN3ERYJ xQw7WAeh1PsEx66SQ.9L0f1FyOucabgfmEsfqBXBHctGEoFKHUrIaqw4.sqLWc_kGXlsfRPEMMDb J1JitlDCiylqZ8.JFjw6tRkdNXgPxlXvbuX.9IktBq9Z.W85usgO9nBSEdh86om_yvXOKbJ04oQ1 Yfz96vljl3nHLI608vHy37JkC5Eu1BdMyNZC9VrDgJ3BOB4dq9dho6rVuRaF7jLiI1F2Ls3YbG_L 5KrWIulayd5Euq7zoUJ7B17vDecmWUW8mrq2.tlcR.vJH_GBm1M7IjtgBkpyAiqfR3HP8Jw0uDsj RCnJkeVUtYMeFkZrOLodRF6Nuc6XaXN66.yr_XqIVtTHQUt2e92llJkn68KnA5vS8NtJhaFIX50y 7KHfpRnE1VZUTnidB730mBsb5rpTK2S17xe09paEabbnAY_MGpbZoVc9m8PdSNKgCHehfe4MP6c7 okxCKz3xIdSGfQFceqdBWp2a6dzebBd0nwGnzRu7h8bCHiezB2AW2M3yxaKroqbN2MXhmwOOE1fC MDBNEHdE_p31R4QIK4LRCnetqnzttg8pWqqg6FeTG.EzYITbGGXBJCw6yKTPdyFgTQotwXsqF4Q1 wxHLOaD_LJjKWYpfqsheMHwybCvM- Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Mon, 22 Jun 2020 04:32:58 +0000 Received: by smtp411.mail.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID ed0d05ef7d5c713e97e10e87bcf2bf09; Mon, 22 Jun 2020 04:32:55 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: Rock64: USB3 SSD and USB3 Ethernet on a common powered USB3 hub: cp over nfs to that SSD via that Ethernet failed Date: Sun, 21 Jun 2020 21:32:54 -0700 References: <3982293D-BFD4-442C-9F04-0FD9593DCEED@yahoo.com> To: freebsd-arm In-Reply-To: <3982293D-BFD4-442C-9F04-0FD9593DCEED@yahoo.com> Message-Id: X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 49qxNX5SWWz47Bx X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.25 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.204:from]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.968]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-1.01)[-1.008]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.204:from]; NEURAL_HAM_SHORT(-0.78)[-0.776]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jun 2020 04:33:01 -0000 On 2020-Jun-21, at 16:13, Mark Millard wrote: > I was experimenting with the external USB3 Ethernet > in order to avoid the leak on the Rock64 that is > associated with: >=20 > vm.uma.mbuf_cluster.limit.max_items >=20 > when the internal Ethernet is used. >=20 > I had the external USB3 hub plugged into the Rock64 > USB port and the USB3 SSD and USB3 Ethernet plugged > into the USB3 hub. I used dhclient ue0 to have the > external Ethernet bound via DHCP. >=20 > The dmesg -a after things were messed up by > the experiment showed: >=20 > . . . > ue0: link state changed to UP > ue0: link state changed to DOWN > ue0: link state changed to UP > ue0: link state changed to DOWN > ue0: link state changed to UP > ue0: link state changed to DOWN > xhci0: Resetting controller That last just looks like something that should not normally be done on the Rock64 once things are set up sufficiently for any USB3 device: # devinfo nexus0 ofwbus0 rk_dwc30 xhci0 usbus0 uhub0 . . . (e.g., umass0 and axge0) . . . cpulist0 . . . It looks like the reset is guaranteed to disconnect all USB3 devices, including the root file system device if it was mounted via USB3. (And that is what happened.) At this point the system had booted and already had served / as an nfs file system (via the axge0) to the machine that had just initiated a cp to the served / . > uhub0: at usbus0, port 1, addr 1 (disconnected) > ugen0.2: at usbus0 (disconnected) > uhub4: at uhub0, port 1, addr 1 (disconnected) > uhub4: detached > ugen0.3: at usbus0 (disconnected) > uhub5: at uhub0, port 2, addr 2 (disconnected) > (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 0c 28 cf 00 00 00 40 00=20= > ugen0.4: at usbus0 (disconnected) > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an = error > axge0: at uhub5, port 1, addr 3 (disconnected) > (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain > rgephy2: detached > miibus1: detached > axge0: detached > ugen0.5: at usbus0 (disconnected) > umass0: at uhub5, port 3, addr 4 (disconnected) > (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 0c 28 cf 00 00 00 40 00=20= > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an = error > (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain > (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 0c 28 cf 00 00 00 40 00=20= > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an = error > (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain > da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 > da0: s/n # detached > g_vfs_done():gpt/Rock64root[WRITE(offset=3D166752878592, = length=3D32768)]error =3D 6 > g_vfs_done():gpt/Rock64root[WRITE(offset=3D166752944128, = length=3D32768)]error =3D 6 > g_vfs_done():gpt/Rock64root[WRITE(offset=3D166753173504, = length=3D32768)]error =3D 6 > g_vfs_done():gpt/Rock64root[WRITE(offset=3D167409385472, = length=3D32768)]error =3D 6 > g_vfs_done():gpt/Rock64root[WRITE(offset=3D104384823296, = length=3D32768)]error =3D 6 > g_vfs_done():gpt/Rock64root[WRITE(offset=3D104447475712, = length=3D32768)]error =3D 6 > (da0:umass-sim0:0:0:0): Periph destroyed > umass0: detached > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: receive_packet failed on = ue0: Device not configured > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: ioctl(SIOCGIFFLAGS) on = ue0: Operation not permitted > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: Interface ue0 no longer = appears valid. > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: No live interfaces to = poll on - exiting. > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: exiting. > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: connection closed > Jun 21 15:30:45 Rock64orRPi4 dhclient[1138]: exiting. > uhub5: detached > uhub0: detached Looks like the below is the reattachment activity. > uhub0 on usbus0 > uhub0: on = usbus0 > uhub0: 2 ports with 2 removable, self powered > ugen0.2: at usbus0 > uhub4 on uhub0 > uhub4: on = usbus0 > uhub4: MTT enabled > uhub4: 4 ports with 4 removable, self powered > ugen0.3: at usbus0 > uhub5 on uhub0 > uhub5: on usbus0 > uhub5: 4 ports with 4 removable, self powered > ugen0.4: at usbus0 > axge0 on uhub5 > axge0: on usbus0 > miibus1: on axge0 > rgephy2: PHY 3 on = miibus1 > rgephy2: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, = 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, = 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow > ue0: on axge0 > ue0: Ethernet address: # > ue0: link state changed to DOWN > ugen0.5: at usbus0 > umass0 on uhub5 > umass0: on = usbus0 > umass0: SCSI over Bulk-Only; quirks =3D 0x0100 > umass0:0:0: Attached to scbus0 > da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 > da0: Fixed Direct Access SPC-4 SCSI device > da0: Serial Number # > da0: 400.000MB/s transfers > da0: 228936MB (468862128 512 byte sectors) > da0: quirks=3D0x2 Reattachment did/does not provide sufficient context for continued device use in the running Rock64 system . . . > Even shutdown then reported "Device not configured". > There did not appear to be much I can with with > it other than cut the power and start over. >=20 >=20 >=20 > On the other machine what I had tried was: >=20 > # mount -onoatime,soft a.a.a.a:/ /mnt > # cp -aRx /usr/obj/clang-armv7-installworld-poud.tar = /mnt/usr/obj/clang-armv7-installworld-poud.tar.alt It is not clear to me why the Rock64 did a "xhci0: Resetting controller" in responce to the above cp. Prior to that, things seemed to be working normally. > Based on the failure this machine showed a message: >=20 > Jun 21 15:31:52 FBSDCA57 kernel: >.n1.1di2n3:g/ >=20 > It eventually reported: >=20 > cp: /mnt/usr/obj/clang-armv7-installworld-poud.tar.alt: Device not = configured >=20 > Later, when I had things booted again and and did the > dhclient ue0 again, it reported: >=20 > nfs server a.a.a.a:/: is alive again >=20 > (The a.a.a.a is a local network address that I've > textually replaced. This was not remote location > use.) >=20 >=20 > I'll note that I've never had problems with the USB3 > SSD being the only USB device on the external USB3 > powered-hub. (But I do not normally use the USB3 hub.) > I think that is the 1st time that I've also plugged in > something else to the hub. >=20 To be clear: both the USB3 SSD and the USB3 Ethernet were plugged in to the external USB3 Hub before powering on the Rock64. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)