From owner-freebsd-arm@freebsd.org Thu May 6 12:55:29 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 31F6B5FFDD1 for ; Thu, 6 May 2021 12:55:29 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-19.consmr.mail.gq1.yahoo.com (sonic313-19.consmr.mail.gq1.yahoo.com [98.137.65.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbYTX1tcWz4fHd for ; Thu, 6 May 2021 12:55:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620305725; bh=vOPfUuyYxfVAny9AWMisHji9BQzPvCStUTYEpcy8suC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=nNXk88fW5+3f2YSO1DIfg2pfTiW/2kJQqYMNWiO/a367sr4KlmlXNQFB9ZEqiMIulaYH9TzcRPA/VsW1REdy9jZC5wNGpLrnMvtu5zkx5AaJVdRqdNaKeAMph2KGtGwJPMJ9Pjyf5Ly31RoEdShjuFl9OCxzSkPIJrQg2SYAnEeG67ivFNCCJJ4EjkGSBhjHjb1U68Y31+o7VV3M2kYN4oxh8xxfHkVLxdF1GrBhE79e9j3swwrZENexoenJ14RRyAq6A3WLqPKN276pYz8OqCDn5EzKxbUF35/RuiICO+kRoQaSu6qh5sWbQx2WUZyTjXCiNOHcfaGf7TBDw9L58w== X-YMail-OSG: 4QvzJqsVM1mlREN9z1jlVRi3pKtdEmuejXB_OZAjuKxH.EGz4ny0WrHV99LYJgb g2_mdxFHfSEJDIWeM2tlXEbRfm9gUUyWBeSDFBhmtjHY19bB4pCofHudd5z2D_dmKM49lLm_OC8m QeQIMfZQxCY2npkY8ZFzfhTcvD0.v55xtFBd6n.gKXz1NafgfC.40VsBSYOqHfXPwlz6J74f5hLW Ym1HQTVSQuC_DlkdlYq2oi7qeTC6PvZmAVLcNJYfP37SBZ6mP3RBDeE9Bh_tMVN5FVzLIG7gWHkT XVV_GcvozI.MsWezDluYjfoaehCZ36h4fLcdcleKlP0W9aHY2n3UUk0SjgsWpke1ZzK9BbrrjDVI k.8QoMDlRrK.vzgnp11cnEl3G3FC2NhzhYDJ7a.ZYMWn81xfXkvqlaC_9tbw1e6YAdsIXlmbsd0y cL8YlRdk5cxdGl6UvCv0cJqSCYahK4_6Fi2JJWiMf8WI9XmVddPH97OxygYgueEh6pgzBxWU16cf 5Jx1h3QCeAfRsM.0wX.qAfB6A9cqAfVmNN_EKJ6aJSKF016oeg42ei7CqrXj5iGAi3GyLoNG0H3. tURmZAJfO8hyZvQ2QLjsCRnqgTgILXPnBorTkoJbtqHj3PhLZLrmNVvB.jAmah3RVzsi2nRfTs.x ovuXqNGBSd854iKtaW1oaprEkdZ8l6J9BnzUyPk_UXk_dOCoAV68UUU08BPDdhfYDDonptGxWbYD MgSmEn2NyiVdN99rN1pLd8WQ1.kYjPzPNwtNyt81SqDClizd7L7gONImXl9P7DrQH6cSQOz.qr__ hECfWzJVenD1XlhWAeyrPcLIOd5xHoWc7ens74bs09Bv4MDmrRV5WJ6jk213HlYP2ViOUQG1ncuq VF2WZvYlSk0KRLrpoOF15xI5CxbrcIgFjdG757PufiNT68u6tUYFPnF8ZLPCbW3VB6wfmQa6xzOb AzGOiSy_QUwb6xrTYC5GuFQsxpfB9LPmHJWkjXSTZsZL4CRhbnvq6Fd_4yhlwnfMTluSo0yNrwn6 jm1do6XbbTwaEK.ofyAO8HsvcLMTMBMXA4X6XprG2mkC1duI02qRWbeiRU75p4zV0Dg6jIF2X5j8 VBrzxtvn40w8m.YruUXkoWlMTsgzNvdHmOr0QruTsmqu.HlcATY_Up5aMo6g6htL2miFOUQDcFrg ONZ1xIANViq8es2he5luXW41La8Ss7iEqUdhOUvM7GQcmOX93_2wUVE2_BM0E6dJnjUCdzvNY7QL Ki8k8u5yO2RPH8BkRQhNBccs3H0l2eCgibRfU6FN662sBQtkvPKMfOKd1jDXGtTNgptefhp3JGnw o.ep9kyAG68Piq_c7ckO9ftqpdSJ5FPuwPTHBrFxQhPDT6zxQVUIrAWLKvgWqD_7W47oE8BSpaUC tdqg_k18HH1IM7ap9gVIab.2IgxrgBB7.BJwl4sUl8379HbZzjOE7f0Z5mvCsxP8dt1kKWOWWomc Tqof.gMmw.KyDcmCdRP7SdEmNhjTnBdyj8vuO_QN2PtiC2z6uFuIOgR9mEi9iFKPUmlEzk4SGMkI YYWjdlhw4XBJ9gxOTYctEFCxqwzNoUrqxpiSRPYRpA_2kAtccTI8zmNONZgw3UMpMrHz8P4o_aY8 YPa4SAh3DmRsIen_X2.xRof2rl0t2aV3baknudFCqHe3UxiZ7kyFke7TVUyJlWqdJBAdLVDhjEtF 7CE6Xtcc0L0NHkLrB1CROxjfYIJyV84MsolA6dQv3AX59KBj_rI3l4znm4.4UJ8qcjc9nM0rcgQT D15FOF9.ZpE3ip_HCaKaGLBCENzsfpOnd7a4MQhOeFflsWwOajYtCvwI21CwpDQTA.Q1AoToq.T0 LRgdlnMkVVMaQMu09Hm6ebkReDxDR3YgtbpfLpBW2g518ZxEqZsAzk3Sm6FQnZuc0aOND3WOzwm0 Vw5B9msNOnHhl.VNcfcQEBjMFugYnJmKAEKlITQ2DulkYFBFH4Ot7vCT.uZzGck6LQ6qkIpjL9to rvkmsZsAVo6PmDV3zOIGOn5jQsewKM4F9lUkU88pqDf9xAY9DJh.JiZ95jH2Itd_je35ixx0DBEn oeOL87hIE3xfkwHv34Q.2gsdjsP6yyuDpNUg6FpqPyjPAv1_wIt3aUM1FJnImoIcNrDrejYTR9dP Ttvp.QwO3CPXDl2i4yq90AsYtYLDWd83Irr_2LuAw716NfOrR5gyvnShGpdRGU.mZ.sORzKchZZI Bz93x0hLqVf4jmKmsz9aTbXkJlQEgSEfP.UqSOoYZhwS78psERmN5mxX68QPGeYCmBQHmV7hILqq njmBFke67p2lqi1zj7ANZHr.kk2dHUB_ydYQ8OjYlMSyxVs75fxmU3BgiU5m2K4aD52x12fpYdKX RgtX2QBi13gE6LJHeSyM1KYJEfoXxf1j8lbeWkz55c1kcLJ.u2jgOms6w6XURW9sNF.dd4qjPEaB UGYy33NDkG81MMceuXHqwAoAWMOpp_uz0ArmAvJAZEzUyyNjGOjCSbHmXQWV4d1mHlJPw0rt1CWC V8q_BkUGjSHKUOdc- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Thu, 6 May 2021 12:55:25 +0000 Received: by kubenode568.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 01a99d040a6d467b008ed84fb2c1b371; Thu, 06 May 2021 12:55:21 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: rpi4 zfs-on-root boot-to-usb3 From: Mark Millard In-Reply-To: Date: Thu, 6 May 2021 05:55:21 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: To: tech-lists X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FbYTX1tcWz4fHd X-Spamd-Bar: - X-Spamd-Result: default: False [-1.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.82:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(1.00)[0.996]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.82:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.82:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.82:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 12:55:29 -0000 On 2021-May-6, at 04:12, tech-lists wrote: > How can zfs-on-root boot-to-usb3 on rpi4 be accomplished? > > I've tried bsdinstall from a mmcsd-booted rpi4 but there seems to be > problems with it that I can't work around. What's really needed is an > installer, but these aren't made for arm64.aarch64 rpi4 from what I can > see (I'm no expert though, it's entirely feasible i've missed > something). > > Maybe one way of doing it would be to have a usb key (as ufs2) for the > system to boot on, then have /home /usr/obj and other larger dirs on the > usb3-zfs disk. I used bsdinstall from booting a releng/13.0's release/13.0.0.0 microsd card in a 8 GiBYte RPi4B to produce the: # gpart show -pl da0 => 40 468862048 da0 GPT (224G) 40 532480 da0p1 efiboot0 (260M) 532520 2008 - free - (1.0M) 534528 25165824 da0p2 swp12a (12G) 25700352 25165824 da0p4 swp12b (12G) 50866176 417994752 da0p3 zfs0 (199G) 468860928 1160 - free - (580K) # gpart show -p da0 => 40 468862048 da0 GPT (224G) 40 532480 da0p1 efi (260M) 532520 2008 - free - (1.0M) 534528 25165824 da0p2 freebsd-swap (12G) 25700352 25165824 da0p4 freebsd-swap (12G) 50866176 417994752 da0p3 freebsd-zfs (199G) 468860928 1160 - free - (580K) that I'm using to experiment with bectl and the like. It boots the RPi4B 8 or 4 GiByte, the OverDrive 1000, and the MACCHIATObin Double Shot. (I had to separately add the RPi firmware and U-Boot to the efi file system efiboot0 in order to enable the RPi4B booting. Later I tried booting the other two.) But until I go back and do it again to another USB3 SSD, recording steps as I go, I can not supply a step-by-step sequence to go through. I might have to again figure things out that I figured out the first time. I just do not remember all the detail. It had been years since I'd used bsdinstall. It will be a while before I can try that but I expect that I can and I then I should be able to report an example sequence. (I split the original swap space in two later. I use only 1 of them as swap for 4 GiByte RPi4B's. Part of my experiments have been using tmpfs in poudriere and the large swap total for 8 GiBYte+ machines is tied to that activity for how I have poudriere configured and building things like llvm*, possibly multiple of them in parallel.) === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)