Date: Mon, 11 Jul 2022 08:38:33 -0600 From: Warner Losh <imp@bsdimp.com> To: "Rodney W. Grimes" <freebsd-rwg@gndrsh.dnsmgr.net> Cc: Mark Millard <marklmi@yahoo.com>, "Dr. Rolf Jansen" <freebsd-rj@cyclaero.com>, freebsd-arm <freebsd-arm@freebsd.org> Subject: Re: Partition layout of ARM SD card images Message-ID: <CANCZdfp-UUSuLwY=mVZX6HgRTnk4V1v5d8NP6tsguMpaZ4U3Hw@mail.gmail.com> In-Reply-To: <202207111431.26BEVXCf037801@gndrsh.dnsmgr.net> References: <97AEE0AA-7EB1-44B6-9175-841425077974@yahoo.com> <202207111431.26BEVXCf037801@gndrsh.dnsmgr.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--0000000000004b4a7c05e388827f Content-Type: text/plain; charset="UTF-8" On Mon, Jul 11, 2022 at 8:31 AM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > On 2022-Jul-10, at 14:34, Dr. Rolf Jansen <freebsd-rj@cyclaero.com> > wrote: > > > > >> Am 10.07.2022 um 17:48 schrieb Mark Millard <marklmi@yahoo.com>: > > >> > > >> On 2022-Jul-10, at 12:26, Dr. Rolf Jansen <freebsd-rj@cyclaero.com> > wrote: > > >> > > >>> For example let's have a llok on the partition layout of, > FreeBSD-13.1-RELEASE-arm64-aarch64-RPI.img (the others are similar): > > >>> > > >>> # mdconfig -a -u 0 -t vnode -f > diskimg/FreeBSD-13.1-RELEASE-arm64-aarch64-RPI.img > > >>> # gpart show md0 md0s2 > > >>> > > >>> => 63 6291393 md0 MBR (3.0G) > > >>> 63 2016 - free - (1.0M) > > >>> 2079 102312 1 fat32lba [active] (50M) > > >>> 104391 6187041 2 freebsd (3.0G) > > >>> 6291432 24 - free - (12K) > > >>> > > >>> => 0 6187041 md0s2 BSD (3.0G) > > >>> 0 57 - free - (29K) > > >>> 57 6186880 1 freebsd-ufs (2.9G) > > >>> 6186937 104 - free - (52K) > > >>> > > >>> The start of the fat32 boot slice s1 (containing the u-boot) stuff > is neither aligned to 1M nor to 4k, it starts on an odd base. The start of > the BSD payload slice s2 and its size are odd as well. The padding of 57 > blocks within s2 lets the UFS partition start on a globally even base, > namely 104391+57 = 104448, which as a matter of fact is 4k aligned > (104448*512/4096 = 13056) and 1M aligned as well (104448*512/1024/1024 = > 51), however all this keeps looking strange. > > >>> > > >>> Are there reasons for this partition layout besides making it look > more interesting? If yes, some insights would be good. > > >> > > >> The layout details are more specific to the aarch64 RPi* context > > >> than to general aarch64 SD card images. For example, the Rock64 > > >> image is different: > > >> > > >> # mdconfig -a -u 0 -t vnode -f > FreeBSD-14.0-CURRENT-arm64-aarch64-ROCK64-20220708-a0b956f5ac5-256605.img > > >> # gpart show md0 > > >> => 40 6291376 md0 GPT (3.0G) > > >> 40 32728 - free - (16M) > > >> 32768 102400 1 efi (50M) > > >> 135168 6156160 2 freebsd-ufs (2.9G) > > >> 6291328 88 - free - (44K) > > > > > > This is a GPT table, while the others are still MBR. Images which come > with u-boot must have a different layout. > > > > I know it is a GPT table. That is part of the point about > > the variety of contexts that there are across the Small > > Board Computers. > > > > No SBC that has a U-Boot/whatever needing more space > > than is provided below is going to use the same > > 2079 figure: > > > > => 63 ??? md0 ??? (?) > > 63 2016 - free - (1.0M) > > I read this thread.. and it keeps nagging me in > the back of the head, I know this 2016 number. > It is common when the sectors per track of a > drive is reported as "32", its an attempt to > 1M align such a drive, is somehow the image > creation code picking up 32 to do the align > calculation wrongly on a 63 sector/track > image? > > > 2079 ?????? 1 fat32lba [active] (?) > > The OP is correct, this is a horrid state of alignment > and the cause should be tracked down and fixed! I > can see no valid reason to have an approx > 1MB free hole that causes this missalignment, > that free hole should be (2048-63)=1985 > Yes, we should be aligning at a 1M or 2M boundary on the root device, not within the partition. The offsets are supposed to do that, and if there's a problem we should fix it. > AHhhhh thought hits me... did the code get changed > to make the images larger, and somehow the image > creation code went from a 32 sector/track fake C/H/S > to a 63 sector fake C/H/S, and the code has all > along been assuming 32 sector/track drives? > 63 sector for 'fake' C/H/S has been a thing since at least FreeBSD 6 and maybe a little longer. There's no cutover based on image size of the device. The older ATA code, pre-cam but post SOS rewrite, would try very hard to return the values from the underlying device that it reported. And that would lead to mismatches because it was different than the lies that md told by default. But that only mattered for really old BIOSes that couldn't handle LBA/packet mode in booting (which is the primary reason the old fdisk program could set the ending CHS of partitions since the FreeBSD code used that to guess the CHS of the drive itself in the absence of other information). I don't think the kernel has changed in this area in a very long time. At worse, we're seeing a mkimage bug. Warner > > > > MBR vs. GPT is not the fundamental issue for that. > > > > === > > Mark Millard > > marklmi at yahoo.com > > > > > > > > > > -- > Rod Grimes > rgrimes@freebsd.org > > --0000000000004b4a7c05e388827f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div dir=3D"ltr"><br></div><br><div class=3D"gmail_quote">= <div dir=3D"ltr" class=3D"gmail_attr">On Mon, Jul 11, 2022 at 8:31 AM Rodne= y W. Grimes <<a href=3D"mailto:freebsd-rwg@gndrsh.dnsmgr.net">freebsd-rw= g@gndrsh.dnsmgr.net</a>> wrote:<br></div><blockquote class=3D"gmail_quot= e" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204)= ;padding-left:1ex">> <br> > On 2022-Jul-10, at 14:34, Dr. Rolf Jansen <<a href=3D"mailto:freebs= d-rj@cyclaero.com" target=3D"_blank">freebsd-rj@cyclaero.com</a>> wrote:= <br> > <br> > >> Am 10.07.2022 um 17:48 schrieb Mark Millard <<a href=3D"ma= ilto:marklmi@yahoo.com" target=3D"_blank">marklmi@yahoo.com</a>>:<br> > >> <br> > >> On 2022-Jul-10, at 12:26, Dr. Rolf Jansen <<a href=3D"mail= to:freebsd-rj@cyclaero.com" target=3D"_blank">freebsd-rj@cyclaero.com</a>&g= t; wrote:<br> > >> <br> > >>> For example let's have a llok on the partition layout= of, FreeBSD-13.1-RELEASE-arm64-aarch64-RPI.img (the others are similar):<b= r> > >>> <br> > >>> # mdconfig -a -u 0 -t vnode -f diskimg/FreeBSD-13.1-RELEA= SE-arm64-aarch64-RPI.img<br> > >>> # gpart show md0 md0s2<br> > >>> <br> > >>> =3D>=C2=A0 =C2=A0 =C2=A063=C2=A0 6291393=C2=A0 md0=C2= =A0 MBR=C2=A0 (3.0G)<br> > >>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 63=C2=A0 =C2=A0 =C2=A02016=C2= =A0 =C2=A0 =C2=A0 =C2=A0- free -=C2=A0 (1.0M)<br> > >>>=C2=A0 =C2=A0 =C2=A0 2079=C2=A0 =C2=A0102312=C2=A0 =C2=A0 = 1=C2=A0 fat32lba=C2=A0 [active]=C2=A0 (50M)<br> > >>>=C2=A0 =C2=A0 104391=C2=A0 6187041=C2=A0 =C2=A0 2=C2=A0 fr= eebsd=C2=A0 (3.0G)<br> > >>>=C2=A0 =C2=A06291432=C2=A0 =C2=A0 =C2=A0 =C2=A024=C2=A0 = =C2=A0 =C2=A0 =C2=A0- free -=C2=A0 (12K)<br> > >>> <br> > >>> =3D>=C2=A0 =C2=A0 =C2=A0 0=C2=A0 6187041=C2=A0 md0s2= =C2=A0 BSD=C2=A0 (3.0G)<br> > >>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00=C2=A0 =C2=A0 =C2=A0 = =C2=A057=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0- free -=C2=A0 (29K)<br> > >>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 57=C2=A0 6186880=C2=A0 =C2=A0 = =C2=A0 1=C2=A0 freebsd-ufs=C2=A0 (2.9G)<br> > >>>=C2=A0 =C2=A06186937=C2=A0 =C2=A0 =C2=A0 104=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0- free -=C2=A0 (52K)<br> > >>> <br> > >>> The start of the fat32 boot slice s1 (containing the u-bo= ot) stuff is neither aligned to 1M nor to 4k, it starts on an odd base. The= start of the BSD payload slice s2 and its size are odd as well. The paddin= g of 57 blocks within s2 lets the UFS partition start on a globally even ba= se, namely 104391+57 =3D 104448, which as a matter of fact is 4k aligned (1= 04448*512/4096 =3D 13056) and 1M aligned as well (104448*512/1024/1024 =3D = 51), however all this keeps looking strange.<br> > >>> <br> > >>> Are there reasons for this partition layout besides makin= g it look more interesting? If yes, some insights would be good.<br> > >> <br> > >> The layout details are more specific to the aarch64 RPi* cont= ext<br> > >> than to general aarch64 SD card images. For example, the Rock= 64<br> > >> image is different:<br> > >> <br> > >> # mdconfig -a -u 0 -t vnode -f=C2=A0 FreeBSD-14.0-CURRENT-arm= 64-aarch64-ROCK64-20220708-a0b956f5ac5-256605.img<br> > >> # gpart show md0<br> > >> =3D>=C2=A0 =C2=A0 =C2=A040=C2=A0 6291376=C2=A0 md0=C2=A0 G= PT=C2=A0 (3.0G)<br> > >>=C2=A0 =C2=A0 =C2=A0 40=C2=A0 =C2=A0 32728=C2=A0 =C2=A0 =C2=A0= =C2=A0- free -=C2=A0 (16M)<br> > >>=C2=A0 =C2=A032768=C2=A0 =C2=A0102400=C2=A0 =C2=A0 1=C2=A0 efi= =C2=A0 (50M)<br> > >>=C2=A0 135168=C2=A0 6156160=C2=A0 =C2=A0 2=C2=A0 freebsd-ufs= =C2=A0 (2.9G)<br> > >> 6291328=C2=A0 =C2=A0 =C2=A0 =C2=A088=C2=A0 =C2=A0 =C2=A0 =C2= =A0- free -=C2=A0 (44K)<br> > > <br> > > This is a GPT table, while the others are still MBR. Images which= come with u-boot must have a different layout.<br> > <br> > I know it is a GPT table. That is part of the point about<br> > the variety of contexts that there are across the Small<br> > Board Computers.<br> > <br> > No SBC that has a U-Boot/whatever needing more space<br> > than is provided below is going to use the same<br> > 2079 figure:<br> > <br> > =3D>=C2=A0 =C2=A0 =C2=A063=C2=A0 ???=C2=A0 md0=C2=A0 ???=C2=A0 (?)<= br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 63=C2=A0 =C2=A0 =C2=A02016=C2=A0 =C2=A0 =C2= =A0 =C2=A0- free -=C2=A0 (1.0M)<br> <br> I read this thread.. and it keeps nagging me in<br> the back of the head, I know this 2016 number.<br> It is common when the sectors per track of a<br> drive is reported as "32", its an attempt to<br> 1M align such a drive, is somehow the image<br> creation code picking up 32 to do the align<br> calculation wrongly on a 63 sector/track<br> image?<br> <br> >=C2=A0 =C2=A0 =C2=A0 2079=C2=A0 =C2=A0??????=C2=A0 =C2=A0 1=C2=A0 fat32= lba=C2=A0 [active]=C2=A0 (?)<br> <br> The OP is correct, this is a horrid state of alignment<br> and the cause should be tracked down and fixed!=C2=A0 I<br> can see no valid reason to have an approx<br> 1MB free hole that causes this missalignment,<br> that free hole should be (2048-63)=3D1985<br></blockquote><div><br></div><d= iv>Yes, we should be aligning at a 1M or 2M boundary on the</div><div>root = device, not within the partition. The offsets are supposed</div><div>to do = that, and if there's a problem we should fix it.</div><div>=C2=A0</div>= <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left:1px solid rgb(204,204,204);padding-left:1ex"> AHhhhh thought hits me... did the code get changed<br> to make the images larger, and somehow the image<br> creation code went from a 32 sector/track fake C/H/S<br> to a 63 sector fake C/H/S, and the code has all<br> along been assuming 32 sector/track drives?<br></blockquote><div><br></div>= <div>63 sector for 'fake' C/H/S has been a thing since at least</di= v><div>FreeBSD 6 and maybe a little longer. There's no cutover</div><di= v>based on image size of the device. The older ATA code,</div><div>pre-cam = but post SOS rewrite, would try very hard to return</div><div>the values fr= om the underlying device that it reported. And that</div><div>would lead to= mismatches because it was different than the lies</div><div>that md told b= y default. But that only mattered for really old</div><div>BIOSes that coul= dn't handle LBA/packet mode in booting (which</div><div>is the primary = reason the old fdisk program could set the ending CHS</div><div>of partitio= ns since the FreeBSD code used that to guess the CHS</div><div>of the drive= itself in the absence of other information).</div><div><br></div><div>I do= n't think the kernel has changed in this area in a very long time.</div= ><div>At worse, we're seeing a mkimage bug.</div><div><br></div><div>Wa= rner</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margi= n:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex= "> > <br> > MBR vs. GPT is not the fundamental issue for that.<br> > <br> > =3D=3D=3D<br> > Mark Millard<br> > marklmi at <a href=3D"http://yahoo.com" rel=3D"noreferrer" target=3D"_= blank">yahoo.com</a><br> > <br> > <br> > <br> > <br> <br> -- <br> Rod Grimes=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0<a href=3D"mailto:rgrimes@freebsd.org= " target=3D"_blank">rgrimes@freebsd.org</a><br> <br> </blockquote></div></div> --0000000000004b4a7c05e388827f--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CANCZdfp-UUSuLwY=mVZX6HgRTnk4V1v5d8NP6tsguMpaZ4U3Hw>