Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 11 Aug 2022 18:44:07 -0600
From:      Warner Losh <imp@bsdimp.com>
To:        John Baldwin <jhb@freebsd.org>
Cc:        Warner Losh <imp@freebsd.org>, src-committers <src-committers@freebsd.org>,  "<dev-commits-src-all@freebsd.org>" <dev-commits-src-all@freebsd.org>, dev-commits-src-main@freebsd.org
Subject:   Re: git: 39fdad34e220 - main - stand: impose 510,000 byte limit for /boot/loader and /boot/pxeldr
Message-ID:  <CANCZdfpxXvTabA5jGSv9mucjECw0uEzmsK0R9SdgV14FHO=oxQ@mail.gmail.com>
In-Reply-To: <ad8467cd-bbc7-37cf-b085-72bf34256431@FreeBSD.org>
References:  <202208110331.27B3Va7M007335@gitrepo.freebsd.org> <727af1f3-7432-c038-a776-682ef161f6f9@FreeBSD.org> <CANCZdfo-CyHD0jj==14Cimy9g77MqEBjZV1ho=TC7qgoDz6eCg@mail.gmail.com> <ad8467cd-bbc7-37cf-b085-72bf34256431@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
On Thu, Aug 11, 2022, 6:24 PM John Baldwin <jhb@freebsd.org> wrote:

> On 8/11/22 11:18 AM, Warner Losh wrote:
> > On Thu, Aug 11, 2022 at 10:56 AM John Baldwin <jhb@freebsd.org> wrote:
> >> You really want to apply the size check to loader.bin, not loader.  The
> >> memory
> >> layout down in the first 1MB for boot loaders is roughly:
> >>
> >> 0x0000: real-mode IDT
> >> 0x0400: BIOS data
> >> 0x7c00: where BIOS loads boot loaders such as /boot/mbr, etc.
> >> 0x1000: various BTX global data like GDT, TSS, IDT, stacks
> >> 0x9000: BTX kernel
> >> 0xa000: BTX client (loader.bin)
> >> 0xa0000: top of BTX client stack (though this can be a bit lower for
> cases
> >> like
> >>            PXE booting)
> >>
> >> The real size constraint is on the BTX client (loader.bin) and the fact
> >> that
> >> it's text/data/bss plus stack need to fit into that 576k window (give or
> >> take).
> >> btxldr isn't stored in low memory, so its size isn't relevant, and BTX's
> >> code
> >> always takes up a full page even though it is much smaller.
> >>
> >
> > Where does 576k come from? That's 589824 bytes, but a0000-a000 is 614400
> > bytes. The delta is 24k (24576). My 'observed' value of about 515,000 is
> > another
> > 75k below that, suggesting we are needing 100k of stack? Can that be
> right?
> > I knew
> > lua ate a lot of stack, but wow!
>
> Hmm, I converted 0xa000 to 64k instead of 40k in my head which is where
> the 576k came from.  Yeah, the total size is 600k.  100k stack does seem
> like a lot.  It is possible that other BIOS ROMs besides just PXE might
> steal data from the stack top.  You could maybe try looking at some of
> your existing BIOS-boot machines to check the 16-bit word at physical
> address 0x413.  That gives you the actual top of the 640k window.  On
> my current desktop (albeit booted via UEFI and not BIOS) it is 629k:
>
> % sudo dd if=/dev/mem bs=1 iseek=0x413 count=2 | hd
> 2+0 records in
> 2+0 records out
> 2 bytes transferred in 0.000026 secs (75643 bytes/sec)
> 00000000  75 02                                             |u.|
> 00000002
> % gdb
> ...
> (gdb) p/d 0x275
> $2 = 629
>
> Still, that's only 11k gone.
>
> I do think that when people have ran into trouble in the past it has been
> in situations that can recurse, e.g. using psuedo-filesystems like gzipfs
> where the gzipfs open routine tries to open the underlying "foo.gz" file,
> etc.
>

I ran into problems with a simple system... with lots of disks (10) visible
to the BIOS. And that was at 518kB. Just UFS. GZIP and BZIP2 were
configured bur not active.

Warner

-- 
> John Baldwin
>

[-- Attachment #2 --]
<div dir="auto"><div><br><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Aug 11, 2022, 6:24 PM John Baldwin &lt;<a href="mailto:jhb@freebsd.org">jhb@freebsd.org</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 8/11/22 11:18 AM, Warner Losh wrote:<br>
&gt; On Thu, Aug 11, 2022 at 10:56 AM John Baldwin &lt;<a href="mailto:jhb@freebsd.org" target="_blank" rel="noreferrer">jhb@freebsd.org</a>&gt; wrote:<br>
&gt;&gt; You really want to apply the size check to loader.bin, not loader.  The<br>
&gt;&gt; memory<br>
&gt;&gt; layout down in the first 1MB for boot loaders is roughly:<br>
&gt;&gt;<br>
&gt;&gt; 0x0000: real-mode IDT<br>
&gt;&gt; 0x0400: BIOS data<br>
&gt;&gt; 0x7c00: where BIOS loads boot loaders such as /boot/mbr, etc.<br>
&gt;&gt; 0x1000: various BTX global data like GDT, TSS, IDT, stacks<br>
&gt;&gt; 0x9000: BTX kernel<br>
&gt;&gt; 0xa000: BTX client (loader.bin)<br>
&gt;&gt; 0xa0000: top of BTX client stack (though this can be a bit lower for cases<br>
&gt;&gt; like<br>
&gt;&gt;            PXE booting)<br>
&gt;&gt;<br>
&gt;&gt; The real size constraint is on the BTX client (loader.bin) and the fact<br>
&gt;&gt; that<br>
&gt;&gt; it&#39;s text/data/bss plus stack need to fit into that 576k window (give or<br>
&gt;&gt; take).<br>
&gt;&gt; btxldr isn&#39;t stored in low memory, so its size isn&#39;t relevant, and BTX&#39;s<br>
&gt;&gt; code<br>
&gt;&gt; always takes up a full page even though it is much smaller.<br>
&gt;&gt;<br>
&gt; <br>
&gt; Where does 576k come from? That&#39;s 589824 bytes, but a0000-a000 is 614400<br>
&gt; bytes. The delta is 24k (24576). My &#39;observed&#39; value of about 515,000 is<br>
&gt; another<br>
&gt; 75k below that, suggesting we are needing 100k of stack? Can that be right?<br>
&gt; I knew<br>
&gt; lua ate a lot of stack, but wow!<br>
<br>
Hmm, I converted 0xa000 to 64k instead of 40k in my head which is where<br>
the 576k came from.  Yeah, the total size is 600k.  100k stack does seem<br>
like a lot.  It is possible that other BIOS ROMs besides just PXE might<br>
steal data from the stack top.  You could maybe try looking at some of<br>
your existing BIOS-boot machines to check the 16-bit word at physical<br>
address 0x413.  That gives you the actual top of the 640k window.  On<br>
my current desktop (albeit booted via UEFI and not BIOS) it is 629k:<br>
<br>
% sudo dd if=/dev/mem bs=1 iseek=0x413 count=2 | hd<br>
2+0 records in<br>
2+0 records out<br>
2 bytes transferred in 0.000026 secs (75643 bytes/sec)<br>
00000000  75 02                                             |u.|<br>
00000002<br>
% gdb<br>
...<br>
(gdb) p/d 0x275<br>
$2 = 629<br>
<br>
Still, that&#39;s only 11k gone.<br>
<br>
I do think that when people have ran into trouble in the past it has been<br>
in situations that can recurse, e.g. using psuedo-filesystems like gzipfs<br>
where the gzipfs open routine tries to open the underlying &quot;foo.gz&quot; file,<br>
etc.<br></blockquote></div></div><div dir="auto"><br></div><div dir="auto">I ran into problems with a simple system... with lots of disks (10) visible to the BIOS. And that was at 518kB. Just UFS. GZIP and BZIP2 were configured bur not active.</div><div dir="auto"><br></div><div dir="auto">Warner</div><div dir="auto"><br></div><div dir="auto"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
-- <br>
John Baldwin<br>
</blockquote></div></div></div>

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CANCZdfpxXvTabA5jGSv9mucjECw0uEzmsK0R9SdgV14FHO=oxQ>