Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 10 Nov 2012 21:55:17 -0800
From:      Peter Wemm <peter@wemm.org>
To:        Andre Oppermann <andre@freebsd.org>
Cc:        src-committers@freebsd.org, Eitan Adler <eadler@freebsd.org>, Alfred Perlstein <alfred@freebsd.org>, svn-src-all@freebsd.org, Alfred Perlstein <bright@mu.org>, svn-src-head@freebsd.org
Subject:   Re: svn commit: r242847 - in head/sys: i386/include kern
Message-ID:  <CAGE5yCp60f2Gf1evkfCszCB-JeVeUFWNxC42cvWU-BzbQFiFYg@mail.gmail.com>
In-Reply-To: <509EA869.6030407@freebsd.org>
References:  <201211100208.qAA28e0v004842@svn.freebsd.org> <CAF6rxg=HPmQS1T-LFsZ=DuKEqH30iJFpkz%2BJGhLr4OBL8nohjg@mail.gmail.com> <509DC25E.5030306@mu.org> <509E3162.5020702@FreeBSD.org> <509E7E7C.9000104@mu.org> <CAF6rxgmV8dx-gsQceQKuMQEsJ%2BGkExcKYxEvQ3kY%2B5_nSjvA3w@mail.gmail.com> <509E830D.5080006@mu.org> <509E847E.30509@mu.org> <CAF6rxgnfm4HURYp=O4MY8rB6H1tGiqJ3rdPx0rZ8Swko5mAOZg@mail.gmail.com> <509E8930.50800@mu.org> <CAF6rxgmabVuR0JoFURRUF%2Bed0hmT=LF_n5LXSip0ibU0hk6qWw@mail.gmail.com> <CAGE5yCouCWr4NKbgnjKfLcjc8EWqG0wRiSmXDDnrnM3%2BUc8KVQ@mail.gmail.com> <CAF6rxg=ryNEMEidJdgf8-Ab=bD15R1ypcz-bS8183U4JK_Q17g@mail.gmail.com> <CAGE5yCoeTXf7x4ZBDXnHJ4dnFi-_2R28kB8HxOB%2B=Je4aJGYQQ@mail.gmail.com> <509EA869.6030407@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On Sat, Nov 10, 2012 at 11:18 AM, Andre Oppermann <andre@freebsd.org> wrote:
> On 10.11.2012 19:04, Peter Wemm wrote:
>>
>> On Sat, Nov 10, 2012 at 9:48 AM, Eitan Adler <eadler@freebsd.org> wrote:
>>>
>>> On 10 November 2012 12:45, Peter Wemm <peter@wemm.org> wrote:
>>>>
>>>> On Sat, Nov 10, 2012 at 9:33 AM, Eitan Adler <eadler@freebsd.org> wrote:
>>>>>
>>>>> On 10 November 2012 12:04, Alfred Perlstein <bright@mu.org> wrote:
>>>>>>
>>>>>> Sure, if you'd like you can help me craft that comment now?
>>>>>
>>>>>
>>>>> I think this is short and clear:
>>>>> ===
>>>>> Limit the amount of kernel address space used to a fixed cap.
>>>>> 384 is an arbitrarily chosen value that leaves 270 MB of KVA available
>>>>> of the 2 MB total. On systems with large amount of memory reduce the
>>>>> the slope of the function in order to avoiding exhausting KVA.
>>>>> ===
>>>>
>>>>
>>>> That's actually completely 100% incorrect...
>>>
>>>
>>> okay. I'm going by the log messages posted so far. I have no idea how
>>> this works. Can you explain it better?
>>
>>
>> That's exactly my point..
>>
>> You get 1 maxuser per 2MB of physical ram.
>> If you get more than 384 maxusers (ie: 192GB of ram) we scale it
>> differently for the part past 192GB.  I have no idea how the hell to
>
>
> Rather past 768MB of RAM.

You're right. It is 768M ram before the slope of the cap changes.

maxusers = physpages / (2 * 1024 * 1024 / PAGE_SIZE);

This is simple math.
physpages is units of pages.
(2 * 1024 * 1024 / PAGE_SIZE) = 2MB, converted to pages.
So maxusers = 1 per 2MB of physical ram.

20MB of ram calculates maxusers = 10.
768M ram gives maxusers = 384.
Above 768M, one maxuser is allocated per 2 * 8 = 16MB of ram.
4G gives maxusers = 592.
16G gives maxusers = 1360.

>> calculate that.
>> You get an unlimited number of regular mbufs.
>> You get 64 clusters per maxuser (128k)
>> Unless I fubared the numbers, this currently works out to be 6%, or 1/16.
>>
>> Each MD backend gets to provide a cap for maxusers, which is in units
>> of 2MB.  For an i386 PAE machine you have a finite amount of KVA space
>> (1GB, but this is adjustable.. you can easily configure it for 3GB kva
>> with one compile option for the kernel).  The backends where the
>> nmbclusters comes out of KVA should calculate the number of 2MB units
>> to avoid running out of KVA.
>>
>> amd64 does a mixture of direct map and kva allocations. eg: mbufs and
>> clusters come from direct map, the jumbo clusters come from kva.

I'm aware of this.  Behavior of how to set a "Don't die" exhaustion is MD.

-- 
Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV
"All of this is for nothing if we don't go to the stars" - JMS/B5
"If Java had true garbage collection, most programs would delete
themselves upon execution." -- Robert Sewell



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGE5yCp60f2Gf1evkfCszCB-JeVeUFWNxC42cvWU-BzbQFiFYg>