Date: Sat, 10 Nov 2012 21:55:17 -0800 From: Peter Wemm <peter@wemm.org> To: Andre Oppermann <andre@freebsd.org> Cc: src-committers@freebsd.org, Eitan Adler <eadler@freebsd.org>, Alfred Perlstein <alfred@freebsd.org>, svn-src-all@freebsd.org, Alfred Perlstein <bright@mu.org>, svn-src-head@freebsd.org Subject: Re: svn commit: r242847 - in head/sys: i386/include kern Message-ID: <CAGE5yCp60f2Gf1evkfCszCB-JeVeUFWNxC42cvWU-BzbQFiFYg@mail.gmail.com> In-Reply-To: <509EA869.6030407@freebsd.org> References: <201211100208.qAA28e0v004842@svn.freebsd.org> <CAF6rxg=HPmQS1T-LFsZ=DuKEqH30iJFpkz%2BJGhLr4OBL8nohjg@mail.gmail.com> <509DC25E.5030306@mu.org> <509E3162.5020702@FreeBSD.org> <509E7E7C.9000104@mu.org> <CAF6rxgmV8dx-gsQceQKuMQEsJ%2BGkExcKYxEvQ3kY%2B5_nSjvA3w@mail.gmail.com> <509E830D.5080006@mu.org> <509E847E.30509@mu.org> <CAF6rxgnfm4HURYp=O4MY8rB6H1tGiqJ3rdPx0rZ8Swko5mAOZg@mail.gmail.com> <509E8930.50800@mu.org> <CAF6rxgmabVuR0JoFURRUF%2Bed0hmT=LF_n5LXSip0ibU0hk6qWw@mail.gmail.com> <CAGE5yCouCWr4NKbgnjKfLcjc8EWqG0wRiSmXDDnrnM3%2BUc8KVQ@mail.gmail.com> <CAF6rxg=ryNEMEidJdgf8-Ab=bD15R1ypcz-bS8183U4JK_Q17g@mail.gmail.com> <CAGE5yCoeTXf7x4ZBDXnHJ4dnFi-_2R28kB8HxOB%2B=Je4aJGYQQ@mail.gmail.com> <509EA869.6030407@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sat, Nov 10, 2012 at 11:18 AM, Andre Oppermann <andre@freebsd.org> wrote: > On 10.11.2012 19:04, Peter Wemm wrote: >> >> On Sat, Nov 10, 2012 at 9:48 AM, Eitan Adler <eadler@freebsd.org> wrote: >>> >>> On 10 November 2012 12:45, Peter Wemm <peter@wemm.org> wrote: >>>> >>>> On Sat, Nov 10, 2012 at 9:33 AM, Eitan Adler <eadler@freebsd.org> wrote: >>>>> >>>>> On 10 November 2012 12:04, Alfred Perlstein <bright@mu.org> wrote: >>>>>> >>>>>> Sure, if you'd like you can help me craft that comment now? >>>>> >>>>> >>>>> I think this is short and clear: >>>>> === >>>>> Limit the amount of kernel address space used to a fixed cap. >>>>> 384 is an arbitrarily chosen value that leaves 270 MB of KVA available >>>>> of the 2 MB total. On systems with large amount of memory reduce the >>>>> the slope of the function in order to avoiding exhausting KVA. >>>>> === >>>> >>>> >>>> That's actually completely 100% incorrect... >>> >>> >>> okay. I'm going by the log messages posted so far. I have no idea how >>> this works. Can you explain it better? >> >> >> That's exactly my point.. >> >> You get 1 maxuser per 2MB of physical ram. >> If you get more than 384 maxusers (ie: 192GB of ram) we scale it >> differently for the part past 192GB. I have no idea how the hell to > > > Rather past 768MB of RAM. You're right. It is 768M ram before the slope of the cap changes. maxusers = physpages / (2 * 1024 * 1024 / PAGE_SIZE); This is simple math. physpages is units of pages. (2 * 1024 * 1024 / PAGE_SIZE) = 2MB, converted to pages. So maxusers = 1 per 2MB of physical ram. 20MB of ram calculates maxusers = 10. 768M ram gives maxusers = 384. Above 768M, one maxuser is allocated per 2 * 8 = 16MB of ram. 4G gives maxusers = 592. 16G gives maxusers = 1360. >> calculate that. >> You get an unlimited number of regular mbufs. >> You get 64 clusters per maxuser (128k) >> Unless I fubared the numbers, this currently works out to be 6%, or 1/16. >> >> Each MD backend gets to provide a cap for maxusers, which is in units >> of 2MB. For an i386 PAE machine you have a finite amount of KVA space >> (1GB, but this is adjustable.. you can easily configure it for 3GB kva >> with one compile option for the kernel). The backends where the >> nmbclusters comes out of KVA should calculate the number of 2MB units >> to avoid running out of KVA. >> >> amd64 does a mixture of direct map and kva allocations. eg: mbufs and >> clusters come from direct map, the jumbo clusters come from kva. I'm aware of this. Behavior of how to set a "Don't die" exhaustion is MD. -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV "All of this is for nothing if we don't go to the stars" - JMS/B5 "If Java had true garbage collection, most programs would delete themselves upon execution." -- Robert Sewell
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGE5yCp60f2Gf1evkfCszCB-JeVeUFWNxC42cvWU-BzbQFiFYg>