From owner-freebsd-hackers Thu Jun 21 5:24:56 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from perninha.conectiva.com.br (perninha.conectiva.com.br [200.250.58.156]) by hub.freebsd.org (Postfix) with ESMTP id 63D3237B401 for ; Thu, 21 Jun 2001 05:24:47 -0700 (PDT) (envelope-from riel@conectiva.com.br) Received: from burns.conectiva (burns.conectiva [10.0.0.4]) by perninha.conectiva.com.br (Postfix) with SMTP id 2CBB538CBB for ; Thu, 21 Jun 2001 09:24:41 -0300 (EST) Received: (qmail 2415 invoked by uid 0); 21 Jun 2001 12:23:20 -0000 Received: from duckman.distro.conectiva (HELO duckman.conectiva.com.br) (root@10.0.17.2) by burns.conectiva with SMTP; 21 Jun 2001 12:23:20 -0000 Received: from localhost (riel@localhost) by duckman.conectiva.com.br (8.11.3/8.11.3) with ESMTP id f5LCObn06378; Thu, 21 Jun 2001 09:24:38 -0300 X-Authentication-Warning: duckman.distro.conectiva: riel owned process doing -bs Date: Thu, 21 Jun 2001 09:24:37 -0300 (BRST) From: Rik van Riel X-X-Sender: To: Terry Lambert Cc: Matt Dillon , "Ashutosh S. Rajekar" , Subject: Re: max kernel memory In-Reply-To: <3B3190D9.D38B903D@mindspring.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On Wed, 20 Jun 2001, Terry Lambert wrote: > Back to swapping socket structures... > > You could swap them if you wanted to give up some KVA > space to be able to do it. Which is a problem, especially for Linux. The problem here is that there are x86 machines around with 64GB of RAM. Linux has just under 1GB of KVA and FreeBSD has (IIRC) 2GB of KVA. Even the FreeBSD figure is just 3% of RAM on those machines. With the KVA being that low a percentage of the total amount of physical memory, you really have to watch carefully at all the excess fat on your data structures... This would certainly be true for the page table and pmap architecture in FreeBSD; Linux is already running into the problem that under some (common on such machines) workloads on the 16GB - 64GB sized machines the needed page tables are almost as large as the total KVA. The solution for this will probably be the use of 2MB pages for the large SHM segments and mmap()ed files. This way we can keep the flexibility of paging (needed by SAP) and bring the pagetable overhead down a factor of 512 ;) > I personally do not think that that is worth it: Nothing but violent agreement here. > The really fundamental problems with FreeBSD at this > point devolve down to some moderately easily repaired > historical artifacts in its VM architecture and allocation > techniques and policies, as well as administrative > limits for "general purpose" use being the defaults, > with no way to "autotune" based on workload. Most of > the fixes have been known in the literature since the > early and mid 1990's (though some are more recent). These aren't even that fundamental. In Linux 2.2 and 2.4 we solved most of these autotune thingies without too much impact on the code. The only major problem is that the writers of each subsystem set a too high maximum for their subsystem ... something I'm slowly getting around to fixing ;) cheers, Rik -- Executive summary of a recent Microsoft press release: "we are concerned about the GNU General Public License (GPL)" http://www.surriel.com/ http://www.conectiva.com/ http://distro.conectiva.com/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message