From owner-freebsd-hackers@FreeBSD.ORG Fri May 12 15:27:14 2006 Return-Path: X-Original-To: freebsd-hackers@freebsd.org Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2A45516A752 for ; Fri, 12 May 2006 15:27:14 +0000 (UTC) (envelope-from silby@silby.com) Received: from relay01.pair.com (relay01.pair.com [209.68.5.15]) by mx1.FreeBSD.org (Postfix) with SMTP id 88DC143D49 for ; Fri, 12 May 2006 15:27:13 +0000 (GMT) (envelope-from silby@silby.com) Received: (qmail 14958 invoked from network); 12 May 2006 15:27:12 -0000 Received: from unknown (HELO localhost) (unknown) by unknown with SMTP; 12 May 2006 15:27:12 -0000 X-pair-Authenticated: 209.68.2.70 Date: Fri, 12 May 2006 10:27:10 -0500 (CDT) From: Mike Silbersack To: Iasen Kostov In-Reply-To: <1147437061.98918.24.camel@DraGoN.OTEL.net> Message-ID: <20060512102305.T1879@odysseus.silby.com> References: <1147264089.51661.10.camel@DraGoN.OTEL.net> <1147264379.51661.14.camel@DraGoN.OTEL.net> <1147265038.51661.19.camel@DraGoN.OTEL.net> <1147361590.33341.19.camel@DraGoN.OTEL.net> <20060512071711.GA714@turion.vk2pj.dyndns.org> <1147428461.98918.10.camel@DraGoN.OTEL.net> <20060512112809.GD714@turion.vk2pj.dyndns.org> <1147437061.98918.24.camel@DraGoN.OTEL.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Hackers Subject: Re: Heavy system load by pagedaemon X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 May 2006 15:27:14 -0000 On Fri, 12 May 2006, Iasen Kostov wrote: > Exactly what i did :). I set vm.pmap.shpgperproc=600 in loader.conf and > about 5 min after boot the system paniced and I was not able even to see > the message (either because I was pressing enter for the command or it > just doesn't wait for a key). Then i set it to 500 in loader at boot > time and currently it works but when it crashed used PV entries were ~4 > 300 000 now they go to ~5 000 000 and it doesn't panic. Which make me > think that the panic is not related to setting vm.pmap.shpgperproc to > 600 (which could probably lead to KVA exhastion) but to something else. > I'll try to increase KVA_PAGES (why isn't there tunable ?) and then set > vm.pmap.shpgperproc to some higher value, but this will be after a fresh > make world (I cvsuped already :( ) some time soon. Can you provide instructions on how to create a testbench that exhibits these same problems? Can eAccelerator + PHP + Apache + some simple script + apachebench do the trick? If so, that would allow other people to work on the problem. Kris Kennaway seems to like benchmarking; maybe you could pry him temporarily away from MySQL benchmarking to take a look at this. Also note that Peter Wemm has been reducing the size of PV Entries in -current, as he was running out of KVA due to them too - maybe he could provide you with a patch for 6.x with the same feature. Here's part of his description of the change: --- This is important because of the following scenario. If you have a 1GB file (262144 pages) mmap()ed into 50 processes, that requires 13 million pv entries. At 24 bytes per pv entry, that is 314MB of ram and kvm, while at 12 bytes it is 157MB. A 157MB saving is significant. --- HTH, Mike "Silby" Silbersack