From owner-freebsd-stable@FreeBSD.ORG Sat Jun 17 21:24:35 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D0C3116A474 for ; Sat, 17 Jun 2006 21:24:35 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.FreeBSD.org (Postfix) with ESMTP id 610DA43D48 for ; Sat, 17 Jun 2006 21:24:35 +0000 (GMT) (envelope-from scrappy@hub.org) Received: from localhost (mx1.hub.org [200.46.208.251]) by hub.org (Postfix) with ESMTP id 78D3B290C20; Sat, 17 Jun 2006 18:24:31 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 71617-09; Sat, 17 Jun 2006 18:24:34 -0300 (ADT) Received: from ganymede.hub.org (blk-7-151-244.eastlink.ca [71.7.151.244]) by hub.org (Postfix) with ESMTP id C4056290C1F; Sat, 17 Jun 2006 18:24:30 -0300 (ADT) Received: by ganymede.hub.org (Postfix, from userid 1000) id 5DD5D4909E; Sat, 17 Jun 2006 18:24:36 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id 578843526A; Sat, 17 Jun 2006 18:24:36 -0300 (ADT) Date: Sat, 17 Jun 2006 18:24:36 -0300 (ADT) From: "Marc G. Fournier" To: Dan Nelson In-Reply-To: <20060617200755.GG74191@dan.emsphone.com> Message-ID: <20060617182336.O1114@ganymede.hub.org> References: <20060617164334.K1114@ganymede.hub.org> <20060617165626.V1114@ganymede.hub.org> <20060617200755.GG74191@dan.emsphone.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-stable@freebsd.org Subject: Re: 6.1: kern.ipc.maxpipekva X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Jun 2006 21:24:35 -0000 On Sat, 17 Jun 2006, Dan Nelson wrote: > In the last episode (Jun 17), Marc G. Fournier said: >> On Sat, 17 Jun 2006, Marc G. Fournier wrote: >>> Jun 17 16:00:03 pluto kernel: kern.ipc.maxpipekva exceeded; see tuning(7) >>> Jun 17 16:00:04 pluto kernel: kern.ipc.maxpipekva exceeded; see tuning(7) >>> >>> but I can't seem to find anything in tuning(7) about it ... so, what >>> is it and how do I monitor for it? >> >> More on this: >> >> # sysctl -a | grep pipekva >> kern.ipc.maxpipekva: 16777216 >> kern.ipc.pipekva: 15122432 >> >> and I just rebooted the server ... >> >> so obviously I've been living on the edge ... not sure what to increase it >> to, since not sure what it affects, so will wait on responses ... > > Try also running "sysctl kern.ipc | grep pipe", which will also tell > you how many pipes are in use, plus some other counters. The comment > at the top of sys/kern/sys_pipe.c explains how pipes are given memory. What uses all of these pipes? right now, with 97 jails running: kern.ipc.maxpipekva: 25165824 kern.ipc.pipes: 7038 kern.ipc.pipekva: 22179840 kern.ipc.pipefragretry: 0 kern.ipc.pipeallocfail: 0 kern.ipc.piperesizefail: 0 kern.ipc.piperesizeallowed: 1 That is an average of 7 pipes per process: pluto# ps aux | wc -l 1326 ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664