From owner-freebsd-performance@FreeBSD.ORG Mon Jan 19 02:24:21 2004 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E5B9816A4CE; Mon, 19 Jan 2004 02:24:21 -0800 (PST) Received: from daemon.kr.FreeBSD.org (daemon.kr.freebsd.org [61.78.53.31]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2910F43D49; Mon, 19 Jan 2004 02:24:20 -0800 (PST) (envelope-from cjh@kr.FreeBSD.org) Received: from localhost (gradius [211.44.63.164]) by daemon.kr.FreeBSD.org (Postfix) with ESMTP id 87F631A6EB; Mon, 19 Jan 2004 19:22:53 +0900 (KST) Date: Mon, 19 Jan 2004 19:22:57 +0900 (KST) Message-Id: <20040119.192257.34695172.cjh@kr.FreeBSD.org> To: silby@silby.com From: CHOI Junho In-Reply-To: <20040119010832.E85911@odysseus.silby.com> References: <20040119.153452.10362034.cjh@kr.FreeBSD.org> <20040119010832.E85911@odysseus.silby.com> Organization: Korea FreeBSD Users Group X-URL: http://www.kr.FreeBSD.org/~cjh X-Mailer: Mew version 4.0.62 on Emacs 21.3.1 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Fri, 23 Jan 2004 00:09:07 -0800 cc: freebsd-net@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: mbuf tuning X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jan 2004 10:24:22 -0000 From: Mike Silbersack Subject: Re: mbuf tuning Date: Mon, 19 Jan 2004 01:12:08 -0600 (CST) > There are no good guidelines other than "don't set it too high." Andre > and I have talked about some ideas on how to make mbuf usage more dynamic, > I think that he has something in the works. But at present, once you hit > the wall, that's it. > > One way to reduce mbuf cluster usage is to use sendfile where possible. > Data sent via sendfile does not use mbuf clusters, and is more memory > efficient. If you run 5.2 or above, it's *much* more memory efficient, > due to change Alan Cox recently made. Apache 2 will use sendfile by > default, so if you're running apache 1, that may be one reason for an > upgrade. I am using custom version of thttpd. It allocates mmap() first(builtin method of thttpd), and it try to use sendfile() if mmap() fails(out of mmap memory). It really works good in normal status but the problem is that sendfile buffer is also easy to flood. I need more sendfile buffers but I don't know how to increase sendfile buffers either(I think it's hidden sysctl but it was more difficult to tune than nmbclusters). With higher traffic, thttpd sometimes stuck at "sfbufa" status when I run top(I guess it's "sendfile buffer allocation" status). 5.2 is fair good quality in my desktop but I have no experience in production environment. I'll consider it once 5.x enters -STABLE tree, but not now. Apache2 is one of my targets. How much better than apache-1.3.x in static file service? > > Increasing kern.ipc.nmbclusters caused frequent kernel panic > > under 4.7/4.8/4.9. How can I set more nmbclusters value with 64K tcp > > buffers? Or is any dependency for mbufclusters value? (e.g. RAM size, > > kern.maxusers value or etc) > > > > p.s. RAM is 2G, Xeon 2.0G x 1 or 2 machines. > > You probably need to bump up KVA_PAGES to fit in all the extra mbuf > clusters you're allocating. Can you tell me in more detail? > Mike "Silby" Silbersack Thanks, -- CHOI Junho KFUG FreeBSD Project Web Data Bank Key fingerprint = 1369 7374 A45F F41A F3C0 07E3 4A01 C020 E602 60F5