From owner-freebsd-questions@FreeBSD.ORG Wed Dec 17 11:51:56 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E4FD31065670 for ; Wed, 17 Dec 2008 11:51:56 +0000 (UTC) (envelope-from OttK@zzz.ee) Received: from zzz.ee (kalah.zzz.ee [194.204.30.253]) by mx1.freebsd.org (Postfix) with ESMTP id 9A9578FC17 for ; Wed, 17 Dec 2008 11:51:56 +0000 (UTC) (envelope-from OttK@zzz.ee) Received: from zzz.ee (localhost.zzz.ee [127.0.0.1]) by zzz.ee (Postfix) with ESMTP id 162EDFD1D0 for ; Wed, 17 Dec 2008 13:51:55 +0200 (EET) Received: by zzz.ee (Postfix, from userid 3019) id 14BB8FD0B2; Wed, 17 Dec 2008 13:51:55 +0200 (EET) X-Spam-Checker-Version: SpamAssassin on spamassassin.zzz.ee X-Spam-Level: X-Spam-Guessed-Language: X-Spam-Status: No, score=-5.4 required=5.0 tests=ALL_TRUSTED,BAYES_20 X-Spam-Checker-URL: http://info.zzz.ee Received: from [192.168.5.3] (adsl215.uninet.ee [194.204.62.215]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by zzz.ee (Postfix) with ESMTPS id 6CA0BFD29B for ; Wed, 17 Dec 2008 13:51:52 +0200 (EET) Message-ID: <4948E7D7.8090400@zzz.ee> Date: Wed, 17 Dec 2008 13:51:51 +0200 From: =?ISO-8859-1?Q?Ott_K=F6stner?= Organization: TIGMA AS User-Agent: Thunderbird 2.0.0.18 (X11/20081125) MIME-Version: 1.0 To: freebsd-questions@freebsd.org References: <20081216142942.GA14998@lpthe.jussieu.fr> <4947C9EF.1060606@zzz.ee> In-Reply-To: <4947C9EF.1060606@zzz.ee> Content-Type: multipart/mixed; boundary="------------010909030203000408030405" X-Virus-Scanned: ClamAV using ClamSMTP @zzz.ee X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: socket: too many open file descriptors (Re: Python with many threads) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Dec 2008 11:51:57 -0000 This is a multi-part message in MIME format. --------------010909030203000408030405 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Hello, Answering my own mail ;) Ott Köstner wrote: > Still, something locks up in the system, when I increase the number > Python threads with http://grub.org/?q=en/node/204 [...] > The frequency of these messages increases with 70 threads. And with > 200 threads the system locks up totally -- almost no access from web. > [I can still access the system and kill the process :) ] > > Clearly, there is some limit in the system. It is not memory, cpu or > bandwidth. If the number of threads is also not limited, it must be > something else. What might it be? > Eventually, I found out that the limiting factor here is named, not capable of handling more request and causing Apache to lock up. But now I am trapped here. Is there anybody who can help? In /var/log/messages: named[63198]: socket: too many open file descriptors I have googled this, but no help. Recompiled bind, adding -DFD_SETSIZE=2048 to CFLAGS. No help. sockstat |grep -c named does not big numbers. With 60 Grubng/Pyhton threads this number is around 20, rises over 100 with 100 threads, but this is still much lower than 2048... Any ideas? Regards, O.K. -- Testi oma Interneti kiirust / Test Your Internet speed: http://speedtest.zzz.ee/ --------------010909030203000408030405--