From owner-freebsd-hackers@FreeBSD.ORG Sat Mar 7 21:22:56 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1853B1065688 for ; Sat, 7 Mar 2009 21:22:56 +0000 (UTC) (envelope-from martinbadie@yahoo.com) Received: from n24.bullet.mail.mud.yahoo.com (n24.bullet.mail.mud.yahoo.com [68.142.206.163]) by mx1.freebsd.org (Postfix) with SMTP id D1A328FC17 for ; Sat, 7 Mar 2009 21:22:55 +0000 (UTC) (envelope-from martinbadie@yahoo.com) Received: from [68.142.200.221] by n24.bullet.mail.mud.yahoo.com with NNFMP; 07 Mar 2009 21:08:56 -0000 Received: from [76.13.13.26] by t9.bullet.mud.yahoo.com with NNFMP; 07 Mar 2009 21:08:56 -0000 Received: from [76.13.10.165] by t3.bullet.mail.ac4.yahoo.com with NNFMP; 07 Mar 2009 21:08:56 -0000 Received: from [127.0.0.1] by omp106.mail.ac4.yahoo.com with NNFMP; 07 Mar 2009 21:08:56 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 196298.93309.bm@omp106.mail.ac4.yahoo.com Received: (qmail 74280 invoked by uid 60001); 7 Mar 2009 21:08:56 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1236460136; bh=UEbwBMfKEcoBzml+imyTFcXdrF3f2e2aDEVkTZa2Vws=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=aDwPMOL1jZZYXKAUycy0s1OHTvqPabPORolAVHztmDFevepIKHpUtVDzJb0OzkbJKo71O3ckcGz3vtnBt/kdIgR9oKmmo/VjmBHRKopNeGEBOWfHMROZdQIb7HsfMqjDN8S6CmqcT29koveDQMn50KBZJH5yK+n8idWUy6j4QdQ= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=6nyYxJzDSia8rT/6cznYq8j6BxJjh/hlbFwYOjJh7d8cRPj/f+8bS+m3V1GapU/8GljhmkzxPlc6EfK6TZh5pDIvT24ADc0k/C807HFpcTP//Qk9TUh5XcuEha5UpywFTUlawx7++eV0A3h/C2TCHYCqvcROaeW6SeLmHQc8mtw=; Message-ID: <67469.69113.qm@web59906.mail.ac4.yahoo.com> X-YMail-OSG: udTyLk8VM1lpgUruUeLrXu_aFD4VKldGlsxwN1LP6AJnetILE39vfkhP3RAN0LVsk1XNgTgwg0Uvn95gTBrNUnWZbwGXTgih0A6Uo_ZTdFyBaD3niiAD931njGPiUHWIqotMaOSIbpHBB4zCY4h1XksGA7w- Received: from [85.103.48.49] by web59906.mail.ac4.yahoo.com via HTTP; Sat, 07 Mar 2009 13:08:56 PST X-Mailer: YahooMailRC/1155.45 YahooMailWebService/0.7.289.1 Date: Sat, 7 Mar 2009 13:08:56 -0800 (PST) From: Martin Badie To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: select.h FD_SETSIZE and Qmail-Postfix test X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Mar 2009 21:22:56 -0000 Hi, There is a test that I am doing with FreeBSD and Linux. This test involves qmail and postfix comparison. Both FreeBSD and Linux seems to have 1024 File Descriptor limit. (FD_SETSIZE in select.h in FreeBSD) . To have a better concurrency in qmail on smtp level. I have used a patch named big-todo patch also used big-concurrency patch. These patches helps me to increase concurrency in operating system. I set concurrent connection to 500(tcpserver -c 500). There is no problem until around 400-500 active smtp connection. But if the total smtp connection exceeds 500, load average increases to ~40-50 but cpu system time arises to %50-60. The strange issue is that, this load increases when the connection is limited to accept 500 connections but the tool I use is configured to 700 (more than 500) connections. Normally ucspi-tcp software limits connection to 500 ( -c 500) I suspect it is something to do with Operating system level. Additionally I have also patched FreeBSD kernel with 4096 FD_SETSIZE in select.h in kernel and booted with that kernel. I have also compiled qmail from scratch to accept 2040 connections (in conf-spawn) but there is no change I mean I still can't get more than decent 500 connections with acceptable load average. I have also used postfix on both Linux FreeBSD: default_process_limit = 500 smtpd_client_connection_count_limit = 500 but I still get strange load when connection raises more than 500 I suspect something is missing or need to be configured on the operating system level (both Linux and FreeBSD)