From owner-freebsd-performance@FreeBSD.ORG Wed Mar 23 08:04:44 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E806816A4CE for ; Wed, 23 Mar 2005 08:04:44 +0000 (GMT) Received: from sffwd0.suedfactoring.de (port-212-202-224-251.static.qsc.de [212.202.224.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id E7F5343D48 for ; Wed, 23 Mar 2005 08:04:43 +0000 (GMT) (envelope-from Axel.Gruner@suedfactoring.de) Received: from sfld1.suedfac.com (sfld1.SUEDFAC.COM [10.4.1.241]) ESMTP id j2N84gaD007470 for ; Wed, 23 Mar 2005 09:04:42 +0100 Importance: Normal X-Priority: 3 (Normal) MIME-Version: 1.0 From: Axel.Gruner@suedfactoring.de To: freebsd-performance@freebsd.org X-MIMETrack: MIME-CD by Notes Server on sfld1/suedfactoring(Release 6.5.2|June 01, 2004) at 03/23/2005 08:59:36, MIME-CD complete at 03/23/2005 08:59:36,2004) at 03/23/2005 08:59:37 Date: Wed, 23 Mar 2005 08:59:36 +0100 Message-ID: Content-type: text/plain; charset=US-ASCII X-Virus-Scanned: by amavisd-new Subject: FreeBSD 5.3 and too many files open... X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Mar 2005 08:04:45 -0000 Hi, i run into a problem on a FreeBSD 5.3-STABLE Applicationserver (2GB of RAM, 4GB Swap, Dual XEON 3.06Ghz). The box serves the "xfrce4-panel" for 80 Network Clients via ssh so the Users can start OpenOffice.org and firefox from that panel. It is goin very well, except a message (and also a problem) i run into the last day. If i tried to open firefox from a networkclient and received the message "too many files open...". I saw that message on 3 different Network Clients and just after a fresh configure and the first time starting firfox on these Networkclients with that UID. I checked my configuration on the server about "openfiles": kern.openfiles:9306 kern.maxfiles:65536 netstat -m 3952 mbufs in use 732/64000 mbuf clusters in use (current/max) [...] "fstat" shows me 393 on User A and on User B 3459. I did not check the other users. kern.maxfilesperproc: 5898 kern.maxusers: 384 My /boot/loader.conf looks like: kern.maxfiles="65536" kern.ipc.nmbclusters=64000 kern.ipc.nmbufs=256000 kern.maxproc=8192 kern.ipc.somaxconn=4096 So i do not get it, imho the configuration is just fine, but why do i get the message "too many files open..."? Thanks in advance From owner-freebsd-performance@FreeBSD.ORG Wed Mar 23 09:45:00 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 83FA916A4CE for ; Wed, 23 Mar 2005 09:45:00 +0000 (GMT) Received: from mailhost.stack.nl (vaak.stack.nl [131.155.140.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id 93E7743D49 for ; Wed, 23 Mar 2005 09:44:59 +0000 (GMT) (envelope-from marcolz@stack.nl) Received: from hammer.stack.nl (hammer.stack.nl [IPv6:2001:610:1108:5010::153]) by mailhost.stack.nl (Postfix) with ESMTP id 540991F30D; Wed, 23 Mar 2005 10:44:58 +0100 (CET) Received: by hammer.stack.nl (Postfix, from userid 333) id 39C0F67FE; Wed, 23 Mar 2005 10:44:58 +0100 (CET) Date: Wed, 23 Mar 2005 10:44:58 +0100 From: Marc Olzheim To: Axel.Gruner@suedfactoring.de Message-ID: <20050323094458.GA3357@stack.nl> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="yrj/dFKFPuw6o+aM" Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD hammer.stack.nl 5.4-PRERELEASE FreeBSD 5.4-PRERELEASE X-URL: http://www.stack.nl/~marcolz/ User-Agent: Mutt/1.5.9i cc: freebsd-performance@freebsd.org Subject: Re: FreeBSD 5.3 and too many files open... X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Mar 2005 09:45:00 -0000 --yrj/dFKFPuw6o+aM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Mar 23, 2005 at 08:59:36AM +0100, Axel.Gruner@suedfactoring.de wrot= e: > kern.maxfilesperproc: 5898 > kern.maxusers: 384 >=20 > My /boot/loader.conf looks like: > kern.maxfiles=3D"65536" > kern.ipc.nmbclusters=3D64000 > kern.ipc.nmbufs=3D256000 > kern.maxproc=3D8192 > kern.ipc.somaxconn=3D4096 >=20 > So i do not get it, imho the configuration is just fine, but why do i get > the message "too many files open..."? Could you try running "limits" ? And / of /etc/login.conf changes to "openfiles" or "openfiles-cur"... Marc --yrj/dFKFPuw6o+aM Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) iD8DBQFCQTqaezjnobFOgrERAu2KAJ9N792nt1h9mozzl4CosNuIiv+64gCfcfwf m6RqoXGrgJZaxPPNfl8C0tA= =nzlw -----END PGP SIGNATURE----- --yrj/dFKFPuw6o+aM-- From owner-freebsd-performance@FreeBSD.ORG Wed Mar 23 09:59:29 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9573016A4CE for ; Wed, 23 Mar 2005 09:59:29 +0000 (GMT) Received: from sffwd0.suedfactoring.de (port-212-202-224-251.static.qsc.de [212.202.224.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5794143D49 for ; Wed, 23 Mar 2005 09:59:28 +0000 (GMT) (envelope-from Axel.Gruner@suedfactoring.de) Received: from sfld1.suedfac.com (sfld1.SUEDFAC.COM [10.4.1.241]) ESMTP id j2N9xRaD008933; Wed, 23 Mar 2005 10:59:27 +0100 MIME-Version: 1.0 Importance: Normal X-Priority: 3 (Normal) From: Axel.Gruner@suedfactoring.de To: Marc Olzheim X-MIMETrack: MIME-CD by Notes Server on sfld1/suedfactoring(Release 6.5.2|June 01, 2004) at 03/23/2005 10:54:19, MIME-CD complete at 03/23/2005 10:54:19,2004) at 03/23/2005 10:54:20 Date: Wed, 23 Mar 2005 10:54:19 +0100 Message-ID: Content-type: text/plain; charset=US-ASCII X-Virus-Scanned: by amavisd-new cc: Axel.Gruner@suedfactoring.de cc: freebsd-performance@freebsd.org Subject: Antwort: Re: FreeBSD 5.3 and too many files open... X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Mar 2005 09:59:29 -0000 Hi, -----Marc Olzheim schrieb: ----- On Wed, Mar 23, 2005 at 08:59:36AM +0100, Axel.Gruner@suedfactoring.de wrote: >> kern.maxfilesperproc: 5898 >> kern.maxusers: 384 >> >> My /boot/loader.conf looks like: >> kern.maxfiles="65536" >> kern.ipc.nmbclusters=64000 >> kern.ipc.nmbufs=256000 >> kern.maxproc=8192 >> kern.ipc.somaxconn=4096 >> >> So i do not get it, imho the configuration is just fine, but why do i get >> the message "too many files open..."? > Could you try running "limits" ? > And / of /etc/login.conf changes to "openfiles" or "openfiles-cur"... limits: Resource limits (current): cputime infinity secs filesize infinity kb datasize 524288 kb stacksize 65536 kb coredumpsize 2048 kb memoryuse infinity kb memorylocked infinity kb maxprocesses 7372 openfiles 58982 sbsize infinity bytes vmemoryuse infinity kb /etc/login.conf: [...] :openfiles=unlimited:\ [...] From owner-freebsd-performance@FreeBSD.ORG Thu Mar 24 03:41:08 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 03F4816A4D1 for ; Thu, 24 Mar 2005 03:41:08 +0000 (GMT) Received: from avscan2.sentex.ca (avscan2.sentex.ca [199.212.134.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 29C1743D1D for ; Thu, 24 Mar 2005 03:41:07 +0000 (GMT) (envelope-from mike@sentex.net) Received: from localhost (localhost.sentex.ca [127.0.0.1]) by avscan2.sentex.ca (8.12.11/8.12.11) with ESMTP id j2O3f8Dn036703; Wed, 23 Mar 2005 22:41:08 -0500 (EST) (envelope-from mike@sentex.net) Received: from avscan2.sentex.ca ([127.0.0.1]) by localhost (avscan2.sentex.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 36176-05; Wed, 23 Mar 2005 22:41:08 -0500 (EST) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by avscan2.sentex.ca (8.12.11/8.12.11) with ESMTP id j2O3f8IX036680; Wed, 23 Mar 2005 22:41:08 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.12.11/8.12.11) with ESMTP id j2O3ex5n016690; Wed, 23 Mar 2005 22:40:59 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.1.2.0.20050323215301.044b4e00@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.1.2 Date: Wed, 23 Mar 2005 22:40:33 -0500 To: freebsd-performance@freebsd.org From: Mike Tancsa In-Reply-To: <6.2.1.2.0.20050309140158.05068ba8@64.7.153.2> References: <6.2.1.2.0.20050308120832.047a5620@64.7.153.2> <422DE1F9.8080004@barryp.org> <20050308173721.GB18993@afflictions.org> <6.2.1.2.0.20050309140158.05068ba8@64.7.153.2> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Virus-Scanned: by amavisd-new at avscan2b Subject: Re: Hardware RAID adaptors and FreeBSD (was Re: ARECA ARC-1120 RAID adaptor X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Mar 2005 03:41:08 -0000 At 02:08 PM 09/03/2005, Mike Tancsa wrote: >FYI, I placed an order for one of the PCI-X 4 port versions today. I >should have it in 2 weeks or so and will summarize my FreeBSD experiences >with it then. Got the card today and so far so good! The RAID5 is *really* quite fast compared to the older 8000 series 3ware. The drives are the same as before as is the rest of the hardware (see previous postings). Just the raid card has changed. FCIII=Fedora 3. The tests in each case was done with the OS on a separate drive and the /mnt partition one big partition off the raid controller. -------Sequential Output-------- ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU twe 2000 33789 25.8 34065 8.3 14038 3.8 47484 44.6 67316 9.5 2873.7 5.7 FCIII 2000 28073 62.0 22391 4.3 12189 2.0 17577 35.5 102132 5.5 1853.7 2.5 ARECA 2000 67648 52.0 63716 17.1 32715 8.5 59734 56.1 76906 11.1 5686.4 11.3 3000 72200 55.7 64210 17.0 32635 8.5 58834 55.5 79055 11.2 329.9 0.9 PostMark v1.5 : 3/27/01 pm>set size 300 100000 pm>set transactions 400000 pm>set location /mnt pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 1287 seconds total 1287 seconds of transactions (310 per second) Files: 200107 created (155 per second) Creation alone: 500 files (500 per second) Mixed with transactions: 199607 files (155 per second) 199905 read (155 per second) 199384 appended (154 per second) 200107 deleted (155 per second) Deletion alone: 889 files (889 per second) Mixed with transactions: 199218 files (154 per second) Data: 12715.55 megabytes read (9.88 megabytes per second) 12728.92 megabytes written (9.89 megabytes per second) pm> The card has source code drivers for FreeBSD 4 and 5 available (i386 and amd64 at ftp.areca.com.tw) on their FTP site as well as a binary cli and http app that allows you to monitor and configure all aspects of the card. The drive shows up as a scsi device so a user can use sysinstall to fdisk / disklabel it. Compiled and loaded the drivers via kld and arcmsr0: mem 0xf9000000-0xf9000fff irq 18 at device 14.0 on pci2. I configured the RAID5 array from the web and a camcontrol rescan all shows da0 at arcmsr0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 166.666MB/s transfers (83.333MHz, offset 32, 16bit), Tagged Queueing Enabled da0: 715255MB (1464843264 512 byte sectors: 255H 63S/T 91182C) I havent really brutalized the card and drivers yet, but running 2 dozen bonnie -s 200 -d & in the background does not lock up the machine, and despite all the io going on, the machine is still fairly responsive It would be really great to see support for this card as part of FreeBSD. The source code seems to imply a BSD'ish header, so perhaps this will be possible ---Mike