From owner-freebsd-stable@FreeBSD.ORG Mon Nov 2 13:39:28 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7317A106566C for ; Mon, 2 Nov 2009 13:39:28 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from lo.gmane.org (lo.gmane.org [80.91.229.12]) by mx1.freebsd.org (Postfix) with ESMTP id 00ACB8FC19 for ; Mon, 2 Nov 2009 13:39:27 +0000 (UTC) Received: from list by lo.gmane.org with local (Exim 4.50) id 1N4x81-0003iw-Qm for freebsd-stable@freebsd.org; Mon, 02 Nov 2009 14:39:25 +0100 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 02 Nov 2009 14:39:25 +0100 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 02 Nov 2009 14:39:25 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Ivan Voras Date: Mon, 02 Nov 2009 14:39:06 +0100 Lines: 41 Message-ID: References: <772532900-1257123963-cardhu_decombobulator_blackberry.rim.net-1402739480-@bda715.bisx.prod.on.blackberry> <4AEEBD4B.1050407@quip.cz> <4AEEDB3B.5020600@quip.cz> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.23 (X11/20090928) In-Reply-To: <4AEEDB3B.5020600@quip.cz> Sender: news Subject: Re: Performance issues with 8.0 ZFS and sendfile/lighttpd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2009 13:39:28 -0000 Miroslav Lachman wrote: > Ivan Voras wrote: >> Miroslav Lachman wrote: > > [..] > >>> I have more strange issue with Lighttpd in jail on top of ZFS. >>> Lighttpd is serving static content (mp3 downloads thru flash player). >>> Is runs fine for relatively small number of parallel clients with >>> bandwidth about 30 Mbps, but after some number of clients is reached >>> (about 50-60 parallel clients) the throughput drops down to 6 Mbps. >>> >>> I can server hundereds of clients on same HW using Lighttpd not in >>> jail and UFS2 with gjournal instead of ZFS reaching 100 Mbps (maybe >>> more). >>> >>> I don't know if it is ZFS or Jail issue. >> >> Do you have actual disk IO or is the vast majority of your data served >> from the caches? (actually - the same question to the OP) > > I had ZFS zpool as mirror of two SATA II drives (500GB) and in the peak > iostat (or systat -vm or gstat) shows about 80 tps / 60% busy. > > In case of UFS, I am using gmirrored 1TB SATA II drives working nice > with 160 or more tps. > > Both setups are using FreeBSD 7.x amd64 with GENERIC kernel, 4GB of RAM. > > As the ZFS + Lighttpd in jail was unreliable, I am no longer using it, > but if you want some more info for debuging, I can set it up again. For what it's worth, I have just set up a little test on a production machine with 3 500 GB SATA drives in RAIDZ, FreeBSD 7.2-RELEASE. The total data set is some 2 GB in 5000 files but the machine has only 2 GB RAM total so there is some disk IO - about 40 IOPS per drive. I'm also using Apache-worker, not lighty, and siege to benchmark with 10 concurrent users. In this setup, the machine has no problems saturating a 100 Mbit/s link - it's not on a LAN but the latency is close enough and I get ~~ 11 MB/s.