From owner-freebsd-performance@FreeBSD.ORG  Thu Nov 18 09:47:29 2004
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id ED8CD16A4CE
	for <freebsd-performance@freebsd.org>;
	Thu, 18 Nov 2004 09:47:29 +0000 (GMT)
Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.204])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 9987A43D4C
	for <freebsd-performance@freebsd.org>;
	Thu, 18 Nov 2004 09:47:29 +0000 (GMT)
	(envelope-from aaron.glenn@gmail.com)
Received: by rproxy.gmail.com with SMTP id b11so1021536rne
	for <freebsd-performance@freebsd.org>;
	Thu, 18 Nov 2004 01:47:17 -0800 (PST)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
	s=beta; d=gmail.com;
	h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type:content-transfer-encoding;
	b=Nn9/TYi/Gi0kDn2yhQubY28y2hn6egH59urKdq5vJc/aiDV10O7nECs051+bBIgy8qNTBcuGK7s4jjSGFGloCM0B6wx9RK265+j5KrtNHjPZQ5kWnEZJgRcDNJhT4yz4BdneFz5P9RvjN2MUG+kcl3Hn1+HdLXY6wcM7nmvkln0=
Received: by 10.38.59.47 with SMTP id h47mr185314rna;
        Thu, 18 Nov 2004 01:47:17 -0800 (PST)
Received: by 10.38.151.56 with HTTP; Thu, 18 Nov 2004 01:47:17 -0800 (PST)
Message-ID: <18f6019404111801471db5bbfd@mail.gmail.com>
Date: Thu, 18 Nov 2004 01:47:17 -0800
From: Aaron Glenn <aaron.glenn@gmail.com>
To: freebsd-performance@freebsd.org
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Subject: I've ran out of ideas
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
Reply-To: Aaron Glenn <aaron.glenn@gmail.com>
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Nov 2004 09:47:30 -0000

I'm pushing large files via thttpd over low-end hardware (celeron
1.8GHz, 512MB RAM, UATA 100 drive) and, out of the box, FreeBSD
5.3-RELEASE topped out at 40Mbps sustained. After creating a separate
partition with a much larger blocksize, it's hit 50Mbps sustained but
won't go past 54Mbps at all.

iostat shows the drive pushing 3.5MB/s pretty consistently. There are
on average 750 http connections. Interrupts take 12% of the CPU,
according to top, and another 2% for thttpd itself. The box doesn't
swap.

My dmesg is inexplicably gone...which I realize is going to seriously
hamper any constructive input. It is an fxp card, and the IDE
controller is a generic Intel controller (the motherboard is an old
gateway desktop pull). The /var/log/messages file is filled with:

Nov 18 04:00:15 d thttpd[38743]: write - Socket is not connected
sending /path/to/file.name

I'd like to know what else I can to do maximize raw network I/O. I
don't see why this box can't push 90Mbps. My good friend, colleague,
and Linux zealot, is eating this up. (-:

Regards,
aaron.glenn