From owner-freebsd-performance@FreeBSD.ORG Wed Apr 2 04:51:46 2008 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 116DE106566B for ; Wed, 2 Apr 2008 04:51:46 +0000 (UTC) (envelope-from tom@tomjudge.com) Received: from tomjudge.vm.bytemark.co.uk (tomjudge.vm.bytemark.co.uk [80.68.91.100]) by mx1.freebsd.org (Postfix) with ESMTP id C93A88FC1C for ; Wed, 2 Apr 2008 04:51:45 +0000 (UTC) (envelope-from tom@tomjudge.com) Received: from localhost (localhost [127.0.0.1]) by tomjudge.vm.bytemark.co.uk (Postfix) with ESMTP id E4329341EA; Wed, 2 Apr 2008 05:29:14 +0100 (BST) Received: from tomjudge.vm.bytemark.co.uk ([127.0.0.1]) by localhost (tomjudge.vm.bytemark.co.uk [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rTCsq-+fOGvv; Wed, 2 Apr 2008 05:29:14 +0100 (BST) Received: from [192.168.255.6] (unknown [192.168.255.6]) by tomjudge.vm.bytemark.co.uk (Postfix) with ESMTP id 03A5C3417B; Wed, 2 Apr 2008 05:29:10 +0100 (BST) Message-ID: <47F30B96.6000605@tomjudge.com> Date: Tue, 01 Apr 2008 23:29:10 -0500 From: Tom Judge User-Agent: Thunderbird 2.0.0.12 (X11/20080227) MIME-Version: 1.0 To: Josh Paetzel References: <24adbbc00803231521h78844f26q77c48573f82408b9@mail.gmail.com> <200803240327.01211.josh@tcbug.org> <24adbbc00803240422m5b04b485s5df2f406aa89dc2b@mail.gmail.com> <200803241040.53346.josh@tcbug.org> In-Reply-To: <200803241040.53346.josh@tcbug.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org, Daniel Andersson Subject: Re: Tuning: 100mbit faster, gbit slower. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Apr 2008 04:51:46 -0000 Josh Paetzel wrote: > > This is on RELENG_6_3 > > net.inet.tcp.sendspace=262144 > net.inet.tcp.recvspace=262144 > kern.ipc.maxsockbuf=1048576 > ifconfig em0 mtu 9014 (You'll need a switch that supports jumbo frames to do > this) > Daniel, you should note that all devices on your network also need to have the same MTU configured, and that Jumbo frames are only supported on gige connections so if you have any 100/10 devices you can not use jumbo frames. > iperf shows wire traffic around 969 mbps and FTP runs at 110 Megs/sec > scp/sftp appears to be cpu bound at 45 Megs/sec, and NFS with TCP mounts and > send/receive packets set to 16384 manages about 90 Megs/sec. > Hi Josh, If you are running SCP/SFTP over your internal lan and are not worried about the security of the data in the session only the authentication then you man want to check out the HPN patches for openssh (I belive they are available as an option in the openssh port) which re-enable the cypher 'none'. Also the latest patch set introduces multi threaded crypto so that ssh is not bound by the performance of a single cpu in multi cpu/core systems. We run the HPN patches here (the older set with no multi threading support) and we can saturate gige with a single scp/sftp/ssh connection between two reasonably spec'd boxes (Our mtu is 8192 as this is more compatiable with most hardware [nics and switchs] most of the hardware wie have will only do 9000 byte jumbo frames). Tom