From owner-freebsd-performance@FreeBSD.ORG Tue Jul 13 03:10:14 2004 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CDE7516A4CE for ; Tue, 13 Jul 2004 03:10:14 +0000 (GMT) Received: from inetbml02.citec.qld.gov.au (inetbml02.citec.qld.gov.au [203.5.10.211]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5735943D46 for ; Tue, 13 Jul 2004 03:10:14 +0000 (GMT) (envelope-from ce018@torfree.net) Received: from lasun129.dnr.qld.gov.au (mailgate1.nrm.qld.gov.au [203.46.162.123]) by inetbml02.citec.qld.gov.au (Postfix) with ESMTP id E2B5A93C61 for ; Tue, 13 Jul 2004 13:10:12 +1000 (EST) Received: from nrmsweep.lands.resnet.qg (dnrsweep.dnr.qld.gov.au [203.8.130.181]) by lasun129.dnr.qld.gov.au (Postfix) with ESMTP id 13FDD9482A for ; Tue, 13 Jul 2004 13:10:12 +1000 (EST) Received: from chqmailgw.lands.resnet.qg (unverified [203.8.130.29]) by nrmsweep.lands.resnet.qg for ; Tue, 13 Jul 2004 13:06:23 +1000 Received: from chqmail2.lands.resnet.qg ([203.8.130.170]) by chqmailgw.lands.resnet.qg with Microsoft SMTPSVC(5.0.2195.6713); Tue, 13 Jul 2004 13:07:54 +1000 Received: from dep ([131.242.90.37]) by chqmail2.lands.resnet.qg with Microsoft SMTPSVC(5.0.2195.6713); Tue, 13 Jul 2004 13:06:34 +1000 From: Joe To: freebsd-performance@freebsd.org Message-ID: X-OriginalArrivalTime: 13 Jul 2004 03:07:24.0100 (UTC) FILETIME=[85170040:01C46886] Date: 13 Jul 2004 13:07:24 +1000 Subject: ethernet rate limiting?? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Jul 2004 03:10:14 -0000 Hi Here goes for a first post. I run an mldonkey server under 4.10-STABLE (though I noticed the same behaviour under 4.8 and 4.9). It also runs samba and ssh2 all on a p2-333. Generally what happens is I download files to this fbsd server and share them to my other pc via samba. When first rebooted this works fine with full ethernet copy speeds. After a while copying files from the fbsd box to the pc rate limits to 40k (via smb/ftp/ssh2 whichever) over the ethernet lan. This is on 100mbit cards I've tried different cables/cards/switches etc with no luck. I'm guessing there is some memory/network/file descriptor limit I'm hitting and I've no idea how to extend it or clear it. I've made the following mods in sysctl.conf kern.maxfiles=65000 kern.maxfilesperproc=65000 kern.ipc.somaxconn=4096 kern.ipc.maxsockbuf=1048576 net.inet.ip.fw.verbose_limit=0 and in kernconf machine i386 cpu I686_CPU maxusers 512 options NMBCLUSTERS=16384 options NMBUFS=32768 sample output from netstat -m 149/944/32768 mbufs in use (current/peak/max): 101 mbufs allocated to data 48 mbufs allocated to packet headers 73/348/16384 mbuf clusters in use (current/peak/max) 932 Kbytes allocated to network (2% of mb_map in use) 0 requests for memory denied 0 requests for memory delayed 0 calls to protocol drain routines # netstat -an | grep tcp4 | wc -l 482 Does anybody have any suggestions or ideas as to optimize this or have I hit some limit that can't be exceeded? thanks again, Joe From owner-freebsd-performance@FreeBSD.ORG Tue Jul 13 07:47:58 2004 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F10E816A4CE for ; Tue, 13 Jul 2004 07:47:57 +0000 (GMT) Received: from relay.kiev.sovam.com (relay.kiev.sovam.com [212.109.32.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5E21F43D3F for ; Tue, 13 Jul 2004 07:47:57 +0000 (GMT) (envelope-from dimitry@al.org.ua) Received: from [212.109.32.116] (helo=svitonline.com) by relay.kiev.sovam.com with esmtp (Exim 4.34) id 1BkI15-0007P3-Q0 for freebsd-performance@freebsd.org; Tue, 13 Jul 2004 10:47:55 +0300 From: Dmitry Alyabyev To: freebsd-performance@freebsd.org Date: Tue, 13 Jul 2004 10:47:55 +0300 User-Agent: KMail/1.6.2 References: In-Reply-To: X-NCC-RegID: ua.svitonline MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <200407131047.55631.dimitry@al.org.ua> X-Scanner-Signature: 0a21689c2f1d2e94d8aa83f1a1b60733 X-DrWeb-checked: yes Subject: Re: ethernet rate limiting?? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: dimitry@al.org.ua List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Jul 2004 07:47:58 -0000 On Tuesday 13 July 2004 06:07, Joe wrote: > Hi > > > Here goes for a first post. > > > I run an mldonkey server under 4.10-STABLE (though I noticed the same > behaviour under 4.8 and 4.9). It also runs samba and ssh2 all on a > p2-333. > > Generally what happens is I download files to this fbsd server and > share them to my other pc via samba. When first rebooted this > works fine with full ethernet copy speeds. > > After a while copying files from the fbsd box to the pc rate limits > to 40k (via smb/ftp/ssh2 whichever) over the ethernet lan. This is on > 100mbit cards I've tried different cables/cards/switches etc with no luck. > > I'm guessing there is some memory/network/file descriptor limit I'm > hitting and I've no idea how to extend it or clear it. i think the problem is wrong duplex negotiation try to set it manually on switch port and ethernet card -- Dimitry From owner-freebsd-performance@FreeBSD.ORG Tue Jul 13 19:35:09 2004 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E0C7416A4CE for ; Tue, 13 Jul 2004 19:35:09 +0000 (GMT) Received: from utils.dsgx.org (mailer.brasnet.org [66.90.84.93]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7D67F43D1F for ; Tue, 13 Jul 2004 19:35:09 +0000 (GMT) (envelope-from fabulous@t7ds.com.br) Received: from [201.9.181.174] (foo.bar.com [66.90.84.93]) by utils.dsgx.org (Postfix) with ESMTP id AFCACD7A927 for ; Tue, 13 Jul 2004 16:35:03 -0300 (BRT) Message-ID: <40F43985.5010508@t7ds.com.br> Date: Tue, 13 Jul 2004 16:35:33 -0300 From: fabulous User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8a1) Gecko/20040520 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <200407131047.55631.dimitry@al.org.ua> In-Reply-To: <200407131047.55631.dimitry@al.org.ua> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: ethernet rate limiting?? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Jul 2004 19:35:10 -0000 I would play with these values: net.inet.tcp.sendspace: 65536 net.inet.tcp.recvspace: 65536 try increasing sendspace to 524288 or more :P (this can eat lots of mbufs btw, but you have lots free) []'s Dmitry Alyabyev wrote: > On Tuesday 13 July 2004 06:07, Joe wrote: > >>Hi >> >> >> Here goes for a first post. >> >> >>I run an mldonkey server under 4.10-STABLE (though I noticed the same >>behaviour under 4.8 and 4.9). It also runs samba and ssh2 all on a >>p2-333. >> >>Generally what happens is I download files to this fbsd server and >>share them to my other pc via samba. When first rebooted this >>works fine with full ethernet copy speeds. >> >>After a while copying files from the fbsd box to the pc rate limits >>to 40k (via smb/ftp/ssh2 whichever) over the ethernet lan. This is on >>100mbit cards I've tried different cables/cards/switches etc with no luck. >> >>I'm guessing there is some memory/network/file descriptor limit I'm >>hitting and I've no idea how to extend it or clear it. > > > i think the problem is wrong duplex negotiation > try to set it manually on switch port and ethernet card >