From owner-freebsd-current@FreeBSD.ORG Tue May 19 13:14:42 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B6CD1065673 for ; Tue, 19 May 2009 13:14:42 +0000 (UTC) (envelope-from pascal.braun@continum.net) Received: from mailsrv1.continum.net (mr1.continum.net [80.72.129.121]) by mx1.freebsd.org (Postfix) with ESMTP id 1D75F8FC1A for ; Tue, 19 May 2009 13:14:41 +0000 (UTC) (envelope-from pascal.braun@continum.net) Received: from c483.continum.net ([80.72.130.250] helo=[172.16.4.73]) by mr1.continum.net with esmtpa (Exim 4.67) (envelope-from ) id 1M6P9Z-0007OZ-5I; Tue, 19 May 2009 15:14:45 +0200 Message-ID: <4A12B0B8.5020507@continum.net> Date: Tue, 19 May 2009 15:14:32 +0200 From: Pascal Braun User-Agent: Thunderbird 2.0.0.17 (X11/20080925) MIME-Version: 1.0 To: pyunyh@gmail.com References: <4A127C56.6040502@continum.net> <20090519104133.GF4697@michelle.cdnetworks.co.kr> In-Reply-To: <20090519104133.GF4697@michelle.cdnetworks.co.kr> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-current@freebsd.org Subject: Re: Problems with jumbo frames on nfe X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 May 2009 13:14:42 -0000 Pyun YongHyeon wrote: > On Tue, May 19, 2009 at 11:31:02AM +0200, Pascal Braun wrote: >> Hi, >> >> I'm currently testing jumbo frames on a Sunfire 4540 running with >> FreeBSD 8-Current (build on April 8th). While using the nfe driver I'm >> having some unexpected problems if i try to bring up the interface with >> MTU sizes greater than 1970 bytes. >> >> The error message (in dmesg) is: >> nfe2: initialization failed: no memory for rx buffers >> > > It means you've run out of jumbo clusters. Check the output of > "netstat -m" and see how many jumbo cluster requests were denied. 771/1149/1920 mbufs in use (current/cache/total) 770/680/1450/25600 mbuf clusters in use (current/cache/total/max) 770/510 mbuf+clusters out of packet secondary zone in use (current/cache) 0/9/9/12800 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/16384 9k jumbo clusters in use (current/cache/total/max) 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) 1732K/1683K/3416K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines There are no denied requests. MTU size was about 1800. But I have to add, that i cant even get the interface up if the mtu size is above 1970. >> Does anyone have any ideas how to get jumbo frames working? >> > > How about increasing 9K jumbo clusters(kern.ipc.nmbjumbo9) with > sysctl(8)? sunfire# sysctl -a | grep jumbo kern.ipc.nmbjumbo16: 3200 kern.ipc.nmbjumbo9: 16384 kern.ipc.nmbjumbop: 12800 I increased kern.ipc.nmbjumbo9 to 16384 (was 6400) but that didn't seem to help. Do you have another idea? Regards Pascal