From owner-freebsd-current@FreeBSD.ORG Tue May 26 13:28:37 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 597691065751 for ; Tue, 26 May 2009 13:28:37 +0000 (UTC) (envelope-from pascal.braun@continum.net) Received: from mailsrv1.continum.net (mr1.continum.net [80.72.129.121]) by mx1.freebsd.org (Postfix) with ESMTP id E06AB8FC0C for ; Tue, 26 May 2009 13:28:36 +0000 (UTC) (envelope-from pascal.braun@continum.net) Received: from c483.continum.net ([80.72.130.250] helo=[172.16.4.73]) by mr1.continum.net with esmtpa (Exim 4.67) (envelope-from ) id 1M8whs-00054q-3T; Tue, 26 May 2009 15:28:40 +0200 Message-ID: <4A1BEE68.6070103@continum.net> Date: Tue, 26 May 2009 15:28:08 +0200 From: Pascal Braun User-Agent: Thunderbird 2.0.0.17 (X11/20080925) MIME-Version: 1.0 To: pyunyh@gmail.com References: <4A127C56.6040502@continum.net> <20090519104133.GF4697@michelle.cdnetworks.co.kr> <4A12B0B8.5020507@continum.net> <20090520060723.GH9043@michelle.cdnetworks.co.kr> <20090525010757.GH23593@michelle.cdnetworks.co.kr> In-Reply-To: <20090525010757.GH23593@michelle.cdnetworks.co.kr> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-current@freebsd.org Subject: Re: Problems with jumbo frames on nfe X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 May 2009 13:28:38 -0000 Pyun YongHyeon wrote: > On Wed, May 20, 2009 at 03:07:23PM +0900, Pyun YongHyeon wrote: >> On Tue, May 19, 2009 at 03:14:32PM +0200, Pascal Braun wrote: >>> Pyun YongHyeon wrote: >>>> On Tue, May 19, 2009 at 11:31:02AM +0200, Pascal Braun wrote: >>>>> Hi, >>>>> >>>>> I'm currently testing jumbo frames on a Sunfire 4540 running with >>>>> FreeBSD 8-Current (build on April 8th). While using the nfe driver I'm >>>>> having some unexpected problems if i try to bring up the interface with >>>>> MTU sizes greater than 1970 bytes. >>>>> >>>>> The error message (in dmesg) is: >>>>> nfe2: initialization failed: no memory for rx buffers >>>>> >>>> It means you've run out of jumbo clusters. Check the output of >>>> "netstat -m" and see how many jumbo cluster requests were denied. >>> 771/1149/1920 mbufs in use (current/cache/total) >>> 770/680/1450/25600 mbuf clusters in use (current/cache/total/max) >>> 770/510 mbuf+clusters out of packet secondary zone in use (current/cache) >>> 0/9/9/12800 4k (page size) jumbo clusters in use (current/cache/total/max) >>> 0/0/0/16384 9k jumbo clusters in use (current/cache/total/max) >>> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) >>> 1732K/1683K/3416K bytes allocated to network (current/cache/total) >>> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) >>> 0/0/0 requests for jumbo clusters denied (4k/9k/16k) >>> 0/0/0 sfbufs in use (current/peak/max) >>> 0 requests for sfbufs denied >>> 0 requests for sfbufs delayed >>> 0 requests for I/O initiated by sendfile >>> 0 calls to protocol drain routines >>> >>> There are no denied requests. MTU size was about 1800. >>> But I have to add, that i cant even get the interface up if the mtu size >>> is above 1970. >>> >>>>> Does anyone have any ideas how to get jumbo frames working? >>>>> >>>> How about increasing 9K jumbo clusters(kern.ipc.nmbjumbo9) with >>>> sysctl(8)? >>> sunfire# sysctl -a | grep jumbo >>> kern.ipc.nmbjumbo16: 3200 >>> kern.ipc.nmbjumbo9: 16384 >>> kern.ipc.nmbjumbop: 12800 >>> >>> I increased kern.ipc.nmbjumbo9 to 16384 (was 6400) but that didn't seem >>> to help. Do you have another idea? >>> >> Ok, would you try attached patch? >> > > FYI: I've committed the patch(r192706). Sorry about the delay, i just came around to test you patch, and i can say its working perfectly for me. Thanks :) Regards Pascal