From owner-freebsd-net@FreeBSD.ORG Fri Nov 21 17:33:21 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2B69FE99 for ; Fri, 21 Nov 2014 17:33:21 +0000 (UTC) Received: from umail.aei.mpg.de (umail.aei.mpg.de [194.94.224.6]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E07EF9C for ; Fri, 21 Nov 2014 17:33:20 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by umail.aei.mpg.de (Postfix) with ESMTP id 32F9C20074D; Fri, 21 Nov 2014 18:33:17 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.6.4 (20090625) (Debian) at aei.mpg.de Received: from umail.aei.mpg.de ([127.0.0.1]) by localhost (umail.aei.mpg.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id j6tPB4JZZrSD; Fri, 21 Nov 2014 18:33:17 +0100 (CET) Received: from mailgate.aei.mpg.de (mailgate.aei.mpg.de [194.94.224.5]) by umail.aei.mpg.de (Postfix) with ESMTP id 0D73F20074A; Fri, 21 Nov 2014 18:33:17 +0100 (CET) Received: from mailgate.aei.mpg.de (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id F2B47405889; Fri, 21 Nov 2014 18:33:16 +0100 (CET) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) by mailgate.aei.mpg.de (Postfix) with ESMTP id C43B3406AF1; Fri, 21 Nov 2014 18:33:16 +0100 (CET) Received: from arc.aei.uni-hannover.de ([10.117.15.110]) by intranet.aei.uni-hannover.de (Lotus Domino Release 8.5.3FP6HF1016) with ESMTP id 2014112118330659-15686 ; Fri, 21 Nov 2014 18:33:06 +0100 Date: Fri, 21 Nov 2014 18:33:06 +0100 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: Jack Vogel Subject: Re: igb Could not setup receive structures (again) Message-Id: <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> In-Reply-To: References: <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de> Organization: Max Planck Gesellschaft X-Mailer: Sylpheed 3.4.2 (GTK+ 2.24.22; amd64-portbld-freebsd10.0) Mime-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 8.5.3FP6HF1016 | October 31, 2014) at 21.11.2014 18:33:06, Serialize by Router on intranet/aei-hannover(Release 8.5.3FP6HF1016 | October 31, 2014) at 21.11.2014 18:33:16, Serialize complete at 21.11.2014 18:33:16 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-PMX-Version: 6.0.2.2308539, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2014.11.21.172719 X-PerlMx-Spam: Gauge=IIIIIIII, Probability=8%, Report=' HTML_00_01 0.05, HTML_00_10 0.05, MIME_LOWER_CASE 0.05, BODYTEXTP_SIZE_3000_LESS 0, BODY_SIZE_2000_2999 0, BODY_SIZE_5000_LESS 0, BODY_SIZE_7000_LESS 0, REFERENCES 0, __ANY_URI 0, __BOUNCE_CHALLENGE_SUBJ 0, __BOUNCE_NDR_SUBJ_EXEMPT 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __FRAUD_BODY_WEBMAIL 0, __FRAUD_WEBMAIL 0, __HAS_FROM 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __IN_REP_TO 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __REFERENCES 0, __SANE_MSGID 0, __SUBJ_ALPHA_NEGATE 0, __TO_MALFORMED_2 0, __URI_NO_PATH 0, __URI_NO_WWW 0, __URI_NS ' Cc: FreeBSD Net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 17:33:21 -0000 On Fri, 21 Nov 2014 08:22:31 -0800 Jack Vogel wrote about Re: igb Could not setup receive structures (again): JV> After you get the error do a `netstat -m` and see what the state of the JV> 9K jumbo pool is, for that is the size you would be using. Hm... --- root@mclane:~ # netstat -m 20472/33783/54255 mbufs in use (current/cache/total) 20461/31381/51842/1014856 mbuf clusters in use (current/cache/total/max) 20461/29764 mbuf+clusters out of packet secondary zone in use (current/cache) 0/191/191/507428 4k (page size) jumbo clusters in use (current/cache/total/max) 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) 46040K/102796K/148836K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/10/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile root@mclane:~ # ifconfig igb1 mtu 9000 root@mclane:~ # netstat -m 16373/37882/54255 mbufs in use (current/cache/total) 16369/35473/51842/1014856 mbuf clusters in use (current/cache/total/max) 16369/33856 mbuf+clusters out of packet secondary zone in use (current/cache) 0/191/191/507428 4k (page size) jumbo clusters in use (current/cache/total/max) 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) 36831K/112005K/148836K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/12/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile --- JV> Depending on the specific device type you may have up to 8 rings JV> per interface, and with a ring size of 1K... JV> It does seem like you should have enough, but maybe something else JV> in your system is using the pool? As I said, look at netstat, it JV> should give you the truth, and then adjust the allocated size to fit JV> your needs. I must admit that I cannot make much of this output... looks all fine to me? cu Gerrit