From owner-freebsd-net@FreeBSD.ORG Fri Nov 21 21:01:26 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4594F681 for ; Fri, 21 Nov 2014 21:01:26 +0000 (UTC) Received: from mail-wg0-x231.google.com (mail-wg0-x231.google.com [IPv6:2a00:1450:400c:c00::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BED10B9E for ; Fri, 21 Nov 2014 21:01:25 +0000 (UTC) Received: by mail-wg0-f49.google.com with SMTP id x12so7568357wgg.36 for ; Fri, 21 Nov 2014 13:01:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/ysosHi00YHKKEodxE6WieKYUSfmlYt01c/gO1pNv8I=; b=qt5DXlEoMKcyTT+95JlOZEEmw679huqNE2er+yb0kwoyY7oIcP5+T2a2V9/2jwQd9T GrZRCyZfvSFqkPl8gz1JWXw9Hx2BcbGSq6Di5Z2V+3kYUn1LltT1TP1mR0B3SAVf71Qz Rr9PDLdCDkIysPLCmSZklq0PktU8yVAhw1bsIT4c2VaqAmSclba0ltBGFdH54H5T81Tq YMnC3rysPkelNTPF7M7LEz4+Hi84keXa7aModzGDihA6o2BNrK0TaytyZoLKaoSZHY+N OPaTgNZZvU0NokrjCPuXiM8iEdDd96o4xyGUEnECgtZiXnB+4g0XFPRHCiyGhfSDFEp3 P76Q== MIME-Version: 1.0 X-Received: by 10.180.99.1 with SMTP id em1mr303049wib.29.1416603683769; Fri, 21 Nov 2014 13:01:23 -0800 (PST) Received: by 10.194.76.34 with HTTP; Fri, 21 Nov 2014 13:01:23 -0800 (PST) In-Reply-To: <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> References: <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de> <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> Date: Fri, 21 Nov 2014 13:01:23 -0800 Message-ID: Subject: Re: igb Could not setup receive structures (again) From: Jack Vogel To: =?ISO-8859-1?Q?Gerrit_K=FChn?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 21:01:26 -0000 Yes, its strange, the mbuf resources look fine. Can you show the dmesg record from a boot that includes the failure please? Jack On Fri, Nov 21, 2014 at 9:33 AM, Gerrit K=FChn wrote: > On Fri, 21 Nov 2014 08:22:31 -0800 Jack Vogel wrote > about Re: igb Could not setup receive structures (again): > > JV> After you get the error do a `netstat -m` and see what the state of t= he > JV> 9K jumbo pool is, for that is the size you would be using. > > Hm... > > --- > root@mclane:~ # netstat -m > 20472/33783/54255 mbufs in use (current/cache/total) > 20461/31381/51842/1014856 mbuf clusters in use (current/cache/total/max) > 20461/29764 mbuf+clusters out of packet secondary zone in use > (current/cache) > 0/191/191/507428 4k (page size) jumbo clusters in use > (current/cache/total/max) > 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) > 46040K/102796K/148836K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) > 0/10/0 requests for jumbo clusters denied (4k/9k/16k) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > > root@mclane:~ # ifconfig igb1 mtu 9000 > > root@mclane:~ # netstat -m > 16373/37882/54255 mbufs in use (current/cache/total) > 16369/35473/51842/1014856 mbuf clusters in use (current/cache/total/max) > 16369/33856 mbuf+clusters out of packet secondary zone in use > (current/cache) > 0/191/191/507428 4k (page size) jumbo clusters in use > (current/cache/total/max) > 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) > 36831K/112005K/148836K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) > 0/12/0 requests for jumbo clusters denied (4k/9k/16k) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > > --- > > > JV> Depending on the specific device type you may have up to 8 rings > JV> per interface, and with a ring size of 1K... > JV> It does seem like you should have enough, but maybe something else > JV> in your system is using the pool? As I said, look at netstat, it > JV> should give you the truth, and then adjust the allocated size to fit > JV> your needs. > > I must admit that I cannot make much of this output... looks all fine to > me? > > > cu > Gerrit >