From owner-freebsd-net@FreeBSD.ORG  Fri Nov 21 21:01:26 2014
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 4594F681
 for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 21:01:26 +0000 (UTC)
Received: from mail-wg0-x231.google.com (mail-wg0-x231.google.com
 [IPv6:2a00:1450:400c:c00::231])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id BED10B9E
 for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 21:01:25 +0000 (UTC)
Received: by mail-wg0-f49.google.com with SMTP id x12so7568357wgg.36
 for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 13:01:23 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=/ysosHi00YHKKEodxE6WieKYUSfmlYt01c/gO1pNv8I=;
 b=qt5DXlEoMKcyTT+95JlOZEEmw679huqNE2er+yb0kwoyY7oIcP5+T2a2V9/2jwQd9T
 GrZRCyZfvSFqkPl8gz1JWXw9Hx2BcbGSq6Di5Z2V+3kYUn1LltT1TP1mR0B3SAVf71Qz
 Rr9PDLdCDkIysPLCmSZklq0PktU8yVAhw1bsIT4c2VaqAmSclba0ltBGFdH54H5T81Tq
 YMnC3rysPkelNTPF7M7LEz4+Hi84keXa7aModzGDihA6o2BNrK0TaytyZoLKaoSZHY+N
 OPaTgNZZvU0NokrjCPuXiM8iEdDd96o4xyGUEnECgtZiXnB+4g0XFPRHCiyGhfSDFEp3
 P76Q==
MIME-Version: 1.0
X-Received: by 10.180.99.1 with SMTP id em1mr303049wib.29.1416603683769; Fri,
 21 Nov 2014 13:01:23 -0800 (PST)
Received: by 10.194.76.34 with HTTP; Fri, 21 Nov 2014 13:01:23 -0800 (PST)
In-Reply-To: <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de>
References: <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de>
 <CAFOYbcnNMFneGN9GhHQDia4GYfhdYjoSMgGF_0_V7RbLMUyNWQ@mail.gmail.com>
 <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de>
Date: Fri, 21 Nov 2014 13:01:23 -0800
Message-ID: <CAFOYbckFyo8nyzo=nM0_eD6mnTFmYrMuLYXZTXMn=dfw9Q223A@mail.gmail.com>
Subject: Re: igb Could not setup receive structures (again)
From: Jack Vogel <jfvogel@gmail.com>
To: =?ISO-8859-1?Q?Gerrit_K=FChn?= <gerrit.kuehn@aei.mpg.de>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1
Cc: FreeBSD Net <freebsd-net@freebsd.org>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 21 Nov 2014 21:01:26 -0000

Yes, its strange, the mbuf resources look fine.

Can you show the dmesg record from a boot that
includes the failure please?

Jack


On Fri, Nov 21, 2014 at 9:33 AM, Gerrit K=FChn <gerrit.kuehn@aei.mpg.de>
wrote:

> On Fri, 21 Nov 2014 08:22:31 -0800 Jack Vogel <jfvogel@gmail.com> wrote
> about Re: igb Could not setup receive structures (again):
>
> JV> After you get the error do a `netstat -m` and see what the state of t=
he
> JV> 9K jumbo pool is, for that is the size you would be using.
>
> Hm...
>
> ---
> root@mclane:~ # netstat -m
> 20472/33783/54255 mbufs in use (current/cache/total)
> 20461/31381/51842/1014856 mbuf clusters in use (current/cache/total/max)
> 20461/29764 mbuf+clusters out of packet secondary zone in use
> (current/cache)
> 0/191/191/507428 4k (page size) jumbo clusters in use
> (current/cache/total/max)
> 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max)
> 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max)
> 46040K/102796K/148836K bytes allocated to network (current/cache/total)
> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
> 0/10/0 requests for jumbo clusters denied (4k/9k/16k)
> 0 requests for sfbufs denied
> 0 requests for sfbufs delayed
> 0 requests for I/O initiated by sendfile
>
> root@mclane:~ # ifconfig igb1 mtu 9000
>
> root@mclane:~ # netstat -m
> 16373/37882/54255 mbufs in use (current/cache/total)
> 16369/35473/51842/1014856 mbuf clusters in use (current/cache/total/max)
> 16369/33856 mbuf+clusters out of packet secondary zone in use
> (current/cache)
> 0/191/191/507428 4k (page size) jumbo clusters in use
> (current/cache/total/max)
> 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max)
> 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max)
> 36831K/112005K/148836K bytes allocated to network (current/cache/total)
> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
> 0/12/0 requests for jumbo clusters denied (4k/9k/16k)
> 0 requests for sfbufs denied
> 0 requests for sfbufs delayed
> 0 requests for I/O initiated by sendfile
>
> ---
>
>
> JV> Depending on the specific device type you may have up to 8 rings
> JV> per interface, and with a ring size of 1K...
> JV> It does seem like you should have enough, but maybe something else
> JV> in your system is using the pool? As I said, look at netstat, it
> JV> should give you the truth, and then adjust the allocated size to fit
> JV> your needs.
>
> I must admit that I cannot make much of this output... looks all fine to
> me?
>
>
> cu
>   Gerrit
>