From owner-freebsd-net@FreeBSD.ORG Fri Nov 21 21:01:26 2014 Return-Path: <owner-freebsd-net@FreeBSD.ORG> Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4594F681 for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 21:01:26 +0000 (UTC) Received: from mail-wg0-x231.google.com (mail-wg0-x231.google.com [IPv6:2a00:1450:400c:c00::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BED10B9E for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 21:01:25 +0000 (UTC) Received: by mail-wg0-f49.google.com with SMTP id x12so7568357wgg.36 for <freebsd-net@freebsd.org>; Fri, 21 Nov 2014 13:01:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/ysosHi00YHKKEodxE6WieKYUSfmlYt01c/gO1pNv8I=; b=qt5DXlEoMKcyTT+95JlOZEEmw679huqNE2er+yb0kwoyY7oIcP5+T2a2V9/2jwQd9T GrZRCyZfvSFqkPl8gz1JWXw9Hx2BcbGSq6Di5Z2V+3kYUn1LltT1TP1mR0B3SAVf71Qz Rr9PDLdCDkIysPLCmSZklq0PktU8yVAhw1bsIT4c2VaqAmSclba0ltBGFdH54H5T81Tq YMnC3rysPkelNTPF7M7LEz4+Hi84keXa7aModzGDihA6o2BNrK0TaytyZoLKaoSZHY+N OPaTgNZZvU0NokrjCPuXiM8iEdDd96o4xyGUEnECgtZiXnB+4g0XFPRHCiyGhfSDFEp3 P76Q== MIME-Version: 1.0 X-Received: by 10.180.99.1 with SMTP id em1mr303049wib.29.1416603683769; Fri, 21 Nov 2014 13:01:23 -0800 (PST) Received: by 10.194.76.34 with HTTP; Fri, 21 Nov 2014 13:01:23 -0800 (PST) In-Reply-To: <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> References: <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de> <CAFOYbcnNMFneGN9GhHQDia4GYfhdYjoSMgGF_0_V7RbLMUyNWQ@mail.gmail.com> <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> Date: Fri, 21 Nov 2014 13:01:23 -0800 Message-ID: <CAFOYbckFyo8nyzo=nM0_eD6mnTFmYrMuLYXZTXMn=dfw9Q223A@mail.gmail.com> Subject: Re: igb Could not setup receive structures (again) From: Jack Vogel <jfvogel@gmail.com> To: =?ISO-8859-1?Q?Gerrit_K=FChn?= <gerrit.kuehn@aei.mpg.de> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Net <freebsd-net@freebsd.org> X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/> List-Post: <mailto:freebsd-net@freebsd.org> List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=subscribe> X-List-Received-Date: Fri, 21 Nov 2014 21:01:26 -0000 Yes, its strange, the mbuf resources look fine. Can you show the dmesg record from a boot that includes the failure please? Jack On Fri, Nov 21, 2014 at 9:33 AM, Gerrit K=FChn <gerrit.kuehn@aei.mpg.de> wrote: > On Fri, 21 Nov 2014 08:22:31 -0800 Jack Vogel <jfvogel@gmail.com> wrote > about Re: igb Could not setup receive structures (again): > > JV> After you get the error do a `netstat -m` and see what the state of t= he > JV> 9K jumbo pool is, for that is the size you would be using. > > Hm... > > --- > root@mclane:~ # netstat -m > 20472/33783/54255 mbufs in use (current/cache/total) > 20461/31381/51842/1014856 mbuf clusters in use (current/cache/total/max) > 20461/29764 mbuf+clusters out of packet secondary zone in use > (current/cache) > 0/191/191/507428 4k (page size) jumbo clusters in use > (current/cache/total/max) > 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) > 46040K/102796K/148836K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) > 0/10/0 requests for jumbo clusters denied (4k/9k/16k) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > > root@mclane:~ # ifconfig igb1 mtu 9000 > > root@mclane:~ # netstat -m > 16373/37882/54255 mbufs in use (current/cache/total) > 16369/35473/51842/1014856 mbuf clusters in use (current/cache/total/max) > 16369/33856 mbuf+clusters out of packet secondary zone in use > (current/cache) > 0/191/191/507428 4k (page size) jumbo clusters in use > (current/cache/total/max) > 0/3425/3425/150349 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/84571 16k jumbo clusters in use (current/cache/total/max) > 36831K/112005K/148836K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) > 0/12/0 requests for jumbo clusters denied (4k/9k/16k) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > > --- > > > JV> Depending on the specific device type you may have up to 8 rings > JV> per interface, and with a ring size of 1K... > JV> It does seem like you should have enough, but maybe something else > JV> in your system is using the pool? As I said, look at netstat, it > JV> should give you the truth, and then adjust the allocated size to fit > JV> your needs. > > I must admit that I cannot make much of this output... looks all fine to > me? > > > cu > Gerrit >