From owner-freebsd-net@FreeBSD.ORG Thu Aug 28 08:32:32 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3B3C2BBB for ; Thu, 28 Aug 2014 08:32:32 +0000 (UTC) Received: from mx11.netapp.com (mx11.netapp.com [216.240.18.76]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx11.netapp.com", Issuer "VeriSign Class 3 International Server CA - G3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id F080C1297 for ; Thu, 28 Aug 2014 08:32:31 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.04,416,1406617200"; d="asc'?scan'208";a="142745797" Received: from vmwexceht04-prd.hq.netapp.com ([10.106.77.34]) by mx11-out.netapp.com with ESMTP; 28 Aug 2014 01:32:28 -0700 Received: from HIOEXCMBX02-PRD.hq.netapp.com (10.122.105.35) by vmwexceht04-prd.hq.netapp.com (10.106.77.34) with Microsoft SMTP Server (TLS) id 14.3.123.3; Thu, 28 Aug 2014 01:32:00 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx02-prd.hq.netapp.com (10.122.105.35) with Microsoft SMTP Server (TLS) id 15.0.913.22; Thu, 28 Aug 2014 01:31:59 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::55e3:a7dc:11bd:462%21]) with mapi id 15.00.0913.011; Thu, 28 Aug 2014 01:32:00 -0700 From: "Eggert, Lars" To: FreeBSD Net Subject: igb "requests for mbufs denied" Thread-Topic: igb "requests for mbufs denied" Thread-Index: AQHPwpqIzDi3XZpt70OIdoMh57Bi8w== Date: Thu, 28 Aug 2014 08:31:59 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.1878.6) x-originating-ip: [10.122.56.79] Content-Type: multipart/signed; boundary="Apple-Mail=_5FFEA2B3-09F4-42CA-B1E7-79BD93E6BA05"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Aug 2014 08:32:32 -0000 --Apple-Mail=_5FFEA2B3-09F4-42CA-B1E7-79BD93E6BA05 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, no matter what value I bump kern.ipc.nmbclusters and kern.ipc.nmbufs to, = I still get "requests for mbufs denied" with igb interfaces, and the = occasional connection stall, even when dialing down hw.igb.num_queues=3D1:= [root@laurel: ~] netstat -m 3070/1355/4425 mbufs in use (current/cache/total) 3069/773/3842/8144896 mbuf clusters in use (current/cache/total/max) 3069/772 mbuf+clusters out of packet secondary zone in use = (current/cache) 0/6/6/1018097 4k (page size) jumbo clusters in use = (current/cache/total/max) 0/0/0/301658 9k jumbo clusters in use (current/cache/total/max) 0/0/0/169682 16k jumbo clusters in use (current/cache/total/max) 6905K/1908K/8814K bytes allocated to network (current/cache/total) 73/3831/3091 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 6/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile The box in question has six igb interfaces, 2x 'I210 Gigabit Network = Connection' and 4x '82580 Gigabit Network Connection' and is running: FreeBSD laurel.muccbc.hq.netapp.com 10.0-RELEASE-p7 FreeBSD = 10.0-RELEASE-p7 #0: Tue Jul 8 06:37:44 UTC 2014 = root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 Anyone have any ideas what else to try? Thanks, Lars --Apple-Mail=_5FFEA2B3-09F4-42CA-B1E7-79BD93E6BA05 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCVAwUBU/7pGNZcnpRveo1xAQLcNwQAg2Vc3dusBevY3EgxpBjdWaNVXbXxU6lL 97HAkLDVJuURAzJ1WxKZsHaEiusYdIHX8e4vrKDg5loYdUE/nj6WWzxxuUVIgOVp JdB2gd41dDjmV7EDYBrAKQOzoXkdvsP2TPDuScdGgZtHA+5H3Lp6XvTMGKiavnpw YNuHwLEU6JI= =UAMP -----END PGP SIGNATURE----- --Apple-Mail=_5FFEA2B3-09F4-42CA-B1E7-79BD93E6BA05--