From owner-freebsd-net@FreeBSD.ORG Mon Mar 11 07:54:15 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 6EB1146D for ; Mon, 11 Mar 2013 07:54:15 +0000 (UTC) (envelope-from ihsan@grep.my) Received: from svc02-kul.b.n3labs.my (svc02-kul.b.n3labs.my [IPv6:2400:3700:10::61]) by mx1.freebsd.org (Postfix) with ESMTP id 3398BB4D for ; Mon, 11 Mar 2013 07:54:15 +0000 (UTC) Received: from [192.168.2.178] (unknown [175.142.133.189]) by svc02-kul.b.n3labs.my (Postfix) with ESMTPSA id A8E0AC60237 for ; Mon, 11 Mar 2013 15:54:03 +0800 (MYT) From: Ihsan Junaidi Ibrahim Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: increasing 'requests for jumbo clusters denied' Message-Id: <1713E286-B096-44B6-846D-81854D6F809B@grep.my> Date: Mon, 11 Mar 2013 15:52:40 +0800 To: "freebsd-net@freebsd.org" Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) X-Mailer: Apple Mail (2.1499) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Mar 2013 07:54:15 -0000 Hi, I'm on 9.0-RELEASE-p3 and have had a number of instances where my igb0 = network connectivity locked up under heavy load. I've had another em1 device which I used for side-band access which does = not have as much load as my primary igb0 device. I've read previous cases of this but can't seem to find any fitting = solutions. I've tried increasing mbufs and jumbo mbufs: nsv01-kul:ihsan $ sysctl -a | grep nmb kern.ipc.nmbjumbo16: 3200 kern.ipc.nmbjumbo9: 25600 kern.ipc.nmbjumbop: 12800 kern.ipc.nmbclusters: 262144 but I'm still receiving a lot of 'requests for jumbo clusters denied' = stats on netstat -m output. nsv01-kul:ihsan $ netstat -m 7347/3063/10410 mbufs in use (current/cache/total) 334/2658/2992/262144 mbuf clusters in use (current/cache/total/max) 334/1330 mbuf+clusters out of packet secondary zone in use = (current/cache) 1749/1310/3059/12800 4k (page size) jumbo clusters in use = (current/cache/total/max) 5116/563/5679/25600 9k jumbo clusters in use (current/cache/total/max) 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) 55544K/16388K/71933K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/25154247/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines The server has not locked up yet after increasing the mbufs (been less = than 8 hours since increasing this) but can someone enlighten me what = could be the causes for jumbo clusters requests being denied although = I've increased the 9k jumbo clusters to 25600? Thanks. ihsan=