From owner-freebsd-amd64@FreeBSD.ORG  Tue May 29 16:44:09 2012
Return-Path: <owner-freebsd-amd64@FreeBSD.ORG>
Delivered-To: freebsd-amd64@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id CF2831065670;
	Tue, 29 May 2012 16:44:09 +0000 (UTC)
	(envelope-from ziyanm@gmail.com)
Received: from mail-pb0-f54.google.com (mail-pb0-f54.google.com
	[209.85.160.54])
	by mx1.freebsd.org (Postfix) with ESMTP id 91CC68FC14;
	Tue, 29 May 2012 16:44:09 +0000 (UTC)
Received: by pbbro2 with SMTP id ro2so6460551pbb.13
	for <multiple recipients>; Tue, 29 May 2012 09:44:09 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
	h=subject:mime-version:content-type:from:in-reply-to:date:cc
	:content-transfer-encoding:message-id:references:to:x-mailer;
	bh=KYEt+gulYN3+SHIDERkcNljcoqi08BKEuapEiDbPo7E=;
	b=NhqUmxZfLjNgQfd9qhkxkbzx1dRvywDKatyLN6tb/yFYaf31G+heWeCs/3HfILR8vx
	PDDMro5zsdMMklAJCrjd9pZyyiDNU1bWw10zwyX5soY6TBDHpTkVQuAytnkJFwTKvkRD
	FtAA5TC0IYrdH9vceBMoBuAM8fy6kk8p5yo5G8FiBcdh934WK5rNOwwJ2oXXOE/ousvt
	ZoPnyZTinnc279l4BSP8ZAV2PZNB/Z6ngVKgxOFRgvipmYiUN3J23cF3yxHZx+STRNTc
	5TrLv+UrS8lsDooUw++d1YxwdRCGzn9DvkpoTD0UIMGHfXgLTUv0FNx+6tgUvv3PiZ6q
	gQ2Q==
Received: by 10.68.226.73 with SMTP id rq9mr38717571pbc.145.1338309849114;
	Tue, 29 May 2012 09:44:09 -0700 (PDT)
Received: from [192.168.1.102] ([112.134.101.120])
	by mx.google.com with ESMTPS id ol1sm4218674pbb.25.2012.05.29.09.44.05
	(version=TLSv1/SSLv3 cipher=OTHER);
	Tue, 29 May 2012 09:44:08 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1257)
Content-Type: text/plain; charset=us-ascii
From: Ziyan Maraikar <ziyanm@gmail.com>
In-Reply-To: <201205290812.40093.jhb@freebsd.org>
Date: Tue, 29 May 2012 22:14:02 +0530
Content-Transfer-Encoding: quoted-printable
Message-Id: <1966F26E-3E73-4E78-8F54-DBDC11195954@gmail.com>
References: <201205252034.q4PKYKcB038870@nanuoya.pdn.ac.lk>
	<201205290812.40093.jhb@freebsd.org>
To: John Baldwin <jhb@freebsd.org>
X-Mailer: Apple Mail (2.1257)
X-Mailman-Approved-At: Tue, 29 May 2012 16:57:04 +0000
Cc: FreeBSD-gnats-submit@freebsd.org, freebsd-amd64@freebsd.org,
	Darshana Jayasinghe <darshana.jayasinghe@gmail.com>
Subject: Re: amd64/168342: mbuf exhaustion hangs all daemons in keglimit
	state
X-BeenThere: freebsd-amd64@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Porting FreeBSD to the AMD64 platform <freebsd-amd64.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-amd64>,
	<mailto:freebsd-amd64-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-amd64>
List-Post: <mailto:freebsd-amd64@freebsd.org>
List-Help: <mailto:freebsd-amd64-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-amd64>,
	<mailto:freebsd-amd64-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 29 May 2012 16:44:09 -0000

Hello John,

Thanks for the response.
>=20
> Have you tried increasing kern.ipc.nmbclusters?  Alternatively, have =
you tried=20
> restricting igb to only using 1 queue?  It sounds like all your igb =
interfaces=20
> are allocating all of your mbuf clusters for their receive rings.
>=20
I found this very suggestion on several mailing list discussions [1] and =
set these values on Saturday.
kern.ipc.nmbclusters=3D"131072"
hw.igb.num_queues=3D"2"
So far everything seems to back to normal, and netstat -m shows plenty =
of headroom now.=20

The problem cropped up after running several months on 9.0-RELEASE when =
I  brought up another interface. Disabling the new interface didn't =
restore normal operation, however. I also tried 8.3-RELEASE but the =
problem was worse on it.

[1] http://osdir.com/ml/freebsd-stable/2012-02/msg00563.html
__
Regards
Ziyan.=