From owner-freebsd-net@FreeBSD.ORG  Tue Aug 24 12:37:53 2010
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id E8236106564A;
	Tue, 24 Aug 2010 12:37:53 +0000 (UTC)
	(envelope-from adrian.chadd@gmail.com)
Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com
	[209.85.160.182])
	by mx1.freebsd.org (Postfix) with ESMTP id 8B7098FC0C;
	Tue, 24 Aug 2010 12:37:53 +0000 (UTC)
Received: by gyg4 with SMTP id 4so2968335gyg.13
	for <multiple recipients>; Tue, 24 Aug 2010 05:37:52 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=domainkey-signature:mime-version:received:received:in-reply-to
	:references:date:message-id:subject:from:to:cc:content-type
	:content-transfer-encoding;
	bh=gSG7gODTrnIbGtLU1RC0gQouwGYneIl4WqWxek0oeZw=;
	b=q5ERAmFm0WqfCUtDb5w05fDXudwoXx237qPkUPKbyxc4XMN7povxnhdKhtV17DxwkS
	fRhhzq9Dss/pQ6BM72QQcbkwb1DtMs+wv7ig3LL8XgNR4TceKRv/WGI2fn1Md3hmBKzh
	nkGSVlDz3dbx6DDX4UKRwvvtK8+RAd834G1dU=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
	h=mime-version:in-reply-to:references:date:message-id:subject:from:to
	:cc:content-type:content-transfer-encoding;
	b=bWJ+pfPC+O25onQWvSmiuybI9gxMMIxC6JTt5B6xH8EhuzedZFsDSiCY1txfZiWDHt
	VsfvRdavowwDVSKSIP/KrHIMdWk1Z+3ytsxRXlX/0JjMjrdCCa9Xavjr/ZgoBIj5j019
	UI91Sr3QY3t6IE6jx/d+UBTW3R4dyTpzz30R4=
MIME-Version: 1.0
Received: by 10.151.130.17 with SMTP id h17mr6748279ybn.426.1282653472579;
	Tue, 24 Aug 2010 05:37:52 -0700 (PDT)
Received: by 10.231.168.14 with HTTP; Tue, 24 Aug 2010 05:37:52 -0700 (PDT)
In-Reply-To: <4C724AD9.5020000@freebsd.org>
References: <AANLkTikrbCFHz-CnuYcgH2JzpeH5hob0Aa2y5dwn3Hvv@mail.gmail.com>
	<AANLkTikYMU=wML_z=HDnkUF1PGYMVa1q-QWTrkxD+7EP@mail.gmail.com>
	<20100822222746.GC6013@michelle.cdnetworks.com>
	<AANLkTi=t+nG8isp1nf2aBec+FwomApNt0NBPO8LqZ+=9@mail.gmail.com>
	<4C724AD9.5020000@freebsd.org>
Date: Tue, 24 Aug 2010 20:37:52 +0800
Message-ID: <AANLkTikBHiQ15CFKhsP4Z=9bRJEP-1_RAJAS4Y3U1GLT@mail.gmail.com>
From: Adrian Chadd <adrian.chadd@gmail.com>
To: Andre Oppermann <andre@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: pyunyh@gmail.com, freebsd-net@freebsd.org
Subject: Re: 8.0-RELEASE-p3: 4k jumbo mbuf cluster exhaustion
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 24 Aug 2010 12:37:54 -0000

On 23 August 2010 18:18, Andre Oppermann <andre@freebsd.org> wrote:
> It seems the 4k clusters do not get freed back to the pool after they've
> been sent by the NIC and dropped from the socket buffer after the ACK has
> arrived. =A0The leak must occur in one of these two places. =A0The socket
> buffer is unlikely as it would affect not just you but everyone else too.
> Thus the mbuf freeing after DMA/tx in the bce(4) driver is the prime
> suspect.

They don't stay leaked though. Killing the offending process sees
mbuf's eventually returned.
It isn't immediate though. It may be related to timing out existing
socket connections or something?

I haven't yet brought up the second box enough to start passing test
traffic, so I can't provide any further details than this.

Adrian