From owner-freebsd-net@FreeBSD.ORG  Tue Oct 25 06:08:17 2011
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 24EA6106564A
	for <freebsd-net@freebsd.org>; Tue, 25 Oct 2011 06:08:17 +0000 (UTC)
	(envelope-from sergeysaley@gmail.com)
Received: from sam.nabble.com (sam.nabble.com [216.139.236.26])
	by mx1.freebsd.org (Postfix) with ESMTP id EECD88FC0A
	for <freebsd-net@freebsd.org>; Tue, 25 Oct 2011 06:08:16 +0000 (UTC)
Received: from [192.168.236.26] (helo=sam.nabble.com)
	by sam.nabble.com with esmtp (Exim 4.72)
	(envelope-from <sergeysaley@gmail.com>) id 1RIaBM-0006Jx-6P
	for freebsd-net@freebsd.org; Mon, 24 Oct 2011 23:08:16 -0700
Date: Mon, 24 Oct 2011 23:08:16 -0700 (PDT)
From: Sergey Saley <sergeysaley@gmail.com>
To: freebsd-net@freebsd.org
Message-ID: <1319522896192-4935167.post@n5.nabble.com>
In-Reply-To: <CACqU3MXMXQf8CP9trpBo81B9Zxo89SVw8GXsmAA_jw-CWYQyaw@mail.gmail.com>
References: <1319449307149-4931883.post@n5.nabble.com>
	<CAFOYbc=vM6_UMXCTOUz_mTyTVpCxp61Np68ERH8tx4KE9aT8gA@mail.gmail.com>
	<1319478384269-4933498.post@n5.nabble.com>
	<CAFOYbcnF8Q-E0Jocja6LQ8HuwTwkL5ghuo_KWM0uku0mxpNHDw@mail.gmail.com>
	<1319483324861-4933765.post@n5.nabble.com>
	<CAFMmRNzYiJz_FigTMLr4iNTr4dhVy+biCgUJ+T5uuCvYw6vEPA@mail.gmail.com>
	<1319485884830-4933934.post@n5.nabble.com>
	<CAFMmRNwOieMM83wHwqukDQy=D5y43ULZOiazVQV0Af5Ad1Tzrw@mail.gmail.com>
	<CACqU3MXMXQf8CP9trpBo81B9Zxo89SVw8GXsmAA_jw-CWYQyaw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Subject: Re: Too much interrupts on ixgbe
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 25 Oct 2011 06:08:17 -0000


Arnaud Lacombe-6 wrote:
>=20
> Hi,
>=20
> On Mon, Oct 24, 2011 at 4:32 PM, Ryan Stone &lt;rysto32@&gt; wrote:
>> On Mon, Oct 24, 2011 at 3:51 PM, Sergey Saley &lt;sergeysaley@&gt; wrote=
:
>>> MPD5, netgraph, pppoe.Types of traffic - any (customer traffic).
>>> Bying this card I counted on a 3-4G traffic at 3-4K pppoe sessions.
>>> It turned to 600-700Mbit/s, about 50K pps at 700-800 pppoe sessions.
>>
>> PPPoE is your problem. =C2=A0The Intel cards can't load-balance PPPoE
>> traffic, so everything goes to one queue. =C2=A0It may be possible to wr=
ite
>> a netgraph module to load-balance the traffic across your CPUs.
>>
> NetGraph already runs a thread per CPU, as you can see in top's
> output. There is also still have plenty of CPU usable, so I'd assume
> some hard-limit are hit, maybe any of `net.graph.maxdata' or
> `net.graph.maxalloc'.
>=20
> Sergey, what is the output of:
>=20
> # vmstat -z | grep NetGraph
>=20
>=20

# vmstat -z | grep NetGraph
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
NetGraph items:          72,   4118,       2,     404,40806244,   0,   0
NetGraph data items:     72,    522,       0,     406,658514523,   0,   0


--
View this message in context: http://freebsd.1045724.n5.nabble.com/Too-much=
-interrupts-on-ixgbe-tp4931883p4935167.html
Sent from the freebsd-net mailing list archive at Nabble.com.