From owner-freebsd-net@FreeBSD.ORG  Thu Sep 22 10:53:16 2011
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 6B98B1065672
	for <net@freebsd.org>; Thu, 22 Sep 2011 10:53:16 +0000 (UTC)
	(envelope-from syuu@dokukino.com)
Received: from mail-qy0-f175.google.com (mail-qy0-f175.google.com
	[209.85.216.175])
	by mx1.freebsd.org (Postfix) with ESMTP id 26FBE8FC0A
	for <net@freebsd.org>; Thu, 22 Sep 2011 10:53:15 +0000 (UTC)
Received: by qyk10 with SMTP id 10so5982902qyk.13
	for <net@freebsd.org>; Thu, 22 Sep 2011 03:53:15 -0700 (PDT)
Received: by 10.229.195.105 with SMTP id eb41mr1499528qcb.182.1316688795144;
	Thu, 22 Sep 2011 03:53:15 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.229.184.199 with HTTP; Thu, 22 Sep 2011 03:52:35 -0700 (PDT)
In-Reply-To: <567B01DF-7D52-4C5C-8F69-96CDB20FAC92@neville-neil.com>
References: <CALG4x-VwhLmnh+Rq0T8zdzp=yMD8o_WQ64_eqzc_dEhF-_mrGA@mail.gmail.com>
	<2AB05A3E-BDC3-427D-B4A7-ABDDFA98D194@dudu.ro>
	<0BB87D28-3094-422D-8262-5FA0E40BFC7C@dudu.ro>
	<CALG4x-VFC0yJK_dB9Z+DoBvBv1FGjOuVYWd=jtTBs0FeArjALg@mail.gmail.com>
	<CALG4x-Vvu=LsRjdvaz19+_QTr2uAqcY514OxA3dy=L+nY-qV5g@mail.gmail.com>
	<567B01DF-7D52-4C5C-8F69-96CDB20FAC92@neville-neil.com>
From: Takuya ASADA <syuu@dokukino.com>
Date: Thu, 22 Sep 2011 19:52:35 +0900
Message-ID: <CALG4x-VxG3hwg=U205a+cEE32YMxs_rtYQfQRFQsbdc8egsjxg@mail.gmail.com>
To: George Neville-Neil <gnn@neville-neil.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: net@freebsd.org
Subject: Re: Multiqueue support for bpf
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 22 Sep 2011 10:53:16 -0000

Sorry for late replying,

> One comment, one question.
>
> First, I think we should try to integrate this work and then tune it up m=
ore. =C2=A0The API
> is, I think, fine, and performance tuning takes a bit of work.

Is there good way(I mean tools or something) to find the bottleneck?

> Second, what are the parameters set on buffers for the drivers? =C2=A0I.e=
. how many slots
> do they have in their queues etc.? =C2=A0If they defaults are too small, =
and often they are,
> then that's going to hurt your performance.

It does equals to number of descriptors per queue, right?
If I'm correct, it's 2048 descriptors per queue by default, and I used
default parameter when I perform benchmarks.

It's on line 290 of
http://p4db.freebsd.org/fileViewer.cgi?FSPC=3D//depot/projects/soc2011/mq_b=
pf/src/sys/dev/ixgbe/ixgbe.c&REV=3D2

and line 105 of
http://p4db.freebsd.org/fileViewer.cgi?FSPC=3D//depot/projects/soc2011/mq_b=
pf/src/sys/dev/ixgbe/ixgbe.h&REV=3D2