Date: Mon, 10 Aug 2015 13:24:36 +0000 (UTC) From: Barney Cordoba <barney_cordoba@yahoo.com> To: Kevin Oberman <rkoberman@gmail.com> Cc: =?UTF-8?Q?Olivier_Cochard-Labb=C3=A9?= <olivier@cochard.me>, FreeBSD Net <freebsd-net@freebsd.org>, Adrian Chadd <adrian@freebsd.org>, Eric Joyner <erj@freebsd.org>, hiren panchasara <hiren@freebsd.org> Subject: Re: Exposing full 32bit RSS hash from card for ixgbe(4) Message-ID: <1159228245.2025586.1439213076880.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: <CAN6yY1tfSq1F%2Bh8wUWYyK7XeUWa5XVYPZXh0nsXXK-QTPwwjeA@mail.gmail.com> References: <CAN6yY1tfSq1F%2Bh8wUWYyK7XeUWa5XVYPZXh0nsXXK-QTPwwjeA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wednesday, August 5, 2015 4:28 PM, Kevin Oberman <rkoberman@gmail.c=
om> wrote:
=20
On Wed, Aug 5, 2015 at 7:10 AM, Barney Cordoba via freebsd-net <
freebsd-net@freebsd.org> wrote:
>
>
>
>=C2=A0 =C2=A0 =C2=A0 On Wednesday, August 5, 2015 2:19 AM, Olivier Cochard=
-Labb=C3=A9 <
> olivier@cochard.me> wrote:
>
>
>=C2=A0 On Wed, Aug 5, 2015 at 1:15 AM, Barney Cordoba via freebsd-net <
> freebsd-net@freebsd.org> wrote:
>
> > What's the point of all of this gobbledygook anyway? Seriously, 99% of
> the
> > world needs a driver that passes packets in the most efficient way, and
> > every time I look at igb and ixgbe it has another 2 heads. It's up to 8
> > heads, and none of the things wrong with it have been fixed. This is no=
w
> > even uglier than Kip Macy's cxgb abortion.
> > I'm not trying to be snarky here. I wrote a simple driver 3 years ago
> that
> > runs and runs and uses little cpu; maybe 8% for a full gig load on an E=
3.
> >
>
> =E2=80=8BHi,
>
> I will be very happy to bench your simple driver. Where can I download th=
e
> sources ?
>
> Thanks,
>
> Olivier
> _______________________________________________
>
> Another unproductive dick head on the FreeBSD team? Figures.
>
A typical Barney thread. First he calls the developers incompetent and says
he has done better. Then someone who has experience in real world
benchmarking (not a trivial thing) offers to evaluate Barney's code, and
gets a quick, rude, obscene dismissal. Is it any wonder that, even though
he made some valid arguments (at least for some workloads), almost everyone
just dismisses him as too obnoxious to try to deal with.
Based on my pre-retirement work with high-performance networking, in some
cases it was clear that it would be better to locking down things to a
single CPU on with FreeBSD or Linux. I can further state that this was NOT
true for all workloads, so it is quite possible that Barney's code works
for some cases (perhaps his) and would be bad in others. But without good
benchmarking, it's hard to tell.
I will say that for large volume data transfers (very large flows), a
single CPU solution does work best. But if Barney is going at this with his
usual attitude, it's probably=C2=A0 not worth it to continue the discussion=
.
--
the "give us the source and we'll test it" nonsense is kindergarden stuff. =
As if my code is open source and you can just have it, and like you know ho=
w to benchmark anything since you can't even benchmark what you have.=C2=A0
Some advice is to ignore guys like Oberman who spent their lives randomly p=
ounding networks on slow machines with slow busses and bad NICs on OS's tha=
t couldn't do SMP properly. Because he'll just lead you down the road to du=
sty death. Multicore design isn't simple math; its about efficiency, lock m=
inimization and the understanding that shifting memory between cpus unneces=
sarily is costly. Today's=C2=A0CPUs and NICs can't be judged using test met=
hods of the past. You'll just end up playing the Microsoft Windows game; ge=
t bigger machines and more memory and don't worry about the fact that the c=
ode is junk.
It's just that the "default" in these drivers is so obviously wrong that it=
's mind-boggling. The argument to use 1, 2 or 4 queues is one worth having;=
using "all" of the cpus, including the hyperthreads, is just plain incompe=
tent.
I will contribute one possibly useful tidbit:
disable_queue() only disables receive interrupts. Both tx and rx ints are e=
ffectively tied together by moderation so you'll just getan interrupt at th=
e next slot anyway.
BC
From owner-freebsd-net@freebsd.org Tue Aug 11 08:09:31 2015
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
by mailman.ysv.freebsd.org (Postfix) with ESMTP id E988599F253
for <freebsd-net@mailman.ysv.freebsd.org>;
Tue, 11 Aug 2015 08:09:31 +0000 (UTC)
(envelope-from lakshmi.n@msystechnologies.com)
Received: from mail-pa0-f44.google.com (mail-pa0-f44.google.com
[209.85.220.44])
(using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
(Client CN "smtp.gmail.com",
Issuer "Google Internet Authority G2" (verified OK))
by mx1.freebsd.org (Postfix) with ESMTPS id C0EC9765
for <freebsd-net@freebsd.org>; Tue, 11 Aug 2015 08:09:31 +0000 (UTC)
(envelope-from lakshmi.n@msystechnologies.com)
Received: by pacgr6 with SMTP id gr6so45618080pac.2
for <freebsd-net@freebsd.org>; Tue, 11 Aug 2015 01:09:25 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20130820;
h=x-gm-message-state:message-id:mime-version:from:to:cc:subject
:importance:date:in-reply-to:references:content-type;
bh=umVmpRHXxcwbHEOMcOR9MKV8RyNrA+j71kEW8TL3yw8=;
b=iDkKz1dpHw/Ed/Jpx8k56jsy00DJ5y4UKyBQazXk8rYAUFe/UsEi2pkPRa8rHgWMEm
kt0jcloSrCRixiBlaWUegEfBQ+cO+pc9PEGlgt2Kq+VSG1L/62d25jsUtc1+bGErs6zJ
qKE+rdFAcFgaXRntJD4LEc6+DvWEQweIGoCq/eG0cCOFz1A5SUImY0yvIRpVwCrUmyhE
2+pgqrUr2H79Vz2zOFifRgg5Js2p4jcFB0zSzJmVGqf1X7hPwCjGqeLUaPj2yzs1JYe1
SrkGRhVUff6tVoTOwxjgg9BWeZ2wsur5JOIHivTy+/ckcDpsFA84YwnIULthmL66f3DJ
/G2g==
X-Gm-Message-State: ALoCoQlC4QounSjgsEVUGVMliSlBg/X69WUxWP4vqxccR4k04ipWPPxW0/IUYgDxgdu6tEnmfc7g
X-Received: by 10.66.122.207 with SMTP id lu15mr53768222pab.146.1439280565079;
Tue, 11 Aug 2015 01:09:25 -0700 (PDT)
Received: from GandivaPC ([113.193.28.226])
by smtp.gmail.com with ESMTPSA id ov3sm1557739pdb.2.2015.08.11.01.09.22
(version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128);
Tue, 11 Aug 2015 01:09:24 -0700 (PDT)
Message-ID: <55c9adb4.a384460a.8fa38.4179@mx.google.com>
MIME-Version: 1.0
From: =?utf-8?Q?Lakshmi_Narasimhan_Sundararajan?=
<lakshmi.n@msystechnologies.com>
To: "=?utf-8?Q?freebsd-net@freebsd.org?=" <freebsd-net@freebsd.org>
CC: "=?utf-8?Q?Lewis,_Fred?=" <flewis@panasas.com>,
"=?utf-8?Q?Pokala,_Ravi?=" <rpokala@panasas.com>,
"=?utf-8?Q?panasas-network@msystechnologies.com?="
<panasas-network@msystechnologies.com>
Subject: =?utf-8?Q?Fw:_D3300:_LAG_LACP_timeout_tunable_through_IOCTL?=
Importance: Normal
Date: Tue, 11 Aug 2015 08:04:37 +0000
In-Reply-To: <da728ddaff1aa66322fae212e31fabf9@localhost.localdomain>
References: <differential-rev-PHID-DREV-4bst3oopwtbisqvaisl5-req@FreeBSD.org>,
<da728ddaff1aa66322fae212e31fabf9@localhost.localdomain>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
X-Content-Filtered-By: Mailman/MimeDel 2.1.20
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.20
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>;
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 11 Aug 2015 08:09:32 -0000
SGkgRnJlZUJTRCBUZWFtLA0KDQpXZSBoYXZlIGJlZW4gd29ya2luZyBvbiBMQUNQIHRpbWVvdXQg
dHVuYWJsZSB0byBoZWxwIGV4cGVkaXRlIGxpbmsgZmFpbHVyZSBwcm9wYWdhdGlvbiB0aHJvdWdo
IGEgSU9DdGwgaW50ZXJmYWNlLg0KDQoNCg0KVGhlIGNoYW5nZXMgaGF2ZSBiZWVuIHRlc3RlZCBh
bmQgcmV2aWV3IGlzIGluIHByb2dyZXNzLiANCg0KVGhlIHBoYWJyaWNhdG9yIGxpbmsgaXMgaHR0
cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QzMzAwDQoNCldlIHdvdWxkIGtpbmRseSBhcHByZWNp
YXRlIGlmIHRoZSBjaGFuZ2VzIGNhbiBiZSBpbnRlZ3JhdGVkIHRvIENVUlJFTlQgYXQgeW91ciBl
YXJsaWVzdC4NCg0KDQpUaGFua3MsDQoNCkxODQoNCg0KDQpNU1lTIFRlY2hub2xvZ2llcw0KDQoN
Cg0KDQoNCkZyb206IGxha3NobWkubl9tc3lzdGVjaG5vbG9naWVzLmNvbSAoTE4pDQpTZW50OiDi
gI5Nb25kYXnigI4sIOKAjkF1Z3VzdOKAjiDigI4xMOKAjiwg4oCOMjAxNSDigI4y4oCOOuKAjjUy
4oCOIOKAjlBNDQpUbzogbGFrc2htaS5uQG1zeXN0ZWNobm9sb2dpZXMuY29tDQoNCg0KDQoNCg0K
bGFrc2htaS5uX21zeXN0ZWNobm9sb2dpZXMuY29tIG1hcmtlZCAyIGlubGluZSBjb21tZW50cyBh
cyBkb25lLg0KbGFrc2htaS5uX21zeXN0ZWNobm9sb2dpZXMuY29tIGFkZGVkIGEgY29tbWVudC4N
Cg0KV2FycmVuLCBJIGhhdmUgYWRkcmVzc2VkIHlvdXIgY29tbWVudHMuIFBsZWFzZSBsZXQgbWUg
a25vdyBob3cgSSBjYW4gc3BlZWQgdXAgdGhlIHByb2Nlc3MgdG8gZ2V0IHRoaXMgaW50ZWdyYXRl
ZCB0byBtYWlubGluZS4NCg0KDQpSRVZJU0lPTiBERVRBSUwNCiAgaHR0cHM6Ly9yZXZpZXdzLmZy
ZWVic2Qub3JnL0QzMzAwDQoNCkVNQUlMIFBSRUZFUkVOQ0VTDQogIGh0dHBzOi8vcmV2aWV3cy5m
cmVlYnNkLm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLw0KDQpUbzogbGFrc2ht
aS5uX21zeXN0ZWNobm9sb2dpZXMuY29tLCBtYW5wYWdlcywgcnBva2FsYS1wYW5hc2FzLmNvbQ0K
Q2M6IHdibG9jaywgaW1w
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1159228245.2025586.1439213076880.JavaMail.yahoo>