From owner-freebsd-net@freebsd.org Mon Aug 10 13:33:13 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8299099DE90 for ; Mon, 10 Aug 2015 13:33:13 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from nm37-vm8.bullet.mail.ne1.yahoo.com (nm37-vm8.bullet.mail.ne1.yahoo.com [98.138.229.136]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4AD959A1 for ; Mon, 10 Aug 2015 13:33:13 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1439213263; bh=5EoiWtAzogjuSETwFbf3qQajWVK2Nu5bGZNi0rM4jOE=; h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:From:Subject; b=aTZDq4/eN57T3AGY9Lzg/jSvfd1NiL3wEgBL3TENKJ+XlmjvZuj8DTm+IHIdmO9m8WtJfodRK4SF8IDTR+LNa8BCIn2nF6h8oKPSnlKU1BxBtMBS0K3xyFvB8w1YhSgC8IhIFWoPtk5orGKmhZTs95v4jVqcoYC35rkO8XH0tqKuvrDPqd8h6ChqIBL2EmBvDfkTEZrxxh7G+2JVMyAtUIdeyxwqYSQA/ytM3GKhMcPu9YAZZXDZeeq06R10rjvmcBIKVBvwKnediHbk6g1YOTksjc0xHiANeY0EGJHRfbEljfe3Qm4Cz7Yus8dVjffW0akL2ssVkGo92N2IymfI3Q== Received: from [127.0.0.1] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 10 Aug 2015 13:27:43 -0000 Received: from [98.138.226.177] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 10 Aug 2015 13:24:43 -0000 Received: from [98.138.87.7] by tm12.bullet.mail.ne1.yahoo.com with NNFMP; 10 Aug 2015 13:24:43 -0000 Received: from [127.0.0.1] by omp1007.mail.ne1.yahoo.com with NNFMP; 10 Aug 2015 13:24:43 -0000 X-Yahoo-Newman-Property: ymail-4 X-Yahoo-Newman-Id: 538996.83387.bm@omp1007.mail.ne1.yahoo.com X-YMail-OSG: 4nWZcPUVM1m9pVZxG5g3YJSX0w0RqHafGEsMlfyHiLZQYhUn4TkjFlrPhWtCMGa 4IXx.0Z8cbYDlBNChZ_HbjXAHw6b9yGM2wZEYXv5yWqy47JDtbAVpAECfvWOoJWaHoTm.87rMFSE xnV6TgLBT3YEYvLKrgist7OW4kq7kinZD4A3wpjpYXJ6Kk5YeEh0mNVSco9npCeRhn2OeuW8gowP cN9auYl4FEprWzqFrSUg8UNcDAZwpYHOV4rRqjTHnxTqJM4dvcAuCVhcIGt8lm0EspkH74t3yX1k PXAXMPqnGWRGbgIoDwhOFdnJgtXv.GdCFoZQqStlODo3glHoogW95VrYppMa5qjxR1vMuLP6GD4q pusdZTUwgw5ELWzfmm1MqF58_nxjBOLqJvP.IYiClGnKeorSfrVawJAyHzku8rBjLnKrE4xyeBsT ibdoq1lNTxi9Fw4LkJAziu6F_MNXCbleeiyQEZZzFM4E2zAzE8JyxuwkAY6SGBVPqfBg5HYQ.Z7u sl5ZuWLoI5wHQAKrTrFj_FDkF Received: by 98.138.101.183; Mon, 10 Aug 2015 13:24:43 +0000 Date: Mon, 10 Aug 2015 13:24:36 +0000 (UTC) From: Barney Cordoba Reply-To: Barney Cordoba To: Kevin Oberman Cc: =?UTF-8?Q?Olivier_Cochard-Labb=C3=A9?= , FreeBSD Net , Adrian Chadd , Eric Joyner , hiren panchasara Message-ID: <1159228245.2025586.1439213076880.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: References: Subject: Re: Exposing full 32bit RSS hash from card for ixgbe(4) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Aug 2015 13:33:13 -0000 On Wednesday, August 5, 2015 4:28 PM, Kevin Oberman wrote: =20 On Wed, Aug 5, 2015 at 7:10 AM, Barney Cordoba via freebsd-net < freebsd-net@freebsd.org> wrote: > > > >=C2=A0 =C2=A0 =C2=A0 On Wednesday, August 5, 2015 2:19 AM, Olivier Cochard= -Labb=C3=A9 < > olivier@cochard.me> wrote: > > >=C2=A0 On Wed, Aug 5, 2015 at 1:15 AM, Barney Cordoba via freebsd-net < > freebsd-net@freebsd.org> wrote: > > > What's the point of all of this gobbledygook anyway? Seriously, 99% of > the > > world needs a driver that passes packets in the most efficient way, and > > every time I look at igb and ixgbe it has another 2 heads. It's up to 8 > > heads, and none of the things wrong with it have been fixed. This is no= w > > even uglier than Kip Macy's cxgb abortion. > > I'm not trying to be snarky here. I wrote a simple driver 3 years ago > that > > runs and runs and uses little cpu; maybe 8% for a full gig load on an E= 3. > > > > =E2=80=8BHi, > > I will be very happy to bench your simple driver. Where can I download th= e > sources ? > > Thanks, > > Olivier > _______________________________________________ > > Another unproductive dick head on the FreeBSD team? Figures. > A typical Barney thread. First he calls the developers incompetent and says he has done better. Then someone who has experience in real world benchmarking (not a trivial thing) offers to evaluate Barney's code, and gets a quick, rude, obscene dismissal. Is it any wonder that, even though he made some valid arguments (at least for some workloads), almost everyone just dismisses him as too obnoxious to try to deal with. Based on my pre-retirement work with high-performance networking, in some cases it was clear that it would be better to locking down things to a single CPU on with FreeBSD or Linux. I can further state that this was NOT true for all workloads, so it is quite possible that Barney's code works for some cases (perhaps his) and would be bad in others. But without good benchmarking, it's hard to tell. I will say that for large volume data transfers (very large flows), a single CPU solution does work best. But if Barney is going at this with his usual attitude, it's probably=C2=A0 not worth it to continue the discussion= . -- the "give us the source and we'll test it" nonsense is kindergarden stuff. = As if my code is open source and you can just have it, and like you know ho= w to benchmark anything since you can't even benchmark what you have.=C2=A0 Some advice is to ignore guys like Oberman who spent their lives randomly p= ounding networks on slow machines with slow busses and bad NICs on OS's tha= t couldn't do SMP properly. Because he'll just lead you down the road to du= sty death. Multicore design isn't simple math; its about efficiency, lock m= inimization and the understanding that shifting memory between cpus unneces= sarily is costly. Today's=C2=A0CPUs and NICs can't be judged using test met= hods of the past. You'll just end up playing the Microsoft Windows game; ge= t bigger machines and more memory and don't worry about the fact that the c= ode is junk. It's just that the "default" in these drivers is so obviously wrong that it= 's mind-boggling. The argument to use 1, 2 or 4 queues is one worth having;= using "all" of the cpus, including the hyperthreads, is just plain incompe= tent. I will contribute one possibly useful tidbit: disable_queue() only disables receive interrupts. Both tx and rx ints are e= ffectively tied together by moderation so you'll just getan interrupt at th= e next slot anyway. BC From owner-freebsd-net@freebsd.org Tue Aug 11 08:09:31 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E988599F253 for ; Tue, 11 Aug 2015 08:09:31 +0000 (UTC) (envelope-from lakshmi.n@msystechnologies.com) Received: from mail-pa0-f44.google.com (mail-pa0-f44.google.com [209.85.220.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C0EC9765 for ; Tue, 11 Aug 2015 08:09:31 +0000 (UTC) (envelope-from lakshmi.n@msystechnologies.com) Received: by pacgr6 with SMTP id gr6so45618080pac.2 for ; Tue, 11 Aug 2015 01:09:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:mime-version:from:to:cc:subject :importance:date:in-reply-to:references:content-type; bh=umVmpRHXxcwbHEOMcOR9MKV8RyNrA+j71kEW8TL3yw8=; b=iDkKz1dpHw/Ed/Jpx8k56jsy00DJ5y4UKyBQazXk8rYAUFe/UsEi2pkPRa8rHgWMEm kt0jcloSrCRixiBlaWUegEfBQ+cO+pc9PEGlgt2Kq+VSG1L/62d25jsUtc1+bGErs6zJ qKE+rdFAcFgaXRntJD4LEc6+DvWEQweIGoCq/eG0cCOFz1A5SUImY0yvIRpVwCrUmyhE 2+pgqrUr2H79Vz2zOFifRgg5Js2p4jcFB0zSzJmVGqf1X7hPwCjGqeLUaPj2yzs1JYe1 SrkGRhVUff6tVoTOwxjgg9BWeZ2wsur5JOIHivTy+/ckcDpsFA84YwnIULthmL66f3DJ /G2g== X-Gm-Message-State: ALoCoQlC4QounSjgsEVUGVMliSlBg/X69WUxWP4vqxccR4k04ipWPPxW0/IUYgDxgdu6tEnmfc7g X-Received: by 10.66.122.207 with SMTP id lu15mr53768222pab.146.1439280565079; Tue, 11 Aug 2015 01:09:25 -0700 (PDT) Received: from GandivaPC ([113.193.28.226]) by smtp.gmail.com with ESMTPSA id ov3sm1557739pdb.2.2015.08.11.01.09.22 (version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 11 Aug 2015 01:09:24 -0700 (PDT) Message-ID: <55c9adb4.a384460a.8fa38.4179@mx.google.com> MIME-Version: 1.0 From: =?utf-8?Q?Lakshmi_Narasimhan_Sundararajan?= To: "=?utf-8?Q?freebsd-net@freebsd.org?=" CC: "=?utf-8?Q?Lewis,_Fred?=" , "=?utf-8?Q?Pokala,_Ravi?=" , "=?utf-8?Q?panasas-network@msystechnologies.com?=" Subject: =?utf-8?Q?Fw:_D3300:_LAG_LACP_timeout_tunable_through_IOCTL?= Importance: Normal Date: Tue, 11 Aug 2015 08:04:37 +0000 In-Reply-To: References: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Aug 2015 08:09:32 -0000 SGkgRnJlZUJTRCBUZWFtLA0KDQpXZSBoYXZlIGJlZW4gd29ya2luZyBvbiBMQUNQIHRpbWVvdXQg dHVuYWJsZSB0byBoZWxwIGV4cGVkaXRlIGxpbmsgZmFpbHVyZSBwcm9wYWdhdGlvbiB0aHJvdWdo IGEgSU9DdGwgaW50ZXJmYWNlLg0KDQoNCg0KVGhlIGNoYW5nZXMgaGF2ZSBiZWVuIHRlc3RlZCBh bmQgcmV2aWV3IGlzIGluIHByb2dyZXNzLiANCg0KVGhlIHBoYWJyaWNhdG9yIGxpbmsgaXMgaHR0 cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QzMzAwDQoNCldlIHdvdWxkIGtpbmRseSBhcHByZWNp YXRlIGlmIHRoZSBjaGFuZ2VzIGNhbiBiZSBpbnRlZ3JhdGVkIHRvIENVUlJFTlQgYXQgeW91ciBl YXJsaWVzdC4NCg0KDQpUaGFua3MsDQoNCkxODQoNCg0KDQpNU1lTIFRlY2hub2xvZ2llcw0KDQoN Cg0KDQoNCkZyb206IGxha3NobWkubl9tc3lzdGVjaG5vbG9naWVzLmNvbSAoTE4pDQpTZW50OiDi gI5Nb25kYXnigI4sIOKAjkF1Z3VzdOKAjiDigI4xMOKAjiwg4oCOMjAxNSDigI4y4oCOOuKAjjUy 4oCOIOKAjlBNDQpUbzogbGFrc2htaS5uQG1zeXN0ZWNobm9sb2dpZXMuY29tDQoNCg0KDQoNCg0K bGFrc2htaS5uX21zeXN0ZWNobm9sb2dpZXMuY29tIG1hcmtlZCAyIGlubGluZSBjb21tZW50cyBh cyBkb25lLg0KbGFrc2htaS5uX21zeXN0ZWNobm9sb2dpZXMuY29tIGFkZGVkIGEgY29tbWVudC4N Cg0KV2FycmVuLCBJIGhhdmUgYWRkcmVzc2VkIHlvdXIgY29tbWVudHMuIFBsZWFzZSBsZXQgbWUg a25vdyBob3cgSSBjYW4gc3BlZWQgdXAgdGhlIHByb2Nlc3MgdG8gZ2V0IHRoaXMgaW50ZWdyYXRl ZCB0byBtYWlubGluZS4NCg0KDQpSRVZJU0lPTiBERVRBSUwNCiAgaHR0cHM6Ly9yZXZpZXdzLmZy ZWVic2Qub3JnL0QzMzAwDQoNCkVNQUlMIFBSRUZFUkVOQ0VTDQogIGh0dHBzOi8vcmV2aWV3cy5m cmVlYnNkLm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLw0KDQpUbzogbGFrc2ht aS5uX21zeXN0ZWNobm9sb2dpZXMuY29tLCBtYW5wYWdlcywgcnBva2FsYS1wYW5hc2FzLmNvbQ0K Q2M6IHdibG9jaywgaW1w