From owner-freebsd-net@FreeBSD.ORG Tue Apr 7 22:24:17 2009 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D3FE310656C7 for ; Tue, 7 Apr 2009 22:24:17 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from web63901.mail.re1.yahoo.com (web63901.mail.re1.yahoo.com [69.147.97.116]) by mx1.freebsd.org (Postfix) with SMTP id 8E2668FC15 for ; Tue, 7 Apr 2009 22:24:17 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: (qmail 65588 invoked by uid 60001); 7 Apr 2009 22:24:16 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1239143056; bh=SlEu34A7VdbgZUxz38n+v990JMVuEfGsN87WKdh5nvk=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=nyPuwfNQn73q3EDyuh6x8tyxlIVsbQlnQeXFmuz804nVc38iBrFUxDfC2p41R9oe5RW/eC/oVa1xzyU9Q2oMq9OaOXX7IkWjjSXnwsM+1Wo3SqzaBcB6ogCvMODgRVOvPlQP4TIfS+4CXDWgjJ+5eRdvlQ9p6iXgX3BSB8cqBdM= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=JnBzAqR8QcOsCqF+ifDSUMvF4b9EJegkhyQGXbJ64gqtkGDNAAgU4e/gHNnZglX3ePbEQagJCmn/MniVT8wuGEc6CihHAjaF3A+aoMOtJIK/WOcgVIcvUJdB5VK5UoNr+W8OdOEp7cFKQdcabJw1Lb1Urr9xV9+Yr8OOof9Of98=; Message-ID: <900824.65358.qm@web63901.mail.re1.yahoo.com> X-YMail-OSG: Lx63aHgVM1k9rc6b0Xup8J3ieUOaCnx7OiNoNhJAksQVPc6OI8dHNDwzefpR4zCQWOsicFm9k8H5kK0J3fzeeY4B57Tu5NsiG4xcI70OZry9GlwFq3eeEkDwCtw85C7cb5tTNL241vgE6MaM.z6GUwDDuDuEGmbHrYpeTPpggajUqKWbs80PsY8ncjp9vxrDDzta4.uR2PySp.bpHJkbftCdgGcmSJq3ZZRvOSnZbyiy8T4.2QdPn3SfNTWfEJpqGBEVbHuCb3QgPvgeEuqeB1sHLHeKrhmGY.5ud6uWWEwHeW66d4cYuYQV2aFxwfqhfwqEH5_Ec.2HQUzFfxYzNCAd Received: from [98.242.222.229] by web63901.mail.re1.yahoo.com via HTTP; Tue, 07 Apr 2009 15:24:16 PDT X-Mailer: YahooMailWebService/0.7.289.1 Date: Tue, 7 Apr 2009 15:24:16 -0700 (PDT) From: Barney Cordoba To: freebsd-net@freebsd.org, Ivan Voras In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: Subject: Re: Advice on a multithreaded netisr patch? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: barney_cordoba@yahoo.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Apr 2009 22:24:18 -0000 --- On Tue, 4/7/09, Ivan Voras wrote: > From: Ivan Voras > Subject: Re: Advice on a multithreaded netisr patch? > To: freebsd-net@freebsd.org > Date: Tuesday, April 7, 2009, 5:59 PM > Barney Cordoba wrote: > > > 1) Multiple TX queues are not supported. There's > some hokey code to > > test, but it doesn't properly separate flows to > the queues. > > 2) 2 Rx queues don't work, so only 1 and 4 work > > 3) With 4 queues, it just sucks up CPU under heavy > load on 4 cpus. It will > > blow 4 cpus at a lower load than em will with 1 > > 4) You'll need to fix DMA setup, as it sets the > alignment requirement > > to PAGE_SIZE. I haven't been able to convince Jack > that its wrong, not > > that I've tried very hard since its easy to just > fix myself. > > Reading this thread it looks like the development of both > Intel drivers > is a bit stalled, doesn't it? AFAIK the em driver is > also > semi-officially abandoned, and both from my experience and > others it > looks like new development and patches are being rejected. > Time to shop > other hardware? To be fair, the OS doesn't really support multiqueue yet, or has for only a few hours, so lets not go crazy. It makes a lot more sense to have someone on the "team" work with Jack on improving the performance and working out the kinks. When I asked Jack about the poor performance of if_igb, he indicated that Intel's position is that the drivers are "just samples", which really doesn't give anyone much confidence that they want to run their business on them. You already have Jack doing all of the hard work; that is supporting the new-chip-per-week that intel puts out, so it seems to me the best strategy would be to try to convince Intel that its in their best interest to have drivers that work well so people don't think that their hardware stinks. As an example, the Chelsio 10gb bypass card is $3495. and an Intel card is ~$1000, so its a big win for the community as a whole to have good intel drivers going forward. My work is commercially proprietary so I can't share my code, but I can certainly share ideas on things that I've tested and discovered. Barney