From owner-freebsd-performance@FreeBSD.ORG Tue Jun 5 22:25:11 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0AF5716A421 for ; Tue, 5 Jun 2007 22:25:11 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.181]) by mx1.freebsd.org (Postfix) with ESMTP id DEF6113C45D for ; Tue, 5 Jun 2007 22:25:10 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by wa-out-1112.google.com with SMTP id j37so2661228waf for ; Tue, 05 Jun 2007 15:25:10 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=B2alqdTkCkhdI/B26++yoloJxJj08iTAvJIrwjwGY644WhcohuZ9W51N6Og1EAC0HFlKoUJQLAJgHKVewum/+zBoRymuW6GCGiIOohhw2VqG9xjEE0nAfw85atQTriIp+W6lzFXnrniL8quxW/cHGboOvOsPUVAxPLBABWj+RP4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=FEjTrWi32HKxdozSxNz/CG1pCTGZVcV6EU7g1wyBe2v1KNsBCKObm4IArjDs9CsqOpS5H0wpVQQrlb67KLKhUktdq9d4BLESpKk1s8Nmr+kwbI72bvib8oCjAYHxG28zEk0r9lt0zu6wXjKEjsFhkNr/oc1ZXzGp1NDZYcrKYBQ= Received: by 10.114.254.1 with SMTP id b1mr6451774wai.1181080557265; Tue, 05 Jun 2007 14:55:57 -0700 (PDT) Received: by 10.114.126.10 with HTTP; Tue, 5 Jun 2007 14:55:57 -0700 (PDT) Message-ID: <2a41acea0706051455mcac3c06p5ca8c13a76d1102f@mail.gmail.com> Date: Tue, 5 Jun 2007 14:55:57 -0700 From: "Jack Vogel" To: "Alan Amesbury" In-Reply-To: <4665D901.1060206@umn.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20070602120018.C5A0516A536@hub.freebsd.org> <46646F3C.6050902@umn.edu> <4665D901.1060206@umn.edu> Cc: Kip Macy , freebsd-performance@freebsd.org Subject: Re: Intel PRO/10GbE CX4? General 10Gb tips? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jun 2007 22:25:11 -0000 On 6/5/07, Alan Amesbury wrote: > Kip Macy wrote: > > > >> Sounds like the Intel hardware is the way to go, then. Performance is > > > > I'm not sure how you extrapolate that from the conversation to this > > point. The ix cards are not currently available so nothing is yet > > known about how they perform under FreeBSD and they may well come at a > > premium for being dual-ported. > > Er, probably from the conversation I was having in my head and failed to > get into writing. :-\ There are some other things which are important, > e.g., having the drivers in 6.2-RELEASE, which I don't think I mentioned. > > >> absolutely key (else why spend the money for 10Gb hardware, right?), so > >> a performance hit of more than 1-2% isn't going to be acceptable. I'd > >> be willing to consider vendors who provided native FreeBSD blobs but, > >> where possible and feasible, I tend to give preference to those who > >> release specs and driver source openly. > > > > I'm sure ix will be open. mxge(4) and cxgb(4) are open. > > Andrew Gallatin was most helpful in providing some additional > information off-list about the Myricom cards. We don't run 6-STABLE, so > the driver he backported to 6-STABLE hasn't shown up on our systems. I > rarely look at -CURRENT because--well, we don't use that in production. > To look at 6.2-RELEASE and earlier, Intel is the only 10Gb hardware > that works with FreeBSD. I'm glad to learn otherwise. :-) > > > I answered this question previously. The only 2 vendors with both good > > cards and good drivers for FreeBSD at this time are Myricom and > > Chelsio. Maybe we can poke Jack to post some numbers for ix(4) soon. > > You did, and thanks! I'm still looking for alternatives, but am already > focusing on Myricom and Chelsio products. For our purposes, the Myricom > hardware is looking more attractive than ixgb(4), as PCIe and support in > 6-STABLE are extremely compelling. > > Thanks again for the help! The ix or ixgbe driver (whichever it finally ends up being called) is currently running on CURRENT or is that stably running on CURRENT :), however I already have a customer requirement for STABLE so I plan to have a version for both. When I started on the driver only CURRENT had MSI/X so thats where I did development, but now we have it in STABLE as well, its only TSO that is lacking and that should soon be remedied as well. Jack