From owner-freebsd-performance@FreeBSD.ORG Wed Apr 16 07:43:24 2008 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8383D1065671 for ; Wed, 16 Apr 2008 07:43:24 +0000 (UTC) (envelope-from stefan.lambrev@moneybookers.com) Received: from blah.sun-fish.com (blah.sun-fish.com [217.18.249.150]) by mx1.freebsd.org (Postfix) with ESMTP id 3648F8FC1F for ; Wed, 16 Apr 2008 07:43:24 +0000 (UTC) (envelope-from stefan.lambrev@moneybookers.com) Received: by blah.sun-fish.com (Postfix, from userid 1002) id 794BA1B10F17; Wed, 16 Apr 2008 09:43:22 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on blah.cmotd.com X-Spam-Level: X-Spam-Status: No, score=-10.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, J_CHICKENPOX_21 autolearn=no version=3.2.3 Received: from hater.haters.org (hater.cmotd.com [192.168.3.125]) by blah.sun-fish.com (Postfix) with ESMTP id 30A021B10F00; Wed, 16 Apr 2008 09:43:10 +0200 (CEST) Message-ID: <4805AE0D.1050005@moneybookers.com> Date: Wed, 16 Apr 2008 10:43:09 +0300 From: Stefan Lambrev User-Agent: Thunderbird 2.0.0.12 (X11/20080326) MIME-Version: 1.0 To: "Benjeman J. Meekhof" References: <5873E91C-C096-4EE1-A5F5-4BCE110E2EE7@ish.com.au> <48054577.2050902@umich.edu> In-Reply-To: <48054577.2050902@umich.edu> Content-Type: text/plain; charset=windows-1251; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.91.2/6793/Wed Apr 16 05:57:30 2008 on blah.cmotd.com X-Virus-Status: Clean Cc: freebsd-performance@freebsd.org, Aristedes Maniatis Subject: Re: 10GbE speeds X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Apr 2008 07:43:24 -0000 Greetings, Benjeman J. Meekhof wrote: > Hi Aristedes, > > We are/were testing FreeBSD on a Dell PE2950 with a Myricom 10GB > PCI-Express copper CX card. The driver seems mature. In tests out of > the box, I only saw about 3Gbps from iperf (testing against a linux > system...and maybe there are other issues with our environment/that > system to tune up yet...i wouldn't take that number too seriously). If I remember correctly there is a problem with iperf, because it utilize too much CPU. I saw patches flying around, and part of them are in FreeBSD ports collection I think. Personally I prefer netperf for doing network tests :) > > I think some tuning could get it up to the maximum, anyways. It > certainly took a little work to get our Linux systems up to the max, > so I would say that in general the defaults with 10G drivers on any > system need some work to hit the maximum bandwidth. > > -Ben > > Aristedes Maniatis wrote: >> I have a project with 3 workstations all needing high speed access to >> about 6Tb of storage. In the past I've installed technology such as >> fibre channel connected SAN storage (using Apple's xsan) for up to a >> dozen workstations, but with only three workstations for this project >> I'm thinking about 10GbE. The workstations will be OSX and the server >> FreeBSD 7 with a bunch of disks in a RAID 5 or RAID 10 configuration. >> >> Are 10GbE NICs and drivers significantly mature enough under FreeBSD >> to accomplish this? I'd need to achieve about 60MB/s transfer rate >> which is theoretically quite doable, as long as the drive array can >> keep up with three streams of that speed. I'd use netatalk, samba or >> nfs to share files depending on which I can eek the best speeds out of. >> >> Alternatively I could populate the server with 1GbE NICs, one per >> workstation and use cross over cable. That way there is absolutely no >> contention on the network. >> >> Any thoughts about the viability of this? Is 10GbE in production use >> with FreeBSD and does it scale well? >> >> >> Cheers >> Ari Maniatis >> >> >> >> >> --------------------------> >> ish >> http://www.ish.com.au >> Level 1, 30 Wilson Street Newtown 2042 Australia >> phone +61 2 9550 5001 fax +61 2 9550 4001 >> GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A >> >> >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" >> >> > -- Best Wishes, Stefan Lambrev ICQ# 24134177