From owner-freebsd-performance@FreeBSD.ORG Wed Apr 16 00:17:11 2008 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 572FB106566B for ; Wed, 16 Apr 2008 00:17:11 +0000 (UTC) (envelope-from bmeekhof@umich.edu) Received: from hellskitchen.mr.itd.umich.edu (smtp.mail.umich.edu [141.211.14.82]) by mx1.freebsd.org (Postfix) with ESMTP id 0E5758FC1E for ; Wed, 16 Apr 2008 00:17:10 +0000 (UTC) (envelope-from bmeekhof@umich.edu) Received: FROM atom.heart.mother (c-68-40-199-244.hsd1.mi.comcast.net [68.40.199.244]) BY hellskitchen.mr.itd.umich.edu ID 48054577.B7BE5.3598 ; 15 Apr 2008 20:16:56 -0400 Message-ID: <48054577.2050902@umich.edu> Date: Tue, 15 Apr 2008 20:16:55 -0400 From: "Benjeman J. Meekhof" User-Agent: Thunderbird 2.0.0.9 (X11/20071031) MIME-Version: 1.0 To: Aristedes Maniatis References: <5873E91C-C096-4EE1-A5F5-4BCE110E2EE7@ish.com.au> In-Reply-To: <5873E91C-C096-4EE1-A5F5-4BCE110E2EE7@ish.com.au> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: 10GbE speeds X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Apr 2008 00:17:11 -0000 Hi Aristedes, We are/were testing FreeBSD on a Dell PE2950 with a Myricom 10GB PCI-Express copper CX card. The driver seems mature. In tests out of the box, I only saw about 3Gbps from iperf (testing against a linux system...and maybe there are other issues with our environment/that system to tune up yet...i wouldn't take that number too seriously). I think some tuning could get it up to the maximum, anyways. It certainly took a little work to get our Linux systems up to the max, so I would say that in general the defaults with 10G drivers on any system need some work to hit the maximum bandwidth. -Ben Aristedes Maniatis wrote: > I have a project with 3 workstations all needing high speed access to > about 6Tb of storage. In the past I've installed technology such as > fibre channel connected SAN storage (using Apple's xsan) for up to a > dozen workstations, but with only three workstations for this project > I'm thinking about 10GbE. The workstations will be OSX and the server > FreeBSD 7 with a bunch of disks in a RAID 5 or RAID 10 configuration. > > Are 10GbE NICs and drivers significantly mature enough under FreeBSD to > accomplish this? I'd need to achieve about 60MB/s transfer rate which is > theoretically quite doable, as long as the drive array can keep up with > three streams of that speed. I'd use netatalk, samba or nfs to share > files depending on which I can eek the best speeds out of. > > Alternatively I could populate the server with 1GbE NICs, one per > workstation and use cross over cable. That way there is absolutely no > contention on the network. > > Any thoughts about the viability of this? Is 10GbE in production use > with FreeBSD and does it scale well? > > > Cheers > Ari Maniatis > > > > > --------------------------> > ish > http://www.ish.com.au > Level 1, 30 Wilson Street Newtown 2042 Australia > phone +61 2 9550 5001 fax +61 2 9550 4001 > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A > > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" > > -- Benjeman Meekhof - UM ATLAS/AGLT2 Computing office: 734-764-3450 cell: 734-417-6312