From owner-freebsd-hardware@FreeBSD.ORG Tue Jul 3 20:17:47 2007 Return-Path: X-Original-To: freebsd-hardware@freebsd.org Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D2C7916A421; Tue, 3 Jul 2007 20:17:47 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.208.78.105]) by mx1.freebsd.org (Postfix) with ESMTP id B64F413C45E; Tue, 3 Jul 2007 20:17:47 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.1/8.13.8) with ESMTP id l63KHKUP063372; Tue, 3 Jul 2007 13:17:20 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.1/8.13.8/Submit) id l63KHKDm063371; Tue, 3 Jul 2007 13:17:20 -0700 (PDT) (envelope-from sgk) Date: Tue, 3 Jul 2007 13:17:20 -0700 From: Steve Kargl To: Brooks Davis Message-ID: <20070703201720.GA60758@troutmask.apl.washington.edu> References: <20070703194815.GA52733@troutmask.apl.washington.edu> <20070703200428.GC18904@lor.one-eyed-alien.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070703200428.GC18904@lor.one-eyed-alien.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-hardware@freebsd.org Subject: Re: Infiniband or myrinet options? X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 20:17:47 -0000 On Tue, Jul 03, 2007 at 03:04:28PM -0500, Brooks Davis wrote: > On Tue, Jul 03, 2007 at 12:48:15PM -0700, Steve Kargl wrote: > > Anyone have a pointer to wither infiniband or myrinet > > networking solutions for FreeBSD? Google hasn't been > > too helpful with an infiniband search. > > Given the current state of drivers, Myrinet is probably your practical > choice. We have drivers in the tree for Myrinet nices in 10GbE mode and > Myricom has FreeBSD drivers for Myrinet mode. There exist Infiniband > stacks for FreeBSD, but I don't know of any that are generally > available. > Thanks Brooks, I forgot to mention that my motherboards are Tyan s2881, which only have PCI-X slots. The mxge driver is for a PCI-E nic. Myricom's M3F-PCIXF-2 NIC is a myrinet card that is compatiable with my motherboards, but the available software is against FreeBSD 5.x. At the moment, my cluster uses the builtin broadcom chips (bge0) and ia SMC 8624T GigE switch. I found a post by you that was not too complementary to this switch. One of our MPI apps is communications bound, so I was hoping to upgrade the network. -- Steve