From owner-freebsd-infiniband@FreeBSD.ORG Mon Oct 7 06:51:33 2013 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9A7A3EC2 for ; Mon, 7 Oct 2013 06:51:33 +0000 (UTC) (envelope-from odeds@mellanox.com) Received: from eu1sys200aog117.obsmtp.com (eu1sys200aog117.obsmtp.com [207.126.144.143]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id BE390285A for ; Mon, 7 Oct 2013 06:51:32 +0000 (UTC) Received: from MTLCAS02.mtl.com ([193.47.165.155]) (using TLSv1) by eu1sys200aob117.postini.com ([207.126.147.11]) with SMTP ID DSNKUlJZ2K3h1wcf3Y2BkqQAdm5D898JYeTV@postini.com; Mon, 07 Oct 2013 06:51:32 UTC Received: from MTLDAG02.mtl.com ([10.0.8.76]) by MTLCAS02.mtl.com ([10.0.8.72]) with mapi id 14.03.0123.003; Mon, 7 Oct 2013 09:51:03 +0300 From: Oded Shanoon To: Jason Bacon , Anthony Cornehl Subject: RE: Supported NICs Thread-Topic: Supported NICs Thread-Index: AQHOslEQ1rGFr8lSzka7+8vcVkQcF5nHf7gAgAAFq4CAAKXOgIAgwecw Date: Mon, 7 Oct 2013 06:51:02 +0000 Message-ID: <058596FC127BDB469D7D60F04E37C63F7351B162@MTLDAG02.mtl.com> References: <52361685.8000901@tds.net> <52370835.7020901@tds.net> In-Reply-To: <52370835.7020901@tds.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.0.13.1] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "freebsd-infiniband@freebsd.org" X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Oct 2013 06:51:33 -0000 Hi Jason, IB support in 9.2 is supposed to be stable enough. Please note that Mellanox started supporting FreeBSD only recently. The dri= ver in 9.2 was ported by someone from Isilon (Jeff Roberson) from OFA-1.5.3= . Since we started our involvement we entered some fixes to that driver (that= were submitted into 9.2). We also mapped various issues which needs to be fixed in the future. We are now working on a major "face lift" to the driver - making it much mo= re stable and with improved performance and features. Regards, Oded Shanoon OFED-FreeBSD Team Leader Mellanox Technologies, Raanana -----Original Message----- From: owner-freebsd-infiniband@freebsd.org [mailto:owner-freebsd-infiniband= @freebsd.org] On Behalf Of Jason Bacon Sent: Monday, September 16, 2013 4:32 PM To: Anthony Cornehl Cc: freebsd-infiniband@freebsd.org Subject: Re: Supported NICs Thanks Anthony & Oded! Would you say that IB support in 9.2 is stable enough for a production HPC = file server? Will do plenty of my own testing first, of course. Regards, Jason On 09/15/13 22:38, Anthony Cornehl wrote: > > > On Sep 15, 2013 8:17 PM, "Anthony Cornehl" > wrote: > > > > > > On Sep 15, 2013 1:20 PM, "Jason bacon" > wrote: > > > > > > > > > Is there a list of supported IB NICs out there somewhere? > > > > > > I followed the wiki instructions for rebuilding with IB support > and now have mlx4ib, mlxen, etc. > > > > > > Was hoping there would be man pages for the drivers that list > known working cards, but there don't seem to be. I'm hoping to test a=20 > file server using IPOIB and possible roll a FreeNAS ISO with IB=20 > support if it works out. > > > > > > Thanks, > > > > > > -- > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > > > Jason W. Bacon > > > jwbacon@tds.net > > > > > > Circumstances don't make a man: > > > They reveal him. > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > > > > > > _______________________________________________ > > > freebsd-infiniband@freebsd.org > mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > > > To unsubscribe, send any mail to > "freebsd-infiniband-unsubscribe@freebsd.org > " > > > > Hey Jason, > > > > Mellanox ConnectX series cards are the only ones supported currently... > > > > http://www.mellanox.com/page/infiniband_cards_overview > > > > Don't forget to compile with IPoIB as well, since the IPoIB support > is compiled into the driver, unlike in Linux. > > > > Just be aware that IPoIB performance is also improved by enabling > connected mode when you compile the kernel module. The IB code in=20 > FreeBSD is a few years older the what is in Linux, but, the following=20 > forum thread is probably relevant... > > > >=20 > http://forums.servethehome.com/networking/1554-infiniband-ipoib-perfor > mance-problems.html > > > > Cheers! > > It also appears that Jeff fixed SDP a few weeks ago, which is more=20 > capable of reaching line-speed for IB-connected devices. > > http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-7.html > > Cheers! > -- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Jason W. Bacon jwbacon@tds.net Circumstances don't make a man: They reveal him. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ _______________________________________________ freebsd-infiniband@freebsd.org mailing list http://lists.freebsd.org/mailma= n/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g"