From owner-freebsd-infiniband@FreeBSD.ORG Mon Sep 16 13:31:43 2013 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 6CD6A681 for ; Mon, 16 Sep 2013 13:31:43 +0000 (UTC) (envelope-from jwbacon@tds.net) Received: from mail-vb0-f51.google.com (mail-vb0-f51.google.com [209.85.212.51]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 290A22D92 for ; Mon, 16 Sep 2013 13:31:41 +0000 (UTC) Received: by mail-vb0-f51.google.com with SMTP id x16so2777360vbf.38 for ; Mon, 16 Sep 2013 06:31:35 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=uKIgA2cjPM0XYPrUCKpR0We46xGrz1r6vsjDKiJ+tLY=; b=Y50SEonD2J8bmjhuwk4DJ59sRKoFTCSW92ShvF/6aYrc3gwXNBa5dAITGIGtgPO3o3 bYEiN6gTgalsYqbYD6jfycLuBp98Y4afhBV+EQO2/2/6aFp0+3nUVPC+6OzWAgsbBph3 gA+GXCzyZhh3tWXDRTa4+kavtkCvDonFfELTqyI0rMhIJzqfisl+MdwIGorU5a/Pz+HH KZDa6MCOeORXnGVr+/Ww3dab0rz9jFcyow9pDhuNN5Th89UoWZLSPZevHAQz8T15ZmO0 TuIduPbl94skx9D8bFLeyrQOtchtrCXZg5L0ppW7IxBEPxCJLPd37+jyUT3J04AwVzlt OFdg== X-Gm-Message-State: ALoCoQlAlo57bwfoU96hFo7ttt4hHx3gNAlk0d2hbfzOF6VS6nix3mTmZL80ZTRvEk8BYMBbBW+n X-Received: by 10.52.122.68 with SMTP id lq4mr22851359vdb.21.1379338295577; Mon, 16 Sep 2013 06:31:35 -0700 (PDT) Received: from sculpin.jbacon.dyndns.org (h69-131-100-239.nwblwi.broadband.dynamic.tds.net. [69.131.100.239]) by mx.google.com with ESMTPSA id bl10sm18883144vec.8.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 16 Sep 2013 06:31:35 -0700 (PDT) Message-ID: <52370835.7020901@tds.net> Date: Mon, 16 Sep 2013 08:31:33 -0500 From: Jason Bacon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120327 Thunderbird/10.0.3 MIME-Version: 1.0 To: Anthony Cornehl Subject: Re: Supported NICs References: <52361685.8000901@tds.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-infiniband@freebsd.org X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Sep 2013 13:31:43 -0000 Thanks Anthony & Oded! Would you say that IB support in 9.2 is stable enough for a production HPC file server? Will do plenty of my own testing first, of course. Regards, Jason On 09/15/13 22:38, Anthony Cornehl wrote: > > > On Sep 15, 2013 8:17 PM, "Anthony Cornehl" > wrote: > > > > > > On Sep 15, 2013 1:20 PM, "Jason bacon" > wrote: > > > > > > > > > Is there a list of supported IB NICs out there somewhere? > > > > > > I followed the wiki instructions for rebuilding with IB support > and now have mlx4ib, mlxen, etc. > > > > > > Was hoping there would be man pages for the drivers that list > known working cards, but there don't seem to be. I'm hoping to test a > file server using IPOIB and possible roll a FreeNAS ISO with IB > support if it works out. > > > > > > Thanks, > > > > > > -- > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > > > Jason W. Bacon > > > jwbacon@tds.net > > > > > > Circumstances don't make a man: > > > They reveal him. > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > > > > > > _______________________________________________ > > > freebsd-infiniband@freebsd.org > mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > > > To unsubscribe, send any mail to > "freebsd-infiniband-unsubscribe@freebsd.org > " > > > > Hey Jason, > > > > Mellanox ConnectX series cards are the only ones supported currently... > > > > http://www.mellanox.com/page/infiniband_cards_overview > > > > Don't forget to compile with IPoIB as well, since the IPoIB support > is compiled into the driver, unlike in Linux. > > > > Just be aware that IPoIB performance is also improved by enabling > connected mode when you compile the kernel module. The IB code in > FreeBSD is a few years older the what is in Linux, but, the following > forum thread is probably relevant... > > > > > http://forums.servethehome.com/networking/1554-infiniband-ipoib-performance-problems.html > > > > Cheers! > > It also appears that Jeff fixed SDP a few weeks ago, which is more > capable of reaching line-speed for IB-connected devices. > > http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-7.html > > Cheers! > -- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Jason W. Bacon jwbacon@tds.net Circumstances don't make a man: They reveal him. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~