From owner-freebsd-infiniband@freebsd.org Thu May 26 18:33:03 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3870B4BDDB for ; Thu, 26 May 2016 18:33:03 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from msa1.earth.yoonka.com (yoonka.com [185.24.122.233]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "msa1.earth.yoonka.com", Issuer "msa1.earth.yoonka.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 73B5E1436 for ; Thu, 26 May 2016 18:33:02 +0000 (UTC) (envelope-from list1@gjunka.com) Received: from crayon2.yoonka.com (crayon2.yoonka.com [192.168.1.20]) (authenticated bits=0) by msa1.earth.yoonka.com (8.15.2/8.15.2) with ESMTPSA id u4QIX0dD062781 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Thu, 26 May 2016 18:33:00 GMT (envelope-from list1@gjunka.com) Subject: Re: InfiniBand supported hw References: <9f3323d3-fc01-c1e7-8a93-3132a61c9235@gjunka.com> <05BB7487-B000-4800-88BD-EC7DEC508160@jnielsen.net> To: freebsd-infiniband@freebsd.org From: Grzegorz Junka Message-ID: <1063e37f-8a71-0804-b96c-13ef90dcdcb0@gjunka.com> Date: Thu, 26 May 2016 18:33:00 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.1.0 MIME-Version: 1.0 In-Reply-To: <05BB7487-B000-4800-88BD-EC7DEC508160@jnielsen.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 18:33:04 -0000 On 26/05/2016 17:44, John Nielsen wrote: > On May 26, 2016, at 11:07 AM, Justin Clift wrote: > >> On 26 May 2016, at 14:00, Grzegorz Junka wrote: >>> Is 500EX-D supported on FreeBSD? I read that it's a Voltaire version and it is the same as Mellanox ConnectX, which supposed to be supported. >> Yep, they should work. You may need to flash them with their Mellanox equivalent >> firmware, but I'm not sure. (doing that flash isn't very hard btw) >> >>> Also, most InfiniBand cards provide two ports. When connecting two computers together (IPoIB) is it possible to use both ports to double the speed? >> Not sure, as I've not needed to personally. None of my storage (or other uses) >> even fills one DDR port. Yet. :) >> >> I *think* the answer to that is yes, > It depends on what you mean by "use both ports." You can of course use both ports at the same time, but if you're envisioning something like an IPoIB version of an Ethernet LAGG I don't think that is supported. > > If you are using the IB for storage protocols, then active/active multipathing is one way to utilize the full bandwidth of multiple ports. > >>> Lastly, is NFS RDMA properly supported on FreeBSD? >> Again not sure. Other people here would likely know. :) > Yes, that's exactly what I was hoping for, a sort of LAGG to double the speed of the link between computer by utilizing both ports together. LAGG is independent from the network interface, if I could set up an IPoIB NIC for each port separately what could prevent me from creating a LAGG interface on top of them? And if that's not supported, what do people usually do with the other interface? Just leave it unconnected? Grzegorz