Date: Thu, 26 May 2016 18:54:36 +0000 From: Chris Reeves <chrisr@spectralogic.com> To: Grzegorz Junka <list1@gjunka.com>, "freebsd-infiniband@freebsd.org" <freebsd-infiniband@freebsd.org> Subject: Re: InfiniBand supported hw Message-ID: <1464288876261.66558@spectralogic.com> In-Reply-To: <1063e37f-8a71-0804-b96c-13ef90dcdcb0@gjunka.com> References: <9f3323d3-fc01-c1e7-8a93-3132a61c9235@gjunka.com> <A69E3E1D-002C-47CA-A898-0ABF67F64D5B@postgresql.org> <05BB7487-B000-4800-88BD-EC7DEC508160@jnielsen.net>, <1063e37f-8a71-0804-b96c-13ef90dcdcb0@gjunka.com>
next in thread | previous in thread | raw e-mail | index | archive | help
I've tried to LAGG two IPOIB ports in the past on FreeBSD, but was not succ=
essful.=0A=
I'm not certain, but I believe the following from sys/net/if_lagg.c is the =
issue:=0A=
=0A=
/* XXX Disallow non-ethernet interfaces (this should be any of 802)=
*/=0A=
if (ifp->if_type !=3D IFT_ETHER) {=0A=
LAGG_WUNLOCK(sc);=0A=
return (EPROTONOSUPPORT);=0A=
}=0A=
=0A=
I think IPOIB is not considered an Ethernet port.=0A=
________________________________________=0A=
From: owner-freebsd-infiniband@freebsd.org <owner-freebsd-infiniband@freebs=
d.org> on behalf of Grzegorz Junka <list1@gjunka.com>=0A=
Sent: Thursday, May 26, 2016 12:33 PM=0A=
To: freebsd-infiniband@freebsd.org=0A=
Subject: Re: InfiniBand supported hw=0A=
=0A=
On 26/05/2016 17:44, John Nielsen wrote:=0A=
> On May 26, 2016, at 11:07 AM, Justin Clift <justin@postgresql.org> wrote:=
=0A=
>=0A=
>> On 26 May 2016, at 14:00, Grzegorz Junka <list1@gjunka.com> wrote:=0A=
>>> Is 500EX-D supported on FreeBSD? I read that it's a Voltaire version an=
d it is the same as Mellanox ConnectX, which supposed to be supported.=0A=
>> Yep, they should work. You may need to flash them with their Mellanox e=
quivalent=0A=
>> firmware, but I'm not sure. (doing that flash isn't very hard btw)=0A=
>>=0A=
>>> Also, most InfiniBand cards provide two ports. When connecting two comp=
uters together (IPoIB) is it possible to use both ports to double the speed=
?=0A=
>> Not sure, as I've not needed to personally. None of my storage (or othe=
r uses)=0A=
>> even fills one DDR port. Yet. :)=0A=
>>=0A=
>> I *think* the answer to that is yes,=0A=
> It depends on what you mean by "use both ports." You can of course use bo=
th ports at the same time, but if you're envisioning something like an IPoI=
B version of an Ethernet LAGG I don't think that is supported.=0A=
>=0A=
> If you are using the IB for storage protocols, then active/active multipa=
thing is one way to utilize the full bandwidth of multiple ports.=0A=
>=0A=
>>> Lastly, is NFS RDMA properly supported on FreeBSD?=0A=
>> Again not sure. Other people here would likely know. :)=0A=
>=0A=
=0A=
Yes, that's exactly what I was hoping for, a sort of LAGG to double the=0A=
speed of the link between computer by utilizing both ports together.=0A=
LAGG is independent from the network interface, if I could set up an=0A=
IPoIB NIC for each port separately what could prevent me from creating a=0A=
LAGG interface on top of them? And if that's not supported, what do=0A=
people usually do with the other interface? Just leave it unconnected?=0A=
=0A=
Grzegorz=0A=
_______________________________________________=0A=
freebsd-infiniband@freebsd.org mailing list=0A=
https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband=0A=
To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or=
g"=0A=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1464288876261.66558>