From owner-freebsd-infiniband@freebsd.org Thu May 26 19:00:59 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71565B4B55B for ; Thu, 26 May 2016 19:00:59 +0000 (UTC) (envelope-from chrisr@spectralogic.com) Received: from mail1.bemta12.messagelabs.com (mail1.bemta12.messagelabs.com [216.82.251.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail1.bemta12.messagelabs.com", Issuer "Symantec Class 3 Secure Server CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 319651B94 for ; Thu, 26 May 2016 19:00:58 +0000 (UTC) (envelope-from chrisr@spectralogic.com) Received: from [216.82.251.33] by server-1.bemta-12.messagelabs.com id 84/E7-21085-D6647475; Thu, 26 May 2016 18:54:37 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrOIsWRWlGSWpSXmKPExsVyQG6fiG6um3u 4wZkeeYu/xyayWryf/ITJgcljxqf5LB6brtcFMEWxZuYl5VcksGZ8ObKRqWC/WMXMu9NYGxhv C3UxcnKwCehIdKw7zQxiiwhkSlzof8QKYgsLqEhsu/oKKq4qsevaJTYI201i6+JJLCA2C1B8y g+IXl4BI4mbO18Axbk4hARuM0rc2f6ECSTBKWAnMaO3E6yBUUBM4vupNWBxZgFxiVtP5oPZEg ICEkv2nGeGsEUlXj7+xwphG0hsXbqPBaJeT+LG1ClsELa2xLKFr6EWC0qcnPmEZQKj4CwkY2c haZmFpGUWkpYFjCyrGDWKU4vKUot0jcz1kooy0zNKchMzc3QNDY30clOLixPTU3MSk4r1kvNz NzECA7yegYFxB+OmRq9DjJIcTEqivLEG7uFCfEn5KZUZicUZ8UWlOanFhxhlODiUJHjTXYFyg kWp6akVaZk5wFiDSUtw8CiJ8BaApHmLCxJzizPTIVKnGBWlxHkFQBICIImM0jy4Nlh8X2KUlR LmZWRgYBDiKUgtys0sQZV/xSjOwagkzBsJMoUnM68EbvoroMVMQIv9vziDLC5JREhJNTB6r+3 iU7k9QTtO7XZpRfO0fR1WvgyBl5VEVZ7NsZzs3cwd3/H/WcHz7NTVx37V2W+f/Wq7EvPC5D+P Xq1Ivbl8k6cuy4K8j/9O7/ux3njhQY3fOxpfflS6Md88OEtR0X7/jLQ1WRKG58V2i0zSaau3z 9Hkvv5y2o/jVwqyb9Yr+z9xnLanjK1NiaU4I9FQi7moOBEAiWsMDOoCAAA= X-Env-Sender: chrisr@spectralogic.com X-Msg-Ref: server-4.tower-130.messagelabs.com!1464288877!34351730!1 X-Originating-IP: [192.30.190.20] X-StarScan-Received: X-StarScan-Version: 8.34; banners=-,-,- X-VirusChecked: Checked Received: (qmail 118394 invoked from network); 26 May 2016 18:54:37 -0000 Received: from outmx2.spectralogic.com (HELO mail.spectralogic.com) (192.30.190.20) by server-4.tower-130.messagelabs.com with AES256-GCM-SHA384 encrypted SMTP; 26 May 2016 18:54:37 -0000 From: Chris Reeves To: Grzegorz Junka , "freebsd-infiniband@freebsd.org" Subject: Re: InfiniBand supported hw Thread-Topic: InfiniBand supported hw Thread-Index: AQHRt06WrtyxxhHDmkO+I7/v2i4P3J/L2AGAgAAKfACAAA2KAP//oEig Date: Thu, 26 May 2016 18:54:36 +0000 Message-ID: <1464288876261.66558@spectralogic.com> References: <9f3323d3-fc01-c1e7-8a93-3132a61c9235@gjunka.com> <05BB7487-B000-4800-88BD-EC7DEC508160@jnielsen.net>, <1063e37f-8a71-0804-b96c-13ef90dcdcb0@gjunka.com> In-Reply-To: <1063e37f-8a71-0804-b96c-13ef90dcdcb0@gjunka.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 19:00:59 -0000 I've tried to LAGG two IPOIB ports in the past on FreeBSD, but was not succ= essful.=0A= I'm not certain, but I believe the following from sys/net/if_lagg.c is the = issue:=0A= =0A= /* XXX Disallow non-ethernet interfaces (this should be any of 802)= */=0A= if (ifp->if_type !=3D IFT_ETHER) {=0A= LAGG_WUNLOCK(sc);=0A= return (EPROTONOSUPPORT);=0A= }=0A= =0A= I think IPOIB is not considered an Ethernet port.=0A= ________________________________________=0A= From: owner-freebsd-infiniband@freebsd.org on behalf of Grzegorz Junka =0A= Sent: Thursday, May 26, 2016 12:33 PM=0A= To: freebsd-infiniband@freebsd.org=0A= Subject: Re: InfiniBand supported hw=0A= =0A= On 26/05/2016 17:44, John Nielsen wrote:=0A= > On May 26, 2016, at 11:07 AM, Justin Clift wrote:= =0A= >=0A= >> On 26 May 2016, at 14:00, Grzegorz Junka wrote:=0A= >>> Is 500EX-D supported on FreeBSD? I read that it's a Voltaire version an= d it is the same as Mellanox ConnectX, which supposed to be supported.=0A= >> Yep, they should work. You may need to flash them with their Mellanox e= quivalent=0A= >> firmware, but I'm not sure. (doing that flash isn't very hard btw)=0A= >>=0A= >>> Also, most InfiniBand cards provide two ports. When connecting two comp= uters together (IPoIB) is it possible to use both ports to double the speed= ?=0A= >> Not sure, as I've not needed to personally. None of my storage (or othe= r uses)=0A= >> even fills one DDR port. Yet. :)=0A= >>=0A= >> I *think* the answer to that is yes,=0A= > It depends on what you mean by "use both ports." You can of course use bo= th ports at the same time, but if you're envisioning something like an IPoI= B version of an Ethernet LAGG I don't think that is supported.=0A= >=0A= > If you are using the IB for storage protocols, then active/active multipa= thing is one way to utilize the full bandwidth of multiple ports.=0A= >=0A= >>> Lastly, is NFS RDMA properly supported on FreeBSD?=0A= >> Again not sure. Other people here would likely know. :)=0A= >=0A= =0A= Yes, that's exactly what I was hoping for, a sort of LAGG to double the=0A= speed of the link between computer by utilizing both ports together.=0A= LAGG is independent from the network interface, if I could set up an=0A= IPoIB NIC for each port separately what could prevent me from creating a=0A= LAGG interface on top of them? And if that's not supported, what do=0A= people usually do with the other interface? Just leave it unconnected?=0A= =0A= Grzegorz=0A= _______________________________________________=0A= freebsd-infiniband@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband=0A= To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g"=0A=