From owner-freebsd-infiniband@freebsd.org Sun Apr 17 06:41:13 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41711B10618 for ; Sun, 17 Apr 2016 06:41:13 +0000 (UTC) (envelope-from menyy@mellanox.com) Received: from emea01-db3-obe.outbound.protection.outlook.com (mail-db3on0096.outbound.protection.outlook.com [157.55.234.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B59921386 for ; Sun, 17 Apr 2016 06:41:11 +0000 (UTC) (envelope-from menyy@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=bm6KAIDtLsFU3f1r2uZEBdHkCEB7JnA5IbrAysgMQAc=; b=N5c8o44NFvqBlwuPYt74HhaZJcQMzFLjR6+1x8X8XMyP4+CFT8yCuFge7vX17UXomTPpa68aeK4vz0M2nvZXniDArWIyBBCnuV6aQtjOSkcEt/7ZOoBWJlQwm9UutbmU46R7PYFPHVMg0GlbmMOuPeA9J6qEYI4KBD4cr3jx46A= Received: from DB5PR05MB1765.eurprd05.prod.outlook.com (10.165.7.23) by DB5PR05MB1382.eurprd05.prod.outlook.com (10.162.157.28) with Microsoft SMTP Server (TLS) id 15.1.466.19; Sun, 17 Apr 2016 05:08:26 +0000 Received: from DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) by DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) with mapi id 15.01.0453.031; Sun, 17 Apr 2016 05:08:26 +0000 From: Meny Yossefi To: "freebsd-infiniband@freebsd.org" CC: Yuval Bason , Mark Bloch Subject: RE: How to force IB cards to come up in IB mode? Thread-Topic: How to force IB cards to come up in IB mode? Thread-Index: AQHRl9FGkcYw8QOXCky3Yxke7zEzY5+McuvlgAA2bcCAAIcXgIAAABeXgABtecA= Date: Sun, 17 Apr 2016 05:08:25 +0000 Message-ID: References: <9C08621D-AAE9-42D0-8079-716CDD9BC5E0@postgresql.org> <223ee8f3dd5240779d39bf78c383c50c@AMSPR05MB0580.eurprd05.prod.outlook.com> , <0DE8164F-FB16-40E0-A512-F233658C52A0@postgresql.org> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=mellanox.com; x-originating-ip: [193.47.165.251] x-ms-office365-filtering-correlation-id: 4d6c8a78-8349-41f0-f414-08d3667e4eae x-microsoft-exchange-diagnostics: 1; DB5PR05MB1382; 5:oFkSe0FzfeIMhqPQ/Wd8c9rrRmj2G5Ilxwzm50A5DdAlY+rwC2ugujaQwxoMZDKIkbogz5yaj8MrcmRIK4tU5pzPJw6e0zd8Xq2Kto7ZvLkDDWFVhY6df27Fy/58wtve+U+7JjKXRPJpc9rlwgcJGKh45ZYpVHXECiWhDKfQcKhO3Y3/M1Vacma/0kXSSYUL; 24:DzXq47JCcSJqN0msR7T2bckzIEfrI6wYeYnlSH7lYPawnbeU4yn6doBsOqOIeLoAJdYUBms+S1P8eYUb6BGo0qcIy/XauBqAv5A7miRORmc=; 7:mmwS/ARnwd2H8+Dy6QuwQHPMyzScnu8NapKzQQ8ZtNlme4Y4/OsOOL8qinrPbblgnZdgdN7lOmWtHdT/YrCJ2WMv1S+LAH3IK3VDn198KjSNrqCsfq823lqTU/oiYaBDRNzz7JfTyqd0Q/x2DxH3/eoTfqr3doA1a8Oe0udt1vbkE5b4BqI9/9EUa1KzC28uS4yt3YNldvHhLlNu3YX6sA== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DB5PR05MB1382; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(9101521026)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046); SRVR:DB5PR05MB1382; BCL:0; PCL:0; RULEID:; SRVR:DB5PR05MB1382; x-forefront-prvs: 0915875B28 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(377454003)(13464003)(24454002)(2351001)(10400500002)(9686002)(33656002)(189998001)(5640700001)(66066001)(92566002)(11100500001)(110136002)(77096005)(107886002)(93886004)(87936001)(5002640100001)(5003600100002)(106116001)(86362001)(2906002)(122556002)(4326007)(2950100001)(81166005)(54356999)(15975445007)(2900100001)(1220700001)(5004730100002)(1096002)(74316001)(5008740100001)(6116002)(3660700001)(586003)(3846002)(3280700002)(19580395003)(102836003)(450100001)(4001430100002)(2501003)(19580405001)(76176999)(76576001)(50986999); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR05MB1382; H:DB5PR05MB1765.eurprd05.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en; Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Apr 2016 05:08:26.0122 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR05MB1382 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Apr 2016 06:41:13 -0000 NP.=20 If you have more Mellanox related questions, you can also use: freebsd-driv= ers@mellanox.com -Meny -----Original Message----- From: freebsd-commits-tracker=20 Sent: Sunday, April 17, 2016 1:34 AM To: Mark Bloch ; Meny Yossefi ; Yuv= al Bason Subject: FW: How to force IB cards to come up in IB mode? ________________________________________ From: owner-freebsd-infiniband@freebsd.orgOn Behalf OfJustin Clift Sent: Saturday, April 16, 2016 10:33:45 PM (UTC) Monrovia, Reykjavik To: Meny Yossefi Cc: freebsd-infiniband@freebsd.org; Yuval Bason; Hans Petter Selasky Subject: Re: How to force IB cards to come up in IB mode? On 16 Apr 2016, at 15:55, Meny Yossefi wrote: > Hi Justin, > > It seems as the pre-boot configuration didn't work. > > loader.conf doesn't work on all sysctl params AFAIK. The solution in this case turned out to be super simple... I was just using= the wrong file. :D It should have been /etc/sysctl.conf for the settings. Adding this in ther= e worked for the initial port mode setup: # Ensure the IB card is in IB mode sys.device.mlx4_core0.mlx4_port1=3D"ib" sys.device.mlx4_core0.mlx4_port2=3D"ib" Apologies for the noise. ;) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who = work and those who take the credit. He told me to try to be in the first gr= oup; there was less competition there." - Indira Gandhi _______________________________________________ freebsd-infiniband@freebsd.org mailing list https://lists.freebsd.org/mailm= an/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g" From owner-freebsd-infiniband@freebsd.org Sun Apr 17 18:06:54 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D99ACB1141E for ; Sun, 17 Apr 2016 18:06:54 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A0A6F1726 for ; Sun, 17 Apr 2016 18:06:54 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1arr5s-0006ND-4v for freebsd-infiniband@freebsd.org; Sun, 17 Apr 2016 18:06:50 +0000 From: Justin Clift Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: OPENSM tokens not being replaced? Message-Id: <98940F59-F9C5-4216-BD90-49ED66D9B40B@postgresql.org> Date: Sun, 17 Apr 2016 19:06:46 +0100 To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Apr 2016 18:06:54 -0000 Hi all, Noticed something a bit strange after buildworld/installworld on = stable/10. With WITH_OFED=3D'yes' in src.conf, the installed man page for opensm = has this as its' FILES section: *************** FILES @OPENSM_CONFIG_DIR@/@OPENSM_CONFIG_FILE@ default OpenSM config file. @OPENSM_CONFIG_DIR@/@NODENAMEMAPFILE@ default node name map file. See ibnetdiscover for more = informa- tion on format. @OPENSM_CONFIG_DIR@/@PARTITION_CONFIG_FILE@ default partition config file @OPENSM_CONFIG_DIR@/@QOS_POLICY_FILE@ default QOS policy config file @OPENSM_CONFIG_DIR@/@PREFIX_ROUTES_FILE@ default prefix routes file. *************** It looks like tokens aren't being replaced in the build process for some reason. My initial thought was it's a missing autoconf, but installing that = first hasn't made a difference. Does anyone have ideas on what the cause might be? Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Mon Apr 18 03:35:46 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B8ADB11D99 for ; Mon, 18 Apr 2016 03:35:46 +0000 (UTC) (envelope-from daichi@ongs.co.jp) Received: from pivot.bsdconsulting.co.jp (183.177.135.10.ap.gmobb-fix.jp [183.177.135.10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2692C1464 for ; Mon, 18 Apr 2016 03:35:45 +0000 (UTC) (envelope-from daichi@ongs.co.jp) Received: from [192.168.1.39] (dullmdaler.ongs.co.jp [202.216.246.94]) by pivot.bsdconsulting.co.jp (Postfix) with ESMTPSA id B343B3C01C5; Mon, 18 Apr 2016 12:35:04 +0900 (JST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Mellanox MCB193A-FCAT From: Daichi GOTO In-Reply-To: Date: Mon, 18 Apr 2016 12:35:35 +0900 Cc: Mark Bloch , Yuval Bason , "freebsd-infiniband@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <2AECE0F0-00F6-4A72-98A2-5B75679C8338@ongs.co.jp> References: <49951A96-E904-4F7C-864C-F0CD953813A2@ongs.co.jp> <111b47284ead41c3a30ea7c1ebc7f2ed@AMSPR05MB0580.eurprd05.prod.outlook.com> To: Meny Yossefi X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 03:35:46 -0000 Thank you, Meny. > 2016/04/17 0:10=E3=80=81Meny Yossefi = =E3=81=AE=E3=83=A1=E3=83=BC=E3=83=AB=EF=BC=9A >=20 > Hi Daichi, >=20 >=20 >=20 > Your IB NIC (Connect-IB) requires our mlx5 driver. >=20 > Our upstream solution which also exists in 10.3 is Eth only. If I use the Mellanox MCB193A-FCAT with FreeBSD 10.3, is the top speed of the card 10Gb/s? > We are currently working on the IB side. >=20 > Please refer to the "OFED v3.2 update" mailing list item. >=20 >=20 >=20 > For any other questions, feel free to use the Mellanox support mail. >=20 >=20 >=20 > support@mellanox.com >=20 > or >=20 > freebsd-drivers@mellanox.com >=20 >=20 >=20 >=20 >=20 > Best regards, > Meny Yossefi | SW Manager | FreeBSD Team > Mellanox Technologies Ltd > Work: +972-74-7129121, Cell: +972-52-8379557 >=20 >=20 >=20 > -----Original Message----- > From: freebsd-commits-tracker > Sent: Saturday, April 16, 2016 11:40 AM > To: Mark Bloch ; Meny Yossefi = ; Yuval Bason > Subject: FW: Mellanox MCB193A-FCAT >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > ________________________________________ >=20 > From: = owner-freebsd-infiniband@freebsd.orgOn Behalf OfDaichi GOTO >=20 > Sent: Saturday, April 16, 2016 8:39:34 AM (UTC) Monrovia, Reykjavik >=20 > To: = freebsd-infiniband@freebsd.org >=20 > Subject: Mellanox MCB193A-FCAT >=20 >=20 >=20 > Hi infiniband folks, this is daichi. >=20 >=20 >=20 > I am considering to buy some Infiniband cards. A reseller of IB asked = me I can buy some Mellanox MCB193A-FCAT cards for now. >=20 >=20 >=20 > Mellanox MCB193A-FCAT >=20 > = http://www.mellanoxstore.com/products/mellanox-mcb193a-fcat-connect-ib-tm-= host-channel-adapter-single-port-qsfp-fdr-56gb-s-pcie3-0-x16-tall-bracket-= rohs-r6.html >=20 >=20 >=20 > Can I use this card with FreeBSD 10.3-RELEASE? Or do I need to use = HEAD with OFED v3.2 patches? Please help me. Thank you. >=20 >=20 >=20 > -- >=20 > Daichi GOTO >=20 > CEO | ONGS Inc. >=20 > 81-42-316-7945 | daichi@ongs.co.jp | = http://www.ongs.co.jp >=20 > LinkedIn: http://linkedin.com/in/daichigoto >=20 >=20 >=20 > _______________________________________________ >=20 > freebsd-infiniband@freebsd.org = mailing list = https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >=20 > To unsubscribe, send any mail to = "freebsd-infiniband-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to = "freebsd-infiniband-unsubscribe@freebsd.org" -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto From owner-freebsd-infiniband@freebsd.org Mon Apr 18 05:27:46 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E630CB1256C for ; Mon, 18 Apr 2016 05:27:46 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ADF011736 for ; Mon, 18 Apr 2016 05:27:46 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1as1in-0006Ru-0e for freebsd-infiniband@freebsd.org; Mon, 18 Apr 2016 05:27:43 +0000 From: Justin Clift Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Would like to expand out the FreeBSD Infiniband page Message-Id: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> Date: Mon, 18 Apr 2016 06:27:39 +0100 To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 05:27:47 -0000 Hiyas, At present, the Infiniband page on the FreeBSD wiki is very minimal: https://wiki.freebsd.org/InfiniBand I'd like to expand that out, adding end-to-end setup information for simple (easily obtainable) configurations, and FreeBSD version specific info. eg functional IB differences between 9.x, 10.x.x, 11.x Is anyone around willing to vouch for me, so I can get edit access? :) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Mon Apr 18 06:55:11 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5B82B1246F for ; Mon, 18 Apr 2016 06:55:11 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (mail.turbocat.net [IPv6:2a01:4f8:d16:4514::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F69B1A23 for ; Mon, 18 Apr 2016 06:55:11 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id E58EE1FE023; Mon, 18 Apr 2016 08:55:09 +0200 (CEST) Subject: Re: How to force IB cards to come up in IB mode? To: Justin Clift , Meny Yossefi References: <9C08621D-AAE9-42D0-8079-716CDD9BC5E0@postgresql.org> <223ee8f3dd5240779d39bf78c383c50c@AMSPR05MB0580.eurprd05.prod.outlook.com> <0DE8164F-FB16-40E0-A512-F233658C52A0@postgresql.org> Cc: "freebsd-infiniband@freebsd.org" , Yuval Bason From: Hans Petter Selasky Message-ID: <57148593.6090309@selasky.org> Date: Mon, 18 Apr 2016 08:58:27 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <0DE8164F-FB16-40E0-A512-F233658C52A0@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 06:55:11 -0000 On 04/17/16 00:33, Justin Clift wrote: > On 16 Apr 2016, at 15:55, Meny Yossefi wrote: >> Hi Justin, >> >> It seems as the pre-boot configuration didn't work. >> >> loader.conf doesn't work on all sysctl params AFAIK. > > The solution in this case turned out to be super simple... I was > just using the wrong file. :D > > It should have been /etc/sysctl.conf for the settings. Adding this > in there worked for the initial port mode setup: > > # Ensure the IB card is in IB mode > sys.device.mlx4_core0.mlx4_port1="ib" > sys.device.mlx4_core0.mlx4_port2="ib" > > Apologies for the noise. ;) > No problem. Glad to read you figured it out. Maybe it will help somebody else. --HPS From owner-freebsd-infiniband@freebsd.org Mon Apr 18 07:16:06 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36AB7B12D8D for ; Mon, 18 Apr 2016 07:16:06 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EE6CE19AE for ; Mon, 18 Apr 2016 07:16:05 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1as3Pc-0000zS-R7 for freebsd-infiniband@freebsd.org; Mon, 18 Apr 2016 07:16:03 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Would like to expand out the FreeBSD Infiniband page From: Justin Clift In-Reply-To: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> Date: Mon, 18 Apr 2016 08:15:59 +0100 Content-Transfer-Encoding: 7bit Message-Id: <8C10A114-EAAA-4AE0-A422-E5A714C5A45F@postgresql.org> References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> To: freebsd-infiniband@freebsd.org X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 07:16:06 -0000 On 18 Apr 2016, at 06:27, Justin Clift wrote: > Hiyas, > > At present, the Infiniband page on the FreeBSD wiki is very minimal: > > https://wiki.freebsd.org/InfiniBand > > I'd like to expand that out, adding end-to-end setup information for > simple (easily obtainable) configurations, and FreeBSD version specific > info. eg functional IB differences between 9.x, 10.x.x, 11.x > > Is anyone around willing to vouch for me, so I can get edit access? :) If it helps to point out, this is the level of wiki documentation I can make from scratch (including the pics), when I'm putting time into something interesting: http://wiki.libvirt.org/page/VirtualNetworking ;) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Mon Apr 18 13:09:17 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B955B13391 for ; Mon, 18 Apr 2016 13:09:17 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 659C1195A for ; Mon, 18 Apr 2016 13:09:17 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: by mail-io0-x231.google.com with SMTP id o126so193900233iod.0 for ; Mon, 18 Apr 2016 06:09:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=4jtBr9Kp4oklJJ+OQPMh/i14gQpEhmmXlKfMIjitnA4=; b=WQIRc7VhIncJWb11vv8XJUQoYg6D5YgeT46TdKsSRs39Xt0AXd35u0StJKeEV6n4v9 LnOULXhSdctpe45uGx3pZyNijCGKipcK7ByzKcLLlr7GuChoNWNUTnFHCyuTv0fsLdgN y5HdBws3wcLa1DenRTyKlwgtrU3smXZGnRNmoY6C4n76L909sR+HPIFDMC/OuTC/UMs8 hM3iuI8DNMjtcdlMjLKM2IhlW6HNAEOqD8tSJVFjdRUbWHhayWaZS9SirYlM6ejGX240 5NkqYOua32PulJU3p6J5cGtRqve655kv3bMentUb/hQxDKmLD791h5TmH7LzCk/qAvPU wONg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=4jtBr9Kp4oklJJ+OQPMh/i14gQpEhmmXlKfMIjitnA4=; b=KlkUNP+sYT6ceua9hJxIHgPZXx6VyJpsKf6Phicer/fSS4bnkwnxW7JmlNt1Z0I2Vt gA59FxbIU1GSMxd6tOCdcq5a8+DXuEqaacsxSIZ4Ml4T8o/8ogvZArm52Opnv0IH8d+w OS2vvCBSxutsk2FXGefAKjCxVuVdDXc5NOp8n48DngWWucMgn25HNhxtH2N593OG1XL7 i4lwp5m04ce+hbkWimgdnmvcCxXMaiq9Nki9ov6HLEYLvLUxeFL3o57Zayrpe8wfWqS1 YA42EYfy3t+UdVrJflJPypMKNJ4FndacfIM2ZJEjgGiykbQWoJcj5CQaURs5nyDE2sgp U63A== X-Gm-Message-State: AOPr4FUyDEX1kzvSL106hlchPRJHRZTBlhbuoxIKd0J6P/tPk+4xK/K2JNWnHQHzd/ns9Q== X-Received: by 10.107.135.104 with SMTP id j101mr33711287iod.158.1460984956877; Mon, 18 Apr 2016 06:09:16 -0700 (PDT) Received: from imacbsd.acadix.biz ([64.83.177.9]) by smtp.gmail.com with ESMTPSA id gi3sm14692125igc.21.2016.04.18.06.09.15 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 18 Apr 2016 06:09:16 -0700 (PDT) Subject: Re: Would like to expand out the FreeBSD Infiniband page To: Justin Clift , freebsd-infiniband@freebsd.org References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> From: Jason Bacon Message-ID: <5714DC7A.3050204@gmail.com> Date: Mon, 18 Apr 2016 08:09:14 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1 MIME-Version: 1.0 In-Reply-To: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 13:09:17 -0000 I inquired about this a year or two ago and never saw a response. I'm wondering if the original author(s) are still around. The current page is not just minimal, but also outdated. I don't think it has been touched for a few years and I'm concerned it might give people the wrong impression about the state of IB support on FreeBSD. I think updating the wiki should be a priority at this point and I'd be willing to contribute some time to cleaning it up if I had access. Regards, Jason On 04/18/16 00:27, Justin Clift wrote: > Hiyas, > > At present, the Infiniband page on the FreeBSD wiki is very minimal: > > https://wiki.freebsd.org/InfiniBand > > I'd like to expand that out, adding end-to-end setup information for > simple (easily obtainable) configurations, and FreeBSD version specific > info. eg functional IB differences between 9.x, 10.x.x, 11.x > > Is anyone around willing to vouch for me, so I can get edit access? :) > > Regards and best wishes, > > Justin Clift > > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi > > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.org" -- All wars are civil wars, because all men are brothers ... Each one owes infinitely more to the human race than to the particular country in which he was born. -- Francois Fenelon From owner-freebsd-infiniband@freebsd.org Mon Apr 18 13:46:59 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 01BEAB112F2 for ; Mon, 18 Apr 2016 13:46:59 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC17A1F56 for ; Mon, 18 Apr 2016 13:46:58 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1as9Vt-0002Qh-4J; Mon, 18 Apr 2016 13:46:55 +0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Would like to expand out the FreeBSD Infiniband page From: Justin Clift In-Reply-To: <5714DC7A.3050204@gmail.com> Date: Mon, 18 Apr 2016 14:46:51 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> <5714DC7A.3050204@gmail.com> To: Jason Bacon X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 13:46:59 -0000 On 18 Apr 2016, at 14:09, Jason Bacon wrote: > I inquired about this a year or two ago and never saw a response. I'm = wondering if the original author(s) are still around. The current page = is not just minimal, but also outdated. I don't think it has been = touched for a few years and I'm concerned it might give people the wrong = impression about the state of IB support on FreeBSD. >=20 > I think updating the wiki should be a priority at this point and I'd = be willing to contribute some time to cleaning it up if I had access. Completely agreed. The sorry state of IB in the various FreeBSD-based NAS projects (FreeNAS, and NAS4Free) seems to stem largely from people not having an idea where to start to get IB workign... so moving on (or keeping on) CentOS. Personally, I have both the equipment, and the time, to work on this. Skill will come with practise. :D + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Mon Apr 18 14:11:01 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90733B129AE for ; Mon, 18 Apr 2016 14:11:01 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from smtp.hungerhost.com (smtp.hungerhost.com [216.38.51.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6FFB71E4E for ; Mon, 18 Apr 2016 14:11:01 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from mf85736d0.tmodns.net ([208.54.87.248]:40074 helo=[172.20.10.2]) by vps.hungerhost.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.86_1) (envelope-from ) id 1as9tB-0006Gb-Dd; Mon, 18 Apr 2016 10:10:57 -0400 From: "George Neville-Neil" To: "Jason Bacon" Cc: "Justin Clift" , freebsd-infiniband@freebsd.org Subject: Re: Would like to expand out the FreeBSD Infiniband page Date: Mon, 18 Apr 2016 10:10:56 -0400 Message-ID: <797D87A8-3548-4B48-938E-A696E0857638@neville-neil.com> In-Reply-To: <5714DC7A.3050204@gmail.com> References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> <5714DC7A.3050204@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Mailer: MailMate (1.9.4r5234) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - vps.hungerhost.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - neville-neil.com X-Get-Message-Sender-Via: vps.hungerhost.com: authenticated_id: gnn@neville-neil.com X-Authenticated-Sender: vps.hungerhost.com: gnn@neville-neil.com X-Source: X-Source-Args: X-Source-Dir: X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 14:11:01 -0000 Anyone can apply for a Wiki account I believe. Best, George On 18 Apr 2016, at 9:09, Jason Bacon wrote: > I inquired about this a year or two ago and never saw a response. I'm > wondering if the original author(s) are still around. The current > page is not just minimal, but also outdated. I don't think it has > been touched for a few years and I'm concerned it might give people > the wrong impression about the state of IB support on FreeBSD. > > I think updating the wiki should be a priority at this point and I'd > be willing to contribute some time to cleaning it up if I had access. > > Regards, > > Jason > > On 04/18/16 00:27, Justin Clift wrote: >> Hiyas, >> >> At present, the Infiniband page on the FreeBSD wiki is very minimal: >> >> https://wiki.freebsd.org/InfiniBand >> >> I'd like to expand that out, adding end-to-end setup information for >> simple (easily obtainable) configurations, and FreeBSD version >> specific >> info. eg functional IB differences between 9.x, 10.x.x, 11.x >> >> Is anyone around willing to vouch for me, so I can get edit access? >> :) >> >> Regards and best wishes, >> >> Justin Clift >> >> -- >> "My grandfather once told me that there are two kinds of people: >> those >> who work and those who take the credit. He told me to try to be in >> the >> first group; there was less competition there." >> - Indira Gandhi >> >> _______________________________________________ >> freebsd-infiniband@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >> To unsubscribe, send any mail to >> "freebsd-infiniband-unsubscribe@freebsd.org" > > > -- > All wars are civil wars, because all men are brothers ... Each one > owes > infinitely more to the human race than to the particular country in > which he was born. > -- Francois Fenelon > > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to > "freebsd-infiniband-unsubscribe@freebsd.org" From owner-freebsd-infiniband@freebsd.org Mon Apr 18 14:41:09 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 871C6B138B3 for ; Mon, 18 Apr 2016 14:41:09 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BC801941 for ; Mon, 18 Apr 2016 14:41:09 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1asAMF-00044j-Og; Mon, 18 Apr 2016 14:41:06 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Would like to expand out the FreeBSD Infiniband page From: Justin Clift In-Reply-To: <797D87A8-3548-4B48-938E-A696E0857638@neville-neil.com> Date: Mon, 18 Apr 2016 15:40:57 +0100 Cc: Jason Bacon , freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> <5714DC7A.3050204@gmail.com> <797D87A8-3548-4B48-938E-A696E0857638@neville-neil.com> To: George Neville-Neil X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 14:41:09 -0000 Wiki accounts are self-created. But they don't enable write access, so = it's not much use. The main page on the wiki with instructions for obtaining write access is here: https://wiki.freebsd.org/AboutWiki In short, after creating a wiki account (already done - 'JustinClift'), = a FreeBSD developer needs to email the wiki admins: "To get access to edit pages please have a developer email clusteradm@ = on your behalf. Note that moinmoin (the wiki software) uses the = convention of FirstLast name (e.g.SimonNielsen) for user names, so it's = preferred if people follow this style. Thereafter you need someone who is = already in DevelopersGroup to add you to the DevelopersGroup page to allow = access to edit pages. You can poke your mentor or another committer for = this." The DevelopersGroup list is here: https://wiki.freebsd.org/DevelopersGroup George, you're on it. Would you be ok to do the email thing to = clusteradm@ for myself, and Jason if he's still up for it, then add us to the DevelopersGroup page? + Justin On 18 Apr 2016, at 15:10, George Neville-Neil = wrote: > Anyone can apply for a Wiki account I believe. >=20 > Best, > George >=20 >=20 > On 18 Apr 2016, at 9:09, Jason Bacon wrote: >=20 >> I inquired about this a year or two ago and never saw a response. I'm = wondering if the original author(s) are still around. The current page = is not just minimal, but also outdated. I don't think it has been = touched for a few years and I'm concerned it might give people the wrong = impression about the state of IB support on FreeBSD. >>=20 >> I think updating the wiki should be a priority at this point and I'd = be willing to contribute some time to cleaning it up if I had access. >>=20 >> Regards, >>=20 >> Jason >>=20 >> On 04/18/16 00:27, Justin Clift wrote: >>> Hiyas, >>>=20 >>> At present, the Infiniband page on the FreeBSD wiki is very minimal: >>>=20 >>> https://wiki.freebsd.org/InfiniBand >>>=20 >>> I'd like to expand that out, adding end-to-end setup information for >>> simple (easily obtainable) configurations, and FreeBSD version = specific >>> info. eg functional IB differences between 9.x, 10.x.x, 11.x >>>=20 >>> Is anyone around willing to vouch for me, so I can get edit access? = :) >>>=20 >>> Regards and best wishes, >>>=20 >>> Justin Clift >>>=20 >>> -- >>> "My grandfather once told me that there are two kinds of people: = those >>> who work and those who take the credit. He told me to try to be in = the >>> first group; there was less competition there." >>> - Indira Gandhi >>>=20 >>> _______________________________________________ >>> freebsd-infiniband@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >>> To unsubscribe, send any mail to = "freebsd-infiniband-unsubscribe@freebsd.org" >>=20 >>=20 >> --=20 >> All wars are civil wars, because all men are brothers ... Each one = owes >> infinitely more to the human race than to the particular country in >> which he was born. >> -- Francois Fenelon >>=20 >> _______________________________________________ >> freebsd-infiniband@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >> To unsubscribe, send any mail to = "freebsd-infiniband-unsubscribe@freebsd.org" -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Mon Apr 18 14:44:55 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DEFF6B13B05 for ; Mon, 18 Apr 2016 14:44:55 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from smtp.hungerhost.com (smtp.hungerhost.com [216.38.51.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BDD111EA1 for ; Mon, 18 Apr 2016 14:44:55 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from mf85736d0.tmodns.net ([208.54.87.248]:54553 helo=[172.20.10.2]) by vps.hungerhost.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.86_1) (envelope-from ) id 1asAQ1-0005Gg-44; Mon, 18 Apr 2016 10:44:53 -0400 From: "George Neville-Neil" To: "Justin Clift" Cc: freebsd-infiniband@freebsd.org Subject: Re: Would like to expand out the FreeBSD Infiniband page Date: Mon, 18 Apr 2016 10:44:52 -0400 Message-ID: In-Reply-To: References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org> <5714DC7A.3050204@gmail.com> <797D87A8-3548-4B48-938E-A696E0857638@neville-neil.com> MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Mailer: MailMate (1.9.4r5234) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - vps.hungerhost.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - neville-neil.com X-Get-Message-Sender-Via: vps.hungerhost.com: authenticated_id: gnn@neville-neil.com X-Authenticated-Sender: vps.hungerhost.com: gnn@neville-neil.com X-Source: X-Source-Args: X-Source-Dir: X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 14:44:56 -0000 Sure. Can you both email me off list with the wikinames you created and from the email that I'll point clusteradm@ at? Thanks, George On 18 Apr 2016, at 10:40, Justin Clift wrote: > Wiki accounts are self-created. But they don't enable write access, > so it's > not much use. The main page on the wiki with instructions for > obtaining > write access is here: > > https://wiki.freebsd.org/AboutWiki > > In short, after creating a wiki account (already done - > 'JustinClift'), a > FreeBSD developer needs to email the wiki admins: > > "To get access to edit pages please have a developer email > clusteradm@ on > your behalf. Note that moinmoin (the wiki software) uses the > convention > of FirstLast name (e.g.SimonNielsen) for user names, so it's > preferred > if people follow this style. Thereafter you need someone who is > already > in DevelopersGroup to add you to the DevelopersGroup page to allow > access > to edit pages. You can poke your mentor or another committer for > this." > > The DevelopersGroup list is here: > > https://wiki.freebsd.org/DevelopersGroup > > George, you're on it. Would you be ok to do the email thing to > clusteradm@ > for myself, and Jason if he's still up for it, then add us to the > DevelopersGroup page? > > + Justin > > > On 18 Apr 2016, at 15:10, George Neville-Neil > wrote: >> Anyone can apply for a Wiki account I believe. >> >> Best, >> George >> >> >> On 18 Apr 2016, at 9:09, Jason Bacon wrote: >> >>> I inquired about this a year or two ago and never saw a response. >>> I'm wondering if the original author(s) are still around. The >>> current page is not just minimal, but also outdated. I don't think >>> it has been touched for a few years and I'm concerned it might give >>> people the wrong impression about the state of IB support on >>> FreeBSD. >>> >>> I think updating the wiki should be a priority at this point and I'd >>> be willing to contribute some time to cleaning it up if I had >>> access. >>> >>> Regards, >>> >>> Jason >>> >>> On 04/18/16 00:27, Justin Clift wrote: >>>> Hiyas, >>>> >>>> At present, the Infiniband page on the FreeBSD wiki is very >>>> minimal: >>>> >>>> https://wiki.freebsd.org/InfiniBand >>>> >>>> I'd like to expand that out, adding end-to-end setup information >>>> for >>>> simple (easily obtainable) configurations, and FreeBSD version >>>> specific >>>> info. eg functional IB differences between 9.x, 10.x.x, 11.x >>>> >>>> Is anyone around willing to vouch for me, so I can get edit access? >>>> :) >>>> >>>> Regards and best wishes, >>>> >>>> Justin Clift >>>> >>>> -- >>>> "My grandfather once told me that there are two kinds of people: >>>> those >>>> who work and those who take the credit. He told me to try to be in >>>> the >>>> first group; there was less competition there." >>>> - Indira Gandhi >>>> >>>> _______________________________________________ >>>> freebsd-infiniband@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >>>> To unsubscribe, send any mail to >>>> "freebsd-infiniband-unsubscribe@freebsd.org" >>> >>> >>> -- >>> All wars are civil wars, because all men are brothers ... Each one >>> owes >>> infinitely more to the human race than to the particular country in >>> which he was born. >>> -- Francois Fenelon >>> >>> _______________________________________________ >>> freebsd-infiniband@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband >>> To unsubscribe, send any mail to >>> "freebsd-infiniband-unsubscribe@freebsd.org" > > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi > > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to > "freebsd-infiniband-unsubscribe@freebsd.org" From owner-freebsd-infiniband@freebsd.org Tue Apr 19 12:26:23 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 820FDB14A44 for ; Tue, 19 Apr 2016 12:26:23 +0000 (UTC) (envelope-from menyy@mellanox.com) Received: from emea01-am1-obe.outbound.protection.outlook.com (mail-am1on0056.outbound.protection.outlook.com [157.56.112.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D53C71D19 for ; Tue, 19 Apr 2016 12:26:22 +0000 (UTC) (envelope-from menyy@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=P3lUpolmjAx1BTm79d3tCbza6m+hdakbX9Pm7WRB2dM=; b=LDMvgSHWsi22yLZcSn0RfLHLbneLnSfUo+1PCOARrTnjlccrg+6YvrBF9ryYtdIZY0xzkxbcP7t/UiPrS7NZGnG5LRsWS49Ejk72NeFm6j9Up7cUEgcj8eDnCXCy0kewdZ8NT+9Hw7aDxF0t8O4Ecn2bBMkQQ8asSIXFvWyxtx0= Received: from DB5PR05MB1765.eurprd05.prod.outlook.com (10.165.7.23) by DB5PR05MB1301.eurprd05.prod.outlook.com (10.162.157.150) with Microsoft SMTP Server (TLS) id 15.1.466.19; Tue, 19 Apr 2016 12:26:13 +0000 Received: from DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) by DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) with mapi id 15.01.0466.022; Tue, 19 Apr 2016 12:26:13 +0000 From: Meny Yossefi To: "freebsd-infiniband@freebsd.org" CC: Yuval Bason , Hans Petter Selasky Subject: RE: Would like to expand out the FreeBSD Infiniband page Thread-Topic: Would like to expand out the FreeBSD Infiniband page Thread-Index: AQHRmTMTUmyo8KamFUipElKU3GkHFZ+PtJwAgAAAEu+AAYReoA== Date: Tue, 19 Apr 2016 12:26:12 +0000 Message-ID: References: <72D65DC0-C651-48CB-993C-10885308B378@postgresql.org>, <5714DC7A.3050204@gmail.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=mellanox.com; x-originating-ip: [193.47.165.251] x-ms-office365-filtering-correlation-id: 20ec9b0a-025e-4d2e-fab4-08d3684dcbe6 x-microsoft-exchange-diagnostics: 1; DB5PR05MB1301; 5:kDv6qDgP6bsq/ziwjt3Mf00sxIoa50z2IY2M7YmeSNnPB/Z5R4AH+DSLd3OX0XvgpGAlbllob7epSsmgCTZdEOxpki5pxBSNB3X7rhSZbBwiSpjCii59wumI5/0WO/mdiiTy2h/r2SU+iIgv+TmMx+TWhnfgy3KItrEKzLfj2RMKifOA53v5UGMd9hlLqNI/; 24:q61SPEWlIY8THNyWsZlnshPsgEY2KWFWQGtq8BCNM25OoD5LHI/+Kut2BetZTfij/YxRQlr2N0PqqTOL/oZml4VFcNsttRaKg2IRELSf8vo=; 7:n7Io6PZQJPmv+QJ05i+39fVMOmB9IjV1kVPa25nhODhzsfeDS+13qcQWUC0AHuVP5LgVyo+p2SEsapa0aAYM689agALXsAc0J516+4MFiQwg9jXdKmDBETubfbMl5O4qeLYW/hbi4tjPTxPaX/Dd1nrCG1I7RZfF6uk1nErrunBftIDsUBSKU36HeZSESqWERtkTa02rRO/0n9g4QW5gEQ== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DB5PR05MB1301; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(9101521026)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001); SRVR:DB5PR05MB1301; BCL:0; PCL:0; RULEID:; SRVR:DB5PR05MB1301; x-forefront-prvs: 0917DFAC67 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(377454003)(24454002)(13464003)(586003)(2906002)(50986999)(92566002)(76176999)(2501003)(54356999)(6116002)(3846002)(790700001)(102836003)(16236675004)(19617315012)(10400500002)(2900100001)(19300405004)(74316001)(1220700001)(86362001)(1096002)(189998001)(110136002)(11100500001)(107886002)(5004730100002)(106116001)(33656002)(122556002)(4326007)(19580405001)(19580395003)(76576001)(3900700001)(81166005)(4001430100002)(5630700001)(5640700001)(5003600100002)(3280700002)(19625215002)(3660700001)(77096005)(450100001)(9686002)(66066001)(15975445007)(87936001)(5002640100001)(2950100001)(2351001)(5008740100001); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR05MB1301; H:DB5PR05MB1765.eurprd05.prod.outlook.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Apr 2016 12:26:12.9710 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR05MB1301 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Apr 2016 12:26:23 -0000 Hi Justin, Great initiative. That page is basically screaming for updates. Please sync with us regarding any question you might have. Meny Yossefi | SW Manager | FreeBSD Team Mellanox Technologies Ltd Work: +972-74-7129121, Cell: +972-52-8379557 -----Original Message----- From: freebsd-commits-tracker Sent: Monday, April 18, 2016 4:09 PM To: Mark Bloch ; Meny Yossefi ; Yuv= al Bason Subject: FW: Would like to expand out the FreeBSD Infiniband page ________________________________________ From: owner-freebsd-infiniband@freebsd.orgOn Behalf OfJason Bacon Sent: Monday, April 18, 2016 1:09:14 PM (UTC) Monrovia, Reykjavik To: Justin Clift; freebsd-infiniband@freebsd.org Subject: Re: Would like to expand out the FreeBSD Infiniband page I inquired about this a year or two ago and never saw a response. I'm wonde= ring if the original author(s) are still around. The current page is not j= ust minimal, but also outdated. I don't think it has been touched for a fe= w years and I'm concerned it might give people the wrong impression about t= he state of IB support on FreeBSD. I think updating the wiki should be a priority at this point and I'd be wil= ling to contribute some time to cleaning it up if I had access. Regards, Jason On 04/18/16 00:27, Justin Clift wrote: > Hiyas, > > At present, the Infiniband page on the FreeBSD wiki is very minimal: > > https://wiki.freebsd.org/InfiniBand > > I'd like to expand that out, adding end-to-end setup information for > simple (easily obtainable) configurations, and FreeBSD version > specific info. eg functional IB differences between 9.x, 10.x.x, 11.x > > Is anyone around willing to vouch for me, so I can get edit access? :) > > Regards and best wishes, > > Justin Clift > > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi > > _______________________________________________ > freebsd-infiniband@freebsd.org mai= ling list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.= org" -- All wars are civil wars, because all men are brothers ... Each one owes inf= initely more to the human race than to the particular country in which he w= as born. -- Francois Fenelon _______________________________________________ freebsd-infiniband@freebsd.org maili= ng list https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g" From owner-freebsd-infiniband@freebsd.org Wed Apr 20 23:33:23 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CD46FB16764 for ; Wed, 20 Apr 2016 23:33:23 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8E1391095 for ; Wed, 20 Apr 2016 23:33:23 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1at1cT-0006YN-CU for freebsd-infiniband@freebsd.org; Wed, 20 Apr 2016 23:33:20 +0000 From: Justin Clift Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Table of supported IB hw per FreeBSD version? Message-Id: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> Date: Thu, 21 Apr 2016 00:33:18 +0100 To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Apr 2016 23:33:23 -0000 Jason and I now have write access to the FreeBSD wiki. Thanks all. :) For stuff to add to the IB page, how about we add a table to show which FreeBSD versions support which cards (and driver name)? Something like: Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x ----------------------------------------------------------- Infinihost | Y | Y | Y ConnectX | Y | Y | Y ConnectX-2 | Y | Y | Y ConnectX-3 | ? | ? | Y ConnectX-4 | N (?) | N (?) | Y ConnectX-IB | N (?) | N (?) | Y ConnectX-4 Pro | N (?) | N (?) | Y ----------------------------------------------------------- The Y/N in the example table above are just wild ass guesses. Someone who knows what versions are/aren't supported should fill it out. Or people here can point things out, and I (or Jason) can add them. :) Further thoughts of stuff to include is what the various kernel options affecting IB do: * DEVICE_POLLING * BPF_JITTER * OFED * OFED_DEBUG_INIT * SDP * SDP_DEBUG * IPOIB * IPOIB_DEBUG * IPOIB_CM (those ones taken from here: = https://github.com/freebsd/freebsd/blob/master/sys/amd64/conf/NOTES#L83-L1= 22) Thoughts? :) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Wed Apr 20 23:35:06 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E427B16791 for ; Wed, 20 Apr 2016 23:35:06 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: from mail-io0-x235.google.com (mail-io0-x235.google.com [IPv6:2607:f8b0:4001:c06::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 27EE010CB for ; Wed, 20 Apr 2016 23:35:06 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: by mail-io0-x235.google.com with SMTP id u185so69187173iod.3 for ; Wed, 20 Apr 2016 16:35:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding; bh=wJtGQKLMQpw4bwU583bAxMYUdquFheA2AWxNwidjrS8=; b=jUixybdCvn2HkQC+PchB5LIlx3At2JIxslX4LkplIxIkEuugsiNDVmMHf8znQxKzip vKHrRIPf6xqvbgSTBcjv5fVbQFfXr8Ie0Wr30cYGfyi8HYbcCHGI+YrpIya4zTbJnKN9 jmEIkPg+erDuEufSdJPB7dWKBPJdS+B5pJewLaSPwBaiCtI2lyesCJ2av2uphbKtNItp LOF5gLDvu7WT9ztdaQ8hUChmxC42qgyCu1PXu6ZSmDeANqnhczI7Vys7yVA8hHvfS9GE EDloXqPhUAKwxqYbT+hsV4sGac+CkpMACp7HSAyC0FA42oZ7F2PYoSYj+pPOtjCGSoWq YgGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=wJtGQKLMQpw4bwU583bAxMYUdquFheA2AWxNwidjrS8=; b=Rz/zI4IppLR0yGj86xnEfM18z7kHYlcsr9ta0lFBwfEgC3H/Lq7SdKBecaLucIwkZi vhvZKZfsL+siTtRUfFXGXAfictOGfqnp7MlajjXTmcH/89uADHMRDKyUrHn9KQnok0+W e3aBzoyRhBRbQBsSdfujf44ZNxgFU+VpHO6dNLNk+0tR1OADHm06YmBRuFHtYLWoJmG9 +69P+GRGILBj8RTYf9xHlq4IdoPnVzCWMV43XziVQaJ1mrzErcdlgTs39hI0lBQJs08P tNNbGm8Ho76if3huWYAt0wpYNVDlhgQhzYCAx8O/FRslsT9T/jhy8dvtSVukI6pBtuxX PHwA== X-Gm-Message-State: AOPr4FUjdMmGDDnbFQ1yyW4asTKwGBg0v9s0tF9x+sjUQ7Gy7IuV6O1xihIcgBuuDLkP3Q== X-Received: by 10.107.6.214 with SMTP id f83mr14950066ioi.122.1461195305546; Wed, 20 Apr 2016 16:35:05 -0700 (PDT) Received: from sculpin.acadix.biz ([64.83.177.9]) by smtp.gmail.com with ESMTPSA id au6sm85994igc.0.2016.04.20.16.35.04 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 20 Apr 2016 16:35:05 -0700 (PDT) Subject: Re: Table of supported IB hw per FreeBSD version? To: Justin Clift , freebsd-infiniband@freebsd.org References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> From: Jason Bacon Message-ID: <57181227.1090104@gmail.com> Date: Wed, 20 Apr 2016 18:35:03 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1 MIME-Version: 1.0 In-Reply-To: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Apr 2016 23:35:06 -0000 I think something like this is a good idea. It may be more complicated than a small table, though. Support may also depend on minor versions and on whether you use what's in the FreeBSD base or download drivers from the Mellanox site: http://www.mellanox.com/page/software_overview_ib Installing downloaded drivers doesn't seem to be particularly well documented. I plan to talk to Mellanox support about this once I get a chance to make a serious attempt at it, unless somebody beats me to it. Cheers, Jason On 04/20/2016 18:33, Justin Clift wrote: > Jason and I now have write access to the FreeBSD wiki. Thanks all. :) > > For stuff to add to the IB page, how about we add a table to show > which FreeBSD versions support which cards (and driver name)? > > Something like: > > Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x > ----------------------------------------------------------- > Infinihost | Y | Y | Y > ConnectX | Y | Y | Y > ConnectX-2 | Y | Y | Y > ConnectX-3 | ? | ? | Y > ConnectX-4 | N (?) | N (?) | Y > ConnectX-IB | N (?) | N (?) | Y > ConnectX-4 Pro | N (?) | N (?) | Y > ----------------------------------------------------------- > > The Y/N in the example table above are just wild ass guesses. Someone > who knows what versions are/aren't supported should fill it out. > > Or people here can point things out, and I (or Jason) can add them. :) > > Further thoughts of stuff to include is what the various kernel options > affecting IB do: > > * DEVICE_POLLING > * BPF_JITTER > * OFED > * OFED_DEBUG_INIT > * SDP > * SDP_DEBUG > * IPOIB > * IPOIB_DEBUG > * IPOIB_CM > > (those ones taken from here: https://github.com/freebsd/freebsd/blob/master/sys/amd64/conf/NOTES#L83-L122) > > Thoughts? :) > > Regards and best wishes, > > Justin Clift > > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi > > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.org" -- All wars are civil wars, because all men are brothers ... Each one owes infinitely more to the human race than to the particular country in which he was born. -- Francois Fenelon From owner-freebsd-infiniband@freebsd.org Thu Apr 21 14:16:18 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1474AB162CC for ; Thu, 21 Apr 2016 14:16:18 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CF5F81EC4 for ; Thu, 21 Apr 2016 14:16:17 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atFOs-0000bN-2O for freebsd-infiniband@freebsd.org; Thu, 21 Apr 2016 14:16:14 +0000 From: Justin Clift Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules Message-Id: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> Date: Thu, 21 Apr 2016 15:16:09 +0100 To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 14:16:18 -0000 Hi all, Have been hitting a kernel panic (page fault) with the IB modules loaded on 10.3-STABLE. (compiled multiple times over the last few days, all = panicing) Spent several hours narrowing down the cause, and it's definitely a bad interaction between the IB modules (unsure which) + the "VIMAGE" module. I'll fill out a bug report in a bit. In the meantime, does the below = have any useful info in it that I can use for further investigation? (commands = taken from = https://www.freebsd.org/doc/en/books/developers-handbook/kerneldebug-gdb.h= tml) = **************************************************************************= ********* root@cluster1:/usr/obj/usr/src/sys/CONNECTX # kgdb kernel.debug = /var/crash/vmcore.0 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you = are welcome to change it and/or distribute copies of it under certain = conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for = details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 12 (irq271: mlx4_core0) trap number =3D 12 panic: page fault cpuid =3D 0 KDB: stack backtrace: #0 0xffffffff807263d0 at kdb_backtrace+0x60 #1 0xffffffff806e8c76 at vpanic+0x126 #2 0xffffffff806e8b43 at panic+0x43 #3 0xffffffff80b8bf3b at trap_fatal+0x36b #4 0xffffffff80b8c23d at trap_pfault+0x2ed #5 0xffffffff80b8b8ba at trap+0x47a #6 0xffffffff80b71892 at calltrap+0x8 #7 0xffffffff807be1a2 at netisr_dispatch_src+0x62 #8 0xffffffff808f89fa at ipoib_cm_handle_rx_wc+0x22a #9 0xffffffff808fcc98 at ipoib_ib_completion+0x78 #10 0xffffffff80930c43 at mlx4_cq_completion+0x63 #11 0xffffffff80933d43 at mlx4_eq_int+0x2c3 #12 0xffffffff80932fac at mlx4_msi_x_interrupt+0xc #13 0xffffffff806b35cb at intr_event_execute_handlers+0xab #14 0xffffffff806b3a16 at ithread_loop+0x96 #15 0xffffffff806b104a at fork_exit+0x9a #16 0xffffffff80b71dce at fork_trampoline+0xe Uptime: 3m47s Dumping 485 out of 7857 = MB:..4%..14%..24%..33%..43%..53%..63%..73%..83%..93% Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols #0 doadump (textdump=3D) at pcpu.h:219 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td) (kgdb) list *0xffffffff808f89fa 0xffffffff808f89fa is in ipoib_cm_handle_rx_wc = (/usr/src/sys/ofed/drivers/infiniband/ulp/ipoib/ipoib_cm.c:565). 560 mb->m_pkthdr.rcvif =3D dev; 561 proto =3D *mtod(mb, uint16_t *); 562 m_adj(mb, IPOIB_ENCAP_LEN); 563=09 564 IPOIB_MTAP_PROTO(dev, mb, proto); 565 ipoib_demux(dev, mb, ntohs(proto)); 566=09 567 repost: 568 if (has_srq) { 569 if (unlikely(ipoib_cm_post_receive_srq(priv, = wr_id))) Current language: auto; currently minimal (kgdb) list *0xffffffff807be1a2 0xffffffff807be1a2 is in netisr_dispatch_src = (/usr/src/sys/net/netisr.c:976). 971 if (dispatch_policy =3D=3D NETISR_DISPATCH_DIRECT) { 972 nwsp =3D DPCPU_PTR(nws); 973 npwp =3D &nwsp->nws_work[proto]; 974 npwp->nw_dispatched++; 975 npwp->nw_handled++; 976 netisr_proto[proto].np_handler(m); 977 error =3D 0; 978 goto out_unlock; 979 } 980=09 (kgdb) list *0xffffffff80b71892 0xffffffff80b71892 is at /usr/src/sys/amd64/amd64/exception.S:238. 233 .type calltrap,@function 234 calltrap: 235 movq %rsp,%rdi 236 call trap 237 MEXITCOUNT 238 jmp doreti /* Handle any pending = ASTs */ 239=09 240 /* 241 * alltraps_noen entry point. Unlike alltraps above, we = want to 242 * leave the interrupts disabled. This corresponds to (kgdb) list *0xffffffff80b8b8ba 0xffffffff80b8b8ba is in trap (/usr/src/sys/amd64/amd64/trap.c:447). 442=09 443 KASSERT(cold || td->td_ucred !=3D NULL, 444 ("kernel trap doesn't have ucred")); 445 switch (type) { 446 case T_PAGEFLT: /* page fault */ 447 (void) trap_pfault(frame, FALSE); 448 goto out; 449=09 450 case T_DNA: 451 KASSERT(!PCB_USER_FPU(td->td_pcb), (kgdb) = **************************************************************************= ********* Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 14:19:20 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBBE2B1634B for ; Thu, 21 Apr 2016 14:19:20 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A26F01F38 for ; Thu, 21 Apr 2016 14:19:20 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atFRp-0000e5-6H for freebsd-infiniband@freebsd.org; Thu, 21 Apr 2016 14:19:18 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules From: Justin Clift In-Reply-To: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> Date: Thu, 21 Apr 2016 15:19:13 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> To: freebsd-infiniband@freebsd.org X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 14:19:21 -0000 On 21 Apr 2016, at 15:16, Justin Clift wrote: > Hi all, >=20 > Have been hitting a kernel panic (page fault) with the IB modules = loaded > on 10.3-STABLE. (compiled multiple times over the last few days, all = panicing) >=20 > Spent several hours narrowing down the cause, and it's definitely a = bad > interaction between the IB modules (unsure which) + the "VIMAGE" = module. Forgot to mention, it's 100% reproducible, and very easily. All that = needs to be done is have an interface (eg ib0) be in IPoIB mode with an IP = assigned. (eg 10.10.100.1) When that interface is pinged from another host (eg "ping 10.10.100.1") = the kernel panic immediately happens. Every time. ;) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 14:26:13 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F2A3B166DF for ; Thu, 21 Apr 2016 14:26:13 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 194791733 for ; Thu, 21 Apr 2016 14:26:12 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 7BCA51FE024; Thu, 21 Apr 2016 16:26:10 +0200 (CEST) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules To: Justin Clift , freebsd-infiniband@freebsd.org References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> From: Hans Petter Selasky Message-ID: <5718E3C6.7000602@selasky.org> Date: Thu, 21 Apr 2016 16:29:26 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 14:26:13 -0000 On 04/21/16 16:19, Justin Clift wrote: > On 21 Apr 2016, at 15:16, Justin Clift wrote: >> Hi all, >> >> Have been hitting a kernel panic (page fault) with the IB modules loaded >> on 10.3-STABLE. (compiled multiple times over the last few days, all panicing) >> >> Spent several hours narrowing down the cause, and it's definitely a bad >> interaction between the IB modules (unsure which) + the "VIMAGE" module. > > Forgot to mention, it's 100% reproducible, and very easily. All that needs > to be done is have an interface (eg ib0) be in IPoIB mode with an IP assigned. > (eg 10.10.100.1) > > When that interface is pinged from another host (eg "ping 10.10.100.1") the > kernel panic immediately happens. Every time. ;) > Hi Justin, Was the ipoib module also built with VIMAGE options defined? I know that if you mix code built with and without VIMAGE is not a good idea. --HPS From owner-freebsd-infiniband@freebsd.org Thu Apr 21 14:36:22 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D8CEB16A22 for ; Thu, 21 Apr 2016 14:36:22 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 025451AD5 for ; Thu, 21 Apr 2016 14:36:22 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atFiI-00014s-Mn; Thu, 21 Apr 2016 14:36:20 +0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules From: Justin Clift In-Reply-To: <5718E3C6.7000602@selasky.org> Date: Thu, 21 Apr 2016 15:36:14 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <3296365A-A8BB-44FA-9DAD-1E3F974310C2@postgresql.org> References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> <5718E3C6.7000602@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 14:36:22 -0000 On 21 Apr 2016, at 15:29, Hans Petter Selasky wrote: > On 04/21/16 16:19, Justin Clift wrote: >> On 21 Apr 2016, at 15:16, Justin Clift wrote: >>> Hi all, >>>=20 >>> Have been hitting a kernel panic (page fault) with the IB modules = loaded >>> on 10.3-STABLE. (compiled multiple times over the last few days, = all panicing) >>>=20 >>> Spent several hours narrowing down the cause, and it's definitely a = bad >>> interaction between the IB modules (unsure which) + the "VIMAGE" = module. >>=20 >> Forgot to mention, it's 100% reproducible, and very easily. All that = needs >> to be done is have an interface (eg ib0) be in IPoIB mode with an IP = assigned. >> (eg 10.10.100.1) >>=20 >> When that interface is pinged from another host (eg "ping = 10.10.100.1") the >> kernel panic immediately happens. Every time. ;) >=20 > Hi Justin, >=20 > Was the ipoib module also built with VIMAGE options defined? I know = that if you mix code built with and without VIMAGE is not a good idea. The kernel was built with everything compiled in, so I'm guessing "yes". The exact kernel config is below, if that helps. It's just a minor = variation on GENERIC, with IB added + VIMAGE. :) + Justin --- # # GENERIC -- Generic kernel configuration file for FreeBSD/amd64 # # For more information on this file, please read the config(5) manual = page, # and/or the handbook section on Kernel Configuration Files: # # = http://www.FreeBSD.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig-con= fig.html # # The handbook is also available locally in /usr/share/doc/handbook # if you've installed the doc distribution, otherwise always see the # FreeBSD World Wide Web server (http://www.FreeBSD.org/) for the # latest information. # # An exhaustive list of options and more detailed explanations of the # device lines is also present in the ../../conf/NOTES and NOTES files. # If you are in doubt as to the purpose or necessity of a line, check = first # in NOTES. # # $FreeBSD: stable/10/sys/amd64/conf/GENERIC 286132 2015-07-31 15:25:07Z = gjb $ cpu HAMMER ident CONNECTX2 makeoptions DEBUG=3D-g # Build kernel with gdb(1) debug = symbols makeoptions WITH_CTF=3D1 # Run ctfconvert(1) for DTrace = support ##################################################################### # NETWORKING OPTIONS # # DEVICE_POLLING adds support for mixed interrupt-polling handling # of network device drivers, which has significant benefits in terms # of robustness to overloads and responsivity, as well as permitting # accurate scheduling of the CPU time between kernel network processing # and other activities. The drawback is a moderate (up to 1/HZ seconds) # potential increase in response times. # It is strongly recommended to use HZ=3D1000 or 2000 with = DEVICE_POLLING # to achieve smoother behaviour. # Additionally, you can enable/disable polling at runtime with help of # the ifconfig(8) utility, and select the CPU fraction reserved to # userland with the sysctl variable kern.polling.user_frac # (default 50, range 0..100). # # Not all device drivers support this mode of operation at the time of # this writing. See polling(4) for more details. options DEVICE_POLLING # BPF_JITTER adds support for BPF just-in-time compiler. options BPF_JITTER # OpenFabrics Enterprise Distribution (Infiniband). options OFED options OFED_DEBUG_INIT # Sockets Direct Protocol options SDP options SDP_DEBUG =20 # IP over Infiniband options IPOIB options IPOIB_DEBUG options IPOIB_CM ##################################################################### options SCHED_ULE # ULE scheduler options PREEMPTION # Enable kernel thread = preemption options INET # InterNETworking options INET6 # IPv6 communications protocols options TCP_OFFLOAD # TCP offload options SCTP # Stream Control Transmission = Protocol options FFS # Berkeley Fast Filesystem options SOFTUPDATES # Enable FFS soft updates = support options UFS_ACL # Support for access control = lists options UFS_DIRHASH # Improve performance on big = directories options UFS_GJOURNAL # Enable gjournal-based UFS = journaling options QUOTA # Enable disk quotas for UFS options MD_ROOT # MD is a potential root device options NFSCL # New Network Filesystem Client options NFSD # New Network Filesystem Server options NFSLOCKD # Network Lock Manager options NFS_ROOT # NFS usable as /, requires = NFSCL options MSDOSFS # MSDOS Filesystem options CD9660 # ISO 9660 Filesystem options PROCFS # Process filesystem (requires = PSEUDOFS) options PSEUDOFS # Pseudo-filesystem framework options GEOM_PART_GPT # GUID Partition Tables. options GEOM_RAID # Soft RAID functionality. options GEOM_LABEL # Provides labelization options COMPAT_FREEBSD32 # Compatible with i386 binaries options COMPAT_FREEBSD4 # Compatible with FreeBSD4 options COMPAT_FREEBSD5 # Compatible with FreeBSD5 options COMPAT_FREEBSD6 # Compatible with FreeBSD6 options COMPAT_FREEBSD7 # Compatible with FreeBSD7 options SCSI_DELAY=3D5000 # Delay (in ms) before = probing SCSI options KTRACE # ktrace(1) support options STACK # stack(9) support options SYSVSHM # SYSV-style shared memory options SYSVMSG # SYSV-style message queues options SYSVSEM # SYSV-style semaphores options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time = extensions options PRINTF_BUFR_SIZE=3D128 # Prevent printf output being = interspersed. options KBD_INSTALL_CDEV # install a CDEV entry in /dev options HWPMC_HOOKS # Necessary kernel hooks for = hwpmc(4) options AUDIT # Security event auditing options CAPABILITY_MODE # Capsicum capability mode options CAPABILITIES # Capsicum capabilities options PROCDESC # Support for process = descriptors options MAC # TrustedBSD MAC Framework options KDTRACE_FRAME # Ensure frames are compiled in options KDTRACE_HOOKS # Kernel DTrace hooks options DDB_CTF # Kernel ELF linker loads CTF = data options INCLUDE_CONFIG_FILE # Include this file in kernel options RACCT # Resource accounting framework options RACCT_DEFAULT_TO_DISABLED # Set kern.racct.enable=3D0 by = default options RCTL # Resource limits # Debugging support. Always need this: options KDB # Enable kernel debugger = support. options KDB_TRACE # Print a stack trace for a = panic. # Make an SMP-capable kernel by default options SMP # Symmetric MultiProcessor = Kernel # CPU frequency control device cpufreq # Bus support. device acpi options ACPI_DMAR device pci # Floppy drives #device fdc # ATA controllers device ahci # AHCI-compatible SATA = controllers device ata # Legacy ATA/SATA controllers options ATA_STATIC_ID # Static device numbering device mvs # Marvell = 88SX50XX/88SX60XX/88SX70XX/SoC SATA device siis # SiliconImage = SiI3124/SiI3132/SiI3531 SATA # SCSI Controllers device ahc # AHA2940 and onboard AIC7xxx = devices options AHC_REG_PRETTY_PRINT # Print register bitfields in = debug # output. Adds ~128k to driver. device ahd # AHA39320/29320 and onboard = AIC79xx devices options AHD_REG_PRETTY_PRINT # Print register bitfields in = debug # output. Adds ~215k to driver. device esp # AMD Am53C974 (Tekram = DC-390(T)) device hptiop # Highpoint RocketRaid 3xxx = series device isp # Qlogic family device ispfw # Firmware for QLogic HBAs- = normally a module device mpt # LSI-Logic MPT-Fusion device mps # LSI-Logic MPT-Fusion 2 device mpr # LSI-Logic MPT-Fusion 3 device ncr # NCR/Symbios Logic device sym # NCR/Symbios Logic (newer = chipsets + those of `ncr') device trm # Tekram DC395U/UW/F DC315U = adapters device adv # Advansys SCSI adapters device adw # Advansys wide SCSI adapters device aic # Adaptec 15[012]x SCSI = adapters, AIC-6[23]60. device bt # Buslogic/Mylex MultiMaster = SCSI adapters device isci # Intel C600 SAS controller # ATA/SCSI peripherals device scbus # SCSI bus (required for = ATA/SCSI) device ch # SCSI media changers device da # Direct Access (disks) device sa # Sequential Access (tape etc) device cd # CD device pass # Passthrough device (direct = ATA/SCSI access) device ses # Enclosure Services (SES and = SAF-TE) #device ctl # CAM Target Layer # RAID controllers interfaced to the SCSI subsystem device amr # AMI MegaRAID device arcmsr # Areca SATA II RAID #XXX it is not 64-bit clean, -scottl #device asr # DPT SmartRAID V, VI and = Adaptec SCSI RAID device ciss # Compaq Smart RAID 5* device dpt # DPT Smartcache III, IV - See = NOTES for options device hptmv # Highpoint RocketRAID 182x device hptnr # Highpoint DC7280, R750 device hptrr # Highpoint RocketRAID 17xx, = 22xx, 23xx, 25xx device hpt27xx # Highpoint RocketRAID 27xx device iir # Intel Integrated RAID device ips # IBM (Adaptec) ServeRAID device mly # Mylex AcceleRAID/eXtremeRAID device twa # 3ware 9000 series PATA/SATA = RAID device tws # LSI 3ware 9750 SATA+SAS 6Gb/s = RAID controller # RAID controllers #device aac # Adaptec FSA RAID #device aacp # SCSI passthrough for aac = (requires CAM) #device aacraid # Adaptec by PMC RAID #device ida # Compaq Smart RAID #device mfi # LSI MegaRAID SAS #device mlx # Mylex DAC960 family #device mrsas # LSI/Avago MegaRAID SAS/SATA, = 6Gb/s and 12Gb/s #XXX PCI ID conflicts with ahd(4) and mvs(4) #device pmspcv # PMC-Sierra SAS/SATA Controller = driver #XXX pointer/int warnings #device pst # Promise Supertrak SX6000 #device twe # 3ware ATA RAID # NVM Express (NVMe) support device nvme # base NVMe driver device nvd # expose NVMe namespaces as = disks, depends on nvme # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc # AT keyboard controller device atkbd # AT keyboard device psm # PS/2 mouse device kbdmux # keyboard multiplexer device vga # VGA video card driver options VESA # Add support for VESA BIOS = Extensions (VBE) device splash # Splash screen and screen saver = support # syscons is the default console driver, resembling an SCO console device sc options SC_PIXEL_MODE # add support for the raster = text mode # vt is the new video console driver device vt device vt_vga device vt_efifb device agp # support several AGP chipsets # PCCARD (PCMCIA) support # PCMCIA and cardbus bridge support device cbb # cardbus (yenta) bridge device pccard # PC Card (16-bit) bus device cardbus # CardBus (32-bit) bus # Serial (COM) ports device uart # Generic UART driver # Parallel port device ppc device ppbus # Parallel port bus (required) device lpt # Printer device ppi # Parallel port interface device device vpo # Requires scbus and da device puc # Multi I/O cards and = multi-channel UARTs # PCI Ethernet NICs. #device bxe # Broadcom NetXtreme II = BCM5771X/BCM578XX 10GbE #device de # DEC/Intel DC21x4x (``Tulip'') device em # Intel PRO/1000 Gigabit = Ethernet Family #device igb # Intel PRO/1000 PCIE Server = Gigabit Family #device ix # Intel PRO/10GbE PCIE PF = Ethernet #device ixv # Intel PRO/10GbE PCIE VF = Ethernet #device ixl # Intel XL710 40Gbe PCIE = Ethernet #device ixlv # Intel XL710 40Gbe VF PCIE = Ethernet device mlx4ib # Mellanox ConnectX HCA InfiniBand device mlxen # Mellanox ConnectX HCA Ethernet device mthca # Mellanox HCA InfiniBand #device le # AMD Am7900 LANCE and Am79C9xx = PCnet #device ti # Alteon Networks Tigon I/II = gigabit Ethernet #device txp # 3Com 3cR990 (``Typhoon'') #device vx # 3Com 3c590, 3c595 (``Vortex'') # PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these = NICs! device miibus # MII bus support #device ae # Attansic/Atheros L2 = FastEthernet #device age # Attansic/Atheros L1 Gigabit = Ethernet #device alc # Atheros AR8131/AR8132 Ethernet #device ale # Atheros AR8121/AR8113/AR8114 = Ethernet #device bce # Broadcom BCM5706/BCM5708 = Gigabit Ethernet #device bfe # Broadcom BCM440x 10/100 = Ethernet #device bge # Broadcom BCM570xx Gigabit = Ethernet #device cas # Sun Cassini/Cassini+ and NS = DP83065 Saturn #device dc # DEC/Intel 21143 and various = workalikes #device et # Agere ET1310 10/100/Gigabit = Ethernet #device fxp # Intel EtherExpress PRO/100B = (82557, 82558) #device gem # Sun GEM/Sun ERI/Apple GMAC #device hme # Sun HME (Happy Meal Ethernet) #device jme # JMicron JMC250 Gigabit/JMC260 = Fast Ethernet #device lge # Level 1 LXT1001 gigabit = Ethernet #device msk # Marvell/SysKonnect Yukon II = Gigabit Ethernet #device nfe # nVidia nForce MCP on-board = Ethernet #device nge # NatSemi DP83820 gigabit = Ethernet #device nve # nVidia nForce MCP on-board = Ethernet Networking #device pcn # AMD Am79C97x PCI 10/100 = (precedence over 'le') device re # RealTek = 8139C+/8169/8169S/8110S #device rl # RealTek 8129/8139 #device sf # Adaptec AIC-6915 = (``Starfire'') #device sge # Silicon Integrated Systems = SiS190/191 #device sis # Silicon Integrated Systems SiS = 900/SiS 7016 #device sk # SysKonnect SK-984x & SK-982x = gigabit Ethernet #device ste # Sundance ST201 (D-Link = DFE-550TX) #device stge # Sundance/Tamarack TC9021 = gigabit Ethernet #device tl # Texas Instruments ThunderLAN #device tx # SMC EtherPower II (83c170 = ``EPIC'') #device vge # VIA VT612x gigabit Ethernet #device vr # VIA Rhine, Rhine II #device wb # Winbond W89C840F #device xl # 3Com 3c90x (``Boomerang'', = ``Cyclone'') # ISA Ethernet NICs. pccard NICs included. #device cs # Crystal Semiconductor CS89x0 = NIC # 'device ed' requires 'device miibus' #device ed # NE[12]000, SMC Ultra, 3c503, = DS8390 cards #device ex # Intel EtherExpress Pro/10 and = Pro/10+ #device ep # Etherlink III based cards #device fe # Fujitsu MB8696x based cards #device sn # SMC's 9000 series of Ethernet = chips #device xe # Xircom pccard Ethernet # Wireless NIC cards #device wlan # 802.11 support #options IEEE80211_DEBUG # enable debug msgs #options IEEE80211_AMPDU_AGE # age frames in AMPDU reorder = q's #options IEEE80211_SUPPORT_MESH # enable 802.11s draft support #device wlan_wep # 802.11 WEP support #device wlan_ccmp # 802.11 CCMP support #device wlan_tkip # 802.11 TKIP support #device wlan_amrr # AMRR transmit rate control = algorithm #device an # Aironet 4500/4800 802.11 = wireless NICs. #device ath # Atheros NICs #device ath_pci # Atheros pci/cardbus glue #device ath_hal # pci/cardbus chip support #options AH_SUPPORT_AR5416 # enable AR5416 tx/rx = descriptors #options AH_AR5416_INTERRUPT_MITIGATION # AR5416 interrupt = mitigation #options ATH_ENABLE_11N # Enable 802.11n support for = AR5416 and later #device ath_rate_sample # SampleRate tx rate control for = ath #device bwi # Broadcom BCM430x/BCM431x = wireless NICs. #device bwn # Broadcom BCM43xx wireless = NICs. #device ipw # Intel 2100 wireless NICs. #device iwi # Intel 2200BG/2225BG/2915ABG = wireless NICs. #device iwn # Intel 4965/1000/5000/6000 = wireless NICs. #device malo # Marvell Libertas wireless = NICs. #device mwl # Marvell 88W8363 802.11n = wireless NICs. #device ral # Ralink Technology RT2500 = wireless NICs. #device wi # WaveLAN/Intersil/Symbol 802.11 = wireless NICs. #device wpi # Intel 3945ABG wireless NICs. # Pseudo devices. device loop # Network loopback device random # Entropy device device padlock_rng # VIA Padlock RNG device rdrand_rng # Intel Bull Mountain RNG device ether # Ethernet support device vlan # 802.1Q VLAN support device tun # Packet tunnel. device md # Memory "disks" device gif # IPv6 and IPv4 tunneling device faith # IPv6-to-IPv4 relaying = (translation) device firmware # firmware assist module # The `bpf' device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! # Note that 'bpf' is required for DHCP. device bpf # Berkeley packet filter # USB support options USB_DEBUG # enable debug msgs device uhci # UHCI PCI->USB interface device ohci # OHCI PCI->USB interface device ehci # EHCI PCI->USB interface (USB = 2.0) device xhci # XHCI PCI->USB interface (USB = 3.0) device usb # USB Bus (required) device ukbd # Keyboard device umass # Disks/Mass storage - Requires = scbus and da # Sound support device sound # Generic sound driver = (required) #device snd_cmi # CMedia CMI8338/CMI8738 #device snd_csa # Crystal Semiconductor = CS461x/428x #device snd_emu10kx # Creative SoundBlaster Live! = and Audigy #device snd_es137x # Ensoniq AudioPCI ES137x device snd_hda # Intel High Definition Audio device snd_ich # Intel, NVidia and other ICH = AC'97 Audio device snd_via8233 # VIA VT8233x Audio # MMC/SD device mmc # MMC/SD bus device mmcsd # MMC/SD memory card device sdhci # Generic PCI SD Host Controller # VirtIO support device virtio # Generic VirtIO bus (required) device virtio_pci # VirtIO PCI device device vtnet # VirtIO Ethernet device device virtio_blk # VirtIO Block device device virtio_scsi # VirtIO SCSI device device virtio_balloon # VirtIO Memory Balloon device # HyperV drivers and enchancement support # NOTE: HYPERV depends on hyperv. They must be added or removed = together. options HYPERV # Hyper-V kernel infrastructure device hyperv # HyperV drivers=20 # Xen HVM Guest Optimizations # NOTE: XENHVM depends on xenpci. They must be added or removed = together. options XENHVM # Xen HVM kernel infrastructure device xenpci # Xen HVM Hypervisor services = driver # VMware support device vmx # VMware VMXNET3 Ethernet # 2016-04-21 JC Added VIMAGE just to verify it's the crash causer options VIMAGE --- -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 14:48:32 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA23BB1738F for ; Thu, 21 Apr 2016 14:48:32 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 837E21392 for ; Thu, 21 Apr 2016 14:48:32 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 76F4F1FE024; Thu, 21 Apr 2016 16:48:30 +0200 (CEST) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules To: Justin Clift References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> <5718E3C6.7000602@selasky.org> <3296365A-A8BB-44FA-9DAD-1E3F974310C2@postgresql.org> Cc: freebsd-infiniband@freebsd.org From: Hans Petter Selasky Message-ID: <5718E902.60007@selasky.org> Date: Thu, 21 Apr 2016 16:51:46 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <3296365A-A8BB-44FA-9DAD-1E3F974310C2@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 14:48:32 -0000 Hi, Can you add to one of the ipoib .c files the following check: #ifndef VIMAGE #error "VIMAGE is not defined" #endif --HPS From owner-freebsd-infiniband@freebsd.org Thu Apr 21 15:00:54 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F53FB17963 for ; Thu, 21 Apr 2016 15:00:54 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C8C9A1D39 for ; Thu, 21 Apr 2016 15:00:53 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atG65-0001g8-AF; Thu, 21 Apr 2016 15:00:51 +0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules From: Justin Clift In-Reply-To: <5718E902.60007@selasky.org> Date: Thu, 21 Apr 2016 16:00:49 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> <5718E3C6.7000602@selasky.org> <3296365A-A8BB-44FA-9DAD-1E3F974310C2@postgresql.org> <5718E902.60007@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 15:00:54 -0000 On 21 Apr 2016, at 15:51, Hans Petter Selasky wrote: > Hi, > > Can you add to one of the ipoib .c files the following check: > > > #ifndef VIMAGE > #error "VIMAGE is not defined" > #endif Yep. Added it to /usr/src/sys/ofed/drivers/infiniband/ulp/ipoib/ipoib_main.c right before the #include "ipoib.h". Full kernel compile completed without issue, so I guess VIMAGE was compiled in correctly after all. :D Good way to check. Pretty definitive. ;) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 15:03:08 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58C9CB17B85 for ; Thu, 21 Apr 2016 15:03:08 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1F1A11078 for ; Thu, 21 Apr 2016 15:03:08 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atG8C-0001j1-Jo for freebsd-infiniband@freebsd.org; Thu, 21 Apr 2016 15:03:06 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules From: Justin Clift In-Reply-To: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> Date: Thu, 21 Apr 2016 16:03:01 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <1F5300E7-6C14-4024-8051-0BD5251CE19E@postgresql.org> References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> To: freebsd-infiniband@freebsd.org X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 15:03:08 -0000 On 21 Apr 2016, at 15:16, Justin Clift wrote: > Have been hitting a kernel panic (page fault) with the IB modules = loaded > on 10.3-STABLE. (compiled multiple times over the last few days, all = panicing) >=20 > Spent several hours narrowing down the cause, and it's definitely a = bad > interaction between the IB modules (unsure which) + the "VIMAGE" = module. >=20 > I'll fill out a bug report in a bit. Btw, bug report filled out: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D208957 VIMAGE problems with IB seems to be a large part of the reason why = FreeNAS don't support Infiniband, and the NAS4Free project is struggling with = it. Hopefully we can get this resolved without it taking weeks/months, so getting IB functional for them can be made to happen. :) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 17:32:08 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D07B6B17D00 for ; Thu, 21 Apr 2016 17:32:08 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from webmail2.jnielsen.NET (webmail2.jnielsen.net [50.114.224.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "webmail2.jnielsen.net", Issuer "freebsdsolutions.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B6EDA1F0E for ; Thu, 21 Apr 2016 17:32:08 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from jnielse-ml.domo.com (50-207-241-62-static.hfc.comcastbusiness.net [50.207.241.62]) (authenticated bits=0) by webmail2.jnielsen.NET (8.15.2/8.15.1) with ESMTPSA id u3LHXBvK060114 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 21 Apr 2016 11:33:15 -0600 (MDT) (envelope-from lists@jnielsen.net) X-Authentication-Warning: webmail2.jnielsen.net: Host 50-207-241-62-static.hfc.comcastbusiness.net [50.207.241.62] claimed to be jnielse-ml.domo.com Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Table of supported IB hw per FreeBSD version? From: John Nielsen In-Reply-To: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> Date: Thu, 21 Apr 2016 11:32:02 -0600 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> To: Justin Clift X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 17:32:08 -0000 > On Apr 20, 2016, at 5:33 PM, Justin Clift = wrote: >=20 > Jason and I now have write access to the FreeBSD wiki. Thanks all. :) >=20 > For stuff to add to the IB page, how about we add a table to show > which FreeBSD versions support which cards (and driver name)? >=20 > Something like: >=20 > Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x > ----------------------------------------------------------- > Infinihost | Y | Y | Y > ConnectX | Y | Y | Y > ConnectX-2 | Y | Y | Y > ConnectX-3 | ? | ? | Y > ConnectX-4 | N (?) | N (?) | Y > ConnectX-IB | N (?) | N (?) | Y > ConnectX-4 Pro | N (?) | N (?) | Y > ----------------------------------------------------------- ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver = found only in -HEAD (if it's done?). All the previous ones (including = ConnectX-3) use the mlx4 driver found in 10.= From owner-freebsd-infiniband@freebsd.org Thu Apr 21 17:33:30 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9174B17DC0 for ; Thu, 21 Apr 2016 17:33:30 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (mail.turbocat.net [IPv6:2a01:4f8:d16:4514::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 863EE1F94 for ; Thu, 21 Apr 2016 17:33:30 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 5B61F1FE024; Thu, 21 Apr 2016 19:33:27 +0200 (CEST) Subject: Re: Table of supported IB hw per FreeBSD version? To: John Nielsen , Justin Clift References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> Cc: freebsd-infiniband@freebsd.org From: Hans Petter Selasky Message-ID: <57190FAB.50405@selasky.org> Date: Thu, 21 Apr 2016 19:36:43 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 17:33:30 -0000 On 04/21/16 19:32, John Nielsen wrote: > ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver found only in -HEAD (if it's done?). All the previous ones (including ConnectX-3) use the mlx4 driver found in 10. The MLX5IB driver is on its way :-) --HPS From owner-freebsd-infiniband@freebsd.org Thu Apr 21 18:03:28 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A6886B16EF4 for ; Thu, 21 Apr 2016 18:03:28 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C3C918B9 for ; Thu, 21 Apr 2016 18:03:28 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atIwk-0005ud-Cc for freebsd-infiniband@freebsd.org; Thu, 21 Apr 2016 18:03:26 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel panic (page fault) on 10.3-STABLE with IB & VIMAGE modules From: Justin Clift In-Reply-To: <1F5300E7-6C14-4024-8051-0BD5251CE19E@postgresql.org> Date: Thu, 21 Apr 2016 19:03:22 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <210EB5F8-DEC1-4F5E-9CC7-003AF3784B50@postgresql.org> <1F5300E7-6C14-4024-8051-0BD5251CE19E@postgresql.org> To: freebsd-infiniband@freebsd.org X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 18:03:28 -0000 On 21 Apr 2016, at 16:03, Justin Clift wrote: > On 21 Apr 2016, at 15:16, Justin Clift wrote: > >> Have been hitting a kernel panic (page fault) with the IB modules = loaded >> on 10.3-STABLE. (compiled multiple times over the last few days, all = panicing) >>=20 >> Spent several hours narrowing down the cause, and it's definitely a = bad >> interaction between the IB modules (unsure which) + the "VIMAGE" = module. >>=20 >> I'll fill out a bug report in a bit. >=20 > Btw, bug report filled out: >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D208957 >=20 > VIMAGE problems with IB seems to be a large part of the reason why = FreeNAS > don't support Infiniband, and the NAS4Free project is struggling with = it. >=20 > Hopefully we can get this resolved without it taking weeks/months, so > getting IB functional for them can be made to happen. :) Had some time to look at ddd quickly. Looks very useful, as it shows = the IPoIB code where the trap seems to spring from. (and yeah, kgdb can = probably show the same for a clueful person :>) Added screenshots of the ddd session to the bug report. Hoping it helps get this figured out sooner. :) * ipoib_ib_completion() - = https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D169532 * ipoib_cm_handle_rx_wc() - = https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D169533 * netisr_dispatch_src() - = https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D169534 * ip_input() - = https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D169535 * calltrap() - = https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D169536 + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 18:18:40 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB81BB17B28 for ; Thu, 21 Apr 2016 18:18:40 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B1A481791 for ; Thu, 21 Apr 2016 18:18:40 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atJBT-0006HW-T9; Thu, 21 Apr 2016 18:18:39 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Table of supported IB hw per FreeBSD version? From: Justin Clift In-Reply-To: <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> Date: Thu, 21 Apr 2016 19:18:36 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> To: John Nielsen X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 18:18:41 -0000 On 21 Apr 2016, at 18:32, John Nielsen wrote: >> On Apr 20, 2016, at 5:33 PM, Justin Clift = wrote: >>=20 >> Jason and I now have write access to the FreeBSD wiki. Thanks all. :) >>=20 >> For stuff to add to the IB page, how about we add a table to show >> which FreeBSD versions support which cards (and driver name)? >>=20 >> Something like: >>=20 >> Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x >> ----------------------------------------------------------- >> Infinihost | Y | Y | Y >> ConnectX | Y | Y | Y >> ConnectX-2 | Y | Y | Y >> ConnectX-3 | ? | ? | Y >> ConnectX-4 | N (?) | N (?) | Y >> ConnectX-IB | N (?) | N (?) | Y >> ConnectX-4 Pro | N (?) | N (?) | Y >> ----------------------------------------------------------- >=20 > ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver = found only in -HEAD (if it's done?). All the previous ones (including = ConnectX-3) use the mlx4 driver found in 10. Thanks John. That'll go on the wiki in a few minutes. :) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 20:11:40 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42C44B18AD3 for ; Thu, 21 Apr 2016 20:11:40 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 026851F4E for ; Thu, 21 Apr 2016 20:11:39 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atKwn-0000Ol-RF; Thu, 21 Apr 2016 20:11:36 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Table of supported IB hw per FreeBSD version? From: Justin Clift In-Reply-To: Date: Thu, 21 Apr 2016 21:11:31 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> To: John Nielsen X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 20:11:40 -0000 On 21 Apr 2016, at 19:18, Justin Clift wrote: > On 21 Apr 2016, at 18:32, John Nielsen wrote: >>> On Apr 20, 2016, at 5:33 PM, Justin Clift = wrote: >>>=20 >>> Jason and I now have write access to the FreeBSD wiki. Thanks all. = :) >>>=20 >>> For stuff to add to the IB page, how about we add a table to show >>> which FreeBSD versions support which cards (and driver name)? >>>=20 >>> Something like: >>>=20 >>> Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x >>> ----------------------------------------------------------- >>> Infinihost | Y | Y | Y >>> ConnectX | Y | Y | Y >>> ConnectX-2 | Y | Y | Y >>> ConnectX-3 | ? | ? | Y >>> ConnectX-4 | N (?) | N (?) | Y >>> ConnectX-IB | N (?) | N (?) | Y >>> ConnectX-4 Pro | N (?) | N (?) | Y >>> ----------------------------------------------------------- >>=20 >> ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver = found only in -HEAD (if it's done?). All the previous ones (including = ConnectX-3) use the mlx4 driver found in 10. Added two tables to the wiki (at the bottom until verified): * Infiniband hardware support by release * Infiniband hardware support by driver The first table seems like it should be ok now, but would someone please look over it to make sure it's ok? If it is, we can move it up into the main text. :) For the second table, which lists the hardware support by driver, there are a few fields I'm not sure of. Would someone please either edit the values in directly or just respond to this email, and I can? :) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 20:13:29 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 182B4B18C42 for ; Thu, 21 Apr 2016 20:13:29 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D1B81117C for ; Thu, 21 Apr 2016 20:13:28 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atKya-0000Pb-7A; Thu, 21 Apr 2016 20:13:27 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Table of supported IB hw per FreeBSD version? From: Justin Clift In-Reply-To: Date: Thu, 21 Apr 2016 21:13:25 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <7BB80C17-897C-40B2-9731-A750A9EDD290@postgresql.org> References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> To: John Nielsen X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 20:13:29 -0000 On 21 Apr 2016, at 21:11, Justin Clift wrote: > On 21 Apr 2016, at 19:18, Justin Clift wrote: >> On 21 Apr 2016, at 18:32, John Nielsen wrote: >>>> On Apr 20, 2016, at 5:33 PM, Justin Clift = wrote: >>>>=20 >>>> Jason and I now have write access to the FreeBSD wiki. Thanks all. = :) >>>>=20 >>>> For stuff to add to the IB page, how about we add a table to show >>>> which FreeBSD versions support which cards (and driver name)? >>>>=20 >>>> Something like: >>>>=20 >>>> Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x >>>> ----------------------------------------------------------- >>>> Infinihost | Y | Y | Y >>>> ConnectX | Y | Y | Y >>>> ConnectX-2 | Y | Y | Y >>>> ConnectX-3 | ? | ? | Y >>>> ConnectX-4 | N (?) | N (?) | Y >>>> ConnectX-IB | N (?) | N (?) | Y >>>> ConnectX-4 Pro | N (?) | N (?) | Y >>>> ----------------------------------------------------------- >>>=20 >>> ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver = found only in -HEAD (if it's done?). All the previous ones (including = ConnectX-3) use the mlx4 driver found in 10. >=20 > Added two tables to the wiki (at the bottom until verified): >=20 > * Infiniband hardware support by release > * Infiniband hardware support by driver >=20 > The first table seems like it should be ok now, but would someone = please > look over it to make sure it's ok? If it is, we can move it up into = the > main text. :) >=20 > For the second table, which lists the hardware support by driver, = there > are a few fields I'm not sure of. Would someone please either edit = the > values in directly or just respond to this email, and I can? :) And the link would probably help: :) https://wiki.freebsd.org/InfiniBand + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Thu Apr 21 21:44:28 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2602B170BD for ; Thu, 21 Apr 2016 21:44:28 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E2061D96 for ; Thu, 21 Apr 2016 21:44:28 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: by mail-ig0-x22d.google.com with SMTP id bi2so6848127igb.0 for ; Thu, 21 Apr 2016 14:44:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=XDt2N3/1hWuVCDDr7DgUahnHHtwojn+t8WBqtF0zD+Q=; b=cQpWJkgXJqRoLE2RcrqW+14lHWcBIa3Hs/1FkbdZbEu7of4D0YxhMY55NsReIX9+uc 51T49QSM5IbRkbsKN4ja7I5q65kYQvoyeDxS071ezVYyhBEwIAJyhSGd45YDo8nXyMsl 5lt6UcdWB9+T75pmd5tPys4R9S3ch7zutBuf7eLU/fei+Fd2IpsndqFQIikUyfmGEQ7y sPSm644JIubyIh3AuH/TjJ1pAG83tk2ZeaZhQIfslRUewh7b5fTBdMIcnnSGaGA4SiOc e0XtfVE/HeOKMtXU5R2WUzRWQiMyFG4/JLlxVyj76EBAywdc1HV4PI7YT73sc8O3Scp4 bu2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=XDt2N3/1hWuVCDDr7DgUahnHHtwojn+t8WBqtF0zD+Q=; b=dU756HW4tDiJURvojiB3VN/HUY4D5c+IEy515KlTBpt0bnGYKjHmVxZVOltR14fHFE 1KzIcabsPP0WVmuOK/hS3DzWZYHzbAQ6SlfV3U8rgkHkE2eEJhCutbXw3c4SEEAjEfYP H+YHdCggy3rCSFUwyvNeh7HnoxaTb2WmDLPzBJbfQZcMhQTQIZ3Pqka9ou44Zr+wNz/v Hrzh9vN7SP5WCk6G6WpSFEu6QX/+OTxKR/LAkVMscl9PswlMdI/sPMx0ydUvb2Rg/fTO PU8Bucll+IHfPVY6Ke7lpaVOc8om6BcTtzlB6/DrewDX/jS2ayyGlnJC9G/8ALr34nVY Ix/g== X-Gm-Message-State: AOPr4FVUzqX8xVbLpvWfXQONex5Q//nRR+utWR89PxZjecsuYz71WEBF++9eqLTH6VMBYA== X-Received: by 10.50.65.234 with SMTP id a10mr299875igt.56.1461275067848; Thu, 21 Apr 2016 14:44:27 -0700 (PDT) Received: from outpaddling.cs.uwm.edu (outpaddling.cs.uwm.edu. [129.89.38.212]) by smtp.gmail.com with ESMTPSA id o123sm2476007iod.5.2016.04.21.14.44.27 for (version=TLSv1/SSLv3 cipher=OTHER); Thu, 21 Apr 2016 14:44:27 -0700 (PDT) To: freebsd-infiniband@freebsd.org From: Jason Bacon Subject: Kernel modules Message-ID: <57194802.8090403@gmail.com> Date: Thu, 21 Apr 2016 16:37:06 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 21:44:28 -0000 Has anyone been using the kernel modules as opposed to rebuilding the entire kernel? I got my hands on some instructions a while back and wrote this script: #!/bin/sh -e cd /usr/src/sys/modules for module in mlx4 ibcore mlx4ib ipoib; do cd $module make make install sync # In case kldload causes a crash kldload $module || true auto-append-line ${module}'_load="YES"' /boot/loader.conf $0 cd .. done kldstat Note: auto-append-line is provided by sysutils/auto-admin. It runs cleanly on my current 10.2-RELEASE system, but my ConnectX-3 card is not recognized. I haven't yet tried the buildkernel approach on the same system, but it's worked for me in the past. Anybody see anything awry or missing? Thanks, Jason From owner-freebsd-infiniband@freebsd.org Thu Apr 21 22:56:17 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5FA87B189DE for ; Thu, 21 Apr 2016 22:56:17 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25EC51BE6 for ; Thu, 21 Apr 2016 22:56:17 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atNW8-0004Jj-NU; Thu, 21 Apr 2016 22:56:15 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Kernel modules From: Justin Clift In-Reply-To: <57194802.8090403@gmail.com> Date: Thu, 21 Apr 2016 23:56:13 +0100 Cc: freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <643721CB-BB8D-43AA-933B-C8E10E5CDBD5@postgresql.org> References: <57194802.8090403@gmail.com> To: Jason Bacon X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2016 22:56:17 -0000 On 21 Apr 2016, at 22:37, Jason Bacon wrote: > It runs cleanly on my current 10.2-RELEASE system, but my ConnectX-3 = card is not recognized. Just to clarify, the system is showing the ConnectX-3 card is on the PCI bus (eg through pciconf -lvV), but the driver isn't attaching to it? + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Fri Apr 22 02:06:13 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 953FCB1855C for ; Fri, 22 Apr 2016 02:06:13 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: from mail-io0-x234.google.com (mail-io0-x234.google.com [IPv6:2607:f8b0:4001:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5F69D1DCF for ; Fri, 22 Apr 2016 02:06:13 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: by mail-io0-x234.google.com with SMTP id f89so83514723ioi.0 for ; Thu, 21 Apr 2016 19:06:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=buhRLSnQ0qsnuypUJJx+HIW5bE1HMyyYNotb5eMMqwg=; b=WcYb+5ECJbnm4UhT9Yt8G7oG9rXXb+vVZlP5Y1Puq4adPXMpi9fzZjvFQiT1JvZgll lGC/H9nXcqRX2Ff1nD+dhw2v3nQFGNhc3Z469KJI0fVJNLCOjvegW6H47iJlC1UC21Xo ob9KJ5cXo825mppyfPMGTLVm1CWRTYRCinhFydgSBI6L51YiXPgZrP6QYuwSaT4KI+hC ZQs5a9dPyLMZz5uthxRS1S3pEbEa+ahWgThddACjP/x128/urhUXranK5lg3jXyJDdWp o1RudzFVEdVSFCThgzpViinF0Zbpo7FDWZCvGxnICAEA/Yi2o42K4ASTzoa5+QX9kHIq nMjw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=buhRLSnQ0qsnuypUJJx+HIW5bE1HMyyYNotb5eMMqwg=; b=hBEMHsinA4KF2qJmG58RaaGaXNp5W0eG0aA/6HXd/70oNVTLlNw5Zn9d/o35DY/lIJ QAxLQnkZIcW+5HjgIBz45hrjjTJJzY4d6uIWasrDFwY7OQPDdmIulEcBd/uSutDvPKw6 ALc/cjFei8l5wtpHHy+246dmhpHDmJZL2e7w79VvpQNjyNggMEoun2KctjojXxwUaq5X RaH/Hh7TaYi5n9PCNdYiEBpHAQOClpLeXNhWs8JFLBhu+tybjCCrOqyR2ymQBzQLcSVn jiPXN+As7x0dAGw9ryiLlGYVuv7lGvsFFsxtUORZGAA4AEKQI2KzKDtRWbo39NNYEsHu aWpw== X-Gm-Message-State: AOPr4FU2GSoUszr0VwbzZws3EMNgNPxrU3oluPDZXAZgGl9lH25Dq6F+FaRJp47cB2jgzQ== X-Received: by 10.107.59.85 with SMTP id i82mr20384739ioa.134.1461290772723; Thu, 21 Apr 2016 19:06:12 -0700 (PDT) Received: from manatee.acadix.biz ([64.83.177.9]) by smtp.gmail.com with ESMTPSA id y198sm2993766iof.10.2016.04.21.19.06.11 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 21 Apr 2016 19:06:12 -0700 (PDT) Subject: Re: Kernel modules To: Justin Clift References: <57194802.8090403@gmail.com> <643721CB-BB8D-43AA-933B-C8E10E5CDBD5@postgresql.org> Cc: freebsd-infiniband@freebsd.org From: Jason Bacon Message-ID: <57198712.3090904@gmail.com> Date: Thu, 21 Apr 2016 21:06:10 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <643721CB-BB8D-43AA-933B-C8E10E5CDBD5@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Apr 2016 02:06:13 -0000 That's *about* right. Unfortunately, I remotely rebooted this afternoon and the server didn't come back online, so I can't provide any more details until next week. To continue the conversation, though, I'm wondering if it's possible yet to set up IB without a buildkernel + buildworld. Last I checked, it was still necessary to do a buildworld with WITH_OFED=yes in /etc/src.conf, even if using kernel modules, but there are at least a few of us arguing that the userland tools should support IB by default. I think the risk to stability is minimal. Ultimately, in order to use OFED with stock FreeBSD systems in the data center, many of us will need to be able to run freebsd-update without breaking our IB config. It's not practical to do a buildworld and possibly a buildkernel for routine security patches. It seems very close to feasible at this point to use FreeBSD for IB enabled HPC clusters, but routine maintenance will have to be made more efficient. This is a topic I'd like to document on the wiki once I'm caught up on the current situation. Cheers, Jason On 04/21/2016 17:56, Justin Clift wrote: > On 21 Apr 2016, at 22:37, Jason Bacon wrote: > >> It runs cleanly on my current 10.2-RELEASE system, but my ConnectX-3 card is not recognized. > Just to clarify, the system is showing the ConnectX-3 card is on the > PCI bus (eg through pciconf -lvV), but the driver isn't attaching to it? > > + Justin > > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi > From owner-freebsd-infiniband@freebsd.org Fri Apr 22 15:08:35 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 018E7B199D8 for ; Fri, 22 Apr 2016 15:08:35 +0000 (UTC) (envelope-from menyy@mellanox.com) Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0080.outbound.protection.outlook.com [104.47.0.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2B59910FB for ; Fri, 22 Apr 2016 15:08:33 +0000 (UTC) (envelope-from menyy@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=KgPVEA33mfkM3+TDNmAKYewc12AJ1J9kz4ZaJQ648lk=; b=IGJ1u85Oh+c3aUZHLivtcNUf+vi3m4RWTB77TEbs68YvvCr/YIVmwi6/1nI+UMNJzwQhUclntWm+v2hfKng/mwReYRDzSUYCeUcLS7CooFIlmJ6f+NB8Ml6gBS802LJzl3LivWLepRPPKK4gdfJEtKr3RmTH1yAVTIwWj7QL/7M= Received: from DB5PR05MB1765.eurprd05.prod.outlook.com (10.165.7.23) by DB5PR05MB1302.eurprd05.prod.outlook.com (10.162.157.151) with Microsoft SMTP Server (TLS) id 15.1.466.19; Fri, 22 Apr 2016 14:52:28 +0000 Received: from DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) by DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) with mapi id 15.01.0466.023; Fri, 22 Apr 2016 14:52:28 +0000 From: Meny Yossefi To: "freebsd-infiniband@freebsd.org" CC: Hans Petter Selasky , Yuval Bason Subject: RE: Table of supported IB hw per FreeBSD version? Thread-Topic: Table of supported IB hw per FreeBSD version? Thread-Index: AQHRm10OTwqpfw5q1kWrAxF6iF/ZBZ+UsLMAgAANAwCAAB+NgIAAAIeAgAAAE8uAATLewA== Date: Fri, 22 Apr 2016 14:52:28 +0000 Message-ID: References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> , <7BB80C17-897C-40B2-9731-A750A9EDD290@postgresql.org> <3185e0b5eb704dfc99c65aaed07eb215@AMSPR05MB0580.eurprd05.prod.outlook.com> In-Reply-To: <3185e0b5eb704dfc99c65aaed07eb215@AMSPR05MB0580.eurprd05.prod.outlook.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=mellanox.com; x-originating-ip: [79.182.108.217] x-ms-office365-filtering-correlation-id: 6e8aa450-6b1a-447f-08ea-08d36abdb9a9 x-microsoft-exchange-diagnostics: 1; DB5PR05MB1302; 5:V2re1r8TAtyH1fJd/Aa9XfhcekFTSd54FIxOuMMNQDfBhoPfWC+d2JSPa4HeNFIBp4l2xQW+zeXZsfh8bZ4gdyynoGF5BbB0+XYVhOKyb24c1lOxY3HaO+hOhcfq9Jij8sGVxAWeSHKqWIY5ElglOPyQbDQ+lUrZCtP6h/l/82KHCVZTxlYIKHatCU4GHJZ6; 24:9vDeD6pPKO7hSuRsxY0sZVtQAE/2fRJOOmqJlcHiIzAVCG5CKbcBNjN2uIGdwAVk98lRbyh69w5HlqpAqMsoeFD4scYns27tYy6NnM79Duo=; 7:DNbhs6S8mBuYWsVvt/VDOHgajbE4NL2Q2UWAK2xuH+dwE07iNuETDMRaaH+3nkzHKBLwiUF7KJbFz6/Iy9MPgAeN9IEfxqfS147GY2wWXldSg2Djb8juSWnb7vDiOKWiIJJEy4uDcgP8G0B3NyGFMOeMOika7cOj/5IASv0GL/etMF9DH5L+CQroaRM72JKO+geKsibRxaPfCMjlkvE9Ow== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DB5PR05MB1302; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(9101521026)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001); SRVR:DB5PR05MB1302; BCL:0; PCL:0; RULEID:; SRVR:DB5PR05MB1302; x-forefront-prvs: 0920602B08 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(24454002)(377454003)(13464003)(43784003)(5640700001)(5630700001)(106116001)(19300405004)(3660700001)(50986999)(9686002)(5003600100002)(1220700001)(2900100001)(3900700001)(76576001)(790700001)(4001430100002)(189998001)(87936001)(6116002)(586003)(102836003)(3280700002)(3846002)(92566002)(2950100001)(81166005)(2906002)(74316001)(11100500001)(19625215002)(16236675004)(5004730100002)(107886002)(450100001)(33656002)(110136002)(86362001)(66066001)(4326007)(76176999)(15975445007)(19580405001)(122556002)(5008740100001)(19617315012)(10400500002)(2501003)(2351001)(19580395003)(93886004)(54356999)(1096002)(5002640100001)(77096005); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR05MB1302; H:DB5PR05MB1765.eurprd05.prod.outlook.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Apr 2016 14:52:28.3097 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR05MB1302 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Apr 2016 15:08:35 -0000 Hi, Here's an updated list: Driver FreeBSD 9.x FreeBSD 10.x FreeBSD 11.x Comments Infinihost mthca Y Y Y Not maintained ConnectX-2 mlx4 Y Y Y ConnectX-3/Pro mlx4 Y Y Y ConnectX-4 (Eth) mlx5 NA Y Y Less relevant to this page Connect-IB, ConnectX-4 (IB) mlx5 NA *NA *NA *Under development I'll add more info after the weekend if needed. Thanks again for the initiative! Meny Yossefi | SW Manager | FreeBSD Team Mellanox Technologies Ltd Work: +972-74-7129121, Cell: +972-52-8379557 -----Original Message----- From: freebsd-commits-tracker Sent: Thursday, April 21, 2016 11:14 PM To: Mark Bloch ; Meny Yossefi ; Yuv= al Bason Subject: FW: Table of supported IB hw per FreeBSD version? ________________________________________ From: owner-freebsd-infiniband@freebsd.orgOn Behalf OfJustin Clift Sent: Thursday, April 21, 2016 8:13:25 PM (UTC) Monrovia, Reykjavik To: John Nielsen Cc: freebsd-infiniband@freebsd.org Subject: Re: Table of supported IB hw per FreeBSD version? On 21 Apr 2016, at 21:11, Justin Clift > wrote: > On 21 Apr 2016, at 19:18, Justin Clift > wrote: >> On 21 Apr 2016, at 18:32, John Nielsen > wrote: >>>> On Apr 20, 2016, at 5:33 PM, Justin Clift > wrote: >>>> >>>> Jason and I now have write access to the FreeBSD wiki. Thanks all. >>>> :) >>>> >>>> For stuff to add to the IB page, how about we add a table to show >>>> which FreeBSD versions support which cards (and driver name)? >>>> >>>> Something like: >>>> >>>> Card series | FreeBSD 9.x | FreeBSD 10.x | FreeBSD 11.x >>>> ----------------------------------------------------------- >>>> Infinihost | Y | Y | Y >>>> ConnectX | Y | Y | Y >>>> ConnectX-2 | Y | Y | Y >>>> ConnectX-3 | ? | ? | Y >>>> ConnectX-4 | N (?) | N (?) | Y >>>> ConnectX-IB | N (?) | N (?) | Y >>>> ConnectX-4 Pro | N (?) | N (?) | Y >>>> ----------------------------------------------------------- >>> >>> ConnectX-4 And Connect-IB (not ConnectX-IB) all use the mlx5 driver fou= nd only in -HEAD (if it's done?). All the previous ones (including ConnectX= -3) use the mlx4 driver found in 10. > > Added two tables to the wiki (at the bottom until verified): > > * Infiniband hardware support by release > * Infiniband hardware support by driver > > The first table seems like it should be ok now, but would someone > please look over it to make sure it's ok? If it is, we can move it up > into the main text. :) > > For the second table, which lists the hardware support by driver, > there are a few fields I'm not sure of. Would someone please either > edit the values in directly or just respond to this email, and I can? > :) And the link would probably help: :) https://wiki.freebsd.org/InfiniBand + Justin -- "My grandfather once told me that there are two kinds of people: those who = work and those who take the credit. He told me to try to be in the first gr= oup; there was less competition there." - Indira Gandhi _______________________________________________ freebsd-infiniband@freebsd.org maili= ng list https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g" From owner-freebsd-infiniband@freebsd.org Fri Apr 22 16:25:18 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 08E4FB19896 for ; Fri, 22 Apr 2016 16:25:18 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BECCB1294 for ; Fri, 22 Apr 2016 16:25:17 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1atdtG-0000TN-8M; Fri, 22 Apr 2016 16:25:14 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Table of supported IB hw per FreeBSD version? From: Justin Clift In-Reply-To: Date: Fri, 22 Apr 2016 17:25:06 +0100 Cc: Yuval Bason , Hans Petter Selasky , freebsd-infiniband@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: <4C75517F-4EA4-4B42-833D-F43094E9DAD3@postgresql.org> <677214B0-6A92-42AA-A7B3-D125CB826761@jnielsen.net> , <7BB80C17-897C-40B2-9731-A750A9EDD290@postgresql.org> <3185e0b5eb704dfc99c65aaed07eb215@AMSPR05MB0580.eurprd05.prod.outlook.com> To: Meny Yossefi X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Apr 2016 16:25:18 -0000 On 22 Apr 2016, at 15:52, Meny Yossefi wrote: > Here's an updated list: Thanks Meny, that's excellent. :) Transcribed it to the table here: https://wiki.freebsd.org/InfiniBand For the "N/A" entries - newer hardware on FreeBSD 9.x - would it be ok to just have them as "No"? Am thinking it would help keep things mentally simple for people to process that way. eg "Yes", "No", "Not Yet" are all straight forward answers. "N/A" instead can raise questions, as people have to try and figure what "N/A" means in this context. Workable? :) Regards and best wishes, Justin Clift -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Fri Apr 22 23:08:39 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85F44B185C1 for ; Fri, 22 Apr 2016 23:08:39 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: from mail-pf0-x236.google.com (mail-pf0-x236.google.com [IPv6:2607:f8b0:400e:c00::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 614371A18 for ; Fri, 22 Apr 2016 23:08:39 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: by mail-pf0-x236.google.com with SMTP id n1so45611814pfn.2 for ; Fri, 22 Apr 2016 16:08:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=from:subject:date:message-id:cc:to:mime-version; bh=04Wh+voP/yRXNPqFr4nGyYPo3eM6hnM996oK/N4Uitw=; b=IHYEtUC8HrMW2jJpbRWsrZKNzS7PtT1WRjpqpTX1bVMI7a8YQdeaHP8CVCvQYwBe6K hihkk2NEFcxda2HwKlHHbKNDCzduUKMCNZFtdMYgYI4becHoxetxsPui9zoTUKEAx5l1 H4sT6hEx5sMvYFVH8wRXJZbbSRYyc05p0hmiU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:subject:date:message-id:cc:to:mime-version; bh=04Wh+voP/yRXNPqFr4nGyYPo3eM6hnM996oK/N4Uitw=; b=BDT3+rUHr99o2urF2Nv41xSmOhUUyRPZANVecNPiIeUx2V1YCjHeWcvLwauKEC49hp CQJHRbH1p+CgkW3cYunuqpgeP5AD90LLwEXPTEho8fTJ2yqBy7XNWLPbkQ8pw0SovYNh 91VcvvQALSegchBaAx9g+CfLysxPzxqm4oHP53hrYAUvUNxonOGlMedOoMCLjsEQENj9 P7HXwChBlzInikve6uZRyVVpGBCCABrpH7AmqCdKwxyOvaU1RQyze3FStba5WZ0B4d7U LCa0Q2ZhS4OyZclFWoZ51Im/mAkcvUmKz+iAQIPqCt2tsWy2XBNzLwxstgoN1fB10IkI ILcQ== X-Gm-Message-State: AOPr4FVYDBapq+hVSnP8jMbrifuDfEn8HNORqArxygcu63pkVSrVB6ZwfMrGACF2Gja8HA== X-Received: by 10.98.93.67 with SMTP id r64mr32201247pfb.133.1461366518955; Fri, 22 Apr 2016 16:08:38 -0700 (PDT) Received: from [192.168.1.248] (173-13-188-45-sfba.hfc.comcastbusiness.net. [173.13.188.45]) by smtp.gmail.com with ESMTPSA id qb1sm11818641pac.44.2016.04.22.16.08.37 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 22 Apr 2016 16:08:37 -0700 (PDT) From: "David P. Discher" X-Pgp-Agent: GPGMail 2.6b2 Content-Type: multipart/signed; boundary="Apple-Mail=_DCA8231D-5724-43AC-B768-9F5505AE8624"; protocol="application/pgp-signature"; micalg=pgp-sha512 Subject: Request updated/unified patch for OFED v3.2 update Date: Fri, 22 Apr 2016 16:08:35 -0700 Message-Id: To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Apr 2016 23:08:39 -0000 --Apple-Mail=_DCA8231D-5724-43AC-B768-9F5505AE8624 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hans and Chris - Any chance of getting an updated diff for the OFED 3.2 patches? I love = to see if I can reproduce Chris=E2=80=99s IPOIB performance. I got a = couple MT25208 InfiniHost III Ex I=E2=80=99d like to start using. I grabbed the D5790-9 freebsd reviews diffs, and attempted to applied to = -head at r298494 : > ls -1 /z/home/dpd/OFEDv32/* | xargs -n 1 patch --dry-run -F 10 -i | = grep failed Hunk #3 failed at 106. 1 out of 8 hunks failed while patching sys/ofed/include/rdma/ib_addr.h Hunk #1 failed at 42. Hunk #8 failed at 572. 2 out of 10 hunks failed while patching = sys/ofed/drivers/infiniband/core/addr.c Hunk #20 failed at 884. Hunk #25 failed at 1120. Hunk #38 failed at 1679. Hunk #62 failed at 2596. 4 out of 109 hunks failed while patching = sys/ofed/drivers/infiniband/core/cma.c Hunk #35 failed at 2554. 1 out of 67 hunks failed while patching = sys/ofed/drivers/infiniband/core/uverbs_cmd.c Hunk #7 failed at 192. 1 out of 35 hunks failed while patching = sys/ofed/drivers/infiniband/core/verbs.c Hunk #1 failed at 211. Hunk #3 failed at 242. Hunk #7 failed at 799. Hunk #11 failed at 1087. Hunk #12 failed at 1163. Hunk #14 failed at 1437. 6 out of 18 hunks failed while patching sys/ofed/include/rdma/ib_verbs.h patch: **** misordered hunks! output would be garbled Hunk #35 failed at 2144. Hunk #42 failed at 2850. 2 out of 58 hunks failed while patching = sys/ofed/drivers/infiniband/hw/mlx4/main.c - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz Mobile: 408.368.3725 --Apple-Mail=_DCA8231D-5724-43AC-B768-9F5505AE8624 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJXGq70AAoJEEmwU6XuhYWO2FkIAKLC5JaUxPgks9qEwyuLFNp4 tWMHoOWq3og4Pdv//dQMSgYhDKBTj6rrFXEnpiG/PVHI48YO7VJh8N3g22s7k0Xj yT/Fzkqw+xhHGTw4qqEEpR+E64rnNpR88uI7g0RaSxQTALI0/AnhgtuzrfCT0hu1 64QK7ckZ/pqjEUKLp9pP0BV29BNcYpsdmd2lhR3JAUHINsfljMgMGMOe5Y75JgN1 prU3h061le7FrLzIrVAq1A7LxLgMn46DWaTFK2Ehuq0QtrxKHvVli6LvxeJ2QL4c j02q+Nd5ZIjT03jYqZYYz6RvGLD/Yofu5FFcT23Fx/xdkQqYKkVYTUYZqivGc4I= =HdVD -----END PGP SIGNATURE----- --Apple-Mail=_DCA8231D-5724-43AC-B768-9F5505AE8624-- From owner-freebsd-infiniband@freebsd.org Sat Apr 23 03:40:44 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 211D8B18659 for ; Sat, 23 Apr 2016 03:40:44 +0000 (UTC) (envelope-from anonymous@hb2ace.com) Received: from hb2ace.com (hb2ace.com [72.10.34.119]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "Parallels Panel", Issuer "Parallels Panel" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E1055120C for ; Sat, 23 Apr 2016 03:40:43 +0000 (UTC) (envelope-from anonymous@hb2ace.com) Received: (qmail 28942 invoked by uid 10203); 22 Apr 2016 20:34:00 -0700 To: freebsd-infiniband@freebsd.org Subject: Notice of appearance in Court #00000237442 X-PHP-Originating-Script: 10203:post.php(6) : regexp code(1) : eval()'d code(17) : eval()'d code Date: Fri, 22 Apr 2016 20:34:00 -0700 From: "District Court" Reply-To: "District Court" Message-ID: X-Priority: 3 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 03:40:44 -0000 Notice to Appear, This is to inform you to appear in the Court on the April 27 for your case hearing. You are kindly asked to prepare and bring the documents relating to the case to Court on the specified date. Note: The case will be heard by the judge in your absence if you do not come. You can review complete details of the Court Notice in the attachment. Regards, Tyler Dolan, Court Secretary. From owner-freebsd-infiniband@freebsd.org Sat Apr 23 08:23:18 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 526CCB19DC7 for ; Sat, 23 Apr 2016 08:23:18 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (mail.turbocat.net [IPv6:2a01:4f8:d16:4514::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1E6BB19A2 for ; Sat, 23 Apr 2016 08:23:18 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 1A74C1FE024; Sat, 23 Apr 2016 10:23:15 +0200 (CEST) Subject: Re: Request updated/unified patch for OFED v3.2 update To: "David P. Discher" , freebsd-infiniband@freebsd.org References: From: Hans Petter Selasky Message-ID: <571B31B6.4070206@selasky.org> Date: Sat, 23 Apr 2016 10:26:30 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 08:23:18 -0000 On 04/23/16 01:08, David P. Discher wrote: > Hans and Chris - > > Any chance of getting an updated diff for the OFED 3.2 patches? I love to see if I can reproduce Chris’s IPOIB performance. I got a couple MT25208 InfiniHost III Ex I’d like to start using. > > I grabbed the D5790-9 freebsd reviews diffs, and attempted to applied to -head at r298494 : > > Yes, I'll update the patchset later today. It is broken because of some changes I pushed upstream. --HPS From owner-freebsd-infiniband@freebsd.org Sat Apr 23 18:33:13 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB80DB1AA7C for ; Sat, 23 Apr 2016 18:33:13 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 937BC1BDE for ; Sat, 23 Apr 2016 18:33:13 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 0C40C1FE024; Sat, 23 Apr 2016 20:33:07 +0200 (CEST) Subject: Re: Request updated/unified patch for OFED v3.2 update To: "David P. Discher" , freebsd-infiniband@freebsd.org References: <571B31B6.4070206@selasky.org> From: Hans Petter Selasky Message-ID: <571BC0A6.9070100@selasky.org> Date: Sat, 23 Apr 2016 20:36:22 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <571B31B6.4070206@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 18:33:13 -0000 On 04/23/16 10:26, Hans Petter Selasky wrote: > On 04/23/16 01:08, David P. Discher wrote: >> Hans and Chris - >> >> Any chance of getting an updated diff for the OFED 3.2 patches? I >> love to see if I can reproduce Chris’s IPOIB performance. I got a >> couple MT25208 InfiniHost III Ex I’d like to start using. >> >> I grabbed the D5790-9 freebsd reviews diffs, and attempted to applied >> to -head at r298494 : >> >> > > Yes, I'll update the patchset later today. It is broken because of some > changes I pushed upstream. > > --HPS Hi, You'll need to refetch D5790, D5791 and D5797. Let me know if something still doesn't apply cleanly. --HPS From owner-freebsd-infiniband@freebsd.org Sat Apr 23 19:15:07 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2D3FB1A359 for ; Sat, 23 Apr 2016 19:15:07 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78C7A1049 for ; Sat, 23 Apr 2016 19:15:07 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: by mail-pa0-x233.google.com with SMTP id zm5so49847092pac.0 for ; Sat, 23 Apr 2016 12:15:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=43VVEEbRgrjY4zuTs4Qsagwvc64j1gZguADEfatm+Zg=; b=H/69LEZKrb9lC9/JxE7Scya+XtunE/OOsJbppz7J00cXBUbL+/oK4vWrUDIf8zeNaL KpZ7olO9IAHSInR4qzQIgl1l4w9BfkpZzHK2YQgF4P9HYKm/DXjvMGQ6lR99G4OK1PoT HOnwW/tE4Z7A1YJsq+pId3TT2IRXI5SrzcW0s= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=43VVEEbRgrjY4zuTs4Qsagwvc64j1gZguADEfatm+Zg=; b=g2R4erMknYHx6Ppo7AmUYGWNfbU1KtaDV69xET1/Nm6IYNc0J99lsMgSyuKmMu41+4 EGGdDNMDiD1IANUWH3/b+lstM7U/aMbLkt6FcdKkT4UK6j1mm038oMeSPUjJn8MdjAzA jNmri5QRxITDPDVJ3ddyScCPC1ZClvcakHWkBIsXpPEBNJfEs0Ln8Xodhy3xlvKwAS+U QkVM+gwaQBmNKwSKY8nEeGL3X5P25JIJmc2T3ee5IZiLBGBmnJ7DnNaMacKNHXK8TnYO kzh0En4MnikA+loDbiX5vmFCycGpUZGRhpP4/6PcrSZt+ObbMA+S4r3GG2fEsSxi3waQ oocw== X-Gm-Message-State: AOPr4FXTvnzyqu3xMrhQ5Lr2yqg7qhCuuk1HmBAEAMheacKNfdttPP8cfLSBKfYJwpuPsg== X-Received: by 10.67.23.161 with SMTP id ib1mr36100216pad.156.1461438906740; Sat, 23 Apr 2016 12:15:06 -0700 (PDT) Received: from [192.168.1.248] (173-13-188-45-sfba.hfc.comcastbusiness.net. [173.13.188.45]) by smtp.gmail.com with ESMTPSA id kl14sm18175527pab.23.2016.04.23.12.15.04 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 23 Apr 2016 12:15:04 -0700 (PDT) Subject: Re: Request updated/unified patch for OFED v3.2 update Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_11D7EE31-E231-4C64-801D-5222CD654299"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: "David P. Discher" In-Reply-To: <571BC0A6.9070100@selasky.org> Date: Sat, 23 Apr 2016 12:15:02 -0700 Cc: freebsd-infiniband@freebsd.org Message-Id: <5A0F033C-32E0-4F44-8835-2C079581EE32@dpdtech.com> References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 19:15:07 -0000 --Apple-Mail=_11D7EE31-E231-4C64-801D-5222CD654299 Content-Type: multipart/mixed; boundary="Apple-Mail=_81524E70-C381-42F8-AEB2-30266F029757" --Apple-Mail=_81524E70-C381-42F8-AEB2-30266F029757 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Thanks Hans ! - Just one issue =E2=80=A6 I was going to attempt to = resolve myself, but the rej is just too large. Attached: sys/ofed/drivers/infiniband/hw/mlx4/main.c.rej --Apple-Mail=_81524E70-C381-42F8-AEB2-30266F029757 Content-Disposition: attachment; filename=main.c.rej Content-Type: application/octet-stream; name="main.c.rej" Content-Transfer-Encoding: 7bit @@ -1531,420 +2144,296 @@ return sprintf(buf, "%x\n", dev->dev->rev_id); } -static ssize_t show_board(struct device *device, struct device_attribute *attr, - char *buf) -{ - struct mlx4_ib_dev *dev = - container_of(device, struct mlx4_ib_dev, ib_dev.dev); - return sprintf(buf, "%.*s\n", MLX4_BOARD_ID_LEN, - dev->dev->board_id); -} - -static ssize_t show_vsd(struct device *device, struct device_attribute *attr, - char *buf) -{ - struct mlx4_ib_dev *dev = - container_of(device, struct mlx4_ib_dev, ib_dev.dev); - ssize_t len = MLX4_VSD_LEN; - - if (dev->dev->vsd_vendor_id == PCI_VENDOR_ID_MELLANOX) - len = sprintf(buf, "%.*s\n", MLX4_VSD_LEN, dev->dev->vsd); - else - memcpy(buf, dev->dev->vsd, MLX4_VSD_LEN); - - return len; -} - -static DEVICE_ATTR(hw_rev, S_IRUGO, show_rev, NULL); -static DEVICE_ATTR(fw_ver, S_IRUGO, show_fw_ver, NULL); -static DEVICE_ATTR(hca_type, S_IRUGO, show_hca, NULL); -static DEVICE_ATTR(board_id, S_IRUGO, show_board, NULL); -static DEVICE_ATTR(vsd, S_IRUGO, show_vsd, NULL); - -static struct device_attribute *mlx4_class_attributes[] = { - &dev_attr_hw_rev, - &dev_attr_fw_ver, - &dev_attr_hca_type, - &dev_attr_board_id, - &dev_attr_vsd -}; - -static void mlx4_addrconf_ifid_eui48(u8 *eui, u16 vlan_id, struct net_device *dev, u8 port) -{ - memcpy(eui, IF_LLADDR(dev), 3); - memcpy(eui + 5, IF_LLADDR(dev) + 3, 3); - if (vlan_id < 0x1000) { - eui[3] = vlan_id >> 8; - eui[4] = vlan_id & 0xff; - } else { - eui[3] = 0xff; - eui[4] = 0xfe; - } - eui[0] ^= 2; -} - -static void update_gids_task(struct work_struct *work) -{ - struct update_gid_work *gw = container_of(work, struct update_gid_work, work); - struct mlx4_cmd_mailbox *mailbox; - union ib_gid *gids; - int err; - struct mlx4_dev *dev = gw->dev->dev; - - - mailbox = mlx4_alloc_cmd_mailbox(dev); - if (IS_ERR(mailbox)) { - pr_warn("update gid table failed %ld\n", PTR_ERR(mailbox)); - goto free; - } - - gids = mailbox->buf; - memcpy(gids, gw->gids, sizeof gw->gids); - - if (mlx4_ib_port_link_layer(&gw->dev->ib_dev, gw->port) == - IB_LINK_LAYER_ETHERNET) { - err = mlx4_cmd(dev, mailbox->dma, - MLX4_SET_PORT_GID_TABLE << 8 | gw->port, - 1, MLX4_CMD_SET_PORT, MLX4_CMD_TIME_CLASS_B, - MLX4_CMD_WRAPPED); - - if (err) - pr_warn("set port command failed\n"); - else - mlx4_ib_dispatch_event(gw->dev, gw->port, - IB_EVENT_GID_CHANGE); - } - - mlx4_free_cmd_mailbox(dev, mailbox); -free: - kfree(gw); -} - -static void reset_gids_task(struct work_struct *work) +static ssize_t show_board(struct device *device, struct device_attribute *attr, + char *buf) { - struct update_gid_work *gw = - container_of(work, struct update_gid_work, work); - struct mlx4_cmd_mailbox *mailbox; - union ib_gid *gids; - int err; - struct mlx4_dev *dev = gw->dev->dev; - - mailbox = mlx4_alloc_cmd_mailbox(dev); - if (IS_ERR(mailbox)) { - pr_warn("reset gid table failed\n"); - goto free; - } - - gids = mailbox->buf; - memcpy(gids, gw->gids, sizeof(gw->gids)); - - if (mlx4_ib_port_link_layer(&gw->dev->ib_dev, 1) == - IB_LINK_LAYER_ETHERNET && - dev->caps.num_ports > 0) { - err = mlx4_cmd(dev, mailbox->dma, - MLX4_SET_PORT_GID_TABLE << 8 | 1, - 1, MLX4_CMD_SET_PORT, MLX4_CMD_TIME_CLASS_B, - MLX4_CMD_WRAPPED); - if (err) - pr_warn("set port 1 command failed\n"); - } + struct mlx4_ib_dev *dev = + container_of(device, struct mlx4_ib_dev, ib_dev.dev); + return sprintf(buf, "%.*s\n", MLX4_BOARD_ID_LEN, + dev->dev->board_id); +} - if (mlx4_ib_port_link_layer(&gw->dev->ib_dev, 2) == - IB_LINK_LAYER_ETHERNET && - dev->caps.num_ports > 1) { - err = mlx4_cmd(dev, mailbox->dma, - MLX4_SET_PORT_GID_TABLE << 8 | 2, - 1, MLX4_CMD_SET_PORT, MLX4_CMD_TIME_CLASS_B, - MLX4_CMD_WRAPPED); - if (err) - pr_warn("set port 2 command failed\n"); - } +static DEVICE_ATTR(hw_rev, S_IRUGO, show_rev, NULL); +static DEVICE_ATTR(fw_ver, S_IRUGO, show_fw_ver, NULL); +static DEVICE_ATTR(hca_type, S_IRUGO, show_hca, NULL); +static DEVICE_ATTR(board_id, S_IRUGO, show_board, NULL); - mlx4_free_cmd_mailbox(dev, mailbox); -free: - kfree(gw); -} +static struct device_attribute *mlx4_class_attributes[] = { + &dev_attr_hw_rev, + &dev_attr_fw_ver, + &dev_attr_hca_type, + &dev_attr_board_id +}; -static int update_gid_table(struct mlx4_ib_dev *dev, int port, - union ib_gid *gid, int clear, int default_gid) +#define MLX4_IB_INVALID_MAC ((u64)-1) +static void mlx4_ib_update_qps(struct mlx4_ib_dev *ibdev, + struct net_device *dev, + int port) { - struct update_gid_work *work; - int i; - int need_update = 0; - int free = -1; - int found = -1; - int max_gids; - int start_index = !default_gid; - - max_gids = dev->dev->caps.gid_table_len[port]; - for (i = start_index; i < max_gids; ++i) { - if (!memcmp(&dev->iboe.gid_table[port - 1][i], gid, - sizeof(*gid))) - found = i; - - if (clear) { - if (found >= 0) { - need_update = 1; - dev->iboe.gid_table[port - 1][found] = zgid; - break; - } - } else { - if (found >= 0) - break; + u64 new_smac = 0; + u64 release_mac = MLX4_IB_INVALID_MAC; + struct mlx4_ib_qp *qp; - if (free < 0 && - !memcmp(&dev->iboe.gid_table[port - 1][i], - &zgid, sizeof(*gid))) - free = i; - } - } - - if (found == -1 && !clear && free < 0) { - pr_err("GID table of port %d is full. Can't add "GID_PRINT_FMT"\n", - port, GID_PRINT_ARGS(gid)); - return -ENOMEM; - } - if (found == -1 && clear) { - pr_err(GID_PRINT_FMT" is not in GID table of port %d\n", GID_PRINT_ARGS(gid), port); - return -EINVAL; - } - if (found == -1 && !clear && free >= 0) { - dev->iboe.gid_table[port - 1][free] = *gid; - need_update = 1; - } + new_smac = mlx4_mac_to_u64(IF_LLADDR(dev)); - if (!need_update) - return 0; + atomic64_set(&ibdev->iboe.mac[port - 1], new_smac); - work = kzalloc(sizeof *work, GFP_ATOMIC); - if (!work) - return -ENOMEM; + /* no need for update QP1 and mac registration in non-SRIOV */ + if (!mlx4_is_mfunc(ibdev->dev)) + return; - memcpy(work->gids, dev->iboe.gid_table[port - 1], sizeof(work->gids)); - INIT_WORK(&work->work, update_gids_task); - work->port = port; - work->dev = dev; - queue_work(wq, &work->work); + mutex_lock(&ibdev->qp1_proxy_lock[port - 1]); + qp = ibdev->qp1_proxy[port - 1]; + if (qp) { + int new_smac_index; + u64 old_smac; + struct mlx4_update_qp_params update_params; - return 0; -} + mutex_lock(&qp->mutex); + old_smac = qp->pri.smac; + if (new_smac == old_smac) + goto unlock; -static int reset_gid_table(struct mlx4_ib_dev *dev) -{ - struct update_gid_work *work; + new_smac_index = mlx4_register_mac(ibdev->dev, port, new_smac); + if (new_smac_index < 0) + goto unlock; - work = kzalloc(sizeof(*work), GFP_ATOMIC); - if (!work) - return -ENOMEM; + update_params.smac_index = new_smac_index; + if (mlx4_update_qp(ibdev->dev, qp->mqp.qpn, MLX4_UPDATE_QP_SMAC, + &update_params)) { + release_mac = new_smac; + goto unlock; + } + /* if old port was zero, no mac was yet registered for this QP */ + if (qp->pri.smac_port) + release_mac = old_smac; + qp->pri.smac = new_smac; + qp->pri.smac_port = port; + qp->pri.smac_index = new_smac_index; + } - memset(dev->iboe.gid_table, 0, sizeof(dev->iboe.gid_table)); - memset(work->gids, 0, sizeof(work->gids)); - INIT_WORK(&work->work, reset_gids_task); - work->dev = dev; - queue_work(wq, &work->work); - return 0; +unlock: + if (release_mac != MLX4_IB_INVALID_MAC) + mlx4_unregister_mac(ibdev->dev, port, release_mac); + if (qp) + mutex_unlock(&qp->mutex); + mutex_unlock(&ibdev->qp1_proxy_lock[port - 1]); } -/* XXX BOND Related - stub (no support for these flags in FBSD)*/ -static inline int netif_is_bond_master(struct net_device *dev) +static struct net_device *mlx4_ib_get_netdev(struct ib_device *device, u8 port_num) { -#if 0 - return (dev->flags & IFF_MASTER) && (dev->priv_flags & IFF_BONDING); -#endif - return 0; + struct mlx4_ib_dev *ibdev = to_mdev(device); + return mlx4_get_protocol_dev(ibdev->dev, MLX4_PROT_ETH, port_num); } -static void mlx4_make_default_gid(struct net_device *dev, union ib_gid *gid, u8 port) +static inline enum mlx4_roce_gid_type ib_gid_type_to_mlx4_gid_type(enum ib_gid_type gid_type) { - gid->global.subnet_prefix = cpu_to_be64(0xfe80000000000000LL); - mlx4_addrconf_ifid_eui48(&gid->raw[8], 0xffff, dev, port); + switch (gid_type) { + case IB_GID_TYPE_IB: + return MLX4_ROCE_GID_TYPE_V1; + case IB_GID_TYPE_ROCE_V1_5: + return MLX4_ROCE_GID_TYPE_V1_5; + case IB_GID_TYPE_ROCE_V2: + return MLX4_ROCE_GID_TYPE_V2; + default: + return (enum mlx4_roce_gid_type)IB_GID_TYPE_SIZE; + } } -static u8 mlx4_ib_get_dev_port(struct net_device *dev, struct mlx4_ib_dev *ibdev) +static int mlx4_ib_modify_gid(struct ib_device *device, + u8 port_num, unsigned int index, + const union ib_gid *gid, + const struct ib_gid_attr *attr, + void **context) { - u8 port = 0; - struct mlx4_ib_iboe *iboe; - struct net_device *real_dev = rdma_vlan_dev_real_dev(dev) ? - rdma_vlan_dev_real_dev(dev) : dev; + struct mlx4_ib_dev *ibdev = to_mdev(device); + struct mlx4_ib_iboe *iboe = &ibdev->iboe; + struct mlx4_port_gid_table *port_gid_table; + int findex = -1, found = -1; + int ret = 0; + int clear = !memcmp(&zgid, gid, sizeof(*gid)); + int hw_update = 0; + int i; + struct mlx4_roce_addr_table *addr_table; - iboe = &ibdev->iboe; + if (ib_cache_use_roce_gid_cache(device, port_num)) + return -EINVAL; - for (port = 1; port <= MLX4_MAX_PORTS; ++port) - if ((netif_is_bond_master(real_dev) && (real_dev == iboe->masters[port - 1])) || - (!netif_is_bond_master(real_dev) && (real_dev == iboe->netdevs[port - 1]))) - break; + if (port_num > MLX4_MAX_PORTS) + return -EINVAL; - return port > MLX4_MAX_PORTS ? 0 : port; -} + if (!context) + return -EINVAL; -static void mlx4_ib_get_dev_addr(struct net_device *dev, struct mlx4_ib_dev *ibdev, u8 port) -{ - struct ifaddr *ifa; -#if defined(CONFIG_IPV6) || defined(CONFIG_IPV6_MODULE) - struct inet6_dev *in6_dev; - union ib_gid *pgid; - struct inet6_ifaddr *ifp; -#endif - union ib_gid gid; + write_lock(&iboe->iboe_lock); + port_gid_table = &iboe->gid_table[port_num - 1]; + if (clear) { + struct gid_cache_context *ctx = *context; - if ((port == 0) || (port > MLX4_MAX_PORTS)) - return; + if (ctx) { + ctx->refcount--; + if (!ctx->refcount) { + unsigned int index = ctx->real_index; - /* IPv4 gids */ - TAILQ_FOREACH(ifa, &dev->if_addrhead, ifa_link) { - if (ifa->ifa_addr && ifa->ifa_addr->sa_family == AF_INET){ - ipv6_addr_set_v4mapped( - ((struct sockaddr_in *) ifa->ifa_addr)->sin_addr.s_addr, - (struct in6_addr *)&gid); - update_gid_table(ibdev, port, &gid, 0, 0); - } - - } -#if defined(CONFIG_IPV6) || defined(CONFIG_IPV6_MODULE) - /* IPv6 gids */ - in6_dev = in6_dev_get(dev); - if (in6_dev) { - read_lock_bh(&in6_dev->lock); - list_for_each_entry(ifp, &in6_dev->addr_list, if_list) { - pgid = (union ib_gid *)&ifp->addr; - update_gid_table(ibdev, port, pgid, 0, 0); + memcpy(&port_gid_table->gids[index].gid, &zgid, sizeof(*gid)); + kfree(port_gid_table->gids[index].ctx); + port_gid_table->gids[index].ctx = NULL; + hw_update = 1; } - read_unlock_bh(&in6_dev->lock); - in6_dev_put(in6_dev); } -#endif + } else { + for (i = 0; i < MLX4_MAX_PORT_GIDS; ++i) { + if (!memcmp(&port_gid_table->gids[i].gid, gid, sizeof(*gid))) { + found = (port_gid_table->gids[i].gid_type == attr->gid_type) ? i : -1; + if (found >= 0) + break; + } + if (findex < 0 && !memcmp(&port_gid_table->gids[i].gid, &zgid, sizeof(*gid))) + findex = i; /* HW has space */ + } + + if (found < 0) { + if (findex < 0) { + ret = -ENOSPC; + } else { + port_gid_table->gids[findex].ctx = kmalloc(sizeof(*port_gid_table->gids[findex].ctx), GFP_ATOMIC); + if (!port_gid_table->gids[findex].ctx) { + ret = -ENOMEM; + } else { + *context = port_gid_table->gids[findex].ctx; + memcpy(&port_gid_table->gids[findex].gid, gid, sizeof(*gid)); + port_gid_table->gids[findex].gid_type = attr->gid_type; + port_gid_table->gids[findex].ctx->real_index = findex; + port_gid_table->gids[findex].ctx->refcount = 1; + hw_update = 1; + } + } + } else { + struct gid_cache_context *ctx = port_gid_table->gids[found].ctx; + *context = ctx; + ctx->refcount++; + } + } + if (!ret && hw_update) { + addr_table = kmalloc(sizeof(*addr_table), GFP_ATOMIC); + if (!addr_table) { + ret = -ENOMEM; + } else { + for (i = 0; i < MLX4_MAX_PORT_GIDS; i++) { + memcpy(addr_table->addr[i].gid, + &port_gid_table->gids[i].gid, + sizeof(union ib_gid)); + addr_table->addr[i].type = ib_gid_type_to_mlx4_gid_type( + port_gid_table->gids[i].gid_type); + } + } + } + write_unlock(&iboe->iboe_lock); + + if (!ret && hw_update) { + ret = mlx4_update_roce_addr_table(ibdev->dev, port_num, addr_table, MLX4_CMD_WRAPPED); + kfree(addr_table); + } + + return ret; } -static void mlx4_set_default_gid(struct mlx4_ib_dev *ibdev, - struct net_device *dev, u8 port) +int mlx4_ib_gid_index_to_real_index(struct mlx4_ib_dev *ibdev, + u8 port_num, int index) { + struct mlx4_ib_iboe *iboe = &ibdev->iboe; + struct gid_cache_context *ctx = NULL; union ib_gid gid; - mlx4_make_default_gid(dev, &gid, port); - update_gid_table(ibdev, port, &gid, 0, 1); -} + struct mlx4_port_gid_table *port_gid_table; + int real_index = -EINVAL; + int i; + int ret; + struct ib_gid_attr attr; -static int mlx4_ib_init_gid_table(struct mlx4_ib_dev *ibdev) -{ - struct net_device *dev; + if (port_num > MLX4_MAX_PORTS) + return -EINVAL; - if (reset_gid_table(ibdev)) - return -1; + if (ib_cache_use_roce_gid_cache(&ibdev->ib_dev, port_num)) + return index; - IFNET_RLOCK_NOSLEEP(); - TAILQ_FOREACH(dev, &V_ifnet, if_link) { - u8 port = mlx4_ib_get_dev_port(dev, ibdev); - if (port) { - if (!rdma_vlan_dev_real_dev(dev) && - !netif_is_bond_master(dev)) - mlx4_set_default_gid(ibdev, dev, port); - mlx4_ib_get_dev_addr(dev, ibdev, port); - } - } + ret = ib_get_cached_gid(&ibdev->ib_dev, port_num, index, &gid, &attr); + if (ret) + return ret; - IFNET_RUNLOCK_NOSLEEP(); + if (!memcmp(&gid, &zgid, sizeof(gid))) + return -EINVAL; - return 0; + read_lock(&iboe->iboe_lock); + port_gid_table = &iboe->gid_table[port_num - 1]; + + for (i = 0; i < MLX4_MAX_PORT_GIDS; ++i) + if (!memcmp(&port_gid_table->gids[i].gid, &gid, sizeof(gid)) && + (attr.gid_type == port_gid_table->gids[i].gid_type)) { + ctx = port_gid_table->gids[i].ctx; + break; + } + if (ctx) + real_index = ctx->real_index; + read_unlock(&iboe->iboe_lock); + return real_index; } static void mlx4_ib_scan_netdevs(struct mlx4_ib_dev *ibdev, - struct net_device *dev, unsigned long event) + struct net_device *dev, + unsigned long event) + { struct mlx4_ib_iboe *iboe; + int update_qps_port = -1; int port; - int init = 0; - unsigned long flags; iboe = &ibdev->iboe; - spin_lock_irqsave(&iboe->lock, flags); + write_lock(&iboe->iboe_lock); mlx4_foreach_ib_transport_port(port, ibdev->dev) { - struct net_device *old_netdev = iboe->netdevs[port - 1]; -/* XXX BOND related */ -#if 0 - struct net_device *old_master = iboe->masters[port - 1]; -#endif - iboe->masters[port - 1] = NULL; + iboe->netdevs[port - 1] = mlx4_get_protocol_dev(ibdev->dev, MLX4_PROT_ETH, port); - - if (old_netdev != iboe->netdevs[port - 1]) - init = 1; if (dev == iboe->netdevs[port - 1] && - event == NETDEV_CHANGEADDR) - init = 1; -/* XXX BOND related */ -#if 0 - if (iboe->netdevs[port - 1] && netif_is_bond_slave(iboe->netdevs[port - 1])) - iboe->masters[port - 1] = iboe->netdevs[port - 1]->master; + (event == NETDEV_CHANGEADDR || event == NETDEV_REGISTER || + event == NETDEV_UP || event == NETDEV_CHANGE)) + update_qps_port = port; - /* if bonding is used it is possible that we add it to masters only after - IP address is assigned to the net bonding interface */ - if (old_master != iboe->masters[port - 1]) - init = 1; -#endif } - spin_unlock_irqrestore(&iboe->lock, flags); + write_unlock(&iboe->iboe_lock); - if (init) - if (mlx4_ib_init_gid_table(ibdev)) - pr_warn("Fail to reset gid table\n"); + if (update_qps_port > 0) + mlx4_ib_update_qps(ibdev, dev, update_qps_port); } -static int mlx4_ib_netdev_event(struct notifier_block *this, unsigned long event, - void *ptr) +static int mlx4_ib_netdev_event(struct notifier_block *this, + unsigned long event, void *ptr) { - struct net_device *dev = ptr; + struct net_device *dev = netdev_notifier_info_to_dev(ptr); struct mlx4_ib_dev *ibdev; - ibdev = container_of(this, struct mlx4_ib_dev, iboe.nb); + if (!net_eq(dev_net(dev), &init_net)) + return NOTIFY_DONE; + ibdev = container_of(this, struct mlx4_ib_dev, iboe.nb); mlx4_ib_scan_netdevs(ibdev, dev, event); return NOTIFY_DONE; } -/* This function initializes the gid table only if the event_netdev real device is an iboe - * device, will be invoked by the inet/inet6 events */ -static int mlx4_ib_inet_event(struct notifier_block *this, unsigned long event, - void *ptr) -{ - struct net_device *event_netdev = ptr; - struct mlx4_ib_dev *ibdev; - struct mlx4_ib_iboe *ibdev_iboe; - int port = 0; - - ibdev = container_of(this, struct mlx4_ib_dev, iboe.nb_inet); - - struct net_device *real_dev = rdma_vlan_dev_real_dev(event_netdev) ? - rdma_vlan_dev_real_dev(event_netdev) : - event_netdev; - - ibdev_iboe = &ibdev->iboe; - - port = mlx4_ib_get_dev_port(real_dev, ibdev); - - /* Perform init_gid_table if the event real_dev is the net_device which represents this port, - * otherwise this event is not related and would be ignored.*/ - if(port && (real_dev == ibdev_iboe->netdevs[port - 1])) - if (mlx4_ib_init_gid_table(ibdev)) - pr_warn("Fail to reset gid table\n"); - - return NOTIFY_DONE; -} - - static void init_pkeys(struct mlx4_ib_dev *ibdev) { int port; int slave; int i; if (mlx4_is_master(ibdev->dev)) { - for (slave = 0; slave <= ibdev->dev->num_vfs; ++slave) { + for (slave = 0; slave <= ibdev->dev->persist->num_vfs; + ++slave) { for (port = 1; port <= ibdev->dev->caps.num_ports; ++port) { for (i = 0; i < ibdev->dev->phys_caps.pkey_phys_table_len[port]; @@ -2352,24 +2850,29 @@ ibdev->ib_dev.req_notify_cq = mlx4_ib_arm_cq; ibdev->ib_dev.get_dma_mr = mlx4_ib_get_dma_mr; ibdev->ib_dev.reg_user_mr = mlx4_ib_reg_user_mr; + ibdev->ib_dev.rereg_user_mr = mlx4_ib_rereg_user_mr; ibdev->ib_dev.dereg_mr = mlx4_ib_dereg_mr; + ibdev->ib_dev.query_values = mlx4_ib_query_values; ibdev->ib_dev.alloc_fast_reg_mr = mlx4_ib_alloc_fast_reg_mr; + ibdev->ib_dev.ioctl = mlx4_ib_ioctl; ibdev->ib_dev.alloc_fast_reg_page_list = mlx4_ib_alloc_fast_reg_page_list; ibdev->ib_dev.free_fast_reg_page_list = mlx4_ib_free_fast_reg_page_list; ibdev->ib_dev.attach_mcast = mlx4_ib_mcg_attach; ibdev->ib_dev.detach_mcast = mlx4_ib_mcg_detach; ibdev->ib_dev.process_mad = mlx4_ib_process_mad; - ibdev->ib_dev.ioctl = mlx4_ib_ioctl; - ibdev->ib_dev.query_values = mlx4_ib_query_values; + ibdev->ib_dev.get_netdev = mlx4_ib_get_netdev; + ibdev->ib_dev.modify_gid = mlx4_ib_modify_gid; + ibdev->ib_dev.disassociate_ucontext = mlx4_ib_disassociate_ucontext; if (!mlx4_is_slave(ibdev->dev)) { ibdev->ib_dev.alloc_fmr = mlx4_ib_fmr_alloc; ibdev->ib_dev.map_phys_fmr = mlx4_ib_map_phys_fmr; ibdev->ib_dev.unmap_fmr = mlx4_ib_unmap_fmr; ibdev->ib_dev.dealloc_fmr = mlx4_ib_fmr_dealloc; } - if (dev->caps.flags & MLX4_DEV_CAP_FLAG_MEM_WINDOW) { + if (dev->caps.flags & MLX4_DEV_CAP_FLAG_MEM_WINDOW || + dev->caps.bmme_flags & MLX4_BMME_FLAG_TYPE_2_WIN) { ibdev->ib_dev.alloc_mw = mlx4_ib_alloc_mw; ibdev->ib_dev.bind_mw = mlx4_ib_bind_mw; ibdev->ib_dev.dealloc_mw = mlx4_ib_dealloc_mw; --Apple-Mail=_81524E70-C381-42F8-AEB2-30266F029757 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 |Index: sys/ofed/drivers/infiniband/hw/mlx4/main.c |=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D |--- sys/ofed/drivers/infiniband/hw/mlx4/main.c |+++ sys/ofed/drivers/infiniband/hw/mlx4/main.c -------------------------- Patching file sys/ofed/drivers/infiniband/hw/mlx4/main.c using Plan A... Hunk #1 succeeded at 34. Hunk #2 succeeded at 62. Hunk #3 succeeded at 109. Hunk #4 succeeded at 123. Hunk #5 succeeded at 136. Hunk #6 succeeded at 150. Hunk #7 succeeded at 198. Hunk #8 succeeded at 212. Hunk #9 succeeded at 232. Hunk #10 succeeded at 282. Hunk #11 succeeded at 407. Hunk #12 succeeded at 420. Hunk #13 succeeded at 557. Hunk #14 succeeded at 699. Hunk #15 succeeded at 708. Hunk #16 succeeded at 780. Hunk #17 succeeded at 801. Hunk #18 succeeded at 811. Hunk #19 succeeded at 823. Hunk #20 succeeded at 843. Hunk #21 succeeded at 1040. Hunk #22 succeeded at 1236. Hunk #23 succeeded at 1262. Hunk #24 succeeded at 1394. Hunk #25 succeeded at 1437. Hunk #26 succeeded at 1463. Hunk #27 succeeded at 1478. Hunk #28 succeeded at 1778. Hunk #29 succeeded at 1842. Hunk #30 succeeded at 1954. Hunk #31 succeeded at 1965. Hunk #32 succeeded at 2039. Hunk #33 succeeded at 2071. Hunk #34 succeeded at 2123. Hunk #35 failed at 2144. Hunk #36 succeeded at 2464 (offset 6 lines). Hunk #37 succeeded at 2703 (offset 6 lines). Hunk #38 succeeded at 2723 (offset 6 lines). Hunk #39 succeeded at 2743 (offset 6 lines). Hunk #40 succeeded at 2765 (offset 6 lines). Hunk #41 succeeded at 2793 (offset 6 lines). Hunk #42 failed at 2850. Hunk #43 succeeded at 2889 (offset 1 line). Hunk #44 succeeded at 2972 (offset 6 lines). Hunk #45 succeeded at 3045 (offset 1 line). Hunk #46 succeeded at 3070 (offset 6 lines). Hunk #47 succeeded at 3112 (offset 1 line). Hunk #48 succeeded at 3147 (offset 6 lines). Hunk #49 succeeded at 3181 (offset 1 line). Hunk #50 succeeded at 3224 (offset 6 lines). Hunk #51 succeeded at 3248 (offset 1 line). Hunk #52 succeeded at 3265 (offset 6 lines). Hunk #53 succeeded at 3412 (offset 1 line). Hunk #54 succeeded at 3438 (offset 6 lines). Hunk #55 succeeded at 3477 (offset 1 line). Hunk #56 succeeded at 3516 (offset 6 lines). Hunk #57 succeeded at 3532 (offset 1 line). Hunk #58 succeeded at 3553 (offset 6 lines). 2 out of 58 hunks failed--saving rejects to = sys/ofed/drivers/infiniband/hw/mlx4/main.c.rej - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz Mobile: 408.368.3725 > On Apr 23, 2016, at 11:36 AM, Hans Petter Selasky = wrote: >=20 > On 04/23/16 10:26, Hans Petter Selasky wrote: >> On 04/23/16 01:08, David P. Discher wrote: >>> Hans and Chris - >>>=20 >>> Any chance of getting an updated diff for the OFED 3.2 patches? I >>> love to see if I can reproduce Chris=E2=80=99s IPOIB performance. I = got a >>> couple MT25208 InfiniHost III Ex I=E2=80=99d like to start using. >>>=20 >>> I grabbed the D5790-9 freebsd reviews diffs, and attempted to = applied >>> to -head at r298494 : >>>=20 >>>=20 >>=20 >> Yes, I'll update the patchset later today. It is broken because of = some >> changes I pushed upstream. >>=20 >> --HPS >=20 > Hi, >=20 > You'll need to refetch D5790, D5791 and D5797. Let me know if = something still doesn't apply cleanly. >=20 > --HPS >=20 --Apple-Mail=_81524E70-C381-42F8-AEB2-30266F029757-- --Apple-Mail=_11D7EE31-E231-4C64-801D-5222CD654299 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJXG8m3AAoJEEmwU6XuhYWOxnsH/AxEg1mbkj520ohLRgUKNmt4 43MpR9E0paJ7VS/F9/PyvXI4kDcjdfyHZt2GwAAQYmhw8XSNbMpSPWJaKiNOqess 7Bo3SSIpiegh7tdDjKTbdujr/4CwXF7QHvtmuBZw7Q3DlvchM0SwuHdDL68SMuLb 9gv8+r7ma7k1xyLPrEstCrNNwWUAuN+PUZl6rqulsj+nszxYhU68m6rA5hmiMJaO F+FVACNBWzOS2zoGVUXcILVA6kYmR62E+2Oaf2T9sTjrs868h4DikDA7vmd7IOlu oVXpLPO7ve+amt8z8MnUIEYOdhGqlAuyrTe4jv7RPL5F0MmfZh6u2338AU5wgSo= =lVGe -----END PGP SIGNATURE----- --Apple-Mail=_11D7EE31-E231-4C64-801D-5222CD654299-- From owner-freebsd-infiniband@freebsd.org Sat Apr 23 20:22:15 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B533B1A0E2 for ; Sat, 23 Apr 2016 20:22:15 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 40FFD1B4A for ; Sat, 23 Apr 2016 20:22:15 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1au448-0008BT-Cp; Sat, 23 Apr 2016 20:22:11 +0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Request updated/unified patch for OFED v3.2 update From: Justin Clift In-Reply-To: <571BC0A6.9070100@selasky.org> Date: Sat, 23 Apr 2016 21:22:05 +0100 Cc: "David P. Discher" , freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 20:22:15 -0000 On 23 Apr 2016, at 19:36, Hans Petter Selasky wrote: > On 04/23/16 10:26, Hans Petter Selasky wrote: >> On 04/23/16 01:08, David P. Discher wrote: >>> Hans and Chris - >>>=20 >>> Any chance of getting an updated diff for the OFED 3.2 patches? I >>> love to see if I can reproduce Chris=92s IPOIB performance. I got a >>> couple MT25208 InfiniHost III Ex I=92d like to start using. >>>=20 >>> I grabbed the D5790-9 freebsd reviews diffs, and attempted to = applied >>> to -head at r298494 : >>>=20 >>>=20 >>=20 >> Yes, I'll update the patchset later today. It is broken because of = some >> changes I pushed upstream. >>=20 >> --HPS >=20 > Hi, >=20 > You'll need to refetch D5790, D5791 and D5797. Let me know if = something still doesn't apply cleanly. For the archives, which revision is that against? :) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Sat Apr 23 20:37:26 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D0A25B1A6CF for ; Sat, 23 Apr 2016 20:37:26 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A8F4A1747 for ; Sat, 23 Apr 2016 20:37:26 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: by mail-pa0-x233.google.com with SMTP id er2so50127382pad.3 for ; Sat, 23 Apr 2016 13:37:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=kcXHBpmb9d+o2UOeGUFgUYPUnj/mKxacxFTPeMuGpHE=; b=GoKTnLrOq39UHaAxSErMIOfdM75jEyhZqLR3DmJH5T25UoIPoodo1/WvKHIUiyHavc GbTazJMhOIEQXByJS1MTlauUCZFvP/3TANHeNd3PHqHWaQoJ6wrelJ0wsvppedchJNlI +lKUg+eeZWMOlDfOaQidXbFwt3j482vX4xQc8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=kcXHBpmb9d+o2UOeGUFgUYPUnj/mKxacxFTPeMuGpHE=; b=mdlEoxAbRaUYJzia4tFajgNclfxVclisD2AgCg3dbLod+i0RmjHc+7nBc4uV+tg6x4 iHy+meq+e6PqNcg1bHDt8YI9jIOwlJgvBbby8IcnYvlIODQ38edEnXfN5Jj2r4IYeDo6 laZoJITSEBtt31B1N9jk/m7IS+mmzjeqLLvf18dky9MOZHMxIXlW8mOmA/3sGRYRAzJl T1/6Ge+zSziccGNsVbJRRCxyYA3wL5XU0T02eeepGv8ejk2RuXBUJrLYaWrGDJf4Q2fl X9W8nxBKNyFhYPFtnxO+3Pp5Bsbmiod6XfuGwH/1P0tgtcNr+UE7zRGGtWuzjvU6z6AY O84w== X-Gm-Message-State: AOPr4FWLMqSxj7rpE19U1XhtqqsPkxeWs5HVviUXry3Bar9y8r/ERhpqGBphc5tgH1r1sA== X-Received: by 10.66.123.105 with SMTP id lz9mr37868032pab.37.1461443846126; Sat, 23 Apr 2016 13:37:26 -0700 (PDT) Received: from [192.168.1.248] (173-13-188-45-sfba.hfc.comcastbusiness.net. [173.13.188.45]) by smtp.gmail.com with ESMTPSA id j62sm17227189pfb.15.2016.04.23.13.37.24 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 23 Apr 2016 13:37:24 -0700 (PDT) Subject: Re: Request updated/unified patch for OFED v3.2 update Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_94E23D1F-FDA2-433F-A44B-16090EBFCDD3"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: "David P. Discher" In-Reply-To: <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> Date: Sat, 23 Apr 2016 13:37:22 -0700 Cc: Hans Petter Selasky , freebsd-infiniband@freebsd.org Message-Id: <2D8BFA01-78F2-4F48-A003-4DC6A80FC192@dpdtech.com> References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> To: Justin Clift X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 20:37:26 -0000 --Apple-Mail=_94E23D1F-FDA2-433F-A44B-16090EBFCDD3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 I=92ve tried it against r298518 (today-ish) =85 and r298494 = (yesterday-ish), and the results where in the same files. Note, I=92m guessing one patch builds on another .. = sys/ofed/include/rdma/ib_verbs.h will also fail in =97dry-run. - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz Mobile: 408.368.3725 > On Apr 23, 2016, at 1:22 PM, Justin Clift = wrote: >=20 > On 23 Apr 2016, at 19:36, Hans Petter Selasky wrote: >> On 04/23/16 10:26, Hans Petter Selasky wrote: >>> On 04/23/16 01:08, David P. Discher wrote: >>>> Hans and Chris - >>>>=20 >>>> Any chance of getting an updated diff for the OFED 3.2 patches? I >>>> love to see if I can reproduce Chris=92s IPOIB performance. I got = a >>>> couple MT25208 InfiniHost III Ex I=92d like to start using. >>>>=20 >>>> I grabbed the D5790-9 freebsd reviews diffs, and attempted to = applied >>>> to -head at r298494 : >>>>=20 >>>>=20 >>>=20 >>> Yes, I'll update the patchset later today. It is broken because of = some >>> changes I pushed upstream. >>>=20 >>> --HPS >>=20 >> Hi, >>=20 >> You'll need to refetch D5790, D5791 and D5797. Let me know if = something still doesn't apply cleanly. >=20 > For the archives, which revision is that against? :) >=20 > + Justin >=20 > -- > "My grandfather once told me that there are two kinds of people: those > who work and those who take the credit. He told me to try to be in the > first group; there was less competition there." > - Indira Gandhi >=20 --Apple-Mail=_94E23D1F-FDA2-433F-A44B-16090EBFCDD3 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJXG90DAAoJEEmwU6XuhYWOq94H/jrQ7EzCYXJoucl3TpnFtC7+ Wvd62fmBoiHZjduB9jIoqAIenu+J/PoVKWixrD68K2i4w9n2hb55W2kL2+fZINoj 7+fADFsZmWFVeNG193EQnEpsZB2unhqKRq3e0o+O7HQ8Ho86/4S0tzwOTDfkhMDF nI9wAFBil0TEyXy8UZse4brH/7OUah8BaNmDTNK8z6chmia/jlntIJMdVIIHrnus gQuP9A8cQdFG/svOFBZhn6ERj9gk1X/O94Fee0OU6KyEU9Ul6uNTJHYrgAGRAHh8 k7iJf1Zuyu3nZzlCvL/9O5Q/kiSSmcdvZq4Y+5JVk5BzUGSrsVnwhYxTdQ2LfKo= =8VCl -----END PGP SIGNATURE----- --Apple-Mail=_94E23D1F-FDA2-433F-A44B-16090EBFCDD3-- From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:06:55 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B1E3B1AFE1 for ; Sat, 23 Apr 2016 21:06:55 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (mail.turbocat.net [IPv6:2a01:4f8:d16:4514::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 273D41DE4 for ; Sat, 23 Apr 2016 21:06:55 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 2A00F1FE024; Sat, 23 Apr 2016 23:06:52 +0200 (CEST) Subject: Re: Request updated/unified patch for OFED v3.2 update To: "David P. Discher" , Justin Clift References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> <2D8BFA01-78F2-4F48-A003-4DC6A80FC192@dpdtech.com> Cc: freebsd-infiniband@freebsd.org From: Hans Petter Selasky Message-ID: <571BE4B0.8020201@selasky.org> Date: Sat, 23 Apr 2016 23:10:08 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <2D8BFA01-78F2-4F48-A003-4DC6A80FC192@dpdtech.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:06:55 -0000 On 04/23/16 22:37, David P. Discher wrote: > I’ve tried it against r298518 (today-ish) … and r298494 (yesterday-ish), and the results where in the same files. > > Note, I’m guessing one patch builds on another .. sys/ofed/include/rdma/ib_verbs.h will also fail in —dry-run. > Try to refetch D5796 aswell. Just updated it. --HPS From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:11:41 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0722BB1A0DD for ; Sat, 23 Apr 2016 21:11:41 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B8B2F1F9A for ; Sat, 23 Apr 2016 21:11:40 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 78B351FE024; Sat, 23 Apr 2016 23:11:37 +0200 (CEST) Subject: Re: Request updated/unified patch for OFED v3.2 update To: Justin Clift References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> Cc: "David P. Discher" , freebsd-infiniband@freebsd.org From: Hans Petter Selasky Message-ID: <571BE5CD.2050401@selasky.org> Date: Sat, 23 Apr 2016 23:14:53 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:11:41 -0000 On 04/23/16 22:22, Justin Clift wrote: > For the archives, which revision is that against? Hi, The latest set of patches should apply cleanly to the latest 11-current: r298482 I try to save some churn by only updating the differential reviews that have changed, but apparently I missed some. 10x work for each update :-) --HPS From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:11:45 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EC70B1A0F2 for ; Sat, 23 Apr 2016 21:11:45 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0387A1FB5 for ; Sat, 23 Apr 2016 21:11:44 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=[172.16.1.14]) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1au4q3-0000rB-Mf; Sat, 23 Apr 2016 21:11:42 +0000 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Request updated/unified patch for OFED v3.2 update From: Justin Clift In-Reply-To: <571BE4B0.8020201@selasky.org> Date: Sat, 23 Apr 2016 22:11:37 +0100 Cc: "David P. Discher" , freebsd-infiniband@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <75D8FBD6-55D1-485D-ADF9-823098FEF482@postgresql.org> References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> <2D8BFA01-78F2-4F48-A003-4DC6A80FC192@dpdtech.com> <571BE4B0.8020201@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.1878.6) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:11:45 -0000 On 23 Apr 2016, at 22:10, Hans Petter Selasky wrote: > On 04/23/16 22:37, David P. Discher wrote: >> I=92ve tried it against r298518 (today-ish) =85 and r298494 = (yesterday-ish), and the results where in the same files. >>=20 >> Note, I=92m guessing one patch builds on another .. = sys/ofed/include/rdma/ib_verbs.h will also fail in =97dry-run. >=20 > Try to refetch D5796 aswell. Just updated it. I'll probably give it a shot on Mon or Tuesday. Neck deep in trying to get Infiniband working on FreeNAS at the moment instead. ;) Ordered some new ConnectX-2 (40Gb/s) cards from eBay today, and a small quantity of fast storage (Samsung SM951). That should all turn up = Monday, and might allow for reasonable throughput testing. Unlike my current storage (spinning rust based). ;) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:40:55 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A432B1A605 for ; Sat, 23 Apr 2016 21:40:55 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: from mail-pa0-x235.google.com (mail-pa0-x235.google.com [IPv6:2607:f8b0:400e:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7316D1AE7 for ; Sat, 23 Apr 2016 21:40:55 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: by mail-pa0-x235.google.com with SMTP id r5so45489326pag.1 for ; Sat, 23 Apr 2016 14:40:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=kVaWCcCmS0kWegbEARbk1B2zrd4gcukTbO1QVO/HUzQ=; b=OmM51EUiwU6MiVmt9BrTmBobVCDRenm0nLFvunJOK4cvIytDx27CVqll8zzdNIqs4s SSNVHobo+bRd0WG7rnCAxWvrEiY10j3ipS/AR364yWVw7Xe4tM6S8oABuwE7fqyWbYxe sn7ND4Xs+ckGguTUG84tXrRuR+5hOMmVM1pvY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=kVaWCcCmS0kWegbEARbk1B2zrd4gcukTbO1QVO/HUzQ=; b=fSXIB881olJTu0THjOZKgaNdKPYGrWfwwRc70qt0YYkRhN8EjhT7eUmzhVEakVSHXP ENdl1W06VL3WYk3/h/+Sxx4AjTd7awt4kIAIH/DRsXavJ9LUdlfmuFUfE/ar624EWfwf OhExKmU1B1Lr5t0d1sBMExV/m+ZPP9xhl654KPopwMV5bqOEWFGGJAh+g1vFDXuVcILo LBTjM/K6f7WhU15nAME8ZuUoaKmXMsIqR5lqoB/Ec1YFK9WbvFTvKuaAtbnOqeFFHmOz kxsxQbs2M+G4nGKEfO4NcbmmdfrwKUVgFn8T/JGf/vza/PeQfBaM6SzRkIQHwKIMDy5w gKNg== X-Gm-Message-State: AOPr4FUn/4lBbpSQhtwlH7wfaZIieE/CMiDxRNoowEY/LOTKNoRedIO/TT0deC4fdGvZhw== X-Received: by 10.66.148.42 with SMTP id tp10mr274660pab.159.1461447654756; Sat, 23 Apr 2016 14:40:54 -0700 (PDT) Received: from [192.168.1.248] (173-13-188-45-sfba.hfc.comcastbusiness.net. [173.13.188.45]) by smtp.gmail.com with ESMTPSA id y27sm17374680pfi.11.2016.04.23.14.40.52 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 23 Apr 2016 14:40:53 -0700 (PDT) Subject: Re: Request updated/unified patch for OFED v3.2 update Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_D3F14B2D-3CE7-4BCD-8046-7DCF04B7D96F"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: "David P. Discher" In-Reply-To: <571BE5CD.2050401@selasky.org> Date: Sat, 23 Apr 2016 14:40:51 -0700 Cc: Justin Clift , freebsd-infiniband@freebsd.org Message-Id: <4F7D00E4-C784-4CDB-B058-F3F24B1B2F06@dpdtech.com> References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> <571BE5CD.2050401@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:40:55 -0000 --Apple-Mail=_D3F14B2D-3CE7-4BCD-8046-7DCF04B7D96F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 I had to refresh all the patches, and they finally applied cleanly =85 = however make failed: make: "/usr/src/share/mk/src.libnames.mk" line 560: /usr/src: Missing = or incorrect value for LIBMLX5DIR in src.libnames.mk: = contrib/ofed/usr.lib/libmlx5 It looks like "contrib/ofed/usr.lib/libmlx5=94 is completely missing. Tried to remove libmlx5 (since I don=92t have a mlx5 card) from the make = files, but seems to all over the place. - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz Mobile: 408.368.3725 > On Apr 23, 2016, at 2:14 PM, Hans Petter Selasky = wrote: >=20 > On 04/23/16 22:22, Justin Clift wrote: >> For the archives, which revision is that against? >=20 > Hi, >=20 > The latest set of patches should apply cleanly to the latest = 11-current: >=20 > r298482 >=20 > I try to save some churn by only updating the differential reviews = that have changed, but apparently I missed some. 10x work for each = update :-) >=20 > --HPS --Apple-Mail=_D3F14B2D-3CE7-4BCD-8046-7DCF04B7D96F Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJXG+vjAAoJEEmwU6XuhYWO6XwH/1QgMRbAtNfcF+pMwDjNwZyl 6nlhOB7LqSpXbzlHMYgdq7DnedAA7lBoB9VJ2Z6BVDAbspK1N6V9paaWo71H8POe eGBD1wSyBLAzvMvBegMJAgSNzXF1FZZMP9AuJMHy8UoX7pCTUxssb7dcDCBoH3sL WFxaak5hS5DZxsqKxoEIDR+kLt/5C3TOemwDWsQjgpfwBKXX3mJtuVfQJZ96uNsk Hh9Rix9gEABsbkJT6bz1bh5mR2mSVdv1orY33WnCI0ILxzJEBm7tfL0GHeT1guCo 8IhqVT09iIMvjL0JmyU0zMMkbFp0FlsuZmM875efyiCO52bhVkUOPIEKRnQaSNU= =fka2 -----END PGP SIGNATURE----- --Apple-Mail=_D3F14B2D-3CE7-4BCD-8046-7DCF04B7D96F-- From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:49:29 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0412B1A83D for ; Sat, 23 Apr 2016 21:49:29 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B89631E4F for ; Sat, 23 Apr 2016 21:49:29 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 0FD271FE024; Sat, 23 Apr 2016 23:49:27 +0200 (CEST) Subject: Re: Request updated/unified patch for OFED v3.2 update To: "David P. Discher" References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> <571BE5CD.2050401@selasky.org> <4F7D00E4-C784-4CDB-B058-F3F24B1B2F06@dpdtech.com> Cc: Justin Clift , freebsd-infiniband@freebsd.org From: Hans Petter Selasky Message-ID: <571BEEAB.4040602@selasky.org> Date: Sat, 23 Apr 2016 23:52:43 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <4F7D00E4-C784-4CDB-B058-F3F24B1B2F06@dpdtech.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:49:30 -0000 On 04/23/16 23:40, David P. Discher wrote: > I had to refresh all the patches, and they finally applied cleanly … however make failed: > > make: "/usr/src/share/mk/src.libnames.mk" line 560: /usr/src: Missing or incorrect value for LIBMLX5DIR in src.libnames.mk: contrib/ofed/usr.lib/libmlx5 > > It looks like "contrib/ofed/usr.lib/libmlx5” is completely missing. > > Tried to remove libmlx5 (since I don’t have a mlx5 card) from the make files, but seems to all over the place. > I think you maybe need to create that directory before applying the patches. --HPS From owner-freebsd-infiniband@freebsd.org Sat Apr 23 21:51:23 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EF21B1A9B6 for ; Sat, 23 Apr 2016 21:51:23 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: from mail-pa0-x235.google.com (mail-pa0-x235.google.com [IPv6:2607:f8b0:400e:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0DBBB1022 for ; Sat, 23 Apr 2016 21:51:23 +0000 (UTC) (envelope-from dpd@dpdtech.com) Received: by mail-pa0-x235.google.com with SMTP id zm5so50502629pac.0 for ; Sat, 23 Apr 2016 14:51:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dpdtech.com; s=google; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=6Le3yPvlfVy5yXY4RyO+jcZR4IlTCkAhvdRbHj2cWok=; b=CAmBZXisYuCkFO43XimQQlzv57M9GK72mKvMRuIp+xaMhf/qdX1vjxyEigjqgv61Hy JiScBaBvqzb7M26gZQzmPxhK5vBoLuMJwUNl/bx+FKd+17b21qA9z/EsYIHwtRJQv3VE FtdDfr4NV2HweFoowCJPxt5JY/EEibo/ejbmQ= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=6Le3yPvlfVy5yXY4RyO+jcZR4IlTCkAhvdRbHj2cWok=; b=XckQlYNCygGaM9kU5srZYLvwKQtfvx0z60WTZd8N/FLiovCMtjLj4B3omvyW9WIzBx +Gv02F4d0LSVtzD76MnnkOchHLgj7qFHgW9Mv9Y+uudOWalTYAnpDalnZNUGlwQFdPd7 6JHL38NPTJ2deqy2vmuAjgc3xK8cw3o/B+ny2X+tazn0ucrQy1qdPap7IOJZGAYeUSKR AZf5iL9M5ayRAXKapDLvj/Fbi8SbNBeZnPADt00zCVolFXMY71mi6yU/9YUqZjqHJHtj o8DoFo32EoKpMsPIMSeM5fmMgCgYta3KoWbB45NHDwX3CirC6zozj5RRaiRw9dDMfNyb HTKA== X-Gm-Message-State: AOPr4FVVbLywRG1yN09yIOq6ia+7rt9Mw7jZoQ+3F0HsKKO6rojiLo5Ci6lBLkui9lhSFQ== X-Received: by 10.66.78.73 with SMTP id z9mr37890885paw.4.1461448282744; Sat, 23 Apr 2016 14:51:22 -0700 (PDT) Received: from [192.168.1.248] (173-13-188-45-sfba.hfc.comcastbusiness.net. [173.13.188.45]) by smtp.gmail.com with ESMTPSA id b19sm8375455pfj.41.2016.04.23.14.51.20 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 23 Apr 2016 14:51:21 -0700 (PDT) Subject: Re: Request updated/unified patch for OFED v3.2 update Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_9EDB9EE8-2748-41D0-A6A2-DB123CF33AAF"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: "David P. Discher" In-Reply-To: <571BEEAB.4040602@selasky.org> Date: Sat, 23 Apr 2016 14:51:19 -0700 Cc: Justin Clift , freebsd-infiniband@freebsd.org Message-Id: References: <571B31B6.4070206@selasky.org> <571BC0A6.9070100@selasky.org> <207113AF-4D33-4DD6-8A69-DD9ABD48DB8F@postgresql.org> <571BE5CD.2050401@selasky.org> <4F7D00E4-C784-4CDB-B058-F3F24B1B2F06@dpdtech.com> <571BEEAB.4040602@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2016 21:51:23 -0000 --Apple-Mail=_9EDB9EE8-2748-41D0-A6A2-DB123CF33AAF Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 yup. That fixed it =85 compiling now. Thanks ! - David P. Discher http://davidpdischer.com/ AIM: DavidDPD | Y!M: daviddpdz Mobile: 408.368.3725 > On Apr 23, 2016, at 2:52 PM, Hans Petter Selasky = wrote: >=20 > On 04/23/16 23:40, David P. Discher wrote: >> I had to refresh all the patches, and they finally applied cleanly =85 = however make failed: >>=20 >> make: "/usr/src/share/mk/src.libnames.mk" line 560: /usr/src: = Missing or incorrect value for LIBMLX5DIR in src.libnames.mk: = contrib/ofed/usr.lib/libmlx5 >>=20 >> It looks like "contrib/ofed/usr.lib/libmlx5=94 is completely missing. >>=20 >> Tried to remove libmlx5 (since I don=92t have a mlx5 card) from the = make files, but seems to all over the place. >>=20 >=20 > I think you maybe need to create that directory before applying the = patches. >=20 > --HPS >=20 --Apple-Mail=_9EDB9EE8-2748-41D0-A6A2-DB123CF33AAF Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJXG+5YAAoJEEmwU6XuhYWOyOMIAKIWuKvzC0oudhdG1vIqZ6fl Z3dXxD/baWnvipUGpqK5UYvp1wP4XRgRTpGgl9qLMUpP4Tcss2rVOTKhiraAQrmB 3LvijEEjcaRWI7Xbnc8p+j3WCrcI5uwizho+4sgd93Hm/mucuOQ/cJsr2+gAUhed X5Ze5OZtdVvw/yDIVFDcc/rHp5e/hMn+n68ZJWk7I+80kSrh/M8q7cg3W8RUbmhL YAN7Kr+JQTMbAYKoKNT9TqqR66DzmrNnmPqb1Kx/t2z/OH/dewt/4LL9WuMQaAcY gsDT0PtjiPcM53G4zI0YQTMn0OKwnciFf2vY3z4AfFjCsHevuVff9LCDTo89QRo= =qO+X -----END PGP SIGNATURE----- --Apple-Mail=_9EDB9EE8-2748-41D0-A6A2-DB123CF33AAF--