From owner-freebsd-infiniband@freebsd.org Wed Jul 27 16:13:44 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 115DCBA6A55 for ; Wed, 27 Jul 2016 16:13:44 +0000 (UTC) (envelope-from ferrao@vmio.com.br) Received: from na01-bl2-obe.outbound.protection.outlook.com (mail-bl2on0122.outbound.protection.outlook.com [65.55.169.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9EC281EB1 for ; Wed, 27 Jul 2016 16:13:41 +0000 (UTC) (envelope-from ferrao@vmio.com.br) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vmio.onmicrosoft.com; s=selector1-vmio-com-br; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=HNrpuxbjrp6v8sMsOhuRiNCS2Bu4eOCoL4WJmPVhu1E=; b=HvTDFyPvfUK1Wty+L643qhRuv7rtr6Pl9ZdNIzMBU14MXb/5O/uxMCUgwK/Lwede0Wwwoni8DzP7vy1G/aCsEYvfhyoF646Uku6hDfdCE17eOJwH6fbRttW5uPvB3yiOb+fNe8cIPWRDw/wCsQu3VULX+h2hYcFWRO9GLk0pHsU= Received: from FR1PR80MB1586.lamprd80.prod.outlook.com (10.167.137.156) by FR1PR80MB1585.lamprd80.prod.outlook.com (10.167.137.155) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Wed, 27 Jul 2016 14:40:17 +0000 Received: from FR1PR80MB1586.lamprd80.prod.outlook.com ([10.167.137.156]) by FR1PR80MB1586.lamprd80.prod.outlook.com ([10.167.137.156]) with mapi id 15.01.0549.016; Wed, 27 Jul 2016 14:40:17 +0000 From: =?Windows-1252?Q?Vin=EDcius_Ferr=E3o?= To: Justin Clift CC: Jason Bacon , Hans Petter Selasky , "freebsd-infiniband@freebsd.org" Subject: Re: QLogic IBA7322 QDR InfiniBand HCA on 10.3-RELEASE Thread-Topic: QLogic IBA7322 QDR InfiniBand HCA on 10.3-RELEASE Thread-Index: AQHRorV+11NfAipR3UCzeQp43nQb5p+iOcQAgAAevYCAAAq9gIAAFYiAgIprZIA= Date: Wed, 27 Jul 2016 14:40:16 +0000 Message-ID: <51C155D2-8BB4-4749-BA10-60496C7D191E@vmio.com.br> References: <1E132EAE-8287-4407-BBBD-25319FB0091C@vmio.com.br> <5724759A.1090805@selasky.org> <57249865.9060301@gmail.com> <001FE6A2-112B-40B2-BC38-C19A57012EA7@postgresql.org> In-Reply-To: <001FE6A2-112B-40B2-BC38-C19A57012EA7@postgresql.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=ferrao@vmio.com.br; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [200.204.163.103] x-ms-office365-filtering-correlation-id: 731ddabd-9ab7-4ad2-dc02-08d3b62bed4d x-microsoft-exchange-diagnostics: 1; FR1PR80MB1585; 6:otEN8laVUcTS3ngeX3Hn6QiMToXaXQ/VqACLnooGv1RyMLOrD7IF5ZJ9IFWrcozucOfKZ9XbwYfLOMwiiusU2ICI+OjLVNq5pzl4SdcPMtGS1+u9yuhk/RhpgpjhNx01ONRxoQH0q/oCQf54GSjqdcUWq6i1jIlvhlTMP2JwVPC2LOOeQ/yVMD7rCwN7/gAoKA3iDEmmurkbfrXP1zL9lU9mydAkEnKJYmCGs+ZWKhNQaFpZp/tzTSyobwj923yzPLObEDpW39sKZVVRb/4pfjgMAh7hxoSXHGeHmEY+yDBbrJO8D6LVZj7V9M1bhSW8; 5:HSK+bzGciF2Ol8jZ0k2NE+Zea5ae3N5N4h5jtNO++o4APEz01+gPHU5QSfVfHekyrRjw44kCTDMZJnem/O5J0sFafKXOFmA0JkTq7lO8VRtrv/u9DHXqZcn2Ip2rgTi8sXDECgAiVDqyOEBh2wV7PA==; 24:s4B+xUe+X/4kOaSnrQ0QNmKBicb5wLDkqzA6rXMgoi0C4QiNhFGkyfODCs/kuLOCW/cCumRvvbbmzr5S5Lnu9WYWwFHPa9INQgnZBNGOOAk=; 7:viuLIkcKK3WYzDmnXk82rcXr3YNWWe6A3jwtSbWzEp5TMeKO+ePmRoLwN4EKtY0Rs6NDXd7ui86XsjP77TktZ0pQuFEIIuM+2WLaoJG0gl08+Icq9wOVFPu6HDMSomjTtwkkLs7U3RzfgCBq74XriCeefrqRAFEbeCIRCePMghgsv2KEeXYZTtvQm2Li4t1gmUm9cBLqwmHgd5qFhUcd5JeKcAhR6tcb05LdN3Mew29UNq1SBeQcSYdGxbHmxaK7 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:FR1PR80MB1585; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040130)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6041072)(6042046)(6043046); SRVR:FR1PR80MB1585; BCL:0; PCL:0; RULEID:; SRVR:FR1PR80MB1585; x-forefront-prvs: 0016DEFF96 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(7916002)(199003)(189002)(24454002)(51874003)(93886004)(3846002)(82746002)(122556002)(19580395003)(2906002)(19580405001)(74482002)(50986999)(54356999)(586003)(76176999)(10400500002)(105586002)(4326007)(6116002)(101416001)(102836003)(66066001)(8936002)(8676002)(92566002)(3280700002)(81166006)(16236675004)(2900100001)(7906003)(7846002)(77096005)(36756003)(86362001)(575784001)(15975445007)(106116001)(189998001)(81156014)(2950100001)(106356001)(33656002)(7736002)(110136002)(5002640100001)(3660700001)(83716003)(19617315012)(11100500001)(68736007)(97736004)(87936001)(104396002); DIR:OUT; SFP:1102; SCL:1; SRVR:FR1PR80MB1585; H:FR1PR80MB1586.lamprd80.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:0; MX:1; LANG:en; received-spf: None (protection.outlook.com: vmio.com.br does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: vmio.com.br X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Jul 2016 14:40:16.5659 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3da02919-4b9d-42af-a7f7-a5975700d7c4 X-MS-Exchange-Transport-CrossTenantHeadersStamped: FR1PR80MB1585 Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jul 2016 16:13:44 -0000 Hello, Just updating the thread. I finally get my hands on the board. It=92s a QLogic QLE7340 model. It appears to be completely unsupported as t= oday. The board is exactly this: https://www.etb-tech.com/qlogic-qle7340-40gb-sin= gle-port-infiniband-to-pci-e-hba-jkmx6.html V. On Apr 30, 2016, at 09:52, Justin Clift > wrote: On 30 Apr 2016, at 12:35, Jason Bacon > wrote: On 04/30/16 05:56, Justin Clift wrote: On 30 Apr 2016, at 10:06, Hans Petter Selasky > wrote: On 04/30/16 09:54, Vin=EDcius Ferr=E3o wrote: Hello guys, I=92m playing with Inifinband for the first time on FreeBSD and I already h= ave problems with it. I=92ve got a machine with this card in specific and I= =92m trying to use this card without any success. pciconf -lv outputs this: root@freebsd1:~ # pciconf -lv | grep -i Qlogic -A3 -B1 none17@pci0:2:0:0: class=3D0x0c0600 card=3D0x73221077 chip=3D0x73221077 rev= =3D0x02 hdr=3D0x00 vendor =3D 'QLogic Corp.' device =3D 'IBA7322 QDR InfiniBand HCA' class =3D serial bus So at least the system is aware of the card, but I can=92t see it on dmesg,= so something is missing. Drivers? Support? Kernel Module? I came across this webpage https://wiki.freebsd.org/InfiniBand and cannot f= ind the card on the table of supported hardware, so at this point I started= to believe that the card is just unsupported. But here we are on the mailing list, to see if anyone can help. Thanks in advance. Hi, Try loading qlxgb or qlxgbe. Hmmm, between them, the man pages for qlxgb and qlxgbe say they support: * QLogic 3200 series (qlxgb) * QLogic 8200 series (qlxgb) * QLogic 8300 series (qlxgbe) Should we add them to the "hardware support by release" table? Vin=EDcius, with your card, do you know the exact model number? IBA7322 seems to be the controller chip on the card itself, not the adapter model number, so it's hard to tell which series it belong too. Saying that from looking through the QLogic IB Adapters PDF: http://filedownloads.qlogic.com/files/driver/78254/Install_Guide_QLogic_IB= _Adapters_A.pdf Page 3-5 mentions it, as well as Figure 3-1 on that same page. :) I'm not seeing any mention of Infiniband support in the 3200 or 8x00 series= cards. They look to be strictly 10 GBE. Ahhh, that explains a few things then. :) + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi From owner-freebsd-infiniband@freebsd.org Wed Jul 27 23:07:09 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BFCDEBA6A4B for ; Wed, 27 Jul 2016 23:07:09 +0000 (UTC) (envelope-from ferrao@vmio.com.br) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1bn0108.outbound.protection.outlook.com [157.56.110.108]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 236391D29 for ; Wed, 27 Jul 2016 23:07:08 +0000 (UTC) (envelope-from ferrao@vmio.com.br) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vmio.onmicrosoft.com; s=selector1-vmio-com-br; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=lEHUcXS30JpUtUxuEatucrMK9tYBbiFjOIvWEdXHrac=; b=UnjHo67nTVkrSZV19T9WBggePgPhHkhYaE3GGHPq8oxJMmOIMBV3brYDJ0fXmWV4yFhqr1eA2JQvK44u1rRQ8JYZcVQQzlHOXwc8EIRNODlSEbDpt4L2LXiCryPQxx9tjBFGSMdGUhhCmkQtslQHY99ai2AB3i6bPNk3Mdc/eiM= Received: from FR1PR80MB1586.lamprd80.prod.outlook.com (10.167.137.156) by FR1PR80MB1587.lamprd80.prod.outlook.com (10.167.137.157) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Wed, 27 Jul 2016 14:34:57 +0000 Received: from FR1PR80MB1586.lamprd80.prod.outlook.com ([10.167.137.156]) by FR1PR80MB1586.lamprd80.prod.outlook.com ([10.167.137.156]) with mapi id 15.01.0549.016; Wed, 27 Jul 2016 14:34:55 +0000 From: =?utf-8?B?Vmluw61jaXVzIEZlcnLDo28=?= To: "freebsd-infiniband@freebsd.org" Subject: Infinihost with FreeNAS 9.10 (FreeBSD 10.3) Thread-Topic: Infinihost with FreeNAS 9.10 (FreeBSD 10.3) Thread-Index: AQHR6BQK4+UtFemEtkGj9TLBmCJ1tg== Date: Wed, 27 Jul 2016 14:34:54 +0000 Message-ID: <451999B3-F239-4EDC-B25A-039F5634783C@vmio.com.br> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=ferrao@vmio.com.br; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [200.204.163.103] x-ms-office365-filtering-correlation-id: d5985dd5-107b-4ec1-357e-08d3b62b2dbb x-microsoft-exchange-diagnostics: 1; FR1PR80MB1587; 6:mnMHZKzbpfIXsqYcBe0p+rlYca9IY5xJMKSOkZXNu/Umwq87NuoymW63DTuQD0RztQYVDWqITjrIlx0RaaYIiH060aqhsdYU+MJfjGB0LfSt9256FqrpDUvk+GlSfP0Vz0hrTRN8a9g9qAmBjxjKsU8U8L34i7vtw1ELdnZhUyBlh5DmZZUpwMgQusze0eN+WhujdK1OCVkxRat+2j4jdNOeaG9cjbQ5oznfyLaKBfoNE3I5h0WAjnX33fbN1fiykHlFtvLKaMCOOf0pMhLoRJQfbPCjYmGCSe1cSfHPXaPGtZslwijEp12ehKkYO741; 5:hmO+KWMcCcN+N/LggEee30j9J97VvOcowA+7gl1F5GTYHMC2Zouy6x6av4KxRx1OinGmKuAKQ6s85XY8HUOGINBNhZ+dnbD4ilNZH+4ZM4UVjd/xkgpfHWTM6YmA/WMPG5AOrHmvGrM92RxyUvaa6Q==; 24:arYL/yBkL/0RmwTjvmXKRy84tM+l47VdeZzhtexnv8Jb8NMuuDXiUcWZJQtZcyb4ooDVF0kgdf7V00OT+LxTTHe3z3VgCM5pIGvcccvzAM4=; 7:CZC+TKPW7FoPaCnTst1pnDOV7emxPCdShZU8/vq7d/zs+IEKt2xqubGSWCSdjIKgu4sg+V/4oy7YirqMdE7WBzkhV7xxqNSmR9DzK83IDFe4INBG2r2qJDFJhI2qm8s1WyRHiLK0yTZFk8osYKl3nxpVbLUNc4McUK2KJpHvEgOKtZo5Iz2f0ApPHI+n8ssrO+tEm6e4uG3kxJahGgwqaZSC6yJTuvzykY/A+MFlQrFxUb0KUUPjh2vmS0a/ruEY x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:FR1PR80MB1587; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040130)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6041072)(6043046)(6042046); SRVR:FR1PR80MB1587; BCL:0; PCL:0; RULEID:; SRVR:FR1PR80MB1587; x-forefront-prvs: 0016DEFF96 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(7916002)(51874003)(189002)(199003)(33656002)(66066001)(2351001)(5002640100001)(229853001)(83716003)(450100001)(82746002)(106356001)(74482002)(5640700001)(85182001)(122556002)(85202003)(87936001)(77096005)(3660700001)(3280700002)(8676002)(7736002)(305945005)(81166006)(86362001)(106116001)(189998001)(7846002)(97736004)(10400500002)(92566002)(81156014)(2501003)(101416001)(68736007)(6116002)(105586002)(8936002)(50986999)(2906002)(586003)(19580405001)(107886002)(2900100001)(3846002)(36756003)(110136002)(54356999)(102836003)(104396002); DIR:OUT; SFP:1102; SCL:1; SRVR:FR1PR80MB1587; H:FR1PR80MB1586.lamprd80.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:3; A:0; LANG:en; received-spf: None (protection.outlook.com: vmio.com.br does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: vmio.com.br X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Jul 2016 14:34:54.6446 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3da02919-4b9d-42af-a7f7-a5975700d7c4 X-MS-Exchange-Transport-CrossTenantHeadersStamped: FR1PR80MB1587 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jul 2016 23:07:09 -0000 SGVsbG8gZ3V5cywNCg0KU29tZW9uZSBoYWQgc3VjY2VzcyB1c2luZyBhbnkgSW5maW5paG9zdCBj YXJkIHdpdGggRnJlZU5BUyA5LjEwPyBUaGlzIHdvdWxkIGJlIHdvcmtpbmcgb3V0IG9mIHRoZSBi b3gsIHJpZ2h0PyBTaW5jZSBpdOKAmXMgYmFzZWQgb24gMTAuMy1SRUxFQVNFLg0KDQpJIGV2ZW4g dHJpZWQgbG9hZGluZyBzb21lIGtlcm5lbCBtb2R1bGVzIHdpdGhvdXQgYW55IHN1Y2Nlc3M6DQoN Cltyb290QGZyZWVuYXNdIH4jIGtsZGxvYWQgbXRoY2ENCmtsZGxvYWQ6IGNhbid0IGxvYWQgbXRo Y2E6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkNCg0KQW55IGlkZWlhcyBvbiBob3cgdG8gcHJv Y2VlZD8NCg0KVGhhbmtzIGluIGFkdmFuY2UsDQpWLg0KDQpQUzogMDM6MDAuMCBJbmZpbmlCYW5k OiBNZWxsYW5veCBUZWNobm9sb2dpZXMgTVQyNTIwOCBbSW5maW5pSG9zdCBJSUkgRXhdIChyZXYg MjApDQoNCg0KDQo= From owner-freebsd-infiniband@freebsd.org Thu Jul 28 08:46:40 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D04CEBA6557 for ; Thu, 28 Jul 2016 08:46:40 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (mail.turbocat.net [IPv6:2a01:4f8:d16:4514::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8DC4317A2 for ; Thu, 28 Jul 2016 08:46:40 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (unknown [62.141.129.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 5E3111FE022; Thu, 28 Jul 2016 10:46:38 +0200 (CEST) Subject: Re: Infinihost with FreeNAS 9.10 (FreeBSD 10.3) To: =?UTF-8?B?Vmluw61jaXVzIEZlcnLDo28=?= , "freebsd-infiniband@freebsd.org" References: <451999B3-F239-4EDC-B25A-039F5634783C@vmio.com.br> From: Hans Petter Selasky Message-ID: <06b7a6f8-3b03-4560-e636-a2dd17424392@selasky.org> Date: Thu, 28 Jul 2016 10:50:49 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.0 MIME-Version: 1.0 In-Reply-To: <451999B3-F239-4EDC-B25A-039F5634783C@vmio.com.br> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jul 2016 08:46:40 -0000 On 07/27/16 16:34, Vinícius Ferrão wrote: > Hello guys, > > Someone had success using any Infinihost card with FreeNAS 9.10? This would be working out of the box, right? Since it’s based on 10.3-RELEASE. > > I even tried loading some kernel modules without any success: > > [root@freenas] ~# kldload mthca > kldload: can't load mthca: No such file or directory > > Any ideias on how to proceed? > What does "pciconf -lv" say about your device? --HPS