From owner-freebsd-infiniband@freebsd.org Thu Apr 28 13:09:03 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6780DB1DF9B for ; Thu, 28 Apr 2016 13:09:03 +0000 (UTC) (envelope-from Krishna2@chelsio.com) Received: from stargate.chelsio.com (stargate.chelsio.com [12.32.117.8]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ACAC1F32 for ; Thu, 28 Apr 2016 13:09:03 +0000 (UTC) (envelope-from Krishna2@chelsio.com) Received: from nice.asicdesigners.com (nice.asicdesigners.com [10.192.160.7]) by stargate.chelsio.com (8.13.8/8.13.8) with ESMTP id u3SD8u89030144; Thu, 28 Apr 2016 06:09:02 -0700 Received: from NICE.asicdesigners.com ([fe80::51b2:ba95:9d72:babc]) by nice.asicdesigners.com ([fe80::51b2:ba95:9d72:babc%15]) with mapi id 14.03.0123.003; Thu, 28 Apr 2016 06:08:56 -0700 From: KrishnamRaju ErapaRaju To: Hans Petter Selasky , "freebsd-infiniband@freebsd.org" Subject: RE: OFED v3.2 update Thread-Topic: OFED v3.2 update Thread-Index: AdGhTtXn1byEZBF6QiiKvqfL/lDwRw== Date: Thu, 28 Apr 2016 13:08:53 +0000 Message-ID: <4EAB2619577FCA4EBCE11F17B7373447C4309697@nice.asicdesigners.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [10.193.191.70] Content-Type: multipart/mixed; boundary="_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_" MIME-Version: 1.0 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2016 13:09:03 -0000 --_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello Hans,=20 Thanks, now I am able to build successfully. ("sys/dev/mlx5/mlx5_ib" also need to be created along with your given list = of directories) Are these latest patches in mailing list are final now? It looks like TCP socket logic(needed for IWARP driver) is missing in the = latest patchsets, for example: In D5791.diff Index: sys/ofed/drivers/infiniband/core/cma.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- sys/ofed/drivers/infiniband/core/cma.c +++ sys/ofed/drivers/infiniband/core/cma.c @@ -2571,79 +2916,74 @@ return ret; } -static int cma_get_tcp_port(struct rdma_id_private *id_priv) +static struct idr *cma_select_inet_ps(struct rdma_id_private *id_priv) { - int ret; - int size; - struct socket *sock; - - ret =3D sock_create_kern(AF_INET, SOCK_STREAM, IPPROTO_TCP, &sock); - if (ret) - return ret; ---------------------------------------------------------------------------= -------------------------------------------- Also, when I try to run rping(after adding the missing TCP socket logic bac= k,attached) I am facing the "poll error -78" error.=20 Were you able to run rping with IBOE successfully? Looks like the legacy behavior of ibv_exp_poll_cq() got changed. Will try t= o root cause this issue. - - - Here are the steps I followed(for those who use Mercurial Version control S= W): -> Create below directories: mkdir -p contrib/ofed/libmlx5 mkdir -p contrib/ofed/libmlx5/config mkdir -p contrib/ofed/libmlx5/debian mkdir -p contrib/ofed/libmlx5/debian/patches mkdir -p contrib/ofed/libmlx5/debian/source mkdir -p contrib/ofed/libmlx5/scripts/expose_libmlx5_headers mkdir -p contrib/ofed/libmlx5/src mkdir -p contrib/ofed/librdmacm/include/infiniband mkdir -p contrib/ofed/usr.lib/libmlx5 mkdir -p sys/modules/mlx5ib mkdir -p sys/dev/mlx5/mlx5_ib -> Get the latest patches from "https://lists.freebsd.org/pipermail/freebsd= -infiniband/2016-March/000190.html" -> Apply patches: patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5790.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5791.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5792.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5793.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5794.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5795.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5796.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5797.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5798.diff patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5799.diff Build process: make -j8 buildworld WITH_OFED=3DYES make -j8 buildkernel WITH_OFED=3DYES make installkernel make installworld Thanks, Krishna. -----Original Message----- From: Hans Petter Selasky [mailto:hps@selasky.org]=20 Sent: Tuesday, April 26, 2016 8:27 PM To: KrishnamRaju ErapaRaju ; freebsd-infiniband@freeb= sd.org Subject: Re: OFED v3.2 update Hi Krishnam, If you are not using GIT's "am" commend, you'll need to create the followin= g directories beforehand: mkdir -p contrib/ofed/libmlx5 mkdir -p contrib/ofed/libmlx5/config mkdir -p contrib/ofed/libmlx5/debian mkdir -p contrib/ofed/libmlx5/debian/patches mkdir -p contrib/ofed/libmlx5/debian/source mkdir -p contrib/ofed/libmlx5/scripts/expose_libmlx5_headers mkdir -p contrib/ofed/libmlx5/src mkdir -p contrib/ofed/librdmacm/include/infiniband mkdir -p contrib/ofed/usr.lib/libmlx5 mkdir -p sys/modules/mlx5ib --HPS On 04/26/16 16:26, KrishnamRaju ErapaRaju wrote: > > Hello Hans, > > > I could apply OFED 3.2 patches cleanly to r298617 but failed to build(bu= ildworld), below is the compile error:(more error log at the bottom of this= mail) > bmake[5]: bmake[5]: don't know how to make buf.c. Stop > > I took the latest OFED 3.2 patchsets as of today. And applied the patches= with commands: "patch --remove-empty-files -F 30 -i /usr/src/ofed3.2/D5790= .diff" > > Here is my config file: > > diff -r 5615b648049d sys/amd64/conf/GENERIC > --- a/sys/amd64/conf/GENERIC Tue Apr 26 05:21:27 2016 +0000 > +++ b/sys/amd64/conf/GENERIC Mon Apr 25 15:34:54 2016 +0530 > @@ -21,8 +21,9 @@ > -makeoptions DEBUG=3D-g # Build kernel with gdb(1) debu= g symbols > +makeoptions DEBUG=3D"-g -O0" # Build kernel with gdb(1) debu= g symbols > +options KSTACK_PAGES=3D16 > +options KTR > +options KTR_COMPILE=3DKTR_SPARE3 > +options KTR_MASK=3DKTR_SPARE3 > +options KTR_ENTRIES=3D65536 > +options BREAK_TO_DEBUGGER > +options LINUXKPI > --_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_ Content-Type: application/octet-stream; name="tcpsocket.patch" Content-Description: tcpsocket.patch Content-Disposition: attachment; filename="tcpsocket.patch"; size=2826; creation-date="Thu, 28 Apr 2016 13:06:33 GMT"; modification-date="Wed, 27 Apr 2016 04:54:43 GMT" Content-Transfer-Encoding: base64 ZGlmZiAtciBiY2Q5M2NiNjczYjggc3lzL29mZWQvZHJpdmVycy9pbmZpbmliYW5kL2NvcmUvY21h LmMKLS0tIGEvc3lzL29mZWQvZHJpdmVycy9pbmZpbmliYW5kL2NvcmUvY21hLmMJV2VkIEFwciAy NyAwNTowODozOSAyMDE2ICswNTMwCisrKyBiL3N5cy9vZmVkL2RyaXZlcnMvaW5maW5pYmFuZC9j b3JlL2NtYS5jCVdlZCBBcHIgMjcgMTA6MjM6MDIgMjAxNiArMDUzMApAQCAtNzIsNiArNzIsMTEg QEAKIG1vZHVsZV9wYXJhbV9uYW1lZChkZWZfcHJlYzJzbCwgZGVmX3ByZWMyc2wsIGludCwgMDY0 NCk7CiBNT0RVTEVfUEFSTV9ERVNDKGRlZl9wcmVjMnNsLCAiRGVmYXVsdCB2YWx1ZSBmb3IgU0wg cHJpb3JpdHkgd2l0aCBSb0NFLiBWYWxpZCB2YWx1ZXMgMCAtIDciKTsKIAorc3RhdGljIGludCB1 bmlmeV90Y3BfcG9ydF9zcGFjZSA9IDE7Cittb2R1bGVfcGFyYW0odW5pZnlfdGNwX3BvcnRfc3Bh Y2UsIGludCwgMDY0NCk7CitNT0RVTEVfUEFSTV9ERVNDKHVuaWZ5X3RjcF9wb3J0X3NwYWNlLCAi VW5pZnkgdGhlIGhvc3QgVENQIGFuZCBSRE1BIHBvcnQgIgorCQkic3BhY2UgYWxsb2NhdGlvbiAo ZGVmYXVsdD0xKSIpOworCiBzdGF0aWMgaW50IGRlYnVnX2xldmVsID0gMDsKICNkZWZpbmUgY21h X3ByKGxldmVsLCBwcml2LCBmb3JtYXQsIGFyZy4uLikJCVwKIAlwcmludGsobGV2ZWwgIkNNQTog JXA6ICVzOiAiIGZvcm1hdCwgKChzdHJ1Y3QgcmRtYV9pZF9wcml2ICopIHByaXYpICwgX19mdW5j X18sICMjIGFyZykKQEAgLTE3MCw2ICsxNzUsMTAgQEAKIHsKIAlyZXR1cm4gY21hX2Rldi0+ZGVm YXVsdF9naWRfdHlwZTsKIH0KK3N0YXRpYyBpbmxpbmUgaW50IGlwX2FkZHJfc2l6ZShzdHJ1Y3Qg c29ja2FkZHIgKmFkZHIpCit7CisJcmV0dXJuIGFkZHItPnNhX2ZhbWlseSA9PSBBRl9JTkVUNiA/ c2l6ZW9mKHN0cnVjdCBzb2NrYWRkcl9pbjYpIDogc2l6ZW9mKHN0cnVjdCBzb2NrYWRkcl9pbik7 Cit9CiAKIHZvaWQgY21hX3NldF9kZWZhdWx0X2dpZF90eXBlKHN0cnVjdCBjbWFfZGV2aWNlICpj bWFfZGV2LAogCQkJICAgICAgZW51bSBpYl9naWRfdHlwZSBkZWZhdWx0X2dpZF90eXBlKQpAQCAt MTI5OSw2ICsxMzA4LDkgQEAKIAkJa2ZyZWUoYmluZF9saXN0KTsKIAl9CiAJbXV0ZXhfdW5sb2Nr KCZsb2NrKTsKKworCWlmICgoaWRfcHJpdi0+c29jayE9IE5VTEwpICYmIChpZF9wcml2LT5zb2Nr LT5zb19jb3VudCA+IDApKQorCQlzb2NrX3JlbGVhc2UoaWRfcHJpdi0+c29jayk7CiB9CiAKIHN0 YXRpYyB2b2lkIGNtYV9sZWF2ZV9tY19ncm91cHMoc3RydWN0IHJkbWFfaWRfcHJpdmF0ZSAqaWRf cHJpdikKQEAgLTIwMTAsNiArMjAyMiw3IEBACiAJZGV2X2lkX3ByaXYgPSBjb250YWluZXJfb2Yo aWQsIHN0cnVjdCByZG1hX2lkX3ByaXZhdGUsIGlkKTsKIAogCWRldl9pZF9wcml2LT5zdGF0ZSA9 IFJETUFfQ01fQUREUl9CT1VORDsKKwlkZXZfaWRfcHJpdi0+c29jayA9IGlkX3ByaXYtPnNvY2s7 CiAJbWVtY3B5KGNtYV9zcmNfYWRkcihkZXZfaWRfcHJpdiksIGNtYV9zcmNfYWRkcihpZF9wcml2 KSwKIAkgICAgICAgcmRtYV9hZGRyX3NpemUoY21hX3NyY19hZGRyKGlkX3ByaXYpKSk7CiAKQEAg LTI5MTYsMTMgKzI5MjksNTcgQEAKIAlyZXR1cm4gcmV0OwogfQogCitzdGF0aWMgaW50IGNtYV9n ZXRfdGNwX3BvcnQoc3RydWN0IHJkbWFfaWRfcHJpdmF0ZSAqaWRfcHJpdikKK3sKKwlpbnQgcmV0 OworCWludCBzaXplOworCXN0cnVjdCBzb2NrZXQgKnNvY2s7CisKKwlyZXQgPSBzb2NrX2NyZWF0 ZV9rZXJuKEFGX0lORVQsIFNPQ0tfU1RSRUFNLCBJUFBST1RPX1RDUCwgJnNvY2spOworCWlmIChy ZXQpCisJCXJldHVybiByZXQ7CisjaWZkZWYgX19saW51eF9fCisJcmV0ID0gc29jay0+b3BzLT5i aW5kKHNvY2ssCisJCQkoc3RydWN0IHNvY2thZGRyICopICZpZF9wcml2LT5pZC5yb3V0ZS5hZGRy LnNyY19hZGRyLAorCQkJaXBfYWRkcl9zaXplKChzdHJ1Y3Qgc29ja2FkZHIgKikgJmlkX3ByaXYt PmlkLnJvdXRlLmFkZHIuc3JjX2FkZHIpKTsKKyNlbHNlCisJcmV0ID0gLXNvYmluZChzb2NrLAor CQkJKHN0cnVjdCBzb2NrYWRkciAqKSZpZF9wcml2LT5pZC5yb3V0ZS5hZGRyLnNyY19hZGRyLAor CQkJY3VydGhyZWFkKTsKKyNlbmRpZgorCWlmIChyZXQpIHsKKwkJc29ja19yZWxlYXNlKHNvY2sp OworCQlyZXR1cm4gcmV0OworCX0KKworCXNpemUgPSBpcF9hZGRyX3NpemUoKHN0cnVjdCBzb2Nr YWRkciAqKSAmaWRfcHJpdi0+aWQucm91dGUuYWRkci5zcmNfYWRkcik7CisJcmV0ID0gc29ja19n ZXRuYW1lKHNvY2ssCisJCQkoc3RydWN0IHNvY2thZGRyICopICZpZF9wcml2LT5pZC5yb3V0ZS5h ZGRyLnNyY19hZGRyLAorCQkJJnNpemUsIDApOworCWlmIChyZXQpIHsKKwkJc29ja19yZWxlYXNl KHNvY2spOworCQlyZXR1cm4gcmV0OworCX0KKworCWlkX3ByaXYtPnNvY2sgPSBzb2NrOworCXJl dHVybiAwOworfQorCiBzdGF0aWMgc3RydWN0IGlkciAqY21hX3NlbGVjdF9pbmV0X3BzKHN0cnVj dCByZG1hX2lkX3ByaXZhdGUgKmlkX3ByaXYpCiB7CisJaW50IHJldDsKKwogCXN3aXRjaCAoaWRf cHJpdi0+aWQucHMpIHsKIAljYXNlIFJETUFfUFNfU0RQOgogCQlyZXR1cm4gJnNkcF9wczsKIAlj YXNlIFJETUFfUFNfVENQOgorCQlpZiAodW5pZnlfdGNwX3BvcnRfc3BhY2UpIHsKKwkJCXJldCA9 IGNtYV9nZXRfdGNwX3BvcnQoaWRfcHJpdik7CisJCQlpZiAocmV0KQorCQkJCXJldHVybiBOVUxM OworCQl9CiAJCXJldHVybiAmdGNwX3BzOworCQogCWNhc2UgUkRNQV9QU19VRFA6CiAJCXJldHVy biAmdWRwX3BzOwogCWNhc2UgUkRNQV9QU19JUE9JQjoK --_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_--