Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 28 Apr 2016 13:08:53 +0000
From:      KrishnamRaju ErapaRaju <Krishna2@chelsio.com>
To:        Hans Petter Selasky <hps@selasky.org>, "freebsd-infiniband@freebsd.org" <freebsd-infiniband@freebsd.org>
Subject:   RE: OFED v3.2 update  
Message-ID:  <4EAB2619577FCA4EBCE11F17B7373447C4309697@nice.asicdesigners.com>

next in thread | raw e-mail | index | archive | help
--_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hello Hans,=20

Thanks, now I am able to build successfully.
("sys/dev/mlx5/mlx5_ib" also need to be created along with your given list =
of directories)

Are these latest patches in mailing list are final now?

It looks like TCP socket logic(needed for IWARP driver)  is missing in the =
latest patchsets, for example:

In D5791.diff

Index: sys/ofed/drivers/infiniband/core/cma.c
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
--- sys/ofed/drivers/infiniband/core/cma.c
+++ sys/ofed/drivers/infiniband/core/cma.c
@@ -2571,79 +2916,74 @@
        return ret;
 }

-static int cma_get_tcp_port(struct rdma_id_private *id_priv)
+static struct idr *cma_select_inet_ps(struct rdma_id_private *id_priv)
 {
-       int ret;
-       int size;
-       struct socket *sock;
-
-       ret =3D sock_create_kern(AF_INET, SOCK_STREAM, IPPROTO_TCP, &sock);
-       if (ret)
-               return ret;
---------------------------------------------------------------------------=
--------------------------------------------

Also, when I try to run rping(after adding the missing TCP socket logic bac=
k,attached) I am facing the "poll error -78" error.=20
Were you able to run rping with IBOE successfully?
Looks like the legacy behavior of ibv_exp_poll_cq() got changed. Will try t=
o root cause this issue.


- - -



Here are the steps I followed(for those who use Mercurial Version control S=
W):

-> Create below directories:
     mkdir -p contrib/ofed/libmlx5
     mkdir -p contrib/ofed/libmlx5/config
     mkdir -p contrib/ofed/libmlx5/debian
     mkdir -p contrib/ofed/libmlx5/debian/patches
     mkdir -p contrib/ofed/libmlx5/debian/source
     mkdir -p contrib/ofed/libmlx5/scripts/expose_libmlx5_headers
     mkdir -p contrib/ofed/libmlx5/src
     mkdir -p contrib/ofed/librdmacm/include/infiniband
     mkdir -p contrib/ofed/usr.lib/libmlx5
     mkdir -p sys/modules/mlx5ib
     mkdir -p sys/dev/mlx5/mlx5_ib

-> Get the latest patches from "https://lists.freebsd.org/pipermail/freebsd=
-infiniband/2016-March/000190.html"

-> Apply patches:
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5790.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5791.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5792.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5793.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5794.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5795.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5796.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5797.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5798.diff
patch --remove-empty-files -F 30 -i /bld_kit/ofed3.2_v3/D5799.diff

Build process:
make -j8 buildworld WITH_OFED=3DYES
make -j8  buildkernel WITH_OFED=3DYES
make installkernel
make installworld

Thanks,
Krishna.

-----Original Message-----
From: Hans Petter Selasky [mailto:hps@selasky.org]=20
Sent: Tuesday, April 26, 2016 8:27 PM
To: KrishnamRaju ErapaRaju <Krishna2@chelsio.com>; freebsd-infiniband@freeb=
sd.org
Subject: Re: OFED v3.2 update

Hi Krishnam,

If you are not using GIT's "am" commend, you'll need to create the followin=
g directories beforehand:

     mkdir -p contrib/ofed/libmlx5
     mkdir -p contrib/ofed/libmlx5/config
     mkdir -p contrib/ofed/libmlx5/debian
     mkdir -p contrib/ofed/libmlx5/debian/patches
     mkdir -p contrib/ofed/libmlx5/debian/source
     mkdir -p contrib/ofed/libmlx5/scripts/expose_libmlx5_headers
     mkdir -p contrib/ofed/libmlx5/src
     mkdir -p contrib/ofed/librdmacm/include/infiniband
     mkdir -p contrib/ofed/usr.lib/libmlx5
     mkdir -p sys/modules/mlx5ib


--HPS

On 04/26/16 16:26, KrishnamRaju ErapaRaju wrote:
>
> Hello Hans,
>
>
> I could apply  OFED 3.2 patches cleanly to r298617 but failed to build(bu=
ildworld), below is the compile error:(more error log at the bottom of this=
 mail)
>              bmake[5]: bmake[5]: don't know how to make buf.c. Stop
>
> I took the latest OFED 3.2 patchsets as of today. And applied the patches=
 with commands: "patch --remove-empty-files -F 30 -i /usr/src/ofed3.2/D5790=
.diff"
>
> Here is my config file:
>
> diff -r 5615b648049d sys/amd64/conf/GENERIC
> --- a/sys/amd64/conf/GENERIC    Tue Apr 26 05:21:27 2016 +0000
> +++ b/sys/amd64/conf/GENERIC    Mon Apr 25 15:34:54 2016 +0530
> @@ -21,8 +21,9 @@
> -makeoptions    DEBUG=3D-g                # Build kernel with gdb(1) debu=
g symbols
> +makeoptions    DEBUG=3D"-g -O0"          # Build kernel with gdb(1) debu=
g symbols
> +options KSTACK_PAGES=3D16
> +options KTR
> +options KTR_COMPILE=3DKTR_SPARE3
> +options KTR_MASK=3DKTR_SPARE3
> +options KTR_ENTRIES=3D65536
> +options BREAK_TO_DEBUGGER
> +options LINUXKPI
>


--_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_
Content-Type: application/octet-stream; name="tcpsocket.patch"
Content-Description: tcpsocket.patch
Content-Disposition: attachment; filename="tcpsocket.patch"; size=2826;
	creation-date="Thu, 28 Apr 2016 13:06:33 GMT";
	modification-date="Wed, 27 Apr 2016 04:54:43 GMT"
Content-Transfer-Encoding: base64

ZGlmZiAtciBiY2Q5M2NiNjczYjggc3lzL29mZWQvZHJpdmVycy9pbmZpbmliYW5kL2NvcmUvY21h
LmMKLS0tIGEvc3lzL29mZWQvZHJpdmVycy9pbmZpbmliYW5kL2NvcmUvY21hLmMJV2VkIEFwciAy
NyAwNTowODozOSAyMDE2ICswNTMwCisrKyBiL3N5cy9vZmVkL2RyaXZlcnMvaW5maW5pYmFuZC9j
b3JlL2NtYS5jCVdlZCBBcHIgMjcgMTA6MjM6MDIgMjAxNiArMDUzMApAQCAtNzIsNiArNzIsMTEg
QEAKIG1vZHVsZV9wYXJhbV9uYW1lZChkZWZfcHJlYzJzbCwgZGVmX3ByZWMyc2wsIGludCwgMDY0
NCk7CiBNT0RVTEVfUEFSTV9ERVNDKGRlZl9wcmVjMnNsLCAiRGVmYXVsdCB2YWx1ZSBmb3IgU0wg
cHJpb3JpdHkgd2l0aCBSb0NFLiBWYWxpZCB2YWx1ZXMgMCAtIDciKTsKIAorc3RhdGljIGludCB1
bmlmeV90Y3BfcG9ydF9zcGFjZSA9IDE7Cittb2R1bGVfcGFyYW0odW5pZnlfdGNwX3BvcnRfc3Bh
Y2UsIGludCwgMDY0NCk7CitNT0RVTEVfUEFSTV9ERVNDKHVuaWZ5X3RjcF9wb3J0X3NwYWNlLCAi
VW5pZnkgdGhlIGhvc3QgVENQIGFuZCBSRE1BIHBvcnQgIgorCQkic3BhY2UgYWxsb2NhdGlvbiAo
ZGVmYXVsdD0xKSIpOworCiBzdGF0aWMgaW50IGRlYnVnX2xldmVsID0gMDsKICNkZWZpbmUgY21h
X3ByKGxldmVsLCBwcml2LCBmb3JtYXQsIGFyZy4uLikJCVwKIAlwcmludGsobGV2ZWwgIkNNQTog
JXA6ICVzOiAiIGZvcm1hdCwgKChzdHJ1Y3QgcmRtYV9pZF9wcml2ICopIHByaXYpICwgX19mdW5j
X18sICMjIGFyZykKQEAgLTE3MCw2ICsxNzUsMTAgQEAKIHsKIAlyZXR1cm4gY21hX2Rldi0+ZGVm
YXVsdF9naWRfdHlwZTsKIH0KK3N0YXRpYyBpbmxpbmUgaW50IGlwX2FkZHJfc2l6ZShzdHJ1Y3Qg
c29ja2FkZHIgKmFkZHIpCit7CisJcmV0dXJuIGFkZHItPnNhX2ZhbWlseSA9PSBBRl9JTkVUNiA/
c2l6ZW9mKHN0cnVjdCBzb2NrYWRkcl9pbjYpIDogc2l6ZW9mKHN0cnVjdCBzb2NrYWRkcl9pbik7
Cit9CiAKIHZvaWQgY21hX3NldF9kZWZhdWx0X2dpZF90eXBlKHN0cnVjdCBjbWFfZGV2aWNlICpj
bWFfZGV2LAogCQkJICAgICAgZW51bSBpYl9naWRfdHlwZSBkZWZhdWx0X2dpZF90eXBlKQpAQCAt
MTI5OSw2ICsxMzA4LDkgQEAKIAkJa2ZyZWUoYmluZF9saXN0KTsKIAl9CiAJbXV0ZXhfdW5sb2Nr
KCZsb2NrKTsKKworCWlmICgoaWRfcHJpdi0+c29jayE9IE5VTEwpICYmIChpZF9wcml2LT5zb2Nr
LT5zb19jb3VudCA+IDApKQorCQlzb2NrX3JlbGVhc2UoaWRfcHJpdi0+c29jayk7CiB9CiAKIHN0
YXRpYyB2b2lkIGNtYV9sZWF2ZV9tY19ncm91cHMoc3RydWN0IHJkbWFfaWRfcHJpdmF0ZSAqaWRf
cHJpdikKQEAgLTIwMTAsNiArMjAyMiw3IEBACiAJZGV2X2lkX3ByaXYgPSBjb250YWluZXJfb2Yo
aWQsIHN0cnVjdCByZG1hX2lkX3ByaXZhdGUsIGlkKTsKIAogCWRldl9pZF9wcml2LT5zdGF0ZSA9
IFJETUFfQ01fQUREUl9CT1VORDsKKwlkZXZfaWRfcHJpdi0+c29jayA9IGlkX3ByaXYtPnNvY2s7
CiAJbWVtY3B5KGNtYV9zcmNfYWRkcihkZXZfaWRfcHJpdiksIGNtYV9zcmNfYWRkcihpZF9wcml2
KSwKIAkgICAgICAgcmRtYV9hZGRyX3NpemUoY21hX3NyY19hZGRyKGlkX3ByaXYpKSk7CiAKQEAg
LTI5MTYsMTMgKzI5MjksNTcgQEAKIAlyZXR1cm4gcmV0OwogfQogCitzdGF0aWMgaW50IGNtYV9n
ZXRfdGNwX3BvcnQoc3RydWN0IHJkbWFfaWRfcHJpdmF0ZSAqaWRfcHJpdikKK3sKKwlpbnQgcmV0
OworCWludCBzaXplOworCXN0cnVjdCBzb2NrZXQgKnNvY2s7CisKKwlyZXQgPSBzb2NrX2NyZWF0
ZV9rZXJuKEFGX0lORVQsIFNPQ0tfU1RSRUFNLCBJUFBST1RPX1RDUCwgJnNvY2spOworCWlmIChy
ZXQpCisJCXJldHVybiByZXQ7CisjaWZkZWYgX19saW51eF9fCisJcmV0ID0gc29jay0+b3BzLT5i
aW5kKHNvY2ssCisJCQkoc3RydWN0IHNvY2thZGRyICopICZpZF9wcml2LT5pZC5yb3V0ZS5hZGRy
LnNyY19hZGRyLAorCQkJaXBfYWRkcl9zaXplKChzdHJ1Y3Qgc29ja2FkZHIgKikgJmlkX3ByaXYt
PmlkLnJvdXRlLmFkZHIuc3JjX2FkZHIpKTsKKyNlbHNlCisJcmV0ID0gLXNvYmluZChzb2NrLAor
CQkJKHN0cnVjdCBzb2NrYWRkciAqKSZpZF9wcml2LT5pZC5yb3V0ZS5hZGRyLnNyY19hZGRyLAor
CQkJY3VydGhyZWFkKTsKKyNlbmRpZgorCWlmIChyZXQpIHsKKwkJc29ja19yZWxlYXNlKHNvY2sp
OworCQlyZXR1cm4gcmV0OworCX0KKworCXNpemUgPSBpcF9hZGRyX3NpemUoKHN0cnVjdCBzb2Nr
YWRkciAqKSAmaWRfcHJpdi0+aWQucm91dGUuYWRkci5zcmNfYWRkcik7CisJcmV0ID0gc29ja19n
ZXRuYW1lKHNvY2ssCisJCQkoc3RydWN0IHNvY2thZGRyICopICZpZF9wcml2LT5pZC5yb3V0ZS5h
ZGRyLnNyY19hZGRyLAorCQkJJnNpemUsIDApOworCWlmIChyZXQpIHsKKwkJc29ja19yZWxlYXNl
KHNvY2spOworCQlyZXR1cm4gcmV0OworCX0KKworCWlkX3ByaXYtPnNvY2sgPSBzb2NrOworCXJl
dHVybiAwOworfQorCiBzdGF0aWMgc3RydWN0IGlkciAqY21hX3NlbGVjdF9pbmV0X3BzKHN0cnVj
dCByZG1hX2lkX3ByaXZhdGUgKmlkX3ByaXYpCiB7CisJaW50IHJldDsKKwogCXN3aXRjaCAoaWRf
cHJpdi0+aWQucHMpIHsKIAljYXNlIFJETUFfUFNfU0RQOgogCQlyZXR1cm4gJnNkcF9wczsKIAlj
YXNlIFJETUFfUFNfVENQOgorCQlpZiAodW5pZnlfdGNwX3BvcnRfc3BhY2UpIHsKKwkJCXJldCA9
IGNtYV9nZXRfdGNwX3BvcnQoaWRfcHJpdik7CisJCQlpZiAocmV0KQorCQkJCXJldHVybiBOVUxM
OworCQl9CiAJCXJldHVybiAmdGNwX3BzOworCQogCWNhc2UgUkRNQV9QU19VRFA6CiAJCXJldHVy
biAmdWRwX3BzOwogCWNhc2UgUkRNQV9QU19JUE9JQjoK

--_002_4EAB2619577FCA4EBCE11F17B7373447C4309697niceasicdesigne_--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4EAB2619577FCA4EBCE11F17B7373447C4309697>