Date: Thu, 12 May 2016 15:46:12 +0000 From: KrishnamRaju ErapaRaju <Krishna2@chelsio.com> To: Hans Petter Selasky <hps@selasky.org>, "freebsd-infiniband@freebsd.org" <freebsd-infiniband@freebsd.org> Subject: RE: OFED v3.2 update Message-ID: <4EAB2619577FCA4EBCE11F17B7373447C4312A8A@nice.asicdesigners.com> In-Reply-To: <5723640D.5020201@selasky.org> References: <4EAB2619577FCA4EBCE11F17B7373447C4309697@nice.asicdesigners.com> <572225D8.8050501@selasky.org> <4EAB2619577FCA4EBCE11F17B7373447C43098E9@nice.asicdesigners.com> <5723640D.5020201@selasky.org>
index | next in thread | previous in thread | raw e-mail
Hi Hans, Looks like rping got changed in the OFED3.2 update patches, I mean, few verbs like ibv_poll_cq(), got replace with experimental verbs like ibv_exp_poll_cq() in rping.c. But the current Chelsio IWARP drivers are not using these new experimental verbs. So, running rping for Chelsio devices is hitting the below poll error: [root@taj ~]# rping -s -a 102.7.7.180 -Vvd libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'. created cm_id 0x801c2d000 rdma_bind_addr successful rdma_listen cma_event type RDMA_CM_EVENT_CONNECT_REQUEST cma_id 0x801e0f000 (child) child cma 0x801e0f000 created pd 0x801c2c020 created channel 0x801c2c030 created cq 0x801d08000 created qp 0x801c5e140 rping_setup_buffers called on cb 0x801c1c000 allocated & registered buffers... accepting client connection request cq_thread started. cma_event type RDMA_CM_EVENT_ESTABLISHED cma_id 0x801e0f000 (child) ESTABLISHED poll error -78 <======ERROR HERE wait for RDMA_READ_ADV state 11 rping_free_buffers called on cb 0x801c1c000 destroy cm_id 0x801c2d000 Will you be changing rping later such that it will work with IWARP drivers(which does not use experimental verbs)? Thanks, Krishna. -----Original Message----- From: Hans Petter Selasky [mailto:hps@selasky.org] Sent: Friday, April 29, 2016 7:09 PM To: KrishnamRaju ErapaRaju <Krishna2@chelsio.com>; freebsd-infiniband@freebsd.org Subject: Re: OFED v3.2 update On 04/29/16 15:31, KrishnamRaju ErapaRaju wrote: > Thank you very much Hans. > I am yet to root cause " ibv_exp_poll_cq()" error(ENOSYS). I will get back to you soon with the update on this. > > May I know( in gist) about adding experimental verbs(like ibv_exp_poll_cq) in recent patches. > > Like rping, do the RDMA applications(already written with old ib verbs, not experimental) also needs changes? > Hi, libibvers now has a symbol map so that you can choose the version you want to interface. The library should be binary compatible to the old apps. About the experimental verbs, they come from Mellanox and are not upstream Linux yet. This might be a showstopper :-) --HPShelp
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4EAB2619577FCA4EBCE11F17B7373447C4312A8A>