hat. It
> > might just be more convenient to set up the siw driver in Linux vs the
> > rxe one? He is the main author of RFC-8166, so he's the NFS-over-RDMA g=
uy.)
> >
> > But it does look like a fun project for the next year. (I recall jhb@ m=
entioning
> > that NFS-over-TLS wouldn't be easy and it turned out to be a fun
> > little project.)
>
> Konstantin is right though that sys/ofed is Linux OpenIB and has an inter=
face
> that should let you do RDMA (both ROCEv2 and iWARP).  I'm hoping to use t=
he APIs
> in sys/ofed to support NVMe over RDMA (both ROCEv2 and iWARP) at some poi=
nt as
> well.
> > rick
> >
> >>
> >>>
> >>> Btw, if anyone is interested in taking a more active involvement in t=
his,
> >>> they are more than welcome to do so. (I'm going to be starting where =
I
> >>> understand things in the krpc/nfs. I'm not looking forward to porting=
 rxe,
> >>> but will probably end up there. I have already had one offer w.r.t. a=
ccess
> >>> to a lab that includes Mellanox hardware, but I don't know if remote
> >>> debugging will be practical yet.)
> >>>
> >>> rick
> >>>
> >>>>
> >>>> The IB implementation for us is still called OFED for historical rea=
sons,
> >>>> and it is located in sys/ofed.
> >>>>
> >>>>>
> >>>>> As for testing, I am planning on hacking away at one of the RDMA
> >>>>> in software drivers in Linux to get it working well enough to use f=
or
> >>>>> testing. Whatever seems to be easiest to get kinda working.
> >>>> Yes rxe driver is the sw RoCE v2 implementation.  We looked at the
> >>>> amount of work to port it.  Its size is ~12 kLoC, which is compatibl=
e
> >>>> with libibverbs (userspace core infiniband interface).
>
> Interesting.  I'm currently working on merging back several OFED commits =
from
> Linux to sys/ofed (currently I have about 30 commits merged, some older t=
han
> Hans' last merge, and some newer, some of the newer ones should permit re=
moving
> compat stubs for some of the newer APIs that are duplicated in bnxt, irdm=
a, and
> mlx*).  When I get a bit further along I'll post the branch I have for mo=
re
> testing (it is a bunch of individual cherry-picks rather than a giant mer=
ge).
>
> Porting over rxe could be useful for me as well for some work I am doing.
I have https://github.com/rmacklem/freebsd-rdma. For now, I'll only be doin=
g
commits to it for the NFS and krpc files.  It will be a while before anythi=
ng in
it is useful for others.

I'll email when I get into the rxe port. (If you hurry, you can beat me to =
it;-)

Others are welcome to push/pull on the above. (Email if you need permission=
s
changes. I know diddly about github.)

rick

>
> --
> John Baldwin
>