Date: Mon, 4 Oct 2021 11:33:43 +0000 From: Francois ten Krooden <ftk@Nanoteq.com> To: Santiago Martinez <sm@codenetworks.net>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: RE: Vector Packet Processing (VPP) portability on FreeBSD Message-ID: <AB9BB4D903F59549B2E27CC033B964D6F7A50DE9@NTQ-EXC.nanoteq.co.za> In-Reply-To: <33b2b043-f3b7-e8e0-c290-f754082e0692@codenetworks.net> References: <AB9BB4D903F59549B2E27CC033B964D6C4F8BECE@NTQ-EXC.nanoteq.co.za> <CA%2BhQ2%2BjQ2fh4TXz02mTxAHJkHBWzfNhd=yRqPG45E7Z4umAsKA@mail.gmail.com> <e778ca61766741b0950585f6b26d8fff@EX16-05.ad.unipi.it> <CA%2BhQ2%2BhzjT5%2BRXmUUV4PpkXkvgQEJb8JrLPY7LqteV9ixeM7Ew@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D386@NTQ-EXC.nanoteq.co.za> <CALX0vxA3_eDRJmEGBak=e99nOrBkFYEmdnBHEY9JLTmT7tQ2vQ@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D3BB@NTQ-EXC.nanoteq.co.za> <CA%2B_eA9iG=4nemZxM_yETxGTMMC-oXPtMZmWc9DCp%2BqJaCQt4=g@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D74A@NTQ-EXC.nanoteq.co.za> <20210517192054.0907beea@x23> <CAK7dMtD2vgzHG4XAxpcUoTnZCpmC2Onwa%2BUd%2Bw1dKb1W_TCxfQ@mail.gmail.com> <CA%2B_eA9joMB4C3=hdP9u0r7TkmeLLPX3=o1nCCqtk84kmkjFQkw@mail.gmail.com> <CAK7dMtDWor3KqdEshfaqUH2mgagU%2BvT2M6jgwAwKiNt9J1ec%2Bw@mail.gmail.com> <CAK7dMtB37iN0HQMuwX-Fk=SR%2Bnc4fZLa-N863%2BNOZe9d1ebG_g@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6F7A4F5C5@NTQ-EXC.nanoteq.co.za>,<33b2b043-f3b7-e8e0-c290-f754082e0692@codenetworks.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi Santiago The patches we have made is all available on the github fork we made from t= he VPP repository. It is located at https://github.com/ftk-ntq/vpp/tree/freebsd So anyone who is interested can find it there. To make the VFIO support work I unfortunately have no idea. I am not exactly sure but I think there is some kernel work required and th= en an update to DPDK. I am not sure how much effort that would be. Kind Regards Francois ten Krooden Principal Developer Nanoteq Tel: +27 12 672 7000 Fax: +27 12 665 1343 Postal: P.O. Box 7991, Centurion, 0046 Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue, Cent= urion ________________________________________ From: Santiago Martinez [sm@codenetworks.net] Sent: Wednesday, September 22, 2021 11:22 AM To: freebsd-net@freebsd.org Subject: Re: Vector Packet Processing (VPP) portability on FreeBSD Hi Francois, I hope you are doing well. It is great to hear about work/progress/updates on VPP / DPDK / Netmap on FBSD, even if the results are not the best. Unfortunately, I'm not a developer, so I cannot help much on the matter of the missing bits. Just wondering if those modifications that your team have done to make VPP run can be upstreamed or shared with the community, so maybe we can create a VPP package making it easier for others to deploy/test/improve. On the other hand, do you roughly know how much effort is required to make VFIO support at the same level as Linux? I hope it makes sense. Best regards. Santiago On 9/21/21 11:52 AM, Francois ten Krooden wrote: > Hi > > This is just some feedback for those who had an interest in this topic. > > After spending quite some time on the VPP to FreeBSD porting effort where= we did manage to get VPP working with netmap, and VPP compiling with DPDK;= We realised that there are some big issues that we would need to overcome.= Some of these efforts are not viable for our small team to accomplish in a= reasonable time frame. > The main issues that we have found are: > - Tests proved that netmap would not deliver the desired performance as i= t is currently implemented within VPP. The main issues here are that for ev= ery 256 packets memory seems to be allocated again, also a number of copies= occur in the memory which slows down the performance. > - VPP relies on VFIO to map device memory into user space for processing = within the application. This code is implemented in DPDK in the Linux imple= mentation but in the FreeBSD implementation in DPDK these functions are stu= bbed. > - To interface with crypto-offloading hardware such as the QAT card from = Intel, or our own card VPP/DPDK also utilize VFIO with the PCI device. > - As far as we have been able to see the VFIO support in FreeBSD is not a= t the same level as Linux, which would then require additional kernel devel= opment which is not possible in the time frame. > > Regards > > Francois ten Krooden > Principal Developer > > > Tel: +27 12 672 7000 > Fax: +27 12 665 1343 > Postal: P.O. Box 7991, Centurion, 0046 > Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue, C= enturion > > > > Important Notice: > > This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mail = legal notice available at: > http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx Important Notice: This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mail le= gal notice available at: http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AB9BB4D903F59549B2E27CC033B964D6F7A50DE9>