Date: Mon, 4 Oct 2021 10:16:14 -0700 From: Kevin Bowling <kevin.bowling@kev009.com> To: Francois ten Krooden <ftk@nanoteq.com> Cc: Santiago Martinez <sm@codenetworks.net>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: Vector Packet Processing (VPP) portability on FreeBSD Message-ID: <CAK7dMtD5TLdCBqk5Dk60OqpQUztuzg_CRqfy%2BQuYeS00s_zoig@mail.gmail.com> In-Reply-To: <AB9BB4D903F59549B2E27CC033B964D6F7A50DE9@NTQ-EXC.nanoteq.co.za> References: <AB9BB4D903F59549B2E27CC033B964D6C4F8BECE@NTQ-EXC.nanoteq.co.za> <CA%2BhQ2%2BjQ2fh4TXz02mTxAHJkHBWzfNhd=yRqPG45E7Z4umAsKA@mail.gmail.com> <e778ca61766741b0950585f6b26d8fff@EX16-05.ad.unipi.it> <CA%2BhQ2%2BhzjT5%2BRXmUUV4PpkXkvgQEJb8JrLPY7LqteV9ixeM7Ew@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D386@NTQ-EXC.nanoteq.co.za> <CALX0vxA3_eDRJmEGBak=e99nOrBkFYEmdnBHEY9JLTmT7tQ2vQ@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D3BB@NTQ-EXC.nanoteq.co.za> <CA%2B_eA9iG=4nemZxM_yETxGTMMC-oXPtMZmWc9DCp%2BqJaCQt4=g@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6C4F8D74A@NTQ-EXC.nanoteq.co.za> <20210517192054.0907beea@x23> <CAK7dMtD2vgzHG4XAxpcUoTnZCpmC2Onwa%2BUd%2Bw1dKb1W_TCxfQ@mail.gmail.com> <CA%2B_eA9joMB4C3=hdP9u0r7TkmeLLPX3=o1nCCqtk84kmkjFQkw@mail.gmail.com> <CAK7dMtDWor3KqdEshfaqUH2mgagU%2BvT2M6jgwAwKiNt9J1ec%2Bw@mail.gmail.com> <CAK7dMtB37iN0HQMuwX-Fk=SR%2Bnc4fZLa-N863%2BNOZe9d1ebG_g@mail.gmail.com> <AB9BB4D903F59549B2E27CC033B964D6F7A4F5C5@NTQ-EXC.nanoteq.co.za> <33b2b043-f3b7-e8e0-c290-f754082e0692@codenetworks.net> <AB9BB4D903F59549B2E27CC033B964D6F7A50DE9@NTQ-EXC.nanoteq.co.za>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Oct 4, 2021 at 4:35 AM Francois ten Krooden <ftk@nanoteq.com> wrote= : > > Hi Santiago > > The patches we have made is all available on the github fork we made from= the VPP repository. > It is located at https://github.com/ftk-ntq/vpp/tree/freebsd > So anyone who is interested can find it there. > > To make the VFIO support work I unfortunately have no idea. > I am not exactly sure but I think there is some kernel work required and = then an update to DPDK. > I am not sure how much effort that would be. I would like to take a look at this, maybe we should discuss it at the upcoming vendor summit https://wiki.freebsd.org/DevSummit/202111 > Kind Regards > > Francois ten Krooden > Principal Developer > > Nanoteq > Tel: +27 12 672 7000 > Fax: +27 12 665 1343 > Postal: P.O. Box 7991, Centurion, 0046 > Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue, Ce= nturion > > ________________________________________ > From: Santiago Martinez [sm@codenetworks.net] > Sent: Wednesday, September 22, 2021 11:22 AM > To: freebsd-net@freebsd.org > Subject: Re: Vector Packet Processing (VPP) portability on FreeBSD > > Hi Francois, I hope you are doing well. > > It is great to hear about work/progress/updates on VPP / DPDK / Netmap > on FBSD, even if the results are not the best. > > Unfortunately, I'm not a developer, so I cannot help much on the matter > of the missing bits. > Just wondering if those modifications that your team have done to make > VPP run can be upstreamed or shared with the community, so maybe we can > create a VPP package making it easier for others to deploy/test/improve. > > On the other hand, do you roughly know how much effort is required to > make VFIO support at the same level as Linux? > > I hope it makes sense. > > Best regards. > > Santiago > > > On 9/21/21 11:52 AM, Francois ten Krooden wrote: > > Hi > > > > This is just some feedback for those who had an interest in this topic. > > > > After spending quite some time on the VPP to FreeBSD porting effort whe= re we did manage to get VPP working with netmap, and VPP compiling with DPD= K; We realised that there are some big issues that we would need to overcom= e. Some of these efforts are not viable for our small team to accomplish in= a reasonable time frame. > > The main issues that we have found are: > > - Tests proved that netmap would not deliver the desired performance as= it is currently implemented within VPP. The main issues here are that for = every 256 packets memory seems to be allocated again, also a number of copi= es occur in the memory which slows down the performance. > > - VPP relies on VFIO to map device memory into user space for processin= g within the application. This code is implemented in DPDK in the Linux imp= lementation but in the FreeBSD implementation in DPDK these functions are s= tubbed. > > - To interface with crypto-offloading hardware such as the QAT card fro= m Intel, or our own card VPP/DPDK also utilize VFIO with the PCI device. > > - As far as we have been able to see the VFIO support in FreeBSD is not= at the same level as Linux, which would then require additional kernel dev= elopment which is not possible in the time frame. > > > > Regards > > > > Francois ten Krooden > > Principal Developer > > > > > > Tel: +27 12 672 7000 > > Fax: +27 12 665 1343 > > Postal: P.O. Box 7991, Centurion, 0046 > > Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue,= Centurion > > > > > > > > Important Notice: > > > > This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mai= l legal notice available at: > > http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx > > > > > > Important Notice: > > This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mail = legal notice available at: > http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx > > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAK7dMtD5TLdCBqk5Dk60OqpQUztuzg_CRqfy%2BQuYeS00s_zoig>