Date: Sat, 13 Aug 2022 09:20:47 +0000 From: Benoit Chesneau <benoitc@enki-multimedia.eu> To: Santiago Martinez <sm@codenetworks.net>, "freebsd-net@FreeBSD.org" <freebsd-net@FreeBSD.org>, Michael Dexter <editor@callfortesting.org> Subject: Re: 25/100 G performance on freebsd Message-ID: <AkeC1lFtRXZ0jmpDIH9sku4ziVstLtRr5TYObntyoPNwPwTowG2o62GaEnjB0Ytkkpx0pYyBDJmBilwgwG6LtL4mZcworq00TEswBr8i9uE=@enki-multimedia.eu> In-Reply-To: <2f362689-0feb-bd41-93b2-afb46b4a4a08@codenetworks.net> References: <PK-t3XGZbrHHDgmV_l5kcpPk_2vXVFRijVzpcBtEJd3UWc3iFs7ygJKiHXFAVTaWg5botdaiI85UJdmjxKV268xTH-xf89igEf7axDGqYmc=@enki-multimedia.eu> <2f362689-0feb-bd41-93b2-afb46b4a4a08@codenetworks.net>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Santiago thanks for the help.
I am curious about your vale setup. Do you have only internal bridges? Do you bridge the NIC interface or are doing L3?
Afaik i am trying to dind what would be the most efficient way to use the 25GB interfaces whle isolating the services on them. I very hesitant of the approach and unsure if freebsd these days can fit the bill:
* run isolated services over the 2x25G . would jails limit the bandwith?
* possibly run bhyve services when linux or else is needed .
Would using only L3 routing solve some performances issues?
benoit
On Wed, Aug 10, 2022 at 23:31, Santiago Martinez <sm@codenetworks.net> wrote:
> Hi Benoit, sorry to hear that the SR-IOV still not working on your HW.
>
> Have you tested the last patch from Intel?
>
> Regarding Bhyve, you can use Vale switches (based on netmap).
> On my machines, i get around ~33Gbps between VM (same local machine), sometimes going towards 40Gbps... ( These are basic tests with iperf3 and TSO/LRO enabled).
>
> @Michael Dexter is working on a document that contains configuration examples and test results for the different network backend available in bhyve.
>
> If you need help, let me know and we can set up a call.
> Take care.
> Santi
>
> On 8/8/22 08:57, Benoit Chesneau wrote:
>
>> For some reasons. I can’t use SR-IOV on my freebsd machines (HPE DL160 gen10) with latest 25G HPE branded cards. I opened tickets for that but since then no move happened.
>>
>> So I wonder id there is a good setup to use these cards with the virtualization. Which kind of performance should I expect using if_bridge? What if i am doing L3 routing instead using epair or tap (for bhyve). Would it work better?
>>
>> Any hint is welcome,
>>
>> Benoît
[-- Attachment #2 --]
<html><head></head><body> <div><br></div>Santiago thanks for the help.<div><br></div><div>I am curious about your vale setup. Do you have only internal bridges? Do you bridge the NIC interface or are doing L3? </div><div><br></div><div>Afaik i am trying to dind what would be the most efficient way to use the 25GB interfaces whle isolating the services on them. I very hesitant of the approach and unsure if freebsd these days can fit the bill:</div><div><br></div><div>* run isolated services over the 2x25G . would jails limit the bandwith? </div><div>* possibly run bhyve services when linux or else is needed . </div><div><br></div><div>Would using only L3 routing solve some performances issues?<caret></caret> </div><div><br></div><div><br></div><div>benoit<br> <div><br></div><div><br></div>On Wed, Aug 10, 2022 at 23:31, Santiago Martinez <<a href="mailto:sm@codenetworks.net" class="">sm@codenetworks.net</a>> wrote:<blockquote class="protonmail_quote" type="cite">
Hi Benoit, sorry to hear that the SR-IOV still not working on your
HW. <br>
<br>
Have you tested the last patch from Intel? <br>
<br>
Regarding Bhyve, you can use Vale switches (based on netmap). <br>
On my machines, i get around ~33Gbps between VM (same local
machine), sometimes going towards 40Gbps... ( These are basic tests
with iperf3 and TSO/LRO enabled).<br>
<br>
@Michael Dexter is working on a document that contains configuration
examples and test results for the different network backend
available in bhyve.<br>
<br>
If you need help, let me know and we can set up a call.<br>
Take care.<br>
Santi
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">On 8/8/22 08:57, Benoit Chesneau wrote:<br>
</div>
<blockquote type="cite">
<div>For some reasons. I can’t use SR-IOV on my
freebsd machines (HPE DL160 gen10) with latest 25G HPE branded
cards. I opened tickets for that but since then no move
happened.</div>
<div><br>
</div>
<div>So I wonder id there is a good setup to use these cards with
the virtualization. Which kind of performance should I expect
using if_bridge? What if i am doing L3 routing instead using
epair or tap (for bhyve). Would it work better?</div>
<div><br>
</div>
<div>Any hint is welcome,</div>
<div><br>
</div>
<div>Benoît</div>
<div><br>
</div>
</blockquote>
</blockquote></div></body></html>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AkeC1lFtRXZ0jmpDIH9sku4ziVstLtRr5TYObntyoPNwPwTowG2o62GaEnjB0Ytkkpx0pYyBDJmBilwgwG6LtL4mZcworq00TEswBr8i9uE=>