Date: Wed, 24 May 2023 11:17:29 +0800 From: Zhenlei Huang <zlei@FreeBSD.org> To: Marko Zec <zec@fer.hr> Cc: Benoit Chesneau <benoitc@enki-multimedia.eu>, "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org> Subject: Re: how to increase the vnet speed? Message-ID: <46D05994-43DB-4BEC-A3E3-C8B15C220155@FreeBSD.org> In-Reply-To: <20230523231533.32c1d022@x25> References: <TbR2mwTT9IpAlR-ds87h3qzhRbj1mVmWUGVVsmxQU2qq6Z1Bv52fsaB5LqUxaZT9ooHdXo2VIhcYQu2zkT7eVMxwbbfxIv6q2JNHp7l-ydM=@enki-multimedia.eu> <20230523231533.32c1d022@x25>
next in thread | previous in thread | raw e-mail | index | archive | help
> On May 24, 2023, at 5:15 AM, Marko Zec <zec@fer.hr> wrote: > > On Tue, 23 May 2023 19:58:07 +0000 > Benoit Chesneau <benoitc@enki-multimedia.eu> wrote: > >> Hi all, >> >> I've created a jail using bastille and setup network. The mainin >> terface is a 25Gbps nic and between hosts I get 24.6 Gbits/sec : > > [...] > >> But between one host and the jail I only get 3.96 Gbits/sec > > [...] > >> Is there a way to increase the performance of the of the jail? The >> nice is a mellannox ConnectX-4 Lx, mce(4) . > > Modern NICs offload a lot of the protocol stack processing (checksum, > segmentation, and / or reassembly) from the CPU to dedicated silicon, > whereas inter-vnet traffic needs to be handled completely in software, > that's where the difference comes from. > > Perhaps we could gain some speed by abusing mbuf flags to skip RXCSUM > for epair traffic, maybe even skip and fake TXCSUM... For epair I think it is doable. Other hardware offload features such as VLAN_HWTAGGING can be also taken into account. > > Marko > Best regards, Zhenlei
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?46D05994-43DB-4BEC-A3E3-C8B15C220155>