Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 16 Sep 2024 16:32:11 +0200
From:      Miroslav Lachman <000.fbsd@quip.cz>
To:        Sad Clouds <cryintothebluesky@gmail.com>
Cc:        Zhenlei Huang <zlei@freebsd.org>, Mark Saad <nonesuch@longcount.org>, FreeBSD Net <freebsd-net@freebsd.org>
Subject:   Re: Performance issues with vnet jails + epair + bridge
Message-ID:  <cd68d032-36fd-4b10-a087-5bbc79b09cdb@quip.cz>
In-Reply-To: <20240915185654.b51cfec5aa2520e5b801cc87@gmail.com>
References:  <20240913100938.3eac55c9fbd976fa72d58bb5@gmail.com> <39B2C95D-1E4F-4133-8923-AD305DFA9435@longcount.org> <20240913155439.1e171a88bd01ce9b97558a90@gmail.com> <A95066A8-F5FC-451B-85CE-C463952ABADE@FreeBSD.org> <20240914112516.cfb31bae68ab90b83ca7ad4b@gmail.com> <CACA0VUjE43FUTaqAtXTur-4akQybKytv-oc1rHxwoUUXM3VQ=Q@mail.gmail.com> <20240915185654.b51cfec5aa2520e5b801cc87@gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On 15/09/2024 19:56, Sad Clouds wrote:
> On Sun, 15 Sep 2024 18:01:07 +0100
> Doug Rabson <dfr@rabson.org> wrote:
> 
>> I just did a throughput test with iperf3 client on a FreeBSD 14.1 host with
>> an intel 10GB nic connecting to an iperf3 server running in a vnet jail on
>> a truenas host (13.something) also with an intel 10GB nic and I get full
>> 10GB throughput in this setup. In the past, I had to disable LRO on the
>> truenas host for this to work properly.
>>
>> Doug.
> 
> Hello Doug, can you please confirm that you are NOT using if_epair(4)? I
> imagine you dedicate one of the Intel 10Gb ports to a jail. This is not
> an option for some of us, so a virtual NIC of some sort is the only
> option with vnet jails. Other people also mentioned that vnet by itself
> is not an issue and your test confirms this, however I'm observing poor
> scalability specifically with the epair virtual NIC.
> 
> I will be trying netgraph when I have some more time. If there are
> other alternatives to if_epair then I would be interested to learn
> about them.

Try ngbuddy, it will help you with configuring netgraph.

Or you can create second loopback interface, for example lo1 and put 
your jails on it. I don't know what your scenario is, but I used lo1 in 
the past with private IPs (10.x.x.x or 172.16.x.x) for jails not facing 
the outside world, just communicating with the host)

You can put something similar to rc.conf:

cloned_interfaces="lo1"
# interface where all jails will bind
ifconfig_lo1="inet 172.16.55.22 netmask 255.255.255.0"

Then run: service netif cloneup

Kind regards
Miroslav Lachman




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?cd68d032-36fd-4b10-a087-5bbc79b09cdb>