Date: Mon, 14 Mar 2016 07:29:28 +0100 From: Gala IT <it@galasoluciones.com> To: Alexey Tarasov <me@lexasoft.ru> Cc: stable@freebsd.org Subject: Re: Virtio network: poor network with KVM hypervisor (latest Proxmox) Message-ID: <2F99614D-7F00-4120-A26B-D21EB05077DC@galasoluciones.com> In-Reply-To: <93EDB7DE-7940-4525-AC7C-E9D62290375D@lexasoft.ru> References: <93EDB7DE-7940-4525-AC7C-E9D62290375D@lexasoft.ru>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi Alexey,
Can=E2=80=99t bring in much light, but here are our settings under =
QEMU-KVM 2.1.0 (qemu-system-x86_64):
kern.ipc.maxsockbuf=3D4194304
net.inet.tcp.sendbuf_max=3D4194304
net.inet.tcp.recvbuf_max=3D4194304
net.inet.tcp.recvspace=3D262144
net.inet.tcp.sendspace=3D262144
net.inet.tcp.mssdflt=3D1460
net.inet.tcp.minmss=3D1300
net.inet.tcp.sendbuf_inc=3D16384
net.inet.tcp.recvbuf_inc=3D524288
We dind=E2=80=99t change any of the eth. settings:
em0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu =
1500
options=3D80028<VLAN_MTU,JUMBO_MTU,LINKSTATE>
nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-T <full-duplex> (this is autodetected, =
we=E2=80=99re not enforcing it in any way)
status: active
We didn=E2=80=99t have as huge of a problem as you do, but we usually =
didn=E2=80=99t get over 10-15 Mbps both inbound and outbound for a =
single TCP connection. Now we easily see 50Mbps ratios, which is way =
more reasonable, although not impressive.
IIRC the biggest change came after changing:
net.inet.tcp.mssdflt=3D1460
net.inet.tcp.minmss=3D1300
net.inet.tcp.sendbuf_inc=3D16384
net.inet.tcp.recvbuf_inc=3D524288
We=E2=80=99re on 9.3-RELEASE-p5.
I can=E2=80=99t seem to enable/disable TSO or LRO via ifconfig, neither =
I can find any sysctl tunables related to this (man vtnet reads that =
there should be some):
# sysctl hw. | grep vtnet
# (no output)
Hope it helps. Please let us know if you find out anything else, as =
we=E2=80=99re also interested in getting some more throughput out of =
those interfaces!
Best,
David
> El 1 mar=C3=A7 2016, a les 12:30, Alexey Tarasov <me@lexasoft.ru> va =
escriure:
>=20
> Hi all!=20
>=20
> I am using the latest Proxmox 4.1 with all updates installed.=20
> I have several VM's with FreeBSD guests and 1 VM with Ubuntu 14 (all =
KVM).=20
> Host system file download speed: 60 MBps.=20
> FreeBSD guest download speed: 2 MBps on virtio network with TSO =
enabled, 5-9 MBps with TSO disabled; 12 MBps on e1000 network.=20
> Ubuntu guest: 60 MBps with virtio.=20
>=20
> I've tried the following:=20
> 1) Different FreeBSD versions: 9.3, 10.2, 10.3-BETA3.=20
> 2) Different TSO settings, enabling/disabling RXCSUM.=20
> 3) Different TSO settings on host system.=20
>=20
> The best results I got described above :(=20
>=20
> Does anyone have any ideas how to get full network performance inside =
FreeBSD guests?=20
>=20
> --
> Alexey Tarasov
>=20
> (\__/)=20
> (=3D'.'=3D)=20
> E[: | | | | :]=D0=97=20
> (")_(")
>=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2F99614D-7F00-4120-A26B-D21EB05077DC>