From owner-freebsd-stable@freebsd.org Mon Mar 14 06:37:45 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EFB2AD0E77 for ; Mon, 14 Mar 2016 06:37:45 +0000 (UTC) (envelope-from it@galasoluciones.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 23E13B7F for ; Mon, 14 Mar 2016 06:37:45 +0000 (UTC) (envelope-from it@galasoluciones.com) Received: by mailman.ysv.freebsd.org (Postfix) id 1F7F1AD0E76; Mon, 14 Mar 2016 06:37:45 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 05477AD0E75 for ; Mon, 14 Mar 2016 06:37:45 +0000 (UTC) (envelope-from it@galasoluciones.com) Received: from mail.galasoluciones.com (maduixa.galasoluciones.com [92.222.120.224]) by mx1.freebsd.org (Postfix) with ESMTP id 9615FB7E for ; Mon, 14 Mar 2016 06:37:44 +0000 (UTC) (envelope-from it@galasoluciones.com) Received: from maduixa.galasoluciones.com (localhost [127.0.0.1]) by mail.galasoluciones.com (Postfix) with ESMTP id 569CF4E606; Mon, 14 Mar 2016 07:26:38 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=galasoluciones.com; s=mail; t=1457936798; bh=4g/R2tfmonlv59tEhuGTz7dkrRHtfVfRvBCGrfrOtuM=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=NoF1i0Ec75VsStvKluLeZMzSYkjc7tx+6iUF2EBI1cMPMshY5QXp4kn9drA26dr8y cIRHPwnK5ZzRlr0TWuhnWIumBUSEuYJxHRjnwRZf6dIFsVB6FhBIwYfbeNK71a6K4V sAHItilVDdx2CbDI5C2TD3ZqzOg0ev+CR8e9ZFqA= X-Virus-Scanned: amavisd-new at galasoluciones.com Received: from mail.galasoluciones.com ([127.0.0.1]) by maduixa.galasoluciones.com (maduixa.galasoluciones.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6EyedXYOMB1F; Mon, 14 Mar 2016 07:26:36 +0100 (CET) Received: from [192.168.0.107] (cli-5b7ef0fc.bcn.adamo.es [91.126.240.252]) by mail.galasoluciones.com (Postfix) with ESMTPA id 438E84E605; Mon, 14 Mar 2016 07:26:36 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=galasoluciones.com; s=mail; t=1457936796; bh=4g/R2tfmonlv59tEhuGTz7dkrRHtfVfRvBCGrfrOtuM=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=gyWkZDyKyGHO5YEaZUzR+SH1IyVA1dyi1Mxu/DKsrIpukqUttrY3HvnZAm0aU+c/2 Lz4kLEKjW+RA6x8pvWa//dNYg4dmd0L8i8RS48Q4HJX71wYs2JAx8S9ZSGd3mRmBx0 jajEkyXOspNOqgsDR2ph/zs2tvxScWUg2SBAkkP8= Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) Subject: Re: Virtio network: poor network with KVM hypervisor (latest Proxmox) From: Gala IT In-Reply-To: <93EDB7DE-7940-4525-AC7C-E9D62290375D@lexasoft.ru> Date: Mon, 14 Mar 2016 07:29:28 +0100 Cc: stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2F99614D-7F00-4120-A26B-D21EB05077DC@galasoluciones.com> References: <93EDB7DE-7940-4525-AC7C-E9D62290375D@lexasoft.ru> To: Alexey Tarasov X-Mailer: Apple Mail (2.3112) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Mar 2016 06:37:45 -0000 Hi Alexey, Can=E2=80=99t bring in much light, but here are our settings under = QEMU-KVM 2.1.0 (qemu-system-x86_64): kern.ipc.maxsockbuf=3D4194304 net.inet.tcp.sendbuf_max=3D4194304 net.inet.tcp.recvbuf_max=3D4194304 net.inet.tcp.recvspace=3D262144 net.inet.tcp.sendspace=3D262144 net.inet.tcp.mssdflt=3D1460 net.inet.tcp.minmss=3D1300 net.inet.tcp.sendbuf_inc=3D16384 net.inet.tcp.recvbuf_inc=3D524288 We dind=E2=80=99t change any of the eth. settings: em0: flags=3D8843 metric 0 mtu = 1500 options=3D80028 nd6 options=3D29 media: Ethernet 10Gbase-T (this is autodetected, = we=E2=80=99re not enforcing it in any way) status: active We didn=E2=80=99t have as huge of a problem as you do, but we usually = didn=E2=80=99t get over 10-15 Mbps both inbound and outbound for a = single TCP connection. Now we easily see 50Mbps ratios, which is way = more reasonable, although not impressive. IIRC the biggest change came after changing: net.inet.tcp.mssdflt=3D1460 net.inet.tcp.minmss=3D1300 net.inet.tcp.sendbuf_inc=3D16384 net.inet.tcp.recvbuf_inc=3D524288 We=E2=80=99re on 9.3-RELEASE-p5. I can=E2=80=99t seem to enable/disable TSO or LRO via ifconfig, neither = I can find any sysctl tunables related to this (man vtnet reads that = there should be some): # sysctl hw. | grep vtnet # (no output) Hope it helps. Please let us know if you find out anything else, as = we=E2=80=99re also interested in getting some more throughput out of = those interfaces! Best, David > El 1 mar=C3=A7 2016, a les 12:30, Alexey Tarasov va = escriure: >=20 > Hi all!=20 >=20 > I am using the latest Proxmox 4.1 with all updates installed.=20 > I have several VM's with FreeBSD guests and 1 VM with Ubuntu 14 (all = KVM).=20 > Host system file download speed: 60 MBps.=20 > FreeBSD guest download speed: 2 MBps on virtio network with TSO = enabled, 5-9 MBps with TSO disabled; 12 MBps on e1000 network.=20 > Ubuntu guest: 60 MBps with virtio.=20 >=20 > I've tried the following:=20 > 1) Different FreeBSD versions: 9.3, 10.2, 10.3-BETA3.=20 > 2) Different TSO settings, enabling/disabling RXCSUM.=20 > 3) Different TSO settings on host system.=20 >=20 > The best results I got described above :(=20 >=20 > Does anyone have any ideas how to get full network performance inside = FreeBSD guests?=20 >=20 > -- > Alexey Tarasov >=20 > (\__/)=20 > (=3D'.'=3D)=20 > E[: | | | | :]=D0=97=20 > (")_(") >=20