From owner-freebsd-net@freebsd.org Tue Jan 2 19:11:09 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5C052EB4304 for ; Tue, 2 Jan 2018 19:11:09 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx1.enfer-du-nord.net (mx1.enfer-du-nord.net [IPv6:2001:41d0:302:1100::7:9a96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 229A06DD67; Tue, 2 Jan 2018 19:11:08 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from [IPv6:2003:8c:2e01:df01:bcbc:ff4e:2390:8572] (p2003008C2E01DF01BCBCFF4E23908572.dip0.t-ipconnect.de [IPv6:2003:8c:2e01:df01:bcbc:ff4e:2390:8572]) by mx1.enfer-du-nord.net (Postfix) with ESMTPSA id 3zB3Z00sPNz3N7; Tue, 2 Jan 2018 20:11:04 +0100 (CET) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.99.2 at mail.enfer-du-nord.net Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: [SOLVED] performance issue within VNET jail From: Michael Grimm In-Reply-To: <5FD6CE98-601B-46B7-B598-83BE5A31200A@ellael.org> Date: Tue, 2 Jan 2018 20:11:03 +0100 Cc: bryanv@FreeBSD.org Content-Transfer-Encoding: quoted-printable Message-Id: <53C901D3-FA1B-49E7-8623-7FE23493B7E8@ellael.org> References: <4F5EE3F6-0163-4435-8726-56B0D4AE9FAF@ellael.org> <8102F5FD-DCFC-4EF8-A443-9E6C9EB1F467@ellael.org> <8C8A172B-4D4F-4066-8B94-EF5F59E2D345@ellael.org> <5A3D67EC.6010907@grosbein.net> <53687746-C487-4712-AA52-DE86CE70FDEF@ellael.org> <5FD6CE98-601B-46B7-B598-83BE5A31200A@ellael.org> To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3445.5.20) X-Spam-Status: No, score=2.2 required=5.0 tests=RDNS_NONE,SPF_SOFTFAIL autolearn=no autolearn_force=no version=3.4.1 X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail.mer-waases.lan X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Jan 2018 19:11:09 -0000 Hi, let me come back to this issue I did report end of last year: = https://lists.freebsd.org/pipermail/freebsd-net/2017-December/049470.html My setup: vtnet/pf-NAT <=E2=80=94> epairXa (bridge0) epairXb <-> vnet jail My observations regarding a sample download like "wget = https://download.freebsd.org/ftp/releases/ISO-IMAGES/11.1/FreeBSD-11.1-REL= EASE-amd64-bootonly.iso -O /dev/null" (-) expected performance at the host of about 30 MB/s (-) dramatic loss of performance inside a vnet jail down to = about 80 KB/s My solution: adding 'hw.vtnet.lro_disable=3D"1"' to /boot/loader.conf In the meantime I did find a comparable reference regarding Linux:=20 "Previously, network drivers that had Large Receive Offload = (LRO) enabled by default caused the system to run slow,=20 lose frame, and eventually prevent communication, when using = software bridging. With this update, LRO is automatically=20 disabled by the kernel on systems with a bridged configuration, = thus preventing this bug." https://bugzilla.redhat.com/show_bug.cgi?id=3D772317 I do not have the knowledge to judge if that should be disabled in = FreeBSD as well when software bridging is involved, thus I just want to = let you know.=20 (And that's the reason that I have included the author of the vnet = driver in CC.) With kind regards, Michael=