From owner-freebsd-jail@freebsd.org Thu Dec 21 20:39:53 2017 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1B7EDE892FE; Thu, 21 Dec 2017 20:39:53 +0000 (UTC) (envelope-from srs0=bbyf=dr=sigsegv.be=kristof@codepro.be) Received: from venus.codepro.be (venus.codepro.be [IPv6:2a01:4f8:162:1127::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.codepro.be", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A754677654; Thu, 21 Dec 2017 20:39:52 +0000 (UTC) (envelope-from srs0=bbyf=dr=sigsegv.be=kristof@codepro.be) Received: from [192.168.228.1] (ptr-8ripyyhtmq100mi0yvj.18120a2.ip6.access.telenet.be [IPv6:2a02:1811:2419:4e02:e137:9435:e3a1:1a8f]) (Authenticated sender: kp) by venus.codepro.be (Postfix) with ESMTPSA id B482237C13; Thu, 21 Dec 2017 21:39:49 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sigsegv.be; s=mail; t=1513888789; bh=6hL79YC2NK2PptCdyIOzYzmY3O5K/hx2/NTMQ/Rse0Y=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=OWnNGkyVj3idYVW9FX7ICcU03qHT2ys39emr96EaxRUb8uvQuw7fPK6abXz+EExqd l/JoJ/MU1u9SP2wfTfSbNUxfAjmUIEwKeN30lZ+jDvucb5CeA1HeFvyp+jaBkaUEdV CZjWBonk0/5qn/N9Feb8N2bv2oYlQfo2pm/tGcWE= From: "Kristof Provost" To: "Michael Grimm" Cc: freebsd-jail@FreeBSD.org, freebsd-net@freebsd.org Subject: Re: performance issue within VNET jail Date: Thu, 21 Dec 2017 21:39:48 +0100 X-Mailer: MailMate (2.0BETAr6102) Message-ID: In-Reply-To: <4F5EE3F6-0163-4435-8726-56B0D4AE9FAF@ellael.org> References: <4F5EE3F6-0163-4435-8726-56B0D4AE9FAF@ellael.org> MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Dec 2017 20:39:53 -0000 On 21 Dec 2017, at 21:24, Michael Grimm wrote: > > I do have to admit that I am lost here, and that I cannot think about > what is going wrong. The last download I did try at my old severs has > been some weeks ago. Ever since I did upgrade FreeBSD 11.1-STABLE, and > I did move my infrastructure from bare metal to cloud, thus I cannot > test anymore if my old servers would have shown that performance issue > in the meantime. > > Thus any feedback is highly recommended! > Can you try turning off TSO? (`ifconfig $ifname -tso`) There have been issues with pf and TSO checksums, which looked a lot like this (i.e. bad TCP performance). Those problems should be fixed, but this is easy to test. Regards, Kristof From owner-freebsd-jail@freebsd.org Thu Dec 21 20:50:28 2017 Return-Path: Delivered-To: freebsd-jail@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D87B5E89DF4; Thu, 21 Dec 2017 20:50:28 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from mx1.enfer-du-nord.net (mx1.enfer-du-nord.net [91.121.41.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A4D8777E0C; Thu, 21 Dec 2017 20:50:28 +0000 (UTC) (envelope-from trashcan@ellael.org) Received: from [IPv6:2003:8c:2e04:e501:40cc:d10e:17c0:531] (p2003008C2E04E50140CCD10E17C00531.dip0.t-ipconnect.de [IPv6:2003:8c:2e04:e501:40cc:d10e:17c0:531]) by mx1.enfer-du-nord.net (Postfix) with ESMTPSA id 3z2kL2420czDnb; Thu, 21 Dec 2017 21:50:18 +0100 (CET) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: performance issue within VNET jail From: Michael Grimm In-Reply-To: Date: Thu, 21 Dec 2017 21:50:17 +0100 Cc: freebsd-net@freebsd.org, freebsd-jail@FreeBSD.org Content-Transfer-Encoding: quoted-printable Message-Id: <8102F5FD-DCFC-4EF8-A443-9E6C9EB1F467@ellael.org> References: <4F5EE3F6-0163-4435-8726-56B0D4AE9FAF@ellael.org> To: Kristof Provost X-Virus-Scanned: clamav-milter 0.99.2 at mail X-Virus-Status: Clean X-Mailer: Apple Mail (2.3445.5.20) X-BeenThere: freebsd-jail@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion about FreeBSD jail\(8\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Dec 2017 20:50:28 -0000 Kristof Provost wrote: >=20 > On 21 Dec 2017, at 21:24, Michael Grimm wrote: >> I do have to admit that I am lost here, and that I cannot think about = what is going wrong. The last download I did try at my old severs has = been some weeks ago. Ever since I did upgrade FreeBSD 11.1-STABLE, and I = did move my infrastructure from bare metal to cloud, thus I cannot test = anymore if my old servers would have shown that performance issue in the = meantime. >>=20 >> Thus any feedback is highly recommended! > Can you try turning off TSO? (`ifconfig $ifname -tso`) >=20 > There have been issues with pf and TSO checksums, which looked a lot = like this (i.e. bad TCP performance). Those problems should be fixed, = but this is easy to test. >=20 I did try it, but without success.=20 This only worked for the external interface, though. Both epairX = interfaces didn't accept that command: ifconfig: -tso: Invalid argument I did mention that I previously tried "sysctl net.inet.tcp.tso=3D0". = That shoukld do the same, right? Thanks and regards, Michael