From owner-freebsd-xen@freebsd.org Tue Jul 14 21:45:03 2015 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 535679A159A for ; Tue, 14 Jul 2015 21:45:03 +0000 (UTC) (envelope-from syd.meyer@gmail.com) Received: from mail-wg0-x244.google.com (mail-wg0-x244.google.com [IPv6:2a00:1450:400c:c00::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E1EED16D4 for ; Tue, 14 Jul 2015 21:45:02 +0000 (UTC) (envelope-from syd.meyer@gmail.com) Received: by wgkl9 with SMTP id l9so1817603wgk.2 for ; Tue, 14 Jul 2015 14:45:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=PIBxQ4M3chSm640/rpso/HUqg5TmcGwcMTsFRavfzN4=; b=Ms5zoaZx6+COvjNlsE6XeL3vwiVAzNOkYDjQMqZEOn/Gn0idSI/pVs7ZIg8XOyiHqx yg+SN9XgBHnmj5o5aQ30x8DRHudc1BPz8MBtwkO91U0UACVxA0aic6Er9WyROcIJEvHL CkO81qkb0uoEgRczMzPa74eqLCmhkfRjdZLcSjb15W6sI6rd8adgm1SQcFHkxBGqyBXm Zr1JUGO/cMDgIJ8d3rEN0JSadoxobd/ZmiG3saxiB6E0alzgr4jywh6Q+5MHEbEdKtd5 djtXyaUN6sidM7IgdZWjQsxFNlnzMvkJlC+OgZ7uoZgAUL9QvMjoBuiZUf0AC+rMRLJP SJ+Q== X-Received: by 10.194.179.167 with SMTP id dh7mr1364853wjc.15.1436910301289; Tue, 14 Jul 2015 14:45:01 -0700 (PDT) Received: from macbookpro.home.sydneymeyer.net (131.69-67-87.adsl-dyn.isp.belgacom.be. [87.67.69.131]) by smtp.gmail.com with ESMTPSA id m10sm5479002wib.17.2015.07.14.14.45.00 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 14 Jul 2015 14:45:00 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.0 \(3067\)) Subject: Re: Networking under Xen From: Sydney Meyer In-Reply-To: <1436890526.3162974.323521249.6B73E6E2@webmail.messagingengine.com> Date: Tue, 14 Jul 2015 23:44:59 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <4B6D4AEF-6107-4F95-9F5A-F0EA137809AC@gmail.com> References: <4E7B7075-4E0D-4EA7-9F5D-6D252CFBD487@gmail.com> <1436890526.3162974.323521249.6B73E6E2@webmail.messagingengine.com> To: freebsd-xen@freebsd.org X-Mailer: Apple Mail (2.3067) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 21:45:03 -0000 > On 14 Jul 2015, at 18:15, Mark Felder wrote: >=20 >=20 >=20 > On Tue, Jul 14, 2015, at 07:36, Sydney Meyer wrote: >> Hello everybody, >>=20 >> i have noticed some odd behaviour with networking under Xen with = FreeBSD >> 10 as a DomU. >>=20 >> - IPv6 (TCP) bandwith drops from ~10 Gbit/s IPv4 to around 3 Gbit/s = IPv6. >> (measured with iperf) >>=20 >=20 > What is the "before" and "after" here? When is FreeBSD successfully > doing 10Gbit/s and when isn't it? Is pf enabled? Are you scrubbing? With two clean 10.1 AMD64 DomU installations both with a single, pinned = cpu, without pf enabled the TCP performance between the two hosts, = measured with iperf, differs between ~10 Gb/s on IPv4 and ~3 Gb/s on = IPv6. With pf enabled and "scrub in all" the difference is almost the = same. >=20 >> - Dropped/Stalled Connections with TCP Segmentation Offload and pf >> enabled. >>=20 >=20 > TSO is a known issue. I've been turning it off for years to get = FreeBSD > to play nice on Xen. This one i am still investigating, because it happens only in "certain" = situations (which are not clear to me, atm), but the host seems to drop = ACK Packets in some situations like when connected to via IPSEC or via = double NAT. This happens only when pf it actually enabled. Disabling TSO = on the xn-interface seems to help. >=20 >> - IPSEC-enabled Kernel TCP Performance drops from ~10 Gbit/s to ~200 >> Mbit/s (iperf). >>=20 >=20 > Are you saying FreeBSD non-IPSEC kernel can do 10Gbit/s TCP = performance, > but IPSEC kernel immediately drops it to 200Mbit/s? As for the apparent performance drop with IPSEC enabled Kernels without = security associations installed, i am unable to reproduce this now, not = on 10.0 or 10.1 nor 10 STABLE. Only when actually _using_ IPSec the = performance drops from ~10Gb/s to around ~200Mb/s whether actually = encrypting esp traffic or not. This clearly must have been a mistake on my side, although i could have = sworn that i checked this two times before asking on the forums and the = -net mailing list a few weeks ago. Well then, i am sincerely sorry about = this one. > _______________________________________________ > freebsd-xen@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-xen > To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org"