From owner-freebsd-net@freebsd.org Tue Jun 25 14:58:06 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E2FAF15CEABD; Tue, 25 Jun 2019 14:58:05 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa4.hc3370-68.iphmx.com (esa4.hc3370-68.iphmx.com [216.71.155.144]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "esa4.hc3370-68.iphmx.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 454108E690; Tue, 25 Jun 2019 14:58:03 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: F+ZM2OCDeMS9HPxSOqBkcCbxLavjozwQSUSWl6QMHa9BxgRax+sCXgfrs8RZ4diyZ7C3X94ipP DTkqMQiCSG0ZV/s+LXgPKDcWulana2ijQiEH68Pad9ohWDBInB8k2qIdu9oamLoZHP9wl/uQcb wqcYn59yi0CztRAhJ3+qX5oK/oPUs4b0DHX9fVxH4gaudtPJCpqVZUT7j1frV5bI/uAGVxHfGU zhBxSK0W43c4QrAMGbQ0I3phnU/bqLDXPM4YJlwIunfWiRsJJZM7WZLZi5nuawo0FqqRGVt116 kEE= X-SBRS: 2.7 X-MesageID: 2229330 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.63,416,1557201600"; d="scan'208";a="2229330" Date: Tue, 25 Jun 2019 16:56:43 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Christian M CC: , Subject: Re: Very slow and inconsistent internal network speed (between, VM's on the same host) for FreeBSD 11.0+ as guest on, XCP-ng/XenServer Message-ID: <20190625145643.shasw7bcgu6s2hg7@MacBook-Air-de-Roger.local> References: <12994df1-f847-ec92-aae8-43a32e59385f@darco.dk> <20190625082103.qiiz2cikrauaqlas@MacBook-Air-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20180716 X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-Rspamd-Queue-Id: 454108E690 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of roger.pau@citrix.com designates 216.71.155.144 as permitted sender) smtp.mailfrom=roger.pau@citrix.com X-Spamd-Result: default: False [-3.97 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:216.71.155.144]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[citrix.com]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: mx1.hc3370-68.iphmx.com]; NEURAL_HAM_SHORT(-0.80)[-0.800,0]; RCVD_IN_DNSWL_NONE(0.00)[144.155.71.216.list.dnswl.org : 127.0.3.0]; IP_SCORE(-0.86)[ip: (-1.33), ipnet: 216.71.154.0/23(-1.80), asn: 16417(-1.10), country: US(-0.06)]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Jun 2019 14:58:06 -0000 On Tue, Jun 25, 2019 at 01:55:40PM +0200, Christian M wrote: > I've made two tests while running tcpdump on the xcp-ng host. I'm not at > all qualified to interpret the .pcap files from tcpdump, but I've put them > on Google Drive and linked them below the two tests. Perhaps someone more > qualified could have a look for anything useful in there. Please note the > extremely uneven throughput for test 2 below. It's almost like the > throughput increased when running tcpdump simultaneously. > > Host: XCP-ng 7.6.0 > Network: Private Network on host, not connected to any PIF. > VM1: 12.0-RELEASE (1 VIF, 172.31.16.125) > VM2: 12.0-RELEASE (1 VIF, 172.31.15.126) > > On the host I listen with tcpdump on the VIF for VM1 in both tests. > > VM1 as client: > > On XCP-ng: tcpdump -i vif42.0 -s 0 -w xcp-ng-vm1-client.pcap Can you check the capabilities of vif42.0? (ie: whether csum offloading is actually disabled on the host?) > xcp-ng-vm1-client.pcap (80M): > https://drive.google.com/open?id=1eR3fetvKRz3vFSXCxDKuJYFrQ3wLqjrU > On VM1: iperf3 -c 172.31.16.126 > On VM2: iperf3 -s I've taken a look at the dump and the checksum is wrong (or maybe missing) for all? packets. Packets with source 172.31.16.125 all have the TCP checksum set to 0x7f80 and all packets with source 172.31.16.125 have the TCP checksum set to 0x7960. FTR, can you also paste the ifconfig output of each interface before running iperf? Thanks, Roger.