From owner-freebsd-net@freebsd.org Mon Jun 24 14:51:54 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9347E15CFE97; Mon, 24 Jun 2019 14:51:54 +0000 (UTC) (envelope-from christian.marcos@gmail.com) Received: from mail-io1-xd35.google.com (mail-io1-xd35.google.com [IPv6:2607:f8b0:4864:20::d35]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7B80F7174B; Mon, 24 Jun 2019 14:51:53 +0000 (UTC) (envelope-from christian.marcos@gmail.com) Received: by mail-io1-xd35.google.com with SMTP id s7so2804074iob.11; Mon, 24 Jun 2019 07:51:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=N78XGcxDZPBC4lC31H9eptysrteZcTOPbm/1JgSfN0w=; b=pCU4VoA/nngBhzGBLJ0JinhUbUt2NNQ+XWzYuRecMdLnzk20Ga3twgHF1fFJic7OK8 aHpvqGK+E3UoeHhwRbyLdt6mPvpZZabuKZMMuvYTMu4Z6Dq+tcgx+i+cLq2IQJNPAwLh R0A9WtIRrwD2IdmRj2Ek4v0dJG5ChvliCrlQhxRWX3wbl06aKTSPfWjJEw2UdvCoK92a f5RBRlocx/vVapXk5jh78d5IoK5S41sWL8kiczd0MNm7xIOYHfhZ6C+nxc6PoPgUsGjv BeHClxfkvI/Fk1anIrePXJB1KYWniVBdY71Rn3cAWt4bWWwT/UMZycUiRdMcaWwqYdwA TQ1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=N78XGcxDZPBC4lC31H9eptysrteZcTOPbm/1JgSfN0w=; b=ckKfsHeZzgyS8Pg74UEC6WzXyNnLh/XbGKKSC4bY1hyrY1Z3lMlE27IJhJUQnH2R9d FVY1IFJCBoATOH5fokxHiblxey0Au6qQbHv1Zpqi9ycgi99ie23rB3+vR87R24WLTRjI XflGJ8kHu1UZxKAJKvz3E68uVGn+Xo65Ap8zalDhAwFFIvmPwCc1V5IYnkug2BpV4YgP 9BvFCl73gZlgoeQaq5jtXn/NtRW2UHexahc7mEe+oPRBJIe7gUjY90s412CfkunZv4Pk OrFk1hUg4r/fzxnktpTi90FZ6auIdOezHBEyMk1JVRBkF3tEiOKP4EKL7Yz94x37pbdR Wt3A== X-Gm-Message-State: APjAAAX53uE/3JKwm6q/+1Y4Jaxm6C2cdFrhZMqfMsAn7UB5kz/Rg3Ry EdT4gAK10Ba1up+Zx8Nja/FyHBD5J9EZfBxsS+s= X-Google-Smtp-Source: APXvYqxsR134wMRWk7crWMeki02iqd+n6Gp1WvX7wrU4S/MjPIqWZtUDaV+9WYo6Ro2XkuN7Tk8uFfiHbwh9cVZc0YE= X-Received: by 2002:a6b:b7d5:: with SMTP id h204mr5621579iof.188.1561387912474; Mon, 24 Jun 2019 07:51:52 -0700 (PDT) MIME-Version: 1.0 References: <20190620143917.h4tq2xtgz4nbgkth@MacBook-Air-de-Roger.local> In-Reply-To: <20190620143917.h4tq2xtgz4nbgkth@MacBook-Air-de-Roger.local> From: Christian M Date: Mon, 24 Jun 2019 16:51:41 +0200 Message-ID: Subject: Re: Very slow and inconsistent internal network speed (between VM's on the same host) for FreeBSD 11.0+ as guest on XCP-ng/XenServer To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-xen@freebsd.org, freebsd-net@freebsd.org X-Rspamd-Queue-Id: 7B80F7174B X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=pCU4VoA/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of christianmarcos@gmail.com designates 2607:f8b0:4864:20::d35 as permitted sender) smtp.mailfrom=christianmarcos@gmail.com X-Spamd-Result: default: False [-6.80 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[5.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-2.88)[ip: (-8.85), ipnet: 2607:f8b0::/32(-3.14), asn: 15169(-2.33), country: US(-0.06)]; NEURAL_HAM_SHORT(-0.92)[-0.916,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Jun 2019 14:51:54 -0000 Den tors 20 juni 2019 kl 16:39 skrev Roger Pau Monn=C3=A9 : > > Do you see the same issues with external connections? Have you tested > throughput between two FreeBSD 12.0 VM running on different hosts? > > I've tested 12.0-RELEASE between two hosts (XCP-ng 7.6.0 and Citrix CXenserver 7.2.0) over Gbit link, and iperf results is about 600Mbit/s back and forth. I also tested 12.0-RELEASE on same XCP-ng host, but changed the network from Private Network to the Internal Network (that's connected to a PIF). That increased speed slightly, but It's still below 100mbit back and forth. > > > Hm, OK that's weird, I don't think however it's related to Xen. Have > you tried if the same happens on a bare-metal install of FreeBSD? > > Or when running on a different hypervisor? > > I have not. I only have XCP-ng 7.6.0 and Citrix XenServer 7.x to play with currently. I have no server at this moment to test a bare metal install on, but if you believe this is an important test I could perhaps find a machine to try it on. Please let me know if I should proceed with this. > > > > > Any ideas of how to proceed now to find a solution for this? > > Maybe you can try to run wireshark/tcpdump or some other similar > software in order to try to detect if there are errors on the > transmitted packets? > > You could run the sniffer on the host and attach it to the backend > interfaces (vifX.X) or the bridge if you are using bridged > networking. > > The 12.0 <-> 12.0 case seems quite bad, so I would start with that > one. > > Roger. > I have now run tshark (wireshark) to capture traffic between 12.0 <-> 12.0 on the private network (running tshark on freebsd). I'm really not qualified to interpret the output, so I'll link to the capture-output here: capture-output.pcap: https://drive.google.com/open?id=3D1zU6qhZO7OOKfLRugXJovYIQuFCLrouH6 (218MB= ) output.txt (tshark -r capture-output.pcap > output.txt): https://drive.google.com/open?id=3D1ORJy_jhDyAIgmw1WnXBsPQSlIxqEzVrF (34MB) I'm not really sure how to run it on XCP-ng, or is there perhaps another tool I can use for that other than tshark? Thanks, Christian