From owner-freebsd-net@freebsd.org Thu Jul 4 09:00:10 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD4A415CDA8F; Thu, 4 Jul 2019 09:00:09 +0000 (UTC) (envelope-from christian.marcos@gmail.com) Received: from mail-io1-xd2b.google.com (mail-io1-xd2b.google.com [IPv6:2607:f8b0:4864:20::d2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 02FA587871; Thu, 4 Jul 2019 09:00:09 +0000 (UTC) (envelope-from christian.marcos@gmail.com) Received: by mail-io1-xd2b.google.com with SMTP id h6so11382755ioh.3; Thu, 04 Jul 2019 02:00:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=R6ZVpY4DFhvpA1IVhW/B+YgAgCRjSDPCO114z2rwVHM=; b=I8JPMJQVOGqjCTEIAvyO27tqkFz62V9WiJNfqVRiAAgJmevkFP40i3OUufgIEaMLWw iYJRB7dAnRs59VUJSzZ9i+kLePuts4BxtCP8hx0r2tCNhKZEPSNbNiaYAOsHotE2q0Mh 51Rl1hJdOS2eWpB3DFElA+vU1UnbsZKo5/rbaHZMH6NnR18GyYKTuUJIqRFQr3gWDni5 ubnomA41UhSxrlfGJBAOIVizV0+ou2IYu8SSkU89jcuA1d1uCiHIJe8DjdT4uHfc8rsX iXz2LERATJUl6+tJOpID/eTwiR/kF3jEkszw8S0FnPfG6ZwPgl7C8aSHe8GRGlcgfVEV AG9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=R6ZVpY4DFhvpA1IVhW/B+YgAgCRjSDPCO114z2rwVHM=; b=mbMK/rJEqSGKG3DCXTmNUpV2IHRezJkGN0zFvVHwcq/JipA/vhjFJ8Q6lFZ48dG2+p 7An1iEVEpCbCkZLeM3x/w9KD/mOX7dYbHNaeUfzrJ10Y+mOfkF65ZqOT8sdHpqls56zL id9cdcI+2LDc4lw4curFNZBOXnG/dwB4FrprMH8t9ZP3p/CtBoSNx12FYjlqYeE1Pdf9 uWRbwAnWPgx3p8poC//s/NZ0tSk4WDyv6UqU5fYOYLUxd4CxVKw2X1EnCaPwKRJF/tKY +/kQFhXIuz+1l1DBMUFHp7ysjfX/6VzLxQnZXWPVgz0VNjxEgn0TVfTn6h6/r2c+C5ff 9NTw== X-Gm-Message-State: APjAAAXP3J4CZmGRxb5UbBRemi8iLGhtNJv2TRDVUlGe3edOEtOpiKhp qXVcESDDcCD2LSqowW8hQbMNoXdnTcvJqhz5lR8= X-Google-Smtp-Source: APXvYqxHMFqzQ2CyBc1qWYbZOjElyGAe4B2zNTaIdIGKM+jG4i7F2TApbMCCIgEVOExUoXYjNsLcNrc5q+0P/FNvrYM= X-Received: by 2002:a02:710f:: with SMTP id n15mr46618313jac.119.1562230807926; Thu, 04 Jul 2019 02:00:07 -0700 (PDT) MIME-Version: 1.0 References: <9c377fe7-5546-9e0b-fac9-076dd094cbac@grosbein.net> <47bb1bfe-ac39-78d3-c9b9-17ff1896e0ec@grosbein.net> <20190627101901.3szaaxhp4xzjiay5@MacBook-Air-de-Roger.local> <20190704072354.6ycduisiidz5iy2x@Air-de-Roger> In-Reply-To: From: Christian M Date: Thu, 4 Jul 2019 10:59:56 +0200 Message-ID: Subject: Re: Very slow and inconsistent internal network speed (between, VM's on the same host) for FreeBSD 11.0+ as guest on, XCP-ng/XenServer To: Karl Pielorz Cc: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= , freebsd-xen@freebsd.org, Eugene Grosbein , freebsd-net@freebsd.org X-Rspamd-Queue-Id: 02FA587871 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=I8JPMJQV; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of christianmarcos@gmail.com designates 2607:f8b0:4864:20::d2b as permitted sender) smtp.mailfrom=christianmarcos@gmail.com X-Spamd-Result: default: False [-6.74 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_FIVE(0.00)[5]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[b.2.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; IP_SCORE(-2.80)[ip: (-8.39), ipnet: 2607:f8b0::/32(-3.16), asn: 15169(-2.39), country: US(-0.06)]; NEURAL_HAM_SHORT(-0.93)[-0.933,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Jul 2019 09:00:10 -0000 >From my tests I found that 10.4-RELEASE was as fast as you could expect (>10Gbit/s), then something changed in 11.0-RELEASE and carried on and got even worse in 12.0-RELEASE. Would it not be a good idea to begin there (10.4 -> 11.0), and try to identify what changes could impact the performance drop so significantly? This is perhaps a much harder task than it sounds for someone that knows nothing about what changes was made, and how difficult it would be to identify what changes actually could be relevant. Just a thought. Regards, Christian Den tors 4 juli 2019 kl 10:39 skrev Karl Pielorz : > > > --On 04 July 2019 09:23 +0200 Roger Pau Monn=C3=A9 > wrote: > > > As a workaround you can switch to the emulated network card by > > setting 'hw.xen.disable_pv_nics=3D1' in /boot/loader.conf. That will > > give you worse performance than a fully working PV network card, but > > at least should be consistent. There are others that have switched to > > virtio-net, but I have no idea how to do that with XCP. > > Just to add my $0.02's to the conversation... > > As Roger knows we've had numerous issues with Xen xn based networking and > FreeBSD guests over the years. We currently run VirtIO (vtnet) on > XenServer > 7.1 and it solves all these issues (it's probably not quite as > 'performant' > as xn - but it's close for what we're using it with - it is miles better > than e1000 performance). > > Unfortunately in XenServer 7.6 virtio is no longer compiled into Qemu fro= m > what I can see. XCP-ng has the same issue (as it's based on XenServer) - > so > virtio is currently not an option with XCP-ng either. > > e1000/rtl8139 will solve 'weirdness' (think of VM's routing traffic, doin= g > DHCP or VPN duties) - but virtio solves the same issues, with much better > performance. > > I've posted to the XCP-ng forums asking if virtio can be enabled in XCP-n= g > builds (as this is probably more likely that getting XenServer to release > with it enabled). > > Aside from getting Xen xn 'fixed' for the cases it currently fails (no > small undertaking from what I understand) - it leaves FreeBSD pretty much > stuck, at least for some usage cases. > > > Regards, > > -Karl >