From owner-freebsd-virtualization@freebsd.org Thu Jan 9 18:58:05 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 85EEB1F636A for ; Thu, 9 Jan 2020 18:58:05 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from mail1.yamagi.org (mail1.yamagi.org [IPv6:2001:19f0:b001:853::3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47twNr5kdvz4YDx for ; Thu, 9 Jan 2020 18:58:04 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from [2001:470:6845:1:fc9a:4782:611e:4abf] (helo=anemone.localdomain) by mail1.yamagi.org with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92.3 (FreeBSD)) (envelope-from ) id 1ipd0M-000A5u-Fd; Thu, 09 Jan 2020 19:58:03 +0100 Date: Thu, 9 Jan 2020 19:57:56 +0100 From: Yamagi Burmeister To: freebsd-virtualization@freebsd.org Cc: matt.churchyard@userve.net Subject: Re: bhyve issues on Dell C6220 node Message-Id: <20200109195756.55ac58ef7e3ae85354ce78e8@yamagi.org> In-Reply-To: <1998222a141e44bbbbc5d295e1c1bb34@SERVER.ad.usd-group.com> References: <202001082137.008LbZl9091675@gndrsh.dnsmgr.net> <1998222a141e44bbbbc5d295e1c1bb34@SERVER.ad.usd-group.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; x86_64-unknown-linux-gnu) Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA256"; boundary="Signature=_Thu__9_Jan_2020_19_57_56_+0100__Z=+UcdKMeKN79I3" X-Rspamd-Queue-Id: 47twNr5kdvz4YDx X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of lists@yamagi.org designates 2001:19f0:b001:853::3 as permitted sender) smtp.mailfrom=lists@yamagi.org X-Spamd-Result: default: False [-4.20 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx:c]; MV_CASE(0.50)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[yamagi.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-0.30)[asn: 20473(-1.46), country: US(-0.05)]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:2001:19f0:b000::/38, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jan 2020 18:58:05 -0000 --Signature=_Thu__9_Jan_2020_19_57_56_+0100__Z=+UcdKMeKN79I3 Content-Type: text/plain; charset=UTF-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, > >2016 is slow (even slower doing windows updates). 2019 is much better. = A tip I have found is a minimum of 1 cpu, 2 cores and 4 threads to get dec= ent speed from that OS (more CPUs in bhyve >tends to make performance worse= - in my observations - in 2016). Also, use the Virtio collection from Red= Hat for vionet and viostor. We are currently using 0.1.171 without issue. = The ahci >emulation in itself is extremely slow. NVMe and virtio is reall= y the only way to go. >=20 > Is there anything else I can check here? I haven=E2=80=99t got round to t= esting networking yet but I=E2=80=99m using nvme for the disk. > It=E2=80=99s basically unusable and there is no way I could put anything = production on it. Just highlighting an icon on the desktop takes several se= conds. Windows is slow when running on Intel CPUs that don't support APICv. That are (nearly?) all desktop CPUs, all Xeons before Sandy Bridge and some Xeons after it. The problem is that Bhyve doesn't implement TPR shadowing. I'm currently working on it. The review can be found here: https://reviews.freebsd.org/D22942 The speedup is about factor 6! I've received some feedback in a private mail, a second version that adds TPR thresholds can be found in my Github branch here: https://github.com/Yamagi/freebsd/commits/wip/tpr_shadowing=20 A backport to 12.1 (the branch also includes the Intel SpeedShift patches from https://reviews.freebsd.org/D18028) is here: https://github.com/Yamagi/freebsd/commits/production/12.1 I've applied it to 2 of my production servers about 4 hours ago. Looks good so far. I'll update the review when I'm sure that it doesn't break anything, maybe early next week. Regards, Yamagi --=20 Homepage: https://www.yamagi.org Github: https://github.com/yamagi GPG: 0x1D502515 --Signature=_Thu__9_Jan_2020_19_57_56_+0100__Z=+UcdKMeKN79I3 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEOXu/lxyufwz0gC5x6xRy5x1QJRUFAl4Xd7QACgkQ6xRy5x1Q JRVpvg/+L6Tc4Ww8AnEtS0TrBB1uTjNsfPIkJwSbc1eNf/qSJ2fZ9CW/PSII/N4G KlEoMngwEau7qomx13B7LMcoFPZgNXnehJoZvZLTk+0cnGANBvZyeUPSUSNo1pkO nvrRKY38MWag3g1BhYP3n3p7e7FAYqy24/v33jZ+C0spG6frqt/QAZwDXFVRc4i3 SohALdtFhA6AlhKuhE9BadmG3uKc7dyjWddAZ8gRJc8wGnK/Rgp6E/UbHj6JuUgP Es5r4e9Wm1Mv4RaGguuAuef2eR2wjlDNOd36CgrS8LV3Mim/00ChwOrCYzQ0VNIA S2MQjFz7pY0K4PvBrKQ2VocLE94c0XAS84QgcY7rfflGz5H0sK7osRRCU4Q/VwWR eu3fthIs7TutPXTxVl0+oKgFw2sr2QXrTKPXyLPgMf2obujz0fThircK6o5/msCQ IMG+p/Qks8Wae4yUCKnEndUsy2m7RESAiXwZAzrl9IMUepvAdK0bQVhecKGiin1A LlnViSt2I7q6wkiMKPqScsNXL1LFe2bbXKiCuej69H0cbhQTgf/BKmszY/UjRzWP Vy8o+fcCs/j2yWOtvBsDGZNV4OIlLIEcRppRLF6/RvpaU7KOgy2q3JblOdfTbOrs Xr1WtAgAgbjS9wlVjqdajY29V4myHKAUamXLTq0nnETRagZLxYI= =rdGX -----END PGP SIGNATURE----- --Signature=_Thu__9_Jan_2020_19_57_56_+0100__Z=+UcdKMeKN79I3--