From owner-freebsd-stable@freebsd.org Sat Apr 24 11:45:44 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E773C5FCB31 for ; Sat, 24 Apr 2021 11:45:44 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id 4FS8Vb5dC6z4qW7 for ; Sat, 24 Apr 2021 11:45:43 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Sat, 24 Apr 2021 13:47:48 +0200 Received-SPF: SoftFail (connect.ultra-secure.de: domain of ultra-secure.de does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=217.71.83.52; helo=[192.168.1.238]; envelope-from= Received: from [192.168.1.238] (217-071-083-052.ip-tech.ch [217.71.83.52]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id 3D762B11-2B86-491F-83BA-C0F3002DD6E0.1 envelope-from (authenticated bits=0); Sat, 24 Apr 2021 13:47:42 +0200 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\)) Subject: Re: FreeBSD 13.0 terrible performance in KVM From: Rainer Duffner In-Reply-To: Date: Sat, 24 Apr 2021 13:45:27 +0200 Cc: "freebsd-stable@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <82D1C8F0-53DA-446E-B3F7-0745C517C1A1@ultra-secure.de> References: To: dashdruid X-Mailer: Apple Mail (2.3445.104.17) X-Haraka-GeoIP: EU, CH, 451km X-Haraka-ASN: 24951 X-Haraka-GeoIP-Received: X-Haraka-ASN: 24951 217.71.80.0/20 X-Haraka-ASN-CYMRU: asn=24951 net=217.71.80.0/20 country=CH assignor=ripencc date=2003-08-07 X-Haraka-FCrDNS: 217-071-083-052.ip-tech.ch X-Haraka-p0f: os="Mac OS X " link_type="DSL" distance=16 total_conn=3 shared_ip=N X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.2 required=5.0 tests=ALL_TRUSTED,BAYES_00, SPF_SOFTFAIL autolearn=no autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 17420, bad: 613, connections: 19732, history: 16807, asn_score: 1400, asn_connections: 1568, asn_good: 1438, asn_bad: 38, pass:asn, relaying X-Rspamd-Queue-Id: 4FS8Vb5dC6z4qW7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of rainer@ultra-secure.de designates 88.198.71.201 as permitted sender) smtp.mailfrom=rainer@ultra-secure.de X-Spamd-Result: default: False [-2.70 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[ultra-secure.de]; ARC_NA(0.00)[]; SPAMHAUS_ZRD(0.00)[88.198.71.201:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[88.198.71.201:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.198.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Apr 2021 11:45:45 -0000 > Am 24.04.2021 um 11:25 schrieb dashdruid via freebsd-stable = : >=20 > Hello List, >=20 > I hope some other folks out there running FreeBSD on KVM as well. I = set up a base VM while doing so I noticed that the disk operations are = very slow. Many times I edit a file in vim or try to run a command there = is a huge lag. It=E2=80=99s a huge and common problem that has been going on for years. I also had the same problem with XenServer. You can search bugzilla for =E2=80=9EKVM=E2=80=9C bugs, as well as the = forums. Apparently, it was mostly fixed for VMWare, but fixing for KVM is = apparently very difficult. Even more so as there are many different = versions of KVM around that all behave differently, depending on how you = configure the virtual hardware (of which there are endless variations = and permutations on how you attach with virtual devices to which virtual = PCI-bus etc.pp.). It=E2=80=99s also likely fixed on AWS (but I do not use that, so I = hardly care). E.g. when I created a KVM VM on my local workstation at work, it = performed identically (more or less) to e.g. a CentOS VM. However, if I create a VM on our on-premise Openstack cloud, it achieves = maybe 10% or 20% of the disk-IO-speed of a CentOS VM with the same = volume type. There=E2=80=99s some work going on in some differentials, but I = haven=E2=80=99t had the time to try. The problem is IMHO that most of the paid developers (for FreeBSD) these = days either use it on bare metal (hello Netflix, EMC, Netapp, Netgate = et.al.) or use it inside VMWare, where the main pain-points seem to have = been fixed. Or they even use FreeBSD=E2=80=99s own hypervisor (bhyve). It=E2=80=99s a tragedy IMO and it totally rules out FreeBSD here around = for almost all future use-cases (that are almost certainly moving to = Openstack in the future).