From owner-freebsd-virtualization@freebsd.org Mon Oct 26 16:27:01 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 42888448ECB for ; Mon, 26 Oct 2020 16:27:01 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id 4CKgGD2Tnhz4RSp for ; Mon, 26 Oct 2020 16:26:59 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Mon, 26 Oct 2020 17:25:56 +0100 Received-SPF: SoftFail (connect.ultra-secure.de: domain of ultra-secure.de does not designate 127.0.0.10 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=127.0.0.10; helo=connect.ultra-secure.de; envelope-from= Received: from connect.ultra-secure.de (webmail [127.0.0.10]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id B8677F31-FE46-45A2-BD5E-6666E01A6790.1 envelope-from (authenticated bits=0) (version=TLSv1/SSLv3 cipher=AES256-SHA verify=NO); Mon, 26 Oct 2020 17:25:49 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 26 Oct 2020 17:25:49 +0100 From: rainer@ultra-secure.de To: freebsd-virtualization@freebsd.org Subject: Why is it that when I run FreeBSD in a local KVM, it behaves normal, but when it run it in our OpenStack cloud, IO is painfully slow? Message-ID: <0466f1268c7059af6a5e9950e47db6a0@ultra-secure.de> X-Sender: rainer@ultra-secure.de User-Agent: Roundcube Webmail/1.2.0 X-Haraka-GeoIP: --, , NaNkm X-Haraka-GeoIP-Received: X-Haraka-p0f: os="undefined undefined" link_type="undefined" distance=undefined total_conn=undefined shared_ip=Y X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.2 required=5.0 tests=ALL_TRUSTED,BAYES_00, SPF_SOFTFAIL autolearn=no autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 1478, bad: 0, connections: 1484, history: 1478, pass:all_good, relaying X-Rspamd-Queue-Id: 4CKgGD2Tnhz4RSp X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of rainer@ultra-secure.de designates 88.198.71.201 as permitted sender) smtp.mailfrom=rainer@ultra-secure.de X-Spamd-Result: default: False [-0.66 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[ultra-secure.de]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.79)[-0.787]; NEURAL_HAM_MEDIUM(-0.81)[-0.813]; NEURAL_SPAM_SHORT(0.14)[0.140]; FROM_NO_DN(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.198.0.0/16, country:DE]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2020 16:27:01 -0000 Hi, I uploaded the qcow2 image of 12.2RC3 and a recent 13-snapshot to our Openstack Cloud. I use dc3dd wipe to test IO because it eliminates the filesystem. I don't really have a particular fast SSD in my office PC, but I get around 100MB/s from writing zeros to the harddisk in CentOS. I also get about 100MB/s on FreeBSD on my local PC. The FreeBSD 13 VM on OpenStack is running like this: 1321858 ? Sl 174:16 | \_ /usr/bin/qemu-system-x86_64 -name guest=instance-0000a1a0,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-499-instance-0000a1a0/master-key.aes -machine pc-i440fx-bionic,accel=kvm,usb=off,dump-guest-core=off -cpu Skylake-Server-IBRS,ss=on,vmx=on,hypervisor=on,tsc_adjust=on,clflushopt=on,pku=on,md-clear=on,ssbd=on,xsaves=on,ibpb=on,amd-ssbd=on -m 4096 -realtime mlock=off -smp 2,sockets=2,cores=1,threads=1 -uuid 621d88e9-e803-4c26-9056-285a3320eeb2 -smbios type=1,manufacturer=OpenStack Foundation,product=OpenStack Nova,version=18.2.4,serial=d48ad200-7d1a-11e9-8000-ac1f6bd59bbe,uuid=621d88e9-e803-4c26-9056-285a3320eeb2,family=Virtual Machine -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-499-instance-0000a1a0/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -object secret,id=virtio-disk0-secret0,data=vwxTtkLohnqwK2r2/UtsDsSy+rhsrHVkltURhbJ4Bpw=,keyid=masterKey0,iv=xRU+WRSUhJLLfXwevFHcOQ==,format=base64 -drive file=rbd:ewos1-prod_nova/621d88e9-e803-4c26-9056-285a3320eeb2_disk:id=nova:auth_supported=cephx\;none:mon_host=10.38.65.71\:6789\;10.38.66.71\:6789\;10.38.67.71\:6789\;10.38.66.74\:6789,file.password-secret=virtio-disk0-secret0,format=raw,if=none,id=drive-virtio-disk0,cache=writeback,discard=unmap,throttling.bps-total=104857600,throttling.iops-total=800 -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -object secret,id=virtio-disk1-secret0,data=2EEZom/oYVK9UXPdJvm8s3/nlpqPjbE9TOpwC/G8NjI=,keyid=masterKey0,iv=ltTLZnuc24yoLp0dSCN8zg==,format=base64 -drive file=rbd:ewos1-prod_cinder/volume-1c88c69a-6b88-4887-b11c-571cc6b8c647:id=cinder:auth_supported=cephx\;none:mon_host=10.38.65.71\:6789\;10.38.66.71\:6789\;10.38.67.71\:6789\;10.38.66.74\:6789,file.password-secret=virtio-disk1-secret0,format=raw,if=none,id=drive-virtio-disk1,serial=1c88c69a-6b88-4887-b11c-571cc6b8c647,cache=writeback,discard=unmap,throttling.bps-total=262144000,throttling.iops-total=5000 -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=1010,id=hostnet0,vhost=on,vhostfd=1012 -device virtio-net-pci,host_mtu=1500,netdev=hostnet0,id=net0,mac=fa:16:3e:bf:58:7e,bus=pci.0,addr=0x3 -chardev pty,id=charserial0,logfile=/var/lib/nova/instances/621d88e9-e803-4c26-9056-285a3320eeb2/console.log,logappend=off -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0,bus=usb.0,port=1 -vnc 10.33.66.150:130 -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7 -msg timestamp=on