Date: Wed, 22 Jan 2020 21:38:02 +0000 From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 243063] [bhyve] nvme timeouts Message-ID: <bug-243063-27103-nZ4n1rjAm2@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-243063-27103@https.bugs.freebsd.org/bugzilla/> References: <bug-243063-27103@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D243063 Mateusz Kwiatkowski <kwiat3k@panic.pl> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kwiat3k@panic.pl --- Comment #1 from Mateusz Kwiatkowski <kwiat3k@panic.pl> --- I also performed some bhyve+nvme tests. Host: FreeBSD 13.0 r356983, Opteron 6128, ZFS raid10 on 4 HDDs Guests: FreeBSD 12.1-RELEASE bhyveload -c /dev/nmdm-1_hv-3.1A -m 2048M -e autoboot_delay=3D3 -d /dev/zvol/zroot/vm/1_hv-3/disk0 1_hv-3 [bhyve options: -c 2 -m 2048M -AHP -U 3805a422-c9c8-46c5-aa8d-31142e90ea89 -u] [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,nvme,/dev/zvol/zroot/vm/1_hv-3/disk0 -s 4:1,ahci-cd,/zroot/vm/1_hv-3/seed.iso -s 5:0,virtio-net,tap2,mac=3D58:9c:fc:0f:3e:27] [bhyve console: -l com1,/dev/nmdm-1_hv-3.1A] # zfs get volblocksize zroot/vm/1_hv-3/disk0 NAME PROPERTY VALUE SOURCE zroot/vm/1_hv-3/disk0 volblocksize 8K default Performance comparison of virtio-blk/ahci-hd/nvme: Test command: fio --name=3Dtest --iodepth=3D4 --rw=3Drandrw:2 --rwmixread= =3D70 --rwmixwrite=3D30 --bs=3D8k --direct=3D0 --size=3D256m --numjobs=3D8 baremetal: READ: bw=3D456MiB/s (478MB/s), 57.3MiB/s-65.5MiB/s (60.1MB/s-68.6MB/s), io=3D1433MiB (1502MB), run=3D2719-3142msec WRITE: bw=3D196MiB/s (205MB/s), 24.1MiB/s-28.7MiB/s (25.3MB/s-30.1MB/s), io=3D615MiB (645MB), run=3D2719-3142msec virtio-blk: READ: bw=3D115MiB/s (121MB/s), 14.4MiB/s-20.5MiB/s (15.1MB/s-21.5MB/s), io=3D1433MiB (1502MB), run=3D8773-12453msec WRITE: bw=3D49.4MiB/s (51.8MB/s), 6348KiB/s-8851KiB/s (6501kB/s-9063kB/s), io=3D615MiB (645MB), run=3D8773-12453msec ahci-hd: READ: bw=3D110MiB/s (116MB/s), 13.8MiB/s-36.4MiB/s (14.4MB/s-38.1MB/s), io=3D1433MiB (1502MB), run=3D4940-12968msec WRITE: bw=3D47.4MiB/s (49.7MB/s), 6107KiB/s-15.5MiB/s (6254kB/s-16.2MB/s), io=3D615MiB (645MB), run=3D4940-12968msec nvme: READ: bw=3D19.7MiB/s (20.7MB/s), 2520KiB/s-4811KiB/s (2580kB/s-4926kB/s), io=3D1433MiB (1502MB), run=3D38351-72662msec WRITE: bw=3D8671KiB/s (8879kB/s), 1083KiB/s-2025KiB/s (1109kB/s-2073kB/s), io=3D615MiB (645MB), run=3D38351-72662msec >From guest's log: nvme0: Missing interrupt nvme0: Missing interrupt nvme0: nvme0: cpl does not map to outstanding cmd Missing interrupt cdw0:00000000 sqhd:0019 sqid:0002 cid:0066 p:1 sc:00 sct:0 m:0 dnr:0 nvme0: Resetting controller due to a timeout. nvme0: resetting controller nvme0: temperature threshold not supported nvme0: aborting outstanding i/o nvme0: resubmitting queued i/o nvme0: WRITE sqid:2 cid:0 nsid:1 lba:8752079 len:8 --=20 You are receiving this mail because: You are the assignee for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-243063-27103-nZ4n1rjAm2>