Skip site navigation (1)Skip section navigation (2) 
Date:      Mon, 4 Dec 2017 17:19:49 -0600
From:      Dustin Wenz <dustinwenz@ebureau.com>
To:        freebsd-virtualization@freebsd.org
Subject:   Storage overhead on zvols
Message-ID:  <CC62E200-A749-4406-AC56-2FC7A104D353@ebureau.com>
index | next in thread | raw e-mail 

[-- Attachment #1 --]
I'm starting a new thread based on the previous discussion in "bhyve uses all available memory during IO-intensive operations" relating to size inflation of bhyve data stored on zvols. I've done some experimenting with this, and I think it will be useful for others.

The zvols listed here were created with this command:

	zfs create -o volmode=dev -o volblocksize=Xk -V 30g vm00/chyves/guests/myguest/diskY

The zvols were created on a raidz1 pool of four disks. For each zvol, I created a basic zfs filesystem in the guest using all default tuning (128k recordsize, etc). I then copied the same 8.2GB dataset to each filesystem.

	volblocksize	size amplification

	512B		11.7x
	4k			1.45x
	8k			1.45x
	16k			1.5x
	32k			1.65x
	64k			1x
	128k		1x

The worst case is with a 512B volblocksize, where the space used is more than 11 times the size of the data stored within the guest. The size efficiency gains are non-linear as I continue from 4k and double the block sizes; 32k blocks being the second-worst. The amount of wasted space was minimized by using 64k and 128k blocks.

It would appear that 64k is a good choice for volblocksize if you are using a zvol to back your VM, and the VM is using the virtual device for a zpool. Incidentally, I believe this is the default when creating VMs in FreeNAS.

	- .Dustin


[-- Attachment #2 --]
0	*H
010	+0	*H
00A0
	*H
010	UUS10U	Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 	*H
	support@ebureau.com0
170505161615Z
270503161615Z0J10	UUS10UDustin Wenz1%0#	*H
	dustinwenz@ebureau.com0"0
	*H
0
rW{aQFb~˞C .h`h]:=LbGl`S#kY0]<P!
J2TCzU)	
+4g:wb<xU~@w<cs8L\[O
s vyS6:ϷSX?<H ͉OܾE9,(s~V$_=XV|x.2]&
ɬNjnʝwddv)g0c0	U00U0'U% 0+++0UˋPz[K}:BjZ40U#0Àg`,P |顁010	UUS10U	Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 	*H
	support@ebureau.com	r0ŗ00	`HB#!http://www.ebureau.com/ca-crl.pem0
	*H
vΩWA)pe?Dki?(ŷF'b3`Gܣ;:dBx,[-5r0peJWqBy}j=$j<aYT6{:ZZwa9<&ɞa{{]ҚnǙp'vR9Ht
{+Lµ+֧v}u.de*IeȚS}	vKRWp,t{&C1Z#H^}c܁Yg100010	UUS10U	Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 	*H
	support@ebureau.comA0	+0	*H
	1	*H
0	*H
	1
171204231950Z0#	*H
	1.nǕFW󰝢.o0	+710010	UUS10U	Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 	*H
	support@ebureau.comA0*H
	1010	UUS10U	Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 	*H
	support@ebureau.comA0
	*H
;y9/fz?0ioھN#@TmR	2sv shsqwʧoZp0|'y=Ƨ,X7S:?^^!!Ľh5-/C"BDP/(Vl,ig;n۵řM3/x))f]jT
=^k@-/Sx WJ.irRiN߰/!qlBzkcz{
help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CC62E200-A749-4406-AC56-2FC7A104D353>