Date: Fri, 1 Dec 2017 15:41:50 -0600 From: Dustin Wenz <dustinwenz@ebureau.com> To: Peter Grehan <grehan@freebsd.org> Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve uses all available memory during IO-intensive operations Message-ID: <9897C115-4212-4161-811D-E71B0CAE911A@ebureau.com> In-Reply-To: <22BC8832-924A-480B-A9A0-DB717D37BF08@ebureau.com> References: <F4E35CB9-30F9-4C63-B4CC-F8ADC9947E3C@ebureau.com> <9C202C72-EF74-4DB7-9B2C-736C049A9F7A@ebureau.com> <a7a196a0-993d-20a4-46be-c617d145f6bb@freebsd.org> <22BC8832-924A-480B-A9A0-DB717D37BF08@ebureau.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --]
I've been running a database stress test on my VMs for the last few hours without issue, and I've noticed no unexpected memory usage. Prior to changing the wired option, this would never have run as long. I haven't limited the ARC size yet, but I probably will since it sounds like best practice for a bhyve host.
The commit history shows that chyves defaults to -S if you are hosting from FreeBSD 10.3 or later. I'm sure they had a reason for doing that, but I don't know what that would be. It seems to an inefficient use of main memory if you need to run a lot of VMs.
Thanks everyone for helping to nail this down!
- .Dustin
> On Dec 1, 2017, at 12:09 PM, Dustin Wenz <dustinwenz@ebureau.com> wrote:
>
> Yep, and that's also why bhyve is getting killed instead of paging out. For some inexplicable reason, chyves defaulted to setting -S on new VMs. That has the effect of wiring in the max amount of memory for each guest at startup.
>
> I changed the bargs option to "-A -H -P" instead of "-A -H -P -S". Memory pressure is greatly alleviated upon restart. I'm going to do more testing, but I suspect this will fix my problem. Take this as a PSA for chyves users.
>
> - .Dustin
>
>> On Dec 1, 2017, at 11:56 AM, Peter Grehan <grehan@freebsd.org> wrote:
>>
>> The -S flag to bhyve wires guest memory so it won't be swapped out.
>>
>> later,
>>
>> Peter.
>
[-- Attachment #2 --]
0 *H
010 + 0 *H
00A0
*H
010 UUS10U Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 *H
support@ebureau.com0
170505161615Z
270503161615Z0J10 UUS10UDustin Wenz1%0# *H
dustinwenz@ebureau.com0"0
*H
0
rW{aQFb~˞C .h`h]:=LbGl`S#kY0]<P!
J2TCzU)
+4g :wb<xU~@w<cs8L\[O
s vyS6:ϷSX?<H ͉OܾE9,(s~V$_=XV|x.2]&
ɬNjnʝwddv) g0c0 U0 0U0'U% 0+++0UˋPz[K}:BjZ40U#0Àg`,P |顁010 UUS10U Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 *H
support@ebureau.com r0ŗ00 `HB#!http://www.ebureau.com/ca-crl.pem0
*H
vΩWA)pe?Dki?(ŷF'b3`Gܣ;:dBx,[-5r0peJWqBy}j=$j<aYT6{:ZZwa9<&ɞa{{]ҚnǙp'vR9Ht
{+Lµ+֧v}u.de*IeȚS} vKRWp,t{&C1Z#H^}c܁Yg100010 UUS10U Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 *H
support@ebureau.comA0 + 0 *H
1 *H
0 *H
1
171201214151Z0# *H
1aIUsZRPZQT%0 +710010 UUS10U Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 *H
support@ebureau.comA0*H
1010 UUS10U Minnesota10USaint Cloud10U
eBureau10UIntegration10Uebureau.com1"0 *H
support@ebureau.comA0
*H
fY!DH! `W>\qcYv\i?vL@epTsڏJ}0ھT־74R<o&EOG&)i|XXyO,d*oAd+ڹ9J;v(4*2L!35 .4YG6(c)'jet0LޟBRIɽ\ CQĭ'Lm<O0C0=o~|
help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?9897C115-4212-4161-811D-E71B0CAE911A>
