Date: Fri, 1 Dec 2017 15:41:50 -0600 From: Dustin Wenz <dustinwenz@ebureau.com> To: Peter Grehan <grehan@freebsd.org> Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve uses all available memory during IO-intensive operations Message-ID: <9897C115-4212-4161-811D-E71B0CAE911A@ebureau.com> In-Reply-To: <22BC8832-924A-480B-A9A0-DB717D37BF08@ebureau.com> References: <F4E35CB9-30F9-4C63-B4CC-F8ADC9947E3C@ebureau.com> <9C202C72-EF74-4DB7-9B2C-736C049A9F7A@ebureau.com> <a7a196a0-993d-20a4-46be-c617d145f6bb@freebsd.org> <22BC8832-924A-480B-A9A0-DB717D37BF08@ebureau.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--Apple-Mail=_A006E473-222E-40BF-B0DF-417C3F9B9DE7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I've been running a database stress test on my VMs for the last few = hours without issue, and I've noticed no unexpected memory usage. Prior = to changing the wired option, this would never have run as long. I = haven't limited the ARC size yet, but I probably will since it sounds = like best practice for a bhyve host. The commit history shows that chyves defaults to -S if you are hosting = from FreeBSD 10.3 or later. I'm sure they had a reason for doing that, = but I don't know what that would be. It seems to an inefficient use of = main memory if you need to run a lot of VMs. Thanks everyone for helping to nail this down! - .Dustin > On Dec 1, 2017, at 12:09 PM, Dustin Wenz <dustinwenz@ebureau.com> = wrote: >=20 > Yep, and that's also why bhyve is getting killed instead of paging = out. For some inexplicable reason, chyves defaulted to setting -S on new = VMs. That has the effect of wiring in the max amount of memory for each = guest at startup. >=20 > I changed the bargs option to "-A -H -P" instead of "-A -H -P -S". = Memory pressure is greatly alleviated upon restart. I'm going to do more = testing, but I suspect this will fix my problem. Take this as a PSA for = chyves users. >=20 > - .Dustin >=20 >> On Dec 1, 2017, at 11:56 AM, Peter Grehan <grehan@freebsd.org> wrote: >>=20 >> The -S flag to bhyve wires guest memory so it won't be swapped out. >>=20 >> later, >>=20 >> Peter. >=20 --Apple-Mail=_A006E473-222E-40BF-B0DF-417C3F9B9DE7 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEzDCCBMgw ggOwoAMCAQICAUEwDQYJKoZIhvcNAQELBQAwgZkxCzAJBgNVBAYTAlVTMRIwEAYDVQQIEwlNaW5u ZXNvdGExFDASBgNVBAcTC1NhaW50IENsb3VkMRAwDgYDVQQKEwdlQnVyZWF1MRQwEgYDVQQLEwtJ bnRlZ3JhdGlvbjEUMBIGA1UEAxMLZWJ1cmVhdS5jb20xIjAgBgkqhkiG9w0BCQEWE3N1cHBvcnRA ZWJ1cmVhdS5jb20wHhcNMTcwNTA1MTYxNjE1WhcNMjcwNTAzMTYxNjE1WjBKMQswCQYDVQQGEwJV UzEUMBIGA1UEAwwLRHVzdGluIFdlbnoxJTAjBgkqhkiG9w0BCQEWFmR1c3RpbndlbnpAZWJ1cmVh dS5jb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCQ/HJXe7JhUaexqEaxCNVifsue sUMgohgXLmi5YIcbAWhdxTr1PUzKYkeTkL9sYNjXU6uaI2tZMF3hA9gcFjxQIfkKSo31MrYOgMdU xQe0Q+t6Vd4pGAmtDQDwhAsrNGccADp3Yjy4eBtVfkDGdzz1Y8Lbc684TPFcW7i9+U/dDaXlcxeq fyDqiHZ5y8Lp/1M2Ot/Rz7eikJZTAuHOWKs/PEiJIM2JHuhPyNy+mL2oqEWeOcEsKMNzgn7HVt4k Xz2irBAG+cj4WAxWs418l46EEXgur4PvhBXZMl0LJg0TyaxOHbsUam4R4tbKnaZ3HhRkg79k2Had sb6DKbnCw9/1AgMBAAGjggFnMIIBYzAJBgNVHRMEAjAAMAsGA1UdDwQEAwIE8DAnBgNVHSUEIDAe BggrBgEFBQcDAQYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBTLi/8HUHpbBEt9OtPqQoax AmpaNDCBzgYDVR0jBIHGMIHDgBRnpZeXB5rQYLgsUKqiiBcLIHyu6aGBn6SBnDCBmTELMAkGA1UE BhMCVVMxEjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAOBgNVBAoT B2VCdXJlYXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNvbTEiMCAG CSqGSIb3DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbYIJAMwZcjAWAsWXMDAGCWCGSAGG+EIBBAQj FiFodHRwOi8vd3d3LmVidXJlYXUuY29tL2NhLWNybC5wZW0wDQYJKoZIhvcNAQELBQADggEBAHbO qVdB9raUKXCgZRA/nES5a60dlIaGnIlpgz+Y3SjFt0bcJxoUYhIzumBHk9yjyP4M1DubOphkQpJ4 LNZbAS01cjCxjnC0ZUq5V3FCeaDwrn1qPY+QJGoZPLlhWdJUNu17OpnR7ZfBWlp3/pRhvNU5PCbJ nmF7rnvsqxUFq9oeiV3SmqBux5lwJ7p2Uss5SHSW6g17K/KdTMK1roQr/+rWpxp2233qddDrLpOE xGRlvhEqSa/IZbGC9oiYmsiaG1PefQkadoob5IMIS5/MDpWHUgSHqAj1V/LwcCx0rbt73SazGMND EzHVWhsj+khepB/MG5QGfWP23IGFmvQYWWcxggOQMIIDjAIBATCBnzCBmTELMAkGA1UEBhMCVVMx EjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAOBgNVBAoTB2VCdXJl YXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNvbTEiMCAGCSqGSIb3 DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbQIBQTAJBgUrDgMCGgUAoIIBxTAYBgkqhkiG9w0BCQMx CwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNzEyMDEyMTQxNTFaMCMGCSqGSIb3DQEJBDEW BBS7mGFJFlVztlpS1h8ZB1BaUVSzJTCBsAYJKwYBBAGCNxAEMYGiMIGfMIGZMQswCQYDVQQGEwJV UzESMBAGA1UECBMJTWlubmVzb3RhMRQwEgYDVQQHEwtTYWludCBDbG91ZDEQMA4GA1UEChMHZUJ1 cmVhdTEUMBIGA1UECxMLSW50ZWdyYXRpb24xFDASBgNVBAMTC2VidXJlYXUuY29tMSIwIAYJKoZI hvcNAQkBFhNzdXBwb3J0QGVidXJlYXUuY29tAgFBMIGyBgsqhkiG9w0BCRACCzGBoqCBnzCBmTEL MAkGA1UEBhMCVVMxEjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAO BgNVBAoTB2VCdXJlYXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNv bTEiMCAGCSqGSIb3DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbQIBQTANBgkqhkiG9w0BAQEFAASC AQBmWSFE50gh4QkV0/TvmopgVz4EydlcFXFjWXapwX9caeSn0T8Y/nbhs7uB70xABBbvZZ6/nHCE nlSZc9qPpEoYfe0O8tn+H6cw2r5U1r7j/jc0DlK4pzzpb/fc6yb4RU/I8ke9Jn+cKY6Lhu7BaXzU 8rizyFhYvYrE1HlPLH9krCrPb0GJgZ5kASvaufC1ObKwSjt2KJkUkQE0xioyy0whM7oTNQmCkC4S NI2JvrzaWQWZRxY2KISED2PNKbIn+rEIamWPvnS4Gu4wTLHd3p/8QlKUC0nJvYETf1wAQwdRrMSt J/HYTG08nIxPMK1Dmeyi1/Mws8A9b+p+5JbRfO29AAAAAAAA --Apple-Mail=_A006E473-222E-40BF-B0DF-417C3F9B9DE7--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?9897C115-4212-4161-811D-E71B0CAE911A>