Date: Thu, 30 Nov 2017 17:15:19 -0600 From: Dustin Wenz <dustinwenz@ebureau.com> To: freebsd-virtualization@freebsd.org Subject: bhyve uses all available memory during IO-intensive operations Message-ID: <F4E35CB9-30F9-4C63-B4CC-F8ADC9947E3C@ebureau.com>
next in thread | raw e-mail | index | archive | help
--Apple-Mail=_B95D81D8-FCDE-491A-8C07-07FF98971E35 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm using chyves on FreeBSD 11.1 RELEASE to manage a few VMs (guest OS = is also FreeBSD 11.1). Their sole purpose is to house some medium-sized = Postgres databases (100-200GB). The host system has 64GB of real memory = and 112GB of swap. I have configured each guest to only use 16GB of = memory, yet while doing my initial database imports in the VMs, bhyve = will quickly grow to use all available system memory and then be killed = by the kernel: kernel: swap_pager: I/O error - pageout failed; blkno 1735,size = 4096, error 12 kernel: swap_pager: I/O error - pageout failed; blkno 1610,size = 4096, error 12 kernel: swap_pager: I/O error - pageout failed; blkno 1763,size = 4096, error 12 kernel: pid 41123 (bhyve), uid 0, was killed: out of swap space The OOM condition seems related to doing moderate IO within the VM, = though nothing within the VM itself shows high memory usage. This is the = chyves config for one of them: bargs -A -H -P -S bhyve_disk_type virtio-blk bhyve_net_type virtio-net bhyveload_flags chyves_guest_version 0300 cpu 4 creation Created on Mon Oct 23 16:17:04 CDT = 2017 by chyves v0.2.0 2016/09/11 using __create() loader bhyveload net_ifaces tap51 os default ram 16G rcboot 0 revert_to_snapshot revert_to_snapshot_method off serial nmdm51 template no uuid 8495a130-b837-11e7-b092-0025909a8b56 I've also tried using different bhyve_disk_types, with no improvement. = How is it that bhyve can use far more memory that I'm specifying? - .Dustin= --Apple-Mail=_B95D81D8-FCDE-491A-8C07-07FF98971E35 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEzDCCBMgw ggOwoAMCAQICAUEwDQYJKoZIhvcNAQELBQAwgZkxCzAJBgNVBAYTAlVTMRIwEAYDVQQIEwlNaW5u ZXNvdGExFDASBgNVBAcTC1NhaW50IENsb3VkMRAwDgYDVQQKEwdlQnVyZWF1MRQwEgYDVQQLEwtJ bnRlZ3JhdGlvbjEUMBIGA1UEAxMLZWJ1cmVhdS5jb20xIjAgBgkqhkiG9w0BCQEWE3N1cHBvcnRA ZWJ1cmVhdS5jb20wHhcNMTcwNTA1MTYxNjE1WhcNMjcwNTAzMTYxNjE1WjBKMQswCQYDVQQGEwJV UzEUMBIGA1UEAwwLRHVzdGluIFdlbnoxJTAjBgkqhkiG9w0BCQEWFmR1c3RpbndlbnpAZWJ1cmVh dS5jb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCQ/HJXe7JhUaexqEaxCNVifsue sUMgohgXLmi5YIcbAWhdxTr1PUzKYkeTkL9sYNjXU6uaI2tZMF3hA9gcFjxQIfkKSo31MrYOgMdU xQe0Q+t6Vd4pGAmtDQDwhAsrNGccADp3Yjy4eBtVfkDGdzz1Y8Lbc684TPFcW7i9+U/dDaXlcxeq fyDqiHZ5y8Lp/1M2Ot/Rz7eikJZTAuHOWKs/PEiJIM2JHuhPyNy+mL2oqEWeOcEsKMNzgn7HVt4k Xz2irBAG+cj4WAxWs418l46EEXgur4PvhBXZMl0LJg0TyaxOHbsUam4R4tbKnaZ3HhRkg79k2Had sb6DKbnCw9/1AgMBAAGjggFnMIIBYzAJBgNVHRMEAjAAMAsGA1UdDwQEAwIE8DAnBgNVHSUEIDAe BggrBgEFBQcDAQYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBTLi/8HUHpbBEt9OtPqQoax AmpaNDCBzgYDVR0jBIHGMIHDgBRnpZeXB5rQYLgsUKqiiBcLIHyu6aGBn6SBnDCBmTELMAkGA1UE BhMCVVMxEjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAOBgNVBAoT B2VCdXJlYXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNvbTEiMCAG CSqGSIb3DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbYIJAMwZcjAWAsWXMDAGCWCGSAGG+EIBBAQj FiFodHRwOi8vd3d3LmVidXJlYXUuY29tL2NhLWNybC5wZW0wDQYJKoZIhvcNAQELBQADggEBAHbO qVdB9raUKXCgZRA/nES5a60dlIaGnIlpgz+Y3SjFt0bcJxoUYhIzumBHk9yjyP4M1DubOphkQpJ4 LNZbAS01cjCxjnC0ZUq5V3FCeaDwrn1qPY+QJGoZPLlhWdJUNu17OpnR7ZfBWlp3/pRhvNU5PCbJ nmF7rnvsqxUFq9oeiV3SmqBux5lwJ7p2Uss5SHSW6g17K/KdTMK1roQr/+rWpxp2233qddDrLpOE xGRlvhEqSa/IZbGC9oiYmsiaG1PefQkadoob5IMIS5/MDpWHUgSHqAj1V/LwcCx0rbt73SazGMND EzHVWhsj+khepB/MG5QGfWP23IGFmvQYWWcxggOQMIIDjAIBATCBnzCBmTELMAkGA1UEBhMCVVMx EjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAOBgNVBAoTB2VCdXJl YXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNvbTEiMCAGCSqGSIb3 DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbQIBQTAJBgUrDgMCGgUAoIIBxTAYBgkqhkiG9w0BCQMx CwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNzExMzAyMzE1MTlaMCMGCSqGSIb3DQEJBDEW BBTyU3crdrxhunlwSLEDBcmGeEtHvTCBsAYJKwYBBAGCNxAEMYGiMIGfMIGZMQswCQYDVQQGEwJV UzESMBAGA1UECBMJTWlubmVzb3RhMRQwEgYDVQQHEwtTYWludCBDbG91ZDEQMA4GA1UEChMHZUJ1 cmVhdTEUMBIGA1UECxMLSW50ZWdyYXRpb24xFDASBgNVBAMTC2VidXJlYXUuY29tMSIwIAYJKoZI hvcNAQkBFhNzdXBwb3J0QGVidXJlYXUuY29tAgFBMIGyBgsqhkiG9w0BCRACCzGBoqCBnzCBmTEL MAkGA1UEBhMCVVMxEjAQBgNVBAgTCU1pbm5lc290YTEUMBIGA1UEBxMLU2FpbnQgQ2xvdWQxEDAO BgNVBAoTB2VCdXJlYXUxFDASBgNVBAsTC0ludGVncmF0aW9uMRQwEgYDVQQDEwtlYnVyZWF1LmNv bTEiMCAGCSqGSIb3DQEJARYTc3VwcG9ydEBlYnVyZWF1LmNvbQIBQTANBgkqhkiG9w0BAQEFAASC AQAIga0Y/e+v/2M+VVbdLrxM+3syJ2sLEliNv0+MmGBI0tdnUSve745seRmnkqCvE0GMQwx/iaEo uFua/veh8A501m1kJuOU/wlgcsrfcYeFAkq0tW/DpWTEuNJtTdnYyUJkzpTpcqx6oQPOSI6FU9e+ Zcm6XcvIFHHz2cLP3+QMLEIK5b3LPcAySCjTvojyDmlfF8OL1M3oLN8ULUpdwIvd8QcjeeLrez/L bpOiBw3yzHb3Yp+FyeGrxWLS+gMD+oHOTcbzANU9vmNNIoVA6mD8qHpghna/jrutZPVrhkvUOp2s /i0TCpRRzFbZ3niFoV5EYc84Z6m5V8Jw1WZkjUw5AAAAAAAA --Apple-Mail=_B95D81D8-FCDE-491A-8C07-07FF98971E35--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?F4E35CB9-30F9-4C63-B4CC-F8ADC9947E3C>