From owner-freebsd-virtualization@freebsd.org Mon Feb 19 09:58:37 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75358F14FE9; Mon, 19 Feb 2018 09:58:37 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from APC01-PU1-obe.outbound.protection.outlook.com (mail-pu1apc01on0108.outbound.protection.outlook.com [104.47.126.108]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2DC306AB59; Mon, 19 Feb 2018 09:58:35 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com (10.170.152.14) by HK2PR0302MB2420.apcprd03.prod.outlook.com (10.170.151.135) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.527.6; Mon, 19 Feb 2018 09:58:31 +0000 Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087]) by HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087%2]) with mapi id 15.20.0527.012; Mon, 19 Feb 2018 09:58:30 +0000 From: Laurence Pawling To: "freebsd-xen@freebsd.org" , "freebsd-virtualization@freebsd.org" , "freebsd-net@freebsd.org" CC: David King , Vlad Galu Subject: multi-vCPU networking issues as client OS under Xen Thread-Topic: multi-vCPU networking issues as client OS under Xen Thread-Index: AQHTqWgyLMPz8qfMa0GcAhXNzUcYuA== Date: Mon, 19 Feb 2018 09:58:30 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [89.197.152.162] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; HK2PR0302MB2420; 7:Jy+0LdTqz0VYXfNf2pZl3s/C/jZ7SQsE14zFpVs2YO7URYRr3lv64eqTlJ5Ilz2qWeeh1PFJjOMxA8yU88jfPy5t0GuT+KTTCQUMPSbpbDixZq8p4UpVVLsHp5rShIaw3PA/AvOQSQCsM1P3t/73JmFpJjDHvh8zeiJzcNPjYu6Lb4PFwTjltzb/NqVRRMflzoXYMdFY88MVMSYH82N4ubFyuTttyrznO13sa9zgG3HZgUO3dbIa0rgIPPSEyMYV x-ms-exchange-antispam-srfa-diagnostics: SSOS;SSOR; x-forefront-antispam-report: SFV:SKI; SCL:-1; SFV:NSPM; SFS:(10019020)(6019001)(7966004)(376002)(366004)(39850400004)(39380400002)(396003)(346002)(269900001)(189003)(199004)(53754006)(3280700002)(102836004)(105586002)(99936001)(6506007)(68736007)(55236004)(316002)(26005)(6116002)(3846002)(3660700001)(110136005)(36756003)(186003)(54906003)(4326008)(450100002)(6306002)(54896002)(6512007)(53936002)(82746002)(6436002)(6486002)(107886003)(106356001)(2501003)(5250100002)(5660300001)(2906002)(25786009)(2900100001)(33656002)(97736004)(66066001)(8936002)(83716003)(86362001)(508600001)(8676002)(81166006)(81156014)(7736002)(99286004)(14454004)(2201001)(966005); DIR:OUT; SFP:1102; SCL:1; SRVR:HK2PR0302MB2420; H:HK2PR0302MB2545.apcprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; x-ms-office365-filtering-correlation-id: 2dd732c0-f776-41c5-28b3-08d5777f54b4 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(5600026)(4604075)(3008032)(2017052603307)(7153060)(49563074)(7193020); SRVR:HK2PR0302MB2420; x-ms-traffictypediagnostic: HK2PR0302MB2420: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(158342451672863)(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040501)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231101)(944501161)(10201501046)(3002001)(6041288)(20161123562045)(20161123564045)(20161123560045)(20161123558120)(201703131423095)(201703011903075)(201702281528075)(20161123555045)(201703061421075)(6072148)(201708071742011); SRVR:HK2PR0302MB2420; BCL:0; PCL:0; RULEID:; SRVR:HK2PR0302MB2420; x-forefront-prvs: 0588B2BD96 received-spf: None (protection.outlook.com: globalsign.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: 6f5xtPZRz6fb2IJcO2+F9eGVS6+UNiCiVRflUTJOaoFdG9F1sDQ1zLt52Z4PY+zILxt63HYDDis3FzwZkscoueHEW4+vOk5k3jAcN77A4PM5+EPR+YDQSDGrwfbcKiLrmG2emJQ1F8zPLRgd1FJUv1d5pMlhw6qTGcPWI+IfL9I= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha256; boundary="B_3601879107_1679118586" MIME-Version: 1.0 X-OriginatorOrg: globalsign.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2dd732c0-f776-41c5-28b3-08d5777f54b4 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Feb 2018 09:58:30.7188 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8fff67c1-8281-4635-b62f-93106cb7a9a8 X-MS-Exchange-Transport-CrossTenantHeadersStamped: HK2PR0302MB2420 X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 09:58:37 -0000 --B_3601879107_1679118586 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable Hi all, =20 I=E2=80=99m wondering if anyone here has seen this issue before, I=E2=80=99ve spent the= last couple of days troubleshooting: =20 Platform: Host: XenServer 7.0 running on 2 x E2660-v4, 256GB RAM Server VM: FreeBSD 11 (tested on 11.0-p15 and 11.1-p6), 2GB RAM (also teste= d with 32GB RAM), 1x50GB HDD, 1 x NIC, 2 or more vCPUs in any combination (2= sockets x 1 core, 1 socket x 2 cores, =E2=80=A6) Client VM: FreeBSD 11, any configuration of vCPUs, RAM and HDD. =20 Behaviour: Sporadic interruption of TCP sessions when utilising the above machine as a= =E2=80=9Cserver=E2=80=9D with =E2=80=9Cclients=E2=80=9D connecting. Looking into the communication = with pcap/Wireshark, you see a TCP Dup Ack sent from both ends, followed by = the client sending an RST packet, terminating the TCP session. We have also = seen evidence of the client sending a Keepalive packet, which is ACK=E2=80=99d by = the server before the RST is sent from the client end. =20 To recreate: On the above VM, perform a vanilla install of nginx: pkg install nginx service nginx onestart Then on a client VM (currently only tested with FreeBSD), run the following= (or similar): for i in {1..10000}; do if [ $(curl -s -o /dev/null -w "%{http_code}" http:= //10.2.122.71) !=3D 200 ] ; then echo "error"; fi; done When vCPUs=3D1 on the server, I get no errors, when vCPUs>1 I get errors repo= rted. The frequency of errors *seems* to be proportional to the number of vC= PUs, but they are sporadic with no clear periodicity or pattern, so that is = just anecdotal. Also, the problem seems by far the most prevalent when commu= nicating between two VMs on the same host, in the same VLAN. Xen still sends= packets via the switch rather than bridging internally between the interfac= es. Note that we have not had a chance to investigate the effect of different n= umbers of CPUs on the *client* end, however it does seem to be governed enti= rely by the server end. =20 We cannot recreate this issue using the same FreeBSD image and same configu= ration, but using KVM as a hypervisor. =20 Has anyone met this before? =20 Thanks, =20 Laurence --B_3601879107_1679118586 Content-type: application/pkcs7-signature; name="smime.p7s" Content-transfer-encoding: base64 Content-disposition: attachment; filename="smime.p7s" MIIP9AYJKoZIhvcNAQcCoIIP5TCCD+ECAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0B BwGggg21MIIFYjCCBEqgAwIBAgIMSX2V7ElwCIrABZuQMA0GCSqGSIb3DQEBCwUAMF0xCzAJ BgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxT aWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2IC0gRzMwHhcNMTYwODI2MTQzNjA4WhcN MTkwODI3MTQzNjA4WjCBnDELMAkGA1UEBhMCR0IxDTALBgNVBAgTBEtlbnQxEjAQBgNVBAcT CU1haWRzdG9uZTEfMB0GA1UEChMWR01PIEdsb2JhbFNpZ24gTGltaXRlZDEZMBcGA1UEAxMQ TGF1cmVuY2UgUGF3bGluZzEuMCwGCSqGSIb3DQEJARYfbGF1cmVuY2UucGF3bGluZ0BnbG9i YWxzaWduLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALBcjCf6ajlJBRGN ptXjlTf3Wwv5TuzE6iW5j3YOxxGE2uRSoisepRd5pHkQ3ffF1u4Rjfc3aXcHvlmipxf3pA3e TrGJGrlLhvpnY2Zg7ZXDYHEqZIfgASxl/5EXeshGqVi9uIoCjHng+oyfXU0GWuKPgqh88oZN Wm45QoeH4t96TRdlY/dpFjK8ea6vFvZApvbum8bYJZGlJOtgPl0j8/uF1akM8SNxciDQfT39 2quhOd6LxK0LeX9qIe5lXjbhojmyb0IUf4HKZanSuFMer5OY9MnsFgMsUdLs/D5LWw2dsqcF YfQgGs2FEolsnBwmogblGogYxpqy8qIK2JZwJp0CAwEAAaOCAeAwggHcMA4GA1UdDwEB/wQE AwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYBBQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xv YmFsc2lnbi5jb20vY2FjZXJ0L2dzcGVyc29uYWxzaWduMnNoYTJnM29jc3AuY3J0MD0GCCsG AQUFBzABhjFodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hh MmczME0GA1UdIARGMEQwQgYKKwYBBAGgMgEoCjA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3 dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAJBgNVHRMEAjAAMEQGA1UdHwQ9MDswOaA3 oDWGM2h0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hhMmczLmNy bDAqBgNVHREEIzAhgR9sYXVyZW5jZS5wYXdsaW5nQGdsb2JhbHNpZ24uY29tMB0GA1UdJQQW MBQGCCsGAQUFBwMCBggrBgEFBQcDBDAdBgNVHQ4EFgQU5SIdmwI3kfJf98Y87lFl62amcP0w HwYDVR0jBBgwFoAUaXKCYjFnlUSFd5GAxAQ2SZ17C2EwDQYJKoZIhvcNAQELBQADggEBACMg 3mWAnD3BBOGpqvrPNem5D3G0GMKlVWSsRax251QsJwogpkoFDgbyX4QtHmkooPRGNydJGwhV TjvWu5BMle9UuZbcDw6zno3/hLD7kDIUlNJOuU+IgRhWtZwp6ELxaSvIBkiDKPRmpue3P73X gMTq2VnDwUx5Sxk9FkZcyFNfZ1wvZGWA03sZAZXj1UkmBrsGZ/dOpfsLr1Z0N4AR2ZVx+H4C MyWzVGJzp5Lvqw54WDY4KL4XRmkw8SrdujgIA5SsoAl4wEmSl1GZiXdb88koxbQ7yME+roNa q86YT7L4n4cWSBsf5lQTodjeYLWN1mmlBGzBxcv2ceTcy541lbwwggToMIID0KADAgECAg5I G2oJE72AJMpdIvAU8zANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQLExdHbG9iYWxTaWduIFJv b3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UEAxMKR2xvYmFsU2lnbjAe Fw0xNjA2MTUwMDAwMDBaFw0yNDA2MTUwMDAwMDBaMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAy IENBIC0gU0hBMjU2IC0gRzMwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC2lmiT Zf0sAexiow1Uv4vLpEORopqvsYPytW1v2fDq3M8We9cZ44QDhfnGH3CPH2xJxWkZHnCRODV+ AkhdOWsYRKZqpch09F31hD5jH3FEggg+7cmn9uluJkEpgMlJuv/ZdqCjuxv2ed9LKNNKe5xR wg9lUKGfqEqd5UYEjYNP3LLIPc+YIQmYTMDxj3qpPzcmZUfYZo9JJsLDQL5mPWz/Oq0pRvAT nOHy65mni8LTX1Btog5vxwaXOC9OoY5HArSDANik47pBB2Dl3Tda8gfBO6ecl2gut++pSDa8 6WmomapH6cf2UdL5sSy2xUm1mJ5TU9r7cvN8D/hxPtcD+mfDAgMBAAGjggG1MIIBsTAOBgNV HQ8BAf8EBAMCAQYwagYDVR0lBGMwYQYIKwYBBQUHAwIGCCsGAQUFBwMEBggrBgEFBQcDCQYK KwYBBAGCNxQCAgYKKwYBBAGCNwoDBAYJKwYBBAGCNxUGBgorBgEEAYI3CgMMBggrBgEFBQcD BwYIKwYBBQUHAxEwEgYDVR0TAQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUaXKCYjFnlUSFd5GA xAQ2SZ17C2EwHwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vcm9vdHIzMDYG A1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vcm9vdC1yMy5jcmww ZwYDVR0gBGAwXjALBgkrBgEEAaAyASgwDAYKKwYBBAGgMgEoCjBBBgkrBgEEAaAyAV8wNDAy BggrBgEFBQcCARYmaHR0cHM6Ly93d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8wDQYJ KoZIhvcNAQELBQADggEBAKidzTLMfGfiC1DXpVxwo2biJe/qtLZTMG6HEjdcM+LCKFbjk71F lfNY2BVxTPPkgokUvv6lzEe96wZUgj7mv7716oj1ecQoIguMevYOC+MqrkmaDpvCJ/JsthtV SgG2GeFoUHRYvBJFGE+u3l4bEzDnVSY0gKL+FIoEqweEYVIRolAAtnLgcvQRZ24TogtgCNfo FJdEO0cV5Q911vjp/kd/mvMhMYuyf0Eimg5WuBLzvw7gmd9RZCLb3IF+fvkdqOJ8W88L66qf 6txWe+ukuCws5gb/riRZf8VEfz6aFV76ZxJffGxSlzEr2r28tNW2uhT/IlSYQLg5wfl1Cxsc GqMwggNfMIICR6ADAgECAgsEAAAAAAEhWFMIojANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQL ExdHbG9iYWxTaWduIFJvb3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UE AxMKR2xvYmFsU2lnbjAeFw0wOTAzMTgxMDAwMDBaFw0yOTAzMTgxMDAwMDBaMEwxIDAeBgNV BAsTF0dsb2JhbFNpZ24gUm9vdCBDQSAtIFIzMRMwEQYDVQQKEwpHbG9iYWxTaWduMRMwEQYD VQQDEwpHbG9iYWxTaWduMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzCV2kHkG eCIW9cCDtoTKKJ79BXYRxa2IcvxGAkPHsoqdBF8kyy5L4WCCRuFSqwyBR3Bs3WTR6/Usow+C PQwrrpfXthSGEHm7OxOAd4wI4UnSamIvH176lmjfiSeVOJ8G1z7JyyZZDXPesMjpJg6DFcbv W4vSBGDKSaYo9mk79svIKJHlnYphVzesdBTcdOA67nIvLpz70Lu/9T0A4QYz6IIrrlOmOhZz jN1BDiA6wLSnoemyT5AuMmDpV8u5BJJoaOU4JmB1sp93/5EU764gSfytQBVI0QIxYRleuJfv rXe3ZJp6v1/BE++bYvsNbOBUaRapA9pu6YOTcXbGaYWCFwIDAQABo0IwQDAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUj/BLf6guRSSuTVD6Y5qL3uLdG7ww DQYJKoZIhvcNAQELBQADggEBAEtA28BQqv7IDO/3llRFSbuWAAlBrLMThoYoBzPKa+Z0uboA La6kCtP18fEPir9zZ0qDx0R7eOCvbmxvAymOMzlFw47kuVdsqvwSluxTxi3kJGy5lGP73FNo Z1Y+g7jPNSHDyWj+ztrCU6rMkIrp8F1GjJXdelgoGi8d3s0AN0GP7URt11Mol37zZwQeFdeK lrTT3kwnpEwbc3N29BeZwh96DuMtCK0KHCz/PKtVDg+Rfjbrw1dJvuEuLXxgi8NBURMjnc73 MmuUAaiZ5ywzHzo7JdKGQM47LIZ4yWEvFLru21Vv34TuBQlNvSjYcs7TYlBlHuuSl4Mx2bO1 ykdYP18xggIDMIIB/wIBATBtMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWdu IG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2 IC0gRzMCDEl9lexJcAiKwAWbkDANBglghkgBZQMEAgEFAKBpMC8GCSqGSIb3DQEJBDEiBCB1 hdN+15YgrzdHOYlGIDgH1Z393+n2atHqAdmV2odHvTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0xODAyMTkwOTU4MjdaMA0GCSqGSIb3DQEBAQUABIIBAIYJ rroL/O9xwtOdTUhkbvXH+oYvFTtPzrlg1QvLkCQn+IC6BUF4840hpt7MrQOeU5vASAlo54t6 Y1GJiOj/kfMU3p+u0GCPf7LsiRWGfFjbpzX2nHaDisT7PGFDp9beMSXQIjZiO9ElElSbTpPF Dr4ofT21umsiuzZevY9GV2+CPEmt9ijuFCcDG1eEBppgEBlwjG+BkoYv2sEu7DiqKGf10znh Vk9aHngQtVuBi67P8LBCEsNKlGKW1Y1yH9hgT8G7CMM1jfqbCC/NkzVwba/F394z8LZOv5eI St5DPdqs5HzDpF3vjXuGz312Nx1IWV5VfAFYWflGgCVIch0H6mg= --B_3601879107_1679118586-- From owner-freebsd-virtualization@freebsd.org Mon Feb 19 10:07:19 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 17CAAF15C53; Mon, 19 Feb 2018 10:07:19 +0000 (UTC) (envelope-from prvs=5814e79b2=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 584346B31C; Mon, 19 Feb 2018 10:07:18 +0000 (UTC) (envelope-from prvs=5814e79b2=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.46,534,1511827200"; d="scan'208";a="68150322" Date: Mon, 19 Feb 2018 10:05:58 +0000 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Laurence Pawling CC: "freebsd-xen@freebsd.org" , "freebsd-virtualization@freebsd.org" , "freebsd-net@freebsd.org" , David King , Vlad Galu Subject: Re: multi-vCPU networking issues as client OS under Xen Message-ID: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> References: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20171208 X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 10:07:19 -0000 On Mon, Feb 19, 2018 at 09:58:30AM +0000, Laurence Pawling via freebsd-xen wrote: > Hi all, > > > > I’m wondering if anyone here has seen this issue before, I’ve spent the last couple of days troubleshooting: > > > > Platform: > > Host: XenServer 7.0 running on 2 x E2660-v4, 256GB RAM > > Server VM: FreeBSD 11 (tested on 11.0-p15 and 11.1-p6), 2GB RAM (also tested with 32GB RAM), 1x50GB HDD, 1 x NIC, 2 or more vCPUs in any combination (2 sockets x 1 core, 1 socket x 2 cores, …) > > Client VM: FreeBSD 11, any configuration of vCPUs, RAM and HDD. > > > > Behaviour: > > Sporadic interruption of TCP sessions when utilising the above machine as a “server” with “clients” connecting. Looking into the communication with pcap/Wireshark, you see a TCP Dup Ack sent from both ends, followed by the client sending an RST packet, terminating the TCP session. We have also seen evidence of the client sending a Keepalive packet, which is ACK’d by the server before the RST is sent from the client end. > > > > To recreate: > > On the above VM, perform a vanilla install of nginx: > > pkg install nginx > > service nginx onestart > > Then on a client VM (currently only tested with FreeBSD), run the following (or similar): > > for i in {1..10000}; do if [ $(curl -s -o /dev/null -w "%{http_code}" http://10.2.122.71) != 200 ] ; then echo "error"; fi; done > > When vCPUs=1 on the server, I get no errors, when vCPUs>1 I get errors reported. The frequency of errors *seems* to be proportional to the number of vCPUs, but they are sporadic with no clear periodicity or pattern, so that is just anecdotal. Also, the problem seems by far the most prevalent when communicating between two VMs on the same host, in the same VLAN. Xen still sends packets via the switch rather than bridging internally between the interfaces. When using >1 vCPUs can you set hw.xn.num_queues=1 on /boot/loader.conf and try to reproduce the issue? I'm afraid this is rather related to multiqueue (which is only used if >1 vCPUs). Thanks, Roger. From owner-freebsd-virtualization@freebsd.org Mon Feb 19 10:42:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7806BF18D1C; Mon, 19 Feb 2018 10:42:18 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sg2apc01on0091.outbound.protection.outlook.com [104.47.125.91]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F5B46D962; Mon, 19 Feb 2018 10:42:16 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com (10.170.152.14) by HK2PR0302MB2579.apcprd03.prod.outlook.com (10.170.145.147) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.527.6; Mon, 19 Feb 2018 10:42:12 +0000 Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087]) by HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087%2]) with mapi id 15.20.0527.012; Mon, 19 Feb 2018 10:42:08 +0000 From: Laurence Pawling To: =?utf-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= CC: "freebsd-xen@freebsd.org" , "freebsd-virtualization@freebsd.org" , "freebsd-net@freebsd.org" , David King , Vlad Galu Subject: Re: multi-vCPU networking issues as client OS under Xen Thread-Topic: multi-vCPU networking issues as client OS under Xen Thread-Index: AQHTqWgyLMPz8qfMa0GcAhXNzUcYuKOrf6kAgAAKGgA= Date: Mon, 19 Feb 2018 10:42:08 +0000 Message-ID: References: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> In-Reply-To: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [89.197.152.162] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; HK2PR0302MB2579; 7:mOYvIhWLrbCaDEWovAyP5/Xnh43SekpUIWaOUzDvFcFcy3bYI595F/JF2RBByJ1+FNW/jNfcrwpm9+ItxOJAaqgjRj9nctwa04gP6POwLf6CckDH884Ah59VFBkcmwIe4rV+Ir5Wjavk3IkRBYsLE0DIlEDnX0mALxxFnlZ5Q0uXUSGP1XpltMX0X2Clbf4TsbR/j0lm+D/wP/Hd31Uf+MggG/KA2vdp6XUNRJqf+kIMfL2NLTQ/6enz0fQPNfY1 x-ms-exchange-antispam-srfa-diagnostics: SSOS;SSOR; x-forefront-antispam-report: SFV:SKI; SCL:-1; SFV:NSPM; SFS:(10019020)(7966004)(396003)(366004)(346002)(376002)(39380400002)(39850400004)(189003)(199004)(8666007)(4326008)(25786009)(33656002)(97736004)(99936001)(54906003)(83716003)(107886003)(316002)(99286004)(86362001)(6246003)(106356001)(6486002)(105586002)(5250100002)(6436002)(53936002)(6512007)(66066001)(2900100001)(82746002)(14454004)(81166006)(68736007)(2906002)(5660300001)(81156014)(8676002)(3660700001)(26005)(6116002)(3846002)(229853002)(55236004)(305945005)(6506007)(102836004)(6346003)(508600001)(7736002)(2950100002)(36756003)(6916009)(186003)(76176011)(8936002)(3280700002); DIR:OUT; SFP:1102; SCL:1; SRVR:HK2PR0302MB2579; H:HK2PR0302MB2545.apcprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; x-ms-office365-filtering-correlation-id: 22d8cdaa-6b7f-4db5-5d65-08d577856d39 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4604075)(3008032)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(2017052603307)(7153060)(49563074)(7193020); SRVR:HK2PR0302MB2579; x-ms-traffictypediagnostic: HK2PR0302MB2579: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040501)(2401047)(5005006)(8121501046)(3231101)(944501161)(93006095)(93001095)(3002001)(10201501046)(6041288)(20161123562045)(20161123560045)(201703131423095)(201703011903075)(201702281528075)(20161123555045)(201703061421075)(20161123564045)(20161123558120)(6072148)(201708071742011); SRVR:HK2PR0302MB2579; BCL:0; PCL:0; RULEID:; SRVR:HK2PR0302MB2579; x-forefront-prvs: 0588B2BD96 received-spf: None (protection.outlook.com: globalsign.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: EhUssBYBudn1yhuBRkD8kZaLgC2I0vav5iH1734j/l3c1m0F+Yuf5QCpT7xe5ON3hwJBEuvUNCCuTkp7+xSYvxMMLiQbWRHrOLCZGf8/mSLupxZPmsmKrGy/1QJTLjHWj1OIs38WRJI3DXFKpyr2hfz13Vq9eG5b0cWBJMe9pHY= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha256; boundary="B_3601881728_1046608566" MIME-Version: 1.0 X-OriginatorOrg: globalsign.com X-MS-Exchange-CrossTenant-Network-Message-Id: 22d8cdaa-6b7f-4db5-5d65-08d577856d39 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Feb 2018 10:42:08.9156 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8fff67c1-8281-4635-b62f-93106cb7a9a8 X-MS-Exchange-Transport-CrossTenantHeadersStamped: HK2PR0302MB2579 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 10:42:18 -0000 --B_3601881728_1046608566 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: 7bit > When using >1 vCPUs can you set hw.xn.num_queues=1 on > /boot/loader.conf and try to reproduce the issue? > > I'm afraid this is rather related to multiqueue (which is only used > if >1 vCPUs). > > Thanks, Roger. Roger - thanks for your quick reply, this is confirmed. Setting hw.xn.num_queues=1 on the server VM when vCPUs > 1 prevents the issue. For reference, please can you comment on the performance impact of this? Laurence --B_3601881728_1046608566 Content-type: application/pkcs7-signature; name="smime.p7s" Content-transfer-encoding: base64 Content-disposition: attachment; filename="smime.p7s" MIIP9AYJKoZIhvcNAQcCoIIP5TCCD+ECAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0B BwGggg21MIIFYjCCBEqgAwIBAgIMSX2V7ElwCIrABZuQMA0GCSqGSIb3DQEBCwUAMF0xCzAJ BgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxT aWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2IC0gRzMwHhcNMTYwODI2MTQzNjA4WhcN MTkwODI3MTQzNjA4WjCBnDELMAkGA1UEBhMCR0IxDTALBgNVBAgTBEtlbnQxEjAQBgNVBAcT CU1haWRzdG9uZTEfMB0GA1UEChMWR01PIEdsb2JhbFNpZ24gTGltaXRlZDEZMBcGA1UEAxMQ TGF1cmVuY2UgUGF3bGluZzEuMCwGCSqGSIb3DQEJARYfbGF1cmVuY2UucGF3bGluZ0BnbG9i YWxzaWduLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALBcjCf6ajlJBRGN ptXjlTf3Wwv5TuzE6iW5j3YOxxGE2uRSoisepRd5pHkQ3ffF1u4Rjfc3aXcHvlmipxf3pA3e TrGJGrlLhvpnY2Zg7ZXDYHEqZIfgASxl/5EXeshGqVi9uIoCjHng+oyfXU0GWuKPgqh88oZN Wm45QoeH4t96TRdlY/dpFjK8ea6vFvZApvbum8bYJZGlJOtgPl0j8/uF1akM8SNxciDQfT39 2quhOd6LxK0LeX9qIe5lXjbhojmyb0IUf4HKZanSuFMer5OY9MnsFgMsUdLs/D5LWw2dsqcF YfQgGs2FEolsnBwmogblGogYxpqy8qIK2JZwJp0CAwEAAaOCAeAwggHcMA4GA1UdDwEB/wQE AwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYBBQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xv YmFsc2lnbi5jb20vY2FjZXJ0L2dzcGVyc29uYWxzaWduMnNoYTJnM29jc3AuY3J0MD0GCCsG AQUFBzABhjFodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hh MmczME0GA1UdIARGMEQwQgYKKwYBBAGgMgEoCjA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3 dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAJBgNVHRMEAjAAMEQGA1UdHwQ9MDswOaA3 oDWGM2h0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hhMmczLmNy bDAqBgNVHREEIzAhgR9sYXVyZW5jZS5wYXdsaW5nQGdsb2JhbHNpZ24uY29tMB0GA1UdJQQW MBQGCCsGAQUFBwMCBggrBgEFBQcDBDAdBgNVHQ4EFgQU5SIdmwI3kfJf98Y87lFl62amcP0w HwYDVR0jBBgwFoAUaXKCYjFnlUSFd5GAxAQ2SZ17C2EwDQYJKoZIhvcNAQELBQADggEBACMg 3mWAnD3BBOGpqvrPNem5D3G0GMKlVWSsRax251QsJwogpkoFDgbyX4QtHmkooPRGNydJGwhV TjvWu5BMle9UuZbcDw6zno3/hLD7kDIUlNJOuU+IgRhWtZwp6ELxaSvIBkiDKPRmpue3P73X gMTq2VnDwUx5Sxk9FkZcyFNfZ1wvZGWA03sZAZXj1UkmBrsGZ/dOpfsLr1Z0N4AR2ZVx+H4C MyWzVGJzp5Lvqw54WDY4KL4XRmkw8SrdujgIA5SsoAl4wEmSl1GZiXdb88koxbQ7yME+roNa q86YT7L4n4cWSBsf5lQTodjeYLWN1mmlBGzBxcv2ceTcy541lbwwggToMIID0KADAgECAg5I G2oJE72AJMpdIvAU8zANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQLExdHbG9iYWxTaWduIFJv b3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UEAxMKR2xvYmFsU2lnbjAe Fw0xNjA2MTUwMDAwMDBaFw0yNDA2MTUwMDAwMDBaMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAy IENBIC0gU0hBMjU2IC0gRzMwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC2lmiT Zf0sAexiow1Uv4vLpEORopqvsYPytW1v2fDq3M8We9cZ44QDhfnGH3CPH2xJxWkZHnCRODV+ AkhdOWsYRKZqpch09F31hD5jH3FEggg+7cmn9uluJkEpgMlJuv/ZdqCjuxv2ed9LKNNKe5xR wg9lUKGfqEqd5UYEjYNP3LLIPc+YIQmYTMDxj3qpPzcmZUfYZo9JJsLDQL5mPWz/Oq0pRvAT nOHy65mni8LTX1Btog5vxwaXOC9OoY5HArSDANik47pBB2Dl3Tda8gfBO6ecl2gut++pSDa8 6WmomapH6cf2UdL5sSy2xUm1mJ5TU9r7cvN8D/hxPtcD+mfDAgMBAAGjggG1MIIBsTAOBgNV HQ8BAf8EBAMCAQYwagYDVR0lBGMwYQYIKwYBBQUHAwIGCCsGAQUFBwMEBggrBgEFBQcDCQYK KwYBBAGCNxQCAgYKKwYBBAGCNwoDBAYJKwYBBAGCNxUGBgorBgEEAYI3CgMMBggrBgEFBQcD BwYIKwYBBQUHAxEwEgYDVR0TAQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUaXKCYjFnlUSFd5GA xAQ2SZ17C2EwHwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vcm9vdHIzMDYG A1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vcm9vdC1yMy5jcmww ZwYDVR0gBGAwXjALBgkrBgEEAaAyASgwDAYKKwYBBAGgMgEoCjBBBgkrBgEEAaAyAV8wNDAy BggrBgEFBQcCARYmaHR0cHM6Ly93d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8wDQYJ KoZIhvcNAQELBQADggEBAKidzTLMfGfiC1DXpVxwo2biJe/qtLZTMG6HEjdcM+LCKFbjk71F lfNY2BVxTPPkgokUvv6lzEe96wZUgj7mv7716oj1ecQoIguMevYOC+MqrkmaDpvCJ/JsthtV SgG2GeFoUHRYvBJFGE+u3l4bEzDnVSY0gKL+FIoEqweEYVIRolAAtnLgcvQRZ24TogtgCNfo FJdEO0cV5Q911vjp/kd/mvMhMYuyf0Eimg5WuBLzvw7gmd9RZCLb3IF+fvkdqOJ8W88L66qf 6txWe+ukuCws5gb/riRZf8VEfz6aFV76ZxJffGxSlzEr2r28tNW2uhT/IlSYQLg5wfl1Cxsc GqMwggNfMIICR6ADAgECAgsEAAAAAAEhWFMIojANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQL ExdHbG9iYWxTaWduIFJvb3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UE AxMKR2xvYmFsU2lnbjAeFw0wOTAzMTgxMDAwMDBaFw0yOTAzMTgxMDAwMDBaMEwxIDAeBgNV BAsTF0dsb2JhbFNpZ24gUm9vdCBDQSAtIFIzMRMwEQYDVQQKEwpHbG9iYWxTaWduMRMwEQYD VQQDEwpHbG9iYWxTaWduMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzCV2kHkG eCIW9cCDtoTKKJ79BXYRxa2IcvxGAkPHsoqdBF8kyy5L4WCCRuFSqwyBR3Bs3WTR6/Usow+C PQwrrpfXthSGEHm7OxOAd4wI4UnSamIvH176lmjfiSeVOJ8G1z7JyyZZDXPesMjpJg6DFcbv W4vSBGDKSaYo9mk79svIKJHlnYphVzesdBTcdOA67nIvLpz70Lu/9T0A4QYz6IIrrlOmOhZz jN1BDiA6wLSnoemyT5AuMmDpV8u5BJJoaOU4JmB1sp93/5EU764gSfytQBVI0QIxYRleuJfv rXe3ZJp6v1/BE++bYvsNbOBUaRapA9pu6YOTcXbGaYWCFwIDAQABo0IwQDAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUj/BLf6guRSSuTVD6Y5qL3uLdG7ww DQYJKoZIhvcNAQELBQADggEBAEtA28BQqv7IDO/3llRFSbuWAAlBrLMThoYoBzPKa+Z0uboA La6kCtP18fEPir9zZ0qDx0R7eOCvbmxvAymOMzlFw47kuVdsqvwSluxTxi3kJGy5lGP73FNo Z1Y+g7jPNSHDyWj+ztrCU6rMkIrp8F1GjJXdelgoGi8d3s0AN0GP7URt11Mol37zZwQeFdeK lrTT3kwnpEwbc3N29BeZwh96DuMtCK0KHCz/PKtVDg+Rfjbrw1dJvuEuLXxgi8NBURMjnc73 MmuUAaiZ5ywzHzo7JdKGQM47LIZ4yWEvFLru21Vv34TuBQlNvSjYcs7TYlBlHuuSl4Mx2bO1 ykdYP18xggIDMIIB/wIBATBtMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWdu IG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2 IC0gRzMCDEl9lexJcAiKwAWbkDANBglghkgBZQMEAgEFAKBpMC8GCSqGSIb3DQEJBDEiBCB8 aNzfpYozQ/xfkCCmjjSKys2lJJQRltQwtSN3tVOFSTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0xODAyMTkxMDQyMDhaMA0GCSqGSIb3DQEBAQUABIIBADW/ nOtPmnBaLXY094SU+v12CNLetpAJYGhjPS7ExN8H7goqX8cajt6j+W9gaBH5yIu3eTe/HS89 +YVS4cPYUgZote8QKxRmxd7+3xomnEQKs1iXPp2QW5fyxi/3xlCJxy190rTlSVzJqstYMPT7 YVGoeYv4PirWpmnyTtGfD+nc1RbUH08w527rvfHds4rFICaFDh6pGLDOu++JdsGAc1Pb+DXq F0ENsOeY+eBszBIvj/ihb+iM2Go2px7oD1K78VaX2PjLeIoeMvXb58uihT+/b0iTpzzTMUXz yrvx+W9LTvRZo5T1+F27++FAXwCvif64zW8mUtQ5M8nCRgtjfeE= --B_3601881728_1046608566-- From owner-freebsd-virtualization@freebsd.org Mon Feb 19 11:02:28 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 093E8F1A800; Mon, 19 Feb 2018 11:02:28 +0000 (UTC) (envelope-from prvs=5814e79b2=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F9C96E80D; Mon, 19 Feb 2018 11:02:27 +0000 (UTC) (envelope-from prvs=5814e79b2=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.46,534,1511827200"; d="scan'208";a="68152684" Date: Mon, 19 Feb 2018 11:02:19 +0000 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Laurence Pawling CC: "freebsd-xen@freebsd.org" , "freebsd-virtualization@freebsd.org" , "freebsd-net@freebsd.org" , David King , Vlad Galu Subject: Re: multi-vCPU networking issues as client OS under Xen Message-ID: <20180219110219.r4yrgbc4yomb3gly@MacBook-Pro-de-Roger.local> References: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20171208 X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 11:02:28 -0000 On Mon, Feb 19, 2018 at 10:42:08AM +0000, Laurence Pawling wrote: > > When using >1 vCPUs can you set hw.xn.num_queues=1 on > > /boot/loader.conf and try to reproduce the issue? > > > > I'm afraid this is rather related to multiqueue (which is only used > > if >1 vCPUs). > > > > Thanks, Roger. > > Roger - thanks for your quick reply, this is confirmed. Setting hw.xn.num_queues=1 on the server VM when vCPUs > 1 prevents the issue. I've also been told that in order to discard this being a XenServer specific issue you should execute the following on Dom0 and reboot the server: # xe-switch-network-backend bridge And then try to reproduce the issue again with >1 vCPUs (and of course removing the queue limit in loader.conf) > For reference, please can you comment on the performance impact of this? I'm afraid I don't have any numbers. Roger. From owner-freebsd-virtualization@freebsd.org Mon Feb 19 18:13:30 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F812F172E5 for ; Mon, 19 Feb 2018 18:13:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F60683B24 for ; Mon, 19 Feb 2018 18:13:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7B7AA15BF3 for ; Mon, 19 Feb 2018 18:13:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1JIDT2E043018 for ; Mon, 19 Feb 2018 18:13:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1JIDToM043010 for freebsd-virtualization@FreeBSD.org; Mon, 19 Feb 2018 18:13:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Mon, 19 Feb 2018 18:13:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 18:13:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #6 from Andriy Gapon --- Could you please run this command after attaching the device and before run= ning the gpart command? # camcontrol debug -c -p -I -P 3:0:0 Where 3:0:0 is taken from bus, target, lun reported by camcontrol devlist. I hope that this will enable debugging messages that will tell us more about what is going on. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 20 14:49:29 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9E21F07D41 for ; Tue, 20 Feb 2018 14:49:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 488C17A320 for ; Tue, 20 Feb 2018 14:49:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 980A3207FF for ; Tue, 20 Feb 2018 14:49:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1KEnSob013324 for ; Tue, 20 Feb 2018 14:49:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1KEnSvr013323 for freebsd-virtualization@FreeBSD.org; Tue, 20 Feb 2018 14:49:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Tue, 20 Feb 2018 14:49:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: David.Boyd49@twc.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Feb 2018 14:49:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #7 from David.Boyd49@twc.com --- Created attachment 190827 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D190827&action= =3Dedit Output of gpart show da0 after camcontrol debug -c -p -I -P 3:0:0 Output of gpart show da0 after camcontrol devlist debug -c -p -I -P 3:0:0 I had to extract this text from dmesg -a due to size exceeding VirtualBox screenshot limit. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 20 18:34:25 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA042F1DB1A for ; Tue, 20 Feb 2018 18:34:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6AEBC85A08 for ; Tue, 20 Feb 2018 18:34:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B03FC22837 for ; Tue, 20 Feb 2018 18:34:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1KIYO2d002056 for ; Tue, 20 Feb 2018 18:34:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1KIYOPU002055 for freebsd-virtualization@FreeBSD.org; Tue, 20 Feb 2018 18:34:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Tue, 20 Feb 2018 18:34:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Feb 2018 18:34:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #8 from Andriy Gapon --- (In reply to David.Boyd49 from comment #7) This is valuable information, thank you! Could you please install sg3_utils package? And then run the following commands (after attaching the USB device): sg_modes -p 63 -vvvvv /dev/pass2 sg_modes -p 63 -m 192 -vvvvv /dev/pass2 sg_modes -p 63 -6 -vvvvv /dev/pass2 It might be helpful to run the same commands (adjusted for the device name)= on the host to see if VirtualBox causes any trouble (unlikely). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 20 18:37:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9686F1F14B for ; Tue, 20 Feb 2018 18:37:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 823BB85D48 for ; Tue, 20 Feb 2018 18:37:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D035422843 for ; Tue, 20 Feb 2018 18:37:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1KIbW2k006447 for ; Tue, 20 Feb 2018 18:37:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1KIbWBR006446 for freebsd-virtualization@FreeBSD.org; Tue, 20 Feb 2018 18:37:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Tue, 20 Feb 2018 18:37:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Feb 2018 18:37:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #9 from Andriy Gapon --- And for completeness: sg_modes -a -vvvvv /dev/pass2 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Feb 20 23:09:17 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D31EF0ED42 for ; Tue, 20 Feb 2018 23:09:17 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from mail.physik.tu-berlin.de (mail.physik-pool.tu-berlin.de [130.149.50.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E18A376738 for ; Tue, 20 Feb 2018 23:09:16 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from [192.168.119.1] (wlan-141-23-176-213.tubit.tu-berlin.de [141.23.176.213]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.physik.tu-berlin.de (Postfix) with ESMTPSA id 7DE9761F92 for ; Tue, 20 Feb 2018 22:59:10 +0000 (UTC) From: "Fabian Freyer" To: freebsd-virtualization@freebsd.org Subject: VMX exit reason=33 and general userboot.so questions Date: Tue, 20 Feb 2018 23:58:56 +0100 X-Mailer: MailMate (1.10r5443) Message-ID: MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=_MailMate_36086495-52E9-42F0-92E1-29907CBCFF01_="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Feb 2018 23:09:17 -0000 --=_MailMate_36086495-52E9-42F0-92E1-29907CBCFF01_= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi! I=E2=80=99m currently writing a userboot.so-compatible boot loader [1] an= d am slowly getting to a point were I want to do some testing with runnin= g test kernels in bhyve. At the moment, I=E2=80=99m getting the following error after loading my k= ernel: ---8< snip vm exit[0] reason VMX rip 0x000000000010000c inst_length 0 status 0 exit_reason 33 qualification 0x0000000000000000 inst_type 0 inst_error 0 [1] [PID] abort bhyve -H -P -s 0,hostbridge -s 31,lpc -c 1 -m 128= M testing --->8 snap This is the register state I=E2=80=99m setting up before running bhyve: ---8< snip efer[0] 0x0000000000000000 cr0[0] 0x0000000000000021 cr3[0] 0x0000000000000000 cr4[0] 0x0000000000000000 dr7[0] 0x0000000000000000 rsp[0] 0x0000000000000000 rip[0] 0x000000000010000c rax[0] 0x000000002badb002 rbx[0] 0x0000000000100952 rcx[0] 0x0000000000000000 rdx[0] 0x0000000000000000 rsi[0] 0x0000000000000000 rdi[0] 0x0000000000000000 rbp[0] 0x0000000000000000 r8[0] 0x0000000000000000 r9[0] 0x0000000000000000 r10[0] 0x0000000000000000 r11[0] 0x0000000000000000 r12[0] 0x0000000000000000 r13[0] 0x0000000000000000 r14[0] 0x0000000000000000 r15[0] 0x0000000000000000 rflags[0] 0x0000000000000002 ds desc[0] 0x0000000000000000/0xffffffff/0x0000c093 es desc[0] 0x0000000000000000/0xffffffff/0x0000c093 fs desc[0] 0x0000000000000000/0xffffffff/0x0000c093 gs desc[0] 0x0000000000000000/0xffffffff/0x0000c093 ss desc[0] 0x0000000000000000/0xffffffff/0x0000c093 cs desc[0] 0x0000000000000000/0xffffffff/0x0000c09b tr desc[0] 0x0000000000000000/0x00000000/0x00000000 ldtr desc[0] 0x0000000000000000/0x00000000/0x00000000 gdtr[0] 0x0000000000000000/0x00000000 idtr[0] 0x0000000000000000/0x00000000 cs[0] 0x0000 ds[0] 0x0000 es[0] 0x0000 fs[0] 0x0000 gs[0] 0x0000 ss[0] 0x0000 tr[0] 0x0000 ldtr[0] 0x0000 [... omitted some, not sure if relevant] --->8 snap And here=E2=80=99s a diff of the register state before and after running = bhyve: ---8< snip --- before 2018-02-20 22:36:16.001919000 +0000 +++ after 2018-02-20 22:36:27.442941000 +0000 --- before 2018-02-20 22:36:16.001919000 +0000 +++ after 2018-02-20 22:36:27.442941000 +0000 @@ -56 +56 @@ -procbased_ctls[0] 0x00000000b5186572 +procbased_ctls[0] 0x00000000f51865f2 @@ -67 +67 @@ -host_cr3[0] 0x0000000000000000 +host_cr3[0] 0x0000000389cac09a @@ -101,4 +101,4 @@ -exit_reason[0] 0 -rtc nvram[000]: 0x05 -rtc time 0x5: Thu Jan 01 00:00:05 1970 -Capability "hlt_exit" is not set on vcpu 0 +exit_reason[0] 0x80000021 +rtc nvram[000]: 0x26 +rtc time 0x5a8ca2ea: Tue Feb 20 22:36:26 2018 +Capability "hlt_exit" is set on vcpu 0 @@ -106 +106 @@ -Capability "pause_exit" is not set on vcpu 0 +Capability "pause_exit" is set on vcpu 0 @@ -109 +109 @@ -active cpus: (none) +active cpus: 0 @@ -125 +125 @@ -number of vm exits for unknown reason 0 +number of vm exits for unknown reason 1 @@ -128 +128 @@ -number of vm exits handled in userspace 0 +number of vm exits handled in userspace 1 @@ -131 +131 @@ -vcpu total runtime 0 +vcpu total runtime 11904 @@ -165,3 +165,3 @@ -Number of vpid invalidations done 0 -vcpu migration across host cpus 0 -total number of vm exits 0 +Number of vpid invalidations done 1 +vcpu migration across host cpus 1 +total number of vm exits 1 --->8 snap The code at that RIP point also looks correct: xxd -s 0x000000000010000c -l 5 /dev/vmm/testing 0010000c: bc00 2000 00 Which decompiles to: 0010000c: bc00200000 mov esp,0x2000 I=E2=80=99ve been looking at what userboot.so, grub2-bhyve and vm_setup_f= reebsd_registers is doing. However, I left all registers that don=E2=80=99= t have a defined state in the multiboot specification [2] in the state th= ey are. How would I best start debugging this? Fabian [1] https://github.com/fabianfreyer/bhyve-multiboot/tree/multiboot/info [2] https://www.gnu.org/software/grub/manual/multiboot/multiboot.html --=_MailMate_36086495-52E9-42F0-92E1-29907CBCFF01_= Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQJWBAEBCgBAFiEEX6JoxdmEemcFacQZmealkcs85+YFAlqMqDAiHGZhYmlhbi5m cmV5ZXJAcGh5c2lrLnR1LWJlcmxpbi5kZQAKCRCZ5qWRyzzn5jimEADKTpWioyeS b5HMGfrwKvMwQHA73KKTE86c7Wo1poRuTSKxqAT4WeDio211I5uALJueyCHkFzWf xyI4XoPw97Ueq93y1Kx+/hjxU1/u8Fy64Jk/I9Nt0DA80hCTULzb4m+jl0tqPRNM Z/4JIQWu/RHTlyX4wHFg4w7vfobvg60X/qqXWjm7uaec5eQEgJdNpe1/x4wuyZ5D OgDFoks8gR/QUaXu3A9onc8lw0VAr59HyHWb+kty0QCHl1RKX7QDEPoqJ6lbt7f/ hfzvqi4F/pRHdy7a8CAz0iqUMsMfWdT5t+jZbsB2b3MvG3ZEa2UMX3uO8N38I5TP MEVxPkujR4hM4Yq/S0FpZD3R/5UFbg9d9zXJopI9byv8+gs1mH3d4GETn3DsovWw dv44QMKhOw8l0zmArX4qpGXzq+85CFo0sQ2vgCjdVqDCVgJZxpyGRxfYy42Gajpx PS/6scHL1CCRCAKsJrYHP3rBd+E94J1MCfo71/OVa4ppUnE1oCmu1KF0aoVCAKb5 OGDPdsfvvkCYbTEcWQ8KQwEFMBcFFHuK+stIN8k+J3E3v25lle9M5MQWXhX7DCxh 1QANGZwM9/iJne0QbfzwS2z/3gMZf0T1rv70aEZ1lhqGW1/1K6ZkL77xUE2x/7cJ kf+8ILy/Ry09LlkOCjWIkQx5pWXFnsTYzA== =y/K5 -----END PGP SIGNATURE----- --=_MailMate_36086495-52E9-42F0-92E1-29907CBCFF01_=-- From owner-freebsd-virtualization@freebsd.org Wed Feb 21 03:55:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A60EF27B74 for ; Wed, 21 Feb 2018 03:55:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D8BB083120 for ; Wed, 21 Feb 2018 03:55:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 1B2BC276FA for ; Wed, 21 Feb 2018 03:55:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1L3tCFT050854 for ; Wed, 21 Feb 2018 03:55:12 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1L3tC8r050853 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 03:55:12 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 03:55:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: David.Boyd49@twc.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 03:55:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #10 from David.Boyd49@twc.com --- Created attachment 190845 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D190845&action= =3Dedit Output of sg3_utils commands I ran the commands requested. The output looks truncated by error condition= s.=20 Maybe that is significant in itself. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 03:57:04 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C07DCF27D6F for ; Wed, 21 Feb 2018 03:57:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47AD883222 for ; Wed, 21 Feb 2018 03:57:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 4C83027701 for ; Wed, 21 Feb 2018 03:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1L3v3pP055104 for ; Wed, 21 Feb 2018 03:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1L3v3TF055103 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 03:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 03:57:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: David.Boyd49@twc.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 03:57:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #11 from David.Boyd49@twc.com --- Created attachment 190847 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D190847&action= =3Dedit Output of sg3_utils commands on CentOS EL 7.1708 host The VirtualBox host is CentOS EL 7.1708. I ran the sg commands there as we= ll. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 06:45:47 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9612F0A09B for ; Wed, 21 Feb 2018 06:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7067269660 for ; Wed, 21 Feb 2018 06:45:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A6956F18 for ; Wed, 21 Feb 2018 06:45:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1L6jkGe022491 for ; Wed, 21 Feb 2018 06:45:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1L6jk1U022490 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 06:45:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 06:45:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 06:45:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #12 from Andriy Gapon --- (In reply to David.Boyd49 from comment #10) Are you sure that you used the correct pass device? You used pass3 while previously the USB device had pass2. Just double-checking... It's very strange that even inquiry command failed= and mode sense command has not been even tried. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 06:49:49 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDF8EF0A2BA for ; Wed, 21 Feb 2018 06:49:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 866C16974C for ; Wed, 21 Feb 2018 06:49:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id C3A8FF20 for ; Wed, 21 Feb 2018 06:49:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1L6nlFw032131 for ; Wed, 21 Feb 2018 06:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1L6nlGl032130 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 06:49:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 06:49:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 06:49:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #13 from Andriy Gapon --- (In reply to David.Boyd49 from comment #11) The host results look good. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 15:13:29 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 305E1F0ACCF for ; Wed, 21 Feb 2018 15:13:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B8CEB809D5 for ; Wed, 21 Feb 2018 15:13:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D26505ADE for ; Wed, 21 Feb 2018 15:13:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1LFDRpl083519 for ; Wed, 21 Feb 2018 15:13:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1LFDRu8083512 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 15:13:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 15:13:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: David.Boyd49@twc.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 15:13:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #14 from David.Boyd49@twc.com --- Created attachment 190860 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D190860&action= =3Dedit Verify camcontrol devlist output for pass3 device Andriy, I verified pass3 as the USB device (see screenshot). I followed up on your suggestion that this might be VirtualBox. I tested w= ith CentOS and openSUSE guest. Neither had any problem mounting and accessing = the USB flash drive but both had similar errors trying to run sg_modes commands. A comment made in January (and overlooked since then) indicated that this occurred in a FreeBSD guest running FreeBSD-12.0-CURRENT-amd64-20180118-r328126.vmdk.xz where the host was usin= g a Via chipset (VL805 to be exact). I will test this as soon as possible on a host that has a NEC chipset (D720= 20x) to see if that actually makes any difference. I'll let you know. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 16:59:55 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D7CA2F150C3 for ; Wed, 21 Feb 2018 16:59:55 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 4C2458647A for ; Wed, 21 Feb 2018 16:59:55 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 9F26920B4AB9 for ; Thu, 22 Feb 2018 02:59:52 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 9648F2809C2 for ; Thu, 22 Feb 2018 02:59:52 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id pJki0tY9dXlZ for ; Thu, 22 Feb 2018 02:59:52 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id D806F2804E8; Thu, 22 Feb 2018 02:59:49 +1000 (AEST) Subject: Re: VMX exit reason=33 and general userboot.so questions To: Fabian Freyer References: Cc: freebsd-virtualization@freebsd.org From: Peter Grehan Message-ID: <0142d062-ca13-6917-bb06-28cac727680b@freebsd.org> Date: Wed, 21 Feb 2018 08:59:47 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=KPZ08mNo c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=Op4juWPpsa0A:10 a=4q-dA8eIyU7An6lk__gA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 16:59:56 -0000 Hi Fabian, > exit_reason 33 From the Intel SDM, vol 3B Appendix C, this error is "VM-entry failure due to invalid guest state". These errors can be difficult to debug given the large amount of guest state involved :( However, looking at the state from your dump: > tr desc[0] 0x0000000000000000/0x00000000/0x00000000 I believe you will have to set this. Here's the comment and relevant code fragment from grub2-bhyve grub-core/kern/emu/bhyve_hostif.c:grub_emu_bhyve_boot32() /* * XXX TR is pointing to null selector even though we set the * TSS segment to be usable with a base address and limit of 0. * Has to be 8b or vmenter will fail */ desc_access = 0x0000008b; assert(vm_set_desc(bhyve_ctx, 0, VM_REG_GUEST_TR, 0x1000, 0x67, desc_access) == 0); grub2-bhyve has been able to load/boot multiboot images, so I suspect the register settings in grub_emu_bhyve_boot32() are a good place to start from. later, Peter. From owner-freebsd-virtualization@freebsd.org Wed Feb 21 19:08:23 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0900EF21092 for ; Wed, 21 Feb 2018 19:08:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8AF006CCBF for ; Wed, 21 Feb 2018 19:08:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E1FF37AF8 for ; Wed, 21 Feb 2018 19:08:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1LJ8Ll8076434 for ; Wed, 21 Feb 2018 19:08:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1LJ8Ljx076433 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 19:08:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 19:08:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 19:08:23 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 --- Comment #15 from Andriy Gapon --- (In reply to David.Boyd49 from comment #14) Perhaps the device genuinely does not support INQUIRY command... Maybe camcontrol would be a better option in this case. Could you please try this? # camcontrol modepage /dev/pass3 -m 63 # camcontrol modepage /dev/pass3 -l --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Wed Feb 21 19:08:38 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA296F210C5 for ; Wed, 21 Feb 2018 19:08:38 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from mail.physik.tu-berlin.de (mail.physik-pool.tu-berlin.de [130.149.50.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48AF86CCFB; Wed, 21 Feb 2018 19:08:37 +0000 (UTC) (envelope-from fabian.freyer@physik.tu-berlin.de) Received: from [192.168.119.1] (wlan.turm11.org [217.197.84.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.physik.tu-berlin.de (Postfix) with ESMTPSA id 3440C61F9A; Wed, 21 Feb 2018 19:08:36 +0000 (UTC) From: "Fabian Freyer" To: "Peter Grehan" Cc: freebsd-virtualization@freebsd.org Subject: Re: VMX exit reason=33 and general userboot.so questions Date: Wed, 21 Feb 2018 20:08:34 +0100 X-Mailer: MailMate (1.10r5443) Message-ID: <5C51D1DD-BD11-40BD-B2EB-185524774D2C@physik.tu-berlin.de> In-Reply-To: <0142d062-ca13-6917-bb06-28cac727680b@freebsd.org> References: <0142d062-ca13-6917-bb06-28cac727680b@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=_MailMate_0DBF650D-C28C-4718-B4DF-7F6F40194E35_="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 19:08:39 -0000 This is an OpenPGP/MIME signed message (RFC 3156 and 4880). --=_MailMate_0DBF650D-C28C-4718-B4DF-7F6F40194E35_= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Peter, thanks for your response! On 21 Feb 2018, at 17:59, Peter Grehan wrote: > > exit_reason 33 > > From the Intel SDM, vol 3B Appendix C, this error is "VM-entry failure= due to invalid guest state". Yes, I=E2=80=99m currently going through SDM, vol 3B, section 26.3, and > These errors can be difficult to debug given the large amount of guest= state involved :( definitely accurately describes the experience. That said, I=E2=80=99m go= ing through each check and trying to see what is going wrong. > However, looking at the state from your dump: > > > tr desc[0] 0x0000000000000000/0x00000000/0x00000000 > > I believe you will have to set this. Here's the comment and relevant c= ode fragment from grub2-bhyve grub-core/kern/emu/bhyve_hostif.c:grub_emu_= bhyve_boot32() > > /* > * XXX TR is pointing to null selector even though we set the > * TSS segment to be usable with a base address and limit of 0. > * Has to be 8b or vmenter will fail > */ > desc_access =3D 0x0000008b; > assert(vm_set_desc(bhyve_ctx, 0, VM_REG_GUEST_TR, 0x1000, 0x67, > desc_access) =3D=3D 0); > > grub2-bhyve has been able to load/boot multiboot images, so I suspect = the register settings in grub_emu_bhyve_boot32() are a good place to star= t from. Thanks. I=E2=80=99ve tried setting all registers (especially) the segment= registers as grub2-bhyve does, but I still don=E2=80=99t seem to be able= to boot correctly. Fixing the TR descriptor didn=E2=80=99t do it. Here=E2=80=99s a list of the descriptors I set up: ds desc[0] 0x0000000000000000/0xffffffff/0x00000093 es desc[0] 0x0000000000000000/0xffffffff/0x00000093 fs desc[0] 0x0000000000000000/0xffffffff/0x00000093 gs desc[0] 0x0000000000000000/0xffffffff/0x00000093 ss desc[0] 0x0000000000000000/0xffffffff/0x00000093 cs desc[0] 0x0000000000000000/0xffffffff/0x0000009b tr desc[0] 0x0000000000001000/0x00000067/0x0000008b ldtr desc[0] 0x0000000000000000/0x0000ffff/0x00010082 gdtr points to a default gdt as set up in grub2-bhyve: static uint16_t bhyve_gdt[] =3D { 0x0000, 0x0000, 0x0000, 0x0000, /* Null */ 0x0000, 0x0000, 0x0000, 0x0000, /* Null #2 */ 0xffff, 0x0000, 0x9a00, 0x00cf, /* code */ 0xffff, 0x0000, 0x9200, 0x00cf, /* data */ 0x0000, 0x0000, 0x8900, 0x0080 /* tss */ }; gdtr[0] 0x0000000000100161/0x00000027 idtr[0] 0x0000000000000000/0x00000000 The rest is set up as by grub2-bhyve: cs[0] 0x0008 ds[0] 0x0010 es[0] 0x0010 fs[0] 0x0010 gs[0] 0x0010 ss[0] 0x0010 tr[0] 0x0000 ldtr[0] 0x0000 I=E2=80=99m assuming entry_ctls[0] =3D 0x91fb is the VM-entry control, bu= t is it the value described by Table 24-7 of the SDM Volume 3B? Is this c= onstant for the first entry after running bhyveload? That is, when writi= ng some compliance checks against section 26.3.1, can I just hardcode tha= t value? I=E2=80=99m starting to dig through the bhyverun code, but I=E2=80=99m st= ill pretty new to VMX stuff, so I am ending up with more questions than a= nswers. Fabian --=_MailMate_0DBF650D-C28C-4718-B4DF-7F6F40194E35_= Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQJWBAEBCgBAFiEEX6JoxdmEemcFacQZmealkcs85+YFAlqNw7IiHGZhYmlhbi5m cmV5ZXJAcGh5c2lrLnR1LWJlcmxpbi5kZQAKCRCZ5qWRyzzn5nLyEACKDA1R/Qg4 ZZyfec5crhrizkog4Wr9T0tTHE1Jc2+wmUoHzKzFoMZdRfF0bWF2GucU70Fbi/Gk 0Hjxqwvoh2U475Nn4x+5Yt6mgHe4xDd38Dwj9pA91r93tAQONGZP4FxtsXGfDrYV +1Tkif8gIN21rJc1Ga4tj+bD/1ruja5hDdrUK39JJgSM0ZDX1iiM6eba7QH6dl0B B2Hle707WrZhUUB0odnQvO4oysqL57Hdxjw2LCswumH+CvRGvcz7TRrCsjPZY/3B n4OUnVdFtAP/ak01jEcjaiLQbyLB3/ARN6RIvNEqn4Ujxh+DEMMbIUTxgYI7zZHx 8z3nOMYtcunXEnfrPH2eLFbQ0vnvwIy5YhWXP93IN6qgufQJFkzvp8fnsseTFcBo PPqtm/6TDDt9YoaFsHk4+OPk4Hurgj5OXIUIA13qc4pW7X4Yj9eOp9yfJFhBTqC6 L/gdBT5E3OImqBOYLbeo3PjggpUZXii61x1VDSaJ0R1bLgg4ILL5nOH4iaMDYYkb R4H1azqM3/3d8LlE2gMLoFDjTxBhND1MOwvDVFgPTzLWNRqm0yv2YXqmfsFCAAI7 lVFTlFCriZMyIZSAjDGSMGnaY+BGeZIBNKfnOvN2CQgElo7xBAejOoKHcGGd3IDi REmfGasV8fZ49Vw3OK5CL/1UsFwlvmRIPA== =wbGw -----END PGP SIGNATURE----- --=_MailMate_0DBF650D-C28C-4718-B4DF-7F6F40194E35_=-- From owner-freebsd-virtualization@freebsd.org Wed Feb 21 19:10:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0FE1FF2130F for ; Wed, 21 Feb 2018 19:10:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7B7A26CE1E for ; Wed, 21 Feb 2018 19:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id BF7957B07 for ; Wed, 21 Feb 2018 19:10:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w1LJAXEN080590 for ; Wed, 21 Feb 2018 19:10:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w1LJAXEU080589 for freebsd-virtualization@FreeBSD.org; Wed, 21 Feb 2018 19:10:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 225794] VM images for 12.0-CURRENT have problem with USB 3.0 ports Date: Wed, 21 Feb 2018 19:10:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Feb 2018 19:10:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225794 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |freebsd-usb@FreeBSD.org Assignee|freebsd-virtualization@Free |freebsd-scsi@FreeBSD.org |BSD.org | --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Thu Feb 22 03:47:47 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 80FFCF23EE3 for ; Thu, 22 Feb 2018 03:47:47 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-qk0-x231.google.com (mail-qk0-x231.google.com [IPv6:2607:f8b0:400d:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EC7B9876F9; Thu, 22 Feb 2018 03:47:46 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-qk0-x231.google.com with SMTP id s188so4873425qkb.2; Wed, 21 Feb 2018 19:47:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=GHzNzHvKlHKGfTV3s1QdF2/G/Wq+57PsE/F6jHqkymY=; b=I96bWgSXdyJ0uXmUWDx1Z6FdKI42C4dm+Sl9s8wJUHCXoDCpx4YUNdHlA2s5Xi3Ky1 G5mCQFyORGLncYIquRPeVkVy2iY5oK7eEM3jXi0B8sNj4SMZGorx7Lig1GnNbMscNnGg DyxWG7jqdztOtDZgN0e0U9sCcaM7tjSRgVot/vgYc2+dvhxSBpFmKesi+wj9a63C27gA 2KRU201CaFOt9HsNnSUsKzWHx7mhhm15B0q3pozBYORtutSCeW1ywJ5GXLyt7N9QzduG Rw3OEZu4rcMp1+d9YRv27rIUob4fOXixog61Bkez/agtShmu/j+6mD1zcuXIvsFLFJOg fZyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=GHzNzHvKlHKGfTV3s1QdF2/G/Wq+57PsE/F6jHqkymY=; b=Xo74EiD48dBpqF0p8RyQXhUsHDoZYTKgVJBHF5IMvIjIz3JrO0bi04dn8cwhah1pNS Z4S5K5B9BQ2FcfxOIpfiRiAt9JCogxtY/oQBdCKSfypY0K3U4Q5BsHgM52Xa7tM3SIV0 MSIL7mCGi/fb+nbhXdCL0wErE8FrE/9fYNKZLnXX1WUBqwspTtSbTpR+e7kJ7VDP1k+j GqvpXmWtSBUh8/m3EusaCyhtLO+SguKiJuYZN/Xo28flZWKlxBOOvvZXH2sDqb5mcvf6 SFboHns/Ykfb5SKtzQZZ9H4hFLnuYcpN942c4QlKKRR7TvXZcOnBJhWq/cZAO6zAqorx /oiw== X-Gm-Message-State: APf1xPAdU6ekZif0YYBqT9oSUu/SeLzRIlkhzm7nfDldNgDzALIuGkJP D6LXRuB/qKTD8ZcWB7gPNRIt3+qMBCnw7m+zr1MEdg== X-Google-Smtp-Source: AH8x224IN8R+AcD1M/dFHbWF+uKpb5h+1nXpWJp5oO0rquL6DHbgP7ftq75tb8RP1HA473wervcIFe3KEVPRsPg0Oi8= X-Received: by 10.55.123.5 with SMTP id w5mr8787925qkc.261.1519271266515; Wed, 21 Feb 2018 19:47:46 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.170.140 with HTTP; Wed, 21 Feb 2018 19:47:45 -0800 (PST) In-Reply-To: <5C51D1DD-BD11-40BD-B2EB-185524774D2C@physik.tu-berlin.de> References: <0142d062-ca13-6917-bb06-28cac727680b@freebsd.org> <5C51D1DD-BD11-40BD-B2EB-185524774D2C@physik.tu-berlin.de> From: Anish Date: Wed, 21 Feb 2018 19:47:45 -0800 Message-ID: Subject: Re: VMX exit reason=33 and general userboot.so questions To: Fabian Freyer Cc: Peter Grehan , "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 03:47:47 -0000 >idtr[0] 0x0000000000000000/0x00000000 IDTR is not set, you can set the value same as in GDTR, from libvmm /* GDTR, IDTR */ desc_base =3D 0; desc_limit =3D 0xffff; desc_access =3D 0; error =3D vm_set_desc(vmctx, vcpu, VM_REG_GUEST_GDTR, desc_base, desc_limit, desc_access); if (error !=3D 0) goto done; error =3D vm_set_desc(vmctx, vcpu, VM_REG_GUEST_IDTR, desc_base, desc_limit, desc_access); >I=E2=80=99m assuming entry_ctls[0] =3D 0x91fb is the VM-entry control, Yes, it is VM entry control. Its value need to be determined based on MSR_VMX_ENTRY_CTLS and MSR_VMX_TRUE_ENTRY_CTLS MSRs, see /* Check support for VM-entry controls */ error =3D vmx_set_ctlreg(MSR_VMX_ENTRY_CTLS, MSR_VMX_TRUE_ENTRY_CTL= S, VM_ENTRY_CTLS_ONE_SETTING, VM_ENTRY_CTLS_ZERO_SETTING, &entry_ctls); -Anish On Wed, Feb 21, 2018 at 11:08 AM, Fabian Freyer < fabian.freyer@physik.tu-berlin.de> wrote: > Hi Peter, > > thanks for your response! > > On 21 Feb 2018, at 17:59, Peter Grehan wrote: > > > exit_reason 33 > > > > From the Intel SDM, vol 3B Appendix C, this error is "VM-entry failure > due to invalid guest state". > > Yes, I=E2=80=99m currently going through SDM, vol 3B, section 26.3, and > > > These errors can be difficult to debug given the large amount of guest > state involved :( > > definitely accurately describes the experience. That said, I=E2=80=99m go= ing > through each check and trying to see what is going wrong. > > > However, looking at the state from your dump: > > > > > tr desc[0] 0x0000000000000000/0x00000000/0x00000000 > > > > I believe you will have to set this. Here's the comment and relevant > code fragment from grub2-bhyve grub-core/kern/emu/bhyve_ > hostif.c:grub_emu_bhyve_boot32() > > > > /* > > * XXX TR is pointing to null selector even though we set the > > * TSS segment to be usable with a base address and limit of 0. > > * Has to be 8b or vmenter will fail > > */ > > desc_access =3D 0x0000008b; > > assert(vm_set_desc(bhyve_ctx, 0, VM_REG_GUEST_TR, 0x1000, 0x67, > > desc_access) =3D=3D 0); > > > > grub2-bhyve has been able to load/boot multiboot images, so I suspect > the register settings in grub_emu_bhyve_boot32() are a good place to star= t > from. > > Thanks. I=E2=80=99ve tried setting all registers (especially) the segment > registers as grub2-bhyve does, but I still don=E2=80=99t seem to be able = to boot > correctly. Fixing the TR descriptor didn=E2=80=99t do it. > > Here=E2=80=99s a list of the descriptors I set up: > > ds desc[0] 0x0000000000000000/0xffffffff/0x00000093 > es desc[0] 0x0000000000000000/0xffffffff/0x00000093 > fs desc[0] 0x0000000000000000/0xffffffff/0x00000093 > gs desc[0] 0x0000000000000000/0xffffffff/0x00000093 > ss desc[0] 0x0000000000000000/0xffffffff/0x00000093 > cs desc[0] 0x0000000000000000/0xffffffff/0x0000009b > tr desc[0] 0x0000000000001000/0x00000067/0x0000008b > ldtr desc[0] 0x0000000000000000/0x0000ffff/0x00010082 > > > gdtr points to a default gdt as set up in grub2-bhyve: > > static uint16_t bhyve_gdt[] =3D { > 0x0000, 0x0000, 0x0000, 0x0000, /* Null */ > 0x0000, 0x0000, 0x0000, 0x0000, /* Null #2 */ > 0xffff, 0x0000, 0x9a00, 0x00cf, /* code */ > 0xffff, 0x0000, 0x9200, 0x00cf, /* data */ > 0x0000, 0x0000, 0x8900, 0x0080 /* tss */ > }; > > gdtr[0] 0x0000000000100161/0x00000027 > idtr[0] 0x0000000000000000/0x00000000 > > The rest is set up as by grub2-bhyve: > cs[0] 0x0008 > ds[0] 0x0010 > es[0] 0x0010 > fs[0] 0x0010 > gs[0] 0x0010 > ss[0] 0x0010 > tr[0] 0x0000 > ldtr[0] 0x0000 > > I=E2=80=99m assuming entry_ctls[0] =3D 0x91fb is the VM-entry control, bu= t is it the > value described by Table 24-7 of the SDM Volume 3B? Is this constant for > the first entry after running bhyveload? That is, when writing some > compliance checks against section 26.3.1, can I just hardcode that value? > > I=E2=80=99m starting to dig through the bhyverun code, but I=E2=80=99m st= ill pretty new to > VMX stuff, so I am ending up with more questions than answers. > > Fabian > From owner-freebsd-virtualization@freebsd.org Thu Feb 22 17:47:30 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9224CF1ABA2 for ; Thu, 22 Feb 2018 17:47:30 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 43A9D6F6B4 for ; Thu, 22 Feb 2018 17:47:30 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 3DA2C2CE9 for ; Thu, 22 Feb 2018 17:47:30 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 3CE2911BB41; Thu, 22 Feb 2018 17:47:30 +0000 (UTC) Date: Thu, 22 Feb 2018 17:47:30 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2Fi X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) new() object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="b1_a9c59b379b8ee92a2d8db348a3c77877" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 17:47:30 -0000 --b1_a9c59b379b8ee92a2d8db348a3c77877 Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: base64 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIGNyZWF0ZWQgdGhpcyByZXZpc2lvbi4K ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIGFkZGVkIGEgcHJvamVjdDogYmh5dmUu CkhlcmFsZCBhZGRlZCBzdWJzY3JpYmVyczogQ29udHJpYnV0b3IgUmV2aWV3cyAoYmFzZSksIGlt cC4KClJFVklTSU9OIFNVTU1BUlkKICBUaGUgY3VycmVudCB1c2VyYm9vdCBpbnRlcmZhY2Ugc2V0 cyB0aGlzIGNhcGFiaWxpdHkgdXNpbmcgYHZtX3NldHVwX2ZyZWVic2RfcmVnaXN0ZXJzX2kzODZg IGluIGxpYi9saWJ2bW1hcGkvbGlidm1tYXBpX2ZyZWVic2QuYy4gVGhpcyBwYXRjaCBhZGRzIHN1 cHBvcnQgZm9yIGxvYWRlcnMgdG8gZXhwbGljaXRseSBxdWVyeSBhbmQvb3Igc2V0IHRoaXMgY2Fw YWJpbGl0eSB3aXRob3V0IGhhdmluZyB0byBnbyB0aHJvdWdoIHRoZSBgZXhlY2AgY2FsbGJhY2ss IGJ1dCBzZXQgdXAgcmVnaXN0ZXJzIHRoZW1zZWx2ZXMuCiAgCiAgVGhpcyBjaGFuZ2UgaXMgYmFj a3dhcmRzLWNvbXBhdGlibGUgYXMgYWxsIG5ldyBjYWxsYmFja3MgYXJlIGFkZGVkIHRvIHRoZSBl bmQgb2YgdGhlIGNhbGxiYWNrIHN0cnVjdHVyZS4KClRFU1QgUExBTgogIHRlc3Qgd2l0aCBhIGxp YnJhcnkgaW1wbGVtZW50aW5nIGBsb2FkZXJfbWFpbmAgYW5kIGNhbGxpbmcgdGhlc2UgY2FsbGJh Y2tzLiBDaGVjayB3aGV0aGVyIGNhcGFiaWxpdHkgaXMgc2V0LgoKUkVQT1NJVE9SWQogIHJTIEZy ZWVCU0Qgc3JjIHJlcG9zaXRvcnkKClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5m cmVlYnNkLm9yZy9EMTQ0NzMKCkFGRkVDVEVEIEZJTEVTCiAgc3RhbmQvdXNlcmJvb3QvdXNlcmJv b3QuaAogIHVzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYwoKRU1BSUwgUFJFRkVSRU5DRVMK ICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvc2V0dGluZ3MvcGFuZWwvZW1haWxwcmVmZXJl bmNlcy8KClRvOiBmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUKQ2M6IGltcCwgZnJl ZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== --b1_a9c59b379b8ee92a2d8db348a3c77877 Content-Type: text/x-patch; charset=utf-8; name="D14473.39609.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="D14473.39609.patch" ZGlmZiAtLWdpdCBhL3Vzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYyBiL3Vzci5zYmluL2Jo eXZlbG9hZC9iaHl2ZWxvYWQuYwotLS0gYS91c3Iuc2Jpbi9iaHl2ZWxvYWQvYmh5dmVsb2FkLmMK KysrIGIvdXNyLnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCkBAIC01NjAsNiArNTYwLDI0IEBA CiAJcmV0dXJuICh2bV9zZXRfZGVzYyhjdHgsIHZjcHUsIHJlZywgYmFzZSwgbGltaXQsIGFjY2Vz cykpOwogfQogCitzdGF0aWMgaW50CitjYl92bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQq IGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKQoreworCXJldHVybiAodm1fZ2V0X2NhcGFiaWxp dHkoY3R4LCB2Y3B1LAorCQkJVk1fQ0FQX1VOUkVTVFJJQ1RFRF9HVUVTVCwgcmV0dmFsKSk7Cit9 CisKK3N0YXRpYyBpbnQKK2NiX3ZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3Qodm9pZCogYXJnLCBp bnQgdmNwdSwgaW50IHZhbCkKK3sKKwlpbnQgZXJyb3IsIHRtcDsKKwlpZiAoKGVycm9yID0gY2Jf dm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXApKSkKKwkJcmV0dXJuIGVy cm9yOworCisJcmV0dXJuICh2bV9zZXRfY2FwYWJpbGl0eShjdHgsIHZjcHUsCisJCQlWTV9DQVBf VU5SRVNUUklDVEVEX0dVRVNULCB2YWwpKTsKK30KKwogc3RhdGljIHN0cnVjdCBsb2FkZXJfY2Fs bGJhY2tzIGNiID0gewogCS5nZXRjID0gY2JfZ2V0YywKIAkucHV0YyA9IGNiX3B1dGMsCkBAIC01 OTMsNiArNjExLDEwIEBACiAJLyogVmVyc2lvbiA0IGFkZGl0aW9ucyAqLwogCS52bV9zZXRfcmVn aXN0ZXIgPSBjYl92bV9zZXRfcmVnaXN0ZXIsCiAJLnZtX3NldF9kZXNjID0gY2Jfdm1fc2V0X2Rl c2MsCisKKwkvKiBWZXJzaW9uIDUgYWRkaXRpb25zICovCisJLnZtX3NldF91bnJlc3RyaWN0ZWRf Z3Vlc3QgPSBjYl92bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0LAorCS52bV9nZXRfdW5yZXN0cmlj dGVkX2d1ZXN0ID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCwKIH07CiAKIHN0YXRpYyBp bnQKZGlmZiAtLWdpdCBhL3N0YW5kL3VzZXJib290L3VzZXJib290LmggYi9zdGFuZC91c2VyYm9v dC91c2VyYm9vdC5oCi0tLSBhL3N0YW5kL3VzZXJib290L3VzZXJib290LmgKKysrIGIvc3RhbmQv dXNlcmJvb3QvdXNlcmJvb3QuaApAQCAtNDEsNiArNDEsMTQgQEAKICAqLwogI2RlZmluZQlVU0VS Qk9PVF9WRVJTSU9OXzQgICAgICA0CiAKKy8qCisgKiBWZXJzaW9uIDUgYWRkcyBjYWxsYmFja3Mg dG8gc2V0IHVwIGxvbmcgbW9kZSBhbmQgc2V0CisgKiB1bnJlc3RyaWN0ZWQgZ3Vlc3QgY2FwYWJp bGl0aWVzLiBUaGUgY2FsbGJhY2sgc3RydWN0dXJlCisgKiBiYWNrd2FyZCBjb21wYXRpYmxlIChu ZXcgY2FsbGJhY2tzIGhhdmUgYmVlbiBhZGRlZCBhdAorICogdGhlIHRhaWwgZW5kKS4KKyAqLwor I2RlZmluZQlVU0VSQk9PVF9WRVJTSU9OXzUgICAgICA1CisKIC8qCiAgKiBFeGl0IGNvZGVzIGZy b20gdGhlIGxvYWRlcgogICovCkBAIC0yMTAsNCArMjE4LDE3IEBACiAJaW50CSgqdm1fc2V0X3Jl Z2lzdGVyKSh2b2lkICphcmcsIGludCB2Y3B1LCBpbnQgcmVnLCB1aW50NjRfdCB2YWwpOwogCWlu dAkoKnZtX3NldF9kZXNjKSh2b2lkICphcmcsIGludCB2Y3B1LCBpbnQgcmVnLCB1aW50NjRfdCBi YXNlLAogCSAgICB1X2ludCBsaW1pdCwgdV9pbnQgYWNjZXNzKTsKKworCS8qCisJICogVmVyc2lv biA1IGFkZGl0aW9ucy4KKwkgKgorCSAqIHZtX2dldF91bnJlc3RyaWN0ZWRfZ3Vlc3QgY2hlY2tz IHN1cHBvcnQgZm9yIHRoZSBVTlJFU1RSSUNURURfR1VFU1QKKwkgKiBjYXBhYmlsaXR5IGFuZCBp ZiBzdXBwb3J0ZWQsIHNldHMgJ3JldHZhbCcuIElmIHVuc3VwcG9ydGVkLCBhbiBlcnJvcgorCSAq IGNvZGUgaXMgcmV0dXJuZWQuCisJICoKKwkgKiB2bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0IHNl dHMgdGhlIFVOUkVTVFJJQ1RFRF9HVUVTVCBjYXBhYmlsaXR5IGlmCisJICogc3VwcG9ydGVkLCBh bmQgcmV0dXJucyBhbiBlcnJvciBjb2RlIG90aGVyd2lzZS4KKwkgKi8KKwlpbnQJKCp2bV9nZXRf dW5yZXN0cmljdGVkX2d1ZXN0KSh2b2lkKiBhcmcsIGludCB2Y3B1LCBpbnQgKnJldHZhbCk7CisJ aW50CSgqdm1fc2V0X3VucmVzdHJpY3RlZF9ndWVzdCkodm9pZCogYXJnLCBpbnQgdmNwdSwgaW50 IHZhbCk7CiB9OwoK --b1_a9c59b379b8ee92a2d8db348a3c77877-- From owner-freebsd-virtualization@freebsd.org Thu Feb 22 19:27:21 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE5A3F23B1C for ; Thu, 22 Feb 2018 19:27:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 643A873DF8 for ; Thu, 22 Feb 2018 19:27:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 566BD41BC for ; Thu, 22 Feb 2018 19:27:21 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 537B010D2DF; Thu, 22 Feb 2018 19:27:21 +0000 (UTC) Date: Thu, 22 Feb 2018 19:27:21 +0000 To: freebsd-virtualization@freebsd.org From: "imp (Warner Losh)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPGZk= X-Phabricator-Stamps: actor(@imp) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(@imp) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 19:27:22 -0000 aW1wIGFjY2VwdGVkIHRoaXMgcmV2aXNpb24uClRoaXMgcmV2aXNpb24gaXMgbm93IGFjY2VwdGVk IGFuZCByZWFkeSB0byBsYW5kLgoKUkVQT1NJVE9SWQogIHJTIEZyZWVCU0Qgc3JjIHJlcG9zaXRv cnkKClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMK CkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdz L3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzogZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVy bGluLmRlLCBpbXAKQ2M6IGltcCwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0LCAjY29udHJp YnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Thu Feb 22 19:33:29 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51E0AF24304 for ; Thu, 22 Feb 2018 19:33:29 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E8B1474289 for ; Thu, 22 Feb 2018 19:33:28 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id E3604435D for ; Thu, 22 Feb 2018 19:33:28 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id E2A1C10FC90; Thu, 22 Feb 2018 19:33:28 +0000 (UTC) Date: Thu, 22 Feb 2018 19:33:28 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <47fd612051887e5c8e52a76b08e6117c@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPGwg= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(@imp) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 19:33:29 -0000 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIGFkZGVkIGEgY29tbWVudC4KCgogIEkg bWF5IGFsc28gYWRkIGEgdmNwdV9yZXNldCBjYWxsYmFjayBzdGlsbCwgd291bGQgYmUgbmljZSB0 byBoYXZlIHRoYXQgaW4gYXMgd2VsbC4KCklOTElORSBDT01NRU5UUwoKPiB1c2VyYm9vdC5oOjQ1 Cj4gKy8qCj4gKyAqIFZlcnNpb24gNSBhZGRzIGNhbGxiYWNrcyB0byBzZXQgdXAgbG9uZyBtb2Rl IGFuZCBzZXQKPiArICogdW5yZXN0cmljdGVkIGd1ZXN0IGNhcGFiaWxpdGllcy4gVGhlIGNhbGxi YWNrIHN0cnVjdHVyZQoKVGJoIHRoaXMgaXMgbm8gbG9uZ2VyIHRydWUsIHNvIEkgd2lsbCB1cGRh dGUgdGhlIHBhdGNoIHRvIGZpeCB0aGUgY29tbWVudAoKUkVQT1NJVE9SWQogIHJTIEZyZWVCU0Qg c3JjIHJlcG9zaXRvcnkKClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNk Lm9yZy9EMTQ0NzMKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qu b3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzogZmFiaWFuLmZyZXllcl9w aHlzaWsudHUtYmVybGluLmRlLCBpbXAKQ2M6IGltcCwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1s aXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Thu Feb 22 20:10:43 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2FDE6F27447 for ; Thu, 22 Feb 2018 20:10:43 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CAD8A77425 for ; Thu, 22 Feb 2018 20:10:42 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id C29A14868 for ; Thu, 22 Feb 2018 20:10:42 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id C1CBD11C378; Thu, 22 Feb 2018 20:10:42 +0000 (UTC) Date: Thu, 22 Feb 2018 20:10:42 +0000 To: freebsd-virtualization@freebsd.org From: rgrimes Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <11a32ccb72765c6dafb9c7f295bcfbf6@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPI8I= X-Phabricator-Stamps: actor(@rgrimes) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@imp) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 20:10:43 -0000 cmdyaW1lcyBhZGRlZCBhIHJldmlld2VyOiBiaHl2ZS4KClJFUE9TSVRPUlkKICByUyBGcmVlQlNE IHNyYyByZXBvc2l0b3J5CgpSRVZJU0lPTiBERVRBSUwKICBodHRwczovL3Jldmlld3MuZnJlZWJz ZC5vcmcvRDE0NDczCgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNk Lm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86IGZhYmlhbi5mcmV5ZXJf cGh5c2lrLnR1LWJlcmxpbi5kZSwgaW1wLCAjYmh5dmUKQ2M6IGltcCwgZnJlZWJzZC12aXJ0dWFs aXphdGlvbi1saXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Thu Feb 22 22:49:47 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9BC63F09840 for ; Thu, 22 Feb 2018 22:49:47 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D9AB7D478 for ; Thu, 22 Feb 2018 22:49:47 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 1B34261E9 for ; Thu, 22 Feb 2018 22:49:47 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 1AA3B1264E3; Thu, 22 Feb 2018 22:49:47 +0000 (UTC) Date: Thu, 22 Feb 2018 22:49:47 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <58eedc38683346a20ebf39446e4c5e3f@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPSQs= X-Phabricator-Stamps: actor(@grehan) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 22:49:47 -0000 Z3JlaGFuIGFjY2VwdGVkIHRoaXMgcmV2aXNpb24uCmdyZWhhbiBhZGRlZCBhIGNvbW1lbnQuCgoK ICBZb3UgbWF5IGJlIGFibGUgdG8gZ2V0IGF3YXkgd2l0aCBqdXN0IHRoZSAic2V0IiBjYWxsLiBH aXZlbiB0aGF0IGFsbCBoL3cgdGhhdCBpcyBzdXBwb3J0ZWQgYnkgYmh5dmUsIHdpdGggdGhlIGV4 Y2VwdGlvbiBvZiBvbmx5IE5laGFsZW0gc3lzdGVtcywgc3VwcG9ydCB0aGlzLCB5b3UgbWF5IHdh bnQgdG8gdXNlIGp1c3QgdGhlIGVycm9yIGZyb20gdGhlIHNldCBjYWxsIHRvIGhhbmRsZSB0aGlz IGxvdy1wcm9iYWJpbGl0eSBlcnJvci4KICAKICBOb3RlIHRoYXQgQU1EIFNWTSBoYXMgYWx3YXlz IHN1cHBvcnRlZCB0aGlzIG1vZGUuICJVbnJlc3RyaWN0ZWQgR3Vlc3QiIGlzIGFuIEludGVsLW9u bHkgZmVhdHVyZSwgYnV0IGdpdmVuIHRoYXQgdGhlIG5hbWUgaXMgYmFrZWQgaW50byBhIGJoeXZl IEFQSSBhbHJlYWR5LCB0aGVyZSBkb2Vzbid0IHNlZW0gdG8gYmUgYW55IGhhcm0gaW4ga2VlcGlu ZyBpdCBnb2luZy4KClJFUE9TSVRPUlkKICByUyBGcmVlQlNEIHNyYyByZXBvc2l0b3J5CgpSRVZJ U0lPTiBERVRBSUwKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDE0NDczCgpFTUFJTCBQ UkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0aW5ncy9wYW5lbC9l bWFpbHByZWZlcmVuY2VzLwoKVG86IGZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1LWJlcmxpbi5kZSwg aW1wLCAjYmh5dmUsIGdyZWhhbgpDYzogZ3JlaGFuLCBpbXAsIGZyZWVic2QtdmlydHVhbGl6YXRp b24tbGlzdCwgI2NvbnRyaWJ1dG9yX3Jldmlld3NfYmFzZQo= From owner-freebsd-virtualization@freebsd.org Thu Feb 22 23:09:24 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35476F0B3A8 for ; Thu, 22 Feb 2018 23:09:24 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B62537E44D for ; Thu, 22 Feb 2018 23:09:23 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id AEF226562 for ; Thu, 22 Feb 2018 23:09:23 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id AE22E102AA6; Thu, 22 Feb 2018 23:09:23 +0000 (UTC) Date: Thu, 22 Feb 2018 23:09:23 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <34c44971aaaf76394bec47fc82468525@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPTaM= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="b1_34c44971aaaf76394bec47fc82468525" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 23:09:24 -0000 --b1_34c44971aaaf76394bec47fc82468525 Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: base64 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIHVwZGF0ZWQgdGhpcyByZXZpc2lvbiB0 byBEaWZmIDM5NjE5LgpmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUgZWRpdGVkIHRo ZSBzdW1tYXJ5IG9mIHRoaXMgcmV2aXNpb24uCmZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1LWJlcmxp bi5kZSBlZGl0ZWQgdGhlIHRlc3QgcGxhbiBmb3IgdGhpcyByZXZpc2lvbi4KZmFiaWFuLmZyZXll cl9waHlzaWsudHUtYmVybGluLmRlIGFkZGVkIGEgY29tbWVudC4KVGhpcyByZXZpc2lvbiBub3cg cmVxdWlyZXMgcmV2aWV3IHRvIHByb2NlZWQuCgoKICAtIHVwZGF0ZWQgdGhlIGNvbW1lbnQgYXQg dGhlIHZlcnNpb24gaWRlbnRpZmllciB0byBjb3JyZWN0bHkgbGlzdCB0aGUgY2hhbmdlcyBpbnRy b2R1Y2VkIGJ5IHRoaXMgdmVyc2lvbgogIC0gYWRkZWQgYSBjYWxsYmFjayB0byBgdmNwdV9yZXNl dGAKClJFUE9TSVRPUlkKICByUyBGcmVlQlNEIHNyYyByZXBvc2l0b3J5CgpDSEFOR0VTIFNJTkNF IExBU1QgVVBEQVRFCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxNDQ3Mz92cz0zOTYw OSZpZD0zOTYxOQoKUkVWSVNJT04gREVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3Jn L0QxNDQ3MwoKQUZGRUNURUQgRklMRVMKICBzdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCiAgdXNy LnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8v cmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86 IGZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1LWJlcmxpbi5kZSwgaW1wLCAjYmh5dmUsIGdyZWhhbgpD YzogZ3JlaGFuLCBpbXAsIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdCwgI2NvbnRyaWJ1dG9y X3Jldmlld3NfYmFzZQo= --b1_34c44971aaaf76394bec47fc82468525 Content-Type: text/x-patch; charset=utf-8; name="D14473.39619.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="D14473.39619.patch" ZGlmZiAtLWdpdCBhL3Vzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYyBiL3Vzci5zYmluL2Jo eXZlbG9hZC9iaHl2ZWxvYWQuYwotLS0gYS91c3Iuc2Jpbi9iaHl2ZWxvYWQvYmh5dmVsb2FkLmMK KysrIGIvdXNyLnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCkBAIC01NjAsNiArNTYwLDMwIEBA CiAJcmV0dXJuICh2bV9zZXRfZGVzYyhjdHgsIHZjcHUsIHJlZywgYmFzZSwgbGltaXQsIGFjY2Vz cykpOwogfQogCitzdGF0aWMgaW50CitjYl92bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQq IGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKQoreworCXJldHVybiAodm1fZ2V0X2NhcGFiaWxp dHkoY3R4LCB2Y3B1LAorCQkJVk1fQ0FQX1VOUkVTVFJJQ1RFRF9HVUVTVCwgcmV0dmFsKSk7Cit9 CisKK3N0YXRpYyBpbnQKK2NiX3ZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3Qodm9pZCogYXJnLCBp bnQgdmNwdSwgaW50IHZhbCkKK3sKKwlpbnQgZXJyb3IsIHRtcDsKKwlpZiAoKGVycm9yID0gY2Jf dm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXApKSkKKwkJcmV0dXJuIGVy cm9yOworCisJcmV0dXJuICh2bV9zZXRfY2FwYWJpbGl0eShjdHgsIHZjcHUsCisJCQlWTV9DQVBf VU5SRVNUUklDVEVEX0dVRVNULCB2YWwpKTsKK30KKworc3RhdGljIGludAorY2JfdmNwdV9yZXNl dCh2b2lkKiBhcmcsIGludCB2Y3B1KQoreworCXJldHVybiB2Y3B1X3Jlc2V0KGN0eCwgdmNwdSk7 Cit9CisKIHN0YXRpYyBzdHJ1Y3QgbG9hZGVyX2NhbGxiYWNrcyBjYiA9IHsKIAkuZ2V0YyA9IGNi X2dldGMsCiAJLnB1dGMgPSBjYl9wdXRjLApAQCAtNTkzLDYgKzYxNywxMSBAQAogCS8qIFZlcnNp b24gNCBhZGRpdGlvbnMgKi8KIAkudm1fc2V0X3JlZ2lzdGVyID0gY2Jfdm1fc2V0X3JlZ2lzdGVy LAogCS52bV9zZXRfZGVzYyA9IGNiX3ZtX3NldF9kZXNjLAorCisJLyogVmVyc2lvbiA1IGFkZGl0 aW9ucyAqLworCS52bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0ID0gY2Jfdm1fc2V0X3VucmVzdHJp Y3RlZF9ndWVzdCwKKwkudm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCA9IGNiX3ZtX2dldF91bnJl c3RyaWN0ZWRfZ3Vlc3QsCisJLnZjcHVfcmVzZXQgPSBjYl92Y3B1X3Jlc2V0LAogfTsKIAogc3Rh dGljIGludApkaWZmIC0tZ2l0IGEvc3RhbmQvdXNlcmJvb3QvdXNlcmJvb3QuaCBiL3N0YW5kL3Vz ZXJib290L3VzZXJib290LmgKLS0tIGEvc3RhbmQvdXNlcmJvb3QvdXNlcmJvb3QuaAorKysgYi9z dGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCkBAIC00MSw2ICs0MSwxNCBAQAogICovCiAjZGVmaW5l CVVTRVJCT09UX1ZFUlNJT05fNCAgICAgIDQKIAorLyoKKyAqIFZlcnNpb24gNSBhZGRzIGNhbGxi YWNrcyB0byBzZXQgdW5yZXN0cmljdGVkIGd1ZXN0CisgKiBjYXBhYmlsaXRpZXMgYW5kIHJlc2V0 IHRoZSB2Y3B1IHN0YXRlLiBUaGUgY2FsbGJhY2sKKyAqIHN0cnVjdHVyZSBiYWNrd2FyZCBjb21w YXRpYmxlIChuZXcgY2FsbGJhY2tzIGhhdmUKKyAqIGJlZW4gYWRkZWQgYXQgdGhlIHRhaWwgZW5k KS4KKyAqLworI2RlZmluZQlVU0VSQk9PVF9WRVJTSU9OXzUgICAgICA1CisKIC8qCiAgKiBFeGl0 IGNvZGVzIGZyb20gdGhlIGxvYWRlcgogICovCkBAIC0yMTAsNCArMjE4LDIyIEBACiAJaW50CSgq dm1fc2V0X3JlZ2lzdGVyKSh2b2lkICphcmcsIGludCB2Y3B1LCBpbnQgcmVnLCB1aW50NjRfdCB2 YWwpOwogCWludAkoKnZtX3NldF9kZXNjKSh2b2lkICphcmcsIGludCB2Y3B1LCBpbnQgcmVnLCB1 aW50NjRfdCBiYXNlLAogCSAgICB1X2ludCBsaW1pdCwgdV9pbnQgYWNjZXNzKTsKKworCS8qCisJ ICogVmVyc2lvbiA1IGFkZGl0aW9ucy4KKwkgKgorCSAqIHZtX2dldF91bnJlc3RyaWN0ZWRfZ3Vl c3QgY2hlY2tzIHN1cHBvcnQgZm9yIHRoZSBVTlJFU1RSSUNURURfR1VFU1QKKwkgKiBjYXBhYmls aXR5IGFuZCBpZiBzdXBwb3J0ZWQsIHNldHMgJ3JldHZhbCcuIElmIHVuc3VwcG9ydGVkLCBhbiBl cnJvcgorCSAqIGNvZGUgaXMgcmV0dXJuZWQuCisJICoKKwkgKiB2bV9zZXRfdW5yZXN0cmljdGVk X2d1ZXN0IHNldHMgdGhlIFVOUkVTVFJJQ1RFRF9HVUVTVCBjYXBhYmlsaXR5IGlmCisJICogc3Vw cG9ydGVkLCBhbmQgcmV0dXJucyBhbiBlcnJvciBjb2RlIG90aGVyd2lzZS4KKwkgKgorCSAqIHZj cHVfcmVzZXQgaW5pdGlhbGl6ZXMgdGhlIHZDUFUgc3RhdGUgYXMgZGVmaW5lZCBpbiAKKwkgKiBJ bnRlbCBWb2wgM2EsIFRhYmxlIDkuMS4gSUEtMzIgUHJvY2Vzc29yIFN0YXRlcyBGb2xsb3dpbmcg UG93ZXItdXAsCisJICogUmVzZXQgb3IgSU5JVAorCSAqLworCWludAkoKnZtX2dldF91bnJlc3Ry aWN0ZWRfZ3Vlc3QpKHZvaWQqIGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKTsKKwlpbnQJKCp2 bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0KSh2b2lkKiBhcmcsIGludCB2Y3B1LCBpbnQgdmFsKTsK KwlpbnQJKCp2Y3B1X3Jlc2V0KSh2b2lkKiBhcmcsIGludCB2Y3B1KTsKIH07Cgo= --b1_34c44971aaaf76394bec47fc82468525-- From owner-freebsd-virtualization@freebsd.org Thu Feb 22 23:12:43 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 089E0F0B8D6 for ; Thu, 22 Feb 2018 23:12:43 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A09587E809 for ; Thu, 22 Feb 2018 23:12:42 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 984CF670E for ; Thu, 22 Feb 2018 23:12:42 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 978EC1041C9; Thu, 22 Feb 2018 23:12:42 +0000 (UTC) Date: Thu, 22 Feb 2018 23:12:42 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <3f8603e248a1bc9df19391ddc487ef5b@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPTmo= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 23:12:43 -0000 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIG1hcmtlZCBhbiBpbmxpbmUgY29tbWVu dCBhcyBkb25lLgoKUkVQT1NJVE9SWQogIHJTIEZyZWVCU0Qgc3JjIHJlcG9zaXRvcnkKClJFVklT SU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMKCkVNQUlMIFBS RUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdzL3BhbmVsL2Vt YWlscHJlZmVyZW5jZXMvCgpUbzogZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlLCBp bXAsICNiaHl2ZSwgZ3JlaGFuCkNjOiBncmVoYW4sIGltcCwgZnJlZWJzZC12aXJ0dWFsaXphdGlv bi1saXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Thu Feb 22 23:13:58 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 012D1F0BAF4 for ; Thu, 22 Feb 2018 23:13:58 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A0EE67E8CF for ; Thu, 22 Feb 2018 23:13:57 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 9B18C6721 for ; Thu, 22 Feb 2018 23:13:57 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 9A70E1046A9; Thu, 22 Feb 2018 23:13:57 +0000 (UTC) Date: Thu, 22 Feb 2018 23:13:57 +0000 To: freebsd-virtualization@freebsd.org From: "grehan (Peter Grehan)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <5af862fd1312906bb2137a17b388c964@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPTrU= X-Phabricator-Stamps: actor(@grehan) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 23:13:58 -0000 Z3JlaGFuIGFkZGVkIGlubGluZSBjb21tZW50cy4KCklOTElORSBDT01NRU5UUwoKPiBiaHl2ZWxv YWQuYzo1NjYKPiArewo+ICsJcmV0dXJuICh2bV9nZXRfY2FwYWJpbGl0eShjdHgsIHZjcHUsCj4g KwkJCVZNX0NBUF9VTlJFU1RSSUNURURfR1VFU1QsIHJldHZhbCkpOwoKTWlub3Igc3R5bGUoOSkg LSBzaG91bGQgYmUgYW4gZW1wdHkgbGluZSBiZWZvcmUgdGhlIHJyZXR1cm4gLSBzZWUgdGhlIHJv dXRpbmUgYWJvdmUuCgo+IGJoeXZlbG9hZC5jOjU2Nwo+ICsJcmV0dXJuICh2bV9nZXRfY2FwYWJp bGl0eShjdHgsIHZjcHUsCj4gKwkJCVZNX0NBUF9VTlJFU1RSSUNURURfR1VFU1QsIHJldHZhbCkp Owo+ICt9CgpNaW5vciBzdHlsZSg5KSAtIGNvbnRpbnVlZCBsaW5lcyBzaG91bGQgYmUgaW5kZW50 ZWQgYnkgNCBzcGFjZXMuCgo+IGJoeXZlbG9hZC5jOjU3NAo+ICsJaW50IGVycm9yLCB0bXA7Cj4g KwlpZiAoKGVycm9yID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0 bXApKSkKPiArCQlyZXR1cm4gZXJyb3I7CgpNaW5vciBzdHlsZSg5KSAtIGJsYW5rIGxpbmUgYmV0 d2VlbiBkZWNsYXJhdGlvbnMgYW5kIHN0YXRlbWVudC4KCj4gYmh5dmVsb2FkLmM6NTc1Cj4gKwlp ZiAoKGVycm9yID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXAp KSkKPiArCQlyZXR1cm4gZXJyb3I7Cj4gKwoKTWlub3Igc3R5bGUoOSkgLSByZXR1cm4gZXhwcmVz c2lvbiBzaG91bGQgYmUgZW5jbG9zZWQgaW4gcGFyZW5zLgoKPiBiaHl2ZWxvYWQuYzo1ODQKPiAr ewo+ICsJcmV0dXJuIHZjcHVfcmVzZXQoY3R4LCB2Y3B1KTsKPiArfQoKTWlub3Igc3R5bGUoOSkg LSBibGFuayBsaW5lIG5lZWRlZCBiZWZvcmUgc3RhdGVtZW50LCBhbmQgcmV0dXJuIGV4cHJlc3Np b24gc2hvdWxkIGJlIGluIHBhcmVucy4KClJFUE9TSVRPUlkKICByUyBGcmVlQlNEIHNyYyByZXBv c2l0b3J5CgpSRVZJU0lPTiBERVRBSUwKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDE0 NDczCgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0 aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86IGZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1 LWJlcmxpbi5kZSwgaW1wLCAjYmh5dmUsIGdyZWhhbgpDYzogZ3JlaGFuLCBpbXAsIGZyZWVic2Qt dmlydHVhbGl6YXRpb24tbGlzdCwgI2NvbnRyaWJ1dG9yX3Jldmlld3NfYmFzZQo= From owner-freebsd-virtualization@freebsd.org Thu Feb 22 23:21:09 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3ABF1F0D290 for ; Thu, 22 Feb 2018 23:21:09 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D31057ECE9 for ; Thu, 22 Feb 2018 23:21:08 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id C9E65686A for ; Thu, 22 Feb 2018 23:21:08 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id C9449107734; Thu, 22 Feb 2018 23:21:08 +0000 (UTC) Date: Thu, 22 Feb 2018 23:21:08 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPUGQ= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) mention(@grehan) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="b1_f3a7a6f87bbecfef897ce5c7ed3b209f" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 23:21:09 -0000 --b1_f3a7a6f87bbecfef897ce5c7ed3b209f Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: base64 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIHVwZGF0ZWQgdGhpcyByZXZpc2lvbiB0 byBEaWZmIDM5NjIyLgpmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUgYWRkZWQgYSBj b21tZW50LgoKCiAgYWRkcmVzc2VkIEBncmVoYW4ncyBjb21tZW50cyByZWdhcmRpbmcgc3R5bGUo OSkKClJFUE9TSVRPUlkKICByUyBGcmVlQlNEIHNyYyByZXBvc2l0b3J5CgpDSEFOR0VTIFNJTkNF IExBU1QgVVBEQVRFCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxNDQ3Mz92cz0zOTYx OSZpZD0zOTYyMgoKUkVWSVNJT04gREVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3Jn L0QxNDQ3MwoKQUZGRUNURUQgRklMRVMKICBzdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCiAgdXNy LnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8v cmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86 IGZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1LWJlcmxpbi5kZSwgaW1wLCAjYmh5dmUsIGdyZWhhbgpD YzogZ3JlaGFuLCBpbXAsIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdCwgI2NvbnRyaWJ1dG9y X3Jldmlld3NfYmFzZQo= --b1_f3a7a6f87bbecfef897ce5c7ed3b209f Content-Type: text/x-patch; charset=utf-8; name="D14473.39622.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="D14473.39622.patch" ZGlmZiAtLWdpdCBhL3Vzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYyBiL3Vzci5zYmluL2Jo eXZlbG9hZC9iaHl2ZWxvYWQuYwotLS0gYS91c3Iuc2Jpbi9iaHl2ZWxvYWQvYmh5dmVsb2FkLmMK KysrIGIvdXNyLnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCkBAIC01NjAsNiArNTYwLDMzIEBA CiAJcmV0dXJuICh2bV9zZXRfZGVzYyhjdHgsIHZjcHUsIHJlZywgYmFzZSwgbGltaXQsIGFjY2Vz cykpOwogfQogCitzdGF0aWMgaW50CitjYl92bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQq IGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKQoreworCisJcmV0dXJuICh2bV9nZXRfY2FwYWJp bGl0eShjdHgsIHZjcHUsCisJICAgIFZNX0NBUF9VTlJFU1RSSUNURURfR1VFU1QsIHJldHZhbCkp OworfQorCitzdGF0aWMgaW50CitjYl92bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQqIGFy ZywgaW50IHZjcHUsIGludCB2YWwpCit7CisJaW50IGVycm9yLCB0bXA7CisKKwlpZiAoKGVycm9y ID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXApKSkKKwkJcmV0 dXJuIChlcnJvcik7CisKKwlyZXR1cm4gKHZtX3NldF9jYXBhYmlsaXR5KGN0eCwgdmNwdSwKKwkg ICAgVk1fQ0FQX1VOUkVTVFJJQ1RFRF9HVUVTVCwgdmFsKSk7Cit9CisKK3N0YXRpYyBpbnQKK2Ni X3ZjcHVfcmVzZXQodm9pZCogYXJnLCBpbnQgdmNwdSkKK3sKKworCXJldHVybiAodmNwdV9yZXNl dChjdHgsIHZjcHUpKTsKK30KKwogc3RhdGljIHN0cnVjdCBsb2FkZXJfY2FsbGJhY2tzIGNiID0g ewogCS5nZXRjID0gY2JfZ2V0YywKIAkucHV0YyA9IGNiX3B1dGMsCkBAIC01OTMsNiArNjIwLDEx IEBACiAJLyogVmVyc2lvbiA0IGFkZGl0aW9ucyAqLwogCS52bV9zZXRfcmVnaXN0ZXIgPSBjYl92 bV9zZXRfcmVnaXN0ZXIsCiAJLnZtX3NldF9kZXNjID0gY2Jfdm1fc2V0X2Rlc2MsCisKKwkvKiBW ZXJzaW9uIDUgYWRkaXRpb25zICovCisJLnZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3QgPSBjYl92 bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0LAorCS52bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0ID0g Y2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCwKKwkudmNwdV9yZXNldCA9IGNiX3ZjcHVfcmVz ZXQsCiB9OwogCiBzdGF0aWMgaW50CmRpZmYgLS1naXQgYS9zdGFuZC91c2VyYm9vdC91c2VyYm9v dC5oIGIvc3RhbmQvdXNlcmJvb3QvdXNlcmJvb3QuaAotLS0gYS9zdGFuZC91c2VyYm9vdC91c2Vy Ym9vdC5oCisrKyBiL3N0YW5kL3VzZXJib290L3VzZXJib290LmgKQEAgLTQxLDYgKzQxLDE0IEBA CiAgKi8KICNkZWZpbmUJVVNFUkJPT1RfVkVSU0lPTl80ICAgICAgNAogCisvKgorICogVmVyc2lv biA1IGFkZHMgY2FsbGJhY2tzIHRvIHNldCB1bnJlc3RyaWN0ZWQgZ3Vlc3QKKyAqIGNhcGFiaWxp dGllcyBhbmQgcmVzZXQgdGhlIHZjcHUgc3RhdGUuIFRoZSBjYWxsYmFjaworICogc3RydWN0dXJl IGJhY2t3YXJkIGNvbXBhdGlibGUgKG5ldyBjYWxsYmFja3MgaGF2ZQorICogYmVlbiBhZGRlZCBh dCB0aGUgdGFpbCBlbmQpLgorICovCisjZGVmaW5lCVVTRVJCT09UX1ZFUlNJT05fNSAgICAgIDUK KwogLyoKICAqIEV4aXQgY29kZXMgZnJvbSB0aGUgbG9hZGVyCiAgKi8KQEAgLTIxMCw0ICsyMTgs MjIgQEAKIAlpbnQJKCp2bV9zZXRfcmVnaXN0ZXIpKHZvaWQgKmFyZywgaW50IHZjcHUsIGludCBy ZWcsIHVpbnQ2NF90IHZhbCk7CiAJaW50CSgqdm1fc2V0X2Rlc2MpKHZvaWQgKmFyZywgaW50IHZj cHUsIGludCByZWcsIHVpbnQ2NF90IGJhc2UsCiAJICAgIHVfaW50IGxpbWl0LCB1X2ludCBhY2Nl c3MpOworCisJLyoKKwkgKiBWZXJzaW9uIDUgYWRkaXRpb25zLgorCSAqCisJICogdm1fZ2V0X3Vu cmVzdHJpY3RlZF9ndWVzdCBjaGVja3Mgc3VwcG9ydCBmb3IgdGhlIFVOUkVTVFJJQ1RFRF9HVUVT VAorCSAqIGNhcGFiaWxpdHkgYW5kIGlmIHN1cHBvcnRlZCwgc2V0cyAncmV0dmFsJy4gSWYgdW5z dXBwb3J0ZWQsIGFuIGVycm9yCisJICogY29kZSBpcyByZXR1cm5lZC4KKwkgKgorCSAqIHZtX3Nl dF91bnJlc3RyaWN0ZWRfZ3Vlc3Qgc2V0cyB0aGUgVU5SRVNUUklDVEVEX0dVRVNUIGNhcGFiaWxp dHkgaWYKKwkgKiBzdXBwb3J0ZWQsIGFuZCByZXR1cm5zIGFuIGVycm9yIGNvZGUgb3RoZXJ3aXNl LgorCSAqCisJICogdmNwdV9yZXNldCBpbml0aWFsaXplcyB0aGUgdkNQVSBzdGF0ZSBhcyBkZWZp bmVkIGluIAorCSAqIEludGVsIFZvbCAzYSwgVGFibGUgOS4xLiBJQS0zMiBQcm9jZXNzb3IgU3Rh dGVzIEZvbGxvd2luZyBQb3dlci11cCwKKwkgKiBSZXNldCBvciBJTklUCisJICovCisJaW50CSgq dm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCkodm9pZCogYXJnLCBpbnQgdmNwdSwgaW50ICpyZXR2 YWwpOworCWludAkoKnZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3QpKHZvaWQqIGFyZywgaW50IHZj cHUsIGludCB2YWwpOworCWludAkoKnZjcHVfcmVzZXQpKHZvaWQqIGFyZywgaW50IHZjcHUpOwog fTsKCg== --b1_f3a7a6f87bbecfef897ce5c7ed3b209f-- From owner-freebsd-virtualization@freebsd.org Thu Feb 22 23:22:56 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4CDC6F0D6EE for ; Thu, 22 Feb 2018 23:22:56 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DC3B77F031 for ; Thu, 22 Feb 2018 23:22:55 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id D3BD668EF for ; Thu, 22 Feb 2018 23:22:55 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id D3008107CE3; Thu, 22 Feb 2018 23:22:55 +0000 (UTC) Date: Thu, 22 Feb 2018 23:22:55 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <572b6aa929b8de77560ab3f6cd23a5d7@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPUM8= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Feb 2018 23:22:56 -0000 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIG1hcmtlZCA1IGlubGluZSBjb21tZW50 cyBhcyBkb25lLgpmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUgYWRkZWQgYSBjb21t ZW50LgoKCiAgSSBob3BlIEkgZ290IHRoZW0gYWxsIG5vdwoKUkVQT1NJVE9SWQogIHJTIEZyZWVC U0Qgc3JjIHJlcG9zaXRvcnkKClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVl YnNkLm9yZy9EMTQ0NzMKCkVNQUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVi c2Qub3JnL3NldHRpbmdzL3BhbmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzogZmFiaWFuLmZyZXll cl9waHlzaWsudHUtYmVybGluLmRlLCBpbXAsICNiaHl2ZSwgZ3JlaGFuCkNjOiBncmVoYW4sIGlt cCwgZnJlZWJzZC12aXJ0dWFsaXphdGlvbi1saXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNl Cg== From owner-freebsd-virtualization@freebsd.org Fri Feb 23 00:03:38 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38EE2F10BA7 for ; Fri, 23 Feb 2018 00:03:38 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C9FA9807D4 for ; Fri, 23 Feb 2018 00:03:37 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id C21A66F73 for ; Fri, 23 Feb 2018 00:03:37 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id C15DE11640B; Fri, 23 Feb 2018 00:03:37 +0000 (UTC) Date: Fri, 23 Feb 2018 00:03:37 +0000 To: freebsd-virtualization@freebsd.org From: rgrimes Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPWlk= X-Phabricator-Stamps: actor(@rgrimes) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) removed(#bhyve) reviewer(@imp) reviewer(@rgrimes) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Feb 2018 00:03:38 -0000 cmdyaW1lcyByZW1vdmVkIHJldmlld2VyczogYmh5dmUsIGdyZWhhbi4KcmdyaW1lcyBhY2NlcHRl ZCB0aGlzIHJldmlzaW9uIGFzOiByZ3JpbWVzLgpUaGlzIHJldmlzaW9uIGlzIG5vdyBhY2NlcHRl ZCBhbmQgcmVhZHkgdG8gbGFuZC4KClJFUE9TSVRPUlkKICByUyBGcmVlQlNEIHNyYyByZXBvc2l0 b3J5CgpSRVZJU0lPTiBERVRBSUwKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDE0NDcz CgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9zZXR0aW5n cy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86IGZhYmlhbi5mcmV5ZXJfcGh5c2lrLnR1LWJl cmxpbi5kZSwgaW1wLCByZ3JpbWVzLCAjYmh5dmUKQ2M6IGdyZWhhbiwgaW1wLCBmcmVlYnNkLXZp cnR1YWxpemF0aW9uLWxpc3QsICNjb250cmlidXRvcl9yZXZpZXdzX2Jhc2UK From owner-freebsd-virtualization@freebsd.org Fri Feb 23 00:05:17 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7C66CF10DAC for ; Fri, 23 Feb 2018 00:05:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 16069808C2 for ; Fri, 23 Feb 2018 00:05:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 02F4A6F84 for ; Fri, 23 Feb 2018 00:05:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 00587117570; Fri, 23 Feb 2018 00:05:17 +0000 (UTC) Date: Fri, 23 Feb 2018 00:05:16 +0000 To: freebsd-virtualization@freebsd.org From: rgrimes Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqPWrw= X-Phabricator-Stamps: actor(@rgrimes) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) reviewer(@rgrimes) revision-repository(rS) revision-status(accepted) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Feb 2018 00:05:17 -0000 cmdyaW1lcyBhZGRlZCByZXZpZXdlcnM6IGJoeXZlLCBncmVoYW4uCnJncmltZXMgYWRkZWQgYSBj b21tZW50LgoKCiAgSSBkb250IGtub3cgd2h5IGl0IGRpZCB0aGF0LCBJIHRyaWVkIHRvIHNpbXBs eSAiYWNjZXB0IHJldmlzaW9uIiBhbmQgaXQgcmVtb3ZlZCBhbGwgb3RoZXIgcmV2aWV3ZXJzLCBz byBwdXQgdGhlbSBiYWNrLgoKUkVQT1NJVE9SWQogIHJTIEZyZWVCU0Qgc3JjIHJlcG9zaXRvcnkK ClJFVklTSU9OIERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMKCkVN QUlMIFBSRUZFUkVOQ0VTCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL3NldHRpbmdzL3Bh bmVsL2VtYWlscHJlZmVyZW5jZXMvCgpUbzogZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGlu LmRlLCBpbXAsIHJncmltZXMsICNiaHl2ZSwgZ3JlaGFuCkNjOiBncmVoYW4sIGltcCwgZnJlZWJz ZC12aXJ0dWFsaXphdGlvbi1saXN0LCAjY29udHJpYnV0b3JfcmV2aWV3c19iYXNlCg== From owner-freebsd-virtualization@freebsd.org Fri Feb 23 19:16:18 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C815DF13E00 for ; Fri, 23 Feb 2018 19:16:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 681A6714C6 for ; Fri, 23 Feb 2018 19:16:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 614781A996 for ; Fri, 23 Feb 2018 19:16:17 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 606E9110D1E; Fri, 23 Feb 2018 19:16:17 +0000 (UTC) Date: Fri, 23 Feb 2018 19:16:17 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: <165aeb06e6eb089a6f32c43ceabdfc93@localhost.localdomain> X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , , X-Herald-Rules: <28>, <67> X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqQaIE= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) reviewer(@rgrimes) revision-repository(rS) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="b1_165aeb06e6eb089a6f32c43ceabdfc93" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Feb 2018 19:16:18 -0000 --b1_165aeb06e6eb089a6f32c43ceabdfc93 Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: base64 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIHVwZGF0ZWQgdGhpcyByZXZpc2lvbiB0 byBEaWZmIDM5NjUzLgpmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUgYWRkZWQgYSBj b21tZW50LgpUaGlzIHJldmlzaW9uIG5vdyByZXF1aXJlcyByZXZpZXcgdG8gcHJvY2VlZC4KCgog IHBhc3MgYFVTRVJCT09UX1ZFUlNJT05fNWAgdG8gYGxvYWRlcl9tYWluYC4KClJFUE9TSVRPUlkK ICByUyBGcmVlQlNEIHNyYyByZXBvc2l0b3J5CgpDSEFOR0VTIFNJTkNFIExBU1QgVVBEQVRFCiAg aHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxNDQ3Mz92cz0zOTYyMiZpZD0zOTY1MwoKUkVW SVNJT04gREVUQUlMCiAgaHR0cHM6Ly9yZXZpZXdzLmZyZWVic2Qub3JnL0QxNDQ3MwoKQUZGRUNU RUQgRklMRVMKICBzdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCiAgdXNyLnNiaW4vYmh5dmVsb2Fk L2JoeXZlbG9hZC5jCgpFTUFJTCBQUkVGRVJFTkNFUwogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNk Lm9yZy9zZXR0aW5ncy9wYW5lbC9lbWFpbHByZWZlcmVuY2VzLwoKVG86IGZhYmlhbi5mcmV5ZXJf cGh5c2lrLnR1LWJlcmxpbi5kZSwgaW1wLCByZ3JpbWVzLCAjYmh5dmUsIGdyZWhhbgpDYzogZ3Jl aGFuLCBpbXAsIGZyZWVic2QtdmlydHVhbGl6YXRpb24tbGlzdCwgI2NvbnRyaWJ1dG9yX3Jldmll d3NfYmFzZQo= --b1_165aeb06e6eb089a6f32c43ceabdfc93 Content-Type: text/x-patch; charset=utf-8; name="D14473.39653.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="D14473.39653.patch" ZGlmZiAtLWdpdCBhL3Vzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYyBiL3Vzci5zYmluL2Jo eXZlbG9hZC9iaHl2ZWxvYWQuYwotLS0gYS91c3Iuc2Jpbi9iaHl2ZWxvYWQvYmh5dmVsb2FkLmMK KysrIGIvdXNyLnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCkBAIC01NjAsNiArNTYwLDMzIEBA CiAJcmV0dXJuICh2bV9zZXRfZGVzYyhjdHgsIHZjcHUsIHJlZywgYmFzZSwgbGltaXQsIGFjY2Vz cykpOwogfQogCitzdGF0aWMgaW50CitjYl92bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQq IGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKQoreworCisJcmV0dXJuICh2bV9nZXRfY2FwYWJp bGl0eShjdHgsIHZjcHUsCisJICAgIFZNX0NBUF9VTlJFU1RSSUNURURfR1VFU1QsIHJldHZhbCkp OworfQorCitzdGF0aWMgaW50CitjYl92bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQqIGFy ZywgaW50IHZjcHUsIGludCB2YWwpCit7CisJaW50IGVycm9yLCB0bXA7CisKKwlpZiAoKGVycm9y ID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXApKSkKKwkJcmV0 dXJuIChlcnJvcik7CisKKwlyZXR1cm4gKHZtX3NldF9jYXBhYmlsaXR5KGN0eCwgdmNwdSwKKwkg ICAgVk1fQ0FQX1VOUkVTVFJJQ1RFRF9HVUVTVCwgdmFsKSk7Cit9CisKK3N0YXRpYyBpbnQKK2Ni X3ZjcHVfcmVzZXQodm9pZCogYXJnLCBpbnQgdmNwdSkKK3sKKworCXJldHVybiAodmNwdV9yZXNl dChjdHgsIHZjcHUpKTsKK30KKwogc3RhdGljIHN0cnVjdCBsb2FkZXJfY2FsbGJhY2tzIGNiID0g ewogCS5nZXRjID0gY2JfZ2V0YywKIAkucHV0YyA9IGNiX3B1dGMsCkBAIC01OTMsNiArNjIwLDEx IEBACiAJLyogVmVyc2lvbiA0IGFkZGl0aW9ucyAqLwogCS52bV9zZXRfcmVnaXN0ZXIgPSBjYl92 bV9zZXRfcmVnaXN0ZXIsCiAJLnZtX3NldF9kZXNjID0gY2Jfdm1fc2V0X2Rlc2MsCisKKwkvKiBW ZXJzaW9uIDUgYWRkaXRpb25zICovCisJLnZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3QgPSBjYl92 bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0LAorCS52bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0ID0g Y2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCwKKwkudmNwdV9yZXNldCA9IGNiX3ZjcHVfcmVz ZXQsCiB9OwogCiBzdGF0aWMgaW50CkBAIC03OTAsNyArODIyLDcgQEAKIAlhZGRlbnYoInNtYmlv cy5iaW9zLnZlbmRvcj1CSFlWRSIpOwogCWFkZGVudigiYm9vdF9zZXJpYWw9MSIpOwogCi0JZnVu YygmY2IsIE5VTEwsIFVTRVJCT09UX1ZFUlNJT05fNCwgbmRpc2tzKTsKKwlmdW5jKCZjYiwgTlVM TCwgVVNFUkJPT1RfVkVSU0lPTl81LCBuZGlza3MpOwogCiAJZnJlZShsb2FkZXIpOwogCXJldHVy biAoMCk7CmRpZmYgLS1naXQgYS9zdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oIGIvc3RhbmQvdXNl cmJvb3QvdXNlcmJvb3QuaAotLS0gYS9zdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCisrKyBiL3N0 YW5kL3VzZXJib290L3VzZXJib290LmgKQEAgLTQxLDYgKzQxLDE0IEBACiAgKi8KICNkZWZpbmUJ VVNFUkJPT1RfVkVSU0lPTl80ICAgICAgNAogCisvKgorICogVmVyc2lvbiA1IGFkZHMgY2FsbGJh Y2tzIHRvIHNldCB1bnJlc3RyaWN0ZWQgZ3Vlc3QKKyAqIGNhcGFiaWxpdGllcyBhbmQgcmVzZXQg dGhlIHZjcHUgc3RhdGUuIFRoZSBjYWxsYmFjaworICogc3RydWN0dXJlIGJhY2t3YXJkIGNvbXBh dGlibGUgKG5ldyBjYWxsYmFja3MgaGF2ZQorICogYmVlbiBhZGRlZCBhdCB0aGUgdGFpbCBlbmQp LgorICovCisjZGVmaW5lCVVTRVJCT09UX1ZFUlNJT05fNSAgICAgIDUKKwogLyoKICAqIEV4aXQg Y29kZXMgZnJvbSB0aGUgbG9hZGVyCiAgKi8KQEAgLTIxMCw0ICsyMTgsMjIgQEAKIAlpbnQJKCp2 bV9zZXRfcmVnaXN0ZXIpKHZvaWQgKmFyZywgaW50IHZjcHUsIGludCByZWcsIHVpbnQ2NF90IHZh bCk7CiAJaW50CSgqdm1fc2V0X2Rlc2MpKHZvaWQgKmFyZywgaW50IHZjcHUsIGludCByZWcsIHVp bnQ2NF90IGJhc2UsCiAJICAgIHVfaW50IGxpbWl0LCB1X2ludCBhY2Nlc3MpOworCisJLyoKKwkg KiBWZXJzaW9uIDUgYWRkaXRpb25zLgorCSAqCisJICogdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVz dCBjaGVja3Mgc3VwcG9ydCBmb3IgdGhlIFVOUkVTVFJJQ1RFRF9HVUVTVAorCSAqIGNhcGFiaWxp dHkgYW5kIGlmIHN1cHBvcnRlZCwgc2V0cyAncmV0dmFsJy4gSWYgdW5zdXBwb3J0ZWQsIGFuIGVy cm9yCisJICogY29kZSBpcyByZXR1cm5lZC4KKwkgKgorCSAqIHZtX3NldF91bnJlc3RyaWN0ZWRf Z3Vlc3Qgc2V0cyB0aGUgVU5SRVNUUklDVEVEX0dVRVNUIGNhcGFiaWxpdHkgaWYKKwkgKiBzdXBw b3J0ZWQsIGFuZCByZXR1cm5zIGFuIGVycm9yIGNvZGUgb3RoZXJ3aXNlLgorCSAqCisJICogdmNw dV9yZXNldCBpbml0aWFsaXplcyB0aGUgdkNQVSBzdGF0ZSBhcyBkZWZpbmVkIGluCisJICogSW50 ZWwgVm9sIDNhLCBUYWJsZSA5LjEuIElBLTMyIFByb2Nlc3NvciBTdGF0ZXMgRm9sbG93aW5nIFBv d2VyLXVwLAorCSAqIFJlc2V0IG9yIElOSVQKKwkgKi8KKwlpbnQJKCp2bV9nZXRfdW5yZXN0cmlj dGVkX2d1ZXN0KSh2b2lkKiBhcmcsIGludCB2Y3B1LCBpbnQgKnJldHZhbCk7CisJaW50CSgqdm1f c2V0X3VucmVzdHJpY3RlZF9ndWVzdCkodm9pZCogYXJnLCBpbnQgdmNwdSwgaW50IHZhbCk7CisJ aW50CSgqdmNwdV9yZXNldCkodm9pZCogYXJnLCBpbnQgdmNwdSk7CiB9OwoK --b1_165aeb06e6eb089a6f32c43ceabdfc93-- From owner-freebsd-virtualization@freebsd.org Fri Feb 23 19:32:02 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 07A31F15576 for ; Fri, 23 Feb 2018 19:32:02 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9F2B7739FF for ; Fri, 23 Feb 2018 19:32:01 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: from reviews.nyi.freebsd.org (reviews.nyi.freebsd.org [IPv6:2610:1c1:1:607c::16:b]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 92B2C1ABD4 for ; Fri, 23 Feb 2018 19:32:01 +0000 (UTC) (envelope-from daemon-user@freebsd.org) Received: by reviews.nyi.freebsd.org (Postfix, from userid 1346) id 91E1B1189C1; Fri, 23 Feb 2018 19:32:01 +0000 (UTC) Date: Fri, 23 Feb 2018 19:32:01 +0000 To: freebsd-virtualization@freebsd.org From: "fabian.freyer_physik.tu-berlin.de (Fabian Freyer)" Reply-to: D14473+333+002e492985d67ce8@reviews.freebsd.org Subject: [Differential] D14473: userboot: add callbacks to set unrestricted guest mode Message-ID: X-Priority: 3 X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , X-Herald-Rules: <28>, <67>, none X-Phabricator-Projects: <#bhyve> X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: Precedence: bulk Thread-Topic: PHID-DREV-z4kdgdlru2lrsvfkw4bo In-Reply-To: References: Thread-Index: OWY4MjZiMDdiMWRiNGU2MWQzZDM0N2I0N2FiIFqQbDE= X-Phabricator-Stamps: actor(@fabian.freyer_physik.tu-berlin.de) application(Differential) author(@fabian.freyer_physik.tu-berlin.de) herald(H28) herald(H67) monogram(D14473) object-type(DREV) phid(PHID-DREV-z4kdgdlru2lrsvfkw4bo) reviewer(#bhyve) reviewer(@grehan) reviewer(@imp) reviewer(@rgrimes) revision-status(needs-review) subscriber(#contributor_reviews_base) subscriber(@freebsd-virtualization-list) subscriber(@grehan) subscriber(@imp) tag(#bhyve) via(web) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="b1_a3b44848b44a0152d1904e62152d9115" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Feb 2018 19:32:02 -0000 --b1_a3b44848b44a0152d1904e62152d9115 Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: base64 ZmFiaWFuLmZyZXllcl9waHlzaWsudHUtYmVybGluLmRlIHVwZGF0ZWQgdGhpcyByZXZpc2lvbiB0 byBEaWZmIDM5NjU1LgpmYWJpYW4uZnJleWVyX3BoeXNpay50dS1iZXJsaW4uZGUgYWRkZWQgYSBj b21tZW50LgoKCiAgSSdtIHNvcnJ5LCBJIHNlZW0gdG8gaGF2ZSBjcmVhdGVkIHRoZSBwcmV2aW91 cyBwYXRjaCB3aXRob3V0IGZ1bGwgY29udGV4dCwgc28gaGVyZSBpdCBpcyBhZ2FpbiwgdGhpcyB0 aW1lIHdpdGggZnVsbCBjb250ZXh0LgoKQ0hBTkdFUyBTSU5DRSBMQVNUIFVQREFURQogIGh0dHBz Oi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzM/dnM9Mzk2NTMmaWQ9Mzk2NTUKClJFVklTSU9O IERFVEFJTAogIGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMTQ0NzMKCkFGRkVDVEVEIEZJ TEVTCiAgc3RhbmQvdXNlcmJvb3QvdXNlcmJvb3QuaAogIHVzci5zYmluL2JoeXZlbG9hZC9iaHl2 ZWxvYWQuYwoKRU1BSUwgUFJFRkVSRU5DRVMKICBodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcv c2V0dGluZ3MvcGFuZWwvZW1haWxwcmVmZXJlbmNlcy8KClRvOiBmYWJpYW4uZnJleWVyX3BoeXNp ay50dS1iZXJsaW4uZGUsIGltcCwgcmdyaW1lcywgI2JoeXZlLCBncmVoYW4KQ2M6IGdyZWhhbiwg aW1wLCBmcmVlYnNkLXZpcnR1YWxpemF0aW9uLWxpc3QsICNjb250cmlidXRvcl9yZXZpZXdzX2Jh c2UK --b1_a3b44848b44a0152d1904e62152d9115 Content-Type: text/x-patch; charset=utf-8; name="D14473.39655.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="D14473.39655.patch" ZGlmZiAtLWdpdCBhL3Vzci5zYmluL2JoeXZlbG9hZC9iaHl2ZWxvYWQuYyBiL3Vzci5zYmluL2Jo eXZlbG9hZC9iaHl2ZWxvYWQuYwotLS0gYS91c3Iuc2Jpbi9iaHl2ZWxvYWQvYmh5dmVsb2FkLmMK KysrIGIvdXNyLnNiaW4vYmh5dmVsb2FkL2JoeXZlbG9hZC5jCkBAIC01NjAsNiArNTYwLDMzIEBA CiAJcmV0dXJuICh2bV9zZXRfZGVzYyhjdHgsIHZjcHUsIHJlZywgYmFzZSwgbGltaXQsIGFjY2Vz cykpOwogfQogCitzdGF0aWMgaW50CitjYl92bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQq IGFyZywgaW50IHZjcHUsIGludCAqcmV0dmFsKQoreworCisJcmV0dXJuICh2bV9nZXRfY2FwYWJp bGl0eShjdHgsIHZjcHUsCisJICAgIFZNX0NBUF9VTlJFU1RSSUNURURfR1VFU1QsIHJldHZhbCkp OworfQorCitzdGF0aWMgaW50CitjYl92bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0KHZvaWQqIGFy ZywgaW50IHZjcHUsIGludCB2YWwpCit7CisJaW50IGVycm9yLCB0bXA7CisKKwlpZiAoKGVycm9y ID0gY2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdChhcmcsIHZjcHUsICZ0bXApKSkKKwkJcmV0 dXJuIChlcnJvcik7CisKKwlyZXR1cm4gKHZtX3NldF9jYXBhYmlsaXR5KGN0eCwgdmNwdSwKKwkg ICAgVk1fQ0FQX1VOUkVTVFJJQ1RFRF9HVUVTVCwgdmFsKSk7Cit9CisKK3N0YXRpYyBpbnQKK2Ni X3ZjcHVfcmVzZXQodm9pZCogYXJnLCBpbnQgdmNwdSkKK3sKKworCXJldHVybiAodmNwdV9yZXNl dChjdHgsIHZjcHUpKTsKK30KKwogc3RhdGljIHN0cnVjdCBsb2FkZXJfY2FsbGJhY2tzIGNiID0g ewogCS5nZXRjID0gY2JfZ2V0YywKIAkucHV0YyA9IGNiX3B1dGMsCkBAIC01OTMsNiArNjIwLDEx IEBACiAJLyogVmVyc2lvbiA0IGFkZGl0aW9ucyAqLwogCS52bV9zZXRfcmVnaXN0ZXIgPSBjYl92 bV9zZXRfcmVnaXN0ZXIsCiAJLnZtX3NldF9kZXNjID0gY2Jfdm1fc2V0X2Rlc2MsCisKKwkvKiBW ZXJzaW9uIDUgYWRkaXRpb25zICovCisJLnZtX3NldF91bnJlc3RyaWN0ZWRfZ3Vlc3QgPSBjYl92 bV9zZXRfdW5yZXN0cmljdGVkX2d1ZXN0LAorCS52bV9nZXRfdW5yZXN0cmljdGVkX2d1ZXN0ID0g Y2Jfdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVzdCwKKwkudmNwdV9yZXNldCA9IGNiX3ZjcHVfcmVz ZXQsCiB9OwogCiBzdGF0aWMgaW50CkBAIC03OTAsNyArODIyLDcgQEAKIAlhZGRlbnYoInNtYmlv cy5iaW9zLnZlbmRvcj1CSFlWRSIpOwogCWFkZGVudigiYm9vdF9zZXJpYWw9MSIpOwogCi0JZnVu YygmY2IsIE5VTEwsIFVTRVJCT09UX1ZFUlNJT05fNCwgbmRpc2tzKTsKKwlmdW5jKCZjYiwgTlVM TCwgVVNFUkJPT1RfVkVSU0lPTl81LCBuZGlza3MpOwogCiAJZnJlZShsb2FkZXIpOwogCXJldHVy biAoMCk7CmRpZmYgLS1naXQgYS9zdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oIGIvc3RhbmQvdXNl cmJvb3QvdXNlcmJvb3QuaAotLS0gYS9zdGFuZC91c2VyYm9vdC91c2VyYm9vdC5oCisrKyBiL3N0 YW5kL3VzZXJib290L3VzZXJib290LmgKQEAgLTQxLDYgKzQxLDE0IEBACiAgKi8KICNkZWZpbmUJ VVNFUkJPT1RfVkVSU0lPTl80ICAgICAgNAogCisvKgorICogVmVyc2lvbiA1IGFkZHMgY2FsbGJh Y2tzIHRvIHNldCB1bnJlc3RyaWN0ZWQgZ3Vlc3QKKyAqIGNhcGFiaWxpdGllcyBhbmQgcmVzZXQg dGhlIHZjcHUgc3RhdGUuIFRoZSBjYWxsYmFjaworICogc3RydWN0dXJlIGJhY2t3YXJkIGNvbXBh dGlibGUgKG5ldyBjYWxsYmFja3MgaGF2ZQorICogYmVlbiBhZGRlZCBhdCB0aGUgdGFpbCBlbmQp LgorICovCisjZGVmaW5lCVVTRVJCT09UX1ZFUlNJT05fNSAgICAgIDUKKwogLyoKICAqIEV4aXQg Y29kZXMgZnJvbSB0aGUgbG9hZGVyCiAgKi8KQEAgLTIxMCw0ICsyMTgsMjIgQEAKIAlpbnQJKCp2 bV9zZXRfcmVnaXN0ZXIpKHZvaWQgKmFyZywgaW50IHZjcHUsIGludCByZWcsIHVpbnQ2NF90IHZh bCk7CiAJaW50CSgqdm1fc2V0X2Rlc2MpKHZvaWQgKmFyZywgaW50IHZjcHUsIGludCByZWcsIHVp bnQ2NF90IGJhc2UsCiAJICAgIHVfaW50IGxpbWl0LCB1X2ludCBhY2Nlc3MpOworCisJLyoKKwkg KiBWZXJzaW9uIDUgYWRkaXRpb25zLgorCSAqCisJICogdm1fZ2V0X3VucmVzdHJpY3RlZF9ndWVz dCBjaGVja3Mgc3VwcG9ydCBmb3IgdGhlIFVOUkVTVFJJQ1RFRF9HVUVTVAorCSAqIGNhcGFiaWxp dHkgYW5kIGlmIHN1cHBvcnRlZCwgc2V0cyAncmV0dmFsJy4gSWYgdW5zdXBwb3J0ZWQsIGFuIGVy cm9yCisJICogY29kZSBpcyByZXR1cm5lZC4KKwkgKgorCSAqIHZtX3NldF91bnJlc3RyaWN0ZWRf Z3Vlc3Qgc2V0cyB0aGUgVU5SRVNUUklDVEVEX0dVRVNUIGNhcGFiaWxpdHkgaWYKKwkgKiBzdXBw b3J0ZWQsIGFuZCByZXR1cm5zIGFuIGVycm9yIGNvZGUgb3RoZXJ3aXNlLgorCSAqCisJICogdmNw dV9yZXNldCBpbml0aWFsaXplcyB0aGUgdkNQVSBzdGF0ZSBhcyBkZWZpbmVkIGluCisJICogSW50 ZWwgVm9sIDNhLCBUYWJsZSA5LjEuIElBLTMyIFByb2Nlc3NvciBTdGF0ZXMgRm9sbG93aW5nIFBv d2VyLXVwLAorCSAqIFJlc2V0IG9yIElOSVQKKwkgKi8KKwlpbnQJKCp2bV9nZXRfdW5yZXN0cmlj dGVkX2d1ZXN0KSh2b2lkKiBhcmcsIGludCB2Y3B1LCBpbnQgKnJldHZhbCk7CisJaW50CSgqdm1f c2V0X3VucmVzdHJpY3RlZF9ndWVzdCkodm9pZCogYXJnLCBpbnQgdmNwdSwgaW50IHZhbCk7CisJ aW50CSgqdmNwdV9yZXNldCkodm9pZCogYXJnLCBpbnQgdmNwdSk7CiB9OwoK --b1_a3b44848b44a0152d1904e62152d9115--