From owner-freebsd-xen@freebsd.org Mon Feb 19 10:42:18 2018 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7806BF18D1C; Mon, 19 Feb 2018 10:42:18 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sg2apc01on0091.outbound.protection.outlook.com [104.47.125.91]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0F5B46D962; Mon, 19 Feb 2018 10:42:16 +0000 (UTC) (envelope-from laurence.pawling@globalsign.com) Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com (10.170.152.14) by HK2PR0302MB2579.apcprd03.prod.outlook.com (10.170.145.147) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.527.6; Mon, 19 Feb 2018 10:42:12 +0000 Received: from HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087]) by HK2PR0302MB2545.apcprd03.prod.outlook.com ([fe80::997e:7c67:c760:d087%2]) with mapi id 15.20.0527.012; Mon, 19 Feb 2018 10:42:08 +0000 From: Laurence Pawling To: =?utf-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= CC: "freebsd-xen@freebsd.org" , "freebsd-virtualization@freebsd.org" , "freebsd-net@freebsd.org" , David King , Vlad Galu Subject: Re: multi-vCPU networking issues as client OS under Xen Thread-Topic: multi-vCPU networking issues as client OS under Xen Thread-Index: AQHTqWgyLMPz8qfMa0GcAhXNzUcYuKOrf6kAgAAKGgA= Date: Mon, 19 Feb 2018 10:42:08 +0000 Message-ID: References: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> In-Reply-To: <20180219100558.adgb6m5ukdfvxehp@MacBook-Pro-de-Roger.local> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [89.197.152.162] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; HK2PR0302MB2579; 7:mOYvIhWLrbCaDEWovAyP5/Xnh43SekpUIWaOUzDvFcFcy3bYI595F/JF2RBByJ1+FNW/jNfcrwpm9+ItxOJAaqgjRj9nctwa04gP6POwLf6CckDH884Ah59VFBkcmwIe4rV+Ir5Wjavk3IkRBYsLE0DIlEDnX0mALxxFnlZ5Q0uXUSGP1XpltMX0X2Clbf4TsbR/j0lm+D/wP/Hd31Uf+MggG/KA2vdp6XUNRJqf+kIMfL2NLTQ/6enz0fQPNfY1 x-ms-exchange-antispam-srfa-diagnostics: SSOS;SSOR; x-forefront-antispam-report: SFV:SKI; SCL:-1; SFV:NSPM; SFS:(10019020)(7966004)(396003)(366004)(346002)(376002)(39380400002)(39850400004)(189003)(199004)(8666007)(4326008)(25786009)(33656002)(97736004)(99936001)(54906003)(83716003)(107886003)(316002)(99286004)(86362001)(6246003)(106356001)(6486002)(105586002)(5250100002)(6436002)(53936002)(6512007)(66066001)(2900100001)(82746002)(14454004)(81166006)(68736007)(2906002)(5660300001)(81156014)(8676002)(3660700001)(26005)(6116002)(3846002)(229853002)(55236004)(305945005)(6506007)(102836004)(6346003)(508600001)(7736002)(2950100002)(36756003)(6916009)(186003)(76176011)(8936002)(3280700002); DIR:OUT; SFP:1102; SCL:1; SRVR:HK2PR0302MB2579; H:HK2PR0302MB2545.apcprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; x-ms-office365-filtering-correlation-id: 22d8cdaa-6b7f-4db5-5d65-08d577856d39 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4604075)(3008032)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(2017052603307)(7153060)(49563074)(7193020); SRVR:HK2PR0302MB2579; x-ms-traffictypediagnostic: HK2PR0302MB2579: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040501)(2401047)(5005006)(8121501046)(3231101)(944501161)(93006095)(93001095)(3002001)(10201501046)(6041288)(20161123562045)(20161123560045)(201703131423095)(201703011903075)(201702281528075)(20161123555045)(201703061421075)(20161123564045)(20161123558120)(6072148)(201708071742011); SRVR:HK2PR0302MB2579; BCL:0; PCL:0; RULEID:; SRVR:HK2PR0302MB2579; x-forefront-prvs: 0588B2BD96 received-spf: None (protection.outlook.com: globalsign.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: EhUssBYBudn1yhuBRkD8kZaLgC2I0vav5iH1734j/l3c1m0F+Yuf5QCpT7xe5ON3hwJBEuvUNCCuTkp7+xSYvxMMLiQbWRHrOLCZGf8/mSLupxZPmsmKrGy/1QJTLjHWj1OIs38WRJI3DXFKpyr2hfz13Vq9eG5b0cWBJMe9pHY= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha256; boundary="B_3601881728_1046608566" MIME-Version: 1.0 X-OriginatorOrg: globalsign.com X-MS-Exchange-CrossTenant-Network-Message-Id: 22d8cdaa-6b7f-4db5-5d65-08d577856d39 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Feb 2018 10:42:08.9156 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8fff67c1-8281-4635-b62f-93106cb7a9a8 X-MS-Exchange-Transport-CrossTenantHeadersStamped: HK2PR0302MB2579 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Feb 2018 10:42:18 -0000 --B_3601881728_1046608566 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: 7bit > When using >1 vCPUs can you set hw.xn.num_queues=1 on > /boot/loader.conf and try to reproduce the issue? > > I'm afraid this is rather related to multiqueue (which is only used > if >1 vCPUs). > > Thanks, Roger. Roger - thanks for your quick reply, this is confirmed. Setting hw.xn.num_queues=1 on the server VM when vCPUs > 1 prevents the issue. For reference, please can you comment on the performance impact of this? Laurence --B_3601881728_1046608566 Content-type: application/pkcs7-signature; name="smime.p7s" Content-transfer-encoding: base64 Content-disposition: attachment; filename="smime.p7s" MIIP9AYJKoZIhvcNAQcCoIIP5TCCD+ECAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0B BwGggg21MIIFYjCCBEqgAwIBAgIMSX2V7ElwCIrABZuQMA0GCSqGSIb3DQEBCwUAMF0xCzAJ BgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxT aWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2IC0gRzMwHhcNMTYwODI2MTQzNjA4WhcN MTkwODI3MTQzNjA4WjCBnDELMAkGA1UEBhMCR0IxDTALBgNVBAgTBEtlbnQxEjAQBgNVBAcT CU1haWRzdG9uZTEfMB0GA1UEChMWR01PIEdsb2JhbFNpZ24gTGltaXRlZDEZMBcGA1UEAxMQ TGF1cmVuY2UgUGF3bGluZzEuMCwGCSqGSIb3DQEJARYfbGF1cmVuY2UucGF3bGluZ0BnbG9i YWxzaWduLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALBcjCf6ajlJBRGN ptXjlTf3Wwv5TuzE6iW5j3YOxxGE2uRSoisepRd5pHkQ3ffF1u4Rjfc3aXcHvlmipxf3pA3e TrGJGrlLhvpnY2Zg7ZXDYHEqZIfgASxl/5EXeshGqVi9uIoCjHng+oyfXU0GWuKPgqh88oZN Wm45QoeH4t96TRdlY/dpFjK8ea6vFvZApvbum8bYJZGlJOtgPl0j8/uF1akM8SNxciDQfT39 2quhOd6LxK0LeX9qIe5lXjbhojmyb0IUf4HKZanSuFMer5OY9MnsFgMsUdLs/D5LWw2dsqcF YfQgGs2FEolsnBwmogblGogYxpqy8qIK2JZwJp0CAwEAAaOCAeAwggHcMA4GA1UdDwEB/wQE AwIFoDCBngYIKwYBBQUHAQEEgZEwgY4wTQYIKwYBBQUHMAKGQWh0dHA6Ly9zZWN1cmUuZ2xv YmFsc2lnbi5jb20vY2FjZXJ0L2dzcGVyc29uYWxzaWduMnNoYTJnM29jc3AuY3J0MD0GCCsG AQUFBzABhjFodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hh MmczME0GA1UdIARGMEQwQgYKKwYBBAGgMgEoCjA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3 dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAJBgNVHRMEAjAAMEQGA1UdHwQ9MDswOaA3 oDWGM2h0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3NwZXJzb25hbHNpZ24yc2hhMmczLmNy bDAqBgNVHREEIzAhgR9sYXVyZW5jZS5wYXdsaW5nQGdsb2JhbHNpZ24uY29tMB0GA1UdJQQW MBQGCCsGAQUFBwMCBggrBgEFBQcDBDAdBgNVHQ4EFgQU5SIdmwI3kfJf98Y87lFl62amcP0w HwYDVR0jBBgwFoAUaXKCYjFnlUSFd5GAxAQ2SZ17C2EwDQYJKoZIhvcNAQELBQADggEBACMg 3mWAnD3BBOGpqvrPNem5D3G0GMKlVWSsRax251QsJwogpkoFDgbyX4QtHmkooPRGNydJGwhV TjvWu5BMle9UuZbcDw6zno3/hLD7kDIUlNJOuU+IgRhWtZwp6ELxaSvIBkiDKPRmpue3P73X gMTq2VnDwUx5Sxk9FkZcyFNfZ1wvZGWA03sZAZXj1UkmBrsGZ/dOpfsLr1Z0N4AR2ZVx+H4C MyWzVGJzp5Lvqw54WDY4KL4XRmkw8SrdujgIA5SsoAl4wEmSl1GZiXdb88koxbQ7yME+roNa q86YT7L4n4cWSBsf5lQTodjeYLWN1mmlBGzBxcv2ceTcy541lbwwggToMIID0KADAgECAg5I G2oJE72AJMpdIvAU8zANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQLExdHbG9iYWxTaWduIFJv b3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UEAxMKR2xvYmFsU2lnbjAe Fw0xNjA2MTUwMDAwMDBaFw0yNDA2MTUwMDAwMDBaMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQK ExBHbG9iYWxTaWduIG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAy IENBIC0gU0hBMjU2IC0gRzMwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC2lmiT Zf0sAexiow1Uv4vLpEORopqvsYPytW1v2fDq3M8We9cZ44QDhfnGH3CPH2xJxWkZHnCRODV+ AkhdOWsYRKZqpch09F31hD5jH3FEggg+7cmn9uluJkEpgMlJuv/ZdqCjuxv2ed9LKNNKe5xR wg9lUKGfqEqd5UYEjYNP3LLIPc+YIQmYTMDxj3qpPzcmZUfYZo9JJsLDQL5mPWz/Oq0pRvAT nOHy65mni8LTX1Btog5vxwaXOC9OoY5HArSDANik47pBB2Dl3Tda8gfBO6ecl2gut++pSDa8 6WmomapH6cf2UdL5sSy2xUm1mJ5TU9r7cvN8D/hxPtcD+mfDAgMBAAGjggG1MIIBsTAOBgNV HQ8BAf8EBAMCAQYwagYDVR0lBGMwYQYIKwYBBQUHAwIGCCsGAQUFBwMEBggrBgEFBQcDCQYK KwYBBAGCNxQCAgYKKwYBBAGCNwoDBAYJKwYBBAGCNxUGBgorBgEEAYI3CgMMBggrBgEFBQcD BwYIKwYBBQUHAxEwEgYDVR0TAQH/BAgwBgEB/wIBADAdBgNVHQ4EFgQUaXKCYjFnlUSFd5GA xAQ2SZ17C2EwHwYDVR0jBBgwFoAUj/BLf6guRSSuTVD6Y5qL3uLdG7wwPgYIKwYBBQUHAQEE MjAwMC4GCCsGAQUFBzABhiJodHRwOi8vb2NzcDIuZ2xvYmFsc2lnbi5jb20vcm9vdHIzMDYG A1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vcm9vdC1yMy5jcmww ZwYDVR0gBGAwXjALBgkrBgEEAaAyASgwDAYKKwYBBAGgMgEoCjBBBgkrBgEEAaAyAV8wNDAy BggrBgEFBQcCARYmaHR0cHM6Ly93d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8wDQYJ KoZIhvcNAQELBQADggEBAKidzTLMfGfiC1DXpVxwo2biJe/qtLZTMG6HEjdcM+LCKFbjk71F lfNY2BVxTPPkgokUvv6lzEe96wZUgj7mv7716oj1ecQoIguMevYOC+MqrkmaDpvCJ/JsthtV SgG2GeFoUHRYvBJFGE+u3l4bEzDnVSY0gKL+FIoEqweEYVIRolAAtnLgcvQRZ24TogtgCNfo FJdEO0cV5Q911vjp/kd/mvMhMYuyf0Eimg5WuBLzvw7gmd9RZCLb3IF+fvkdqOJ8W88L66qf 6txWe+ukuCws5gb/riRZf8VEfz6aFV76ZxJffGxSlzEr2r28tNW2uhT/IlSYQLg5wfl1Cxsc GqMwggNfMIICR6ADAgECAgsEAAAAAAEhWFMIojANBgkqhkiG9w0BAQsFADBMMSAwHgYDVQQL ExdHbG9iYWxTaWduIFJvb3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UE AxMKR2xvYmFsU2lnbjAeFw0wOTAzMTgxMDAwMDBaFw0yOTAzMTgxMDAwMDBaMEwxIDAeBgNV BAsTF0dsb2JhbFNpZ24gUm9vdCBDQSAtIFIzMRMwEQYDVQQKEwpHbG9iYWxTaWduMRMwEQYD VQQDEwpHbG9iYWxTaWduMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzCV2kHkG eCIW9cCDtoTKKJ79BXYRxa2IcvxGAkPHsoqdBF8kyy5L4WCCRuFSqwyBR3Bs3WTR6/Usow+C PQwrrpfXthSGEHm7OxOAd4wI4UnSamIvH176lmjfiSeVOJ8G1z7JyyZZDXPesMjpJg6DFcbv W4vSBGDKSaYo9mk79svIKJHlnYphVzesdBTcdOA67nIvLpz70Lu/9T0A4QYz6IIrrlOmOhZz jN1BDiA6wLSnoemyT5AuMmDpV8u5BJJoaOU4JmB1sp93/5EU764gSfytQBVI0QIxYRleuJfv rXe3ZJp6v1/BE++bYvsNbOBUaRapA9pu6YOTcXbGaYWCFwIDAQABo0IwQDAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUj/BLf6guRSSuTVD6Y5qL3uLdG7ww DQYJKoZIhvcNAQELBQADggEBAEtA28BQqv7IDO/3llRFSbuWAAlBrLMThoYoBzPKa+Z0uboA La6kCtP18fEPir9zZ0qDx0R7eOCvbmxvAymOMzlFw47kuVdsqvwSluxTxi3kJGy5lGP73FNo Z1Y+g7jPNSHDyWj+ztrCU6rMkIrp8F1GjJXdelgoGi8d3s0AN0GP7URt11Mol37zZwQeFdeK lrTT3kwnpEwbc3N29BeZwh96DuMtCK0KHCz/PKtVDg+Rfjbrw1dJvuEuLXxgi8NBURMjnc73 MmuUAaiZ5ywzHzo7JdKGQM47LIZ4yWEvFLru21Vv34TuBQlNvSjYcs7TYlBlHuuSl4Mx2bO1 ykdYP18xggIDMIIB/wIBATBtMF0xCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWdu IG52LXNhMTMwMQYDVQQDEypHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAyIENBIC0gU0hBMjU2 IC0gRzMCDEl9lexJcAiKwAWbkDANBglghkgBZQMEAgEFAKBpMC8GCSqGSIb3DQEJBDEiBCB8 aNzfpYozQ/xfkCCmjjSKys2lJJQRltQwtSN3tVOFSTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0xODAyMTkxMDQyMDhaMA0GCSqGSIb3DQEBAQUABIIBADW/ nOtPmnBaLXY094SU+v12CNLetpAJYGhjPS7ExN8H7goqX8cajt6j+W9gaBH5yIu3eTe/HS89 +YVS4cPYUgZote8QKxRmxd7+3xomnEQKs1iXPp2QW5fyxi/3xlCJxy190rTlSVzJqstYMPT7 YVGoeYv4PirWpmnyTtGfD+nc1RbUH08w527rvfHds4rFICaFDh6pGLDOu++JdsGAc1Pb+DXq F0ENsOeY+eBszBIvj/ihb+iM2Go2px7oD1K78VaX2PjLeIoeMvXb58uihT+/b0iTpzzTMUXz yrvx+W9LTvRZo5T1+F27++FAXwCvif64zW8mUtQ5M8nCRgtjfeE= --B_3601881728_1046608566--