From nobody Tue Jan 11 10:26:15 2022 X-Original-To: xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 235141944A86 for ; Tue, 11 Jan 2022 10:26:29 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa1.hc3370-68.iphmx.com (esa1.hc3370-68.iphmx.com [216.71.145.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.hc3370-68.iphmx.com", Issuer "HydrantID SSL CA G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JY6LD4h1Yz4pyX; Tue, 11 Jan 2022 10:26:28 +0000 (UTC) (envelope-from roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1641896788; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=IHUuK68FbOsY9rkN8OwO9HWFfxNH6D43zG284iGGYpc=; b=KgOl1tYBRQ54PVCBtmQgLIpQ/yiFYKq/P9ibOmfoYUGDqBwatFS1yp4v 9EneMQYArM5Ku2KrVe5QKo2AJYZax0y4+XeBAN4hzRbs+fx/8zlUW2xmc 8jTpKVNRCyzOgwv6/IKzNoRa+uur/qKMuEjix++UUek/BAz5E6OacVMXV g=; IronPort-SDR: Ysg/hVoP8NJq2vcbx+aQEkLofpWvE8G9Ifn438uboDifeUUHfl8RthFl+TE+IRvH+3Ax82JJNN f9gNAe99+uRL0xyGhck1Q1UUqmAdmYeNWYr50ZXhCKhnbjdjzDK0cMLZ6ri+gx0d60NCx1sUkq gB3krNA0FG2o+0e8MOr+5ENhaDT+uPs9PRcMk6wAyow7geeaUuwtHPoZcXTHc/HtVixZMHhRWr 0UA59qMXVa/9FxVMEH+HSv9wdSAlg6ybvj7GAKxv5e1e09OM2Bq4cyVjtxdNkkQo0kw3NNREF8 0VQVM8d4GoZPN2K3H+DFaUKI X-SBRS: 5.2 X-MesageID: 62128562 X-Ironport-Server: esa1.hc3370-68.iphmx.com X-Remote-IP: 162.221.156.83 X-Policy: $RELAYED IronPort-Data: A9a23:tGk2LqyxOGxfT2WPYaV6t+f0wSrEfRIJ4+MujC+fZmUNrF6WrkVUm mUXCmCAMvaCa2vxc991Oo/n8UkC7JWBzIUxSFZo/yAxQypGp/SeCIXCJC8cHc8zwu4v7q5Dx 59DAjUVBJlsFhcwnvopW1TYhSEUOZugH9IQM8aZfHAhLeNYYH1500g7wrdg2tcAbeWRWGthh /uj+6UzB3f9s9JEGjp8B3Wr8U4HUFza4Vv0j3RmDRx5lAa2e0o9VfrzEZqZPXrgKrS4K8bhL wr1IBNVyUuCl/slIovNfr8W6STmSJaKVeSFoiI+t6RPHnGuD8H9u0o2HKN0VKtZt9mGt4BD+ ulih9+uclwkZpeQyPQxDxkISwgraMWq+JefSZS+mcmazkmAeHrw2fR+SkoxOOX0+M4uXzsIr 6ZBbmlQMFbT3Ipaw5riIgVort4kI8TxepsWp1lrzC3DDOZgSpfGK0nPzYEChW1g254UdRrYT 5M8SyZ3QzThWEVoOXwyC65mvuKmq0CqJlW0r3rK/PFqsgA/1jdZwLXrGNTPd9GAXskTmVyXz krP4WvRDAsXOdaExXyC6H3EuwPUtXqlAsRITuT+r6M0xg3IroAONPEIfQuJk8WWuA2gYIlSc 3ZIqjoC8ahirGX+G7ERQCaEiHKDuxcdXf9ZHOs79ByBx8Lo3uqJOoQXZmUfMYJ77afaURRvj wbUxI2xWVSDpZXIESr1y1uCkd+l1cH5x0cmbDRMcwYK6sKLTGob3kOWFYYL/EJYY7TI9dDML 9Ki8XBWa1Y715djO0CHEbbv2WnESn/hFF9d2+kvdjj5hj6Vnab8D2BS1XDV7OxbMKGSRUSbs X4PlqC2tb5SVMHRzHXcGL5QRNlFAspp1hWG2jaD+LF7plyQF4OLJ9gMsFmS2m80Wir7RdMZS BCK4l4AjHOiFHCrcbV2c+qM5zcClsDd+SDefqmMNLJmO8EpHCfepX0GTRPOgwjFzRZ9+Ylia cbzWZv9Vh4yVPU4pAdass9Ai9fHMAhkmzOKLX06pjz6uYejiIm9EuZaYADQP7FgvMtpYmz9q r5iCidD8D0GOMXWaSjL648Da1cMKHkwH5ftrMJLMOWEJ2Jb9KsJUZc9GJstJN5ombp7jODN8 i3vU0NU0gOn13bGNR+LejZob7a2BcRzqncyPCoNO1e02id8PdbzvflHL5ZnL6M68OFDzOJvS 6VXccu3HfkSGC/M/C4QbMehodU6Jgirnw+HIwGsfCM7I8x7XwXM99K9Jlnv+SACAzCZr8w7p 7H8hArXTYBaH1ZpDdrMaeLpxFS05CBPlOV3VkrOA99SZESzr9Q6d32v1qc6epheJw/Cyz2W0 xetLS0Z/eSd8ZUo9NTphLyfq9v7GeVJAUcHTXLQ6qy7NHeG8zP7k5NASuuBYRvUSHjwpPe5f exQwvzxbK8HkVJNv9YuGrpn1/tjtd7mprscxQV4BnTbKV+sD+o4cHWB2MBOsIxLx6NY5lTqC h7epIECNOXbIt7hHX4QOBEhP7aK2vwjkzXP6eg4fRfh7yht8bvbCUhfMnFgUsCGwGeZ5G/9/ dochQ== IronPort-HdrOrdr: A9a23:ej1Y160qp5VVTQ5W/4OdvwqjBLYkLtp133Aq2lEZdPUzSL3+qy nOpoV+6faQsl0ssR4b9exoVJPufZq+z/5ICOsqU4tKNTOO0AHEEGgI1+rf6gylNyri9vNMkY dMGpIObeEY1GIK7voSNjPIceod/A== X-IronPort-AV: E=Sophos;i="5.88,279,1635220800"; d="scan'208";a="62128562" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QIqXB0CnLaU8DSw6bC+hVL0fpM2Ho0gP7b9O7BADkUduB081QppvCnlRKt2AipI8sO6nM7zkGMWoQQtQzzL5HtKmhqjr0WTR2Yct6Z6xaPAE6su/NHIXtt5a/MGIQcynUf/MxOpwTi7kK0oE3TW+0CgaVXF4chHCvHe6v+7zLbt9VTuLClG2xPFiYPRdkcw7bGEz3TKO6OYG4iItbhFE++xjdadBfGbge3svwaYdfx1L7pY9RmL16hPRvrIwNT4w8AQ9nN9yv3gQr7HtPoGdGpxDToGILJkZx81Cho1TgjYV9Uzh42GsKj57kuq8/y8FsWrfBRMBTlR1Gx3P8AXOWg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=+gmPZ38Lo8YIp0zfonpS86wKFP1+jZ96fJAdKIudfw0=; b=R7f6hkDEc+G3i/hoW1cLlDXAt/LK63Gw9VYQQUu8o1SKEzPETZ3HXS+8cCEvCW1VtJQZ49MYXwy7JdMiwldLWA6m0XvIjecRGR419x0eePuU6NSMKANLQohpBgOLKdIOpAdXpg5EpCS2LBQ9sTFYathw/mwzQGo3Qj32I1Z8yZmhVYSoZsix1JVeK0fsNDkv4fJxhcgw/Hhtbp56TJWg1PnDBxnGXStraUbkT9jMTTW59fUftFSykNyha9T91qoerU+rghLqvXclemKeHAxG87HbLLdgN2J7MZkk1LCLk3sz+3kZ9COw1T+eRpBNBFdsq5uzHwxNtomSRe018o8cMw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.onmicrosoft.com; s=selector2-citrix-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+gmPZ38Lo8YIp0zfonpS86wKFP1+jZ96fJAdKIudfw0=; b=gMg/zrkI6Rx+zFsh5fsmh5Ve+kLFZXlYzBUmZRNzD0xHrY4fSrDdY0pKv5gUe53ARviU8WsGLHk4OaJvzp6+h/DYHv87638/AJjum57QtcOKcheu37pILASgB3l6BLgUD+zN4wbmSfSF2aomKYZ5eYfM7yYcQhnNlpwLFmoWyTQ= Date: Tue, 11 Jan 2022 11:26:15 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Andriy Gapon CC: Subject: Re: VCPUOP_send_nmi returns -38 Message-ID: References: <3f9f173b-40b9-0180-404d-52fa56dde45f@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-ClientProxiedBy: FR0P281CA0078.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:1e::17) To DS7PR03MB5608.namprd03.prod.outlook.com (2603:10b6:5:2c9::18) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 6e6c1f6a-a795-4d73-35f3-08d9d4ecce75 X-MS-TrafficTypeDiagnostic: DM6PR03MB4138:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: k8zdygrNyxzX4ufnWFclZzqVpYUsGogNdiggB4+G0uDslya8+9YEFedYwmcqzFudKiLUBzd3CYUUPUPlrNq18oJ7mAYxkt2oivN9/pOWGyrD4QfKsFOenenBbDRrGzQb3zO5owrTzKEJrNGM9rnzjTErWRZYcx1RAuT0roHrY51oFfOCQZ8DxGhMH33uf9BQ/ocOcefBpQ8kMz6+OLsl0h/rZfws4I0SgGhVb0kFbHYmsDhHO/UunPqPOjocbMeUMKMkKYT85E5Vyr2RESuuTJqf3QaJvACien+KksdwpZ8rSaUCfQOGIbISb5DwqOb9ADrGmGwpbhwlEf4n/aifqBNo3EDjdrkQ7KY18Pp1+v6h9Tfo5grtOHB3mZ6WecKhv2wTb+tW2mn040OKP806lxLS3mhFhbxG4EaLzDZR8ekj8Yj9VAajgrmntuNuvgm+hntO5JiZYsWsVc6tPBhYEgY/A+PGp5FxyvwXsUMppNnfOcA6aroV1XuDW25rlD0api4Gp9eWp5pfNdtHs+cZHJWH++9TTUj6ud/bAM4u28D4pj89xJoWbVR4kBOWJvQgRHjFWYMELED0DRYmWzZzGvJYF7n+l6A4JQQmcIWWL4l04gDTneACKXYsYVxXKQYPxDXgTZZ+IaKe1p6zmgOQ6Q== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5608.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(7916004)(4636009)(366004)(186003)(5660300002)(8936002)(66556008)(6486002)(83380400001)(450100002)(6506007)(53546011)(66946007)(508600001)(8676002)(26005)(82960400001)(316002)(66476007)(4326008)(33716001)(85182001)(9686003)(7116003)(2906002)(6666004)(6512007)(6916009)(4744005)(38100700002)(86362001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?S1RHNHNZN054RjE5aSt3dUFpYU9FbEdYUW9RUmFtU2c5MjhxOWhycUdqeXZX?= =?utf-8?B?TmZUbjVMa3MzZzhDend2OGwyQWVOTXJmM0NmUnlEQ1B1M1lNSWFQbjBGL2Zv?= =?utf-8?B?MzU4L2taK3FpaVRFMGtEaG9ZMFJmc3M2SWN1QTJWMFlwQnlKOGJROUZkdU5r?= =?utf-8?B?YjYyTWpnWGhOMUZ4emxXNXJSUUIyNUNESnhNYkNKd2V5TlVSL1pCVSszL3cy?= =?utf-8?B?VmZQMGkvNitGY2o1ay9MakJFQWZlV0JVdjAyNTkyc2JBeHFHVFpnT3FxZThS?= =?utf-8?B?M2RsWUJvUnZ4ZFlWdVNNM0xvNFFiZkVaTFB3SzhGaU14QjFXTWN2dEljUENr?= =?utf-8?B?WXFUaTVLZnBMUmVHMmRpK3pVVGx2U1Jncmh3UUNlbUpacFhPYVZPby9kNE1o?= =?utf-8?B?Rk96ZGJCeUJSRXM2RVVBZUx3eFNIRERPUEt3dDZ4aHlNRlliZWxoaUgxUEI1?= =?utf-8?B?cHdiTzZyMjRuWXpJV2NkUmRuMzZPY2t6VTJpTTB0VEtqWCthZGlCUjREVWov?= =?utf-8?B?d2oxbjZJZCtGdEcrTHNnOTZmU3UrTTUvL3VmUUdXRG1weXAwbWVHZkJlNlJp?= =?utf-8?B?VnZLRStBOC9DT1ZRMkVENFVaQ2Z5eFdxS1lTT1ViWUJWaktUUnhzZk5Zdy9R?= =?utf-8?B?eVJoYlZuUThJczIrc1BNRjk4Ym9XSGdDd0JCYytiK3VqOC93MkxKNGJnSHkz?= =?utf-8?B?alVKMCtQVkx3bS9UdklUYjE3bmJpM1FOb1BxVElSR1RQbFpiekoyODU1RGtl?= =?utf-8?B?T1RZSmhWR3FMK1FLK21mOEVpWEpXVEhwTnkwbG8zTnJ0REp3eUhQVTQ5MWsr?= =?utf-8?B?UWJxaXRMMjRabFlxeG1yREVRUjJMMDNvRWxpVkIybjFJMlJXdEdYdno1WVpW?= =?utf-8?B?L282aEZROFRhVC9oSGQ0aHU4VVZFdXk2Mm4zMngzVkY5L2s5SlhDeTNuZ2xU?= =?utf-8?B?VjlnMkxnci9yeGxtekU2RUE3eGI0RXJNS2ZQK1RDZmRLRlJ0L3FDTGpSbklD?= =?utf-8?B?RjA2eE5HaFhVZGVzdlduZkR5UHo2SWJJc0xZQzdFWUJ3OVdDWU91SUkxOGh1?= =?utf-8?B?SDZ1dWM2T0c5cmRHV05ZVStOZmoyNDRaL2gxaFZzUlltazhIblRlZTZsdHlk?= =?utf-8?B?RDAwTzN2djB4aXZZZEFZSUtkMjcvNnk0VlI4Nm9MTVk3VXJKdTZweERIYllY?= =?utf-8?B?RW9KREZXTlFCbkw5Y0lMMEM3ZjVoWHpEeWg5VHp2K1ZSZVlaQS85NGs5VnMr?= =?utf-8?B?UjAzenVxQmVKdEJnWFBlYmMyWHViMmhUcDI2TjI0bG9yMzJDSlRlbUo5WFNB?= =?utf-8?B?aVpaTnZlMGljQ1VGR2JCY1BwN2xUMTUxZkZrOWlXd2krUk15eElVVTRhNGhz?= =?utf-8?B?WXhLSjZCbExaTVJyeDhnd05JV2JuWERMQmZGM3FTRW1SdDhvajFJeWdrOGM2?= =?utf-8?B?OWhlTktHeGgveDNlQlgyMDhreVNsTjd5TzdBZ0JPNUhGVHExdFd0c1EvQlhQ?= =?utf-8?B?S2dDK004dU1od3diQlltdmZjcFpsMjVyTVdXVGRZbm5QbWswNHRvT3lGQlpi?= =?utf-8?B?ZFhEYzdsRG01VTFoTUZrRmIzdERHc0tUMHo5M1lSdnhHbkkrWkdPK1A0ekc4?= =?utf-8?B?eW84SnJDYU5KSHhiemMrTUt2N3cyV2l4eE5rcGtpOVpNT1U0RVBCZzBwRFRn?= =?utf-8?B?dloyMlU4NExoaE5TNElBOXd1azBsaVJGSHBxT3VwYmRERHY1RTJlbDI4eEpC?= =?utf-8?B?dTJteEllSkc1MGIvazBWanE4R0RTdEQ1WXNUMlVaUlBKanZPS1RncFNzNU1y?= =?utf-8?B?OGJwZEVnUlpXWW1raVlGTjZFK3dQemNHRGwrdzVKUEJubHlmUmdIcDZFK1J3?= =?utf-8?B?MXFVNkdvVzNKeG9KcUhKRW5aSTFUZEtQdXhBQ3MzSTFJTC9YanJhaDdnQmdH?= =?utf-8?B?RXFPNkEweGw2UDByOUFXN0RtQk5ib2NsVnFNSS9uMENaM0RXVGFVWWF5VW9V?= =?utf-8?B?ZzE5NDd1S0pZZk81UzYzei82YW0vbkhsd2pXWHM3UGNoZ1JndmxVK0RjUWtp?= =?utf-8?B?TElzd2U3bWl6WGNnNnJDaXJxNUJHOGRpWGs2NnJTaWFvNm0zVURMbXZOdEJk?= =?utf-8?B?VU1PcmQyVXRkL1NrSERVWUxrb1ljYmhOYUJOQjE1MDFTdGtRZ0xJSkM4ekdZ?= =?utf-8?Q?hgRIptI49XA5qKWz3ndkWws=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: 6e6c1f6a-a795-4d73-35f3-08d9d4ecce75 X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5608.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Jan 2022 10:26:19.1886 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335836de-42ef-43a2-b145-348c2ee9ca5b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Pae7FinKtCxUIw1OfdeNiEMC2BW1VVxIH3zvwpNTcb98RiMZ1VD08aIMUaH/ovPTkZrK2fFLmLlBS0PHLPNpIg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR03MB4138 X-OriginatorOrg: citrix.com X-Rspamd-Queue-Id: 4JY6LD4h1Yz4pyX X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Tue, Jan 11, 2022 at 12:07:28PM +0200, Andriy Gapon wrote: > On 11/01/2022 11:50, Andriy Gapon wrote: > > > > Recently I got a report of crashes related to using procstat -k on one > > of our systems.  The system runs FreeBSD 12.2 on an AWS Xen-based > > instance (can get more specifics about it later). > > The instance type is t2.large. > Here are all lines from verbose boot that mention Xen: > > XEN: Hypervisor version 4.2 detected. > Disabling MSI-X interrupt migration due to Xen hypervisor bug. > XEN: disabling emulated disks > XEN: disabling emulated nics > Hypervisor: Origin = "XenVMMXenVMM" > x2APIC available but disabled due to running under XEN Thanks. I've asked someone at AWS for comments. I guess the only way to workaround this is to switch back to using the emulated APIC. I will try to prepare a patch later. Roger.