From owner-freebsd-virtualization@freebsd.org Fri Mar 13 02:06:24 2020 Return-Path: Delivered-To: freebsd-virtualization@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47630271730 for ; Fri, 13 Mar 2020 02:06:24 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from vito.onthenet.com.au (vito.onthenet.com.au [203.22.124.72]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48dpvy5kTDz4f1p for ; Fri, 13 Mar 2020 02:06:22 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by vito.onthenet.com.au (Postfix) with ESMTPS id 82AE820D1599 for ; Fri, 13 Mar 2020 12:06:16 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id 6771C20B49B2 for ; Fri, 13 Mar 2020 12:06:16 +1000 (AEST) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 5B1D1208D487 for ; Fri, 13 Mar 2020 12:06:16 +1000 (AEST) Received: from iredmail.onthenet.com.au ([127.0.0.1]) by iredmail.onthenet.com.au (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 65n1VSKg65-b for ; Fri, 13 Mar 2020 12:06:16 +1000 (AEST) Received: from MacBook-Air-4.local (otn-120-29-62-248.broadband.onthenet.net [120.29.62.248]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id B1D6320C92F4; Fri, 13 Mar 2020 12:06:15 +1000 (AEST) Subject: Re: Passthru a VF to Windows guest cause BSOD, chelsio T520BT, SR-IOV To: =?UTF-8?B?6Yqt5LiH5qOa?= References: From: Peter Grehan Cc: FreeBSD virtualization Message-ID: <8357fd6d-d02d-76bb-712a-e5c330ecf434@freebsd.org> Date: Fri, 13 Mar 2020 12:06:14 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=UIBp4xXy c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=DPSYfp6L38iglyTf480Cpw==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=IkcTkHD0fZMA:10 a=SS2py6AdgQ4A:10 a=p1A8HRnZwKVOAvT7yiMA:9 a=QEXdDO2ut3YA:10 X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=d81BNirE c=1 sm=1 tr=0 a=eF5wA05EhuPcU0j7PNT2Vg==:117 a=DPSYfp6L38iglyTf480Cpw==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=IkcTkHD0fZMA:10 a=SS2py6AdgQ4A:10 a=p1A8HRnZwKVOAvT7yiMA:9 a=QEXdDO2ut3YA:10 X-Rspamd-Queue-Id: 48dpvy5kTDz4f1p X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-0.84 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.10)[0.101,0]; ASN(0.00)[asn:9313, ipnet:203.22.124.0/23, country:AU]; NEURAL_HAM_LONG(-0.94)[-0.940,0] X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2020 02:06:24 -0000 > When I pass the same VF1 to Windows 10 guest, ver 1909, the guest got > BSOD during installation. I also try to add VF1 post installation. > also got BSOD. > the message is IRQL_NOT_LESS_OR_EQUAL. > I also try Windows server 2012, during installation of Chelsio Driver, BSOD too. > > Any suggestions? driver issue or bhyve issue? Can you try disabling APIC acceleration (which should be available on that Xeon E5) ? This can be done on the fly using kenv and unloading/reloading vmm.ko (or loader.conf and rebooting) kenv hw.vmm.vmx.use_tpr_shadowing=0 kldunload vmm kldload vmm later, Peter.