From owner-freebsd-virtualization@freebsd.org Fri Jan 13 15:47:24 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2BCC7CAD378 for ; Fri, 13 Jan 2017 15:47:24 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E40061335; Fri, 13 Jan 2017 15:47:23 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id v0DFlFVp054298; Fri, 13 Jan 2017 07:47:15 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id v0DFlEjt054297; Fri, 13 Jan 2017 07:47:14 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201701131547.v0DFlEjt054297@pdx.rh.CN85.dnsmgr.net> Subject: Re: Issues with GTX960 on CentOS7 using bhyve PCI passthru (FreeBSD 11-RC2) In-Reply-To: <20170113001737.5fe3001b@mscad14> To: soralx@cydem.org Date: Fri, 13 Jan 2017 07:47:14 -0800 (PST) CC: grehan@freebsd.org, freebsd-virtualization@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2017 15:47:24 -0000 ... > > > - Performance State : P0 > > > + Performance State : P8 > > > > Note sure what's happening here. > > Driver not kicking the card's BIOS into the right mode > to switch to dynamic power state selection? I suspect this is a failure to run the BIOS code that enables the secondary power connector so you can come out of slot only power mode. > > > Jan 11 11:34:49 fbsd12tst kernel: nvidia-modeset: ERROR: GPU:0: > > > Display engine push buffer channel allocation failed Jan 11 11:34:49 > > > fbsd12tst kernel: nvidia-modeset: ERROR: GPU:0: Failed to allocate > > > display engine core DMA push buffer > > > > Not sure what's happening with those. > > > > Would it be possible to try the nouveau driver ? At least the source > > is available, so it may be easier to determine what is broken. > > I could, but for now I'd like to focus more on AMD card > (which also has an open-source driver). The general rule on other platforms is that ATI/AMD cards tend to just work, where as the NVidia cards are very picky and unless official listed as known to work when passed through you well fight problems. Very few cards are listed as known to work, most populars being the Quadro 2000, and the Quadro FX3800. Many cards are listed as known to NOT work. ... GOOD WORK on getting as far as you have as quickly as you have! Note that the https://wiki.freebsd.org/bhyve/pci_passthru has had a small update to reflect we know that VGA passthrough is not working at this time. Also a note about AMD IOmmu/AMD-Vi was added, hopefully saving someone from duplicate work. -- Rod Grimes rgrimes@freebsd.org