From owner-freebsd-virtualization@freebsd.org Wed Jan 11 19:44:04 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2A275CAB791 for ; Wed, 11 Jan 2017 19:44:04 +0000 (UTC) (envelope-from kmacybsd@gmail.com) Received: from mail-lf0-f44.google.com (mail-lf0-f44.google.com [209.85.215.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C66C210B5 for ; Wed, 11 Jan 2017 19:44:03 +0000 (UTC) (envelope-from kmacybsd@gmail.com) Received: by mail-lf0-f44.google.com with SMTP id m78so122619158lfg.2 for ; Wed, 11 Jan 2017 11:44:03 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=aK91yyHRJQiti0zhaBnFKJYBReiVJWeQam1kJWEVUJw=; b=L1iEC+flMBjASfBzMz84wZi2sJIv/8UfzfplKhzDlTZl1kQIsWKeDXNuqbsHtoaW1i 8M1wxQ0yrvDTjQrffH4Mqz+A1OUmMyDPEiBcSsgiYZLCZdfJGrSG0UA2oANdEJhC5bs/ x3BfAyuiZR/lgierGMcd1YKjRei9AsdIl/ViYReSIOqOlTzBl/XTAx8ebFXODoB4avuR 4G6uTMTxWXaxJzEtvcpwqGCoJoo2Sgb5OKbMgz5ftZmXk2DoEzhdmBTUEmLnEV0DStVf OG6nxWrMZIOfV2GDjNShqE4kH8k850svZ26nz8p724gv+r4u2u6FcbpS4MCYr+Fpr+iU 0MXg== X-Gm-Message-State: AIkVDXJws+4ldO2gQWeKRRbS+C4sr4rj+kJ+hsfoO+sCAXQ9XLuSy8Z27/Tw2UBB8x/zkk/2+VVbzUejRQoxlA== X-Received: by 10.46.8.2 with SMTP id 2mr3759985lji.55.1484163431959; Wed, 11 Jan 2017 11:37:11 -0800 (PST) MIME-Version: 1.0 References: <20170110003332.7cf8ba15@mscad14> <0de7e0fe-5680-b1be-bd57-6bf446c2fd38@talk2dom.com> <0c927784-3e3f-7946-fba9-c25001f4156c@talk2dom.com> <20170110180117.7f246b5a@mscad14> <75abdb83-8902-1c6e-e881-5af24e5bba05@talk2dom.com> In-Reply-To: <75abdb83-8902-1c6e-e881-5af24e5bba05@talk2dom.com> From: "K. Macy" Date: Wed, 11 Jan 2017 19:37:01 +0000 Message-ID: Subject: Re: Issues with GTX960 on CentOS7 using bhyve PCI passthru (FreeBSD 11-RC2) To: Dom , soralx@cydem.org Cc: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 19:44:04 -0000 Is the VM checking documented in the driver notes somewhere? I have a Titan X that I need to run CUDA on and would be much happier if I didn't have to actually switch back and forth between FreeBSD and Ubuntu on my desktop. Are we new fairly certain that this won't work? (Yet another reason to go with AMD if they ever deliver on ROCm) On Wed, Jan 11, 2017 at 05:53 Dom wrote: > On 11/01/2017 02:01, soralx@cydem.org wrote: > > > Dom wote: > > >> There doesn't seem to be support for CPUID 0x40000001 in bhyve either. > > > What is it supposed to do? > > > > As far as I can tell it's the Hypervisor extension flags list. The lack > > of these extensions/optimisations might explain why your FreeBSD VM runs > > slow but their presence also causes the nVidia driver to refuse to run. > > (Can't remember where I read this, sorry) > > > > With your change to PCI_EMUL_MEMBASE64 I can boot a CentOS VM without > > the "pci=nocrs" kernel option and nVidia card is assigned BARs without > > issue. > > > > However, even with reapplying the changes to vmm.ko to hide/remove the > > 0x40000000 CPUID support and CPUID2_HV, I still have the same > > "RmInitAdapter failed" issue. > > > > Allegedly[0] nVidia VM checking came in with driver version 337.88, with > > more checking after version 344.11. I couldn't install version 319 as it > > failed to build the Linux kernel module. I currently have 370.28 > > installed which supports both my GT610 and my GTX960. > > > > Maybe the next thing for me to try is to replicate your tests with a > > FreeBSD VM. > > > > [0] https://ubuntuforums.org/showthread.php?t=2266916 search for > > "337.88" > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > >