From nobody Wed Feb 1 12:48:58 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4P6MDw3kGWz3c7vK for ; Wed, 1 Feb 2023 12:49:20 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (2403-5800-5200-4700-225-90ff-fe47-39b4.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:225:90ff:fe47:39b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "dons.net.au", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4P6MDv5fpXz46sm for ; Wed, 1 Feb 2023 12:49:19 +0000 (UTC) (envelope-from darius@dons.net.au) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (2403-5800-5200-4700-74ab-27d6-db94-a375.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:74ab:27d6:db94:a375]) (authenticated bits=0) by midget.dons.net.au (8.17.1/8.15.2) with ESMTPSA id 311Cn9Wi051804 (version=TLSv1.2 cipher=ECDHE-ECDSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 1 Feb 2023 23:19:09 +1030 (ACDT) (envelope-from darius@dons.net.au) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=dons.net.au; s=default; t=1675255749; bh=rOE7948BtWytbyWOEfSYaXkoWD8lu3te/wgaifMsVPY=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=A8otQApg43oV0ObsIwRqH1PPngYBkFlExzFh/uwF4PcY8D0wij0qe2H5Ph420DFuG uK2c78KeAtNwBep3lPdle2PW9wMF6nAlm6q1nqSTB8D40krTjMSMPdV21FjnD3S3kh W5W70FpBiUDVGa9uU6iHFxSTilPlq1qpkEgz1NWw= X-Authentication-Warning: midget.dons.net.au: Host 2403-5800-5200-4700-74ab-27d6-db94-a375.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:74ab:27d6:db94:a375] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: devctl: Failed to detach pci0:1:0:0: Device busy / devctl: Failed to set pci0:1:0:0 driver to ppt: Device busy From: "Daniel O'Connor" In-Reply-To: Date: Wed, 1 Feb 2023 23:18:58 +1030 Cc: freebsd-hackers Content-Transfer-Encoding: quoted-printable Message-Id: <128F6D81-D71B-4BC7-9143-8205E826088F@dons.net.au> References: <09A3D05B-E269-437F-8ACB-A150EBCACF4E@dons.net.au> To: Mario Marietto X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spam-Status: No, score=0.40 X-Rspamd-Server: midget.dons.net.au X-Rspamd-Queue-Id: 4P6MDv5fpXz46sm X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800::/32, country:AU] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On 1 Feb 2023, at 21:41, Mario Marietto = wrote: > ---> Do you have 'vmm_load=3D"YES"' in loader.conf ? >=20 > yes. >=20 > ---> If you want to pass through the video card (as evidenced by = devctl and pptdevs) then why have the nvidia driver installed? >=20 > because I have 3 gpus on my PC. I use the intel gpu on the host ; I = would like to use the nvidia gtx 1060 within a bhyve Linux vm and the = 2080 ti with the Linuxulator to run stable diffusion,or vice versa. = Stable diffusion needs pytorch + cuda and they need the nVidia driver = installed on FreeBSD and the modules loaded. >=20 > My goal is to run stable diffusion and a bhyve / linux vm +my nvidia = gpus attached. I note that https://wiki.freebsd.org/bhyve/pci_passthru says "Note: VGA = / GPU pass-through devices are not currently supported" so perhaps that = is why it is ignoring your pptdevs line. Although that said some googling suggests that is not the case so I = don't know, unfortunately I haven't tried it myself. There are some threads about it on the forums, eg: https://forums.freebsd.org/threads/bhyve-gpu-pass-through.83152/ Those suggest that modifications to bhyve are required before it will = work properly but none of them are for vmm that I can see. -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum