From owner-freebsd-virtualization@freebsd.org Sun Sep 18 02:31:36 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C3599BD6074 for ; Sun, 18 Sep 2016 02:31:36 +0000 (UTC) (envelope-from zhao6014@gmail.com) Received: from mail-yb0-x232.google.com (mail-yb0-x232.google.com [IPv6:2607:f8b0:4002:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7A977615 for ; Sun, 18 Sep 2016 02:31:36 +0000 (UTC) (envelope-from zhao6014@gmail.com) Received: by mail-yb0-x232.google.com with SMTP id x93so65839896ybh.1 for ; Sat, 17 Sep 2016 19:31:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=Fk9gxN2oaAqQncAUEhZFbE/edc+MgL7oRGkEuVZG5/Y=; b=z+IQxEJ2aRhlPOn4MHCYxNFJdKdS/v+t7WE44UPoZOI7mNcqUxQ7NjDaSjDG04YAiD dSi5dTBAfyGAIowdihzH7+/l92PPTtj23H8ATXG+qJ1nZhigZ8iHf4rLeyeXiEHgtlrD V1F6cwtCfichAFode1tbXnHyGrcLyc8HHFUPH3OU9jLMmqNW5JZ4m/t5bsV8gvT1FJ0V nhxYlL8DUPpwBwwrO+z1Q10V6UQ2P5HDNVQjNgCrLI3qahAEzZqxWZNC0r/WKvxfrgQD NhhZjHFfYoq+gvXq5B8dXYS7fF2ccpxQvcNwARrJxHnGBuDoGfILKfUdNI0CcX9bj+eK KxfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=Fk9gxN2oaAqQncAUEhZFbE/edc+MgL7oRGkEuVZG5/Y=; b=UWoYz6Z6H11ypuBWYKoJMW+dqmSn7hdDnIHsI1USkO2ite+CNAIR6O33fkyCTa63jC 3nlilxvxhF3/mGhirNMqgzGFt0lmE5ankx/H5SL7tnFo9bZtpR3ZLDQE1hVdfXWhckFb rpk/YAYe2jvfkseF5ImKg4duT0AwfCc+RkJRhwmOki9urBUDAE0HPsjHIylubeVPnYrB ygvr1xmYUn2X7HbqBmW6rA/tl/WLex9M3ywAGco1YigSaYCdFrQ4168Q8t54IpTh9gmO RZgXWo7GMe+clip2l2lqEwmwDhXvC0+uYTRQIId5E/CzuUPzxIzKFEAlNHZDPwi805xo NBDg== X-Gm-Message-State: AE9vXwN/Rmo7PT1LW24GHQ4sBI/EoqcZUkt/wCoYjnvJK2Ht6jlkRqPA8ySdPVK4+BNzQfqj2LqqRiCatEG8Rw== X-Received: by 10.37.197.138 with SMTP id v132mr4662380ybe.112.1474165895632; Sat, 17 Sep 2016 19:31:35 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.114.197 with HTTP; Sat, 17 Sep 2016 19:31:15 -0700 (PDT) In-Reply-To: References: From: Jov Date: Sun, 18 Sep 2016 10:31:15 +0800 Message-ID: Subject: Fwd: bhyve centos7-64 guest nvidia graphic card passthru get error when load nvidia driver To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Sep 2016 02:31:36 -0000 Subject: bhyve centos7-64 guest nvidia graphic card passthru get error when load nvidia driver To: freebsd-virtualization@freebsd.org lshw on guest: *-display UNCLAIMED description: VGA compatible controller product: GM107 [GeForce GTX 750] vendor: NVIDIA Corporation physical id: 6 bus info: pci@0000:00:06.0 version: a2 width: 64 bits clock: 33MHz capabilities: pm msi pciexpress vga_controller cap_list configuration: latency=0 resources: iomemory:d00-cff memory:c1000000-c1ffffff memory:c2000000-c3ffffff ioport:2080(size=128) memory:c0080000-c00fffff dmesg on centos7: dmesg | grep -i nv [ 0.762062] rtc_cmos 00:05: alarms up to one day, y3k, 114 bytes nvram [ 1.004666] nvidia: module license 'NVIDIA' taints kernel. [ 1.011149] nvidia: module verification failed: signature and/or required key missing - tainting kernel [ 1.020598] nvidia 0000:00:06.0: can't derive routing for PCI INT A [ 1.021759] nvidia 0000:00:06.0: PCI INT A: no GSI [ 1.022640] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: NVRM: BAR1 is 0M @ 0x0 (PCI:0000:00:06.0) [ 1.024828] NVRM: The system BIOS may have misconfigured your GPU. [ 1.026083] nvidia: probe of 0000:00:06.0 failed with error -1 [ 1.028015] nvidia-nvlink: Nvlink Core is being initialized, major device number 248 [ 1.030265] NVRM: The NVIDIA probe routine failed for 1 device(s). [ 1.031360] NVRM: None of the NVIDIA graphics adapters were initialized! [ 1.032688] nvidia-nvlink: Unregistered the Nvlink Core, major device number 248 [ 1.036132] NVRM: NVIDIA init module failed! [ 1.054519] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: I use vm-bhyve,the log is : Sep 17 17:40:00: initialising Sep 17 17:40:00: [loader: grub] Sep 17 17:40:00: [uefi: no] Sep 17 17:40:00: [cpu: 2] Sep 17 17:40:00: [memory: 4096M] Sep 17 17:40:00: [hostbridge: standard] Sep 17 17:40:00: [com ports: com1] Sep 17 17:40:00: [uuid: auto] Sep 17 17:40:00: [utctime: no] Sep 17 17:40:00: [debug mode: no] Sep 17 17:40:00: [primary disk: disk0.img] Sep 17 17:40:00: [primary disk dev: file] Sep 17 17:40:00: initialising network device tap0 Sep 17 17:40:00: adding tap0 -> bridge0 (public) Sep 17 17:40:00: booting Sep 17 17:40:00: create file /stage/vm/centos7/device.map Sep 17 17:40:00: -> (hd0) /stage/vm/centos7/disk0.img Sep 17 17:40:00: create file /stage/vm/centos7/grub.cfg Sep 17 17:40:00: -> timeout=3 Sep 17 17:40:00: -> menuentry 'centos7 (bhyve run)' { Sep 17 17:40:00: -> root=hd0,1 Sep 17 17:40:00: -> linux /vmlinuz-3.10.0-327.el7.x86_64 root=/dev/mapper/centos-root LANG=en_US.UTF-8 KEYTABLE=us SYSFONT=latarcyrheb-sun16 console=ttyS0 Sep 17 17:40:00: -> initrd /initramfs-3.10.0-327.el7.x86_64.img Sep 17 17:40:00: -> } Sep 17 17:40:00: /usr/local/sbin/grub-bhyve -c /dev/nmdm0A -S -m /stage/vm/centos7/device.map -M 4096M -r host -d /stage/vm/centos7 centos7 Sep 17 17:40:52: [bhyve options: -c 2 -m 4096M -AHP -S] Sep 17 17:40:52: [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/stage/vm/centos7/disk0.img -s 5:0,virtio-net,tap0,mac=58:9c:fc:00:7f:9b -s 6:0,passthru,1/0/0] Sep 17 17:40:52: [bhyve console: -l com1,/dev/nmdm0A] Sep 17 17:40:52: starting bhyve (run 1) when I try to load the nvidia driver manuly,the error message is : modprobe nvidia [58663.346487] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: [58663.346487] NVRM: BAR1 is 0M @ 0x0 (PCI:0000:00:06.0) [58663.353385] NVRM: The system BIOS may have misconfigured your GPU. [58663.357700] nvidia: probe of 0000:00:06.0 failed with error -1 [58663.360926] nvidia-nvlink: Nvlink Core is being initialized, major device number 248 [58663.364851] NVRM: The NVIDIA probe routine failed for 1 device(s). [58663.367189] NVRM: None of the NVIDIA graphics adapters were initialized! [58663.369472] nvidia-nvlink: Unregistered the Nvlink Core, major device number 248 [58663.372807] NVRM: NVIDIA init module failed! modprobe: ERROR: could not insert 'nvidia': No such device