From nobody Thu Feb 10 14:23:57 2022 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 25B7819C4887 for ; Thu, 10 Feb 2022 14:24:36 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-lj1-x22c.google.com (mail-lj1-x22c.google.com [IPv6:2a00:1450:4864:20::22c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JvfC72Jc5z4s3L for ; Thu, 10 Feb 2022 14:24:35 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: by mail-lj1-x22c.google.com with SMTP id k18so8190418lji.12 for ; Thu, 10 Feb 2022 06:24:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=30pYRoTid8Q41p/KVCvisIdsHSnOtLKLtokoQo2diTo=; b=JejhssG9Ju6JnX6IhTltdkNROivdxvIvVWH3WM017NTBMaE0HNC1oq/TlzkNpbH1l9 yKM+CJnqiy4AelDEjDWSWFxghWPkDpRPkfa43e8t6EYETme5pKORSJ/6qU7vO9yNqnO6 PI2/J5QtUHPn820a0mNhBzBBCXraMgfC/4Jj0PisTuHjWceX6lFgpWpWdSQt21lMZjxs jbMq6YVgQIk9RBr4HwO8Z7128Ek2rZ9v2tuFmmdouEpU5edOAIvONxyBjRG/Dw+BK6Am OhQVsN1vZY3eFc/BvpqeOJdfwA37NEGgZnIjJcVuLhoURW+V0xi6s+y0buaGJUA1qtrN T2IA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=30pYRoTid8Q41p/KVCvisIdsHSnOtLKLtokoQo2diTo=; b=ufr3Hi77lBOcBJ4S2qpsoJs0JQKxDQ/FzPnHxU0Lt9qR2zF+hWAtgUNudcoSQy/0pm mWojscMgQ2FiM2i43HQJCdkB/BHQyrEf6ljyeEKqur/+avjF6ZP/YojiWMYVDOJpg9/8 b+qgLFlKBxKty+K37qWlCazRQM01AvVvB72aiEf5KjgXH0ko1w2lS93wyLsih4spb8/1 YfherxQ2cgcBzYdwj4hGeXDQUVhwlLgSYuBWup9dwhfj7VSfw6qXU/iIkjudlTUzqOdO 7/DGlByIwGjknCqUiHqCpdF8KDF9L0Z/ry67sJq+eEAbxDFScu1oagDQIK0ezvjAnZd/ 8Qrg== X-Gm-Message-State: AOAM533uKKdr/uSeIXDIcxOmbQHQi61epg+KwHjS7dWP49tm0ipD+67g ZXXCTyl92cUA732FeB6KMnQrsc1cPnZ66rtSw0XZWCgp5R3qsA== X-Google-Smtp-Source: ABdhPJwQXPgAoYcGcHRDbcOlKVYoxNwQ/Dcl+ydwUaZqAxqtMfZsTtDzMpWeHoZkYGShms+Pjcu9XPOjokUdehbKeTE= X-Received: by 2002:a2e:a5cb:: with SMTP id n11mr4810056ljp.361.1644503073467; Thu, 10 Feb 2022 06:24:33 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 From: Mario Marietto Date: Thu, 10 Feb 2022 15:23:57 +0100 Message-ID: Subject: ERRATA CORRIGE "BUG !!!! X64 Exception Type - 06(#UD - Invalid Opcode) CPU Apic ID - 00000000 !!!! while trying to pass thru my devices with bhyve on FreeBSD 14-CURRENT" To: FreeBSD virtualization Content-Type: multipart/alternative; boundary="00000000000086b36905d7aab51c" X-Rspamd-Queue-Id: 4JvfC72Jc5z4s3L X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=JejhssG9; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2a00:1450:4864:20::22c as permitted sender) smtp.mailfrom=marietto2008@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; SUBJECT_HAS_EXCLAIM(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::22c:from]; HTTP_TO_IP(1.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --00000000000086b36905d7aab51c Content-Type: text/plain; charset="UTF-8" Hello. I've bought an additional PCI to USB (Renesas) controller that I've attached to the PCIe Gen3 x4 (Type 22110) of my MOBO Gigabyte Aorus Pro with Intel I9 chipset and Nvidia Geforce RTX 2080 ti. On this controller I've attached two USB disks and my KInect 2. The nVidia geforce RTX 2080 ti is attached to the PCIe Gen3 x 4 (Type 2280). Check this image : https://ibb.co/fC0jR1p check by yourself the logs showing that my passed through devices are working great : dmesg --> https://pastebin.ubuntu.com/p/cSy7jkHdZz/ pciconf -vl --> https://pastebin.ubuntu.com/p/xZNggrz6D5/ On FreeBSD 14 the bhyve setup below works. I can boot Linux passing through the devices that you see. But I have used a raw image file (not a physical installation on a sata or nvme disk,because in this case it wont work and for this I've opened another bug). With this I want to demonstrate that there aren't any problems with my bios settings and with my passed thru devices. bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H \ -s 0,hostbridge \ -s 1,virtio-blk,/mnt/da1p2/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img \ -s 3:0,passthru,2/0/0 \ -s 3:1,passthru,2/0/1 \ -s 3:2,passthru,2/0/2 \ -s 3:3,passthru,2/0/3 \ -s 4:0,passthru,1/0/0 \ -s 9,virtio-net,tap0 \ -s 29,fbuf,tcp=0.0.0.0:5900,w=1440,h=900 \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ -l com1,stdio \ vm0 My host graphic card is not an Nvidia card. It's the graphic chipset integrated on the motherboard (CoffeeLake-S GT2 [UHD Graphics 630); to use it I've installed the xf86-video-intel driver with this xorg.conf file : Section "Device" Identifier "Card0" Driver "intel" BusID "PCI:0:2:0" EndSection so,now,let's to straight to this problem : I've created a new VM with the goal to passthru my graphic card and my usb controller from the host os (freebsd 14-CURRENT) to the guest os (freebsd 13R p7) and I've used the parameters below : bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H -A \ -s 0,hostbridge \ -s 1,ahci-hd,/mnt/da2p2/bhyve/os/BSD/freebsd13vm.img \ -s 2,passthru,1/0/0 \ -s 3:0,passthru,2/0/0 \ -s 3:1,passthru,2/0/1 \ -s 3:2,passthru,2/0/2 \ -s 3:3,passthru,2/0/3 \ -s 8,virtio-net,tap1 \ -s 9,virtio-9p,sharename=/ \ -s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ -l com1,stdio \ vm1 inside /etc/rc.conf I've added the following parameters : linux_enable="YES" linux_mounts_enable="YES" vm_enable="YES" kdm5_enable="YES" dbus_enable="YES" sddm_enable="YES" on /boot/loader.conf : nvidia_load="YES" vmm_load="YES" nmdm_load="YES" if_tap_load="YES" if_bridge_load="YES" bridgestp_load="YES" linprocfs_load="YES" linsysfs_load="YES" tmpfs_load="YES" verbose_loading="YES" hw.vmm.topology.cores_per_package=8 kern.racct.enable=1 snd_hda_load="YES" on /etc/sysctl.conf net.link.tap.up_on_open=1 net.inet.ip.forwarding=1 net.inet.ip.random_id=1 kern.evdev.rcpt_mask=6 kern.init_shutdown_timeout="900" kern.capmode_coredump=1 and with this xorg.conf file : Section "ServerLayout" Identifier "X.org Configured" Screen 0 "Screen0" 0 0 #Screen 1 "Screen1" RightOf "Screen0" InputDevice "Mouse0" "CorePointer" InputDevice "Keyboard0" "CoreKeyboard" EndSection Section "Module" Load "glx" EndSection Section "Files" ModulePath "/usr/local/lib/xorg/modules" FontPath "/usr/local/share/fonts/misc/" FontPath "/usr/local/share/fonts/TTF/" FontPath "/usr/local/share/fonts/OTF/" FontPath "/usr/local/share/fonts/Type1/" FontPath "/usr/local/share/fonts/100dpi/" FontPath "/usr/local/share/fonts/75dpi/" FontPath "catalogue:/usr/local/etc/X11/fontpath.d" EndSection Section "InputDevice" Identifier "Mouse0" Driver "mouse" Option "Protocol" "auto" Option "Device" "/dev/sysmouse" Option "ZAxisMapping" "4 5 6 7" EndSection Section "Monitor" Identifier "Monitor0" VendorName "Monitor Vendor" ModelName "Monitor Model" EndSection Section "Device" ### Available Driver options are:- ### Values: : integer, : float, : "True"/"False", ### : "String", : " Hz/kHz/MHz", ### : "%" ### [arg]: arg optional #Option "SWcursor" # [] #Option "kmsdev" # #Option "ShadowFB" # [] #Option "AccelMethod" # #Option "PageFlip" # [] #Option "ZaphodHeads" # #Option "DoubleShadow" # [] #Option "Atomic" # [] Identifier "Card0" Driver "nvidia" BusID "PCI:0:4:0" EndSection this is what happens when I boot it : Loading kernel... /boot/kernel/kernel text=0x17b9e0 text=0xdd6d50 text=0x65ba0c data=0x140 data=0x1b9348+0x445cb8 syms=[0x8+0x178ed8+0x8+0x1990a2] Loading configured modules... snd_hda...if_bridge.../boot/kernel/if_bridge.ko size 0xfc48 at 0x2112000 loading required module 'bridgestp' /boot/kernel/bridgestp.ko size 0x8178 at 0x2122000 tmpfs.../boot/kernel/tmpfs.ko size 0x14820 at 0x212b000 /etc/hostid.../etc/hostid size=0x25 /boot/entropy.../boot/entropy size=0x1000 if_tap...linprocfs.../boot/kernel/linprocfs.ko size 0x10e50 at 0x2141000 loading required module 'linux_common' /boot/kernel/linux_common.ko size 0x2c650 at 0x2152000 nvidia.../boot/modules/nvidia.ko size 0x28c8640 at 0x217f000 loading required module 'linux' /boot/kernel/linux.ko size 0x9e070 at 0x4a48000 nmdm.../boot/kernel/nmdm.ko size 0x4110 at 0x4ae7000 bridgestp...linsysfs.../boot/kernel/linsysfs.ko size 0x79b8 at 0x4aec000 vmm.../boot/kernel/vmm.ko size 0x5748f0 at 0x4af4000 Start @ 0xffffffff8037c000 ... efi_check_space: Unable to expand staging area efi_check_space: Unable to expand staging area EFI framebuffer information: addr, size 0xc3000000, 0x1000000 dimensions 1440 x 900 stride 1440 masks 0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000 !!!! X64 Exception Type - 06(#UD - Invalid Opcode) CPU Apic ID - 00000000 !!!! RIP - 00000000000C000E, CS - 0000000000000038, RFLAGS - 0000000000010086 RAX - 0000000054A218D8, RCX - 0000000000000002, RDX - 0000000000000002 RBX - 0000000005069001, RSP - 00000000BFF58098, RBP - 00000000BFF58100 RSI - 0000000000001000, RDI - 0000000040001000 R8 - 0000000000000001, R9 - 00000000BFF580D8, R10 - 00000000B902D6E0 R11 - 0000000000000D80, R12 - 00000000BE819050, R13 - 0000000005069000 R14 - 00000000BE819058, R15 - 00000000BE819048 DS - 0000000000000030, ES - 0000000000000030, FS - 0000000000000030 GS - 0000000000000030, SS - 0000000000000030 CR0 - 0000000080010033, CR2 - 0000000000000000, CR3 - 00000000BFC01000 CR4 - 0000000000000668, CR8 - 0000000000000000 DR0 - 0000000000000000, DR1 - 0000000000000000, DR2 - 0000000000000000 DR3 - 0000000000000000, DR6 - 00000000FFFF0FF0, DR7 - 0000000000000400 GDTR - 00000000BFBEEA98 0000000000000047, LDTR - 0000000000000000 IDTR - 00000000BF832018 0000000000000FFF, TR - 0000000000000000 FXSAVE_STATE - 00000000BFF57CF0 !!!! Can't find image information. !!!! it freezes here and I can't do anything anymore. -- Mario. --00000000000086b36905d7aab51c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello.

=
I've bought an additional PCI to USB (Renesas) controller that I've attache= d to the PCIe Gen3 x4 (Type 22110) of my MOBO Gigabyte Aorus Pro with=20 Intel I9 chipset and Nvidia Geforce RTX 2080 ti. On this controller I'v= e attached two USB disks and my KInect 2. The nVidia geforce RTX 2080 ti=20 is attached to the PCIe Gen3 x 4 (Type 2280). Check this image : https://ibb.co/fC0jR1p
=
check by yourself the logs showing that my passed through devices are w= orking great :

dmesg --> https://pastebin.ubuntu.com/p/cSy7jkHdZz/
pciconf -vl -->
https://pastebin.ubuntu.com/p/xZNggrz6D5/

= On FreeBSD 14 the bhyve setup below works. I can boot Linux passing=20 through the devices that you see. But I have used a raw image file (not a physical installation on a sata or nvme disk,because in this case it=20 wont work and for this I've opened another bug). With this I want to=20 demonstrate that there aren't any problems with my bios settings and=20 with my passed thru devices.

bhyve -S -c sockets=3D2,cores=3D2,threa= ds=3D2 -m 8G -w -H \
-s 0,hostbridge \
-s 1,virtio-blk,/mnt/da1p2/bhy= ve/os/Linux/impish-cuda-11-5-nvidia-495.img \
-s 3:0,passthru,2/0/0 \-s 3:1,passthru,2/0/1 \
-s 3:2,passthru,2/0/2 \
-s 3:3,passthru,2/0/= 3 \
-s 4:0,passthru,1/0/0 \
-s 9,virtio-net,tap0 \
-s 29,fbuf,tcp= =3D0.0.0.0:5900,w=3D1= 440,h=3D900 \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/loca= l/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm0
=C2=A0My host graphic card is not an Nvidia card. It's the graphic chipset=20 integrated on the motherboard (CoffeeLake-S GT2 [UHD Graphics 630); to=20 use it I've installed the xf86-video-intel driver with this xorg.conf= =20 file :

Section "Device"
Identifier =C2=A0"Card0&qu= ot;
Driver =C2=A0 =C2=A0 =C2=A0"intel"
BusID =C2=A0 =C2=A0 = =C2=A0 "PCI:0:2:0"
EndSection

so,now,let's to strai= ght to this problem :

I've created a new VM with the goal to passthru my graphic card and my usb=20 controller from the host os (freebsd 14-CURRENT) to the guest os=20 (freebsd 13R p7) and I've used the parameters below :

bhyve -S -= c sockets=3D1,cores=3D2,threads=3D2 -m 4G -w -H -A \
-s 0,hostbridge \-s 1,ahci-hd,/mnt/da2p2/bhyve/os/BSD/freebsd13vm.img \
-s 2,passthru,1= /0/0 \
-s 3:0,passthru,2/0/0 \ =C2=A0 =C2=A0
-s 3:1,passthru,2/0/1 \=
-s 3:2,passthru,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 8,virtio-net,t= ap1 \
-s 9,virtio-9p,sharename=3D/ \
-s 29,fbuf,tcp=3D0.0.0.0:5901,w=3D1440,h=3D900,wait \=
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-= firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1

inside /etc/rc.co= nf I've added the following parameters :

linux_enable=3D"YE= S"
linux_mounts_enable=3D"YES"
vm_enable=3D"YES&q= uot;
kdm5_enable=3D"YES"
dbus_enable=3D"YES"
s= ddm_enable=3D"YES"

on /boot/loader.conf :

nvidia_lo= ad=3D"YES"
vmm_load=3D"YES"
nmdm_load=3D"YES= "
if_tap_load=3D"YES"
if_bridge_load=3D"YES"=
bridgestp_load=3D"YES"
linprocfs_load=3D"YES"linsysfs_load=3D"YES"
tmpfs_load=3D"YES"
verbose= _loading=3D"YES"
hw.vmm.topology.cores_per_package=3D8
kern= .racct.enable=3D1
snd_hda_load=3D"YES"

on /etc/sysctl.c= onf

net.link.tap.up_on_open=3D1
net.inet.ip.forwarding=3D1
net= .inet.ip.random_id=3D1
kern.evdev.rcpt_mask=3D6
kern.init_shutdown_ti= meout=3D"900"
kern.capmode_coredump=3D1

and with this x= org.conf file :

Section "ServerLayout"
=C2=A0 =C2=A0 = =C2=A0 =C2=A0Identifier =C2=A0 =C2=A0 "X.org Configured"
=C2= =A0 =C2=A0 =C2=A0 =C2=A0Screen =C2=A0 =C2=A0 =C2=A00 =C2=A0"Screen0&qu= ot; 0 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Screen =C2=A0 =C2=A0 =C2=A01 =C2=A0&= quot;Screen1" RightOf "Screen0"
=C2=A0 =C2=A0 =C2=A0 =C2= =A0InputDevice =C2=A0 =C2=A0"Mouse0" "CorePointer"
= =C2=A0 =C2=A0 =C2=A0 =C2=A0InputDevice =C2=A0 =C2=A0"Keyboard0" &= quot;CoreKeyboard"
EndSection

Section "Module"
= =C2=A0 =C2=A0 =C2=A0 =C2=A0Load =C2=A0"glx"
EndSection

= Section "Files"
=C2=A0 =C2=A0 =C2=A0 =C2=A0ModulePath =C2=A0 &= quot;/usr/local/lib/xorg/modules"
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPa= th =C2=A0 =C2=A0 "/usr/local/share/fonts/misc/"
=C2=A0 =C2=A0 = =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/local/share/fonts/TTF/"=
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/local/shar= e/fonts/OTF/"
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 &qu= ot;/usr/local/share/fonts/Type1/"
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPa= th =C2=A0 =C2=A0 "/usr/local/share/fonts/100dpi/"
=C2=A0 =C2= =A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/local/share/fonts/75dpi/= "
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "catalogue= :/usr/local/etc/X11/fontpath.d"
EndSection

Section "Inp= utDevice"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Identifier =C2=A0"Mouse0&= quot;
=C2=A0 =C2=A0 =C2=A0 =C2=A0Driver =C2=A0 =C2=A0 =C2=A0"mouse&= quot;
=C2=A0 =C2=A0 =C2=A0 =C2=A0Option =C2=A0 =C2=A0 =C2=A0"Protoc= ol" "auto"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Option =C2=A0 =C2= =A0 =C2=A0"Device" "/dev/sysmouse"
=C2=A0 =C2=A0 =C2= =A0 =C2=A0Option =C2=A0 =C2=A0 =C2=A0"ZAxisMapping" "4 5 6 7= "
EndSection

Section "Monitor"
=C2=A0 =C2=A0 = =C2=A0 =C2=A0Identifier =C2=A0 "Monitor0"
=C2=A0 =C2=A0 =C2=A0= =C2=A0VendorName =C2=A0 "Monitor Vendor"
=C2=A0 =C2=A0 =C2=A0= =C2=A0ModelName =C2=A0 =C2=A0"Monitor Model"
EndSection
Section "Device"
=C2=A0 =C2=A0 =C2=A0 =C2=A0### Available Dr= iver options are:-
=C2=A0 =C2=A0 =C2=A0 =C2=A0### Values: <i>: int= eger, <f>: float, <bool>: "True"/"False",=C2=A0 =C2=A0 =C2=A0 =C2=A0### <string>: "String", <fr= eq>: "<f> Hz/kHz/MHz",
=C2=A0 =C2=A0 =C2=A0 =C2=A0###= <percent>: "<f>%"
=C2=A0 =C2=A0 =C2=A0 =C2=A0### = [arg]: arg optional
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 &qu= ot;SWcursor" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0# [<bool>]
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 = "kmsdev" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0# <str>
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2= =A0 "ShadowFB" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0# [<bool>]
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 = =C2=A0 "AccelMethod" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 # <str>
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 &q= uot;PageFlip" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0# [<bool>]
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 = "ZaphodHeads" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 # = <str>
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "Doubl= eShadow" =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool&g= t;]
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "Atomic" = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<= ;bool>]
=C2=A0 =C2=A0 =C2=A0 =C2=A0Identifier =C2=A0"Card0"=
=C2=A0 =C2=A0 =C2=A0 =C2=A0Driver =C2=A0 =C2=A0 =C2=A0"nvidia"= ;
=C2=A0 =C2=A0 =C2=A0 =C2=A0BusID =C2=A0 =C2=A0 =C2=A0 "PCI:0:4:0&= quot;
EndSection

this is what happens when I boot it :

Loa= ding kernel...
/boot/kernel/kernel text=3D0x17b9e0 text=3D0xdd6d50 text= =3D0x65ba0c data=3D0x140 data=3D0x1b9348+0x445cb8 syms=3D[0x8+0x178ed8+0x8+= 0x1990a2]
Loading configured modules...
snd_hda...if_bridge.../boot/k= ernel/if_bridge.ko size 0xfc48 at 0x2112000
loading required module '= ;bridgestp'
/boot/kernel/bridgestp.ko size 0x8178 at 0x2122000
tm= pfs.../boot/kernel/tmpfs.ko size 0x14820 at 0x212b000
/etc/hostid.../etc= /hostid size=3D0x25
/boot/entropy.../boot/entropy size=3D0x1000
if_ta= p...linprocfs.../boot/kernel/linprocfs.ko size 0x10e50 at 0x2141000
load= ing required module 'linux_common'
/boot/kernel/linux_common.ko = size 0x2c650 at 0x2152000
nvidia.../boot/modules/nvidia.ko size 0x28c864= 0 at 0x217f000
loading required module 'linux'
/boot/kernel/l= inux.ko size 0x9e070 at 0x4a48000
nmdm.../boot/kernel/nmdm.ko size 0x411= 0 at 0x4ae7000
bridgestp...linsysfs.../boot/kernel/linsysfs.ko size 0x79= b8 at 0x4aec000
vmm.../boot/kernel/vmm.ko size 0x5748f0 at 0x4af4000
= Start @ 0xffffffff8037c000 ...
efi_check_space: Unable to expand staging= area
efi_check_space: Unable to expand staging area
EFI framebuffer = information:
addr, size =C2=A0 =C2=A0 0xc3000000, 0x1000000
dimension= s =C2=A0 =C2=A0 1440 x 900
stride =C2=A0 =C2=A0 =C2=A0 =C2=A0 1440
ma= sks =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00x00ff0000, 0x0000ff00, 0x000000ff, 0= xff000000
!!!! X64 Exception Type - 06(#UD - Invalid Opcode) =C2=A0CPU A= pic ID - 00000000 !!!!
RIP =C2=A0- 00000000000C000E, CS =C2=A0- 00000000= 00000038, RFLAGS - 0000000000010086
RAX =C2=A0- 0000000054A218D8, RCX - = 0000000000000002, RDX - 0000000000000002
RBX =C2=A0- 0000000005069001, R= SP - 00000000BFF58098, RBP - 00000000BFF58100
RSI =C2=A0- 00000000000010= 00, RDI - 0000000040001000
R8 =C2=A0 - 0000000000000001, R9 =C2=A0- 0000= 0000BFF580D8, R10 - 00000000B902D6E0
R11 =C2=A0- 0000000000000D80, R12 -= 00000000BE819050, R13 - 0000000005069000
R14 =C2=A0- 00000000BE819058, = R15 - 00000000BE819048
DS =C2=A0 - 0000000000000030, ES =C2=A0- 00000000= 00000030, FS =C2=A0- 0000000000000030
GS =C2=A0 - 0000000000000030, SS = =C2=A0- 0000000000000030
CR0 =C2=A0- 0000000080010033, CR2 - 00000000000= 00000, CR3 - 00000000BFC01000
CR4 =C2=A0- 0000000000000668, CR8 - 000000= 0000000000
DR0 =C2=A0- 0000000000000000, DR1 - 0000000000000000, DR2 - 0= 000000000000000
DR3 =C2=A0- 0000000000000000, DR6 - 00000000FFFF0FF0, DR= 7 - 0000000000000400
GDTR - 00000000BFBEEA98 0000000000000047, LDTR - 00= 00000000000000
IDTR - 00000000BF832018 0000000000000FFF, =C2=A0 TR - 000= 0000000000000
FXSAVE_STATE - 00000000BFF57CF0
!!!! Can't find ima= ge information. !!!!

it freezes here and I can't do anything any= more.

--
Mario.
--00000000000086b36905d7aab51c--