From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 18 10:21:29 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 39EC6E7B for ; Mon, 18 Nov 2013 10:21:29 +0000 (UTC) Received: from dub0-omc2-s22.dub0.hotmail.com (dub0-omc2-s22.dub0.hotmail.com [157.55.1.161]) by mx1.freebsd.org (Postfix) with ESMTP id D42A82D78 for ; Mon, 18 Nov 2013 10:21:28 +0000 (UTC) Received: from DUB114-W124 ([157.55.1.137]) by dub0-omc2-s22.dub0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Mon, 18 Nov 2013 02:20:21 -0800 X-TMN: [+Cw046ZaBtdk29Dtf8z9sjINZlg/cGxY] X-Originating-Email: [robert.sevat@live.nl] Message-ID: From: Robert Sevat To: "freebsd-hackers@freebsd.org" Subject: FreeBSD hangs during boot when assigned a controller via vt-d Date: Mon, 18 Nov 2013 11:20:20 +0100 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 18 Nov 2013 10:20:21.0209 (UTC) FILETIME=[C9578490:01CEE447] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.16 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Nov 2013 10:21:29 -0000 Greetings=2C I have a problem with forwarding an LSI 2308 via vt-d in KVM to a FreeBSD v= irtual machine. FreeBSD (9.2 and 10.0 beta 3) will=20 hang during the boot. Hardware Setup: Supermicro X10SL7-F with LSI 2308 flashed to IT mode 8x4 GB ecc ram Haswell Xeon E3-1230V3 Software Setup: Ubuntu 12.04.3 LTS 64 bit + latest KVM version. uname -a Linux Secretum 3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06= UTC 2013 x86_64 x86_64 x86_64 GNU/Linux dpkg --list | grep kvm=20 ii kvm 1:84+dfsg-0ubuntu16+1.0+noroms+0ubuntu14.12 dummy transiti= onal package from kvm to qemu-kvm ii kvm-ipxe 1.0.0+git-3.55f6c88-0ubuntu1 PXE ROM's for = KVM ii qemu-kvm 1.0+noroms-0ubuntu14.12 Full virtualiz= ation on i386 and amd64 hardware Under KVM I have the following 3 virtual machines installed=2C I have tried= forwarding the LSI 2308 to all three virtual machines.=20 It works perfectly under Ubuntu=2C but both FreeBSD vms will hang during th= e boot. FreeBSD 9.2 FreeBSD 10.0 beta 3 FreeBSD 10.0 live cd Ubuntu 12.04 LTS If I run FreeBSD 10.0 beta 3 directly on the hardware=2C it does recognize = the raid controller and it'll use the mps0 driver.=20 Everything works fine then. So the problem is that for some reason FreeBSD hangs during boot if you for= ward the LSI 2308 via vt-d=2C and I have no idea why. It will hang and give the following error: http://i.imgur.com/hAMxwR7.png http://i.imgur.com/rKALeXZ.png While doing so the FreeBSD virtual machine uses 300% cpu=2C so it maxes out= 3 cores. And it will stay like that. After googling a bit some people suggested turning off msi / msix in the lo= ader.conf hw.pci.enable_msi=3D"0" hw.pci.enable_msix=3D"0" I have tried this on both freebsd virtual machines=2C it makes no differenc= e. It still hangs. Could somebody point me in the right direction of what I could still try? S= hould I submit this as a bug? Should I ask this on another mailing list? Kind Regards Robert Sevat =