From owner-freebsd-virtualization@freebsd.org Thu Oct 15 16:57:08 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2F6EA157B3 for ; Thu, 15 Oct 2015 16:57:08 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 6181417CA for ; Thu, 15 Oct 2015 16:57:08 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id 726E6114F8 for ; Fri, 16 Oct 2015 02:57:00 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 0BAE2280F54 for ; Fri, 16 Oct 2015 02:57:00 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Z8j8aUodhMBO for ; Fri, 16 Oct 2015 02:56:59 +1000 (AEST) Received: from Peters-MacBook-Pro.local (c-50-184-135-69.hsd1.ca.comcast.net [50.184.135.69]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 38BB12804DB; Fri, 16 Oct 2015 02:56:55 +1000 (AEST) Subject: Re: Illumos boot To: Matt Churchyard , Tycho Nightingale References: <17936712-FB88-4017-8C0D-BEC4926D698E@pluribusnetworks.com> <568ad0b2decf4537bff8f310a703c40b@SERVER.ad.usd-group.com> <83C11159-D5DE-4E02-972C-A66A80155EB8@pluribusnetworks.com> <051593da46cc417fa3e3b8fef3018746@SERVER.ad.usd-group.com> Cc: "freebsd-virtualization@freebsd.org" , Andriy Gapon From: Peter Grehan Message-ID: <561FDAD6.4030006@freebsd.org> Date: Thu, 15 Oct 2015 09:56:54 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <051593da46cc417fa3e3b8fef3018746@SERVER.ad.usd-group.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Oct 2015 16:57:08 -0000 Hi Matt, >> -s 0,hostbridge Things should work if you leave out the hostbridge. The PCIe capability that is tacked on to this will make Illumos use MSI/MSIx for the virtio adapter which apparently hits a bug in the driver. Without it, the virtio driver will fall back to legacy interrupts. This also means that the virtio adapter will be confined to slots 3/4/5/6. [root@smartos ~]# echo ::interrupts | mdb -k IRQ Vect IPL Bus Trg Type CPU Share APIC/INT# ISR(s) 1 0x40 5 ISA Edg Fixed 0 1 0x0/0x1 i8042_intr 3 0xb1 12 ISA Edg Fixed 0 1 0x0/0x3 asyintr 4 0xb0 12 ISA Edg Fixed 0 1 0x0/0x4 asyintr 9 0x81 9 PCI Lvl Fixed 1 1 0x0/0x9 acpi_wrapper_isr 12 0x41 5 ISA Edg Fixed 1 1 0x0/0xc i8042_intr 16 0x42 5 PCI Lvl Fixed 1 1 0x0/0x10 ahci_intr 17 0x43 5 PCI Lvl Fixed 0 1 0x0/0x11 ahci_intr 18 0x60 6 PCI Lvl Fixed 1 1 0x0/0x12 virtio_intx_dispatch 160 0xa0 0 Edg IPI all 0 - poke_cpu 208 0xd0 14 Edg IPI all 1 - kcpc_hw_overflow_intr 209 0xd1 14 Edg IPI all 1 - cbe_fire 210 0xd3 14 Edg IPI all 1 - cbe_fire 240 0xe0 15 Edg IPI all 1 - xc_serv 241 0xe1 15 Edg IPI all 1 - apic_error_intr (I believe Andriy Gapon (cc'd) has a fix for this in Illumos) later, Peter.