From owner-freebsd-virtualization@freebsd.org Thu Oct 15 17:25:48 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C2567A15DB4 for ; Thu, 15 Oct 2015 17:25:48 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from smtp-outbound.userve.net (smtp-outbound.userve.net [217.196.1.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.userve.net", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6CA67FA5; Thu, 15 Oct 2015 17:25:47 +0000 (UTC) (envelope-from matt.churchyard@userve.net) Received: from owa.usd-group.com (owa.usd-group.com [217.196.1.2]) by smtp-outbound.userve.net (8.15.1/8.15.1) with ESMTPS id t9FHPbI5027888 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=FAIL); Thu, 15 Oct 2015 18:25:40 +0100 (BST) (envelope-from matt.churchyard@userve.net) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=userve.net; s=201508; t=1444929940; bh=GWFJontVuno0htYgnxUDqzJPmw4ieq+F6tzXITUUl3Y=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=g5xXIQFWfRmQL4z8/AzqttGRfJohaVmFxnSViohOQm9KYd5fnYfHI4qmpSGuNPTLn IlaW6PBa2ARoqRf8y6nYSgfGJ8EnUQ125gU6TQr0JuffWPaz4aCvaWmXqd8NJV6rSl uBPOaIhaUvPWhVBGc30z0XTYFVwRsvTgbgJawsqY= Received: from SERVER.ad.usd-group.com (192.168.0.1) by SERVER.ad.usd-group.com (192.168.0.1) with Microsoft SMTP Server (TLS) id 15.0.847.32; Thu, 15 Oct 2015 18:25:31 +0100 Received: from SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9]) by SERVER.ad.usd-group.com ([fe80::b19d:892a:6fc7:1c9%12]) with mapi id 15.00.0847.030; Thu, 15 Oct 2015 18:25:31 +0100 From: Matt Churchyard To: Peter Grehan CC: "freebsd-virtualization@freebsd.org" Subject: RE: Illumos boot Thread-Topic: Illumos boot Thread-Index: AdEFpuLuEiXyF4rFT0iOg0wo9KoWVQABU0uAAAObRxAADlSqgABK4nfwABCovQAAAue4ig== Date: Thu, 15 Oct 2015 17:25:30 +0000 Message-ID: References: <17936712-FB88-4017-8C0D-BEC4926D698E@pluribusnetworks.com> <568ad0b2decf4537bff8f310a703c40b@SERVER.ad.usd-group.com> <83C11159-D5DE-4E02-972C-A66A80155EB8@pluribusnetworks.com> <051593da46cc417fa3e3b8fef3018746@SERVER.ad.usd-group.com>, <561FDAD6.4030006@freebsd.org> In-Reply-To: <561FDAD6.4030006@freebsd.org> Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [89.145.244.131] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Oct 2015 17:25:49 -0000 =0A= =0A= >> -s 0,hostbridge=0A= =0A= > Things should work if you leave out the hostbridge. The PCIe=0A= > capability that is tacked on to this will make Illumos use MSI/MSIx for= =0A= > the virtio adapter which apparently hits a bug in the driver. Without=0A= > it, the virtio driver will fall back to legacy interrupts. This also=0A= > means that the virtio adapter will be confined to slots 3/4/5/6.=0A= =0A= > [root@smartos ~]# echo ::interrupts | mdb -k=0A= > IRQ Vect IPL Bus Trg Type CPU Share APIC/INT# ISR(s)=0A= > 1 0x40 5 ISA Edg Fixed 0 1 0x0/0x1 i8042_intr=0A= > 3 0xb1 12 ISA Edg Fixed 0 1 0x0/0x3 asyintr=0A= > 4 0xb0 12 ISA Edg Fixed 0 1 0x0/0x4 asyintr=0A= > 9 0x81 9 PCI Lvl Fixed 1 1 0x0/0x9 acpi_wrapper_isr=0A= > 12 0x41 5 ISA Edg Fixed 1 1 0x0/0xc i8042_intr=0A= > 16 0x42 5 PCI Lvl Fixed 1 1 0x0/0x10 ahci_intr=0A= > 17 0x43 5 PCI Lvl Fixed 0 1 0x0/0x11 ahci_intr=0A= > 18 0x60 6 PCI Lvl Fixed 1 1 0x0/0x12 virtio_intx_dispatch= =0A= > 160 0xa0 0 Edg IPI all 0 - poke_cpu=0A= > 208 0xd0 14 Edg IPI all 1 - kcpc_hw_overflow_intr= =0A= > 209 0xd1 14 Edg IPI all 1 - cbe_fire=0A= > 210 0xd3 14 Edg IPI all 1 - cbe_fire=0A= > 240 0xe0 15 Edg IPI all 1 - xc_serv=0A= > 241 0xe1 15 Edg IPI all 1 - apic_error_intr=0A= =0A= =0A= > (I believe Andriy Gapon (cc'd) has a fix for this in Illumos)=0A= =0A= > later,=0A= =0A= > Peter.=0A= =0A= Thanks Peter. I can't believe how many times I checked you Illumos instruct= ions making sure there were no obvious differences, and didn't notice the h= ostbridge was missing. I think I just had it in my mind that the hostbridge= was a basic required device.=0A= =0A= Regards=0A= Matt=