From owner-freebsd-virtualization@freebsd.org Tue Jun 19 16:45:14 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9A3981025989 for ; Tue, 19 Jun 2018 16:45:14 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from mail.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3CEB56A3D8 for ; Tue, 19 Jun 2018 16:45:14 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro-2.local (ralph.baldwin.cx [66.234.199.215]) by mail.baldwin.cx (Postfix) with ESMTPSA id 1F26C10AFD4 for ; Tue, 19 Jun 2018 12:45:13 -0400 (EDT) Subject: Re: bhyve panic on netcup root server (vmx enabled) From: John Baldwin To: freebsd-virtualization@freebsd.org References: <46c8809d-89d3-dbe5-bfd7-7add64ac7e84@bader-muenchen.de> Message-ID: <17d9d5b9-8928-866e-ba0f-fb2ba9c681e6@FreeBSD.org> Date: Tue, 19 Jun 2018 09:45:12 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.baldwin.cx); Tue, 19 Jun 2018 12:45:13 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.99.2 at mail.baldwin.cx X-Virus-Status: Clean X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2018 16:45:14 -0000 On 6/15/18 11:22 AM, John Baldwin wrote: > On 6/15/18 4:44 AM, richard bader wrote: >> Hi, >> >> i try to install a virtual host on a virtual root-server (netcup.de) >> >> I've enabled the VMX-Options on the root-server. >> >> I've followed the instruction from >> https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html >> >> on the root-server i've installed FreeBSD-11.1. >> >> but wenn starting the guest it panics: >> >> sh /usr/share/examples/bhyve/vmrun.sh -c 1 -m 5Gb -w -t tap0 -d >> guest.img -i -I FreeBSD-11.1-RELEASE-anly.iso test1 >> >> >> /boot/kernel/kernel text=0x14972f8 data=0x1384c0+0x4c15e8 >> syms=[0x8+0x15e8b0+0x8+0x178422] >> Booting... >> Copyright (c) 1992-2017 The FreeBSD Project. >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 >>         The Regents of the University of California. All rights reserved. >> FreeBSD is a registered trademark of The FreeBSD Foundation. >> FreeBSD 11.1-RELEASE #0 r321309: Fri Jul 21 02:08:28 UTC 2017 >>     root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >> FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on >> LLVM 4.0.0) >> VT(vga): text 80x25 >> CPU: Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz (2294.60-MHz K8-class CPU) >>   Origin="GenuineIntel"  Id=0x50654  Family=0x6  Model=0x55 Stepping=4 >> Features=0x1f83fbff >> Features2=0xfeda3203 >>   AMD Features=0x24100800 >>   AMD Features2=0x121 >>   Structured Extended >> Features=0x10010b38 >>   XSAVE Features=0x1 >> Hypervisor: Origin = "bhyve bhyve " >> real memory  = 6442450944 (6144 MB) >> avail memory = 5131386880 (4893 MB) >> Event timer "LAPIC" quality 600 >> ACPI APIC Table: >> panic: APIC: CPU with APIC ID 224 is not enabled >> cpuid = 0 >> KDB: stack backtrace: >> #0 0xffffffff80aada97 at kdb_backtrace+0x67 >> #1 0xffffffff80a6bb76 at vpanic+0x186 >> #2 0xffffffff80a6b9e3 at panic+0x43 >> #3 0xffffffff8101dc11 at madt_set_ids+0x91 >> #4 0xffffffff80a07c9c at mi_startup+0x9c >> #5 0xffffffff8030202c at btext+0x2c >> Uptime: 1s >> >> Any ideas to get it working or is it just not possible. > > This indicates a bug in the ACPI tables generated by bhyve to give to the > guest. Try setting the environment variable 'BHYVE_ACPI_KEEPTMPS=yes' > when running vmrun.sh and then look in /tmp for files named 'bhyve.*'. > If you can provide them via a URL or some such, I'm mostly interested in > the MADT table. I looked at the raw AML richard provided and it looked fine. :-/ In particular, the MADT only lists a single CPU with APIC ID of 0, so I'm not sure why it thinks there is a CPU with an APIC ID of 224. Can you do a 'boot -v' so I can see more messages from the MADT code while it is running? -- John Baldwin