From owner-freebsd-virtualization@FreeBSD.ORG Thu Jul 19 23:55:13 2012 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE74D106564A for ; Thu, 19 Jul 2012 23:55:13 +0000 (UTC) (envelope-from sree.openwrk@gmail.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 65A5A8FC14 for ; Thu, 19 Jul 2012 23:55:13 +0000 (UTC) Received: by obbun3 with SMTP id un3so5261680obb.13 for ; Thu, 19 Jul 2012 16:55:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=iJMC6UaBbPyEBo6xKpxSlUkon5mjIYI18VKSgpSUQC0=; b=Wzg7npd1yVBHZcW15kyyrKsaqAmd3ml9vfMnkNvg5EUnOw9kgldzLbNvMo+Rwout3V Ap1m8fC9ZLZsPWODKuR1DlBHHXL4QzlImHz4QYSsXIZOe555yLdmM4QvUbguLGJnewph ahVuOatozyy1J/f7Rbk51A0QE7fCjbeFytTyaVfl7PSNNGrp39gizuNVYXp/ztj7dZb5 IwLwHIzeQGvUdpHRlfcQr4q1K4rp0EJedAvHPp/3y/Ac409b8TbTrPUdDvglOC4H1ZHS ON38dPzltPYMl1vWgHnP92E7PjQbSduaoCtcpyTxVxWMuDPmpHXVrzmgB3P/dmffKxsM j9Qg== MIME-Version: 1.0 Received: by 10.60.2.131 with SMTP id 3mr4258889oeu.59.1342742106852; Thu, 19 Jul 2012 16:55:06 -0700 (PDT) Received: by 10.60.147.164 with HTTP; Thu, 19 Jul 2012 16:55:06 -0700 (PDT) In-Reply-To: References: Date: Thu, 19 Jul 2012 16:55:06 -0700 Message-ID: From: "sree.openwrk" To: Neel Natu Content-Type: multipart/mixed; boundary=e89a8f643d9a4dcd2e04c5378234 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-virtualization@freebsd.org Subject: Re: Bhyve - Host kernel panic after running 'kldload vmm' X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 23:55:13 -0000 --e89a8f643d9a4dcd2e04c5378234 Content-Type: text/plain; charset=ISO-8859-1 Hi I have hit another road block while trying to run the guest using bhyve. These are the steps I followed. I have used http://people.freebsd.org/~neel/bhyve/bhyve_instructions.txt as the reference for preparing and running guest. 1. As posted in my previous e-mail, I installed FreeBSD 9 and then checked out /projects/bhyve and installed the world and kernel from that. Later I am going to use the same kernel, (built from /projects/bhyve, thats used to update from Freebsd-9 to latest in /projects/bhyve) for the guest in step 9. Also the virtio kernel modules I use in step 9 are from the ones built from /projects/bhyve. 2. I have 8gb ram and I have set aside 4gb for the vms. sysctl -a | grep hw.physmem hw.physmem: 3185541120 3. I have successfully performed upto step 7 in http://people.freebsd.org/~neel/bhyve/bhyve_instructions.txt. 4. Skipped step 8, as I plan to use virtio built from the latest code from /projects/bhyve (As part of updating the host freebsd to the latest source in /projects/bhyve, as mentioned above, I also made the virtio modules.) 5. Created vm1 directory in /usr/share and created all its sub-directories and their contents. I copied only the mdroot file from http://people.freebsd.org/~neel/bhyve/vm1.tar.gz. (remember that I copied /boot/kernel (i.e. host kernel) as the guest kernel) 6. Then cd to /usr/share/vm1 and execute './vmrun.sh vm1'. After the freebsd boot loader prompy comes up for the guest, after I hit enter, I get segfaulted with core. I am attaching herewith the backtrace of the core. Also I am pasting below the loader.conf file witihn /usr/share/vm1/boot. Any idea what is happening? Also is there any easy way to configure and run the guest, after building the host kernel with bhyve hypervisor? loader.conf ------------------- kernel="/kernel" virtio_load="YES" if_vtnet_load="YES" virtio_pci_load="YES" virtio_blk_load="YES" kern.hz="100" hw.pci.enable_msix="0" hw.pci.honor_msi_blacklist="0" bootverbose="1" mfsroot_load="YES" mfsroot_type="mfs_root" mfsroot_name="mdroot" Thanks On Wed, Jul 18, 2012 at 11:17 AM, sree.openwrk wrote: > Hey Neel > Thanks for the immediate reply. > I found that the BIOS did not have vm-x and vt-d enabled and luckily > enabling them fixed the issue. > Now I am able to load the vmm module and its not throwing any error as of > now. > > Thanks > > > On Tue, Jul 17, 2012 at 10:07 PM, Neel Natu wrote: > >> Hi, >> >> On Tue, Jul 17, 2012 at 9:12 PM, s vas wrote: >> > Hi >> > I have a kernel panic when loading bhyve hypervisor kernel module. >> > These are the steps I followed >> > 1. First I installed Freebsd 9 on my machine which has Intel-x86_64 and >> 8Gb >> > Ram >> > 2. The following output from dmesg.boot confirm that vmx is enabled in >> the >> > machine. >> > PU: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz (2394.06-MHz >> K8-class >> > CPU) >> > Origin = "GenuineIntel" Id = 0x20655 Family = 6 Model = 25 >> Stepping = >> > 5 >> > >> > >> Features=0xbfebfbff >> > >> > >> Features2=0x29ae3ff >> > AMD Features=0x28100800 >> > AMD Features2=0x1 >> > TSC: P-state invariant, performance statistics >> > >> > 3. Then I checked out the latest code from svn:// >> > svn.freebsd.org/base/projects/bhyve/ >> > a) I built world and kernel >> > b) Followed the steps in >> > >> http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/makeworld.html >> > (25.7.1 >> > The Canonical Way to Update Your System) to install the new kernel and >> to >> > install the new world. >> > c) Rebooted to the newly built kernel. >> > 4. I wanted to give 4gb to the host kernel and the remaining memory for >> the >> > guest. So I set hw.physmem to "0x100000000". >> > 5. Rebooted the host so that hw.physmem takes effect (Following >> > http://people.freebsd.org/~neel/bhyve/bhyve_instructions.txt) >> > a) This is the sysctl output >> > sysctl -a | grep hw.physmem >> > hw.physmem: 3185545216 >> > cat /boot/loader.conf >> > hw.physmem="0x100000000" >> > 6. Then executed 'kldload vmm'. Got kernel panic with the following >> trace >> > >> > ----- >> > #0 - #8 is panic related call trace.... >> > ........ >> >> Could you provide the stack frames above vmx_enable()? >> >> It is unclear from the subset of stack frames provided here as to what >> the cause of the panic is. >> >> best >> Neel >> >> > #9 0xffffffff8189b91f in vmx_enable (arg=Variable "arg" is not >> available. >> > ) at vmx_cpufunc.h:65 >> > #10 0xffffffff808b9e5d in smp_rendezvous_action () >> > at /media/fbsd_part2/bhyve/bhyve/ >> > sys/kern/subr_smp.c:381 >> > #11 0xffffffff80b5f0c5 in Xrendezvous () at apic_vector.S:342 >> > #12 0xffffffff80b58e86 in acpi_cpu_c1 () >> > at /media/fbsd_part2/bhyve/bhyve/sys/amd64/acpica/acpi_machdep.c:97 >> > #13 0xffffffff803467ce in acpi_cpu_idle () >> > at /media/fbsd_part2/bhyve/bhyve/sys/dev/acpica/acpi_cpu.c:967 >> > #14 0xffffffff80b622b5 in cpu_idle_acpi (busy=Variable "busy" is not >> > available. >> > ) >> > at /media/fbsd_part2/bhyve/bhyve/sys/amd64/amd64/machdep.c:689 >> > #15 0xffffffff80b64ab8 in cpu_idle (busy=0) >> > at /media/fbsd_part2/bhyve/bhyve/sys/amd64/amd64/machdep.c:843 >> > #16 0xffffffff8089ed21 in sched_idletd (dummy=Variable "dummy" is not >> > available. >> > ) >> > at /media/fbsd_part2/bhyve/bhyve/sys/kern/sched_ule.c:2583 >> > #17 0xffffffff80846835 in fork_exit ( >> > callout=0xffffffff8089eae0 , arg=0x0, >> > frame=0xffffff800023cc40) >> > at /media/fbsd_part2/bhyve/bhyve/sys/kern/kern_fork.c:992 >> > #18 0xffffffff80b5e55e in fork_trampoline () >> > at /media/fbsd_part2/bhyve/bhyve/sys/amd64/amd64/exception.S:602 >> > >> > I am attaching herewith the text core as well as the info. Can someone >> tell >> > me whats happening? >> > >> > _______________________________________________ >> > freebsd-virtualization@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> > To unsubscribe, send any mail to " >> freebsd-virtualization-unsubscribe@freebsd.org" >> > >> > > --e89a8f643d9a4dcd2e04c5378234 Content-Type: text/plain; charset=US-ASCII; name="bhyveload_core_bt.txt" Content-Disposition: attachment; filename="bhyveload_core_bt.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_h4uhua060 IzAgIDB4MDAwMDAwMDgzMTgxMzVhZiBpbiBmaWNsRXhlY0MgKCkgZnJvbSAvYm9vdC91c2VyYm9v dC5zbwojMSAgMHgwMDAwMDAwODMxODFiMWYxIGluIGZpY2xUaWNrICgpIGZyb20gL2Jvb3QvdXNl cmJvb3Quc28KIzIgIDB4MDAwMDAwMDgzMTgxMzVjMSBpbiBmaWNsRXhlY0MgKCkgZnJvbSAvYm9v dC91c2VyYm9vdC5zbwojMyAgMHgwMDAwMDAwODMxODA2YmU5IGluIGJmX3J1biAoKSBmcm9tIC9i b290L3VzZXJib290LnNvCiM0ICAweDAwMDAwMDA4MzE4MGJkNjggaW4gaW5jbHVkZSAoKSBmcm9t IC9ib290L3VzZXJib290LnNvCiM1ICAweDAwMDAwMDA4MzE4MGJmNWIgaW4gaW50ZXJhY3QgKCkg ZnJvbSAvYm9vdC91c2VyYm9vdC5zbwojNiAgMHgwMDAwMDAwODMxODBiYjM4IGluIGxvYWRlcl9t YWluICgpIGZyb20gL2Jvb3QvdXNlcmJvb3Quc28KIzcgIDB4MDAwMDAwMDAwMDQwMTYyMiBpbiA/ PyAoKQojOCAgMHgwMDAwMDAwMDAwNDAxMTRlIGluID8/ICgpCiM5ICAweDAwMDAwMDA4MDA2MWMw MDAgaW4gPz8gKCkKIzEwIDB4MDAwMDAwMDAwMDAwMDAwMCBpbiA/PyAoKQojMTEgMHgwMDAwMDAw MDAwMDAwMDAwIGluID8/ICgpCiMxMiAweDAwMDAwMDAwMDAwMDAwMDggaW4gPz8gKCkKIzEzIDB4 MDAwMDdmZmZmZmZmZGUxOCBpbiA/PyAoKQojMTQgMHgwMDAwN2ZmZmZmZmZkZTJjIGluID8/ICgp CiMxNSAweDAwMDA3ZmZmZmZmZmRlMmYgaW4gPz8gKCkKIzE2IDB4MDAwMDdmZmZmZmZmZGUzMyBp biA/PyAoKQojMTcgMHgwMDAwN2ZmZmZmZmZkZTM2IGluID8/ICgpCiMxOCAweDAwMDA3ZmZmZmZm ZmRlM2IgaW4gPz8gKCkKIzE5IDB4MDAwMDdmZmZmZmZmZGUzZSBpbiA/PyAoKQojMjAgMHgwMDAw N2ZmZmZmZmZkZTRkIGluID8/ICgpCiMyMSAweDAwMDAwMDAwMDAwMDAwMDAgaW4gPz8gKCkKIzIy IDB4MDAwMDdmZmZmZmZmZGU1MSBpbiA/PyAoKQojMjMgMHgwMDAwN2ZmZmZmZmZkZTVlIGluID8/ ICgpCiMyNCAweDAwMDA3ZmZmZmZmZmRlNjkgaW4gPz8gKCkKIzI1IDB4MDAwMDdmZmZmZmZmZGU3 ZSBpbiA/PyAoKQojMjYgMHgwMDAwN2ZmZmZmZmZkZTkyIGluID8/ICgpCiMyNyAweDAwMDA3ZmZm ZmZmZmRlZTkgaW4gPz8gKCkKIzI4IDB4MDAwMDdmZmZmZmZmZGVmYiBpbiA/PyAoKQojMjkgMHgw MDAwN2ZmZmZmZmZkZjBlIGluID8/ICgpCiMzMCAweDAwMDA3ZmZmZmZmZmRmMWIgaW4gPz8gKCkK IzMxIDB4MDAwMDdmZmZmZmZmZGYyNiBpbiA/PyAoKQojMzIgMHgwMDAwN2ZmZmZmZmZkZjMxIGlu ID8/ICgpCiMzMyAweDAwMDA3ZmZmZmZmZmRmM2IgaW4gPz8gKCkKIzM0IDB4MDAwMDdmZmZmZmZm ZGY1NSBpbiA/PyAoKQojMzUgMHgwMDAwN2ZmZmZmZmZkZjYxIGluID8/ICgpCiMzNiAweDAwMDAw MDAwMDAwMDAwMDAgaW4gPz8gKCkKIzM3IDB4MDAwMDAwMDAwMDAwMDAwMyBpbiA/PyAoKQojMzgg MHgwMDAwMDAwMDAwNDAwMDQwIGluID8/ICgpCiMzOSAweDAwMDAwMDAwMDAwMDAwMDQgaW4gPz8g KCkKIzQwIDB4MDAwMDAwMDAwMDAwMDAzOCBpbiA/PyAoKQojNDEgMHgwMDAwMDAwMDAwMDAwMDA1 IGluID8/ICgpCiM0MiAweDAwMDAwMDAwMDAwMDAwMDggaW4gPz8gKCkKIzQzIDB4MDAwMDAwMDAw MDAwMDAwNiBpbiA/PyAoKQojNDQgMHgwMDAwMDAwMDAwMDAxMDAwIGluID8/ICgpCiM0NSAweDAw MDAwMDAwMDAwMDAwMDggaW4gPz8gKCkKIzQ2IDB4MDAwMDAwMDAwMDAwMDAwMCBpbiA/PyAoKQoj NDcgMHgwMDAwMDAwMDAwMDAwMDA5IGluID8/ICgpCiM0OCAweDAwMDAwMDAwMDA0MDEwYzAgaW4g Pz8gKCkKIzQ5IDB4MDAwMDAwMDAwMDAwMDAwNyBpbiA/PyAoKQojNTAgMHgwMDAwMDAwODAwNjAy MDAwIGluID8/ICgpCiM1MSAweDAwMDAwMDAwMDAwMDAwMGYgaW4gPz8gKCkKIzUyIDxzaWduYWwg aGFuZGxlciBjYWxsZWQ+CiM1MyAweDAwMDAwMDAwMDAwMDAwMDAgaW4gPz8gKCkKUHJldmlvdXMg ZnJhbWUgaW5uZXIgdG8gdGhpcyBmcmFtZSAoY29ycnVwdCBzdGFjaz8pCg== --e89a8f643d9a4dcd2e04c5378234--