From owner-freebsd-virtualization@FreeBSD.ORG Mon Feb 4 11:06:53 2013 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id F1E649C7 for ; Mon, 4 Feb 2013 11:06:53 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id DFDBED24 for ; Mon, 4 Feb 2013 11:06:53 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.6/8.14.6) with ESMTP id r14B6rkV028968 for ; Mon, 4 Feb 2013 11:06:53 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.6/8.14.6/Submit) id r14B6rXb028966 for freebsd-virtualization@FreeBSD.org; Mon, 4 Feb 2013 11:06:53 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 4 Feb 2013 11:06:53 GMT Message-Id: <201302041106.r14B6rXb028966@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Feb 2013 11:06:54 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/170096 virtualization[vimage] Dynamically-attached network interface will c o kern/169991 virtualization[run] [vimage] panic after device plugged in o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE o kern/148155 virtualization[vimage] [pf] Kernel panic with PF/IPFilter + VIMAGE k a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail a kern/141696 virtualization[rum] [vimage] [panic] rum(4)+ vimage = kernel panic 10 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 03:55:10 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 06FD6E18 for ; Thu, 7 Feb 2013 03:55:10 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-la0-x236.google.com (mail-la0-x236.google.com [IPv6:2a00:1450:4010:c03::236]) by mx1.freebsd.org (Postfix) with ESMTP id 867A2F18 for ; Thu, 7 Feb 2013 03:55:09 +0000 (UTC) Received: by mail-la0-f54.google.com with SMTP id gw10so2170456lab.13 for ; Wed, 06 Feb 2013 19:55:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=RXv4LDQlnASChe+fnIDlZNtfjD3Alw5AEPNPDVZnD4g=; b=QMwTnM0t+lZbPJiXoL1/fxCbUFmmoRxnpus3QH1AEyoxfto47AaDwLqU1ha6eyIy7e Lk5rZtTr16ne8W88xkwdYzBDeHRQ+yf5g59S8tCNH3csvNcO70C1eDDa4Pf11sLZxqFS Y7NVVu68rCuVUmPbtznZOv8Eh7OCZUSkrJ0LznXoDeToUq/BCJy1UOekrZo9Mnun2G7a P6IHchrH/Pb+NF8X/GN/veRZwesWZ4AjUFZhG8klxlXHeOWhvYugXTEJlxhLPUfEbs7R wWGmbvkbcEPKZ3DizkEaJXgbi3j2r8mSPHHIc0zZA+5CfzAoJ92cP2d2ZDnbPW3VMLff 6PjQ== X-Received: by 10.112.28.101 with SMTP id a5mr172603lbh.0.1360209308359; Wed, 06 Feb 2013 19:55:08 -0800 (PST) Received: from Sevans-MacBook-Pro.local ([2a02:578:540e:1:8dc6:b9e1:ee2c:316a]) by mx.google.com with ESMTPS id i4sm6050585lbd.5.2013.02.06.19.55.06 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 06 Feb 2013 19:55:07 -0800 (PST) Message-ID: <51132599.60506@gmail.com> Date: Thu, 07 Feb 2013 07:55:05 +0400 From: Sevan / Venture37 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130107 Thunderbird/17.0.2 MIME-Version: 1.0 To: freebsd-virtualization@FreeBSD.org Subject: bhyve hangs on going multi user Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 03:55:10 -0000 Hi, Attempting to start a VM with the following command results in a hang when the system tries to go multiuser sudo bhyveload -m 768 -M 8192 -d ./diskdev guest0 && sudo bhyve -c 1 -a -A -m 768 -M 8192 -I -H -g 0 -s 0:0,hostbridge -s 1:0,virtio-blk,diskdev -S 31,uart,stdio gues0 /boot/loader.conf autoboot_delay=5 kernel="kernel" virtio_load="YES" if_vtnet_load="YES" virtio_pci_load="YES" virtio_blk_load="YES" # Avoid clock drift kern.timecounter.hardware="TSC" kern.timecounter.invariant_tsc="1" # Tell the guest it is virtualized #smbios.bios.vendor="Bochs" smbios.bios.vendor="BHYVE" console="userboot" bootverbose="1" /etc/fstab /dev/vtbd0s1a / ufs rw 1 1 Booting... GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb SMAP type=01 base=0000000000000000 len=00000000000a0000 SMAP type=01 base=0000000000100000 len=000000002ff00000 SMAP type=01 base=0000000100000000 len=0000000200000000 Table 'APIC' at 0xf0500 APIC: Found table at 0xf0500APIC: Using the MADT enumerator. MADT: Found CPU APIC ID 0 ACPI ID 0: enabled SMP: Added CPU 0 (AP) Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r246446: Thu Feb 7 02:36:17 UTC 2013 you@dev.foo.local:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81822000. Hypervisor: Origin = "BHyVBHyVBHyV" Calibrating TSC clock ... TSC clock: 3399738220 Hz CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3399.74-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping = 9 Features=0x8fa3ab7f Features2=0xe3bae257 AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant real memory = 12884901888 (12288 MB) Physical memory chunk(s): 0x0000000000001000 - 0x000000000009bfff, 634880 bytes (155 pages) 0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages) 0x000000000184f000 - 0x000000002fffffff, 779816960 bytes (190385 pages) 0x0000000100000000 - 0x00000002e96e7fff, 8211300352 bytes (2004712 pages) avail memory = 8932638720 (8518 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: x86bios: IVT 0x000000-0x0004ff at 0xfffffe0000000000 x86bios: SSEG 0x001000-0x001fff at 0xffffff8000223000 x86bios: ROM 0x0a0000-0x0fefff at 0xfffffe00000a0000 APIC: CPU 0 has ACPI ID 0 random device not loaded; using insecure entropy ULE: setup cpu 0 ACPI: RSDP 0xf0400 00024 (v02 BHYVE ) ACPI: XSDT 0xf0480 00034 (v01 BHYVE BVXSDT 00000001 INTL 20130117) ACPI: APIC 0xf0500 0004A (v01 BHYVE BVMADT 00000001 INTL 20130117) ACPI: FACP 0xf0600 0010C (v05 BHYVE BVFACP 00000001 INTL 20130117) ACPI: DSDT 0xf0800 000F2 (v02 BHYVE BVDSDT 00000001 INTL 20130117) ACPI: FACS 0xf0780 00040 MADT: Found IO APIC ID 1, Interrupt 0 at 0xfec00000 ioapic0: Changing APIC ID to 1 ioapic0: Routing external 8259A's -> intpin 0 MADT: Interrupt override: source 9, irq 9 ioapic0: intpin 9 trigger: level ioapic0: intpin 9 polarity: low ioapic0 irqs 0-16 on motherboard cpu0 BSP: ID: 0x00000000 VER: 0x00000011 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024] feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=5 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25 wlan: <802.11 Link Layer> nfslock: pseudo-device null: random: module_register_init: MOD_LOAD (vesa, 0xffffffff80c24d10, 0) error 19 io: kbd0 at kbdmux0 ctl: CAM Target Layer loaded acpi0: on motherboard ACPI: All ACPI Tables successfully acquired ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 atrtc0: port 0x70-0x71,0x72-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock (resolution 1000000us, adjustment 0.500000000s) ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 0 vector 49 Event timer "RTC" frequency 32768 Hz quality 0 ACPI timer: 1/5 1/4 1/5 1/4 1/3 1/4 1/5 1/4 1/5 1/5 -> 10 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pcib0: decoding 4 range 0-0xcf7 pcib0: decoding 4 range 0xd00-0xffff pcib0: could not get PCI interrupt routing table for \_SB_.PCI0 - AE_NOT_FOUND pci0: on pcib0 pci0: domain=0, physical bus=0 found-> vendor=0x1275, dev=0x1275, revid=0x00 domain=0, bus=0, slot=0, func=0 class=06-00-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x1af4, dev=0x1001, revid=0x00 domain=0, bus=0, slot=1, func=0 class=01-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) MSI-X supports 2 messages in map 0x14 map[10]: type I/O Port, range 32, base 0x2000, size 6, enabled pcib0: allocated type 4 (0x2000-0x203f) for rid 10 of pci0:0:1:0 map[14]: type Memory, range 32, base 0x30000000, size 13, enabled found-> vendor=0x131f, dev=0x2000, revid=0x00 domain=0, bus=0, slot=31, func=0 class=07-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=4 map[10]: type I/O Port, range 32, base 0x3f8, size 3, enabled pcib0: allocated type 4 (0x3f8-0x3ff) for rid 10 of pci0:0:31:0 pcib0: no PRT entry for 0.31.INTA virtio_pci0: port 0x2000-0x203f mem 0x30000000-0x30001fff at device 1.0 on pci0 vtblk0: on virtio_pci0 virtio_pci0: host features: 0x10000004 virtio_pci0: negotiated features: 0x10000004 virtio_pci0: attempting to allocate 2 MSI-X vectors (2 supported) msi: routing MSI-X IRQ 256 to local APIC 0 vector 50 msi: routing MSI-X IRQ 257 to local APIC 0 vector 51 virtio_pci0: using IRQs 256-257 for MSI-X virtio_pci0: using per VQ MSIX interrupts vtblk0: 20480MB (41943040 512 byte sectors) uart2: <16550 or compatible> port 0x3f8-0x3ff irq 4 at device 31.0 on pci0 ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 0 vector 52 uart2: fast interrupt uart2: console (9600,n,8,1) acpi0: wakeup code va 0xffffff8000299000 pa 0x4000 Device configuration finished. procfs registered lapic: Divisor 2, Frequency 1700037000 Hz Timecounters tick every 10.000 msec vlan: initialized, using hash tables with chaining tcp_init: net.inet.tcp.tcbhashsize auto tuned to 131072 lo0: bpf attached hptrr: no controller detected. hpt27xx: no controller detected. GEOM: new disk vtbd0 g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT TSC timecounter discards lower 1 bit(s) Timecounter "TSC-low" frequency 1699869110 Hz quality 1000 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/vtbd0s1a [rw]... start_init: trying /sbin/init pid 17 (stty), uid 0: exited on signal 4 Illegal instruction pid 19 (ps), uid 0: exited on signal 4 Illegal instruction Setting hostuuid: 524a76a9-70d9-11e2-9241-9f81272ed682. Setting hostid: 0x7c395229. No suitable dump device was found. Entropy harvesting:. Starting file system checks: /dev/vtbd0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS pid 50 (fsck_ufs), uid 0: exited on signal 4 g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT fsck: /dev/vtbd0s1a: Illegal instruction Unknown error; help! ERROR: ABORTING BOOT (sending SIGTERM to parent)! From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 07:24:57 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id A4DF2376 for ; Thu, 7 Feb 2013 07:24:57 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-ia0-x22d.google.com (ia-in-x022d.1e100.net [IPv6:2607:f8b0:4001:c02::22d]) by mx1.freebsd.org (Postfix) with ESMTP id 6C361695 for ; Thu, 7 Feb 2013 07:24:57 +0000 (UTC) Received: by mail-ia0-f173.google.com with SMTP id h37so2630657iak.32 for ; Wed, 06 Feb 2013 23:24:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=xZ2xjIf4tgrpV/jFv1GaMMn8SbRKnr9Slmk4alyHpbg=; b=pT3EhYKBohMekMrQOeiqaTC1a8O038cJ6XuHRZjYRrEayCE/f2nmVaa+GXSqDKJ/Ws Qp3SDjpvLSNQSGRrp3rQce6q1DaG9jMlEvqKC1Imd877EdfwRFa4rrDUzzgonIWMcB/6 p+GwNRHrI75CYo6KyTB9FXJhRQNMtVYxqFjKKZEAtGjFwG2SdLMVRGncMB5H1g04FPfZ mWZkm+Rj7uL8FNKRMxqs/eJjEMBk6OIxXElyrY6d2PjV3aVwUsqP8VlKPDqjelEnlJED W1aAS6Eg7VRKHwKJuP6k0EXt/nlVT8/tKPUrBxoKgjjgxLkCsrOvAZgpFfP0wixsMRf4 +2vA== MIME-Version: 1.0 X-Received: by 10.50.170.69 with SMTP id ak5mr583438igc.56.1360221896792; Wed, 06 Feb 2013 23:24:56 -0800 (PST) Received: by 10.42.23.132 with HTTP; Wed, 6 Feb 2013 23:24:56 -0800 (PST) In-Reply-To: <51132599.60506@gmail.com> References: <51132599.60506@gmail.com> Date: Wed, 6 Feb 2013 23:24:56 -0800 Message-ID: Subject: Re: bhyve hangs on going multi user From: Neel Natu To: "Sevan / Venture37" Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 07:24:57 -0000 Hi Sevan, At the risk of stating the obvious: > pid 17 (stty), uid 0: exited on signal 4 > Illegal instruction > pid 19 (ps), uid 0: exited on signal 4 > Illegal instruction The userland processes launched by /etc/rc are getting a SIGILL but it is not clear why. Could you do some experiments on your end to narrow this down a bit more: - Boot to single user and then execute a variety of commands to figure out whether the problem happens randomly or does is follow a particular executable (for e.g. execute "ps", "stty", "fsck", "find", "ls" etc). - Did this problem start happening only recently? - If you have a different host system does it happen there too? If you have a different virtual machine does it happen there as well? best Neel On Wed, Feb 6, 2013 at 7:55 PM, Sevan / Venture37 wrote: > Hi, > Attempting to start a VM with the following command results in a hang when > the system tries to go multiuser > sudo bhyveload -m 768 -M 8192 -d ./diskdev guest0 && sudo bhyve -c 1 -a -A > -m 768 -M 8192 -I -H -g 0 -s 0:0,hostbridge -s 1:0,virtio-blk,diskdev -S > 31,uart,stdio gues0 > > > /boot/loader.conf > autoboot_delay=5 > kernel="kernel" > > virtio_load="YES" > if_vtnet_load="YES" > virtio_pci_load="YES" > virtio_blk_load="YES" > > # Avoid clock drift > kern.timecounter.hardware="TSC" > kern.timecounter.invariant_tsc="1" > # Tell the guest it is virtualized > #smbios.bios.vendor="Bochs" > smbios.bios.vendor="BHYVE" > > console="userboot" > bootverbose="1" > > > /etc/fstab > /dev/vtbd0s1a / ufs rw 1 1 > > > > > Booting... > GDB: no debug ports present > KDB: debugger backends: ddb > KDB: current backend: ddb > SMAP type=01 base=0000000000000000 len=00000000000a0000 > SMAP type=01 base=0000000000100000 len=000000002ff00000 > SMAP type=01 base=0000000100000000 len=0000000200000000 > Table 'APIC' at 0xf0500 > APIC: Found table at 0xf0500APIC: Using the MADT enumerator. > MADT: Found CPU APIC ID 0 ACPI ID 0: enabled > SMP: Added CPU 0 (AP) > Copyright (c) 1992-2013 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 10.0-CURRENT #0 r246446: Thu Feb 7 02:36:17 UTC 2013 > you@dev.foo.local:/usr/obj/usr/src/sys/GENERIC amd64 > FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 > WARNING: WITNESS option enabled, expect reduced performance. > Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81822000. > Hypervisor: Origin = "BHyVBHyVBHyV" > Calibrating TSC clock ... TSC clock: 3399738220 Hz > CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3399.74-MHz K8-class CPU) > Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping > = 9 > > Features=0x8fa3ab7f > > Features2=0xe3bae257 > AMD Features=0x28100800 > AMD Features2=0x1 > TSC: P-state invariant > real memory = 12884901888 (12288 MB) > Physical memory chunk(s): > 0x0000000000001000 - 0x000000000009bfff, 634880 bytes (155 pages) > 0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages) > 0x000000000184f000 - 0x000000002fffffff, 779816960 bytes (190385 pages) > 0x0000000100000000 - 0x00000002e96e7fff, 8211300352 bytes (2004712 pages) > avail memory = 8932638720 (8518 MB) > Event timer "LAPIC" quality 400 > ACPI APIC Table: > x86bios: IVT 0x000000-0x0004ff at 0xfffffe0000000000 > x86bios: SSEG 0x001000-0x001fff at 0xffffff8000223000 > x86bios: ROM 0x0a0000-0x0fefff at 0xfffffe00000a0000 > APIC: CPU 0 has ACPI ID 0 > random device not loaded; using insecure entropy > ULE: setup cpu 0 > ACPI: RSDP 0xf0400 00024 (v02 BHYVE ) > ACPI: XSDT 0xf0480 00034 (v01 BHYVE BVXSDT 00000001 INTL 20130117) > ACPI: APIC 0xf0500 0004A (v01 BHYVE BVMADT 00000001 INTL 20130117) > ACPI: FACP 0xf0600 0010C (v05 BHYVE BVFACP 00000001 INTL 20130117) > ACPI: DSDT 0xf0800 000F2 (v02 BHYVE BVDSDT 00000001 INTL 20130117) > ACPI: FACS 0xf0780 00040 > MADT: Found IO APIC ID 1, Interrupt 0 at 0xfec00000 > ioapic0: Changing APIC ID to 1 > ioapic0: Routing external 8259A's -> intpin 0 > MADT: Interrupt override: source 9, irq 9 > ioapic0: intpin 9 trigger: level > ioapic0: intpin 9 polarity: low > ioapic0 irqs 0-16 on motherboard > cpu0 BSP: > ID: 0x00000000 VER: 0x00000011 LDR: 0x00000000 DFR: 0xffffffff > lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff > timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 > snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024] > feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=5 > feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25 > wlan: <802.11 Link Layer> > nfslock: pseudo-device > null: > random: > module_register_init: MOD_LOAD (vesa, 0xffffffff80c24d10, 0) error 19 > io: > kbd0 at kbdmux0 > ctl: CAM Target Layer loaded > acpi0: on motherboard > ACPI: All ACPI Tables successfully acquired > ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 > atrtc0: port 0x70-0x71,0x72-0x77 irq 8 on acpi0 > atrtc0: registered as a time-of-day clock (resolution 1000000us, adjustment > 0.500000000s) > ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 0 vector 49 > Event timer "RTC" frequency 32768 Hz quality 0 > ACPI timer: 1/5 1/4 1/5 1/4 1/3 1/4 1/5 1/4 1/5 1/5 -> 10 > Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 > acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 > pcib0: port 0xcf8-0xcff on acpi0 > pcib0: decoding 4 range 0-0xcf7 > pcib0: decoding 4 range 0xd00-0xffff > pcib0: could not get PCI interrupt routing table for \_SB_.PCI0 - > AE_NOT_FOUND > pci0: on pcib0 > pci0: domain=0, physical bus=0 > found-> vendor=0x1275, dev=0x1275, revid=0x00 > domain=0, bus=0, slot=0, func=0 > class=06-00-00, hdrtype=0x01, mfdev=0 > cmdreg=0x0007, statreg=0x0000, cachelnsz=0 (dwords) > lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) > found-> vendor=0x1af4, dev=0x1001, revid=0x00 > domain=0, bus=0, slot=1, func=0 > class=01-00-00, hdrtype=0x00, mfdev=0 > cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) > lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) > MSI-X supports 2 messages in map 0x14 > map[10]: type I/O Port, range 32, base 0x2000, size 6, enabled > pcib0: allocated type 4 (0x2000-0x203f) for rid 10 of pci0:0:1:0 > map[14]: type Memory, range 32, base 0x30000000, size 13, enabled > found-> vendor=0x131f, dev=0x2000, revid=0x00 > domain=0, bus=0, slot=31, func=0 > class=07-00-00, hdrtype=0x00, mfdev=0 > cmdreg=0x0007, statreg=0x0000, cachelnsz=0 (dwords) > lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) > intpin=a, irq=4 > map[10]: type I/O Port, range 32, base 0x3f8, size 3, enabled > pcib0: allocated type 4 (0x3f8-0x3ff) for rid 10 of pci0:0:31:0 > pcib0: no PRT entry for 0.31.INTA > virtio_pci0: port 0x2000-0x203f mem > 0x30000000-0x30001fff at device 1.0 on pci0 > vtblk0: on virtio_pci0 > virtio_pci0: host features: 0x10000004 > virtio_pci0: negotiated features: 0x10000004 > virtio_pci0: attempting to allocate 2 MSI-X vectors (2 supported) > msi: routing MSI-X IRQ 256 to local APIC 0 vector 50 > msi: routing MSI-X IRQ 257 to local APIC 0 vector 51 > virtio_pci0: using IRQs 256-257 for MSI-X > virtio_pci0: using per VQ MSIX interrupts > vtblk0: 20480MB (41943040 512 byte sectors) > uart2: <16550 or compatible> port 0x3f8-0x3ff irq 4 at device 31.0 on pci0 > ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 0 vector 52 > uart2: fast interrupt > uart2: console (9600,n,8,1) > acpi0: wakeup code va 0xffffff8000299000 pa 0x4000 > Device configuration finished. > procfs registered > lapic: Divisor 2, Frequency 1700037000 Hz > Timecounters tick every 10.000 msec > vlan: initialized, using hash tables with chaining > tcp_init: net.inet.tcp.tcbhashsize auto tuned to 131072 > lo0: bpf attached > hptrr: no controller detected. > hpt27xx: no controller detected. > GEOM: new disk vtbd0 > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > TSC timecounter discards lower 1 bit(s) > Timecounter "TSC-low" frequency 1699869110 Hz quality 1000 > WARNING: WITNESS option enabled, expect reduced performance. > Trying to mount root from ufs:/dev/vtbd0s1a [rw]... > start_init: trying /sbin/init > pid 17 (stty), uid 0: exited on signal 4 > Illegal instruction > pid 19 (ps), uid 0: exited on signal 4 > Illegal instruction > Setting hostuuid: 524a76a9-70d9-11e2-9241-9f81272ed682. > Setting hostid: 0x7c395229. > No suitable dump device was found. > Entropy harvesting:. > Starting file system checks: > /dev/vtbd0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS > pid 50 (fsck_ufs), uid 0: exited on signal 4 > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT > fsck: /dev/vtbd0s1a: Illegal instruction > Unknown error; help! > ERROR: ABORTING BOOT (sending SIGTERM to parent)! > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 07:58:47 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 63D0987A for ; Thu, 7 Feb 2013 07:58:47 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-la0-x234.google.com (la-in-x0234.1e100.net [IPv6:2a00:1450:4010:c03::234]) by mx1.freebsd.org (Postfix) with ESMTP id E5B9E770 for ; Thu, 7 Feb 2013 07:58:46 +0000 (UTC) Received: by mail-la0-f52.google.com with SMTP id fs12so2273218lab.39 for ; Wed, 06 Feb 2013 23:58:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:references:in-reply-to:mime-version :content-transfer-encoding:content-type:message-id:cc:x-mailer:from :subject:date:to; bh=lI4O6J5s0x13tPapQE5xChkJNJdXM/1eiwRMc6MU9eY=; b=MP61thcaomIMaGzi9R7GMcU4SkjvZvLxAoC2asBHEgILFgU0Sglf64ciXBPj4GY7V8 LbeYzl2UHbVdcvSgWLg/UIqJwwM0XdYvoeflWKhsMssxKH4r9jGyLLE/sI/Ml7RVPU5G D4Nxo/DMrlB+5rtmXVk9PQaWVAPTUI0jK8eKFiuFIunazlsbMZ5PqNtZQJvB6ZSNsNyq u38g/aZKQhawlXm6/QB7KkF5S4YKZQcGoMDe431Vsk492+y9GpoGaV0x0t3l/5jhLig6 +B9VPUe3hanV/Yu9jj7g2PsO1YNF0FPIRcbVprp7lZUFLjrB/UHp1PQWaic9iV1TPmAT Kiew== X-Received: by 10.112.17.3 with SMTP id k3mr376012lbd.42.1360223925956; Wed, 06 Feb 2013 23:58:45 -0800 (PST) Received: from [192.168.47.22] ([83.167.125.235]) by mx.google.com with ESMTPS id go4sm8632745lbb.16.2013.02.06.23.58.43 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 06 Feb 2013 23:58:44 -0800 (PST) References: <51132599.60506@gmail.com> In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: X-Mailer: iPhone Mail (9B208) From: Sevan / Venture37 Subject: Re: bhyve hangs on going multi user Date: Thu, 7 Feb 2013 11:58:42 +0400 To: Neel Natu Cc: "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 07:58:47 -0000 On 7 Feb 2013, at 11:24 AM, Neel Natu wrote: > Hi Sevan, Hi Neel, > At the risk of stating the obvious: >=20 >> pid 17 (stty), uid 0: exited on signal 4 >> Illegal instruction >> pid 19 (ps), uid 0: exited on signal 4 >> Illegal instruction >=20 > The userland processes launched by /etc/rc are getting a SIGILL but it > is not clear why. >=20 > Could you do some experiments on your end to narrow this down a bit more: >=20 > - Boot to single user and then execute a variety of commands to figure > out whether the problem happens randomly or does is follow a > particular executable (for e.g. execute "ps", "stty", "fsck", "find", > "ls" etc). >=20 Ok, will give it a try > - Did this problem start happening only recently? >=20 System was just built yesterday > - If you have a different host system does it happen there too? If you > have a different virtual machine does it happen there as well? I dont have another system capable of running bhyve but I'll give a new mach= ine a try.= From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 08:40:57 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 03093E9 for ; Thu, 7 Feb 2013 08:40:57 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-la0-x231.google.com (mail-la0-x231.google.com [IPv6:2a00:1450:4010:c03::231]) by mx1.freebsd.org (Postfix) with ESMTP id 81DDCDD4 for ; Thu, 7 Feb 2013 08:40:56 +0000 (UTC) Received: by mail-la0-f49.google.com with SMTP id fs13so2339824lab.36 for ; Thu, 07 Feb 2013 00:40:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=XePm2Nq6vOikMapHTZQBhKEGifbyGFzxu/sNO8103Rw=; b=SICSgfkwCL2kRvZTaTyUCwcTWSRhQv9/quSricIBaJ5FlFaiShc0IIY3smYt6PVBUG SoroyYpp2c5AKYbtrQFhQzJ1AmgETRaupEu3ttE2s+sDDGWwRoTxngU5ADo0ydyIEFMi LHyxK31QdRqC5K49n8ZATyl56mdwinKzAbHctrmo69JAeDaNwnlESp4DjiKcNFqRCCHj cVyPPoWa8A57RgHPSnrqetBjTtsagAkJQS2AOd4SGNG6M38/lM0sV4Cni/fWMIT8gcsY qViPz31b7mvq7uetvT9xhokiUTs2onpHmF8WoB3L8V2Va/kxv+XBXgkgCm51BRswQX/7 M8GQ== X-Received: by 10.112.28.101 with SMTP id a5mr449079lbh.0.1360226454729; Thu, 07 Feb 2013 00:40:54 -0800 (PST) Received: from Sevans-MacBook-Pro.local ([83.167.125.235]) by mx.google.com with ESMTPS id ns7sm14372544lab.5.2013.02.07.00.40.52 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 07 Feb 2013 00:40:53 -0800 (PST) Message-ID: <51136892.1020505@gmail.com> Date: Thu, 07 Feb 2013 12:40:50 +0400 From: Sevan / Venture37 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130107 Thunderbird/17.0.2 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 08:40:57 -0000 On 07/02/2013 11:58, Sevan / Venture37 wrote: >> - Boot to single user and then execute a variety of commands to figure >> >out whether the problem happens randomly or does is follow a >> >particular executable (for e.g. execute "ps", "stty", "fsck", "find", >> >"ls" etc). >> > > Ok, will give it a try Unable to enter single user mode Trying to mount root from ufs:/dev/vtbd0s1a [rw]... pid 16 (init), uid 0: exited on signal 4 Will try building a new world with without a make.conf & use that as the basis for a new VM & see if that makes a difference. Sevan From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 15:12:52 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 9293EE17 for ; Thu, 7 Feb 2013 15:12:52 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-lb0-f174.google.com (mail-lb0-f174.google.com [209.85.217.174]) by mx1.freebsd.org (Postfix) with ESMTP id 15559734 for ; Thu, 7 Feb 2013 15:12:51 +0000 (UTC) Received: by mail-lb0-f174.google.com with SMTP id l12so2205539lbo.33 for ; Thu, 07 Feb 2013 07:12:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:subject:references:from:content-type:x-mailer :in-reply-to:message-id:date:to:content-transfer-encoding :mime-version; bh=y18qRGs7usGI2MtudG66qhoZ+H8hFYwWn38UJI/LHKU=; b=aHQbrg+FR5q3bp5U7BX0ZR9croEsYtGi7VajG2CjCl4IabN4bI7I9Gx3EOMQ2/Q7Iq rvIPk9+Q6k7rNDfOrWed6dIAZgXAIJSU2eh0yGrK7HiuI4CACcoRWGkrMQ3b/OmcTKPD AQ/2WensYjqa7esQU/H6UPF3l/JZ8ON8bD3uzlB1pVOUk5YnAvrbLdwrXnYUdx5xq17S sYdz46jTdj9sZRB8LdXMNyujP+snh1CoLQBEuurlGoQQ9fDepSrF7/JK113Wztl4Nv0X RAETIVtqJgpAD1f+rHoFzCH5D+pzhso4WtFjrxhR34XwSboHjRGOhAdhe3+T+JM8Y8W5 JzkQ== X-Received: by 10.152.123.34 with SMTP id lx2mr1598990lab.52.1360249964613; Thu, 07 Feb 2013 07:12:44 -0800 (PST) Received: from ?IPv6:2a02:2018:20::d4fa:d0a:6bb9:16ba? ([2a02:2018:20:0:d4fa:d0a:6bb9:16ba]) by mx.google.com with ESMTPS id k15sm4663798lbd.6.2013.02.07.07.12.42 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 07 Feb 2013 07:12:43 -0800 (PST) Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> From: Sevan / Venture37 Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (9B208) In-Reply-To: <51136892.1020505@gmail.com> Message-Id: Date: Thu, 7 Feb 2013 19:12:41 +0400 To: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 15:12:52 -0000 On 7 Feb 2013, at 12:40 PM, Sevan / Venture37 wrote: > Will try building a new world with without a make.conf & use that as the b= asis for a new VM & see if that makes a difference. It did, will follow up later with instruction once I have a working system, I= 'm now trying to get networking going. If I run tcpdump on guest, I see traffic showing up destined for the host. I do not see the traffic make it back out however. Sevan= From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 18:16:59 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id C9F436D7 for ; Thu, 7 Feb 2013 18:16:59 +0000 (UTC) (envelope-from neelnatu@gmail.com) Received: from mail-ie0-x229.google.com (ie-in-x0229.1e100.net [IPv6:2607:f8b0:4001:c03::229]) by mx1.freebsd.org (Postfix) with ESMTP id A2B3428A for ; Thu, 7 Feb 2013 18:16:59 +0000 (UTC) Received: by mail-ie0-f169.google.com with SMTP id 13so4004131iea.0 for ; Thu, 07 Feb 2013 10:16:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=PBlbEE6v/p+fe4Y5TleeMfoZYkYPfXM5K8N/aqRA1S4=; b=xttPbYUm2+ct3sFqEljKAUvTsLJouHKABok3VyRkJU+Vg69TcRM4rBaFsxmCSo3oX4 RFYah9HqGRqqspT5q56r2HHtb3NgN2iyTJXB+Yeb6sCHSCRsE4oMAXUUUZ3znpOt5hHe yq5Ohknom4BaqJGix/daQF7FM1JBn71pI8RPKA3deowwaHtGpgxpmq5wh2LeskP6lZrD snsUCfexkYFHaR60cHkdncOMkdGHrbE0/y6/G4c11K/GZcabyU37tAsUZOu279gbtpJl /Tk4u8R0RaLIj+70gyHS3nGzvBWdMrPIrIiK5HgKujJwjU4hxNqRPmlbdriUHqqcQQJy iE4g== MIME-Version: 1.0 X-Received: by 10.50.170.69 with SMTP id ak5mr4993832igc.56.1360261018491; Thu, 07 Feb 2013 10:16:58 -0800 (PST) Received: by 10.42.23.132 with HTTP; Thu, 7 Feb 2013 10:16:58 -0800 (PST) In-Reply-To: References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> Date: Thu, 7 Feb 2013 10:16:58 -0800 Message-ID: Subject: Re: bhyve hangs on going multi user From: Neel Natu To: "Sevan / Venture37" Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 18:16:59 -0000 Hi Sevan, On Thu, Feb 7, 2013 at 7:12 AM, Sevan / Venture37 wrote: > On 7 Feb 2013, at 12:40 PM, Sevan / Venture37 wrote: > >> Will try building a new world with without a make.conf & use that as the basis for a new VM & see if that makes a difference. > > It did, will follow up later with instruction once I have a working system, I'm now trying to get networking going. That's great. I am interested in knowing how make options resulted in illegal instruction traps in guest userspace. > If I run tcpdump on guest, I see traffic showing up destined for the host. > I do not see the traffic make it back out however. > Could you share output of "ifconfig" and "netstat -rn" from the guest as well as the host? best Neel > Sevan > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Thu Feb 7 23:19:19 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 4EE0889B for ; Thu, 7 Feb 2013 23:19:19 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com [209.85.214.53]) by mx1.freebsd.org (Postfix) with ESMTP id C9953681 for ; Thu, 7 Feb 2013 23:19:18 +0000 (UTC) Received: by mail-bk0-f53.google.com with SMTP id j10so1401767bkw.26 for ; Thu, 07 Feb 2013 15:19:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=nHvybm3+oCwFauiojeN70Oc+J/bsmyMm3XfHS0R9SNM=; b=Q9TxccDZwUUkWxCZpA5fvr2NT2WEfEaOLBCdZKHhmSI+z3l3FoBAr+0mjP2wCSbK9O Pn48qdgS53E4abkY4dDZIMqh8rwu8LHsXzfuBlg6f9+eJwkNH60DGgNbNYMEMhzO9qji 6CokjPx8YjhCqrN4OR8bqniApVabwXp/I5jlnRzSLX2bdXBrBF7QY2taf8SpZFtPkGQ1 07uaLzS2uYDhAsE7BsGDEDAQpuEvqj6aC3CizUQ336gM+Xa1LvRdX8oq6Yi5rkW1IPXM ZsjXdZxs6QRtZpZlcSn//eBhhQDQZ60xwDuhvE217lMpAN5N8FDXUiPuxS1AY9Z08EB1 ffRw== X-Received: by 10.204.8.15 with SMTP id f15mr920462bkf.88.1360279157621; Thu, 07 Feb 2013 15:19:17 -0800 (PST) Received: from Sevans-MacBook-Pro.local ([83.167.125.235]) by mx.google.com with ESMTPS id ge12sm9575676bkc.19.2013.02.07.15.19.07 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 07 Feb 2013 15:19:16 -0800 (PST) Message-ID: <5114361F.8060303@gmail.com> Date: Fri, 08 Feb 2013 03:17:51 +0400 From: Sevan / Venture37 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130107 Thunderbird/17.0.2 MIME-Version: 1.0 To: Neel Natu Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Feb 2013 23:19:19 -0000 On 07/02/2013 22:16, Neel Natu wrote: > Hi Sevan, > > On Thu, Feb 7, 2013 at 7:12 AM, Sevan / Venture37 > wrote: >> On 7 Feb 2013, at 12:40 PM, Sevan / Venture37 >> wrote: >> >>> Will try building a new world with without a make.conf & use that >>> as the basis for a new VM & see if that makes a difference. >> >> It did, will follow up later with instruction once I have a working >> system, I'm now trying to get networking going. > > That's great. I am interested in knowing how make options resulted > in illegal instruction traps in guest userspace. Previous make.conf STRIP= CFLAGS+=-fno-omit-frame-pointer CFLAGS= -O2 -fno-strict-aliasing -pipe COPTFLAGS= -O -pipe CXXFLAGS+= -fconserve-space CPUTYPE?=corei7-avx >> If I run tcpdump on guest, I see traffic showing up destined for >> the host. I do not see the traffic make it back out however. >> > Could you share output of "ifconfig" and "netstat -rn" from the > guest as well as the host? Problem solved, need to wait for a bit after bringing tap/bridge up otherwise traffic wont pass. (see working dmesg at the bottom of the page) I can now make a guest panic if I assign 4GB or more RAM. GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r246446: Thu Feb 7 12:21:37 UTC 2013 :/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3399.72-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping = 9 Features=0x8fa3ab7f Features2=0xe3bae257 AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 4114264064 (3923 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: random device not loaded; using insecure entropy ioapic0: Changing APIC ID to 1 ioapic0 irqs 0-0 on motherboard module_register_init: MOD_LOAD (vesa, 0xffffffff80c28300, 0) error 19 kbd0 at kbdmux0 ctl: CAM Target Layer loaded acpi0: on motherboard acpi0: could not allocate interrupt ACPI Exception: AE_ALREADY_EXISTS, Unable to install System Control Interrupt handler (20130117/evevent-152) acpi0: Could not enable ACPI: AE_ALREADY_EXISTS device_attach: acpi0 attach returned 6 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x60 fault code = supervisor write data, page not present instruction pointer = 0x20:0xffffffff80c9c813 stack pointer = 0x28:0xffffffff8182ab70 frame pointer = 0x28:0xffffffff8182aba0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (swapper) [ thread pid 0 tid 100000 ] Stopped at acpi_install_wakeup_handler+0x113: movq %r14,0x60(%r15) Tracing pid 0 tid 100000 td 0xffffffff814f8ff0 acpi_install_wakeup_handler() at acpi_install_wakeup_handler+0x113/frame 0xffffffff8182aba0 nexus_acpi_attach() at nexus_acpi_attach+0x8c/frame 0xffffffff8182abd0 device_attach() at device_attach+0x396/frame 0xffffffff8182ac20 bus_generic_new_pass() at bus_generic_new_pass+0x116/frame 0xffffffff8182ac50 bus_set_pass() at bus_set_pass+0x8f/frame 0xffffffff8182ac80 configure() at configure+0xa/frame 0xffffffff8182ac90 mi_startup() at mi_startup+0x118/frame 0xffffffff8182acb0 btext() at btext+0x2c pid ppid pgrp uid state wmesg wchan cmd 2 0 0 0 RL [ctl_thrd] 13 0 0 0 RL (threaded) [geom] 100009 RunQ [g_down] 100008 RunQ [g_up] 100007 RunQ [g_event] 12 0 0 0 WL (threaded) [intr] 100019 I [swi5: fast taskq] 100017 I [swi6: Giant taskq] 100016 I [swi6: task queue] 100012 I [swi2: cambio] 100006 I [swi3: vm] 100005 I [swi4: clock] 100004 I [swi1: netisr 0] 11 0 0 0 RL [idle: cpu0] 1 0 0 0 ?L [kernel] 10 0 0 0 RL [audit] 0 0 0 0 RLs (threaded) [kernel] 100020 RunQ [kqueue taskq] 100018 RunQ [thread taskq] 100015 RunQ [acpi_task_2] 100014 RunQ [acpi_task_1] 100013 RunQ [acpi_task_0] 100011 RunQ [ffs_trim taskq] 100010 RunQ [firmware taskq] 100000 Run CPU 0 [swapper] GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r246446: Thu Feb 7 12:21:37 UTC 2013 :/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3399.75-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping = 9 Features=0x8fa3ab7f Features2=0xe3bae257 AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant real memory = 3221225472 (3072 MB) avail memory = 3078328320 (2935 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: random device not loaded; using insecure entropy ioapic0: Changing APIC ID to 1 ioapic0 irqs 0-16 on motherboard module_register_init: MOD_LOAD (vesa, 0xffffffff80c28300, 0) error 19 kbd0 at kbdmux0 ctl: CAM Target Layer loaded acpi0: on motherboard atrtc0: port 0x70-0x71,0x72-0x77 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib0: no PRT entry for 0.31.INTA virtio_pci0: port 0x2000-0x201f mem 0xc0000000-0xc0001fff at device 1.0 on pci0 vtnet0: on virtio_pci0 virtio_pci0: host features: 0x18020 virtio_pci0: negotiated features: 0x18020 vtnet0: Ethernet address: 00:a0:98:a0:46:9c virtio_pci1: host features: 0x10000004 virtio_pci1: negotiated features: 0x10000004 vtblk0: 4096MB (8388608 512 byte sectors) uart2: <16550 or compatible> port 0x3f8-0x3ff irq 4 at device 31.0 on pci0 uart2: console (9600,n,8,1) Timecounters tick every 10.000 msec g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT Timecounter "TSC-low" frequency 1699875246 Hz quality 1000 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/vtbd0s1a [rw]... Setting hostuuid: 04124b58-712c-11e2-b131-cdebce931f3f. Setting hostid: 0x44378452. No suitable dump device was found. Entropy harvesting:. Starting file system checks: /dev/vtbd0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/vtbd0s1a: clean, 647080 free (760 frags, 80790 blocks, 0.1% fragmentation) g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT g_handleattr: vtbd0 bio_length 24 len 28 -> EFAULT Mounting local file systems:. From owner-freebsd-virtualization@FreeBSD.ORG Fri Feb 8 02:39:58 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id D4AAB321 for ; Fri, 8 Feb 2013 02:39:58 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 8A70AEE4 for ; Fri, 8 Feb 2013 02:39:58 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 9EAE711D85; Fri, 8 Feb 2013 12:39:50 +1000 (EST) Received: from 192-168-1-107.tpgi.com.au (110-174-216-99.static.tpgi.com.au [110.174.216.99]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BJV27138 (AUTH peterg@ptree32.com.au); Fri, 8 Feb 2013 12:39:50 +1000 Message-ID: <51146575.2080602@freebsd.org> Date: Fri, 08 Feb 2013 12:39:49 +1000 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: Sevan / Venture37 Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> <5114361F.8060303@gmail.com> In-Reply-To: <5114361F.8060303@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Feb 2013 02:39:58 -0000 Hi Sevan, > CPUTYPE?=corei7-avx Hmmm, could be from this. bhyve doesn't expose AVX to the guest (yet), so if user processes unconditionally use AVX instructions that may result in a coredump. > I can now make a guest panic if I assign 4GB or more RAM. What are the memory params you are using in this case ? later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Fri Feb 8 09:31:52 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 5ECBFA27 for ; Fri, 8 Feb 2013 09:31:52 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-la0-x233.google.com (la-in-x0233.1e100.net [IPv6:2a00:1450:4010:c03::233]) by mx1.freebsd.org (Postfix) with ESMTP id A44347CC for ; Fri, 8 Feb 2013 09:31:51 +0000 (UTC) Received: by mail-la0-f51.google.com with SMTP id fo13so3476983lab.24 for ; Fri, 08 Feb 2013 01:31:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=xxcb+l1YbnCVF7me1uwJuf+1dMerjVFQ4cQ6C/RovhM=; b=HUAAhtCcDUScpL08hGhfredQbwmvGzjU+1jHu3oGCTo2uOmdshcO3lahfI8LOfk7p5 Mum314cVrqLwp8DiusoBYIC0jbus4hrbasZv4gO+WnUEc+jE2xU8etuVnUr2g8eDnuok 54uARKrwZeo6kc4qEdtFrYmBvun5a2Wg3AP2j3/Ri97ztOD+lolYyZ2C4F7AIneqzdX1 w9wASKSnl8TfqB4vSTpGX91zKBkck+GSCd++TX2pDJrvPPXEqIaRxG4J0G1Ekbr1BWhS eKRNDZujBmG7swNeETExmWQOHdtavVLDo0jJF4qPxjxBz1Xn+f4/3Gb2avjAouWgMSU/ e0Fg== X-Received: by 10.112.88.9 with SMTP id bc9mr2031990lbb.22.1360315910435; Fri, 08 Feb 2013 01:31:50 -0800 (PST) Received: from Sevans-MacBook-Pro.local ([83.167.125.235]) by mx.google.com with ESMTPS id o2sm9854454lby.11.2013.02.08.01.31.48 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 08 Feb 2013 01:31:49 -0800 (PST) Message-ID: <5114C5B5.8030209@gmail.com> Date: Fri, 08 Feb 2013 13:30:29 +0400 From: Sevan / Venture37 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130107 Thunderbird/17.0.2 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> <5114361F.8060303@gmail.com> <51146575.2080602@freebsd.org> In-Reply-To: <51146575.2080602@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Feb 2013 09:31:52 -0000 On 08/02/2013 06:39, Peter Grehan wrote: > Hi Sevan, Hi Peter, >> CPUTYPE?=corei7-avx > > Hmmm, could be from this. bhyve doesn't expose AVX to the guest (yet), > so if user processes unconditionally use AVX instructions that may > result in a coredump. I see. >> I can now make a guest panic if I assign 4GB or more RAM. > > What are the memory params you are using in this case ? I've not made any changes on the host such as reserving memory. I'm starting the VM like so: sudo bhyveload -d myimge -m 4096 sevan && sudo bhyve -c 1 -a -A -m 4096 -I -H -g 0 -s 0:0,hostbridge -s 2:0,virtio-blk,myimage -s 1:0,virtio-net,tap0 -S 31,uart,stdio sevan Sevan From owner-freebsd-virtualization@FreeBSD.ORG Fri Feb 8 09:39:44 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 3B96B1CA for ; Fri, 8 Feb 2013 09:39:44 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id DCEB384B for ; Fri, 8 Feb 2013 09:39:43 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id C6B8611B51; Fri, 8 Feb 2013 19:39:41 +1000 (EST) Received: from 192-168-1-107.tpgi.com.au (110-174-216-99.static.tpgi.com.au [110.174.216.99]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BJV49828 (AUTH peterg@ptree32.com.au); Fri, 8 Feb 2013 19:39:41 +1000 Message-ID: <5114C7DC.6070106@freebsd.org> Date: Fri, 08 Feb 2013 19:39:40 +1000 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: Sevan / Venture37 Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> <5114361F.8060303@gmail.com> <51146575.2080602@freebsd.org> <5114C5B5.8030209@gmail.com> In-Reply-To: <5114C5B5.8030209@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Feb 2013 09:39:44 -0000 Hi Sevan, >>> I can now make a guest panic if I assign 4GB or more RAM. >> >> What are the memory params you are using in this case ? > > I've not made any changes on the host such as reserving memory. > I'm starting the VM like so: ... > -m 4096 Ah - that actually won't work. There has to be space for PCI MMIO decode below 4GB, so it's usually best to use up to say 2 or 3GB of RAM below the 4GB mark, leaving 1GB for PCI decode, and then put the remainder of your memory above 4G e.g. for 4GB total RAM, and using 2GB below 4G -m 2048 -M 2048 and an example 8G system: -m 2048 -M 6144 We should really error out on values too large for the '-m' parameter. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Fri Feb 8 10:00:42 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id E69069D4; Fri, 8 Feb 2013 10:00:42 +0000 (UTC) (envelope-from venture37@gmail.com) Received: from mail-ie0-x235.google.com (mail-ie0-x235.google.com [IPv6:2607:f8b0:4001:c03::235]) by mx1.freebsd.org (Postfix) with ESMTP id A5BB593F; Fri, 8 Feb 2013 10:00:42 +0000 (UTC) Received: by mail-ie0-f181.google.com with SMTP id 17so4768373iea.26 for ; Fri, 08 Feb 2013 02:00:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=TyvdkMBBj2XceeAwOm8oj9be/cJO21aEvYT2vbWQ4sU=; b=LrRNpSBgy9MmOIEkBjZldNaX3b7+2dIcOt99qNu/zWe0i600zS47Sq54SlHgvhZq03 Eq658eoFwQcOC4GZ1bY2VohiEdT/BSF8Qo+oU8eIgsY1bwxYC5onVVTunFQHQIiwiaYt aBhAKoRy0g9r9A90ler4tENs9fDiWuc3E+CZFtvDk0DZFcONALtWZPNZbYujT4HHZqCX 9Sju17vi6aWB6D7/llvAJqYr/Xz//bCxW5O/dFi/6toXLnvqAnUakMlRtVxcT81XpzeL ALHJVAg3nDnGkBBaOhx5an6rMbQqeIznUvsLvjrL5Oq5o1gYKU4Dy51NS/zHFruj9Qhc YTRA== X-Received: by 10.50.95.227 with SMTP id dn3mr1063095igb.99.1360317642357; Fri, 08 Feb 2013 02:00:42 -0800 (PST) Received: from Sevans-MacBook-Pro.local ([83.167.125.235]) by mx.google.com with ESMTPS id uj6sm14575224igb.4.2013.02.08.02.00.40 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 08 Feb 2013 02:00:41 -0800 (PST) Message-ID: <5114CC79.40605@gmail.com> Date: Fri, 08 Feb 2013 13:59:21 +0400 From: Sevan / Venture37 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130107 Thunderbird/17.0.2 MIME-Version: 1.0 To: Peter Grehan Subject: Re: bhyve hangs on going multi user References: <51132599.60506@gmail.com> <51136892.1020505@gmail.com> <5114361F.8060303@gmail.com> <51146575.2080602@freebsd.org> <5114C5B5.8030209@gmail.com> <5114C7DC.6070106@freebsd.org> In-Reply-To: <5114C7DC.6070106@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Feb 2013 10:00:43 -0000 On 08/02/2013 13:39, Peter Grehan wrote: > Ah - that actually won't work. There has to be space for PCI MMIO > decode below 4GB, so it's usually best to use up to say 2 or 3GB of RAM > below the 4GB mark, leaving 1GB for PCI decode, and then put the > remainder of your memory above 4G e.g. for 4GB total RAM, and using 2GB > below 4G > > -m 2048 -M 2048 > > and an example 8G system: > > -m 2048 -M 6144 > > We should really error out on values too large for the '-m' parameter. Thanks for that Peter :) Starting the VM with -m 2048 -M 14336 worked fine. FreeBSD 10.0-CURRENT #0 r246446: Thu Feb 7 12:21:37 UTC 2013 :/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3399.75-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping = 9 Features=0x8fa3ab7f Features2=0xe3bae257 AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant real memory = 19327352832 (18432 MB) avail memory = 16482443264 (15718 MB)