From owner-freebsd-virtualization@FreeBSD.ORG Sun Aug 19 19:12:08 2012 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1063D1065670 for ; Sun, 19 Aug 2012 19:12:08 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 7DDF98FC0A for ; Sun, 19 Aug 2012 19:12:06 +0000 (UTC) Received: by lbbgk8 with SMTP id gk8so3745232lbb.13 for ; Sun, 19 Aug 2012 12:12:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=oqsxFj0uwqGSpTIVrZRS3d0SO49yEpr1gfLbx9MPZHg=; b=HimKiEhVfT1NWCjIHFcIREhBHQXzMZRP/eBA7HRFecTOsb69os67/f2EVfJliYHcRD AB7h+5CIM5sMtiP6ShaDUpQ4/4kTtE6ucaeHHKq4ta33Oe7Ha5wU972CZKRj0faOieb4 6rBiCXGwzPZQxDDi6f/GJ4/mjI5kUw50ZN4gjynEAGwCD7BxtWdAdt0Dt+pz+qIA8xTi Pn1crc5I1AzJEjjoCZpb97516uYcHqH1MoPxq7dSKxgt7FhgawcriGaetFIdoAXjD8Ub BEWdip2aFQmbwlQyelbsujkkvgOX112asonkgrVpdtVo28IqzdnOe4zr5r4qTFnU6Ftt 5cRg== Received: by 10.112.84.65 with SMTP id w1mr5164700lby.40.1345403525390; Sun, 19 Aug 2012 12:12:05 -0700 (PDT) Received: from kloomba ([77.94.192.221]) by mx.google.com with ESMTPS id fd1sm3098569lbb.7.2012.08.19.12.12.03 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 19 Aug 2012 12:12:04 -0700 (PDT) Sender: Roman Bogorodskiy Date: Sun, 19 Aug 2012 23:11:29 +0400 From: Roman Bogorodskiy To: freebsd-virtualization@freebsd.org Message-ID: <20120819191127.GA1733@kloomba> References: <20120815155222.GA46502@kloomba> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="YiEDa0DAkWCtVeE4" Content-Disposition: inline In-Reply-To: <20120815155222.GA46502@kloomba> User-Agent: Mutt/1.5.21 (2010-09-15) Subject: Re: BHyVe: vm_setup_memory(highmem): Cannot allocate memory X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Aug 2012 19:12:08 -0000 --YiEDa0DAkWCtVeE4 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Roman Bogorodskiy wrote: > Hi, >=20 > I'm running into a problem. I did a fresh checkout of 'bhyve' branch > from svn and followed the instruction here: >=20 > http://people.freebsd.org/~neel/bhyve/bhyve_instructions.txt >=20 > In my /boot/loader.conf I have: >=20 > debug.witness.watch=3D"0" > hw.physmem=3D"0x180000000" >=20 > and dmesg says: >=20 > real memory =3D 8589934592 (8192 MB) > avail memory =3D 5643694080 (5382 MB) >=20 > When I try to start a VM I get this error: >=20 > (19:46) novel@kloomba:~/bhyve/vm1 %> sudo ./vmrun.sh -m 256 vm1 > Launching virtual machine "vm1" with 256MB memory below 4GB and 2048MB me= mory above 4GB ... > vm_setup_memory(highmem): Cannot allocate memory > (19:46) novel@kloomba:~/bhyve/vm1 %>=20 >=20 > This page: >=20 > http://callfortesting.org/bhyve/ >=20 > describes that reloading 'vmm' would help, but doing it changes nothing. >=20 > Any ideas what's wrong with that? Also, I am curious, what do these > numbers mean: >=20 > "256MB memory below 4GB and 2048MB memory above 4GB". I get that 256 is > the amount of mem to give to VM, but what do 4GB and 2048MB stand for? I have managed to boot a VM. The 4GB thing is hardcoded in the vmrun.sh script: 110 echo "Launching virtual machine \"$vmname\" with ${lowmem}MB memory below 4GB and ${highmem}MB memory above 4GB ..." Also, it seems it's hardcoded in bhyveload.c: if (highmem !=3D 0) { error =3D vm_setup_memory(ctx, 4 * GB, highmem, NULL); <---= here if (error) { perror("vm_setup_memory(highmem)"); exit(1); } } I used './vmrun.sh -m 512 -M 0 vm1' which sets highmem =3D=3D 0 to avoid th= is call. Roman Bogorodskiy --YiEDa0DAkWCtVeE4 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iQEcBAEBAgAGBQJQMTpfAAoJEMltX/4IwiJq+h8H/iMnDW4eR/DftPkdFIzVIzWe ywfxlBHlL+nreFUvZGYttUOTxHiHCJTGpGsmFlIzdvApxDosiUxaBiSygBl7oB3P +og8Yp8RZK07W1QhSa3hECwK4o14q5HgG23FKl5Oufl/HjzKJclvLYelHxnIpZop NdwLJGRsIyCFK8Bg1pUuJX2f7YdjrhMV/OaG2U6ygJ/FMh9SxMoZQe+ziqbbfz85 hRBC3CTS0w6h/E/xAUU/loK8ESa2ceZaXkiruIENwfN1XqQF+c6jiEXNviJ3xBgO T++bOfiMDP5ebsSjJox4epbp1TP+2ipVAvdUJ+6sau4uoHkmSJ9BbEDoJACKhnQ= =6VdT -----END PGP SIGNATURE----- --YiEDa0DAkWCtVeE4-- From owner-freebsd-virtualization@FreeBSD.ORG Mon Aug 20 05:12:30 2012 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D93A8106564A; Mon, 20 Aug 2012 05:12:30 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 8D8948FC0C; Mon, 20 Aug 2012 05:12:30 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 233BD122E5; Mon, 20 Aug 2012 15:05:29 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro.local (c-71-56-248-150.hsd1.co.comcast.net [71.56.248.150]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BFW38890 (AUTH peterg@ptree32.com.au); Mon, 20 Aug 2012 15:05:26 +1000 Message-ID: <5031C58C.40108@freebsd.org> Date: Sun, 19 Aug 2012 23:05:16 -0600 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: Roman Bogorodskiy References: <20120815155222.GA46502@kloomba> <20120819191127.GA1733@kloomba> In-Reply-To: <20120819191127.GA1733@kloomba> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Junkmail-Info: RCVD_IN_SORBS_DUL,RDNS_DYNAMIC,SPF_SOFTFAIL X-Junkmail-Status: score=24/51, host=dommail.onthenet.com.au Cc: freebsd-virtualization@freebsd.org Subject: Re: BHyVe: vm_setup_memory(highmem): Cannot allocate memory X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Aug 2012 05:12:31 -0000 Hi Roman, > I have managed to boot a VM. Great ! > The 4GB thing is hardcoded in the vmrun.sh script: The bhyve memory parameters mirror standard PC architecture. RAM is usually contiguous below 4GB, with the region from top-of-RAM to 4GB reserved for PCI memory-mapped i/o space. Additional RAM is usually contiguous and starts from 4GB. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Mon Aug 20 11:08:07 2012 Return-Path: Delivered-To: freebsd-virtualization@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8B64106568F for ; Mon, 20 Aug 2012 11:08:07 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id B1D948FC16 for ; Mon, 20 Aug 2012 11:08:07 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q7KB87tM048230 for ; Mon, 20 Aug 2012 11:08:07 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q7KB86Ju048220 for freebsd-virtualization@FreeBSD.org; Mon, 20 Aug 2012 11:08:06 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 20 Aug 2012 11:08:06 GMT Message-Id: <201208201108.q7KB86Ju048220@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-virtualization@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-virtualization@FreeBSD.org X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Aug 2012 11:08:07 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/170096 virtualization[vimage] Dynamically-attached network interface will c o kern/169991 virtualization[run] [vimage] panic after device plugged in o kern/165252 virtualization[vimage] [pf] [panic] kernel panics with VIMAGE and PF o kern/161094 virtualization[vimage] [pf] [panic] kernel panic with pf + VIMAGE wh o kern/160541 virtualization[vimage][pf][patch] panic: userret: Returning on td 0x o kern/160496 virtualization[vimage] [pf] [patch] kernel panic with pf + VIMAGE f kern/152047 virtualization[vimage] [panic] TUN\TAP under jail with vimage crashe o kern/148155 virtualization[vimage] [pf] Kernel panic with PF/IPFilter + VIMAGE k a kern/147950 virtualization[vimage] [carp] VIMAGE + CARP = kernel crash s kern/143808 virtualization[pf] pf does not work inside jail a kern/141696 virtualization[rum] [vimage] [panic] rum(4)+ vimage = kernel panic 11 problems total. From owner-freebsd-virtualization@FreeBSD.ORG Mon Aug 20 13:36:50 2012 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D9F101065677; Mon, 20 Aug 2012 13:36:50 +0000 (UTC) (envelope-from bogorodskiy@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id EE31F8FC19; Mon, 20 Aug 2012 13:36:49 +0000 (UTC) Received: by lbbgg13 with SMTP id gg13so345915lbb.13 for ; Mon, 20 Aug 2012 06:36:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=aLi3IJFDTqocfdpmmr921xlt9I4/RfxOUNksBg6Q8WM=; b=bBfVKWbSDUikIElT0nSPCrI3cFvZMLKAHLtKUQwCX8xnGpLmUyob6bqs4ZNos//WuH Zhn0XQCzR5ieuysN6y/pvGDUhdOqnQdQts/EfrG5sFz6g3QZZS+HqtF6JlppimKf5Z/q ST3h5t+e+vddtBB0/haIdo0Q+wKKpRbzRAXIrUmzPdOI+cOx4Riqv5aprXPP7Nw8ecZ7 UZQCRJqDSp5CJG+6zHfMntUuk0WdtwWCXr4RCW5rtw6A/ecOw/Bhffrz5eFUIKPDvTgI Kh75R1QYiYxZY2/UPXipimTFMh87VfFq7vLMu0xHAAYVxf4qAzv9lnUyktUoWZ6cpkk/ TWOA== Received: by 10.112.9.3 with SMTP id v3mr6168798lba.32.1345469808671; Mon, 20 Aug 2012 06:36:48 -0700 (PDT) Received: from kloomba ([77.94.197.173]) by mx.google.com with ESMTPS id hz16sm15813229lab.6.2012.08.20.06.36.47 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 20 Aug 2012 06:36:47 -0700 (PDT) Sender: Roman Bogorodskiy Date: Mon, 20 Aug 2012 17:36:14 +0400 From: Roman Bogorodskiy To: Peter Grehan Message-ID: <20120820133613.GA1701@kloomba> References: <20120815155222.GA46502@kloomba> <20120819191127.GA1733@kloomba> <5031C58C.40108@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FCuugMFkClbJLl1L" Content-Disposition: inline In-Reply-To: <5031C58C.40108@freebsd.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-virtualization@freebsd.org Subject: Re: BHyVe: vm_setup_memory(highmem): Cannot allocate memory X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Aug 2012 13:36:51 -0000 --FCuugMFkClbJLl1L Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Peter Grehan wrote: > Hi Roman, >=20 > > I have managed to boot a VM. >=20 > Great ! >=20 > > The 4GB thing is hardcoded in the vmrun.sh script: >=20 > The bhyve memory parameters mirror standard PC architecture. RAM is=20 > usually contiguous below 4GB, with the region from top-of-RAM to 4GB=20 > reserved for PCI memory-mapped i/o space. Additional RAM is usually=20 > contiguous and starts from 4GB. Yeah, but I'd like to leave more memory for the host system, so I specified 6GB. I have 8GB at all, so 2GB left for VMs. Should it cause any problems? BTW, I encountered a problem with the tap0 device. I create a tap device and assign an address to it, using 'ifconfig tap0 192.168.1.1 up'. I boot a VM and everything goes fine. When I do 'reboot' in the guest, it reboots, but tap0 on the host goes down and its address is dropped. Is that an expected behaviour? Roman Bogorodskiy --FCuugMFkClbJLl1L Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iQEcBAEBAgAGBQJQMj1NAAoJEMltX/4IwiJqTrgH/jDHla8vyMHJjCjkfLiNMPRJ 2NbutW833Dc4KQinc2iJ0Npk28cHzYdOCvxt6NjLBl0nc+kOCBM/QbxzKGsmdHg2 SaP14Rba/6MlnEr06ya24oFIFsr0Uocx6INMZj6LKMzgKiy9S3tGM0pWFYDeXIUe MkWz2Td1GC7wWLFcl47kA6JlOl5Arr9ngPszo/1J420A8MlB10QtxT8RoZHiLT1r Po6ah4QmHnMPetzNkH8+NwYqYkbKfl2jiYxNto3G+/DE0FxZbzJEeWxS6Fxz4C3x RwRQNhxNNVXX+SkkVAbZ32UMalGNaOMUJpB12IywhiHrtgw/flSfPm3YkV/Rq5g= =Cq++ -----END PGP SIGNATURE----- --FCuugMFkClbJLl1L-- From owner-freebsd-virtualization@FreeBSD.ORG Mon Aug 20 13:58:16 2012 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A7AC91065672; Mon, 20 Aug 2012 13:58:16 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 5A4E28FC0A; Mon, 20 Aug 2012 13:58:16 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTPS id 66F5B118E3; Mon, 20 Aug 2012 23:58:14 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro.local (c-71-56-248-150.hsd1.co.comcast.net [71.56.248.150]) by dommail.onthenet.com.au (MOS 4.2.4-GA) with ESMTP id BFW56369 (AUTH peterg@ptree32.com.au); Mon, 20 Aug 2012 23:58:11 +1000 Message-ID: <50324270.9040504@freebsd.org> Date: Mon, 20 Aug 2012 07:58:08 -0600 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: Roman Bogorodskiy References: <20120815155222.GA46502@kloomba> <20120819191127.GA1733@kloomba> <5031C58C.40108@freebsd.org> <20120820133613.GA1701@kloomba> In-Reply-To: <20120820133613.GA1701@kloomba> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Junkmail-Info: RCVD_IN_SORBS_DUL,RDNS_DYNAMIC,SPF_SOFTFAIL X-Junkmail-Status: score=24/51, host=dommail.onthenet.com.au Cc: freebsd-virtualization@freebsd.org Subject: Re: BHyVe: vm_setup_memory(highmem): Cannot allocate memory X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Aug 2012 13:58:16 -0000 Hi Roman, > Yeah, but I'd like to leave more memory for the host system, so I > specified 6GB. I have 8GB at all, so 2GB left for VMs. > Should it cause any problems? No, that should be fine. > BTW, I encountered a problem with the tap0 device. I create a tap device > and assign an address to it, using 'ifconfig tap0 192.168.1.1 up'. > > I boot a VM and everything goes fine. When I do 'reboot' in the guest, > it reboots, but tap0 on the host goes down and its address is dropped. > Is that an expected behaviour? Yes - we probably need to fix the tap device to not do that :( later, Peter.