From owner-freebsd-virtualization@FreeBSD.ORG Sun May 10 13:17:02 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F3240AB5 for ; Sun, 10 May 2015 13:17:01 +0000 (UTC) Received: from mail2.openmailbox.org (mail2.openmailbox.org [62.4.1.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B38CB1CA8 for ; Sun, 10 May 2015 13:17:01 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail2.openmailbox.org (Postfix) with ESMTP id D1A9820345E; Sun, 10 May 2015 15:16:51 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=openmailbox.org; h=user-agent:message-id:references:in-reply-to:subject:subject :from:from:date:date:content-transfer-encoding:content-type :content-type:mime-version:received:received; s=openmailbox; t= 1431263810; bh=9BN6HXpijYHFNGam0wRCKNEuHj2xxjnEkjrp3xkckT4=; b=c BpDjP/MIqEilcjckdI4LbBGDoRD7VXoTazRDOOoDjPmZZv399yzpasZ1b9UnpKYC Oykf05AfVcxyMDr8QjYefeZf37pgFSDAS7+nWWfQm9UX1fzm+8NTvpM3MF/P0mWI 7xFqHUYngDdhHH1Avn5npy3GV1Suin1Tyod3FP08TU= X-Virus-Scanned: amavisd-new at openmailbox.org Received: from mail2.openmailbox.org ([62.4.1.33]) by localhost (mail.openmailbox.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id s5GFDjOFdXKE; Sun, 10 May 2015 15:16:50 +0200 (CEST) Received: from www.openmailbox.org (mail2.openmailbox.org [62.4.1.33]) by mail2.openmailbox.org (Postfix) with ESMTP id 06397202D8F; Sun, 10 May 2015 15:16:49 +0200 (CEST) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Sun, 10 May 2015 18:46:49 +0530 From: Tinker To: Neel Natu Cc: freebsd-virtualization@freebsd.org Subject: Re: Is the BHyVe guest as suitable for high-performance disk IO as the =?UTF-8?Q?host=3F?= In-Reply-To: References: <7dd04a4cec612d18110a00b9020fd948@openmailbox.org> Message-ID: X-Sender: tinkr@openmailbox.org User-Agent: Roundcube Webmail/1.0.5 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 May 2015 13:17:02 -0000 Hi Neel, Thank you very much for your response - That's great! I guess this should deliver the full capacity for basically any IO system around, be it a fast SSD or ramdisk. (Since the guest may not need to flush data immediately to the host, I guess read performance is the more sensitive point.) Which disk emulation mode is best for a BSD guest, "virtio-blk" or "ahci-hd"? In general, should any other consideration be made for performance (using the "direct" or "nocache" BHyVe configuration options, particular consideration for proper sector alignment when using a disk image stored on the host's SSD-based ZFS, mounting the host ZFS filesystem with "noatime")? Kind regards, Tinker On 2015-05-10 04:03, Neel Natu wrote: > Hi Tinker, > > On Sat, May 9, 2015 at 9:49 AM, Tinker wrote: >> Hi! >> >> For an environment with very heavy parallell IO, should the >> performance be >> just as good in a BHyVe guest as in the FreeBSD host environment? >> >> What I thought of is that I guess within the host environment, the >> storage >> subsystem should have all kinds of optimizations like an internal work >> queue >> that pushes lots of work alinearly/asynchronously to the disk >> controller and >> this way allows it, in turn, to give all its performance. >> >> Does the virtualized disk interface carry over all that goodness to >> the >> guest? >> > > bhyve creates 8 worker threads for each virtual disk controller (both > ahci and virtio-blk). > > All guest I/O is handled asynchronously by these worker threads which > provide parallelism. > >> (https://wiki.freebsd.org/bhyve seems to say yes, presuming you >> configure >> BHyVe to run the virtual disk in AHCI mode?) >> > > The wiki is out of date. > > Since r280037 the virtio-blk emulation also gets the benefits of using > the block_if worker threads. > > best > Neel > >> Thanks! >> Tinker >> >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to >> "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@FreeBSD.ORG Sun May 10 15:17:43 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 34AD476E for ; Sun, 10 May 2015 15:17:43 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0F50318C1 for ; Sun, 10 May 2015 15:17:43 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4AFHgkq037463 for ; Sun, 10 May 2015 15:17:42 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4AFHgPb037462; Sun, 10 May 2015 15:17:42 GMT (envelope-from daemon-user) Date: Sun, 10 May 2015 15:17:42 +0000 To: freebsd-virtualization@freebsd.org From: "julian (JulianElischer)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <4c428611459d8c6f054d4ea9a42bfbb4@localhost.localdomain> X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVPdpY= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: , MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 May 2015 15:17:43 -0000 julian added a subscriber: julian. julian added a comment. in case I didn't point you at this before... http://p4web.freebsd.org/@md=d&cd=//depot/projects/vimage/&cdf=//depot/projects/vimage/porting_to_vimage.txt&c=win@//depot/projects/vimage/porting_to_vimage.txt?ac=22 REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net From owner-freebsd-virtualization@FreeBSD.ORG Mon May 11 04:30:45 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8DDB8793 for ; Mon, 11 May 2015 04:30:45 +0000 (UTC) Received: from mail-wi0-x233.google.com (mail-wi0-x233.google.com [IPv6:2a00:1450:400c:c05::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 26736168C for ; Mon, 11 May 2015 04:30:45 +0000 (UTC) Received: by wizk4 with SMTP id k4so90116946wiz.1 for ; Sun, 10 May 2015 21:30:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=SXGuz0CBJPVCXPMmasv3B10+gPhQwi6I2CvyTFbxO18=; b=FGc53NmEpSMqfoNcdTxiIdyUGQ2Zy32XK3CDHOEg8QFqJP9lTRCc87TdsWGwW9QNzD vzCtY96Tclr4wn+UwskwcfvsxY/uKXO4VeE1lhUwwqgXL4U1cgEsomDP7uQxqulNZqz0 bOJv8sD5n0vB+ePolV/aJqRgvbdM+g1wic6X1xQbzxoQjBOh1AYUMNqj4CU/f48vFGM0 Okr7KfoguzumwaTgwnzJHJq7cWZIwm7uftCbwB9xn6lBwtj7/fMME4npm4tzYvj00IAJ 4efP+pKZP0w7yo5CV5jMn+uBdLS7g5ZcwIGwJ5cqjSw3O7GssLobmSfD+5dYxrAEYimS rmeg== MIME-Version: 1.0 X-Received: by 10.194.204.230 with SMTP id lb6mr16341829wjc.63.1431318642830; Sun, 10 May 2015 21:30:42 -0700 (PDT) Received: by 10.27.52.18 with HTTP; Sun, 10 May 2015 21:30:42 -0700 (PDT) In-Reply-To: References: <7dd04a4cec612d18110a00b9020fd948@openmailbox.org> Date: Sun, 10 May 2015 21:30:42 -0700 Message-ID: Subject: Re: Is the BHyVe guest as suitable for high-performance disk IO as the host? From: Neel Natu To: Tinker Cc: "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 May 2015 04:30:45 -0000 Hi Tinker, On Sun, May 10, 2015 at 6:16 AM, Tinker wrote: > Hi Neel, > > Thank you very much for your response - > > That's great! > > I guess this should deliver the full capacity for basically any IO system > around, be it a fast SSD or ramdisk. (Since the guest may not need to flush > data immediately to the host, I guess read performance is the more sensitive > point.) > > Which disk emulation mode is best for a BSD guest, "virtio-blk" or > "ahci-hd"? > You'll need to experiment because there are so many moving pieces: the guest driver implementation, VM exit overhead, capabilities of a emulated disk controller. From the narrow perspective of VM-exit overhead 'virtio-blk' is better because the CPU decodes all the information needed to handle the I/O exit. > In general, should any other consideration be made for performance (using > the "direct" or "nocache" BHyVe configuration options, particular > consideration for proper sector alignment when using a disk image stored on > the host's SSD-based ZFS, mounting the host ZFS filesystem with "noatime")? > Using "nocache" will prevent double-buffering of the virtual disk file in the host. Using "direct" will guarantee consistency of the virtual disk file on the underlying storage device. If you are purely focused on performance then don't use either option but be aware that you'll be using buffer cache on the host and also that the guest filesystem could be corrupted on an unplanned host shutdown. With respect to alignment I am not sure if you can request a specific alignment when creating a flat file for the virtual disk. However, if you use a ZVOL as a backing device then it can be created on top of a partition which has the correct alignment. best Neel > Kind regards, > Tinker > > > On 2015-05-10 04:03, Neel Natu wrote: >> >> Hi Tinker, >> >> On Sat, May 9, 2015 at 9:49 AM, Tinker wrote: >>> >>> Hi! >>> >>> For an environment with very heavy parallell IO, should the performance >>> be >>> just as good in a BHyVe guest as in the FreeBSD host environment? >>> >>> What I thought of is that I guess within the host environment, the >>> storage >>> subsystem should have all kinds of optimizations like an internal work >>> queue >>> that pushes lots of work alinearly/asynchronously to the disk controller >>> and >>> this way allows it, in turn, to give all its performance. >>> >>> Does the virtualized disk interface carry over all that goodness to the >>> guest? >>> >> >> bhyve creates 8 worker threads for each virtual disk controller (both >> ahci and virtio-blk). >> >> All guest I/O is handled asynchronously by these worker threads which >> provide parallelism. >> >>> (https://wiki.freebsd.org/bhyve seems to say yes, presuming you configure >>> BHyVe to run the virtual disk in AHCI mode?) >>> >> >> The wiki is out of date. >> >> Since r280037 the virtio-blk emulation also gets the benefits of using >> the block_if worker threads. >> >> best >> Neel >> >>> Thanks! >>> Tinker >>> >>> _______________________________________________ >>> freebsd-virtualization@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >>> To unsubscribe, send any mail to >>> "freebsd-virtualization-unsubscribe@freebsd.org" > > From owner-freebsd-virtualization@FreeBSD.ORG Mon May 11 10:48:14 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AB1D9A48 for ; Mon, 11 May 2015 10:48:14 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8B3341F45 for ; Mon, 11 May 2015 10:48:14 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4BAmESN066982 for ; Mon, 11 May 2015 10:48:14 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4BAmEu9066981; Mon, 11 May 2015 10:48:14 GMT (envelope-from daemon-user) Date: Mon, 11 May 2015 10:48:14 +0000 To: freebsd-virtualization@freebsd.org From: "nvass-gmx.com (Nikos Vassiliadis)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVQiO4= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 May 2015 10:48:14 -0000 nvass-gmx.com added a comment. This guilde is definitely invaluable, I have seen it. It would be great if we could move it in the source tree. Regarding PF it can be further simplified. I think the logic right is OK but there are many *init* functions for sure and some of these functions can go away. Maybe we could do that a step two? REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net From owner-freebsd-virtualization@FreeBSD.ORG Mon May 11 16:55:25 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 15B223C6; Mon, 11 May 2015 16:55:25 +0000 (UTC) Received: from mail-la0-x22b.google.com (mail-la0-x22b.google.com [IPv6:2a00:1450:4010:c03::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8E0A91C5F; Mon, 11 May 2015 16:55:24 +0000 (UTC) Received: by labbd9 with SMTP id bd9so97806533lab.2; Mon, 11 May 2015 09:55:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=2+21WZ482S3oZ5vY2VLrPpw/A1NZ+z30kUxCIA5Bwpk=; b=u5RpM5O3JHjLyR1cvwCpIH0eB16olW7eX4BFMknzqwbeBC8q+SXxPa0idNW5uTXOM7 mCvnpSGqJpcLTKEcaGJr4MDTSj78rjXSP9B0tEdPY8uXeeW42N/ePrKSJLL1ijs43KXo UA4K94GNnPv255/GISiDHTYMW5I0K9lB3w18DyV1mgpu6WlAUU6LQYeQYSnc+pxzv9IE 8FsIg2/0sp1UbOCz6HGezVzibABT/nr6BcTyzSMSPeJSocu/lv+kJ7OGc9ovq7kwMysP JkHG4a+YRhDRvMSgm7ntpv20kT2VlYExbcyTX/0mRAZ2nZDCNywbK0rOcpCbNTfXOjyQ FJ9g== X-Received: by 10.112.219.201 with SMTP id pq9mr8789758lbc.109.1431363322471; Mon, 11 May 2015 09:55:22 -0700 (PDT) Received: from kloomba ([31.29.236.164]) by mx.google.com with ESMTPSA id u15sm3166079lal.4.2015.05.11.09.55.20 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 11 May 2015 09:55:21 -0700 (PDT) Sender: Roman Bogorodskiy Date: Mon, 11 May 2015 19:55:04 +0300 From: Roman Bogorodskiy To: freebsd-virtualization@freebsd.org Cc: royger@freebsd.org, bapt@freebsd.org Subject: Re: xen_kernel, console and X11 Message-ID: <20150511165503.GD1004@kloomba> References: <20150502154340.GA8333@kloomba> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="4zI0WCX1RcnW9Hbu" Content-Disposition: inline In-Reply-To: <20150502154340.GA8333@kloomba> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 May 2015 16:55:25 -0000 --4zI0WCX1RcnW9Hbu Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Roman Bogorodskiy wrote: > With this setup I get my system booted and at some point I can see a > login screen. When I type 'startx' the system freezes. Have to hard > reboot it to get working again. Update: I was bothering Roger off-list and he helped to figure out that the problem with X11 is closely related to nvidia-driver (the one from x11/nvidia-driver port). There's no solution how to make it work so far. Roman Bogorodskiy --4zI0WCX1RcnW9Hbu Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJVUN7nAAoJEMltX/4IwiJqUGYH/RWt4nOKWQWhUeccPm20ZZ9k Rk7rSG1WFwtCNpcysDU0ueJX7VEg/tnSRfTURjkyaT6aSvMpdnnapCDwDpMY7M64 heOqxGFxbTc4ZgfcdR/+GHz7BAoNX4Xb62ymg4txs3KZm6zlcm2TXB7rZNe8pzhV c79ljxBIYO7v20dVnd9vd1S+sidtYpI+FFlBpvTlUe3rLuIfuB7pmVemTvkwqD44 IwtC9ZIlhRCnPjjnVkxSPYqrCPjCOWXWKWMHeGkT7ZVmKbaZHos4xxU/4dgqumZg qyyaKf1Qm4dkR2HwgV6y1uMRFsKrht3Xl62zkcquDbL4HLyzzAnr58hMrrIXrA4= =yoMO -----END PGP SIGNATURE----- --4zI0WCX1RcnW9Hbu-- From owner-freebsd-virtualization@FreeBSD.ORG Tue May 12 14:01:24 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A92734BD for ; Tue, 12 May 2015 14:01:24 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass DE-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 41F6311A3 for ; Tue, 12 May 2015 14:01:24 +0000 (UTC) Received: from moby.local ([92.211.154.134]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0Lg0sd-1ZXt8y3f4t-00pb65 for ; Tue, 12 May 2015 16:01:15 +0200 Message-ID: <55520784.9050508@gmx.com> Date: Tue, 12 May 2015 16:00:36 +0200 From: Nikos Vassiliadis User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "freebsd-virtualization@freebsd.org" Subject: adding vtnet to bridge results to kernel panic Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K0:tHi6h2lOl1/wWuXNhIO5oKjUUzzc3tPb+5pRLdSu4DGv9nqRFql Rv15vlPwgaI9bEIQxHE8d5gaFPB0+ly6P8hy7HDBcoJ+ZYv8ziO/tM+poQdCekA7HcVNgHz 9JsRemtlcZNTrr1uMB4PF82mXiN5YNUVCCQJPvm7KXHEcDbEXY4ISlw05DvZ4mMDlx1jj1Y juwWkSy3jd4OZ2xFVusvA== X-UI-Out-Filterresults: notjunk:1; X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 May 2015 14:01:24 -0000 Hi, I get this panic when I add vtnet0 to a bridge. > > Unread portion of the kernel message buffer: > panic: if_setflag: decrement non-positive refcount 0 for flag 256 > cpuid = 1 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01a5be54c0 > vpanic() at vpanic+0x189/frame 0xfffffe01a5be5540 > kassert_panic() at kassert_panic+0x132/frame 0xfffffe01a5be55b0 > if_setflag() at if_setflag+0x147/frame 0xfffffe01a5be5610 > ifpromisc() at ifpromisc+0x2c/frame 0xfffffe01a5be5640 > bridge_delete_member() at bridge_delete_member+0x3a8/frame 0xfffffe01a5be56c0 > bridge_ioctl_add() at bridge_ioctl_add+0x574/frame 0xfffffe01a5be5710 > bridge_ioctl() at bridge_ioctl+0x1ad/frame 0xfffffe01a5be57b0 > ifioctl() at ifioctl+0x9df/frame 0xfffffe01a5be5860 > kern_ioctl() at kern_ioctl+0x230/frame 0xfffffe01a5be58c0 > sys_ioctl() at sys_ioctl+0x153/frame 0xfffffe01a5be59a0 > amd64_syscall() at amd64_syscall+0x27f/frame 0xfffffe01a5be5ab0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe01a5be5ab0 > --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8011e09aa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe2a0 --- > KDB: enter: panic Thanks in advance for any ideas, Nikos From owner-freebsd-virtualization@FreeBSD.ORG Wed May 13 06:34:34 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0ECE2A87 for ; Wed, 13 May 2015 06:34:34 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DE05E13BC for ; Wed, 13 May 2015 06:34:33 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4D6YXUB061760 for ; Wed, 13 May 2015 06:34:33 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4D6YX0k061759; Wed, 13 May 2015 06:34:33 GMT (envelope-from daemon-user) Date: Wed, 13 May 2015 06:34:33 +0000 To: freebsd-virtualization@freebsd.org From: "rodrigc (Craig Rodrigues)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <0e22a32ab27d9fdb9f57597f657e7f70@localhost.localdomain> X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVS8Hk= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 May 2015 06:34:34 -0000 rodrigc added a comment. In https://reviews.freebsd.org/D1944#46127, @julian wrote: > in case I didn't point you at this before... > http://p4web.freebsd.org/@md=d&cd=//depot/projects/vimage/&cdf=//depot/projects/vimage/porting_to_vimage.txt&c=win@//depot/projects/vimage/porting_to_vimage.txt?ac=22 @julian , I have copied this to: https://wiki.freebsd.org/VIMAGE/porting-to-vimage so that this isn't buried in Perforce. REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net From owner-freebsd-virtualization@FreeBSD.ORG Wed May 13 23:15:24 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D356B3F5 for ; Wed, 13 May 2015 23:15:24 +0000 (UTC) Received: from mail-ie0-x235.google.com (mail-ie0-x235.google.com [IPv6:2607:f8b0:4001:c03::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9BC9E15BD for ; Wed, 13 May 2015 23:15:24 +0000 (UTC) Received: by iebgx4 with SMTP id gx4so46157924ieb.0 for ; Wed, 13 May 2015 16:15:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=Q4l4GrBLyRGWIiXOADzWEg6j5Z0SwrBZt8Ex63/xEm0=; b=M4rjT0TV/+c9tJ9adZadRKv6gjl45uEuuZmFMKbrB3IB6mf23PVBjXftpigyf0BBpD kk50C2/RxwxLKAej2wY1w5hjrP+OCuXu3ojlDAOwrvyJ6UsOMp1QwIf+eo2joMjjMtzg s1W2a5iy5ZVvJ4QezMKDo46CO5tFP+6goTnbyDb+KKa2GBKOFpyEuyBFi0TT5tXiTI+Q D+4VIILv+J3PbC2yOB9gu7VSZ7NOSOwQIxGBatmElvVVleJ4fmABJraKmqjgdoKZHnx5 iuzdcVdIdCcr1FRXaLt5gbi63T+ZsmqLzVez+z9KSOkL25H7+0esuct4TNKb+Qy/xrFA XkhA== MIME-Version: 1.0 X-Received: by 10.50.50.148 with SMTP id c20mr31257999igo.0.1431558923971; Wed, 13 May 2015 16:15:23 -0700 (PDT) Received: by 10.50.207.5 with HTTP; Wed, 13 May 2015 16:15:23 -0700 (PDT) Date: Wed, 13 May 2015 16:15:23 -0700 Message-ID: Subject: Nested virtualization networking issues with bhyve From: Jonathan Wong To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 May 2015 23:15:25 -0000 I've recently tried to experiment with vmware esxi 6 + vmworkstation and I managed to get nested virtualization with freebsd guest and nested bhyve ubuntu VM working. However, the networking doesn't seem to come up properly while installing, and post install for the ubuntu VM. The bridged networking works as expected with freebsd guests and other network nodes on the network. However, the nested VMs themselves can't seem to bring up networking properly. lspci seems to bring up the virtio network device, but even configuring static ips doesn't help. The VM is not able to receive or route any packets from any VM FreeBSD guest can ssh into the nested VM. The nested VM can ssh into freebsd guest. The nested VM cannot contact internet or local gateway. Tried with E1000 and VMXNET 2. Computers on network can ssh into freebsd guest. The freebsd guest can ssh into other computers on the network. Computers on the network cannot contact the VM. The vmware host cannot contact the nested VM or vice versa. Any tips to getting this to work? Thanks. From owner-freebsd-virtualization@FreeBSD.ORG Wed May 13 23:41:43 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F0B14E18 for ; Wed, 13 May 2015 23:41:43 +0000 (UTC) Received: from mail-ie0-x229.google.com (mail-ie0-x229.google.com [IPv6:2607:f8b0:4001:c03::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B8C9418F9 for ; Wed, 13 May 2015 23:41:43 +0000 (UTC) Received: by iebgx4 with SMTP id gx4so46564095ieb.0 for ; Wed, 13 May 2015 16:41:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type; bh=G22yWi3C+D8aEhPE/9RRIXhCLd+KrqLEz43F+CoGxoI=; b=v22sffJTeFi+Nb8wM1x3o63/EgEF2miZvhbo9GTObw8pe4V/O6bZ5WO2RKcqngqLx1 vduMVYf/1ytlqb45fRV/8uiUKWouR2PbRdeAC8XElnW23cc77tSJg7mvn32+xKcYSdKC evUs9KHU5cZGHdrA5cOyQ2bQsFFe6Af6Wxq4VYw7YqYu1216oy3WKCzMMiEMCYyb0eyL oQqvsMlSZSnOerKWYF+7XcOSuCAw6duB68mDqbx3/fu8lhW4M2pMbc+3tYswrzFfGY2F JdLiCcktGOBnH+5iKWWCzO/okhL6i1vwlu0FLI8PJ95hpLEf1zv8f5CDGlmwzwbxT4c6 pcNw== X-Received: by 10.107.26.207 with SMTP id a198mr1712733ioa.5.1431560503003; Wed, 13 May 2015 16:41:43 -0700 (PDT) Received: from [192.168.0.101] ([209.195.113.231]) by mx.google.com with ESMTPSA id l128sm15350427iol.1.2015.05.13.16.41.42 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 13 May 2015 16:41:42 -0700 (PDT) Message-ID: <5553E12F.50506@gmail.com> Date: Wed, 13 May 2015 19:41:35 -0400 From: Manas Bhatnagar User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Bhyve error with Debian 8 Content-Type: multipart/mixed; boundary="------------000605030708080703060707" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 May 2015 23:41:44 -0000 This is a multi-part message in MIME format. --------------000605030708080703060707 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hello, Please see the attached file. I am running FreeBSD 10.1-RELEASE-p9. I am running into an error while trying to install Debian 8 as a Bhyve guest. The error occurs at the step of creating the partitions on the disk. Any fix or workaround is welcome. Thanks, Manas --------------000605030708080703060707 Content-Type: text/plain; charset=windows-1252; name="debian8-bhyve-13_may_2015.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="debian8-bhyve-13_may_2015.txt" ICB4IFsgIDM4MC4zNzI0NjRdIEJVRzogdW5hYmxlIHRvIGhhbmRsZSBrZXJuZWwgcGFnaW5n IHJlcXVlc3QgYXQgMDAwMDAwMDAxMDAyMDAwMA0KWyAgMzgwLjM3MzI4Nl0gSVA6IFs8ZmZm ZmZmZmY4MTI4NDdkZT5dIF9fYmxrX2Jpb3NfbWFwX3NnKzB4MWRlLzB4NDAwICAgICAgIHgN ClsgIDM4MC4zNzM5ODhdIFBHRCAzMDg4ODA2NyBQVUQgMzFhZmEwNjcgUE1EIDAgcXFxcXFx cXFxcXFxcXFxcXFxcXFxcXFxcXFxcXFqDQpbICAzODAuMzc0NTE4XSBPb3BzOiAwMDAwIFsj MV0gU01QDQpbICAzODAuMzc0OTE4XSBNb2R1bGVzIGxpbmtlZCBpbjogZG1fbW9kIG1kX21v ZCB4ZnMgbGliY3JjMzJjIGpmcyBjcmMzMmNfZ2VuZXJpYyBidHJmcyB4b3IgcmFpZDZfcHEg dmZhdCBmYXQgZXh0NCBjcmMxNiBtYmNhY2hlIGpiZDIgdmlydGlvX2JsayB2DQppcnRpb19u ZXQgdmlydGlvX3BjaSB2aXJ0aW9fcmluZyB2aXJ0aW8gbmxzX3V0ZjggaXNvZnMgc2cgc3Jf bW9kIGNkcm9tIGFoY2kgbGliYWhjaSBsaWJhdGEgc2NzaV9tb2QNClsgIDM4MC4zNzc3NzNd IENQVTogMCBQSUQ6IDc1IENvbW06IGt3b3JrZXIvdTI6NCBOb3QgdGFpbnRlZCAzLjE2LjAt NC1hbWQ2NCAjMSBEZWJpYW4gMy4xNi43LWNrdDktMg0KWyAgMzgwLjM3ODczN10gSGFyZHdh cmUgbmFtZTogICBCSFlWRSwgQklPUyAxLjAwIDAzLzE0LzIwMTQNClsgIDM4MC4zNzkzMzBd IFdvcmtxdWV1ZTogd3JpdGViYWNrIGJkaV93cml0ZWJhY2tfd29ya2ZuIChmbHVzaC0yNTI6 MCkNClsgIDM4MC4zODAwNTZdIHRhc2s6IGZmZmY4ODAwM2NkZDBhMjAgdGk6IGZmZmY4ODAw M2NkZDgwMDAgdGFzay50aTogZmZmZjg4MDAzY2RkODAwMA0KWyAgMzgwLjM4MDg3M10gUklQ OiAwMDEwOls8ZmZmZmZmZmY4MTI4NDdkZT5dICBbPGZmZmZmZmZmODEyODQ3ZGU+XSBfX2Js a19iaW9zX21hcF9zZysweDFkZS8weDQwMA0KWyAgMzgwLjM4MTgzN10gUlNQOiAwMDE4OmZm ZmY4ODAwM2NkZGI3MTggIEVGTEFHUzogMDAwMTAyMDYNClsgIDM4MC4zODI0MjVdIFJBWDog MDAwMDAwMDAxMDAyMDAwMCBSQlg6IDAwMDAwMDAwMDAwMDEwMDAgUkNYOiAwMDAwMDAwMDAw MDAwMDAwDQpbICAzODAuMzgzMjA5XSBSRFg6IDAwMDAwMDAwMTAwMjAwMDEgUlNJOiBmZmZm ZWEwMDAwYWM4MTQwIFJESTogMDAwMDAwMDAwMDAwMDAwMA0KWyAgMzgwLjM4Mzk5MF0gUkJQ OiBmZmZmODgwMDNjZGRiNzk4IFIwODogZmZmZjg4MDAyYzZkOTAyMCBSMDk6IDAwMDAwMDAw MDAwMDAwMjUNClsgIDM4MC4zODQ3NzNdIFIxMDogMDAwMDAwMDAwMDAwMDAwMCBSMTE6IDAw MDAwMDAwMzA5MTAwMDAgUjEyOiAwMDAwMDAwMDAwMDAwMDAwDQpbICAzODAuMzg1NTU5XSBS MTM6IDAwMDAwMDAwMDAwMDEwMDAgUjE0OiAwMDAwMDAwMDAwMDAwMDAwIFIxNTogZmZmZjg4 MDAzY2RkYjdhOA0KWyAgMzgwLjM4NjMzOF0gRlM6ICAwMDAwMDAwMDAwMDAwMDAwKDAwMDAp IEdTOmZmZmY4ODAwM2ZjMDAwMDAoMDAwMCkga25sR1M6MDAwMDAwMDAwMDAwMDAwMA0KWyAg MzgwLjM4NzIxNl0gQ1M6ICAwMDEwIERTOiAwMDAwIEVTOiAwMDAwIENSMDogMDAwMDAwMDA4 MDA1MDAzMw0KWyAgMzgwLjM4Nzg0OF0gQ1IyOiAwMDAwMDAwMDEwMDIwMDAwIENSMzogMDAw MDAwMDAzMDg4ZjAwMCBDUjQ6IDAwMDAwMDAwMDAwNDA2YjANClsgIDM4MC4zODg2MjZdIFN0 YWNrOg0KWyAgMzgwLjM4ODg1OF0gIDAwMDAwMDAwMDAwMDAwMDAgZmZmZjg4MDAzN2IyMDdh MCBmZmZmODgwMDNjYzU3MDA4IDAxZmY4ODAwM2NkZDBhMjANClsgIDM4MC4zODk3MzhdICBm ZmZmODgwMDJjNmQ5MDIwIDAwMDAwMDAwMDAwMDAwMjUgMDAwMDAwMDAwMDAwMDAwMCBmZmZm ZWEwMDAwYWM4MTQwDQpbICAzODAuMzkwNjIxXSAgMDAwMDAwMDAwMDAwMTAwMCBmZmZmZWEw MDAwYTlmYjQ4IDAwMDAwMDAwMDAwMDEwMDAgZmZmZjg4MDAzN2IyMDYwMA0KWyAgMzgwLjM5 MTUwMV0gQ2FsbCBUcmFjZToNClsgIDM4MC4zOTE3ODFdICBbPGZmZmZmZmZmODEyODRhMmY+ XSA/IGJsa19ycV9tYXBfc2crMHgyZi8weDE3MA0KWyAgMzgwLjM5MjQxMF0gIFs8ZmZmZmZm ZmZhMDBiNzRkYj5dID8gdmlydGlvX3F1ZXVlX3JxKzB4OWIvMHgyNDAgW3ZpcnRpb19ibGtd DQpbICAzODAuMzkzMTcyXSAgWzxmZmZmZmZmZjgxMjg4NWQyPl0gPyBfX2Jsa19tcV9ydW5f aHdfcXVldWUrMHgxYzIvMHgzMjANClsgIDM4MC4zOTM4ODJdICBbPGZmZmZmZmZmODEyODk5 NGQ+XSA/IGJsa19tcV9pbnNlcnRfcmVxdWVzdHMrMHhiZC8weDEyMA0KWyAgMzgwLjM5NDYx MV0gIFs8ZmZmZmZmZmY4MTI4YTQ4OT5dID8gYmxrX21xX2ZsdXNoX3BsdWdfbGlzdCsweDEy OS8weDE0MA0KWyAgMzgwLjM5NTMyOV0gIFs8ZmZmZmZmZmY4MTI4MGI5Mz5dID8gYmxrX2Zs dXNoX3BsdWdfbGlzdCsweGUzLzB4MjMwDQpbICAzODAuMzk2MDEwXSAgWzxmZmZmZmZmZjgx Mjg5YzZhPl0gPyBibGtfc3FfbWFrZV9yZXF1ZXN0KzB4MmJhLzB4MzYwDQpbICAzODAuMzk2 Njk4XSAgWzxmZmZmZmZmZjgxMjdjODgwPl0gPyBnZW5lcmljX21ha2VfcmVxdWVzdCsweGIw LzB4MTAwDQpbICAzODAuMzk3Mzg3XSAgWzxmZmZmZmZmZjgxMjdjOTQxPl0gPyBzdWJtaXRf YmlvKzB4NzEvMHgxNTANClsgIDM4MC4zOTc5ODBdICBbPGZmZmZmZmZmODEyNzgwNjg+XSA/ IGJpb19hbGxvY19iaW9zZXQrMHgxOTgvMHgyOTANClsgIDM4MC4zOTg2NDFdICBbPGZmZmZm ZmZmODExZDc5ZGE+XSA/IF9zdWJtaXRfYmgrMHgxMmEvMHgxZjANClsgIDM4MC4zOTkyNDRd ICBbPGZmZmZmZmZmODExZGE0NjE+XSA/IF9fYmxvY2tfd3JpdGVfZnVsbF9wYWdlLmNvbnN0 cHJvcC4zNisweDEyMS8weDM5MA0KWyAgMzgwLjQwMDA5Ml0gIFs8ZmZmZmZmZmY4MTFkYWVj MD5dID8gSV9CREVWKzB4MTAvMHgxMA0KWyAgMzgwLjQwMDY1M10gIFs8ZmZmZmZmZmY4MTE3 MmY1MD5dID8gcGFnZV9yZWZlcmVuY2VkX29uZSsweDE2MC8weDE2MA0KWyAgMzgwLjQwMTM0 N10gIFs8ZmZmZmZmZmY4MTE0NmJhZj5dID8gX193cml0ZXBhZ2UrMHhmLzB4NDANClsgIDM4 MC40MDE5MzhdICBbPGZmZmZmZmZmODExNDc0NmI+XSA/IHdyaXRlX2NhY2hlX3BhZ2VzKzB4 MWRiLzB4M2YwDQpbICAzODAuNDAyNjE0XSAgWzxmZmZmZmZmZjgxMTQ2YmEwPl0gPyBnbG9i YWxfZGlydHlhYmxlX21lbW9yeSsweDUwLzB4NTANClsgIDM4MC40MDMzMjZdICBbPGZmZmZm ZmZmODExNDc2YzM+XSA/IGdlbmVyaWNfd3JpdGVwYWdlcysweDQzLzB4NjANClsgIDM4MC40 MDM5ODhdICBbPGZmZmZmZmZmODExY2UyZTk+XSA/IF9fd3JpdGViYWNrX3NpbmdsZV9pbm9k ZSsweDM5LzB4MjIwDQpbICAzODAuNDA0NzE0XSAgWzxmZmZmZmZmZjgxMWNlZjU0Pl0gPyB3 cml0ZWJhY2tfc2JfaW5vZGVzKzB4MWE0LzB4M2UwDQpbICAzODAuNDA1NDA1XSAgWzxmZmZm ZmZmZjgxMWNmMjI2Pl0gPyBfX3dyaXRlYmFja19pbm9kZXNfd2IrMHg5Ni8weGMwDQpbICAz ODAuNDA2MDk3XSAgWzxmZmZmZmZmZjgxMWNmNDkzPl0gPyB3Yl93cml0ZWJhY2srMHgyNDMv MHgyZDANClsgIDM4MC40MDY3MjVdICBbPGZmZmZmZmZmODExZDE2ZWM+XSA/IGJkaV93cml0 ZWJhY2tfd29ya2ZuKzB4MWJjLzB4NDIwDQpbICAzODAuNDA3NDI4XSAgWzxmZmZmZmZmZjgx MDgxNWQyPl0gPyBwcm9jZXNzX29uZV93b3JrKzB4MTcyLzB4NDIwDQpbICAzODAuNDA4MDk1 XSAgWzxmZmZmZmZmZjgxMDgxYzYzPl0gPyB3b3JrZXJfdGhyZWFkKzB4MTEzLzB4NGYwDQpb ICAzODAuNDA4NzI0XSAgWzxmZmZmZmZmZjgxMDgxYjUwPl0gPyByZXNjdWVyX3RocmVhZCsw eDJkMC8weDJkMA0KWyAgMzgwLjQwOTM3Ml0gIFs8ZmZmZmZmZmY4MTA4N2VlZD5dID8ga3Ro cmVhZCsweGJkLzB4ZTANClsgIDM4MC40MDk5MzNdICBbPGZmZmZmZmZmODEwODdlMzA+XSA/ IGt0aHJlYWRfY3JlYXRlX29uX25vZGUrMHgxODAvMHgxODANClsgIDM4MC40MTA2NTVdICBb PGZmZmZmZmZmODE1MTBkOTg+XSA/IHJldF9mcm9tX2ZvcmsrMHg1OC8weDkwDQpbICAzODAu NDExMjg0XSAgWzxmZmZmZmZmZjgxMDg3ZTMwPl0gPyBrdGhyZWFkX2NyZWF0ZV9vbl9ub2Rl KzB4MTgwLzB4MTgwDQpbICAzODAuNDEyMDA0XSBDb2RlOiAzZiA0NCA4OSA0YyAyNCAyOCA0 OCA4OSA0YyAyNCAzMCBlOCA5ZCA1OCAwMyAwMCA4YiA3YyAyNCA0NCA0OCA4YiA3NCAyNCAz OCA0YyA4YiA0NCAyNCAyMCA0NCA4YiA0YyAyNCAyOCA0OCA4YiA0YyAyNCAzMCA0OSA4DQo5 IDA3IDw0OD4gOGIgMTAgODMgZTIgMDMgNDAgZjYgYzYgMDMgMGYgODUgYjIgMDEgMDAgMDAg NDggMDkgZjIgODkgNzgNClsgIDM4MC40MTUyMTddIFJJUCAgWzxmZmZmZmZmZjgxMjg0N2Rl Pl0gX19ibGtfYmlvc19tYXBfc2crMHgxZGUvMHg0MDANClsgIDM4MC40MTU5MjZdICBSU1Ag PGZmZmY4ODAwM2NkZGI3MTg+DQpbICAzODAuNDE2MzE3XSBDUjI6IDAwMDAwMDAwMTAwMjAw MDANClsgIDM4MC40MTY2OTVdIC0tLVsgZW5kIHRyYWNlIDQzOWJjYWEyZGIyYmYwMzAgXS0t LQ0KWyAgMzgwLjQ2NDc5MV0gQlVHOiB1bmFibGUgdG8gaGFuZGxlIGtlcm5lbCBwYWdpbmcg cmVxdWVzdCBhdCBmZmZmZmZmZmZmZmZmZmQ4DQpbICAzODAuNDY1NjEwXSBJUDogWzxmZmZm ZmZmZjgxMDg4NDdjPl0ga3RocmVhZF9kYXRhKzB4Yy8weDIwDQpbICAzODAuNDY2MjQwXSBQ R0QgMTgxNjA2NyBQVUQgMTgxODA2NyBQTUQgMA0KWyAgMzgwLjQ2Njc1MV0gT29wczogMDAw MCBbIzJdIFNNUA0KWyAgMzgwLjQ2NzE0OF0gTW9kdWxlcyBsaW5rZWQgaW46IGRtX21vZCBt ZF9tb2QgeGZzIGxpYmNyYzMyYyBqZnMgY3JjMzJjX2dlbmVyaWMgYnRyZnMgeG9yIHJhaWQ2 X3BxIHZmYXQgZmF0IGV4dDQgY3JjMTYgbWJjYWNoZSBqYmQyIHZpcnRpb19ibGsgdg0KaXJ0 aW9fbmV0IHZpcnRpb19wY2kgdmlydGlvX3JpbmcgdmlydGlvIG5sc191dGY4IGlzb2ZzIHNn IHNyX21vZCBjZHJvbSBhaGNpIGxpYmFoY2kgbGliYXRhIHNjc2lfbW9kDQpbICAzODAuNDcw MDI1XSBDUFU6IDAgUElEOiA3NSBDb21tOiBrd29ya2VyL3UyOjQgVGFpbnRlZDogRyAgICAg IEQgICAgICAgMy4xNi4wLTQtYW1kNjQgIzEgRGViaWFuIDMuMTYuNy1ja3Q5LTINClsgIDM4 MC40NzExMDJdIEhhcmR3YXJlIG5hbWU6ICAgQkhZVkUsIEJJT1MgMS4wMCAwMy8xNC8yMDE0 DQpbICAzODAuNDcxNjk5XSB0YXNrOiBmZmZmODgwMDNjZGQwYTIwIHRpOiBmZmZmODgwMDNj ZGQ4MDAwIHRhc2sudGk6IGZmZmY4ODAwM2NkZDgwMDANClsgIDM4MC40NzI1NDVdIFJJUDog MDAxMDpbPGZmZmZmZmZmODEwODg0N2M+XSAgWzxmZmZmZmZmZjgxMDg4NDdjPl0ga3RocmVh ZF9kYXRhKzB4Yy8weDIwDQpbICAzODAuNDczNDM1XSBSU1A6IDAwMDA6ZmZmZjg4MDAzY2Rk YjQzMCAgRUZMQUdTOiAwMDAxMDAwMg0KWyAgMzgwLjQ3NDAyNV0gUkFYOiAwMDAwMDAwMDAw MDAwMDAwIFJCWDogMDAwMDAwMDAwMDAwMDAwMCBSQ1g6IDAwMDAwMDAwMDAwMDAwMGYNClsg IDM4MC40NzQ4MTJdIFJEWDogMDAwMDAwMDAwMDAwMDAwZSBSU0k6IDAwMDAwMDAwMDAwMDAw MDAgUkRJOiBmZmZmODgwMDNjZGQwYTIwDQpbICAzODAuNDc1NTk4XSBSQlA6IGZmZmY4ODAw M2NkZDBhMjAgUjA4OiAwMDAwMDAwMDAwMDAwMDAxIFIwOTogMDAwMDAwMDAwMDAwYjZmZA0K WyAgMzgwLjQ3NjQzMF0gUjEwOiBmZmZmZmZmZjgxYWUwNDM4IFIxMTogMDAwMDAwMDAwMDAw MDAwMCBSMTI6IGZmZmY4ODAwM2ZjMTJmMDANClsgIDM4MC40NzcyMzFdIFIxMzogMDAwMDAw MDAwMDAwMDAwMCBSMTQ6IDAwMDAwMDAwMDAwMDAwMDAgUjE1OiBmZmZmODgwMDNjZGQwYTIw DQpbICAzODAuNDc4MDEzXSBGUzogIDAwMDAwMDAwMDAwMDAwMDAoMDAwMCkgR1M6ZmZmZjg4 MDAzZmMwMDAwMCgwMDAwKSBrbmxHUzowMDAwMDAwMDAwMDAwMDAwDQpbICAzODAuNDc4ODk4 XSBDUzogIDAwMTAgRFM6IDAwMDAgRVM6IDAwMDAgQ1IwOiAwMDAwMDAwMDgwMDUwMDMzDQpb ICAzODAuNDc5NTMxXSBDUjI6IDAwMDAwMDAwMDAwMDAwMjggQ1IzOiAwMDAwMDAwMDMwODhm MDAwIENSNDogMDAwMDAwMDAwMDA0MDZiMA0KWyAgMzgwLjQ4MDMxNl0gU3RhY2s6DQpbICAz ODAuNDgwNTUwXSAgZmZmZmZmZmY4MTA4MjBhZCBmZmZmODgwMDNjZGQwZTgwIGZmZmZmZmZm ODE1MGQzNGQgMDAwMDAwMDAwMDAxMmYwMA0KWyAgMzgwLjQ4MTQzNV0gIGZmZmY4ODAwM2Nk ZGJmZDggMDAwMDAwMDAwMDAxMmYwMCBmZmZmODgwMDNjZGQwYTIwIGZmZmY4ODAwM2NkZDEw YTANClsgIDM4MC40ODIzMTVdICBmZmZmODgwMDNjZGQwZDc4IGZmZmY4ODAwM2NkZDBhMTAg ZmZmZjg4MDAzZTI2MzJiMCBmZmZmODgwMDNjZGQwYTEwDQpbICAzODAuNDgzMTk1XSBDYWxs IFRyYWNlOg0KWyAgMzgwLjQ4MzQ3N10gIFs8ZmZmZmZmZmY4MTA4MjBhZD5dID8gd3Ffd29y a2VyX3NsZWVwaW5nKzB4ZC8weDgwDQpbICAzODAuNDg0MTI5XSAgWzxmZmZmZmZmZjgxNTBk MzRkPl0gPyBfX3NjaGVkdWxlKzB4NDVkLzB4NzEwDQpbICAzODAuNDg0NzM3XSAgWzxmZmZm ZmZmZjgxMDY5ZjJmPl0gPyBkb19leGl0KzB4NmVmLzB4YTYwDQpbICAzODAuNDg1MzE5XSAg WzxmZmZmZmZmZjgxMDE2M2I3Pl0gPyBvb3BzX2VuZCsweDk3LzB4ZTANClsgIDM4MC40ODU4 OTNdICBbPGZmZmZmZmZmODE1MDc4YzU+XSA/IG5vX2NvbnRleHQrMHgyYjIvMHgyYmUNClsg IDM4MC40ODY1MDNdICBbPGZmZmZmZmZmODEwNTcxNzA+XSA/IF9fZG9fcGFnZV9mYXVsdCsw eDgwLzB4NGYwDQpbICAzODAuNDg3MTUwXSAgWzxmZmZmZmZmZjgxMTVhYTA1Pl0gPyB6b25l X3N0YXRpc3RpY3MrMHg4NS8weDkwDQpbICAzODAuNDg3Nzg3XSAgWzxmZmZmZmZmZjgxNTEy ZTY4Pl0gPyBwYWdlX2ZhdWx0KzB4MjgvMHgzMA0KWyAgMzgwLjQ4ODM3N10gIFs8ZmZmZmZm ZmY4MTI4NDdkZT5dID8gX19ibGtfYmlvc19tYXBfc2crMHgxZGUvMHg0MDANClsgIDM4MC40 ODkwNDZdICBbPGZmZmZmZmZmODEyODQ3YzM+XSA/IF9fYmxrX2Jpb3NfbWFwX3NnKzB4MWMz LzB4NDAwDQpbICAzODAuNDg5NzE3XSAgWzxmZmZmZmZmZjgxMjg0YTJmPl0gPyBibGtfcnFf bWFwX3NnKzB4MmYvMHgxNzANClsgIDM4MC40OTAzNDddICBbPGZmZmZmZmZmYTAwYjc0ZGI+ XSA/IHZpcnRpb19xdWV1ZV9ycSsweDliLzB4MjQwIFt2aXJ0aW9fYmxrXQ0KWyAgMzgwLjQ5 MTExN10gIFs8ZmZmZmZmZmY4MTI4ODVkMj5dID8gX19ibGtfbXFfcnVuX2h3X3F1ZXVlKzB4 MWMyLzB4MzIwDQpbICAzODAuNDkxODI3XSAgWzxmZmZmZmZmZjgxMjg5OTRkPl0gPyBibGtf bXFfaW5zZXJ0X3JlcXVlc3RzKzB4YmQvMHgxMjANClsgIDM4MC40OTI1MzVdICBbPGZmZmZm ZmZmODEyOGE0ODk+XSA/IGJsa19tcV9mbHVzaF9wbHVnX2xpc3QrMHgxMjkvMHgxNDANClsg IDM4MC40OTMyNTJdICBbPGZmZmZmZmZmODEyODBiOTM+XSA/IGJsa19mbHVzaF9wbHVnX2xp c3QrMHhlMy8weDIzMA0KWyAgMzgwLjQ5MzkzMl0gIFs8ZmZmZmZmZmY4MTI4OWM2YT5dID8g YmxrX3NxX21ha2VfcmVxdWVzdCsweDJiYS8weDM2MA0KWyAgMzgwLjQ5NDYyM10gIFs8ZmZm ZmZmZmY4MTI3Yzg4MD5dID8gZ2VuZXJpY19tYWtlX3JlcXVlc3QrMHhiMC8weDEwMA0KWyAg MzgwLjQ5NTMxMV0gIFs8ZmZmZmZmZmY4MTI3Yzk0MT5dID8gc3VibWl0X2JpbysweDcxLzB4 MTUwDQpbICAzODAuNDk1OTIxXSAgWzxmZmZmZmZmZjgxMjc4MDY4Pl0gPyBiaW9fYWxsb2Nf Ymlvc2V0KzB4MTk4LzB4MjkwDQpbICAzODAuNDk2NzI5XSAgWzxmZmZmZmZmZjgxMWQ3OWRh Pl0gPyBfc3VibWl0X2JoKzB4MTJhLzB4MWYwDQpbICAzODAuNDk3MzUwXSAgWzxmZmZmZmZm ZjgxMWRhNDYxPl0gPyBfX2Jsb2NrX3dyaXRlX2Z1bGxfcGFnZS5jb25zdHByb3AuMzYrMHgx MjEvMHgzOTANClsgIDM4MC40OTgxOTldICBbPGZmZmZmZmZmODExZGFlYzA+XSA/IElfQkRF VisweDEwLzB4MTANClsgIDM4MC40OTg3NTBdICBbPGZmZmZmZmZmODExNzJmNTA+XSA/IHBh Z2VfcmVmZXJlbmNlZF9vbmUrMHgxNjAvMHgxNjANClsgIDM4MC40OTk0NDBdICBbPGZmZmZm ZmZmODExNDZiYWY+XSA/IF9fd3JpdGVwYWdlKzB4Zi8weDQwDQpbICAzODAuNTAwMDI4XSAg WzxmZmZmZmZmZjgxMTQ3NDZiPl0gPyB3cml0ZV9jYWNoZV9wYWdlcysweDFkYi8weDNmMA0K WyAgMzgwLjUwMDcwMl0gIFs8ZmZmZmZmZmY4MTE0NmJhMD5dID8gZ2xvYmFsX2RpcnR5YWJs ZV9tZW1vcnkrMHg1MC8weDUwDQpbICAzODAuNTAxNDEyXSAgWzxmZmZmZmZmZjgxMTQ3NmMz Pl0gPyBnZW5lcmljX3dyaXRlcGFnZXMrMHg0My8weDYwDQpbICAzODAuNTAyMDcyXSAgWzxm ZmZmZmZmZjgxMWNlMmU5Pl0gPyBfX3dyaXRlYmFja19zaW5nbGVfaW5vZGUrMHgzOS8weDIy MA0KWyAgMzgwLjUwMjgwMl0gIFs8ZmZmZmZmZmY4MTFjZWY1ND5dID8gd3JpdGViYWNrX3Ni X2lub2RlcysweDFhNC8weDNlMA0KWyAgMzgwLjUwMzQ5M10gIFs8ZmZmZmZmZmY4MTFjZjIy Nj5dID8gX193cml0ZWJhY2tfaW5vZGVzX3diKzB4OTYvMHhjMA0KWyAgMzgwLjUwNDE4NV0g IFs8ZmZmZmZmZmY4MTFjZjQ5Mz5dID8gd2Jfd3JpdGViYWNrKzB4MjQzLzB4MmQwDQpbICAz ODAuNTA0ODA5XSAgWzxmZmZmZmZmZjgxMWQxNmVjPl0gPyBiZGlfd3JpdGViYWNrX3dvcmtm bisweDFiYy8weDQyMA0KWyAgMzgwLjUwNTUwOV0gIFs8ZmZmZmZmZmY4MTA4MTVkMj5dID8g cHJvY2Vzc19vbmVfd29yaysweDE3Mi8weDQyMA0KWyAgMzgwLjUwNjE2OV0gIFs8ZmZmZmZm ZmY4MTA4MWM2Mz5dID8gd29ya2VyX3RocmVhZCsweDExMy8weDRmMA0KWyAgMzgwLjUwNjgw MF0gIFs8ZmZmZmZmZmY4MTA4MWI1MD5dID8gcmVzY3Vlcl90aHJlYWQrMHgyZDAvMHgyZDAN ClsgIDM4MC41MDc0NDJdICBbPGZmZmZmZmZmODEwODdlZWQ+XSA/IGt0aHJlYWQrMHhiZC8w eGUwDQpbICAzODAuNTA4MDAxXSAgWzxmZmZmZmZmZjgxMDg3ZTMwPl0gPyBrdGhyZWFkX2Ny ZWF0ZV9vbl9ub2RlKzB4MTgwLzB4MTgwDQpbICAzODAuNTA4NzIwXSAgWzxmZmZmZmZmZjgx NTEwZDk4Pl0gPyByZXRfZnJvbV9mb3JrKzB4NTgvMHg5MA0KWyAgMzgwLjUwOTMzNV0gIFs8 ZmZmZmZmZmY4MTA4N2UzMD5dID8ga3RocmVhZF9jcmVhdGVfb25fbm9kZSsweDE4MC8weDE4 MA0KWyAgMzgwLjUxMDA1NF0gQ29kZTogMDggMDQgMDAgMDAgNDggOGIgNDAgYzggNDggYzEg ZTggMDIgODMgZTAgMDEgYzMgNjYgNjYgNjYgNjYgNjYgNjYgMmUgMGYgMWYgODQgMDAgMDAg MDAgMDAgMDAgMGYgMWYgNDQgMDAgMDAgNDggOGIgODcgMDggMDQgMA0KMCAwMCA8NDg+IDhi IDQwIGQ4IGMzIDY2IDY2IDY2IDY2IDY2IDY2IDJlIDBmIDFmIDg0IDAwIDAwIDAwIDAwIDAw IDBmDQpbICAzODAuNTEzMzE3XSBSSVAgIFs8ZmZmZmZmZmY4MTA4ODQ3Yz5dIGt0aHJlYWRf ZGF0YSsweGMvMHgyMA0KWyAgMzgwLjUxMzk1M10gIFJTUCA8ZmZmZjg4MDAzY2RkYjQzMD4N ClsgIDM4MC41MTQzNDhdIENSMjogZmZmZmZmZmZmZmZmZmZkOA0KWyAgMzgwLjUxNDcyNF0g LS0tWyBlbmQgdHJhY2UgNDM5YmNhYTJkYjJiZjAzMSBdLS0tDQpbICAzODAuNTE1MjM5XSBG aXhpbmcgcmVjdXJzaXZlIGZhdWx0IGJ1dCByZWJvb3QgaXMgbmVlZGVkIQ0K --------------000605030708080703060707-- From owner-freebsd-virtualization@FreeBSD.ORG Wed May 13 23:55:37 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 10215117 for ; Wed, 13 May 2015 23:55:37 +0000 (UTC) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id C49461A45 for ; Wed, 13 May 2015 23:55:36 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id D7B431275C for ; Thu, 14 May 2015 09:55:28 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id D1A9A2810BA for ; Thu, 14 May 2015 09:55:28 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cvrDxoQ6wvtA for ; Thu, 14 May 2015 09:55:28 +1000 (EST) Received: from Peters-MacBook-Pro.local (unknown [64.245.0.210]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 22CFB2810AC; Thu, 14 May 2015 09:55:26 +1000 (EST) Message-ID: <5553E46C.3060809@freebsd.org> Date: Wed, 13 May 2015 16:55:24 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Manas Bhatnagar CC: freebsd-virtualization@freebsd.org Subject: Re: Bhyve error with Debian 8 References: <5553E12F.50506@gmail.com> In-Reply-To: <5553E12F.50506@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 May 2015 23:55:37 -0000 Hi Manas, > Please see the attached file. I am running FreeBSD 10.1-RELEASE-p9. I am > running into an error while trying to install Debian 8 as a Bhyve guest. > The error occurs at the step of creating the partitions on the disk. Any > fix or workaround is welcome. Would you be able to post your grub2 and bhyve configs/command lines ? later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 00:05:49 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5D8E742A; Thu, 14 May 2015 00:05:49 +0000 (UTC) Received: from mail-ig0-x235.google.com (mail-ig0-x235.google.com [IPv6:2607:f8b0:4001:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 273B51B79; Thu, 14 May 2015 00:05:49 +0000 (UTC) Received: by igbsb11 with SMTP id sb11so59768133igb.0; Wed, 13 May 2015 17:05:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=rIAiMdkluvClvmvZ7mThH+RPnMejmAELB5oolN6snxY=; b=MGXQS+lgAYLzVRHTiClSHCdxrYZSNvj7FT3cej1DSjLbsaGNZFNLFATOKy2rAqBj2Y sdORdl3m6UaZGrboWsu7cr55T9+vECrzDtAYEhbWLKoJc192/DcJchX+xDNqrwABD2r+ 9GCJaZOHZDqMTjoGst3fPyXGHT8p17yMRd+XeGoShZMHvV6uWFQOW17xhfCjPY03FEaP YnobhrJUVxWDrVi5UkS/VkPFvnMjvsNuAEQmslT87JokT7wGN4hDdYU+VbweTbsyRFKP ff0JSvIcjesrkDDVhI5Ju3zxf4piqA4VQadjHJgEzGgEfygliZI0XHA3NlxalPL7DwlH jy0w== X-Received: by 10.107.37.211 with SMTP id l202mr1834715iol.76.1431561948658; Wed, 13 May 2015 17:05:48 -0700 (PDT) Received: from [192.168.0.101] ([209.195.113.231]) by mx.google.com with ESMTPSA id r4sm4713412igw.12.2015.05.13.17.05.47 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 13 May 2015 17:05:48 -0700 (PDT) Message-ID: <5553E6D5.1000601@gmail.com> Date: Wed, 13 May 2015 20:05:41 -0400 From: Manas Bhatnagar User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Peter Grehan CC: freebsd-virtualization@freebsd.org Subject: Re: Bhyve error with Debian 8 References: <5553E12F.50506@gmail.com> <5553E46C.3060809@freebsd.org> In-Reply-To: <5553E46C.3060809@freebsd.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 00:05:49 -0000 On 13-May-15 7:55 PM, Peter Grehan wrote: > Hi Manas, > >> Please see the attached file. I am running FreeBSD 10.1-RELEASE-p9. I am >> running into an error while trying to install Debian 8 as a Bhyve guest. >> The error occurs at the step of creating the partitions on the disk. Any >> fix or workaround is welcome. > > Would you be able to post your grub2 and bhyve configs/command lines ? > > later, > > Peter. > grub-bhyve -m device.map -r cd0 -M 1024M apurva-debian64 bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s 3:0,virtio-blk,./apurva-debian64.img -s 4:0,ahci-cd,./debian-8.0.0-amd64-BD-1.iso -l com1,stdio -c 1 -m 1024M apurva-debian64 These are the lines I used. Manas From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 00:23:16 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7027B609 for ; Thu, 14 May 2015 00:23:16 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 327201D34 for ; Thu, 14 May 2015 00:23:15 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 8D7D8AA284 for ; Thu, 14 May 2015 00:23:09 +0000 (UTC) Message-ID: <5553EAFD.8030406@freebsd.org> Date: Wed, 13 May 2015 20:23:25 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: freebsd-virtualization@freebsd.org Subject: Re: Nested virtualization networking issues with bhyve References: In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="8Wrf0A14qIit10CM3QDFw5t3H4bKGMXLU" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 00:23:16 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --8Wrf0A14qIit10CM3QDFw5t3H4bKGMXLU Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2015-05-13 19:15, Jonathan Wong wrote: > I've recently tried to experiment with vmware esxi 6 + vmworkstation an= d I > managed to get nested virtualization with freebsd guest and nested bhyv= e > ubuntu VM working. However, the networking doesn't seem to come up prop= erly > while installing, and post install for the ubuntu VM. >=20 > The bridged networking works as expected with freebsd guests and other > network nodes on the network. However, the nested VMs themselves can't = seem > to bring up networking properly. >=20 > lspci seems to bring up the virtio network device, but even configuring= > static ips doesn't help. The VM is not able to receive or route any pac= kets > from any VM >=20 > FreeBSD guest can ssh into the nested VM. The nested VM can ssh into > freebsd guest. The nested VM cannot contact internet or local gateway.= > Tried with E1000 and VMXNET 2. Computers on network can ssh into freebs= d > guest. The freebsd guest can ssh into other computers on the network. > Computers on the network cannot contact the VM. The vmware host cannot > contact the nested VM or vice versa. >=20 > Any tips to getting this to work? >=20 > Thanks. > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" >=20 I helped you (or someone else) with this issue on IRC. The answer was to enable promiscuous mode on the nic in ESXi http://kb.vmware.com/selfservice/microsites/search.do?language=3Den_US&cm= d=3DdisplayKC&externalId=3D1004099 So that the FreeBSD (middle) host would receive the packets destine for the inner VM. Without promiscuous mode, any packets with an ethernet address other than that of the ESXi virtual nic, will not be passed into the VM. --=20 Allan Jude --8Wrf0A14qIit10CM3QDFw5t3H4bKGMXLU Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJVU+r/AAoJEJrBFpNRJZKfIhYP/jBOOfT1vQRFuxhVqtNtkYNf HTJ1b1YWDlKLVviMDGiUtts6CF3bAGoPdkzO0Lqma9aBdyKC49NdffU+YDlIRefs r4J9hareSpO5WiL6Ej7eDuTmAnouKvYkyTqv27pP5VGbHjpc+Xwhd3q2e32ZAeMU YAJhrIFoJQfgyv9f9n1siietksHHPfsP5O49aE8RHaGt4ezsqT4e8UDfu3zpqMpG HuE3ZTnm8WC+FCAGoQOcu2FQa/Soq6xl7SpatrBAd41VBboyt29hbYbH3i6aHn9u 3dQ1kGQzaoCFGwaQlCLGRwvf/PkznZ8iLLW8PQDr+0Z8Rs6USqd+39BE8Pjlwzsc YZewE9Ka5J+gbiAZhZzPrxrQKzAcY2rBwpQWJjJX5JdlQoHsWyNhMNWTjMPKuMCw ruicqbaYIS8wnk7IIu6n1ifpgES22BOl2ME0k27zSyXVo0808+gBzu2nR6meUeMW 08w1xZYDgR6iVLqYA6oFnE26aG8qOH5UzmAHJPVd6LQ+NcubrhNKPsT062nTQASc Nqa6msED4dOpSDok77fKwoT6C0Uj01v8/kvyIwTM1E7P8/ddADGLrYF6lokQ2Tnr j81+sMkGFwxFGTpvQM3HQXAudtltrWvBnslZ/nT4tV/T2x0dmyutjRXe/vtHtkyl z/9kQJamG074kBu0wUoN =Vhcs -----END PGP SIGNATURE----- --8Wrf0A14qIit10CM3QDFw5t3H4bKGMXLU-- From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 00:52:10 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 527B8CB1 for ; Thu, 14 May 2015 00:52:10 +0000 (UTC) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id 1213F1028 for ; Thu, 14 May 2015 00:52:09 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id 1FFB71274F for ; Thu, 14 May 2015 10:52:08 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 1B1E82810BD for ; Thu, 14 May 2015 10:52:08 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p5YagYFRZjxc for ; Thu, 14 May 2015 10:52:08 +1000 (EST) Received: from Peters-MacBook-Pro.local (unknown [64.245.0.210]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 4C5D42810BA; Thu, 14 May 2015 10:52:05 +1000 (EST) Message-ID: <5553F1B4.2050902@freebsd.org> Date: Wed, 13 May 2015 17:52:04 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Manas Bhatnagar CC: freebsd-virtualization@freebsd.org Subject: Re: Bhyve error with Debian 8 References: <5553E12F.50506@gmail.com> <5553E46C.3060809@freebsd.org> <5553E6D5.1000601@gmail.com> In-Reply-To: <5553E6D5.1000601@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 00:52:10 -0000 Hi Manas, >>> Please see the attached file. I am running FreeBSD 10.1-RELEASE-p9. I am >>> running into an error while trying to install Debian 8 as a Bhyve guest. >>> The error occurs at the step of creating the partitions on the disk. Any >>> fix or workaround is welcome. >> >> Would you be able to post your grub2 and bhyve configs/command lines ? ... > grub-bhyve -m device.map -r cd0 -M 1024M apurva-debian64 > > bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s > 3:0,virtio-blk,./apurva-debian64.img -s > 4:0,ahci-cd,./debian-8.0.0-amd64-BD-1.iso -l com1,stdio -c 1 -m 1024M > apurva-debian64 > > These are the lines I used. Thanks for that. I get the same panic on CURRENT when selecting 'Guided - use entire disk and set up LVM' :( A workaround is to select 'Guided - use entire disk' with virtio-blk, or use ahci-hd for the disk controller which does allow the LVM install. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 00:55:57 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6E8C3D68 for ; Thu, 14 May 2015 00:55:57 +0000 (UTC) Received: from mail-ig0-x234.google.com (mail-ig0-x234.google.com [IPv6:2607:f8b0:4001:c05::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 45C4B1052 for ; Thu, 14 May 2015 00:55:57 +0000 (UTC) Received: by igbyr2 with SMTP id yr2so154551049igb.0 for ; Wed, 13 May 2015 17:55:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:cc:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=fV1vHjvguSxax29I7DTI2fed7AXMCnlQFTPqgAknslI=; b=tyMMPa+0HFOaA/bu3hs6Avby0zBRZytgEoCc0FYccE+EmQLzqdRY9/l6v9R/RYAiN6 bQccx10cGW9u3jj8Nh4OmAd19iKdmWBu8o68/HVogSxOy+1FvZlAjVmTIDq/aWBpFHTL kVwURvNfZDHOt3apMGW2t1qRIrkWFf3q0212zLgm/84tN7VRoA1KXf0+yqVhKSblcZQg l2ayYGeRI+x8xIhJ3lzgZtVIdCiw+h95DohMfxjXzOaaGWtA0ARotWYupOo7pfCPZlqO u2JI8vH713vcINP4ffrVytmJCtP2eBW1euZEpVRPudBZI5Q8Tc7hyEcJ0+93Q73/Cui6 zEmQ== X-Received: by 10.42.238.14 with SMTP id kq14mr11979972icb.23.1431564956537; Wed, 13 May 2015 17:55:56 -0700 (PDT) Received: from [192.168.0.101] ([209.195.113.231]) by mx.google.com with ESMTPSA id 71sm15454894ioe.16.2015.05.13.17.55.55 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 13 May 2015 17:55:55 -0700 (PDT) Message-ID: <5553F294.6090700@gmail.com> Date: Wed, 13 May 2015 20:55:48 -0400 From: Manas Bhatnagar User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 CC: freebsd-virtualization@freebsd.org Subject: Re: Bhyve error with Debian 8 References: <5553E12F.50506@gmail.com> <5553E46C.3060809@freebsd.org> <5553E6D5.1000601@gmail.com> <5553F1B4.2050902@freebsd.org> In-Reply-To: <5553F1B4.2050902@freebsd.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 00:55:57 -0000 On 13-May-15 8:52 PM, Peter Grehan wrote: > Hi Manas, > >>>> Please see the attached file. I am running FreeBSD 10.1-RELEASE-p9. >>>> I am >>>> running into an error while trying to install Debian 8 as a Bhyve >>>> guest. >>>> The error occurs at the step of creating the partitions on the disk. >>>> Any >>>> fix or workaround is welcome. >>> >>> Would you be able to post your grub2 and bhyve configs/command lines ? > ... >> grub-bhyve -m device.map -r cd0 -M 1024M apurva-debian64 >> >> bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s >> 3:0,virtio-blk,./apurva-debian64.img -s >> 4:0,ahci-cd,./debian-8.0.0-amd64-BD-1.iso -l com1,stdio -c 1 -m 1024M >> apurva-debian64 >> >> These are the lines I used. > > Thanks for that. > > I get the same panic on CURRENT when selecting 'Guided - use entire > disk and set up LVM' :( > > A workaround is to select 'Guided - use entire disk' with virtio-blk, > or use ahci-hd for the disk controller which does allow the LVM install. > > later, > > Peter. Thank you. I tried using 'Guided - use entire disk and set up LVM' on 7.8.0 and it seems to work fine, just thought I would let you know. Manas From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 01:18:29 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A78681C9 for ; Thu, 14 May 2015 01:18:29 +0000 (UTC) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id 651151289 for ; Thu, 14 May 2015 01:18:28 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id 0831112780 for ; Thu, 14 May 2015 11:18:27 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 022CB2810AC for ; Thu, 14 May 2015 11:18:27 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9jhzZ1aNeApf for ; Thu, 14 May 2015 11:18:26 +1000 (EST) Received: from Peters-MacBook-Pro.local (unknown [64.245.0.210]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 197512810B1; Thu, 14 May 2015 11:18:24 +1000 (EST) Message-ID: <5553F7DE.2080505@freebsd.org> Date: Wed, 13 May 2015 18:18:22 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Manas Bhatnagar CC: freebsd-virtualization@freebsd.org Subject: Re: Bhyve error with Debian 8 References: <5553E12F.50506@gmail.com> <5553E46C.3060809@freebsd.org> <5553E6D5.1000601@gmail.com> <5553F1B4.2050902@freebsd.org> <5553F294.6090700@gmail.com> In-Reply-To: <5553F294.6090700@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 01:18:29 -0000 > Thank you. I tried using 'Guided - use entire disk and set up LVM' on > 7.8.0 and it seems to work fine, just thought I would let you know. I've installed with LVM successfully on older Ubuntus/CentOS, but your report led me to trying it on 15.04 with virtio and saw the same crash :( I'll get this fixed. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Thu May 14 20:49:27 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0153921B for ; Thu, 14 May 2015 20:49:26 +0000 (UTC) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id B549F10F2 for ; Thu, 14 May 2015 20:49:26 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id 5D5B2124A9 for ; Fri, 15 May 2015 06:49:24 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 1D42A2810B1 for ; Fri, 15 May 2015 06:49:24 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0nuvnGCstHIf for ; Fri, 15 May 2015 06:49:24 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-50-184-135-69.hsd1.ca.comcast.net [50.184.135.69]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id 0C6922810AC; Fri, 15 May 2015 06:49:19 +1000 (EST) Message-ID: <55550A4C.1030902@freebsd.org> Date: Thu, 14 May 2015 13:49:16 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Nikos Vassiliadis CC: "freebsd-virtualization@freebsd.org" Subject: Re: adding vtnet to bridge results to kernel panic References: <55520784.9050508@gmx.com> In-Reply-To: <55520784.9050508@gmx.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 May 2015 20:49:27 -0000 Hi Nikos, > I get this panic when I add vtnet0 to a bridge. I created a PR for this (https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=200210) and will look into it. >Thanks in advance for any ideas, tap will work, though, I suspect you're using vtnet to retain a config'd IP address when the guest exits ?? later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Fri May 15 17:08:50 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5AA3A953 for ; Fri, 15 May 2015 17:08:50 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 22D5E1735 for ; Fri, 15 May 2015 17:08:50 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4FH8nfF006502 for ; Fri, 15 May 2015 17:08:49 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4FH8nZn006501; Fri, 15 May 2015 17:08:49 GMT (envelope-from daemon-user) Date: Fri, 15 May 2015 17:08:49 +0000 To: freebsd-virtualization@freebsd.org From: "rodrigc (Craig Rodrigues)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <05e0308a22a1529e89ae8386b3dbce6e@localhost.localdomain> X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVWKCE= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 May 2015 17:08:50 -0000 rodrigc added a comment. I tested this patch. # kldload pf # kldunload pf kldunload: can't unload file: Device busy The fact that the pf module cannot be unloaded was one of the reasons that @glebius used to back out the entire changeset last time I committed your pf changes. Can you fix this? I also saw this in dmesg: CURVNET_SET() recursion in pfi_vnet_initialize() line 130, prev in vnet_register_sysinit() 0xfffff800056e4100 -> 0xfffff800056e4100 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe046389a550 pfi_vnet_initialize() at pfi_vnet_initialize+0x21b/frame 0xfffffe046389a590 pf_vnet_init() at pf_vnet_init+0x35/frame 0xfffffe046389a5c0 vnet_register_sysinit() at vnet_register_sysinit+0x13c/frame 0xfffffe046389a600 linker_load_module() at linker_load_module+0xc87/frame 0xfffffe046389a920 kern_kldload() at kern_kldload+0x10e/frame 0xfffffe046389a970 sys_kldload() at sys_kldload+0x5b/frame 0xfffffe046389a9a0 amd64_syscall() at amd64_syscall+0x27f/frame 0xfffffe046389aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe046389aab0 REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 12:25:57 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 92D44490 for ; Sat, 16 May 2015 12:25:57 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 692E7100E for ; Sat, 16 May 2015 12:25:57 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4GCPvp3067956 for ; Sat, 16 May 2015 12:25:57 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4GCPvNY067955; Sat, 16 May 2015 12:25:57 GMT (envelope-from daemon-user) Date: Sat, 16 May 2015 12:25:57 +0000 To: freebsd-virtualization@freebsd.org From: "nvass-gmx.com (Nikos Vassiliadis)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: <2d869212c86d7fa18f94762d5b91e592@localhost.localdomain> X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVXN1U= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 12:25:57 -0000 nvass-gmx.com added a comment. In https://reviews.freebsd.org/D1944#47231, @rodrigc wrote: > I tested this patch. > > # kldload pf > # kldunload pf > kldunload: can't unload file: Device busy > > > The fact that the pf module cannot be unloaded was one of the > reasons that @glebius used to back out the entire changeset last time > I committed your pf changes. Can you fix this? This is intended behaviour, regadless of VIMAGE. You need to use kldunload -f to unload it. > I also saw this in dmesg: > > CURVNET_SET() recursion in pfi_vnet_initialize() line 130, prev in vnet_register_sysinit() > 0xfffff800056e4100 -> 0xfffff800056e4100 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe046389a550 > pfi_vnet_initialize() at pfi_vnet_initialize+0x21b/frame 0xfffffe046389a590 > pf_vnet_init() at pf_vnet_init+0x35/frame 0xfffffe046389a5c0 > vnet_register_sysinit() at vnet_register_sysinit+0x13c/frame 0xfffffe046389a600 > linker_load_module() at linker_load_module+0xc87/frame 0xfffffe046389a920 > kern_kldload() at kern_kldload+0x10e/frame 0xfffffe046389a970 > sys_kldload() at sys_kldload+0x5b/frame 0xfffffe046389a9a0 > amd64_syscall() at amd64_syscall+0x27f/frame 0xfffffe046389aab0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe046389aab0 > This should be ok. It is just a warning that we are setting curvnet although it is already set. Maybe it can be avoided. REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 12:49:52 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9788A9AC; Sat, 16 May 2015 12:49:52 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass DE-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2FDB81246; Sat, 16 May 2015 12:49:52 +0000 (UTC) Received: from moby.local ([92.74.254.103]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0MIhDo-1YvnOZ2xoG-002DOY; Sat, 16 May 2015 14:49:43 +0200 Message-ID: <55573CB2.2030202@gmx.com> Date: Sat, 16 May 2015 14:48:50 +0200 From: Nikos Vassiliadis User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Peter Grehan CC: "freebsd-virtualization@freebsd.org" Subject: Re: adding vtnet to bridge results to kernel panic References: <55520784.9050508@gmx.com> <55550A4C.1030902@freebsd.org> In-Reply-To: <55550A4C.1030902@freebsd.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K0:FHiPYHYQzd3E8q4D/4mfzFdvGNYWRqZGJ8vItveaXNs82gUyrlf eNqA3WUcl1+9cmkKoOLHq+ZyEsNm5rRoQ5LImSg5459NGaZpunVqNA0tA9boOAxYN8s+DVW xoSo4E19KCR4zxtnH15ie0/84wL+PW0kiw6bGVupRhKS1v91ZdZhgYM62l0CAqhThd0WAXJ I0Sb09wswxs4kpTrwXYzw== X-UI-Out-Filterresults: notjunk:1; X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 12:49:52 -0000 On 05/14/15 22:49, Peter Grehan wrote: > Hi Nikos, Hi Peter, >> I get this panic when I add vtnet0 to a bridge. > > I created a PR for this > (https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=200210) and will look > into it. Thanks > >Thanks in advance for any ideas, > > tap will work, though, I suspect you're using vtnet to retain a > config'd IP address when the guest exits ?? I don't have a specific use case. I was trying something (*) and I got this panic and I reported it;) *: I was testing a big STP experiment with VIMAGE and I wanted to connect the host to the experiment and I got this panic. After that I tried to narrow down the panic's trigger, so I removed VIMAGE and tried to connect vtnet to a bridge. Thanks, Nikos From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 17:01:50 2015 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7E745A34 for ; Sat, 16 May 2015 17:01:50 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 5AE7D1C0A for ; Sat, 16 May 2015 17:01:49 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 9BADAAB87F for ; Sat, 16 May 2015 17:01:43 +0000 (UTC) Message-ID: <55577814.6040202@freebsd.org> Date: Sat, 16 May 2015 13:02:12 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: virtualization@freebsd.org Subject: bhyve code question, pci_virtio_net.c Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="8x2KDc8as1P1b2kThjDTc4b3mG4npEPAT" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 17:01:50 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --8x2KDc8as1P1b2kThjDTc4b3mG4npEPAT Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable While looking at the code, I noticed the following comment: /* * The default MAC address is the standard NetApp OUI of 00-a0-98, * followed by an MD5 of the PCI slot/func number and dev name */ if (!mac_provided) { snprintf(nstr, sizeof(nstr), "%d-%d-%s", pi->pi_slot, pi->pi_func, vmname); which raised 2 questions: 1) According to the comment, the mac address should be based on the md5 of the DEVICE name, not the VM name. Which is correct? Which is more desirable? I suppose most people's VMs will have similar slot/func numbers for the NIC (especially with certain config engines that always assign devices in a specific order), and so the VM name is more likely to be unique than the name of the tap device. Would it make sense to include more unique information in this hash? like the host's UUID or something, to prevent the chance of more than 1 VM on the same LAN having the same MAC if they have the same VM Name? 2) Should bhyve instead use the FreeBSD assigned OUI for these MAC addresses? --=20 Allan Jude --8x2KDc8as1P1b2kThjDTc4b3mG4npEPAT Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJVV3gXAAoJEJrBFpNRJZKfZqMP/j3BNJt1zTF73eNTvYyyiJ69 TeweBfzJbaTjXibOlZlqgo/Fq0cwmyhosUz09FBFOnTdBRZOdXgslKe5RAdaS9dP 6ZaO9g7EPrctw3XhodEys29VRKt4qvwJ6wY2FPyFe5k/YpY7Vt2S2xzuc8t3hc3Q jX0x8r3IIJb/XtMyPzMTZWG4JN5mjsEVnZ5IkGxEMleLKaShWKexpxCdieSBwKUx YXnL9KMMmdrh0ucd2b2Cal/VnQTqVIP+JBd3eoZJIryf1vIwuxKsL8dQ981FRJLN L6n1DAj2lPDeunxdpW+FfjM+VU8KDGSZIMv2RupoHCb0th0bfN2Pg4OMvsPMbgI1 s5E7qCXWfvoqsMXrXQQgfudcSsZqTjRRFeZ+8U3AD8DRVwSbHBOttfz9a5MII4O+ XJFaBiRS5dxwidUaVOhUkOBim/v0A33aAKnWos+TfQnhhJOxfSCSdnAsyxcohY4o sVIj+53MZET61jbSEIwp38E+ybe+evRKNJWPNRhJwuwl54hHZEdr3gWTD5GvIU6i Tv9PTgLXK6uqLJteD0kRcmDTe9q5AuL/pYs771SsX6Op5y8CyKUrs6800sPtNm/m BmrpFQDe9H5Jd9KhwlBR6vdpSfHe9BcI8Kxt12PJTijyFcji6VIg9VnyWJPKgOxS n5DzoiK+K+t1rLO7CXoA =/I7T -----END PGP SIGNATURE----- --8x2KDc8as1P1b2kThjDTc4b3mG4npEPAT-- From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 18:36:22 2015 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3AE76EB6; Sat, 16 May 2015 18:36:22 +0000 (UTC) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "gold.funkthat.com", Issuer "gold.funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 0225714F4; Sat, 16 May 2015 18:36:21 +0000 (UTC) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.14.5/8.14.5) with ESMTP id t4GIaE9V024511 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 16 May 2015 11:36:14 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.14.5/8.14.5/Submit) id t4GIaE4g024510; Sat, 16 May 2015 11:36:14 -0700 (PDT) (envelope-from jmg) Date: Sat, 16 May 2015 11:36:14 -0700 From: John-Mark Gurney To: Allan Jude Cc: virtualization@freebsd.org, "George V. Neville-Neil" Subject: Re: bhyve code question, pci_virtio_net.c Message-ID: <20150516183614.GL37063@funkthat.com> References: <55577814.6040202@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <55577814.6040202@freebsd.org> X-Operating-System: FreeBSD 9.1-PRERELEASE amd64 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (gold.funkthat.com [127.0.0.1]); Sat, 16 May 2015 11:36:15 -0700 (PDT) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 18:36:22 -0000 Allan Jude wrote this message on Sat, May 16, 2015 at 13:02 -0400: > While looking at the code, I noticed the following comment: > > /* > * The default MAC address is the standard NetApp OUI of 00-a0-98, > * followed by an MD5 of the PCI slot/func number and dev name > */ > if (!mac_provided) { > snprintf(nstr, sizeof(nstr), "%d-%d-%s", pi->pi_slot, > pi->pi_func, vmname); > > > which raised 2 questions: > 1) According to the comment, the mac address should be based on the md5 > of the DEVICE name, not the VM name. Which is correct? Which is more > desirable? > > I suppose most people's VMs will have similar slot/func numbers for the > NIC (especially with certain config engines that always assign devices > in a specific order), and so the VM name is more likely to be unique > than the name of the tap device. Correct, VM name makes the most sense here... > Would it make sense to include more unique information in this hash? > like the host's UUID or something, to prevent the chance of more than 1 > VM on the same LAN having the same MAC if they have the same VM Name? Sure... > 2) Should bhyve instead use the FreeBSD assigned OUI for these MAC > addresses? Depends, if NetApp gave us permission to use them here, then we might as well keep using them. gnn would be the persion to talk to about this.. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 19:02:04 2015 Return-Path: Delivered-To: virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1DE6837A for ; Sat, 16 May 2015 19:02:04 +0000 (UTC) Received: from alto.onthenet.com.au (alto2.onthenet.com.au [203.13.68.14]) by mx1.freebsd.org (Postfix) with ESMTP id D10D617B6 for ; Sat, 16 May 2015 19:02:03 +0000 (UTC) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTP id 7AC5D1271D for ; Sun, 17 May 2015 05:01:56 +1000 (EST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id 74E6C2810BA for ; Sun, 17 May 2015 05:01:56 +1000 (EST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au X-Virus-Scanned: amavisd-new at iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pkk-4em7F1Kh for ; Sun, 17 May 2015 05:01:56 +1000 (EST) Received: from Peters-MacBook-Pro.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id B49B6280F62; Sun, 17 May 2015 05:01:54 +1000 (EST) Message-ID: <5557941F.9040608@freebsd.org> Date: Sat, 16 May 2015 12:01:51 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Allan Jude CC: virtualization@freebsd.org Subject: Re: bhyve code question, pci_virtio_net.c References: <55577814.6040202@freebsd.org> In-Reply-To: <55577814.6040202@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 19:02:04 -0000 Hi Allan, > 1) According to the comment, the mac address should be based on the md5 > of the DEVICE name, not the VM name. Which is correct? Which is more > desirable? The comment may not be specific enough - dev name meant /dev/vmm/, which is the same as the VM name. > Would it make sense to include more unique information in this hash? > like the host's UUID or something, to prevent the chance of more than 1 > VM on the same LAN having the same MAC if they have the same VM Name? Yes: see the discussion at http://lists.freebsd.org/pipermail/freebsd-virtualization/2014-February/002187.html The issue was the changing the algorithm breaks existing Linux VMs which base configuration on MAC addresses. Using the host fixes one issue but creates another in that starting a VM on another host then gives a different MAC. However, there is always the option to set the MAC address manually if you feel there will be issues with collisions, using VMs on different hosts, etc. > 2) Should bhyve instead use the FreeBSD assigned OUI for these MAC > addresses? Yes, though switching to that would have had the same issue with breaking Linux guests. My rough plan to move forward with this is that any new non-virtio NIC emulation will get the FreeBSD OUI and perhaps a different default algorithm. virtio-net will continue to use the existing one, but maybe in the future a "legacy-mac" option will be required to use the old algorithm, and then it can be phased out. Yet another option is an auto-generated MAC is placed in a config file on first boot, ala VMWare. That could be the solution when config file work arrives. later, Peter. From owner-freebsd-virtualization@FreeBSD.ORG Sat May 16 23:23:14 2015 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 99157AC9 for ; Sat, 16 May 2015 23:23:14 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [IPv6:2001:4f8:3:ffe0:406a:0:50:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 59F5F1178 for ; Sat, 16 May 2015 23:23:14 +0000 (UTC) Received: from phabric-backend.isc.freebsd.org (phabric-backend.isc.freebsd.org [127.0.1.5]) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9) with ESMTP id t4GNNEp2079173 for ; Sat, 16 May 2015 23:23:14 GMT (envelope-from daemon-user@phabric-backend.isc.freebsd.org) Received: (from daemon-user@localhost) by phabric-backend.isc.freebsd.org (8.14.9/8.14.9/Submit) id t4GNNEmh079172; Sat, 16 May 2015 23:23:14 GMT (envelope-from daemon-user) Date: Sat, 16 May 2015 23:23:14 +0000 To: freebsd-virtualization@freebsd.org From: "rodrigc (Craig Rodrigues)" Subject: [Differential] [Commented On] D1944: PF and VIMAGE fixes Message-ID: X-Priority: 3 Thread-Topic: D1944: PF and VIMAGE fixes X-Herald-Rules: none X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-To: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: X-Phabricator-Cc: In-Reply-To: References: Thread-Index: NDc2NzM0MzY4OTdiYThiNTU1MjY2ZDZmMTJiIFVX0WI= Precedence: bulk X-Phabricator-Sent-This-Message: Yes X-Mail-Transport-Agent: MetaMTA X-Auto-Response-Suppress: All X-Phabricator-Mail-Tags: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="utf-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 May 2015 23:23:14 -0000 rodrigc added a comment. I can confirm that: kldunload -f pf.ko does work to unload the module. That is good. I saw this warning message in dmesg: lock order reversal: (sleepable after non-sleepable) 1st 0xffffffff823b72e0 pf rulesets (pf rulesets) @ /opt2/branches/head/sys/modules/pf/../../netpfil/pf/pf_ioctl.c:321 2nd 0xffffffff818f99a0 umadrain (umadrain) @ /opt2/branches/head/sys/vm/uma_core.c:2109 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe04639fd310 witness_checkorder() at witness_checkorder+0xe26/frame 0xfffffe04639fd3a0 _sx_slock() at _sx_slock+0x76/frame 0xfffffe04639fd3e0 uma_zdestroy() at uma_zdestroy+0x23/frame 0xfffffe04639fd400 pf_normalize_cleanup() at pf_normalize_cleanup+0x26/frame 0xfffffe04639fd420 pf_vnet_uninit() at pf_vnet_uninit+0x6e7/frame 0xfffffe04639fd8c0 vnet_deregister_sysuninit() at vnet_deregister_sysuninit+0x9c/frame 0xfffffe04639fd900 linker_file_unload() at linker_file_unload+0x45e/frame 0xfffffe04639fd950 kern_kldunload() at kern_kldunload+0x12f/frame 0xfffffe04639fd9a0 amd64_syscall() at amd64_syscall+0x27f/frame 0xfffffe04639fdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe04639fdab0 If possible, it would be good to clean that up. REVISION DETAIL https://reviews.freebsd.org/D1944 EMAIL PREFERENCES https://reviews.freebsd.org/settings/panel/emailpreferences/ To: nvass-gmx.com, bz, zec, trociny, glebius, rodrigc, kristof, gnn Cc: julian, robak, freebsd-virtualization, freebsd-pf, freebsd-net