From owner-freebsd-virtualization@FreeBSD.ORG  Wed May 13 23:15:24 2015
Return-Path: <owner-freebsd-virtualization@FreeBSD.ORG>
Delivered-To: freebsd-virtualization@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id D356B3F5
 for <freebsd-virtualization@freebsd.org>; Wed, 13 May 2015 23:15:24 +0000 (UTC)
Received: from mail-ie0-x235.google.com (mail-ie0-x235.google.com
 [IPv6:2607:f8b0:4001:c03::235])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 9BC9E15BD
 for <freebsd-virtualization@freebsd.org>; Wed, 13 May 2015 23:15:24 +0000 (UTC)
Received: by iebgx4 with SMTP id gx4so46157924ieb.0
 for <freebsd-virtualization@freebsd.org>; Wed, 13 May 2015 16:15:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:date:message-id:subject:from:to:content-type;
 bh=Q4l4GrBLyRGWIiXOADzWEg6j5Z0SwrBZt8Ex63/xEm0=;
 b=M4rjT0TV/+c9tJ9adZadRKv6gjl45uEuuZmFMKbrB3IB6mf23PVBjXftpigyf0BBpD
 kk50C2/RxwxLKAej2wY1w5hjrP+OCuXu3ojlDAOwrvyJ6UsOMp1QwIf+eo2joMjjMtzg
 s1W2a5iy5ZVvJ4QezMKDo46CO5tFP+6goTnbyDb+KKa2GBKOFpyEuyBFi0TT5tXiTI+Q
 D+4VIILv+J3PbC2yOB9gu7VSZ7NOSOwQIxGBatmElvVVleJ4fmABJraKmqjgdoKZHnx5
 iuzdcVdIdCcr1FRXaLt5gbi63T+ZsmqLzVez+z9KSOkL25H7+0esuct4TNKb+Qy/xrFA
 XkhA==
MIME-Version: 1.0
X-Received: by 10.50.50.148 with SMTP id c20mr31257999igo.0.1431558923971;
 Wed, 13 May 2015 16:15:23 -0700 (PDT)
Received: by 10.50.207.5 with HTTP; Wed, 13 May 2015 16:15:23 -0700 (PDT)
Date: Wed, 13 May 2015 16:15:23 -0700
Message-ID: <CAO8hVipq_5AzxvL+kSbpaLFEuP+ecU5_s1bGR2Rqv_=xM_ampQ@mail.gmail.com>
Subject: Nested virtualization networking issues with bhyve
From: Jonathan Wong <jon.the.wong@gmail.com>
To: freebsd-virtualization@freebsd.org
Content-Type: text/plain; charset=UTF-8
X-Content-Filtered-By: Mailman/MimeDel 2.1.20
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.20
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 13 May 2015 23:15:25 -0000

I've recently tried to experiment with vmware esxi 6 + vmworkstation and I
managed to get nested virtualization with freebsd guest and nested bhyve
ubuntu VM working. However, the networking doesn't seem to come up properly
while installing, and post install for the ubuntu VM.

The bridged networking works as expected with freebsd guests and other
network nodes on the network. However, the nested VMs themselves can't seem
to bring up networking properly.

lspci seems to bring up the virtio network device, but even configuring
static ips doesn't help. The VM is not able to receive or route any packets
from any VM

FreeBSD guest can ssh into the nested VM. The nested VM can ssh into
freebsd guest.  The nested VM cannot contact internet or local gateway.
Tried with E1000 and VMXNET 2. Computers on network can ssh into freebsd
guest. The freebsd guest can ssh into other computers on the network.
Computers on the network cannot contact the VM. The vmware host cannot
contact the nested VM or vice versa.

Any tips to getting this to work?

Thanks.