From owner-freebsd-virtualization@freebsd.org Mon Feb 26 09:56:34 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D61F0F39BF0 for ; Mon, 26 Feb 2018 09:56:34 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3B6B16D1E5 for ; Mon, 26 Feb 2018 09:56:34 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w1Q9uXD0089737; Mon, 26 Feb 2018 10:56:33 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id CC03DB68; Mon, 26 Feb 2018 10:56:32 +0100 (CET) Message-ID: <5A93D9D0.4090804@omnilan.de> Date: Mon, 26 Feb 2018 10:56:32 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Ruben CC: freebsd-virtualization@freebsd.org Subject: Re: bhyve manager References: <20180225131401.GA3138@v007.zyxst.net> <5A93CEB6.1080406@omnilan.de> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: ACL 130 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Mon, 26 Feb 2018 10:56:33 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Feb 2018 09:56:35 -0000 Bezüglich Ruben's Nachricht vom 26.02.2018 10:15 (localtime): … > On 26/02/2018 10:09, Harry Schmalzbauer wrote: >> Bezüglich tech-lists's Nachricht vom 25.02.2018 14:14 (localtime): >>> Hi, >>> >>> What do folks use for their bhyve guest management? >>> … >> Copy'n'pasting relevant lines from 'cat ~/vm-launches.txt' >> >> Reason: >> I very much dislike utilizing if_bridge(4), instead would prefere >> vale(4), but that's reproducibly locking up in real world setups. >> So my choice is ng_bridge(4), which isn't covered by any byhve(4) helper > Hi Harry, > > > What are your reasons for preferring ng_bridge over the "normal" bridge? Two very different main reasons: if_bridge(4) is very standards compliant (e.g. that different reserved MAC addresses won't get forwarded – don't know any explicit examples out of mind), which was problematic for some SDN setups (software defined networking, in means of sharing a PHY for multiple VMs and simultaniously interconnect VMs to VMs) Another, personally very significant, reason is that you'll get a superfluous host interface for each if_bridge(4), which makes the output of plain ifconfig(8) kind of unreadable. For VM SDN, I don't need/want those host interfaces, despite they don't do any harm. vale(4) was extremely convinient. Simply create a switch, then each VM attaches on the fly :-) Unfortunately, I'm unable to debug the lockups and my setups was kind of hacky, since I haven't used NIC's native netmap(4) support, but used emulated netmap(4) for if_vlan(4). This leads to loss of almost all performance advantages, but left convinience advantages. Unfortunately, emulated netmap(4) is supposed to have some unresolved problems on FreeBSD and upstream hackers consider my hacky setup as wrong by nature – which it is technically speaking. For real-world usagen, one would need to code a VLAN filter between bhyve(4) and vale(4). Skillwise, I'm not the one :-( -harry