From owner-freebsd-net@freebsd.org Fri Mar 17 18:11:30 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 318F6D103BB for ; Fri, 17 Mar 2017 18:11:30 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BCE5A133A for ; Fri, 17 Mar 2017 18:11:29 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id v2HIBSR7030096; Fri, 17 Mar 2017 19:11:28 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id A74AA721; Fri, 17 Mar 2017 19:11:27 +0100 (CET) Message-ID: <58CC26CF.5050708@omnilan.de> Date: Fri, 17 Mar 2017 19:11:27 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Vincenzo Maffione CC: "freebsd-net@freebsd.org" Subject: Re: Are ./valte-ctl and ./bridge friends or competitors? References: <58CBA727.3040108@omnilan.de> <58CBBF7A.8050604@omnilan.de> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: ACL 119 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Fri, 17 Mar 2017 19:11:28 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Mar 2017 18:11:30 -0000 Bezüglich Vincenzo Maffione's Nachricht vom 17.03.2017 18:51 (localtime): > Hi, > > ./bridge is a netmap application that implements a simple forwarder > between two netmap ports (given as input arguments). I don't see any way > to use that to let two bhyve VMs work together. It's an example > application that shows you how fast a netmap application can be in > forwarding packets between two NICs, when there is no "business logic". > > ./vale-ctl is a control tool to attach network interfaces to a VALE L2 > switch. If the switch does not exists yet, it is created. So vale-ctl is > not a netmap application. Then, the bhyve VM typically attaches to the > VALE switch using a vale port, e.g. "vale0:guest1" in your example. The > VALE port has the same role as the tap(4) in the traditional > if_bridge-based way to connect VMs. > When using your physical NICs with netmap, you need to disable the > offloadings because netmap is not able to program the NIC to perform > these offloadings. This is a design decision that has been taken to > preserve simplicity and efficiency. > The promiscuous mode is necessary to accept the ethernet frames with > MACs corresponding to the VM virtual interfaces (virtio-net a.k.a. vtnet). *doh* of course. Dumb question, thanks for your patience! > Actually, there is pending work on bhyve and netmap, that is going to be > merged soon, available at https://github.com/vmaffione/freebsd/ in > branch ptnet-head. > > If you are interested, here there is some information > https://wiki.freebsd.org/DevSummit/201609?action=AttachFile&do=view&target=20160923-freebsd-summit-ptnet.pdf > > together with bhyve cmdlines. Thanks for the hint! I saw ptnet commits to head some weekas ago, but haven't expected them to be merged soon. There's also some em/igb overhaul pending, which won't be too easy to merge backt to stable/11 because of iflib differences, if I understood the story. So I'm a bit lost regarding furhter decisions. My prefered if_lagg(4) setup doesn't work with netmap at the moment, if_bridge(4) has in-house-overhead and forces me to either drop jumbo frames completely or use 9k MTU for any bridge member. Will look into openvSwitch. Or better get some card providing VFs? Or wait the ptnet merge and check if I can deploy my desired setup then? And, I want to keep TSO and HWVLAN_TAG on the host interfaces… Thanks a lot, -harry