From owner-freebsd-net@freebsd.org Sat Mar 18 08:29:27 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE53BD1069B for ; Sat, 18 Mar 2017 08:29:27 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-ot0-x22b.google.com (mail-ot0-x22b.google.com [IPv6:2607:f8b0:4003:c0f::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8B6A91572 for ; Sat, 18 Mar 2017 08:29:27 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-ot0-x22b.google.com with SMTP id a12so39209754ota.0 for ; Sat, 18 Mar 2017 01:29:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7Y6Kc6tTwWGwbnALTWFdACAMf3GdYSlLdUhYGLK/k9A=; b=qywf4GxZVbw4F7vw8InOZGZ6q/WW7PXZxsaBoQqm+CsLWQCigbO9yc2FTb48nMjo4Y m2Fj6w+Tb7syNazmTk7BSEubQFFkMKIETdQUIw63zakDMyn69uieHZjF3DsHS4kJqb+u wFP4RLGlV/F11LcIZF6YnQjN38mydyk1MYsPl0CYdHB7ZM8cZRoHqUt3DvivXuTdNZLh W9SP8uL9TnU5jR4o2kkK9k0BQs+TcK4X31GTLd+50VOF5So+buyzbBuS+eYuBIdS9HC9 aEyHR2AJAD59N9mlc/if5cpxVJlDnu3lyggg+N5Rs3NmSaSa1UM2xJO5PJp1gzfaUf0R Ijng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7Y6Kc6tTwWGwbnALTWFdACAMf3GdYSlLdUhYGLK/k9A=; b=IjZt+jwMziNG+mVVt5EuGn+9M/mT8bu4Xw6ZXhl3wfEhFROiVhEuHt+LVOnfa5NY0F WszROTq7QmM92zAss9T+217sKgvRVT0R09FPzWdpKfGnZNXH7PXeRl9MVA1nZSkAZ6Ei ZNxX1PC1N45xXtLBHLmBp7rEhAB6umpdPEeTlxQeW3zLGEW/L21dF6vJEQf/fbfo3jlS OB0t5gEoWcibjd3+8TkyJ4X8fyXlc6AgzdDcV5ZJj2Ad6uvI3uZy8rxT101EehPY27e5 TKAEp7QuJNTo3Oz+ZFqpefQJy7Qu8ztWb/ycOoshvSLYvL/jqJ9JZ+nxKVR4d/zWVvUw jeSA== X-Gm-Message-State: AFeK/H0oqpbjirJOxq5B44b3cvtVbW80gg1ypBYionKJm9alTEgHoll1b0T2BeD+PrJ57WKRiTHEAmIT37+Ctw== X-Received: by 10.157.48.167 with SMTP id s39mr10838034otc.108.1489825766302; Sat, 18 Mar 2017 01:29:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.50.45 with HTTP; Sat, 18 Mar 2017 01:29:25 -0700 (PDT) In-Reply-To: <58CC26CF.5050708@omnilan.de> References: <58CBA727.3040108@omnilan.de> <58CBBF7A.8050604@omnilan.de> <58CC26CF.5050708@omnilan.de> From: Vincenzo Maffione Date: Sat, 18 Mar 2017 09:29:25 +0100 Message-ID: Subject: Re: Are ./valte-ctl and ./bridge friends or competitors? To: Harry Schmalzbauer Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 18 Mar 2017 08:29:27 -0000 2017-03-17 19:11 GMT+01:00 Harry Schmalzbauer : > Bez=C3=BCglich Vincenzo Maffione's Nachricht vom 17.03.2017 18:51 (localt= ime): > > Hi, > > > > ./bridge is a netmap application that implements a simple forwarder > > between two netmap ports (given as input arguments). I don't see any wa= y > > to use that to let two bhyve VMs work together. It's an example > > application that shows you how fast a netmap application can be in > > forwarding packets between two NICs, when there is no "business logic". > > > > ./vale-ctl is a control tool to attach network interfaces to a VALE L2 > > switch. If the switch does not exists yet, it is created. So vale-ctl i= s > > not a netmap application. Then, the bhyve VM typically attaches to the > > VALE switch using a vale port, e.g. "vale0:guest1" in your example. The > > VALE port has the same role as the tap(4) in the traditional > > if_bridge-based way to connect VMs. > > When using your physical NICs with netmap, you need to disable the > > offloadings because netmap is not able to program the NIC to perform > > these offloadings. This is a design decision that has been taken to > > preserve simplicity and efficiency. > > The promiscuous mode is necessary to accept the ethernet frames with > > MACs corresponding to the VM virtual interfaces (virtio-net a.k.a. > vtnet). > > *doh* of course. Dumb question, thanks for your patience! > > > > Actually, there is pending work on bhyve and netmap, that is going to b= e > > merged soon, available at https://github.com/vmaffione/freebsd/ in > > branch ptnet-head. > > > > If you are interested, here there is some information > > https://wiki.freebsd.org/DevSummit/201609?action=3D > AttachFile&do=3Dview&target=3D20160923-freebsd-summit-ptnet.pdf > > AttachFile&do=3Dview&target=3D20160923-freebsd-summit-ptnet.pdf> > > together with bhyve cmdlines. > > Thanks for the hint! > I saw ptnet commits to head some weekas ago, but haven't expected them > to be merged soon. > There's also some em/igb overhaul pending, which won't be too easy to > merge backt to stable/11 because of iflib differences, if I understood > the story. > > So I'm a bit lost regarding furhter decisions. My prefered if_lagg(4) > setup doesn't work with netmap at the moment, if_bridge(4) has > in-house-overhead and forces me to either drop jumbo frames completely > or use 9k MTU for any bridge member. > Will look into openvSwitch. Or better get some card providing VFs? > Or wait the ptnet merge and check if I can deploy my desired setup then? > And, I want to keep TSO and HWVLAN_TAG on the host interfaces=E2=80=A6 > > It depends on your requirements, in terms of connectivity between VMs and NICs and required performance (for a given workload, e.g. average packet-size, average packet rate, etc.). If you really want TSO an other offloadings on the phyisical NIC, then you cannot use that NIC in netmap mode (e.g. attaching it to VALE). Cheers, Vincenzo > Thanks a lot, > > -harry > > --=20 Vincenzo Maffione