From owner-freebsd-net@freebsd.org Wed Jun 14 15:03:53 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ABE1CD8FE8C for ; Wed, 14 Jun 2017 15:03:53 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: from mail-ot0-x22a.google.com (mail-ot0-x22a.google.com [IPv6:2607:f8b0:4003:c0f::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E087673AE for ; Wed, 14 Jun 2017 15:03:53 +0000 (UTC) (envelope-from v.maffione@gmail.com) Received: by mail-ot0-x22a.google.com with SMTP id s7so2497290otb.3 for ; Wed, 14 Jun 2017 08:03:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=i1wzkDDWcDKa8BQkrEHDPcijN04qLAPC/LIIP3YnZrQ=; b=Ijm7ZjlEkrBySa20dwgFWe0r4mDsBLySxKXKPVcnA38Qoiyf+Rt8aY0yVgjR4FDQM4 R7wLAuC7bUl/iKtFEmZdShItWvJ716gjELOGCqwwf/kyONkt1AKoGRGPatyo1iUCYU2k lwTtIC4gMQYI6VI5S6lty4E6IN9YCB2DaMK0T1uivff2GMtLtuekLdFHBL1IGl5iYPCD oJlog0hF24+1lRdsyz+GWUQAvC2f59RfXZLIfZyBjz3nLqOhLqNiCfwilFxksR9J70ts qZiUc0Vv1wz+b3UBpgyPzlJLzeKeM+4PbUTyYxbMZRMnWmv64+VlSKfTZ+HNthaGE9d6 B9GQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=i1wzkDDWcDKa8BQkrEHDPcijN04qLAPC/LIIP3YnZrQ=; b=dxB+dRMVuZOvY0L073APaCCTIJQ6w3GO23ScEhrcXiHgBy8VCxC6qngdzVlVM07MVU fnmsLlprpFNaxsK6gAydlQfDJLG+yw51TAphXi4Ycr5El4HRgHAK9SS9RJFO6pOXyQ69 K96xZRp69rgBxU3eTIZ6bEZOo2Edto5Tqhqr6UYt2jwMroqyg/dICIO17Pz9ZbxHX6pj CqQoIyCoyxXyOUqy2W++zhWb8sP61XwID1zPsVmO+6ZF0lspZ1H25pD0oQKVECsA6oVN m+wI5nYfpyJVEGTrnCNWIwlAFPL+WGtCsR62N1o92u+1um8qQcPkAGbMkRALdBYB2Do/ IaRA== X-Gm-Message-State: AKS2vOzbgNP0L8UXySKYjSAEL130f59e17UadbgUPAxYV5i1yscQPTqg 9K3NkhxNAc/LRenCxgUFyfKmXizZpA== X-Received: by 10.157.45.169 with SMTP id g38mr430357otb.73.1497452632630; Wed, 14 Jun 2017 08:03:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.17.49 with HTTP; Wed, 14 Jun 2017 08:03:52 -0700 (PDT) Received: by 10.157.17.49 with HTTP; Wed, 14 Jun 2017 08:03:52 -0700 (PDT) In-Reply-To: References: From: Vincenzo Maffione Date: Wed, 14 Jun 2017 17:03:52 +0200 Message-ID: Subject: Re: state of packet forwarding in FreeBSD? To: John Jasen Cc: FreeBSD Net Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Jun 2017 15:03:53 -0000 Hi, To test netmap raw forwarding performance using just one core, use the bridge program between two netmap supported NICs, like ix or ixl # ./bridge ix0 ix1 You could implement your own multicore software router by extending the bridge example to implement the protocols you need. Vale-ctl it's a different story, you can use it to attach netmap enabled NICs to the VALE software bridge. See the VALE paper for details. Cheers, Vincenzo Il 14 giu 2017 4:48 PM, "John Jasen" ha scritto: > Our goal was to test whether or not FreeBSD currently is viable, as the > operating system platform for high speed routers and firewalls, in the > 40 to 100 GbE range. > > In our investigations, we tested 10.3, 11.0/-STABLE, -CURRENT, and a USB > stick from BSDRP using the FreeBSD routing improvements project > enhancements (https://wiki.freebsd.org/ProjectsRoutingProposal). > > We've tried stock and netmap-fwd, have played around a little with > netmap itself and dpdk, with the results summarized below. The current > testing platform is a Dell PowerEdge R530 with a Chelsio T580-LP-CR dual > port 40GbE card. > > Suggestions, examples for using netmap, etc, all warmly welcomed. > > Further questions cheerfully answered to the best of our abilities. > > a) On the positive side, it appears that 11.0 is much faster than 10.0, > which we tested several years ago. With appropriate cpuset tuning, 5.5 > mpps is achievable using modern hardware. Using slightly older hardware, > (such as a Dell R720 with v3 xeons), around 5.2-5.3 mpps can be obtained. > > b) On the negative side, between the various releases, netmap appeared > to be unstable with the Chelsio cards -- sometimes supported, sometimes > broken. Also, we're still trying to figure out netmap utilities, such as > vale-ctl and bridge, so any advice would be appreciated. > > b.1) netmap-fwd is admittedly single-threaded and does not support IPv6. > These clearly showed in our tests, as we were unable to achieve over 2.5 > mpps, saturating a single CPU and letting the others fall asleep. > However, bumping a single CPU queue from around 0.6 mpps to 2.5 mpps is > nothing to ignore, so it could be useful in some cases. > > c) The routing improvement project USB stick performed incredibly, > achieving 8.5 mpps out of the box. However, it appears > (https://wiki.freebsd.org/ProjectsRoutingProposal/ConversionStatus), > that many of the changes are still pending review, and that things have > not moved much in the last 18 months > (https://svnweb.freebsd.org/base/projects/routing/) > > d) We've not figured out dpdk (dpdk.org) yet. Our first foray into the > test examples, and we're stuck trying to get the interfaces online. > > -- John Jasen (jjasen@gmail.com) > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >