From owner-freebsd-net@freebsd.org  Fri Mar 17 19:55:34 2017
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4098FD0F0F6
 for <freebsd-net@mailman.ysv.freebsd.org>;
 Fri, 17 Mar 2017 19:55:34 +0000 (UTC) (envelope-from slw@zxy.spb.ru)
Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id F24021B1C
 for <freebsd-net@freebsd.org>; Fri, 17 Mar 2017 19:55:33 +0000 (UTC)
 (envelope-from slw@zxy.spb.ru)
Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD))
 (envelope-from <slw@zxy.spb.ru>)
 id 1coxyF-000PBn-9H; Fri, 17 Mar 2017 22:55:31 +0300
Date: Fri, 17 Mar 2017 22:55:31 +0300
From: Slawa Olhovchenkov <slw@zxy.spb.ru>
To: John Jasen <jjasen@gmail.com>
Cc: Navdeep Parhar <nparhar@gmail.com>,
 "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>,
 "Caraballo-vega, Jordan A." <jordancaraballo87@gmail.com>
Subject: Re: bad throughput performance on multiple systems: Re: Fwd: Re:
 Disappointing packets-per-second performance results on a Dell,PE R530
Message-ID: <20170317195531.GP70430@zxy.spb.ru>
References: <6ad029e0-86c6-af3d-8fc3-694d4bcdc683@gmail.com>
 <b460cc49-364a-34fb-e212-582730546dee@gmail.com>
 <20170312231826.GV15630@zxy.spb.ru>
 <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com>
 <CAPFoGT9k4HfDCQ7wJPDFMTrJTtDyc9uK_ma9ubneDhVSsS-jcA@mail.gmail.com>
 <173fffac-7ae2-786a-66c0-e9cd7ab78f44@gmail.com>
 <CAPFoGT-BAMpj34wtB06dxMKk+87OEOs5-qu+RLVz=aPrhX6hDA@mail.gmail.com>
 <CAACLuR29xQhDWATRheBaOU2vtiYp61JgDKHaXum+U32MBDLBzw@mail.gmail.com>
 <20170317100814.GN70430@zxy.spb.ru>
 <9924b2d5-4a72-579c-96c6-4dbdacc07c95@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <9924b2d5-4a72-579c-96c6-4dbdacc07c95@gmail.com>
User-Agent: Mutt/1.5.24 (2015-08-30)
X-SA-Exim-Connect-IP: <locally generated>
X-SA-Exim-Mail-From: slw@zxy.spb.ru
X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 17 Mar 2017 19:55:34 -0000

On Fri, Mar 17, 2017 at 03:21:37PM -0400, John Jasen wrote:

> On 03/17/2017 06:08 AM, Slawa Olhovchenkov wrote:
> 
> > On Thu, Mar 16, 2017 at 03:50:42PM -0400, John Jasen wrote:
> >
> >> As a few points of note, partial resolution, and curiosity:
> >>
> >> Following down leads that 11-STABLE had tryforward improvements over
> >> 11-RELENG, I upgraded. The same tests (24 client streams over UDP with
> >> small packets), the system went from passing 1.7m pps to about 2.5m.
> >>
> >> Following indications from Navdeep Parhar that UDP queue hashing is not as
> >> efficient as it could be, we started running the tests with various powers
> >> of 2 streams (2,4,8,16,32) -- and were able to push the system up to 5m pps.
> >>
> >> We are currently seeing in the tests approximately 10-11m pps on the
> >> outside interface, around 5-6m dropped, and 5 million passed.
> > You want more?
> 
> Yes.

OK. How many?
What the current utilisation per core?
What exactly hardware and software used?

I mean netmap don't give to you many performance gain.