From owner-freebsd-net@freebsd.org  Mon Aug  8 19:45:50 2016
Return-Path: <owner-freebsd-net@freebsd.org>
Delivered-To: freebsd-net@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 872A3BB254C
 for <freebsd-net@mailman.ysv.freebsd.org>;
 Mon,  8 Aug 2016 19:45:50 +0000 (UTC)
 (envelope-from eugen@grosbein.net)
Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id 1DA4F199B
 for <freebsd-net@freebsd.org>; Mon,  8 Aug 2016 19:45:49 +0000 (UTC)
 (envelope-from eugen@grosbein.net)
Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221])
 by hz.grosbein.net (8.14.9/8.14.9) with ESMTP id u78JjgjC055663
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT);
 Mon, 8 Aug 2016 21:45:43 +0200 (CEST)
 (envelope-from eugen@grosbein.net)
X-Envelope-From: eugen@grosbein.net
X-Envelope-To: sepherosa@gmail.com
Received: from [10.58.0.10] (dadvw [10.58.0.10])
 by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id u78JjY2N033300
 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT);
 Tue, 9 Aug 2016 02:45:34 +0700 (KRAT)
 (envelope-from eugen@grosbein.net)
Subject: Re: 40Gbps http client benchmark
To: Sepherosa Ziehau <sepherosa@gmail.com>
References: <57A62668.7020309@grosbein.net>
 <CAMOc5cyHsLZ93R9jQncBgReii0nCTnW0ZoBFbA4RkHpTcwHcnw@mail.gmail.com>
Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
From: Eugene Grosbein <eugen@grosbein.net>
Message-ID: <57A8E15A.2060304@grosbein.net>
Date: Tue, 9 Aug 2016 02:45:30 +0700
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101
 Thunderbird/38.7.2
MIME-Version: 1.0
In-Reply-To: <CAMOc5cyHsLZ93R9jQncBgReii0nCTnW0ZoBFbA4RkHpTcwHcnw@mail.gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM
 autolearn=no version=3.3.2
X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1%
 *      [score: 0.0000] *  2.6 LOCAL_FROM From my domains
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hz.grosbein.net
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Aug 2016 19:45:50 -0000

08.08.2016 8:57, Sepherosa Ziehau пишет:
> We have an optimized wrk here:
> https://github.com/sepherosa/wrk

I've glanced over your changes to wrk.
(Btw, you have minor bug there: missed 'N' short flag in getopt_long() invocation
for new --delay option, so "wrk --delay" works but "wrk -N" fails to parse command line.)

I managed to reproducible get 4.38GB/s (about 36Gbps) with your version of wrk
and it still eats over 60% of each core with "system time" using 8-core
Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz. Same speed I get without your changes.

I see that I cannot make even load for all four 10G ports of lagg interface
and that's obvious reason to be unable to saturate 40Gbps.

I need to create more connections for benchmark but then wrk eats even more CPU
and overall throughput decreases.