From owner-freebsd-net@freebsd.org Thu Jul 26 14:41:12 2018 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BE7210512F0 for ; Thu, 26 Jul 2018 14:41:12 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (unknown [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EEF74925E6 for ; Thu, 26 Jul 2018 14:41:11 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w6QEf4Up063492 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 26 Jul 2018 16:41:04 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: freebsd-net@freebsd.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w6QEf06A030900 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Thu, 26 Jul 2018 21:41:00 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: PPPoE RX traffic is limited to one queue To: Richard Pasztor , freebsd-net@freebsd.org References: From: Eugene Grosbein Message-ID: <5B59DD78.3020908@grosbein.net> Date: Thu, 26 Jul 2018 21:40:56 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -0.0 SPF_PASS SPF: sender matches SPF record * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS * 2.6 LOCAL_FROM From my domains X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jul 2018 14:41:12 -0000 26.07.2018 21:27, Richard Pasztor wrote: > Note2: I am not at the level of building a proper PPPoE simlator network to > properly validate the final performance, all my tests were performed using > pure IP routing. So expect PPPoE can be by definition only worse than what > I can possibly reach using pure IP. > > I was suggested to set the following: > net.isr.numthreads=4 > net.isr.maxthreads=4 > net.isr.bindthreads=1 > net.isr.dispatch=deferred > > It didnt improve the situation, max. throughput was about the same, but CPU > load in interrupt handling effectively became doubled. > > On the other hand, installing a small Linux firewall distrib (IPfire), I > could easily manage to get 900+ MBit of traffic with less interrupt load on > the system. So I dont know how could Linux overcome the above said > limitation. > > As the original bugreport was against a possibly "igb" Intel driver issues, > and that was said not the case, the PR was closed. So no advancement is > expected in this topic, hence I opened it here, hoping there is some > solution for this issue. Please describe your setup, hardware and software. Include exact FreeBSD version/revision you use. Include all changes to /boot/loader.conf and /etc/sysctl.conf, if any. Do you use GENERIC kernel? If not, include your kernel configuration file. Include full output of "ifconfig" command. Show output of "top -SHPI" at receiving side while performing your test. Also, include output of "systat -vm 3" while traffic flows.