From owner-freebsd-net@FreeBSD.ORG  Fri Jul 11 18:04:13 2014
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id B54362E5
 for <freebsd-net@freebsd.org>; Fri, 11 Jul 2014 18:04:13 +0000 (UTC)
Received: from mx1.sbone.de (bird.sbone.de [46.4.1.90])
 (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits))
 (Client CN "mx1.sbone.de", Issuer "SBone.DE" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id 686B925BF
 for <freebsd-net@freebsd.org>; Fri, 11 Jul 2014 18:04:12 +0000 (UTC)
Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587])
 (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
 (No client certificate requested)
 by mx1.sbone.de (Postfix) with ESMTPS id 2C2E825D37C7;
 Fri, 11 Jul 2014 18:04:10 +0000 (UTC)
Received: from content-filter.sbone.de (content-filter.sbone.de
 [IPv6:fde9:577b:c1a9:31::2013:2742])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by mail.sbone.de (Postfix) with ESMTPS id 51908C22C26;
 Fri, 11 Jul 2014 18:04:09 +0000 (UTC)
X-Virus-Scanned: amavisd-new at sbone.de
Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587])
 by content-filter.sbone.de (content-filter.sbone.de
 [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024)
 with ESMTP id tGZOqRsmF2f9; Fri, 11 Jul 2014 18:04:07 +0000 (UTC)
Received: from [IPv6:fde9:577b:c1a9:4410:80b3:3e87:431:f220] (unknown
 [IPv6:fde9:577b:c1a9:4410:80b3:3e87:431:f220])
 (using TLSv1 with cipher AES128-SHA (128/128 bits))
 (No client certificate requested)
 by mail.sbone.de (Postfix) with ESMTPSA id 8CA68C22B9F;
 Fri, 11 Jul 2014 18:04:05 +0000 (UTC)
Content-Type: text/plain; charset=windows-1252
Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\))
Subject: Re: tuning routing using cxgbe and T580-CR cards?
From: "Bjoern A. Zeeb" <bzeeb-lists@lists.zabbadoz.net>
In-Reply-To: <53C01EB5.6090701@gmail.com>
Date: Fri, 11 Jul 2014 18:03:45 +0000
Content-Transfer-Encoding: quoted-printable
Message-Id: <01AABF44-4801-45B5-9509-1CA7BAA3CB30@lists.zabbadoz.net>
References: <53C01EB5.6090701@gmail.com>
To: John Jasem <jjasen@gmail.com>
X-Mailer: Apple Mail (2.1878.6)
Cc: FreeBSD Net <freebsd-net@freebsd.org>, Navdeep Parhar <nparhar@gmail.com>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 11 Jul 2014 18:04:13 -0000

On 11 Jul 2014, at 17:28 , John Jasem <jjasen@gmail.com> wrote:

> c) the defaults for the cxgbe driver appear to be 8 rx queues, and N =
tx
> queues, with N being the number of CPUs detected. For a system running
> multiple cards, routing or firewalling, does this make sense, or would
> balancing tx and rx be more ideal? And would reducing queues per card
> based on NUMBER-CPUS and NUM-CHELSIO-PORTS make sense at all?
> =85
> g) Are there other settings I should be looking at, that may squeeze =
out
> a few more packets?

If you are primarily forwarding packets (you say =93routing=94 multiple =
times) the first thing you should do is turn off LRO and TSO on all =
ports.

=97=20
Bjoern A. Zeeb             "Come on. Learn, goddamn it.", WarGames, 1983