From owner-freebsd-net@FreeBSD.ORG Thu May 24 23:43:47 2012 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2B79F106564A for ; Thu, 24 May 2012 23:43:47 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:130:3ffc::401:25]) by mx1.freebsd.org (Postfix) with ESMTP id D2ABD8FC12 for ; Thu, 24 May 2012 23:43:46 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id E057C25D3A90; Thu, 24 May 2012 23:43:45 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 02E29BE7A9D; Thu, 24 May 2012 23:43:45 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id UVJ22-b-CgqE; Thu, 24 May 2012 23:43:44 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 0AB24BE7A9A; Thu, 24 May 2012 23:43:43 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: Date: Thu, 24 May 2012 23:43:42 +0000 Content-Transfer-Encoding: 7bit Message-Id: References: To: Kevin Oberman X-Mailer: Apple Mail (2.1084) Cc: net@freebsd.org Subject: Re: Major performance hit with ToS setting X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 May 2012 23:43:47 -0000 On 24. May 2012, at 22:55 , Kevin Oberman wrote: > When we set the ToS bits for less than best effort (also called > scavenger) on packets (ToS=32), performance on FreeBSD 8.2 is > terrible. It was as good as best effort on FreeBSD 7.3 (assuming no > congestion). I will look into what 9 does, but does anyone have an > idea of why 8.2 behaves so badly when ToS is set to 32? > Here is an example of what happens to performance: > nuttcp with ToS=0: > 622.5000 MB / 1.00 sec = 5221.7570 Mbps > 623.3125 MB / 1.00 sec = 5228.5883 Mbps > 624.0000 MB / 1.00 sec = 5234.4495 Mbps > > With ToS=32 (0x20): > 0.3750 MB / 1.00 sec = 3.1457 Mbps > 0.5000 MB / 1.00 sec = 4.1942 Mbps > 0.5000 MB / 1.00 sec = 4.1942 Mbps > > This is,of course, on a 10G interface. On 7.3 there is little > difference between the two. We are using cubic CC on the 8.2 system. This looks like a different problem than just TOS. I assume however that not setting the TOS you get the same as expected performance? Which NIC? /bz -- Bjoern A. Zeeb You have to have visions! It does not matter how good you are. It matters what good you do!