From owner-freebsd-net@FreeBSD.ORG  Fri May 25 13:31:45 2012
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
	by hub.freebsd.org (Postfix) with ESMTP id 7DB04106566B
	for <freebsd-net@freebsd.org>; Fri, 25 May 2012 13:31:45 +0000 (UTC)
	(envelope-from gallatin@cs.duke.edu)
Received: from duke.cs.duke.edu (duke.cs.duke.edu [152.3.140.1])
	by mx1.freebsd.org (Postfix) with ESMTP id 2B1508FC14
	for <freebsd-net@freebsd.org>; Fri, 25 May 2012 13:31:45 +0000 (UTC)
Received: from [192.168.200.2] (c-24-125-204-77.hsd1.va.comcast.net
	[24.125.204.77]) (authenticated bits=0)
	by duke.cs.duke.edu (8.14.5/8.14.5) with ESMTP id q4PDRhs0023267
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Fri, 25 May 2012 09:27:43 -0400 (EDT)
X-DKIM: Sendmail DKIM Filter v2.8.3 duke.cs.duke.edu q4PDRhs0023267
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=cs.duke.edu; s=mail;
	t=1337952464; bh=9BnQGuJE8ZjOVQe86fxEHhXgNy3ODKvrd5RUmEciJrQ=;
	h=Message-ID:Date:From:MIME-Version:To:CC:Subject:References:
	In-Reply-To:Content-Type:Content-Transfer-Encoding;
	b=GU/pVgGehwrsKV0GLF/ESmD7VVZVQcdNkWJlndN08WiRMvKw0HI97VCkI7aC3TgZ5
	NDU9DNLWCq0JjBlwHqhYKQRsj1m2tseCOMA6a9+42QQ0pWdCvYyW/dbroFYvUIinxx
	DUzzIrG48ktTEoa7561bdYU/ZhPsC/m4XeUi9et44Qlg6qZlZglJvc+GfG2KU7pGAd
	LJlB8htXEaLUi9Fn+34LqAMMMSEQZz9LPcyyWQVDLhWDCoxNzCfJuP66qobbfuINko
	2H4VgQvG7th2sEQjtDFLB9COEu4j0g1PKh8AH42fzTFUCAtqxmrzeKSU7CB7o1c8rt
	+8/V2jZzGffBQ==
Message-ID: <4FBF88CE.20209@cs.duke.edu>
Date: Fri, 25 May 2012 09:27:42 -0400
From: Andrew Gallatin <gallatin@cs.duke.edu>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:11.0) Gecko/20120329 Thunderbird/11.0.1
MIME-Version: 1.0
To: freebsd-net@freebsd.org
References: <CAN6yY1sLxFJ18ANO7nQqLetnJiT-K6pHC-X3yT1dWuWGa0VLUg@mail.gmail.com>
In-Reply-To: <CAN6yY1sLxFJ18ANO7nQqLetnJiT-K6pHC-X3yT1dWuWGa0VLUg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Andrew Gallatin <gallatin@myri.com>
Subject: Re: Major performance hit with ToS setting
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 25 May 2012 13:31:45 -0000

On 05/24/12 18:55, Kevin Oberman wrote:

>
> This is,of course, on a 10G interface. On 7.3 there is little

Hi Kevin,


What you're seeing looks almost like a checksum is bad, or
there is some other packet damage.  Do you see any
error counters increasing if you run netstat -s before
and after the test & compare the results?

Thinking that, perhaps, this was a bug in my mxge(4), I attempted
to reproduce it this morning between  8.3 and 9.0 boxes and
failed to see the bad behavior..

% nuttcp-6.1.2 -c32t -t diablo1-m < /dev/zero
  9161.7500 MB /  10.21 sec = 7526.5792 Mbps 53 %TX 97 %RX 0 
host-retrans 0.11 msRTT
% nuttcp-6.1.2  -t diablo1-m < /dev/zero
  9140.6180 MB /  10.21 sec = 7509.8270 Mbps 53 %TX 97 %RX 0 
host-retrans 0.11 msRTT


However, I don't have any 8.2-r box handy, so I cannot
exactly repro your experiment...


Drew