From owner-freebsd-net@FreeBSD.ORG  Tue Jul 19 11:16:28 2011
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 4978A106564A
	for <freebsd-net@freebsd.org>; Tue, 19 Jul 2011 11:16:28 +0000 (UTC)
	(envelope-from prvs=1181b50c55=killing@multiplay.co.uk)
Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23])
	by mx1.freebsd.org (Postfix) with ESMTP id C12248FC19
	for <freebsd-net@freebsd.org>; Tue, 19 Jul 2011 11:16:27 +0000 (UTC)
X-MDAV-Processed: mail1.multiplay.co.uk, Tue, 19 Jul 2011 12:05:03 +0100
X-Spam-Processed: mail1.multiplay.co.uk, Tue, 19 Jul 2011 12:04:57 +0100
X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on
	mail1.multiplay.co.uk
X-Spam-Level: 
X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST
	shortcircuit=ham autolearn=disabled version=3.2.5
Received: from r2d2 ([188.220.16.49])
	by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23])
	(MDaemon PRO v10.0.4) with ESMTP id md50014221054.msg
	for <freebsd-net@freebsd.org>; Tue, 19 Jul 2011 12:04:56 +0100
X-MDRemoteIP: 188.220.16.49
X-Return-Path: prvs=1181b50c55=killing@multiplay.co.uk
X-Envelope-From: killing@multiplay.co.uk
X-MDaemon-Deliver-To: freebsd-net@freebsd.org
Message-ID: <00F86D895BEA493E8FB82F0CDF42AA04@multiplay.co.uk>
From: "Steven Hartland" <killing@multiplay.co.uk>
To: "Jack Vogel" <jfvogel@gmail.com>
References: <379885BA631F4C7787C24E00A174B429@multiplay.co.uk><CAN6yY1s=o=Fd5mgkjrPPqeKmtCXVeDbFrEUqJZk85ccBBa2X4Q@mail.gmail.com><CEE01EEE7538428F8CB9A764CF0EFFFA@multiplay.co.uk>
	<CAFOYbc=2RyTM_SbQt_v96HL_bSwFPmiJqW--tWJUx1x_jM3ffQ@mail.gmail.com>
Date: Tue, 19 Jul 2011 12:05:12 +0100
MIME-Version: 1.0
Content-Type: text/plain; format=flowed; charset="iso-8859-1";
	reply-type=original
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2900.5931
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6109
Cc: freebsd-net@freebsd.org, Kevin Oberman <kob6558@gmail.com>
Subject: Re: igb enable_aim or flow_control causing tcp stalls?
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Jul 2011 11:16:28 -0000

Ok making some progress now, disabling msix by setting hw.igb.enable_msix=0
in /boot/loader.conf fixes the stalls, so I'm guessing this indicates a
driver issue?

My current test case is a repeating scp of the freebsd iso from 3 local
machines + 1 remote to the target machine, which seems to be enough to
reproduce the stall within ~30mins if its going to happen.

I also tried setting hw.igb.num_queues=1 with msix enabled but I was still
able to create a stall with this config.

Is there some debugging I can do to help track this down?

    Regards
    Steve

================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster@multiplay.co.uk.