From owner-freebsd-net@FreeBSD.ORG  Mon Mar  4 18:16:19 2013
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by hub.freebsd.org (Postfix) with ESMTP id 47D9665D
 for <freebsd-net@freebsd.org>; Mon,  4 Mar 2013 18:16:19 +0000 (UTC)
 (envelope-from jfvogel@gmail.com)
Received: from mail-vc0-f177.google.com (mail-vc0-f177.google.com
 [209.85.220.177]) by mx1.freebsd.org (Postfix) with ESMTP id D939ECC0
 for <freebsd-net@freebsd.org>; Mon,  4 Mar 2013 18:16:18 +0000 (UTC)
Received: by mail-vc0-f177.google.com with SMTP id m18so3541785vcm.22
 for <freebsd-net@freebsd.org>; Mon, 04 Mar 2013 10:16:18 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:x-received:in-reply-to:references:date:message-id
 :subject:from:to:cc:content-type;
 bh=CM8tmangjINKI2bTYR+D4LqV85uQDGow7zqBrVisZxw=;
 b=wL2eXN3K8hto9pQ40gwmt6IlX87odAVQAjIGI2/y/QEFjWb/nHQxwNa8B5Y/Q48Z5K
 c4V/PnZ7+dcs+Uqp5HA4po+t/2QXoT4F772I94MB30qBpzIsFvhAH/wFAZVMwZ0OfAYd
 j07UlMLrhq1enF92DOJ8OC20AVV8T04sLVMo/zjERe8u7Tf+CV9chvmEaFtADyOx/zd1
 ea7gSK2ttlB50WTC3Ugk3HO3C7uCF2Dzq42GwksQ4laQfASqrCGHGoaqXSW/EhUBoHHF
 nHZwEGoH0438uUAAk/osv2l8Qx/vLRP8i52yq9XdMEtfAL3UwnMNsl4HNMGKesEVKpPj
 qmyQ==
MIME-Version: 1.0
X-Received: by 10.58.214.231 with SMTP id od7mr8381659vec.44.1362420978031;
 Mon, 04 Mar 2013 10:16:18 -0800 (PST)
Received: by 10.220.191.132 with HTTP; Mon, 4 Mar 2013 10:16:17 -0800 (PST)
In-Reply-To: <CAMOc5cz+knVK=skEz1z=WNAjd5mL3DeOVBasHnJ6ggsNtiQdbA@mail.gmail.com>
References: <512BAA60.3060703@biostat.wisc.edu>
 <CAFOYbckDFJKRip+e=a+_JPHhk+HbAikRBK0dHEBDDEgdsZT6sw@mail.gmail.com>
 <512BAF8D.7080308@biostat.wisc.edu>
 <CAFOYbcnEN=Pzd9k4hvR+wqP3_HJj3-QRQSwocfHDSehUH5YPXA@mail.gmail.com>
 <CAKOb=YYyJZyKzpEBT+o-Vmn7dedRfVW+wVh1KVM7oaWT63+qBg@mail.gmail.com>
 <CAKOb=YYRu94CRC8Fd1TrWezHig6Od_uNpO2f+tCBQTBNQVjtog@mail.gmail.com>
 <CAMOc5cz+knVK=skEz1z=WNAjd5mL3DeOVBasHnJ6ggsNtiQdbA@mail.gmail.com>
Date: Mon, 4 Mar 2013 10:16:17 -0800
Message-ID: <CAFOYbc=j6AU+78O3VZotRJVozyRATYkqB97gCXHfb6AkJr70uQ@mail.gmail.com>
Subject: Re: igb network lockups
From: Jack Vogel <jfvogel@gmail.com>
To: Sepherosa Ziehau <sepherosa@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.14
Cc: Nick Rogers <ncrogers@gmail.com>,
 "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>,
 "Christopher D. Harrison" <harrison@biostat.wisc.edu>
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
 <mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 04 Mar 2013 18:16:19 -0000

On Sun, Mar 3, 2013 at 2:14 AM, Sepherosa Ziehau <sepherosa@gmail.com>wrote:
...

>
>
> For 82574L, i.e. supported by em(4), MSI-X must _not_ be enabled; it
> is simply broken (you could check 82574 errata on Intel's website to
> confirm what I have said here).
>

If you actually checked the errata you will find that its not "simply
broken",
furthermore it most certainly SHOULD be enabled, it is by default in the
Linux driver as well as mine, the issue is not with the 82574, its with some
system designs that have upstream PCIE problems.

If you experience problems with a particular system, then we recommend
disabling MSIX to determine if this hardware issue may be behind it. In most
cases MSIX works just fine.


>
> For 82575, i.e. supported by igb(4), MSI-X must _not_ be enabled; it
> is simply broken (you could check 82575 errata on Intel's website to
> confirm what I have said here).
>
>
The same issue obtains on the 82575, its a system issue, and we have
tested the part on our Reference systems in prolonged stress without any
problem. So the same recommendation as above applies.

Jack Vogel
Intel Network Division