From owner-freebsd-net@FreeBSD.ORG Fri Oct 7 20:26:36 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 97B2D106566B for ; Fri, 7 Oct 2011 20:26:36 +0000 (UTC) (envelope-from lacombar@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 302988FC08 for ; Fri, 7 Oct 2011 20:26:35 +0000 (UTC) Received: by wwe3 with SMTP id 3so6131309wwe.31 for ; Fri, 07 Oct 2011 13:26:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=ipWcgC1TQfH6X6Ku07aEMbcDhSfE9ZbcBodnoMhnAaU=; b=GoQOi7C+3/32xQXsDykyJpt4yAhF4I2kL3iyeMv87iCTBW/T4XuU7TYjSV8kKlHZ5/ UDaHMW4V1Ed30A8cO+8UCxsnfQ99r3z1aITAPctBxoUTr2xqWJ1/WceyH5PpkoNo5Q6g z9cBXakNJWSmHFlx4xkhVv/aGVDJ4G/NRGrIc= MIME-Version: 1.0 Received: by 10.227.153.211 with SMTP id l19mr2913414wbw.51.1318019195230; Fri, 07 Oct 2011 13:26:35 -0700 (PDT) Received: by 10.180.103.33 with HTTP; Fri, 7 Oct 2011 13:26:35 -0700 (PDT) In-Reply-To: <4E8F5D28.2050109@sentex.net> References: <4E8F157A.40702@sentex.net> <4E8F51D4.1060509@sentex.net> <4E8F5D28.2050109@sentex.net> Date: Fri, 7 Oct 2011 16:26:35 -0400 Message-ID: From: Arnaud Lacombe To: Mike Tancsa Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org, Jason Wolfe Subject: Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Oct 2011 20:26:36 -0000 Hi, On Fri, Oct 7, 2011 at 4:12 PM, Mike Tancsa wrote: > On 10/7/2011 3:55 PM, Arnaud Lacombe wrote: >>> When you disable MSI-X, you mean via hw.pci.enable_msix=3D0 across the >>> board, or you disable multi-queue for the NIC, so it uses just one >>> interrupt, rather than separate ones for xmit and recv ? >>> >> em(4)'s multiqueue is misleading. By default, with MSI-X enabled, >> before AFAIK, April 2010 it used 2 (RX+TX) queue + 1, ie. 5 MSI-X >> vectors[0]. After April 2010, it uses 1 * (RX+TX) queue + =A01, ie. 3 >> MSI-X vectors. There is no logic for the driver to use 1 vector with >> MSI-X enabled. > > Hi, > =A0 =A0 =A0 =A0Very poor choice of wording on my part. I meant to say sep= arate > interrupts for the xmit and recv, as opposed to multiqueue which is > quite different. > > On the server I used to see the issue with, it has 2 onboard NICs > > em0: port 0x4040-0x405f mem > 0xb4500000-0xb451ffff,0xb4525000-0xb4525fff irq 16 at device 25.0 on pci0 > em0: Using an MSI interrupt > em0: [FILTER] > em0: Ethernet address: 00:15:17:ed:68:a5 > > em1: port 0x2000-0x201f mem > 0xb4100000-0xb411ffff,0xb4120000-0xb4123fff irq 16 at device 0.0 on pci11 > em1: Using MSIX interrupts with 3 vectors > em1: [ITHREAD] > em1: [ITHREAD] > em1: [ITHREAD] > em1: Ethernet address: 00:15:17:ed:68:a4 > I'd assume that `em0' is not a 82574, whereas `em1' is. - Arnaud > irq257: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0506496667 =A0 =A0 =A0 = =A0813 > irq258: em1:rx 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 296438098 =A0 =A0 =A0 =A0476 > irq259: em1:tx 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 252033695 =A0 =A0 =A0 =A0404 > > Actually, I see it in Jason's email now that I re-read it. > hw.em.enable_msix=3D"0" > > However, with 7.1.9 this setting did not help me. > > > =A0 =A0 =A0 =A0---Mike > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada =A0 http://www.tancsa.com/ >