From owner-freebsd-current@FreeBSD.ORG Wed May 4 17:46:06 2011 Return-Path: Delivered-To: Current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B225D106566B for ; Wed, 4 May 2011 17:46:06 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 69BEE8FC13 for ; Wed, 4 May 2011 17:46:06 +0000 (UTC) Received: by vxc34 with SMTP id 34so1893414vxc.13 for ; Wed, 04 May 2011 10:46:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=cLCTX8Tj91gACJFk2lNl8f03nv40GoG2CJ8hndKyv1E=; b=XRc021LP9Ya7SqpkaQtnF1Fjjr51uJyACJdqP6ig+AzOOu/y52o5g807T510umNwYl lRu2sE30FfNX1OH+8/ivTcZ47xJQF1GGsVJFFiXWZp9Z1b5B1ltBYdR8tkbgpLCD2R5Z homjnHRa0OdIFj9pSfIR7iz9uI6adcHwaYr9U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=pq9JyVrV9BwgxaEUVo3SJwuSfVNWD8jr4uQ38EMlLNRfnnRelQd9D6ORSsNxG3peEj /InEE7b//lzR1T6Iy8DC1ucIUGG2NdUdCiDKxY3KcQbz24Z5tNBtGmPTckJd8h4mHSuq ZlfhBdVtbU/R143pgq/45kgOOGWWRQaCLWb5o= MIME-Version: 1.0 Received: by 10.52.76.102 with SMTP id j6mr1800520vdw.44.1304531165587; Wed, 04 May 2011 10:46:05 -0700 (PDT) Received: by 10.52.184.169 with HTTP; Wed, 4 May 2011 10:46:05 -0700 (PDT) In-Reply-To: <201105041734.50738.Daan@vehosting.nl> References: <201105041734.50738.Daan@vehosting.nl> Date: Wed, 4 May 2011 10:46:05 -0700 Message-ID: From: Jack Vogel To: Daan Vreeken Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Current@freebsd.org Subject: Re: Interrupt storm with MSI in combination with em1 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 May 2011 17:46:06 -0000 Who makes your motherboard? The problem you are having is that MSIX AND MSI are both failing as em0 comes up, so it falls back to Legacy interrupt mode, and must be having some issue with sharing the line, causing the storm. This is the second report in a matter of a week perhaps about a problematic motherboard, I would like to know who makes them. Thanks, Jack On Wed, May 4, 2011 at 8:34 AM, Daan Vreeken wrote: > Hi All, > > I've just updated a machine to -current (r221321) and since then I'm seeing > an > interrupt storm on irq 16. The storm goes away when I disable MSI/MSIX with > the following lines in "loader.conf" : > > hw.pci.enable_msix="0" > hw.pci.enable_msi="0" > > According to "dmesg" the following devices share IRQ 16 : > > pcib1: irq 16 at device 1.0 on pci0 > em0: port 0xcc00-0xcc1f > mem > 0xf7de0000-0xf7dfffff,0xf7d00000-0xf7d7ffff,0xf7ddc000-0xf7ddffff > irq 16 at device 0.0 on pci1 > vgapci0: port 0xbc00-0xbc07 > mem 0xf7800000-0xf7bfffff,0xe0000000-0xefffffff irq 16 at device > 2.0 on > pci0 > ehci0: mem > 0xf7cfa000-0xf7cfa3ff > irq 16 at device 26.0 on pci0 > em1: port 0xec00-0xec1f > mem > 0xf7fe0000-0xf7ffffff,0xf7f00000-0xf7f7ffff,0xf7fdc000-0xf7fdffff > irq 16 at device 0.0 on pci4 > pcib4: irq 16 at device 28.5 on pci0 > > During a storm "vmstat -i" shows a rate of about 220.000 interrupts/sec. > MSI > interrupt delivery to both 'em0' and 'em1' seems to work correctly during a > storm, as I see their counters increase normally in the "vmstat -i" output. > > As only 'em0' and 'em1' seem to be using MSI interrupts, my guess is that > the > e1000 driver is causing this problem. Could it be that the driver forgets > to > clear/mask legacy interrupts when attaching the MSI interrupts perhaps? > > Any tips on how to debug and/or fix this? > > > The full output of "dmesg" can be found here : > http://vehosting.nl/pub_diffs/dmesg_plantje2_2011_05_04.txt > > And the full output of "pciconf -lv" is here : > http://vehosting.nl/pub_diffs/pciconf_plantje2_2011_05_04.txt > > > Regards, > -- > Daan Vreeken > VEHosting > http://VEHosting.nl > tel: +31-(0)40-7113050 / +31-(0)6-46210825 > KvK nr: 17174380 >