From owner-freebsd-current@FreeBSD.ORG Thu Nov 12 17:38:53 2009 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 86206106566C; Thu, 12 Nov 2009 17:38:53 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-fx0-f227.google.com (mail-fx0-f227.google.com [209.85.220.227]) by mx1.freebsd.org (Postfix) with ESMTP id DCE7F8FC22; Thu, 12 Nov 2009 17:38:51 +0000 (UTC) Received: by fxm27 with SMTP id 27so2624628fxm.3 for ; Thu, 12 Nov 2009 09:38:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=kKJI7Syulh26XOZcqxocNiTrGs1nPf740gREyxr6sPQ=; b=xxL8M9OAnrt1XEOFUjDMPnW6pl9+YWR9SIOQdi5UU7AEN1tjBkQHdmSJXQHZppNY5S BUHdOQFTeI0xjW5WSX5Ouujq2UAGvJZGKLyClYuhU9zHa7YT8bGZ3fTDhzaBDTbQmBCT iOsy8+Yjgivdp2WBR2Gxxl7hqUwEFpvSkmOH0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=R8mtTo00t/T6UgXR+Eo5ZrIZwY6Zo1hBtmcI+qlsLvisOtids1FO7T3LW1kTml0GIl AsP5EfAH7EGzJltKBDQgkTtY/5l7tTecFtAmFQRo2wS7fvX0wHkqVCTnqV7elcXS+KnG p4Cbuz1WMtBjIBFES5vaeCI2fkcaIrYofJnBU= MIME-Version: 1.0 Received: by 10.216.89.8 with SMTP id b8mr1026089wef.180.1258047530921; Thu, 12 Nov 2009 09:38:50 -0800 (PST) In-Reply-To: <200911121529.nACFT8ad037531@lava.sentex.ca> References: <20091017222314.GB19204@michelle.cdnetworks.com> <200911100021.nAA0LvMG014534@lava.sentex.ca> <2a41acea0911091633u2899b47ewb514b6276ba2cf62@mail.gmail.com> <200911100227.nAA2RtDY015177@lava.sentex.ca> <2a41acea0911101057q4f913e30m9319e52bbd254cfe@mail.gmail.com> <2a41acea0911101120o39fd695cpa325736d00b11587@mail.gmail.com> <200911102018.nAAKI3s7021614@lava.sentex.ca> <20091111203101.GC15449@michelle.cdnetworks.com> <2a41acea0911111419v5ae5682cy12613e1bd9a9c325@mail.gmail.com> <200911121529.nACFT8ad037531@lava.sentex.ca> Date: Thu, 12 Nov 2009 09:38:50 -0800 Message-ID: <2a41acea0911120938g60de3ff0o6fbca1c06bdeb7a3@mail.gmail.com> From: Jack Vogel To: Mike Tancsa Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: pyunyh@gmail.com, jfv@freebsd.org, Mykola Dzham , current@freebsd.org Subject: Re: page fault in igb driver on 8.0-RC2 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Nov 2009 17:38:53 -0000 The storm threshold is a tuneable, like for 10G the default (1000) is guaranteed to be too low, we usually up it to 10000 in our lab. In this case its not indicative of a problem so just increase until it does not throttle the source. Jack On Thu, Nov 12, 2009 at 7:28 AM, Mike Tancsa wrote: > At 05:19 PM 11/11/2009, Jack Vogel wrote: > > Ya, so maybe a more robust solution to that failure would be a good >> thing, but this is not the time for more elaborate code, having this small >> fix put in is low risk and the better failure response can come later. >> >> In fact, I have a number of places in the ixgbe driver where I'm pondering >> over what to do in failure mode anyway. >> > > [trimming re@freebsd as this isnt a release issue] > > No panics yet, but at around 350k pps, I see > > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > interrupt storm detected on "irq257:"; throttling interrupt source > > 0(ich10)# vmstat -i > interrupt total rate > irq16: uhci0+ 22 0 > irq18: ehci0 uhci5 15 0 > irq19: fwohci0++ 78 0 > irq21: uhci1 17 0 > irq23: uhci3 ehci1 2 0 > cpu0: timer 175404021 1998 > irq256: igb0 19731770 224 > irq257: igb0 30741918 350 > irq258: igb0 14 0 > irq259: igb1 71514077 814 > irq260: igb1 28098687 320 > irq261: igb1 2 0 > irq262: em0 4435336 50 > irq263: ahci0 89527 1 > cpu7: timer 175395421 1998 > cpu6: timer 175394148 1998 > cpu1: timer 175395011 1998 > cpu4: timer 175394583 1998 > cpu5: timer 175395129 1998 > cpu3: timer 175395466 1998 > cpu2: timer 175394884 1998 > Total 1557780128 17749 > 0(ich10)# > > > > > > -------------------------------------------------------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet since 1994 www.sentex.net > Cambridge, Ontario Canada www.sentex.net/mike > >