From owner-freebsd-mips@FreeBSD.ORG Tue Jul 22 19:26:56 2014 Return-Path: Delivered-To: freebsd-mips@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1113F618 for ; Tue, 22 Jul 2014 19:26:56 +0000 (UTC) Received: from mail-qa0-x235.google.com (mail-qa0-x235.google.com [IPv6:2607:f8b0:400d:c00::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C5FE62B3B for ; Tue, 22 Jul 2014 19:26:55 +0000 (UTC) Received: by mail-qa0-f53.google.com with SMTP id v10so138596qac.12 for ; Tue, 22 Jul 2014 12:26:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=Ey1/mgNw0sr00nSKBUaXTls9WQDifqCzk3sBZ8yMtEg=; b=CSEnwqAEzs41nLLPQzykdYfNvfDGtZ7bcj1laDaBUq015V0SdJcjplnjZAUkFrFEPA Bsk4Y2QFiJhPnrLIZvhrBXkFrHc+di2A4T1zewGFPDtUtKCODZFz6Z7tYXMFW9ylTO4r dKeOrr7dkQhlaHp0QzmtfrWhvCh4LCHib2vjJDsPcAr2h3zTuxplGDgqoLoikMz/PO5+ BX2vukmUjmyR4Xmhox9F+Ku1LOkaYl5X3QVj9GvNcW/gigrVe7Xhk89dQrDXV+uosE+p dwVYElXI56w9+PrBwsAT9CrjY2AGgA6kexpQK/Zyyk02tsIYm06mTp0IDHUNrueNp96S viIQ== MIME-Version: 1.0 X-Received: by 10.140.92.13 with SMTP id a13mr20395450qge.88.1406057214720; Tue, 22 Jul 2014 12:26:54 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.224.1.6 with HTTP; Tue, 22 Jul 2014 12:26:54 -0700 (PDT) In-Reply-To: <53CEB6B1.9050301@weites.com> References: <53CEB6B1.9050301@weites.com> Date: Tue, 22 Jul 2014 12:26:54 -0700 X-Google-Sender-Auth: R30mb9VgKbKXiOBO4jX7WRlFds8 Message-ID: Subject: Re: interrupt storm arge0, tplink 1043nd From: Adrian Chadd To: Harm Weites Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-mips@freebsd.org" X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jul 2014 19:26:56 -0000 Hi! So, ignore the ath0 stuff for now. int2 should be arge0, right? what's vmstat -ia say? Assuming it's actually arge0, we need to add some debugging counters to the interrupt path to count how many of each interrupt are occuring. The stuff i stuck behind ARGEDEBUG() is useful for debugging some silly bugs but not at the rate that you're getting interrupts. So I'd add something like this to the arge softc struct: uint32_t intr_status[32]; .. then in the interrupt routine, something like this: temp_status = status; for (i = 0; i < 32; i++) { if (temp_status & 1) { intr_status[i]++; } temp_status = temp_status >> 1; } That'll count the number of interrupts that are firing for each interrupt status bit. Then, you'll want to write a sysctl for it. Have a look at if_ath_sysctl.c for the SYSCTL_PROC() entries. Just write one that when called will just printf() the intr_status array: for (i = 0; i < 32; i++) { printf("interrupt %d count %u\n", i, intr_status[i]); } Just make sure you do a complete kernel recompile as changing the headers doesn't always force the source files to recompile. -a On 22 July 2014 12:08, Harm Weites wrote: > Hi, > > My 1043nd is complaining about interrupt storms, presumably only when > wifi is beeing used. When this occurs, networking is gone. > > The exact message thats flooding me: > interrupt storm detected on "int2"; throttling interrupt source > > The device associated with int2 is arge0. > > Some possibly related logs, though these messages start at boot: > > # /sbin/dmesg | tail > ath0: stuck beacon; resetting (bmiss count 4) > ar5416StopDmaReceive: dma failed to stop in 10ms > AR_CR=0x00000024 > AR_DIAG_SW=0x42000020 > MBSSID Set bit 22 of AR_STA_ID 0xb8c16866 > ath0: stuck beacon; resetting (bmiss count 4) > ar5416StopDmaReceive: dma failed to stop in 10ms > AR_CR=0x00000024 > AR_DIAG_SW=0x42000020 > MBSSID Set bit 22 of AR_STA_ID 0xb8c16866 > > This unit is configured with (arge0) port0 bound to device vlan1, port4 > to vlan2 and ports 1,2,3 make up vlan3. There is wlan0, bound to ath0 > and a bridge device that connects wlan0 to vlan3. There is a dhcp server > running in vlan3 to answer to wifi clients, internet is routed through > vlan1. This initially works but after a little while the storm begins > and the wifi client is left to die. > > Adrian@ suggested to start with reading which interrupt(s) occur(s), but > that is perhaps a little to hard for me to code :) Looking at if_arge.c, > it seems there is some debug code already in place (ARGEDEBUG()) though > I'm not sure on how to use that. Reading from the AR71XX_DMA_INTR > register and mapping its content to AR71XX_DMA_INTR_STATUS would be > something I'd like to do with a separate program (instead of boldly > taking a deepdive in to if_arge.c and recompiling/flashing untill > something works). > > One of my other units is configured with just a vlan device per switch > port, no wifi and no bridge. A third unit is configured with a wlan0, > vlan1 (port0) and vlan2 (ports 1,2,3,4). Both not showing any issues in > the past months. The only difference would be this problem-unit has a > bridge. > > Any thoughts on how to approach or 'just' fix this? > > Regards, > Harm > _______________________________________________ > freebsd-mips@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-mips > To unsubscribe, send any mail to "freebsd-mips-unsubscribe@freebsd.org"