From owner-freebsd-stable@FreeBSD.ORG Thu Jan 8 10:22:40 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1268A1A5 for ; Thu, 8 Jan 2015 10:22:40 +0000 (UTC) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7E807A85 for ; Thu, 8 Jan 2015 10:22:38 +0000 (UTC) Received: from mh0.gentlemail.de (mh0.gentlemail.de [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id t08AMbmA043888 for ; Thu, 8 Jan 2015 11:22:37 +0100 (CET) (envelope-from h.schmalzbauer@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 9D6C1BC1; Thu, 8 Jan 2015 11:22:36 +0100 (CET) Message-ID: <54AE5A6B.7040601@omnilan.de> Date: Thu, 08 Jan 2015 11:22:35 +0100 From: Harald Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: FreeBSD Stable Subject: Re: igb(4) watchdog timeout, lagg(4) fails References: <54ACC6A2.1050400@omnilan.de> <54AE565D.50208@omnilan.de> In-Reply-To: <54AE565D.50208@omnilan.de> X-Enigmail-Version: 1.1.2 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigC4672369CB72B459969A3152" X-Greylist: ACL 119 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Thu, 08 Jan 2015 11:22:37 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2015 10:22:40 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigC4672369CB72B459969A3152 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Bez=C3=BCglich Harald Schmalzbauer's Nachricht vom 08.01.2015 11:05 (localtime): > Bez=C3=BCglich Harry Schmalzbauer's Nachricht vom 07.01.2015 06:39 (lo= caltime): >> Hello, >> >> recently I upgraded one server from 9.1 to 10.1. There are two 82576 >> (one port of two Intel ET Dual-Port GbE [kawela]), driven by igb(4). >> I've never seen any watchdog timeout with FreeBSD-9.1 but suddenly (wi= th >> 10-stable) I see: >> igb0: Watchdog timeout -- resetting >> igb0: Queue(0) tdh =3D 2974, hw tdt =3D 2973 >> igb0: TX(0) desc avail =3D 0,Next TX to Clean =3D 0 >> >> My biggest problem is, that lagg(4) doesn't detect the problem with >> igb0. It's configured with "lagghash l2' and most connections were >> interupted until I manually do 'ifconfig igb0 down'. Then lagg does it= 's >> job and connectivity was restored via the remaining igb1. >> >> Is there a way to auto-if-down an interface which suffers from watchdo= g >> timeouts? And any way to really reset it without rebooting the machine= ? > igb wathchdog timeout happened again :-( ~48 hours after the last with > very moderate-to-low avarage traffic. > > This time I could fetch dev.igb sysctls before igb0 was reset by watchd= og > It's showing strange irq load: While systat tells: 3 igb1:que 0 1619 igb1:que 1 3 igb1:que 2 1 igb1:que 3 sysctl dev.igb tells: dev.igb.1.queue0.interrupt_rate: 43478 dev.igb.1.queue1.interrupt_rate: 76923 dev.igb.1.queue2.interrupt_rate: 111111 dev.igb.1.queue3.interrupt_rate: 90909 How do I have to understand sysctl's interrupt_rate value? Thanks, -Harry --------------enigC4672369CB72B459969A3152 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAlSuWmwACgkQLDqVQ9VXb8g7mACgnCnyEHbMjfEULi91SjQq7ORR XS0AoKB0pUpVvqQt+i2TU70QSRfyMtUA =iVf7 -----END PGP SIGNATURE----- --------------enigC4672369CB72B459969A3152--