From owner-freebsd-stable@FreeBSD.ORG Wed Aug 17 19:44:37 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 31279106564A; Wed, 17 Aug 2011 19:44:37 +0000 (UTC) (envelope-from hrs@FreeBSD.org) Received: from mail.allbsd.org (gatekeeper-int.allbsd.org [IPv6:2001:2f0:104:e002::2]) by mx1.freebsd.org (Postfix) with ESMTP id A08688FC17; Wed, 17 Aug 2011 19:44:36 +0000 (UTC) Received: from alph.allbsd.org (p3028-ipbf608funabasi.chiba.ocn.ne.jp [125.175.94.28]) (authenticated bits=128) by mail.allbsd.org (8.14.4/8.14.4) with ESMTP id p7HJiEp5092450; Thu, 18 Aug 2011 04:44:24 +0900 (JST) (envelope-from hrs@FreeBSD.org) Received: from localhost (localhost [IPv6:::1]) (authenticated bits=0) by alph.allbsd.org (8.14.4/8.14.4) with ESMTP id p7HJiAHT041636; Thu, 18 Aug 2011 04:44:12 +0900 (JST) (envelope-from hrs@FreeBSD.org) Date: Thu, 18 Aug 2011 04:33:32 +0900 (JST) Message-Id: <20110818.043332.27079545013461535.hrs@allbsd.org> To: attilio@FreeBSD.org From: Hiroki Sato In-Reply-To: References: <4E15A08C.6090407@sentex.net> <20110818.023832.373949045518579359.hrs@allbsd.org> X-PGPkey-fingerprint: BDB3 443F A5DD B3D0 A530 FFD7 4F2C D3D8 2793 CF2D X-Mailer: Mew version 6.3 on Emacs 23.1 / Mule 6.0 (HANACHIRUSATO) Mime-Version: 1.0 Content-Type: Multipart/Signed; protocol="application/pgp-signature"; micalg=pgp-sha1; boundary="--Security_Multipart(Thu_Aug_18_04_33_32_2011_840)--" Content-Transfer-Encoding: 7bit X-Virus-Scanned: clamav-milter 0.97 at gatekeeper.allbsd.org X-Virus-Status: Clean X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.3 (mail.allbsd.org [133.31.130.32]); Thu, 18 Aug 2011 04:44:29 +0900 (JST) X-Spam-Status: No, score=-102.2 required=13.0 tests=BAYES_00, CONTENT_TYPE_PRESENT,DIRECTOCNDYN,MIMEQENC,QENCPTR2,RCVD_IN_RP_RNBL, SPF_SOFTFAIL,USER_IN_WHITELIST autolearn=no version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on gatekeeper.allbsd.org Cc: kostikbel@gmail.com, freebsd-stable@FreeBSD.org, avg@FreeBSD.org Subject: Re: panic: spin lock held too long (RELENG_8 from today) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Aug 2011 19:44:37 -0000 ----Security_Multipart(Thu_Aug_18_04_33_32_2011_840)-- Content-Type: Text/Plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Attilio Rao wrote in : at> 2011/8/17 Hiroki Sato : at> > Hi, at> > at> > Mike Tancsa wrote at> > =A0in <4E15A08C.6090407@sentex.net>: at> > at> > mi> On 7/7/2011 7:32 AM, Mike Tancsa wrote: at> > mi> > On 7/7/2011 4:20 AM, Kostik Belousov wrote: at> > mi> >> at> > mi> >> BTW, we had a similar panic, "spinlock held too long", the= spinlock at> > mi> >> is the sched lock N, on busy 8-core box recently upgraded = to the at> > mi> >> stable/8. Unfortunately, machine hung dumping core, so the= stack trace at> > mi> >> for the owner thread was not available. at> > mi> >> at> > mi> >> I was unable to make any conclusion from the data that was= present. at> > mi> >> If the situation is reproducable, you coulld try to revert= r221937. This at> > mi> >> is pure speculation, though. at> > mi> > at> > mi> > Another crash just now after 5hrs uptime. I will try and re= vert r221937 at> > mi> > unless there is any extra debugging you want me to add to t= he kernel at> > mi> > instead =A0? at> > at> > =A0I am also suffering from a reproducible panic on an 8-STABLE b= ox, an at> > =A0NFS server with heavy I/O load. =A0I could not get a kernel du= mp at> > =A0because this panic locked up the machine just after it occurre= d, but at> > =A0according to the stack trace it was the same as posted one. at> > =A0Switching to an 8.2R kernel can prevent this panic. at> > at> > =A0Any progress on the investigation? at> = at> Hiroki, at> how easilly can you reproduce it? It takes 5-10 hours. I installed another kernel for debugging just now, so I think I will be able to collect more detail information in a couple of days. at> It would be important to have a DDB textdump with these information= s: at> - bt at> - ps at> - show allpcpu at> - alltrace at> = at> Alternatively, a coredump which has the stop cpu patch which Andryi= can provide. Okay, I will post them once I can get another panic. Thanks! -- Hiroki ----Security_Multipart(Thu_Aug_18_04_33_32_2011_840)-- Content-Type: application/pgp-signature Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iEYEABECAAYFAk5MF4wACgkQTyzT2CeTzy0Z6gCgluxIPrG308LTbGGysww6wQ4R 4TsAnj2fiZoQOXYk0jycI9e3TPKTFcpy =lTzB -----END PGP SIGNATURE----- ----Security_Multipart(Thu_Aug_18_04_33_32_2011_840)----