From owner-freebsd-sparc64@FreeBSD.ORG Tue Sep 28 18:04:44 2004 Return-Path: Delivered-To: freebsd-sparc64@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3527A16A4CE for ; Tue, 28 Sep 2004 18:04:44 +0000 (GMT) Received: from mail4.speakeasy.net (mail4.speakeasy.net [216.254.0.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id EDF8143D2F for ; Tue, 28 Sep 2004 18:04:43 +0000 (GMT) (envelope-from jhb@FreeBSD.org) Received: (qmail 27153 invoked from network); 28 Sep 2004 18:04:43 -0000 Received: from dsl027-160-063.atl1.dsl.speakeasy.net (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender ) encrypted SMTP for ; 28 Sep 2004 18:04:42 -0000 Received: from [10.50.40.210] (gw1.twc.weather.com [216.133.140.1]) (authenticated bits=0) by server.baldwin.cx (8.12.11/8.12.11) with ESMTP id i8SI4dmU003180; Tue, 28 Sep 2004 14:04:40 -0400 (EDT) (envelope-from jhb@FreeBSD.org) From: John Baldwin To: freebsd-sparc64@FreeBSD.org Date: Tue, 28 Sep 2004 14:02:00 -0400 User-Agent: KMail/1.6.2 References: <20040925070741.GA51297@xor.obsecurity.org> <20040928153451.GB27640@electra.cse.Buffalo.EDU> <20040928165449.GA3605@xor.obsecurity.org> In-Reply-To: <20040928165449.GA3605@xor.obsecurity.org> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <200409281402.00338.jhb@FreeBSD.org> X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on server.baldwin.cx cc: Ken Smith cc: sparc64@FreeBSD.org cc: Kris Kennaway Subject: Re: panic: ipi_send: couldn't send ipi X-BeenThere: freebsd-sparc64@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Porting FreeBSD to the Sparc List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Sep 2004 18:04:44 -0000 On Tuesday 28 September 2004 12:54 pm, Kris Kennaway wrote: > On Tue, Sep 28, 2004 at 11:34:51AM -0400, Ken Smith wrote: > > On Tue, Sep 28, 2004 at 12:16:20PM +0400, Andrew Belashov wrote: > > > I have install this patch. > > > > > > Hardware: Sun Ultra 60 Creator 3D, 2 x UltraSparc IIi @ 450 MHz, 1 GB > > > memory. > > > > > > OS: FreeBSD bel.localdomain 5.2-CURRENT FreeBSD 5.2-CURRENT #32: > > > Tue Sep 28 11:14:38 MSD 2004 > > > bel@bel.localdomain:/usr/obj/usr/src/sys/SUNC3D sparc64 > > > > > > Messages from console: > > > > > > cpu_ipi_send: raised ipi_retries_max to 2000 > > > cpu_ipi_send: raised ipi_retries_max to 3000 > > > > Thank you very much for testing this out. > > > > Unless someone thinks this would be a problem I'll wait another couple > > of days and if nobody else has any further input I'll leave the existing > > code as-is but bump the max retries to 5000 for the 5.3 release. I'm > > still curious about what the underlying problem is but it'll take some > > time to track down I think. I did manage to find a machine to test > > this on late yesterday and some initial attempts at triggering the > > problem by generating a lot of disk I/O didn't seem to trigger it. > > > > Your case seems to be a bit extreme - I'm wondering if it has something > > to do with the Creator 3D. I don't think it is the only thing that can > > cause the problem to crop up but it might be something that makes the > > situation "worse". > > > > Kris, was your problem machine one of the machines here? > > I don't remember if any of those were SMP, but this was on phk's dual > u60. I applied the patch in PR 66314, and while I haven't had a > repeat of the ipi panic, it did fall over with one of the other panics > I regularly see on this machine. Also, jhb seemed to think there was > an underlying MI problem, and this patch would only delay the > occurence of the panic. Well, on x86 when I make the spin longer it will just spin forever and deadlock. If on sparc64 it can stay up for long periods of time w/o deadlocking under heavy load then a moderate bump on the upper limit might be a good idea. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve" = http://www.FreeBSD.org