From owner-freebsd-hardware@FreeBSD.ORG Wed Oct 8 13:53:05 2003 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 30FBB16A4BF for ; Wed, 8 Oct 2003 13:53:05 -0700 (PDT) Received: from mail.speakeasy.net (mail6.speakeasy.net [216.254.0.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id A53FA43FAF for ; Wed, 8 Oct 2003 13:53:03 -0700 (PDT) (envelope-from jhb@FreeBSD.org) Received: (qmail 21191 invoked from network); 8 Oct 2003 20:53:01 -0000 Received: from unknown (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender )encrypted SMTP for ; 8 Oct 2003 20:53:01 -0000 Received: from laptop.baldwin.cx (gw1.twc.weather.com [216.133.140.1]) by server.baldwin.cx (8.12.9/8.12.9) with ESMTP id h98Kqfce013747; Wed, 8 Oct 2003 16:52:44 -0400 (EDT) (envelope-from jhb@FreeBSD.org) Message-ID: X-Mailer: XFMail 1.5.4 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: Date: Wed, 08 Oct 2003 16:52:47 -0400 (EDT) From: John Baldwin To: David Raistrick X-Spam-Checker-Version: SpamAssassin 2.55 (1.174.2.19-2003-05-19-exp) cc: freebsd-scsi@freebsd.org cc: freebsd-hardware@freebsd.org cc: support@supermicro.com Subject: RE: SCSI, SMP, and Supermicro, problems! X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Oct 2003 20:53:05 -0000 On 08-Oct-2003 David Raistrick wrote: > >> You can try using the attached patch. It removes the HTT option and >> HTT is on by default, but it halts the CPUs the same way that we do >> in current now. > > John, > > Thanks very much! That patch, applied to 4.8-R's /sys, does the trick. > Both local CPUs are disabled, and the system seems stable so far. > > I see you cc'd supermicro support, hopefully they'll be able to add this > to their FAQ...and perhaps they'll be able to find out where the problem > with HTT disabled lies, as well. Oh, didn't mean to. Just did a reply to all. Anyways, the real problem is that many P4 motherboard BIOS's leave the local APIC on the logical CPUs enabled so that they are eligible to receive interrupts. Due to the way we manage the Task Priority Register (TPR) on the CPUs that we know about, the system can try to route interrupts to the logical CPUs that we don't know about and aren't using. Because these CPUs aren't really awake, they don't acknowledge these interrupts and eventually the system locks up. That's the short version anyway. From what I hear, this bug of leaving the local APIC enabled is in the sample BIOS source code that a certain CPU vendor released so just about all the P4 chipsets have it. :) > Once again this is in reference to the Supermicro SuperServer 6023P-8R > with the X5DP8-G2 motherboard and FreeBSD 4.8-RELEASE. -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/