From owner-freebsd-current@FreeBSD.ORG Wed Dec 1 08:45:44 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2048016A4CE; Wed, 1 Dec 2004 08:45:44 +0000 (GMT) Received: from dragon.nuxi.com (trang.nuxi.com [66.93.134.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id BAF0043D2F; Wed, 1 Dec 2004 08:45:41 +0000 (GMT) (envelope-from obrien@NUXI.com) Received: from dragon.nuxi.com (obrien@localhost [127.0.0.1]) by dragon.nuxi.com (8.13.1/8.13.1) with ESMTP id iB18jci8036414; Wed, 1 Dec 2004 00:45:39 -0800 (PST) (envelope-from obrien@dragon.nuxi.com) Received: (from obrien@localhost) by dragon.nuxi.com (8.13.1/8.13.1/Submit) id iB18jc8j036413; Wed, 1 Dec 2004 00:45:38 -0800 (PST) (envelope-from obrien) Date: Wed, 1 Dec 2004 00:45:37 -0800 From: "David O'Brien" To: "Ketrien I. Saihr-Kenchedra" Message-ID: <20041201084537.GA1621@dragon.nuxi.com> References: <20041129211341.GA26548@troutmask.apl.washington.edu> <41AC6FF8.40501@freebsd.org> <20041130183555.GA32237@troutmask.apl.washington.edu> <20041130142652.A59122@bahre.achedra.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041130142652.A59122@bahre.achedra.org> User-Agent: Mutt/1.4.1i X-Operating-System: FreeBSD 6.0-CURRENT Organization: The NUXI BSD Group X-Pgp-Rsa-Fingerprint: B7 4D 3E E9 11 39 5F A3 90 76 5D 69 58 D9 98 7A X-Pgp-Rsa-Keyid: 1024/34F9F9D5 cc: freebsd-current@freebsd.org cc: freebsd-amd64@freebsd.org cc: Steve Kargl Subject: Re: kernel panic with greater that 8 GB of memory X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: obrien@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Dec 2004 08:45:44 -0000 On Tue, Nov 30, 2004 at 02:35:30PM -0500, Ketrien I. Saihr-Kenchedra wrote: > On Tue, 30 Nov 2004, Steve Kargl wrote: > > > >The system starts to boot and dmesg reports the 16 GB of memory, but > >I rapidly get this panic. > > >So, it looks like ACPI on this Tyan motherboard is restricting > >the memory to 8G. > > I presume you're using CM74SD2048RLP-2700/S DIMMs? (Corsair/Samsung 2GB > ECC Reg'd.) > More importantly, which BIOS version? You have to run the 2.03 BIOS on > the K8SPro if you're running 16GB. Make sure that ccNUMA support is off > in the BIOS as well - this was a never-ending source of fun on both the > S2882 and S4882's. There is no 'ccNUMA' setting in the BIOS. A multi-processor Opteron is a NUMA architecture machine regardless of any BIOS settings. I.E. there is no way to disable that a MP Opteron is a NUMA machine. The setting of interest is should the BIOS round-robin interleave physical addresses across the NUMA nodes[*]. The reference AMI BIOS refers to this as "Node Interleaving". It should be "DISABLED". Or if the BIOS speaks of the SRAT table, it should be "ENABLED". While FreeBSD doesn't use the SRAT table (and cannot until ACPI 3.0 BIOS's); turning on the SRAT turns off node interleaving. There is a CPU errata for older CPU's that can cause problems if you have both memory interleaving turned on and ECC turned enabled in the BIOS. -- -- David (obrien@FreeBSD.org)