From owner-freebsd-amd64@FreeBSD.ORG Sat May 21 11:14:17 2005 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8764A16A4CE for ; Sat, 21 May 2005 11:14:17 +0000 (GMT) Received: from blackwater.lemis.com (wantadilla.lemis.com [192.109.197.135]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0F08743D94 for ; Sat, 21 May 2005 11:14:16 +0000 (GMT) (envelope-from grog@lemis.com) Received: from blackwater.lemis.com (wantadilla.lemis.com [192.109.197.135]) by blackwater.lemis.com (Postfix) with ESMTP id 7D82B856B3; Sat, 21 May 2005 20:44:13 +0930 (CST) Received: by blackwater.lemis.com (Postfix, from userid 1004) id 592C24AC43; Sat, 21 May 2005 19:14:07 +0800 (SGT) Date: Sat, 21 May 2005 19:14:07 +0800 From: Greg 'groggy' Lehey To: Martin Nilsson , Kris Kennaway , Steve Kargl , Tim Stoakes Message-ID: <20050521111407.GV1029@eucla.lemis.com> References: <428C85A6.6010004@gneto.com> <20050519165116.GA3906@xor.obsecurity.org> <20050519180908.GA27190@troutmask.apl.washington.edu> <428C85A6.6010004@gneto.com> <20050519165116.GA3906@xor.obsecurity.org> <428C85A6.6010004@gneto.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050519180908.GA27190@troutmask.apl.washington.edu> <20050519165116.GA3906@xor.obsecurity.org> <428C85A6.6010004@gneto.com> User-Agent: Mutt/1.4.2.1i Organization: Rocksoft Ltd Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.rocksoft.com/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 cc: freebsd-amd64@freebsd.org Subject: Re: Opteron problens with 16GB memory X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 May 2005 11:14:17 -0000 On Thursday, 19 May 2005 at 14:25:10 +0200, Martin Nilsson wrote: > Are there any known problems with Opterons and more than 12GB memory? > > I'm running 5.4-STABLE on a Tyan K8WE, the box is stable with 12GB > but I get internal compiler errors when building world with 16GB. > > Disks are on a MegaRAID 320-2e kontroller (PCI-express) could there > be something wrong in the amr driver when having lots of memory. > > I remember having similar problems on a MSI board with lots of memory > a couple of months ago. Yes, that would have been me. It wasn't as much, though. On Thursday, 19 May 2005 at 9:51:17 -0700, Kris Kennaway wrote: > On Thu, May 19, 2005 at 02:25:10PM +0200, Martin Nilsson wrote: >> Are there any known problems with Opterons and more than 12GB memory? >> >> I'm running 5.4-STABLE on a Tyan K8WE, the box is stable with 12GB >> but I get internal compiler errors when building world with 16GB. > > Check that the last set of memory is not bad, i.e. swap out a > different 4GB. In my case, the issue was electrical. I had 8 GB of memory in 4 sticks, and any combination of 2 seemed to work fine. But read on... On Thursday, 19 May 2005 at 11:09:09 -0700, Steve Kargl wrote: > On Thu, May 19, 2005 at 09:51:17AM -0700, Kris Kennaway wrote: >> On Thu, May 19, 2005 at 02:25:10PM +0200, Martin Nilsson wrote: >>> Are there any known problems with Opterons and more than 12GB memory? >>> >>> I'm running 5.4-STABLE on a Tyan K8WE, the box is stable with 12GB >>> but I get internal compiler errors when building world with 16GB. >> >> Check that the last set of memory is not bad, i.e. swap out a >> different 4GB. > > http://www.memtest.org/ Yes. I ran memtest and discovered that even with only 4 GB I was getting about 1 correctable error a second. With smaller memory, the machine worked fine, and the original memory (which I had borrowed from Tim Stoakes, copied in the hope that he might have more insight) works fine in a 4-way machine with a total of 16 GB. Greg -- See complete headers for address and phone numbers