From owner-freebsd-hardware@FreeBSD.ORG Tue Jul 17 16:50:56 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12215106566C for ; Tue, 17 Jul 2012 16:50:56 +0000 (UTC) (envelope-from ayoung@mosaicarchive.com) Received: from mail-yw0-f54.google.com (mail-yw0-f54.google.com [209.85.213.54]) by mx1.freebsd.org (Postfix) with ESMTP id BB4D88FC16 for ; Tue, 17 Jul 2012 16:50:55 +0000 (UTC) Received: by yhfs35 with SMTP id s35so740598yhf.13 for ; Tue, 17 Jul 2012 09:50:55 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:cc:content-type:x-gm-message-state; bh=+d/pNYUBegpct44wZ8+/BrDXLQ5jg4R8t+sHZPV7gWM=; b=R4QNK7ydr18h2Y11IJjGd/xBq8U6jqqoLIbkhjxwA6/dJR+WMlqgrIaIjDOQ+AEamq 1TZokOcUm7mmtHkMiyKmYv6H/9+YK1t5mFd+rtqR1ZKMZ0FriRbVW7ygU2snbYuj7yuw XEOGjSjiH4x6yN8CcSTgEkAJR1ZYaquNDTy1Kwr4mT9vAYtNMHTX1GByKCLN/UekSgXJ 8nBK5EIEH38yykAYvCEm4xPdQHgFJWDAyafADXZ0JBDPkaX6zaMCuqQSTnHD7W4VXrqG GDm3UM/XgHu/vp2AfuiaUp6zoQAuRAnLaRl4xxpJBVtmCtQT+QMtz+f5kW7s9cF9KZc7 zE+Q== MIME-Version: 1.0 Received: by 10.60.28.162 with SMTP id c2mr4437857oeh.3.1342543855084; Tue, 17 Jul 2012 09:50:55 -0700 (PDT) Received: by 10.76.79.165 with HTTP; Tue, 17 Jul 2012 09:50:55 -0700 (PDT) X-Originating-IP: [75.147.53.134] In-Reply-To: <20120717004909.GB66913@server.rulingia.com> References: <20120717004909.GB66913@server.rulingia.com> Date: Tue, 17 Jul 2012 12:50:55 -0400 Message-ID: From: Andy Young To: Peter Jeremy X-Gm-Message-State: ALoCoQl7V8ZI4q5lj0MWZmkIESILW01c5lGRiWR7JXN4LDSBSkj253RzTXWaZ8iiGvR7I5sOrzJN Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-hardware@freebsd.org Subject: Re: Server memory problems X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 16:50:56 -0000 Hi Peter, I will check the BIOS firmware. I haven't tried that yet. I'm running FreeBSD 9-RELEASE-p3. Yes it is AMD64. I ran memtest on the first 32 gb or memory where the machine was initially stable. Once I put over 64 GB in, I can't get the machine to stay up for long enough to even try. I'll try the verbose boot idea too. Thanks! On Mon, Jul 16, 2012 at 8:49 PM, Peter Jeremy wrote: > On 2012-Jul-16 19:45:18 -0400, Andy Young > wrote: > >I am having trouble with one of our servers and I'm not sure what to try > >next. It has a Supermicro H8DGi-F motherboard with two 16-core AMD > >processors and two memory banks, one for each processor. When I originally > >built it, I only had one processor and 40 GB of ram. Everything worked > >awesome. I recently upgraded it, adding another processor and another 40 > GB > >of ram. It was incredibly unstable and constantly rebooted within minute > or > >two of uptime, sometimes it wouldn't even boot all the way before crashing > >and rebooting again. > ... > >other ideas? Again, its perfectly stable with two processors and 64 GB of > >memory but goes nuts when I more. > > Have you checked the motherboard notes to ensure that your configuration > is supported? Is the BIOS up to date? > > What version of FreeBSD is this? And I presume it's amd64 rather than > i386+PAE. > > Have you tried running memtest86 or memtest86+? (You might like to > run both because ISTR only the former handles SMP). > > Can you capture the output from a verbose boot with all the memory > installed? The SMAP and/or physical memory layout might offer a > clue as to what is going wrong. > > -- > Peter Jeremy > -- Andrew Young Mosaic Storage Systems, Inc http://www.mosaicarchive.com/ Follow us on: Twitter , Facebook , Google Plus , Pinterest