From owner-freebsd-hackers@FreeBSD.ORG  Wed Mar 11 17:34:53 2015
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id E0E99796;
 Wed, 11 Mar 2015 17:34:53 +0000 (UTC)
Received: from mail-wi0-x231.google.com (mail-wi0-x231.google.com
 [IPv6:2a00:1450:400c:c05::231])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 7752DF82;
 Wed, 11 Mar 2015 17:34:53 +0000 (UTC)
Received: by wiwl15 with SMTP id l15so41015973wiw.4;
 Wed, 11 Mar 2015 10:34:52 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:in-reply-to:references:date:message-id:subject:from:to
 :cc:content-type;
 bh=+7qdx+Ua335ymtIEle9CudANe36LxrVLQ3b1FuY+sK4=;
 b=vIFyLIkjd5wc281C6znUhYZiDst+sRqSKqAQ+PK8RXjBnhcCro+7oDOWCqZl7361wJ
 IE8CP7XntNvE450N1JwUlZm/oHhoQsAgGN6EbwIXjmXA2aV61mnXgtdsj3hvtRnCYKge
 HgKMxwRTS3Fe262qvdXWZhzAg7iYAYJmnYuXfsGdRD7NRiihNl3b7jCtXkfQ2hoI+/FS
 CrX/yB9u1nRZ3Bt8fuBwMDUT1gosXlmHZ21rlOkDb8TAhjsLdCvLPNk7EVOMpKMDmrRD
 XsnH4KB1Cx2rUC8xMEQGjPLYsDK2h0E4i5/smigO6C34K6ZBf3ND2H28otFqAO013xvf
 BPfQ==
MIME-Version: 1.0
X-Received: by 10.194.6.228 with SMTP id e4mr78631050wja.63.1426095291942;
 Wed, 11 Mar 2015 10:34:51 -0700 (PDT)
Received: by 10.27.91.79 with HTTP; Wed, 11 Mar 2015 10:34:51 -0700 (PDT)
In-Reply-To: <550046F7.1050205@fuckner.net>
References: <550046F7.1050205@fuckner.net>
Date: Wed, 11 Mar 2015 10:34:51 -0700
Message-ID: <CAFgRE9FaycX9-jc6QkwiM6mQKhb_+CYPSq1J+rpOt6nc--HpRw@mail.gmail.com>
Subject: Re: Server with 3TB Crashing at boot
From: Neel Natu <neelnatu@gmail.com>
To: Michael Fuckner <michael@fuckner.net>
Content-Type: text/plain; charset=UTF-8
Cc: FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-hardware@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
 <freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>, 
 <mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers/>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
 <mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 11 Mar 2015 17:34:54 -0000

Hi Michael,

On Wed, Mar 11, 2015 at 6:45 AM, Michael Fuckner <michael@fuckner.net> wrote:
> Hi,
>
> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory
> Risers with 12DIMMs each. With 2 Risers I can boot the System with
> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes
> on boot.
>

Can you try to boot the system with SMP disabled and more than 2
risers populated?

LOADER> set kern.smp.disabled=1

best
Neel

>
> http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png
> http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi
>
>
> Here is the dmesg/ verbose dmesg, but I believe the verbose one got
> truncated. Is there anything more I can do than booting verbose and to copy
> /var/run/dmesg.boot?
>
> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt
> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt
>
> Regards,
>  Michael!
>
> PS: already posted to freebsd-amd64, but I was told these lists are better.
> _______________________________________________
> freebsd-hackers@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"