From owner-freebsd-hardware@FreeBSD.ORG  Thu Mar 12 09:30:36 2015
Return-Path: <owner-freebsd-hardware@FreeBSD.ORG>
Delivered-To: freebsd-hardware@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 67857517
 for <freebsd-hardware@freebsd.org>; Thu, 12 Mar 2015 09:30:36 +0000 (UTC)
Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de
 [IPv6:2a01:238:20a:202:5300::8])
 (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id F1CBCA7F
 for <freebsd-hardware@freebsd.org>; Thu, 12 Mar 2015 09:30:35 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426152620; l=868;
 s=domk; d=fuckner.net;
 h=Content-Transfer-Encoding:Content-Type:In-Reply-To:References:
 Subject:To:MIME-Version:From:Date;
 bh=MPBRbmIZCq8agEuvyPMLFCgYYw/rfdhylDLWqXiJ7vU=;
 b=WlynvMDfRIi6VN8XCmnBO4EyqiG6q2CazX3QF4lnR3mc8aHo313fe7xPJYNa6dafg47
 1iPUHIMULoJHz4FfOBirtZE2o0BCZTgahxBjlne2XQWoVcEEheo1mDvfppazqMoa0BR3z
 95CuCu18O3j+P28jqXmlDxlQFtSZUQiOPpQ=
X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgkO4q1xDEhkgOJDsXNs=
X-RZG-CLASS-ID: mo00
Received: from fuckner.delnet ([85.183.0.195])
 by smtp.strato.de (RZmta 37.3 AUTH) with ESMTPA id j01b07r2C9UEtSi
 for <freebsd-hardware@freebsd.org>;
 Thu, 12 Mar 2015 10:30:14 +0100 (CET)
Message-ID: <55015CA6.1060006@fuckner.net>
Date: Thu, 12 Mar 2015 10:30:14 +0100
From: Michael Fuckner <michael@fuckner.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.5.0
MIME-Version: 1.0
To: freebsd-hardware@freebsd.org
Subject: Re: Server with 3TB Crashing at boot
References: <550046F7.1050205@fuckner.net>
 <CAFgRE9FaycX9-jc6QkwiM6mQKhb_+CYPSq1J+rpOt6nc--HpRw@mail.gmail.com>
In-Reply-To: <CAFgRE9FaycX9-jc6QkwiM6mQKhb_+CYPSq1J+rpOt6nc--HpRw@mail.gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-hardware@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: General discussion of FreeBSD hardware <freebsd-hardware.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hardware/>
List-Post: <mailto:freebsd-hardware@freebsd.org>
List-Help: <mailto:freebsd-hardware-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hardware>, 
 <mailto:freebsd-hardware-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 12 Mar 2015 09:30:36 -0000

On 03/11/2015 06:34 PM, Neel Natu wrote:
> Hi Michael,
>
> On Wed, Mar 11, 2015 at 6:45 AM, Michael Fuckner <michael@fuckner.net> wrote:
>> Hi,
>>
>> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory
>> Risers with 12DIMMs each. With 2 Risers I can boot the System with
>> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes
>> on boot.
>>
>
> Can you try to boot the system with SMP disabled and more than 2
> risers populated?
>

> LOADER> set kern.smp.disabled=1
with 3 risers it boots, with 8 it crashes, but I couldn't read the error 
message fast enough). And with 3 Modules USB was not working anymore- 
probably the USB Controller is attached to  another CPU?

http://dedi3.fuckner.net/~molli123/temp/dmesg.smp.disabled.txt
http://dedi3.fuckner.net/~molli123/temp/dmesg-s4l_opensuse13.2.txt