From owner-freebsd-hackers@FreeBSD.ORG Wed Mar 11 19:13:42 2015 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DE658553; Wed, 11 Mar 2015 19:13:42 +0000 (UTC) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 92F17DC7; Wed, 11 Mar 2015 19:13:42 +0000 (UTC) Received: from Julian-MBP3.local (50-196-156-133-static.hfc.comcastbusiness.net [50.196.156.133]) (authenticated bits=0) by vps1.elischer.org (8.14.9/8.14.9) with ESMTP id t2BJDctW016867 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Wed, 11 Mar 2015 12:13:40 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <550093DD.5040603@freebsd.org> Date: Wed, 11 Mar 2015 12:13:33 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Oliver Pinter , Adrian Chadd Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 19:13:43 -0000 On 3/11/15 8:39 AM, Oliver Pinter wrote: > On Wed, Mar 11, 2015 at 4:26 PM, Adrian Chadd wrote: >> Hm, have you tried with just one TB of RAM? I haven't had access to >> systems with 3TB of RAM - I'm just about to get 1TB in a box. :) >> >> Hm, other hackers - what's the current size of the AMD64 direct map? > 4TB - https://github.com/freebsd/freebsd/blob/master/sys/amd64/include/vmparam.h#L157 yeah but since direct-map is, well, directly mapped, you might have 3TB of ram but it might be spread over a larger range. there may be holes in it.. it would be worth knowing the apparent layout of the ram. > >> >> >> -adrian >> >> >> On 11 March 2015 at 06:45, Michael Fuckner wrote: >>> Hi, >>> >>> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory >>> Risers with 12DIMMs each. With 2 Risers I can boot the System with >>> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes >>> on boot. >>> >>> >>> http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png >>> http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi >>> >>> >>> Here is the dmesg/ verbose dmesg, but I believe the verbose one got >>> truncated. Is there anything more I can do than booting verbose and to copy >>> /var/run/dmesg.boot? >>> >>> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt >>> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt >>> >>> Regards, >>> Michael! >>> >>> PS: already posted to freebsd-amd64, but I was told these lists are better. >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >