From owner-freebsd-hardware@FreeBSD.ORG Tue Mar 10 02:45:37 2015 Return-Path: Delivered-To: freebsd-hardware@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CD752EDF for ; Tue, 10 Mar 2015 02:45:37 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B3459C97 for ; Tue, 10 Mar 2015 02:45:37 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t2A2jbAB010519 for ; Tue, 10 Mar 2015 02:45:37 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-hardware@FreeBSD.org Subject: [Bug 156241] [mfi] 'zfs send' does not prevents disks to suspend if no other activity Date: Tue, 10 Mar 2015 02:45:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 8.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: linimon@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Mar 2015 02:45:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=156241 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-hardware@FreeBSD.or |linimon@FreeBSD.org |g | --- Comment #5 from Mark Linimon --- Reassign from non-responding assignee. To submitter: does this problem still recur on recent versions of FreeBSD? -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 13:45:57 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B453AD66; Wed, 11 Mar 2015 13:45:57 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::11]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 29471DDA; Wed, 11 Mar 2015 13:45:56 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426081528; l=762; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:Subject:To:MIME-Version:From: Date; bh=yABuP3lrNXtL4ie4CDeyReEI8sfW4/iPPwZfGeXJzAI=; b=oiw9N1H2Efb9y6rgRNlX2+/EOoEBNg96/EB1LyoPE3U6LCkhhuIR5uEVyGXrHQs6aiK Cfl2Ft+HyQulqLALdADhZw1wBjh+tMdtLYmozn5BhpuSeiUGxuVn4rB2oZEL6hUDB+qPx +L4S6sBg64nfONF925gfeyU1ACad+nC1L1k= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgkO4q1xDEhkgOJDsXNs= X-RZG-CLASS-ID: mo00 Received: from fuckner.delnet ([85.183.0.195]) by smtp.strato.de (RZmta 37.3 AUTH) with ESMTPA id 003b59r2BDjSZ94; Wed, 11 Mar 2015 14:45:28 +0100 (CET) Message-ID: <550046F7.1050205@fuckner.net> Date: Wed, 11 Mar 2015 14:45:27 +0100 From: Michael Fuckner User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-hardware@freebsd.org, freebsd-hackers@freebsd.org Subject: Server with 3TB Crashing at boot Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 13:45:57 -0000 Hi, I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory Risers with 12DIMMs each. With 2 Risers I can boot the System with FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes on boot. http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi Here is the dmesg/ verbose dmesg, but I believe the verbose one got truncated. Is there anything more I can do than booting verbose and to copy /var/run/dmesg.boot? http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt Regards, Michael! PS: already posted to freebsd-amd64, but I was told these lists are better. From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 15:26:04 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1D73FC96; Wed, 11 Mar 2015 15:26:04 +0000 (UTC) Received: from mail-ie0-x236.google.com (mail-ie0-x236.google.com [IPv6:2607:f8b0:4001:c03::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D83FDDCC; Wed, 11 Mar 2015 15:26:03 +0000 (UTC) Received: by iecsl2 with SMTP id sl2so116200iec.1; Wed, 11 Mar 2015 08:26:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=Vf51ZYMJuXZzVhBfNqlwBQ2DckKqdg0Uv83vBYlnHNU=; b=ztY+VjHERQsS3FrLqzjJcKKbiT4k4Rt9as10vTi4+TEHqWQg3SgmRhEuTqqQBsZRb5 KkmfPnilUgBYv1jwdjXl/rdRMelYpwhvev8FW5Jt0v/Lg7qCi7ezPhHnOawXwEiWvv0z lwel5Se+QKxadxQ9BhUMmyDJ3BDWi2+SIbu0+JqHSbbWDss8W6SRvIKZaSOhBXzXo/+l 32k13pECOTBEheg5wcNCvFkG5hF1HPxee1yT5fdm9nV9zAeWEbXiN1A4SZsPj4zd22h6 ZSVpVX0wX+i3MKkEh5bksHV6n5n/oW4LdRJmnZUHkkdCAkSxu4oUvz5TcTSb8T+PbCiy c2kQ== MIME-Version: 1.0 X-Received: by 10.50.93.70 with SMTP id cs6mr91370111igb.6.1426087563230; Wed, 11 Mar 2015 08:26:03 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.17.194 with HTTP; Wed, 11 Mar 2015 08:26:03 -0700 (PDT) In-Reply-To: <550046F7.1050205@fuckner.net> References: <550046F7.1050205@fuckner.net> Date: Wed, 11 Mar 2015 08:26:03 -0700 X-Google-Sender-Auth: B8kNdPWRBiNOd_Jtqqq_FwTuLuI Message-ID: Subject: Re: Server with 3TB Crashing at boot From: Adrian Chadd To: Michael Fuckner Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-hackers@freebsd.org" , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 15:26:04 -0000 Hm, have you tried with just one TB of RAM? I haven't had access to systems with 3TB of RAM - I'm just about to get 1TB in a box. :) Hm, other hackers - what's the current size of the AMD64 direct map? -adrian On 11 March 2015 at 06:45, Michael Fuckner wrote: > Hi, > > I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory > Risers with 12DIMMs each. With 2 Risers I can boot the System with > FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes > on boot. > > > http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png > http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi > > > Here is the dmesg/ verbose dmesg, but I believe the verbose one got > truncated. Is there anything more I can do than booting verbose and to copy > /var/run/dmesg.boot? > > http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt > http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt > > Regards, > Michael! > > PS: already posted to freebsd-amd64, but I was told these lists are better. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 15:44:55 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C244C691 for ; Wed, 11 Mar 2015 15:44:55 +0000 (UTC) Received: from mail-yh0-f53.google.com (mail-yh0-f53.google.com [209.85.213.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84090FF6 for ; Wed, 11 Mar 2015 15:44:55 +0000 (UTC) Received: by yhaf73 with SMTP id f73so4847090yha.12 for ; Wed, 11 Mar 2015 08:44:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Ytf5ZxlxyjncP7cJXNgGTcOOf1PjzaShxD9KJvPJqwA=; b=TdqjcLSR3uv2uv8UmBjIY8Nh04aOMZRJZu6KqsqOF6xTlvOE6UviDCbgCDg+Y/zOai H8hqv/LV8YP/2t0iFcjDdeYYGm14ns6GvWMosYVr4X/MUS9oK3v1e/VeFSD+ykKT0hCA KT0L+ruZitZo3RwiGKVhyPLTmgeHqgI6nq4R0iK7MKWNw1y0D7YdU6Z4+BuwjaZzw2GK oCHUWuEJ7raknQkF1JxM0+YUyYm7xKh9r0gImzVb5GKc/fL6wPkKbX0gOr5qcHtkPpEE LZITkuh4D4aQ6Yd8jY99MGoB19jPoT/RXQpomA3lBvOA0AsyS/v7KJJxvdS0LAABpcM9 aQcg== X-Gm-Message-State: ALoCoQl/n5vLboXxzr+kVcH4IN/amEbKVjf22USh6DbmSoV5MG76YMUuTtwuC6LqgUe8LrDa7NPG MIME-Version: 1.0 X-Received: by 10.236.209.137 with SMTP id s9mr37749605yho.45.1426088348728; Wed, 11 Mar 2015 08:39:08 -0700 (PDT) Received: by 10.170.104.86 with HTTP; Wed, 11 Mar 2015 08:39:08 -0700 (PDT) In-Reply-To: References: <550046F7.1050205@fuckner.net> Date: Wed, 11 Mar 2015 16:39:08 +0100 Message-ID: Subject: Re: Server with 3TB Crashing at boot From: Oliver Pinter To: Adrian Chadd Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 15:44:55 -0000 On Wed, Mar 11, 2015 at 4:26 PM, Adrian Chadd wrote: > Hm, have you tried with just one TB of RAM? I haven't had access to > systems with 3TB of RAM - I'm just about to get 1TB in a box. :) > > Hm, other hackers - what's the current size of the AMD64 direct map? 4TB - https://github.com/freebsd/freebsd/blob/master/sys/amd64/include/vmparam.h#L157 > > > > -adrian > > > On 11 March 2015 at 06:45, Michael Fuckner wrote: >> Hi, >> >> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory >> Risers with 12DIMMs each. With 2 Risers I can boot the System with >> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes >> on boot. >> >> >> http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png >> http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi >> >> >> Here is the dmesg/ verbose dmesg, but I believe the verbose one got >> truncated. Is there anything more I can do than booting verbose and to copy >> /var/run/dmesg.boot? >> >> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt >> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt >> >> Regards, >> Michael! >> >> PS: already posted to freebsd-amd64, but I was told these lists are better. >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 17:08:20 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BCE86FB3 for ; Wed, 11 Mar 2015 17:08:20 +0000 (UTC) Received: from weser.webweaving.org (weser.webweaving.org [148.251.234.232]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.webweaving.org", Issuer "RapidSSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 27740C7B for ; Wed, 11 Mar 2015 17:08:19 +0000 (UTC) Received: from [10.11.0.122] (a83-163-239-115.adsl.xs4all.nl [83.163.239.115]) (authenticated bits=0) by weser.webweaving.org (8.14.9/8.14.9) with ESMTP id t2BGclBd075454 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 11 Mar 2015 17:38:48 +0100 (CET) (envelope-from dirkx@webweaving.org) X-Authentication-Warning: weser.webweaving.org: Host a83-163-239-115.adsl.xs4all.nl [83.163.239.115] claimed to be [10.11.0.122] Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2087\)) Subject: Re: Server with 3TB Crashing at boot From: Dirk-Willem van Gulik In-Reply-To: Date: Wed, 11 Mar 2015 17:38:46 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <664C3D0B-932E-4350-94BC-FFC5F7CD4A2B@webweaving.org> References: <550046F7.1050205@fuckner.net> To: Adrian Chadd X-Mailer: Apple Mail (2.2087) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (weser.webweaving.org [148.251.234.232]); Wed, 11 Mar 2015 17:38:49 +0100 (CET) Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 17:08:20 -0000 > On 11 Mar 2015, at 16:26, Adrian Chadd wrote: >=20 > Hm, have you tried with just one TB of RAM? I haven't had access to > systems with 3TB of RAM - I'm just about to get 1TB in a box. :) >=20 > Hm, other hackers - what's the current size of the AMD64 direct map? Since 10.0 - = https://svnweb.freebsd.org/base?view=3Drevision&revision=3D254466 has = made 2Tbyte work reliably for me. Dw. *: See also [amd64] The maximum amount of memory the FreeBSD kernel can = address has been increased from 1TB to 4TB in relnotes of = https://www.freebsd.org/releases/10.0R/relnotes.html= From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 17:34:53 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E0E99796; Wed, 11 Mar 2015 17:34:53 +0000 (UTC) Received: from mail-wi0-x231.google.com (mail-wi0-x231.google.com [IPv6:2a00:1450:400c:c05::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7752DF82; Wed, 11 Mar 2015 17:34:53 +0000 (UTC) Received: by wiwl15 with SMTP id l15so41015973wiw.4; Wed, 11 Mar 2015 10:34:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+7qdx+Ua335ymtIEle9CudANe36LxrVLQ3b1FuY+sK4=; b=vIFyLIkjd5wc281C6znUhYZiDst+sRqSKqAQ+PK8RXjBnhcCro+7oDOWCqZl7361wJ IE8CP7XntNvE450N1JwUlZm/oHhoQsAgGN6EbwIXjmXA2aV61mnXgtdsj3hvtRnCYKge HgKMxwRTS3Fe262qvdXWZhzAg7iYAYJmnYuXfsGdRD7NRiihNl3b7jCtXkfQ2hoI+/FS CrX/yB9u1nRZ3Bt8fuBwMDUT1gosXlmHZ21rlOkDb8TAhjsLdCvLPNk7EVOMpKMDmrRD XsnH4KB1Cx2rUC8xMEQGjPLYsDK2h0E4i5/smigO6C34K6ZBf3ND2H28otFqAO013xvf BPfQ== MIME-Version: 1.0 X-Received: by 10.194.6.228 with SMTP id e4mr78631050wja.63.1426095291942; Wed, 11 Mar 2015 10:34:51 -0700 (PDT) Received: by 10.27.91.79 with HTTP; Wed, 11 Mar 2015 10:34:51 -0700 (PDT) In-Reply-To: <550046F7.1050205@fuckner.net> References: <550046F7.1050205@fuckner.net> Date: Wed, 11 Mar 2015 10:34:51 -0700 Message-ID: Subject: Re: Server with 3TB Crashing at boot From: Neel Natu To: Michael Fuckner Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD Hackers , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 17:34:54 -0000 Hi Michael, On Wed, Mar 11, 2015 at 6:45 AM, Michael Fuckner wrote: > Hi, > > I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory > Risers with 12DIMMs each. With 2 Risers I can boot the System with > FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes > on boot. > Can you try to boot the system with SMP disabled and more than 2 risers populated? LOADER> set kern.smp.disabled=1 best Neel > > http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png > http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi > > > Here is the dmesg/ verbose dmesg, but I believe the verbose one got > truncated. Is there anything more I can do than booting verbose and to copy > /var/run/dmesg.boot? > > http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt > http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt > > Regards, > Michael! > > PS: already posted to freebsd-amd64, but I was told these lists are better. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hardware@FreeBSD.ORG Wed Mar 11 19:13:42 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DE658553; Wed, 11 Mar 2015 19:13:42 +0000 (UTC) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 92F17DC7; Wed, 11 Mar 2015 19:13:42 +0000 (UTC) Received: from Julian-MBP3.local (50-196-156-133-static.hfc.comcastbusiness.net [50.196.156.133]) (authenticated bits=0) by vps1.elischer.org (8.14.9/8.14.9) with ESMTP id t2BJDctW016867 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Wed, 11 Mar 2015 12:13:40 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <550093DD.5040603@freebsd.org> Date: Wed, 11 Mar 2015 12:13:33 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Oliver Pinter , Adrian Chadd Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Mar 2015 19:13:43 -0000 On 3/11/15 8:39 AM, Oliver Pinter wrote: > On Wed, Mar 11, 2015 at 4:26 PM, Adrian Chadd wrote: >> Hm, have you tried with just one TB of RAM? I haven't had access to >> systems with 3TB of RAM - I'm just about to get 1TB in a box. :) >> >> Hm, other hackers - what's the current size of the AMD64 direct map? > 4TB - https://github.com/freebsd/freebsd/blob/master/sys/amd64/include/vmparam.h#L157 yeah but since direct-map is, well, directly mapped, you might have 3TB of ram but it might be spread over a larger range. there may be holes in it.. it would be worth knowing the apparent layout of the ram. > >> >> >> -adrian >> >> >> On 11 March 2015 at 06:45, Michael Fuckner wrote: >>> Hi, >>> >>> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory >>> Risers with 12DIMMs each. With 2 Risers I can boot the System with >>> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes >>> on boot. >>> >>> >>> http://dedi3.fuckner.net/~molli123/temp/3tb_ap1_phy2.png >>> http://dedi3.fuckner.net/~molli123/temp/3tb_crash.avi >>> >>> >>> Here is the dmesg/ verbose dmesg, but I believe the verbose one got >>> truncated. Is there anything more I can do than booting verbose and to copy >>> /var/run/dmesg.boot? >>> >>> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_verbose.txt >>> http://dedi3.fuckner.net/~molli123/temp/dmesg_q71l-4u_10.1.txt >>> >>> Regards, >>> Michael! >>> >>> PS: already posted to freebsd-amd64, but I was told these lists are better. >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hardware@FreeBSD.ORG Thu Mar 12 09:30:36 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 67857517 for ; Thu, 12 Mar 2015 09:30:36 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::8]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F1CBCA7F for ; Thu, 12 Mar 2015 09:30:35 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426152620; l=868; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:References: Subject:To:MIME-Version:From:Date; bh=MPBRbmIZCq8agEuvyPMLFCgYYw/rfdhylDLWqXiJ7vU=; b=WlynvMDfRIi6VN8XCmnBO4EyqiG6q2CazX3QF4lnR3mc8aHo313fe7xPJYNa6dafg47 1iPUHIMULoJHz4FfOBirtZE2o0BCZTgahxBjlne2XQWoVcEEheo1mDvfppazqMoa0BR3z 95CuCu18O3j+P28jqXmlDxlQFtSZUQiOPpQ= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgkO4q1xDEhkgOJDsXNs= X-RZG-CLASS-ID: mo00 Received: from fuckner.delnet ([85.183.0.195]) by smtp.strato.de (RZmta 37.3 AUTH) with ESMTPA id j01b07r2C9UEtSi for ; Thu, 12 Mar 2015 10:30:14 +0100 (CET) Message-ID: <55015CA6.1060006@fuckner.net> Date: Thu, 12 Mar 2015 10:30:14 +0100 From: Michael Fuckner User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: freebsd-hardware@freebsd.org Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2015 09:30:36 -0000 On 03/11/2015 06:34 PM, Neel Natu wrote: > Hi Michael, > > On Wed, Mar 11, 2015 at 6:45 AM, Michael Fuckner wrote: >> Hi, >> >> I have a server with 4 Xeon E7-8857 v2 and 96x32TB, organized as 8 Memory >> Risers with 12DIMMs each. With 2 Risers I can boot the System with >> FreeBSD10.1-p6, when adding a third riser (above 1TB RAM) the system crashes >> on boot. >> > > Can you try to boot the system with SMP disabled and more than 2 > risers populated? > > LOADER> set kern.smp.disabled=1 with 3 risers it boots, with 8 it crashes, but I couldn't read the error message fast enough). And with 3 Modules USB was not working anymore- probably the USB Controller is attached to another CPU? http://dedi3.fuckner.net/~molli123/temp/dmesg.smp.disabled.txt http://dedi3.fuckner.net/~molli123/temp/dmesg-s4l_opensuse13.2.txt From owner-freebsd-hardware@FreeBSD.ORG Thu Mar 12 09:32:47 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4BAAA591; Thu, 12 Mar 2015 09:32:47 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::11]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 61253AA4; Thu, 12 Mar 2015 09:32:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426152764; l=2114; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:References: Subject:CC:To:MIME-Version:From:Date; bh=pmquw4YBb3mY2N2wHNWCis6juFgz/BejcUahZOUcQX0=; b=HS18olQrz6cYusvMGErBEqfZp3SJwasCk/HhX2u3Mv0anMfGKLd7RPMF+nfsQpY00Wl 2sHqgSwkUsX+LxCNlg1Urs79RyhE0htGo8ik9csBqwTwoywgM4q4LAQGB6BpJ2EGQVaQf ZHnwWHY0658kv7Sl71eEoyt7+2vPZ26xG3U= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgkO4q1xDEhkgOJDsXNs= X-RZG-CLASS-ID: mo00 Received: from fuckner.delnet ([85.183.0.195]) by smtp.strato.de (RZmta 37.3 AUTH) with ESMTPA id m077c7r2C9Whnmv; Thu, 12 Mar 2015 10:32:43 +0100 (CET) Message-ID: <55015D3B.6030605@fuckner.net> Date: Thu, 12 Mar 2015 10:32:43 +0100 From: Michael Fuckner User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Julian Elischer , Oliver Pinter , Adrian Chadd Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> In-Reply-To: <550093DD.5040603@freebsd.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2015 09:32:47 -0000 On 03/11/2015 08:13 PM, Julian Elischer wrote: > On 3/11/15 8:39 AM, Oliver Pinter wrote: >> On Wed, Mar 11, 2015 at 4:26 PM, Adrian Chadd wrote: >>> Hm, have you tried with just one TB of RAM? I haven't had access to >>> systems with 3TB of RAM - I'm just about to get 1TB in a box. :) >>> >>> Hm, other hackers - what's the current size of the AMD64 direct map? >> 4TB - >> https://github.com/freebsd/freebsd/blob/master/sys/amd64/include/vmparam.h#L157 >> > > yeah but since direct-map is, well, directly mapped, you might have 3TB > of ram but it might be spread over a larger range. > there may be holes in it.. it would be worth knowing the apparent > layout of the ram. is it this you are looking for (from OpenSUSE 13.2)? http://dedi3.fuckner.net/~molli123/temp/dmesg.smp.disabled.txt http://dedi3.fuckner.net/~molli123/temp/dmesg-s4l_opensuse13.2.txt [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x00000000000997ff] usable [ 0.000000] BIOS-e820: [mem 0x0000000000099800-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000784affff] usable [ 0.000000] BIOS-e820: [mem 0x00000000784b0000-0x0000000078c63fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000078c64000-0x0000000078ca6fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x0000000078ca7000-0x000000007a268fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000007a269000-0x000000007bdc3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bdc4000-0x000000007bdc4fff] usable [ 0.000000] BIOS-e820: [mem 0x000000007bdc5000-0x000000007be4afff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007be4b000-0x000000007bffffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000003007fffffff] usable From owner-freebsd-hardware@FreeBSD.ORG Thu Mar 12 18:39:33 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C9278DA2; Thu, 12 Mar 2015 18:39:33 +0000 (UTC) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D67F766; Thu, 12 Mar 2015 18:39:33 +0000 (UTC) Received: from Julian-MBP3.local (50-196-156-133-static.hfc.comcastbusiness.net [50.196.156.133]) (authenticated bits=0) by vps1.elischer.org (8.14.9/8.14.9) with ESMTP id t2CIdOql021847 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 12 Mar 2015 11:39:25 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <5501DD57.7030305@freebsd.org> Date: Thu, 12 Mar 2015 11:39:19 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Michael Fuckner , Oliver Pinter , Adrian Chadd Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> In-Reply-To: <55015D3B.6030605@fuckner.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2015 18:39:33 -0000 On 3/12/15 2:32 AM, Michael Fuckner wrote: > On 03/11/2015 08:13 PM, Julian Elischer wrote: >> On 3/11/15 8:39 AM, Oliver Pinter wrote: >>> On Wed, Mar 11, 2015 at 4:26 PM, Adrian Chadd >>> wrote: >>>> Hm, have you tried with just one TB of RAM? I haven't had access to >>>> systems with 3TB of RAM - I'm just about to get 1TB in a box. :) >>>> >>>> Hm, other hackers - what's the current size of the AMD64 direct map? >>> 4TB - >>> https://github.com/freebsd/freebsd/blob/master/sys/amd64/include/vmparam.h#L157 >>> >>> >> >> yeah but since direct-map is, well, directly mapped, you might have >> 3TB >> of ram but it might be spread over a larger range. >> there may be holes in it.. it would be worth knowing the apparent >> layout of the ram. > is it this you are looking for (from OpenSUSE 13.2)? > > > http://dedi3.fuckner.net/~molli123/temp/dmesg.smp.disabled.txt > http://dedi3.fuckner.net/~molli123/temp/dmesg-s4l_opensuse13.2.txt > > > [ 0.000000] e820: BIOS-provided physical RAM map: > [ 0.000000] BIOS-e820: [mem > 0x0000000000000000-0x00000000000997ff] usable > [ 0.000000] BIOS-e820: [mem > 0x0000000000099800-0x000000000009ffff] reserved > [ 0.000000] BIOS-e820: [mem > 0x00000000000e0000-0x00000000000fffff] reserved > [ 0.000000] BIOS-e820: [mem > 0x0000000000100000-0x00000000784affff] usable > [ 0.000000] BIOS-e820: [mem > 0x00000000784b0000-0x0000000078c63fff] reserved > [ 0.000000] BIOS-e820: [mem > 0x0000000078c64000-0x0000000078ca6fff] ACPI data > [ 0.000000] BIOS-e820: [mem > 0x0000000078ca7000-0x000000007a268fff] ACPI NVS > [ 0.000000] BIOS-e820: [mem > 0x000000007a269000-0x000000007bdc3fff] reserved > [ 0.000000] BIOS-e820: [mem > 0x000000007bdc4000-0x000000007bdc4fff] usable > [ 0.000000] BIOS-e820: [mem > 0x000000007bdc5000-0x000000007be4afff] reserved > [ 0.000000] BIOS-e820: [mem > 0x000000007be4b000-0x000000007bffffff] usable > [ 0.000000] BIOS-e820: [mem > 0x0000000080000000-0x000000008fffffff] reserved > [ 0.000000] BIOS-e820: [mem > 0x00000000fed1c000-0x00000000fed1ffff] reserved > [ 0.000000] BIOS-e820: [mem > 0x00000000ff000000-0x00000000ffffffff] reserved > [ 0.000000] BIOS-e820: [mem > 0x0000000100000000-0x000003007fffffff] usable > ok, it looks like it is in one big chunk.. so that is not an issue. From owner-freebsd-hardware@FreeBSD.ORG Thu Mar 12 19:30:51 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 94D55EF2; Thu, 12 Mar 2015 19:30:51 +0000 (UTC) Received: from mail-ie0-x22b.google.com (mail-ie0-x22b.google.com [IPv6:2607:f8b0:4001:c03::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 58584DD1; Thu, 12 Mar 2015 19:30:51 +0000 (UTC) Received: by iegc3 with SMTP id c3so58351044ieg.3; Thu, 12 Mar 2015 12:30:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=h5p1AZrjhyqOzqrGzWTQbxMq+F740IHRo2ImPl03XoU=; b=DpniJJVCUm6dLcYZrlGxxKVLrlRJafc+ciu7VuWV6DZAvMk36wRXKc81g33a3Ri4hA tuHQkch9EmuJFCgDSrYR2/QrMCXHWnVuCB2v5om5xc6dkBg7Q9M2q5a25eBcr6nK/dtd +Ns+xfMsSw0cxaCDDBixPmOgfuMssS3murmVcBOim1ZI/nWLLGVaONZjhQpXxkJRhXKE qfMg/kXa3AQUDT9Cuis/6YSsftcI/2aeHKJ2tEZeGyWfVvGuf/JvGsAdRi3xvclal4QK w9LJXO7Lj6347W8oHrDXuAwKY2TK/zJEmvo/0MT8xmiWtlNuIb2MscNYrOG4lDdNzv/a nsow== MIME-Version: 1.0 X-Received: by 10.50.66.170 with SMTP id g10mr103496657igt.49.1426188639908; Thu, 12 Mar 2015 12:30:39 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.17.194 with HTTP; Thu, 12 Mar 2015 12:30:39 -0700 (PDT) In-Reply-To: <5501DD57.7030305@freebsd.org> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> Date: Thu, 12 Mar 2015 12:30:39 -0700 X-Google-Sender-Auth: hQaVUxKXZKf65_2JqGAfvHhXMlo Message-ID: Subject: Re: Server with 3TB Crashing at boot From: Adrian Chadd To: Julian Elischer Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2015 19:30:51 -0000 Right. Try booting it with SMP disabled but with all the RAM. I think it's 'kern.smp.disabled=1' at the bootloader, then 'boot -v' -a From owner-freebsd-hardware@FreeBSD.ORG Thu Mar 12 21:19:11 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B6867EF7; Thu, 12 Mar 2015 21:19:11 +0000 (UTC) Received: from mail-ie0-x22d.google.com (mail-ie0-x22d.google.com [IPv6:2607:f8b0:4001:c03::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78F81C61; Thu, 12 Mar 2015 21:19:11 +0000 (UTC) Received: by iecvj10 with SMTP id vj10so59035138iec.0; Thu, 12 Mar 2015 14:19:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=fdeUtvO1iPw8BW73spSiU4EJKw7heAGh8htKbf4ZpIg=; b=Km7g3O4TN7A0S5X0vTBA7GSjGXL94PAsu4hcR0HBGvhqgkiAAqo/C6URYNQ+VMdNS8 MWv6N9BeJm/1hVzinKd/koHJOkhb2aEMHp2uD7b+As0hK7MMjmXibke+D04UG31+mosi sPxEJXWt1PwyE3YAt4wuMD0IkPSgyrgwloBHApXug8bP1TAHMWbE5L2YacFhv+xlj/Pu UJOk/kTywXuwp5VqSbS1IC57ZL/JYY6da9lpxf3NYet54/UJpAtWBv60GGzuNDoXAy/e /ztGgd9IvrpR5rcNrUWeTRsCj4V5ZVSqnnLnaxbUN+sSPWaLwQX9ncZzDjwON0bj4hPl 1HmA== MIME-Version: 1.0 X-Received: by 10.50.111.10 with SMTP id ie10mr103618069igb.15.1426195150618; Thu, 12 Mar 2015 14:19:10 -0700 (PDT) Received: by 10.36.104.78 with HTTP; Thu, 12 Mar 2015 14:19:10 -0700 (PDT) Date: Thu, 12 Mar 2015 17:19:10 -0400 Message-ID: Subject: Zoned Commands ZBC/ZAC, Shingled SMR drives, ZFS From: grarpamp To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 Cc: freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Mar 2015 21:19:11 -0000 Here is a performance review of the ST8000AS0002 non-SED "drive managed" model (caveat your actual expected usage). http://www.storagereview.com/seagate_archive_hdd_review_8tb You can also find these drives inside the STDT8000100 external USB unit for a bit more at $300. From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 05:41:39 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6EE5E524; Fri, 13 Mar 2015 05:41:39 +0000 (UTC) Received: from vps.rulingia.com (vps.rulingia.com [103.243.244.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps.rulingia.com", Issuer "CAcert Class 3 Root" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CF1F4CBC; Fri, 13 Mar 2015 05:41:38 +0000 (UTC) Received: from server.rulingia.com (c220-239-242-83.belrs5.nsw.optusnet.com.au [220.239.242.83]) by vps.rulingia.com (8.14.9/8.14.9) with ESMTP id t2D5fMRx021400 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 13 Mar 2015 16:41:28 +1100 (AEDT) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.14.9/8.14.9) with ESMTP id t2D5fG1s019509 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 13 Mar 2015 16:41:16 +1100 (AEDT) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.14.9/8.14.9/Submit) id t2D5fGxb019508; Fri, 13 Mar 2015 16:41:16 +1100 (AEDT) (envelope-from peter) Date: Fri, 13 Mar 2015 16:41:16 +1100 From: Peter Jeremy To: Adrian Chadd Subject: Re: Server with 3TB Crashing at boot Message-ID: <20150313054116.GB92183@server.rulingia.com> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="tKW2IUtsqtDRztdT" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.5.23 (2014-03-12) Cc: "freebsd-hackers@freebsd.org" , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 05:41:39 -0000 --tKW2IUtsqtDRztdT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2015-Mar-12 12:30:39 -0700, Adrian Chadd wrote: >Right. Try booting it with SMP disabled but with all the RAM. Is this possible? Can one CPU see the RAM on another CPU if that CPU isn't enabled in the kernel? --=20 Peter Jeremy --tKW2IUtsqtDRztdT Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJVAnh8XxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRFRUIyOTg2QzMwNjcxRTc0RTY1QzIyN0Ux NkE1OTdBMEU0QTIwQjM0AAoJEBall6Dkogs06YkP/iOXjuzz4mEC/8lhrOYcBpHg lYJ1riUaBTM8gXhQoZQktJLzDk5nME9iZvoswGUybUkYgYCGcAUD+IXlnltsCmvh 8kSprGHlxyCHOpvB/UTK1h5HdCFgwHH4kI7Q3C8eVFaZSWvx8ISxxGFXYuANCJQ2 +ArfmNJAVPIIwQ/LStwPzZtXc0su2nZv6L/N6gYAUD09J77RQnwbB5IEIUz5he7q tkQzKAw2Y9NUQg6gzSf3NwpfjcX1Q39d50M4DUR3407kAO25xTqTWkphDsUyAkzg PS9ZtcoSbbpl91oINe9rjT5Eo8ycJUOLS0tfrmWukjtjTlVCIF8AFGU8qhANNh3k 8xec8Npn6r3VGKFQCmhD0RY+c8SpjKMrjg1vvav3jfiuGdnPowrhdq9dLuNZTDyt FYE2tyf1Ysua3EMRF7tg1hX1v01/AC33SWOHFV8muQdbxR6eoQ4n6UQCcigRDSYA rNBqpb6HOK+Wsf8iQh471ezPK3Bz8A1l8ikQfzCX8ZtSRpTvkQU6kkTPoNWebeKr 9qvlINFhatnfZo31blZQ/VbR7ACZLLJgCD0IG7OJWYnURAIy90eGYLwaFA3BKD5T JJAglNcB9hx0wbQIwVnHYd5Pnqh4l26HxiucmVpn6f9UDsHdlRuAZQB4OT6RSG/r JvGvwL0CKAA4pUR7b/33 =QpkY -----END PGP SIGNATURE----- --tKW2IUtsqtDRztdT-- From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 07:36:35 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4351E52C; Fri, 13 Mar 2015 07:36:35 +0000 (UTC) Received: from mail-qg0-x22f.google.com (mail-qg0-x22f.google.com [IPv6:2607:f8b0:400d:c04::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E726799B; Fri, 13 Mar 2015 07:36:34 +0000 (UTC) Received: by qgef51 with SMTP id f51so24065118qge.0; Fri, 13 Mar 2015 00:36:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=h3xFJmvGWJy4mQBuJZXZmvk+2CBhmXDwNHa0/XnVue4=; b=HZ19Hokpdp3HC5t17A1+bjfZFVtMYmBrzliFTmG5FXN0cJcDJYD8csH6ziln9zwBfk VKO4NxYLTv1LZp8nAMbGwO0Gulf5HaTj9Offj8uVVr0ovnEkIZW04KbfdXV/Yyb/ZRp3 Fv8WrKQfzqTGlxXL77CTzsrodaYe1W09FdkJTPHpe9wynPzeCBIi+AZ/zQ+P15ovu7HS n7rfuks9JAxnla66g2hwY1hLG2BnJV/w/vHmt3AACvt+3Cps8VSdsgvrKlhFcx1Fr/ls FcWco+TPAbPsWBdUCM8pjhRnT+IuFauxc5+3XdiPP+AWrYaRG3ac9fcMJpM7O5oSzTdA ZirA== X-Received: by 10.140.37.7 with SMTP id q7mr56653937qgq.29.1426232194079; Fri, 13 Mar 2015 00:36:34 -0700 (PDT) Received: from [10.134.110.94] (mobile-107-107-56-178.mycingular.net. [107.107.56.178]) by mx.google.com with ESMTPSA id f77sm894015qka.9.2015.03.13.00.36.33 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 13 Mar 2015 00:36:33 -0700 (PDT) References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <20150313054116.GB92183@server.rulingia.com> Mime-Version: 1.0 (1.0) In-Reply-To: <20150313054116.GB92183@server.rulingia.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <207BA405-A483-4EFB-9BC5-3AD4EDEA11DD@gmail.com> X-Mailer: iPhone Mail (12D508) From: Garrett Cooper Subject: Re: Server with 3TB Crashing at boot Date: Fri, 13 Mar 2015 03:36:29 -0400 To: Peter Jeremy Cc: "freebsd-hackers@freebsd.org" , Adrian Chadd , "freebsd-hardware@freebsd.org" X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 07:36:35 -0000 > On Mar 13, 2015, at 01:41, Peter Jeremy wrote: >=20 >> On 2015-Mar-12 12:30:39 -0700, Adrian Chadd wrote: >> Right. Try booting it with SMP disabled but with all the RAM. >=20 > Is this possible? Can one CPU see the RAM on another CPU if that CPU > isn't enabled in the kernel? I could be wrong, but I think Adrian's recommending that the number of varia= bles be reduced so the root cause cause could be better isolated. Thanks!= From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 07:52:21 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4586C79D; Fri, 13 Mar 2015 07:52:21 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A6B70BA5; Fri, 13 Mar 2015 07:52:20 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id t2D7qE09049531 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 13 Mar 2015 09:52:14 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.9.2 kib.kiev.ua t2D7qE09049531 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.9/Submit) id t2D7qCQe049530; Fri, 13 Mar 2015 09:52:12 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 13 Mar 2015 09:52:12 +0200 From: Konstantin Belousov To: Peter Jeremy Subject: Re: Server with 3TB Crashing at boot Message-ID: <20150313075212.GU2379@kib.kiev.ua> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <20150313054116.GB92183@server.rulingia.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150313054116.GB92183@server.rulingia.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: "freebsd-hackers@freebsd.org" , Adrian Chadd , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 07:52:21 -0000 On Fri, Mar 13, 2015 at 04:41:16PM +1100, Peter Jeremy wrote: > On 2015-Mar-12 12:30:39 -0700, Adrian Chadd wrote: > >Right. Try booting it with SMP disabled but with all the RAM. > > Is this possible? Can one CPU see the RAM on another CPU if that CPU > isn't enabled in the kernel? Yes, of course. The disabled state means that the core is not started to execute the stream of the architectural instructions opcodes. The memory controller, address decoder and inter-socket links, and pcie links are configured by the motherboard firmware during the POST. They are left alone by our kernel. From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 17:50:31 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D5ADEDCF; Fri, 13 Mar 2015 17:50:31 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::12]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DFF2FB91; Fri, 13 Mar 2015 17:50:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426269004; l=803; s=domk; d=fuckner.net; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:References: Subject:CC:To:MIME-Version:From:Date; bh=TH3amsfH+Fk2BbZ4t+b3Zt2RXl6XFn6lspx6ELCe9Yo=; b=hxj8XCUO1jNda4wKYlapcv1RFGITYBIKJs0G00yuq7IXo8UyAT1taEqvo8HkoZcox/z qQGswpOszwiJme91SoPNiQeG51aOiVlmcbHeU+vQ4Jpfw9slQYNSjPxDCDwCQ2LwACACA mliPGHlGXpIGS1D3qCU7jyS34xtlcI09mAc= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTL/JIGbzkGUoozgkO4q1xDEhkgOJDsXNs= X-RZG-CLASS-ID: mo00 Received: from fuckner.delnet ([85.183.0.195]) by smtp.strato.de (RZmta 37.4 AUTH) with ESMTPA id 901c6er2DHo35di; Fri, 13 Mar 2015 18:50:03 +0100 (CET) Message-ID: <5503234A.4060103@fuckner.net> Date: Fri, 13 Mar 2015 18:50:02 +0100 From: Michael Fuckner User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Adrian Chadd , Julian Elischer Subject: Re: Server with 3TB Crashing at boot References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 17:50:31 -0000 On 03/12/2015 08:30 PM, Adrian Chadd wrote: > Right. Try booting it with SMP disabled but with all the RAM. > > I think it's 'kern.smp.disabled=1' at the bootloader, then 'boot -v' my problem seems to be my /boot/loader.conf which is the correct option for verboose booting? when loading nvme/nvd/zfs it crashes. why is mpr1 detected after loading nvme? (I boot from mpr0) hw.memtest.tests=0 #kern.smp.disabled=1 console=comconsole boot_verbose="YES" verbose_loading="YES" zfs_load="NO" nvme_load="NO" nvd_load="NO" http://dedi3.fuckner.net/~molli123/temp/kldload-nvme_nvd_zfs.txt http://dedi3.fuckner.net/~molli123/temp/freebsd-10.1_smp-disabled_verbose.txt http://dedi3.fuckner.net/~molli123/temp/freebsd-10.1_smp-enabled_verbose.txt Any idea? Regards, Michael! From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 18:02:24 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DADC55A3; Fri, 13 Mar 2015 18:02:24 +0000 (UTC) Received: from mail-ie0-x232.google.com (mail-ie0-x232.google.com [IPv6:2607:f8b0:4001:c03::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8D6D4D59; Fri, 13 Mar 2015 18:02:24 +0000 (UTC) Received: by iegc3 with SMTP id c3so120890154ieg.3; Fri, 13 Mar 2015 11:02:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=GjpZjhb7bSri01aDPT7RYzHmhs+g4gY8/qzeJIuC3VQ=; b=xSCOjCoVdCrQ22YZlquxs4N1gCyYQg/NulU5glNzP66a29s4kBCcCpbAU++Y+KKKmg UoGvad7qyfUBK1dPrMmxEAf49YrVl9mN+E/5K4z5isgX94nW6aDTNTGoGmuDy37JefRJ lem8CYgUt9AKbjuFbNQn/xs7wIivRD/po1SpqQdHpzKweLPaYv/6mKq+sjkO+Bzjj9w/ s4VVqNa3vzeWjxfwKMJjyIejnKDTDeqA8QYG4HzvPCN6KHqHqBXOL+VThd0fLJGSBcKC kXM2i5DUHRc8vywe+qRtitBiwWUrSRgrTCT/B7DCwShREzHgQ4kNwdR8+bOBh27/zD4/ ulbg== MIME-Version: 1.0 X-Received: by 10.107.136.206 with SMTP id s75mr51439019ioi.8.1426269735349; Fri, 13 Mar 2015 11:02:15 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.17.194 with HTTP; Fri, 13 Mar 2015 11:02:15 -0700 (PDT) In-Reply-To: <5503234A.4060103@fuckner.net> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <5503234A.4060103@fuckner.net> Date: Fri, 13 Mar 2015 11:02:15 -0700 X-Google-Sender-Auth: CSkLeW2Vv8yRQqlo8W_OD8QKH1g Message-ID: Subject: Re: Server with 3TB Crashing at boot From: Adrian Chadd To: Michael Fuckner Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-hackers@freebsd.org" , Julian Elischer , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 18:02:25 -0000 On 13 March 2015 at 10:50, Michael Fuckner wrote: > On 03/12/2015 08:30 PM, Adrian Chadd wrote: >> >> Right. Try booting it with SMP disabled but with all the RAM. >> >> I think it's 'kern.smp.disabled=1' at the bootloader, then 'boot -v' > > > my problem seems to be my /boot/loader.conf > > which is the correct option for verboose booting? > when loading nvme/nvd/zfs it crashes. > why is mpr1 detected after loading nvme? (I boot from mpr0) > > > hw.memtest.tests=0 > #kern.smp.disabled=1 > console=comconsole > boot_verbose="YES" > verbose_loading="YES" > zfs_load="NO" > nvme_load="NO" > nvd_load="NO" > > http://dedi3.fuckner.net/~molli123/temp/kldload-nvme_nvd_zfs.txt > http://dedi3.fuckner.net/~molli123/temp/freebsd-10.1_smp-disabled_verbose.txt > http://dedi3.fuckner.net/~molli123/temp/freebsd-10.1_smp-enabled_verbose.txt > > > Any idea? Hi, boot_verbose=YES looks to be right. So hm, just to be clear - it boots fine if you don't load zfs/nvme/nvd? -adrian From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 19:50:29 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 46D4F49B; Fri, 13 Mar 2015 19:50:29 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::1]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 53D82C88; Fri, 13 Mar 2015 19:50:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426276199; l=1800; s=domk; d=fuckner.net; h=Content-Type:MIME-Version:Subject:References:In-Reply-To:Cc:To: Reply-To:From:Date; bh=+QESKfdCq53CUeOeDqhDSu4iRopDU4kO6KlQyYNHn3k=; b=od9Q/jYyUja3Ylnvu4R1P0h3EGSv/Ate/q11Pzp/liBEHB6Bot1o+vmHS0penWrlcC8 MuuhdUXRGChNzmLO1e4bBwhVWt1b36GCIcGITSPrGjkxlHjBmoexHvwvq93igiP5UOQ+J le0GOC816lw+32hfOQRog/Q+HyMaHqcoUQQ= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTEGbkn8hussqFHiy/c+oYVPeezIVIZYA== X-RZG-CLASS-ID: mo00 Received: from ptangptang.store (com4.strato.de [81.169.145.237]) by smtp-ox.front (RZmta 37.4 AUTH) with ESMTPSA id n0379ar2DJni8rE (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate); Fri, 13 Mar 2015 20:49:44 +0100 (CET) Date: Fri, 13 Mar 2015 20:49:44 +0100 (CET) From: Michael Fuckner Reply-To: Michael Fuckner To: Adrian Chadd Message-ID: <101866634.392324.1426276184167.JavaMail.open-xchange@ptangptang.store> In-Reply-To: References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <5503234A.4060103@fuckner.net> Subject: Re: Server with 3TB Crashing at boot MIME-Version: 1.0 X-Priority: 3 Importance: Medium X-Mailer: Open-Xchange Mailer v7.6.0-Rev36 X-Originating-Client: com.openexchange.ox.gui.dhtml Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-hackers@freebsd.org" , Julian Elischer , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 19:50:29 -0000 > Adrian Chadd hat am 13. M=C3=A4rz 2015 um 19:02 gesc= hrieben: =20 Hi! > boot_verbose=3DYES looks to be right. root@s4l:~ # grep verbose /boot/defaults/loader.conf verbose_loading=3D"NO" # Set to YES for verbose loader output OK, this confused me :-( > So hm, just to be clear - it boots fine if you don't load zfs/nvme/nvd? yes, probably zfs, but why does loading nvme also come up with other device= s like mpr? From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 20:26:19 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7E30E62C; Fri, 13 Mar 2015 20:26:19 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49558108; Fri, 13 Mar 2015 20:26:19 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id t2DKS1ME005725; Fri, 13 Mar 2015 13:28:04 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) To: Adrian Chadd , Michael Fuckner In-Reply-To: <101866634.392324.1426276184167.JavaMail.open-xchange@ptangptang.store> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <5503234A.4060103@fuckner.net> , <101866634.392324.1426276184167.JavaMail.open-xchange@ptangptang.store> From: "Chris H" Subject: Re: Server with 3TB Crashing at boot Date: Fri, 13 Mar 2015 13:28:05 -0700 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <72adbbf534c673c111c0b8cec018318b@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: "freebsd-hackers@freebsd.org" , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 20:26:19 -0000 On Fri, 13 Mar 2015 20:49:44 +0100 (CET) Michael Fuckner wrote > > Adrian Chadd hat am 13. März 2015 um 19:02 > > geschrieben: > > Hi! > > > boot_verbose=YES looks to be right. > > root@s4l:~ # grep verbose /boot/defaults/loader.conf > verbose_loading="NO" # Set to YES for verbose loader output > > OK, this confused me :-( In case it's still not clear: The values your copy of loader.conf located as /boot/loader.conf overrides the values set in /boot/defaults/loader.conf --Chris > > > So hm, just to be clear - it boots fine if you don't load zfs/nvme/nvd? > yes, probably zfs, but why does loading nvme also come up with other devices > like mpr? > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 20:38:39 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 995748F5; Fri, 13 Mar 2015 20:38:39 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::1]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C9877211; Fri, 13 Mar 2015 20:38:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1426279092; l=2485; s=domk; d=fuckner.net; h=Content-Type:MIME-Version:Subject:References:In-Reply-To:Cc:To: Reply-To:From:Date; bh=/JrWJ2QROOgHOW12w+sjfZ+ks3ZKV70Ai7MCTsf1a9A=; b=QSKN86SssjVk1F8Rv9Sx1BmNXqLzuRCrB3gkC7tKQP/Kv6nWGq6yI+Ezj4dp0aWqmyz WGV4PR9ySC1fCPpH1Sw1ViyT4Pu7/y2pEDaiDu5M4eqTDdv5lMDsEqw5D/BZ86RsxkPT8 s+gqdCf/2cqLBXUDQaZvPVce/4lMm4Jp6+M= X-RZG-AUTH: :IWUHfUGtd9+6EujMWHx57N4dWae4bmTEGbkn8hussqFHiy/c+oYVPeezIVIZYA== X-RZG-CLASS-ID: mo00 Received: from ptangptang.store (com4.strato.de [81.169.145.237]) by smtp-ox.front (RZmta 37.4 AUTH) with ESMTPSA id x02882r2DKc1Ajs (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate); Fri, 13 Mar 2015 21:38:01 +0100 (CET) Date: Fri, 13 Mar 2015 21:38:01 +0100 (CET) From: Michael Fuckner Reply-To: Michael Fuckner To: Chris H , Adrian Chadd Message-ID: <1037310890.395652.1426279081703.JavaMail.open-xchange@ptangptang.store> In-Reply-To: <72adbbf534c673c111c0b8cec018318b@ultimatedns.net> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <5503234A.4060103@fuckner.net> , <101866634.392324.1426276184167.JavaMail.open-xchange@ptangptang.store> <72adbbf534c673c111c0b8cec018318b@ultimatedns.net> Subject: Re: Server with 3TB Crashing at boot MIME-Version: 1.0 X-Priority: 3 Importance: Medium X-Mailer: Open-Xchange Mailer v7.6.0-Rev36 X-Originating-Client: com.openexchange.ox.gui.dhtml Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-hackers@freebsd.org" , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 20:38:39 -0000 > Chris H hat am 13. M=C3=A4rz 2015 um 21:28 gesch= rieben: > > > On Fri, 13 Mar 2015 20:49:44 +0100 (CET) Michael Fuckner > wrote > > > > Adrian Chadd hat am 13. M=C3=A4rz 2015 um 19:02 > > > geschrieben: > > > > Hi! > > > > > boot_verbose=3DYES looks to be right. > > > > root@s4l:~ # grep verbose /boot/defaults/loader.conf > > verbose_loading=3D"NO" # Set to YES for verbose loader output > > > > OK, this confused me :-( > In case it's still not clear: > The values your copy of loader.conf located as /boot/loader.conf > overrides the values set in /boot/defaults/loader.conf >=20 that is clear to me, but I was confused by verbose_loading vs boot_verbose From owner-freebsd-hardware@FreeBSD.ORG Fri Mar 13 23:59:42 2015 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F31CD957; Fri, 13 Mar 2015 23:59:41 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8C391B35; Fri, 13 Mar 2015 23:59:41 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id t2E01QIo046620; Fri, 13 Mar 2015 17:01:27 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) To: Adrian Chadd , Michael Fuckner In-Reply-To: <1037310890.395652.1426279081703.JavaMail.open-xchange@ptangptang.store> References: <550046F7.1050205@fuckner.net> <550093DD.5040603@freebsd.org> <55015D3B.6030605@fuckner.net> <5501DD57.7030305@freebsd.org> <5503234A.4060103@fuckner.net> , <101866634.392324.1426276184167.JavaMail.open-xchange@ptangptang.store> <72adbbf534c673c111c0b8cec018318b@ultimatedns.net>, <1037310890.395652.1426279081703.JavaMail.open-xchange@ptangptang.store> From: "Chris H" Subject: Re: Server with 3TB Crashing at boot Date: Fri, 13 Mar 2015 17:01:27 -0700 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <6efe9f7b5f8e1de40c1f950c864631c7@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: "freebsd-hackers@freebsd.org" , Oliver Pinter , freebsd-hardware@freebsd.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Mar 2015 23:59:42 -0000 On Fri, 13 Mar 2015 21:38:01 +0100 (CET) Michael Fuckner wrote > > Chris H hat am 13. März 2015 um 21:28 > > geschrieben: > > > > > On Fri, 13 Mar 2015 20:49:44 +0100 (CET) Michael Fuckner > > wrote > > > > > > Adrian Chadd hat am 13. März 2015 um 19:02 > > > > geschrieben: > > > > > > Hi! > > > > > > > boot_verbose=YES looks to be right. > > > > > > root@s4l:~ # grep verbose /boot/defaults/loader.conf > > > verbose_loading="NO" # Set to YES for verbose loader output > > > > > > OK, this confused me :-( > > In case it's still not clear: > > The values your copy of loader.conf located as /boot/loader.conf > > overrides the values set in /boot/defaults/loader.conf > > > that is clear to me, but I was confused by verbose_loading vs boot_verbose LOL in all honesty, that one got me too, at first. :-/ It *is* confusing. --Chris > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" --Chris --