From owner-netperf-users@freebsd.org Fri Nov 20 16:08:43 2020 Return-Path: Delivered-To: netperf-users@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A56EA2EEACA for ; Fri, 20 Nov 2020 16:08:43 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-wm1-x333.google.com (mail-wm1-x333.google.com [IPv6:2a00:1450:4864:20::333]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cd1gZ18pyz3pqZ; Fri, 20 Nov 2020 16:08:41 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-wm1-x333.google.com with SMTP id a65so10272986wme.1; Fri, 20 Nov 2020 08:08:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=rDroy2DuV0Z4iy9XiqW72UlqD6lNpGcZjykkgT7KSSU=; b=isM9P7/My6UeEea5tKNhUJrTbPge0Ro4PNx9oym9mi8jctChzwv+2nA5Vs6fClNzPp XS9kLvuR240dRot3UkJo/HkDO1YfYrtIwudj8uIWj++Xn/n/VrBBHH+Z0TpRnwmlL9bM BeYL15V9CItbhu/Jl/h0uJoJF9ROmeBA09Xb9h1vqhVN7Bx3zh8VhDhp/kFFMePdrWm2 H6hXRrXTQMnIK3PY94EtaqGEitpp9wALeELCke+ni5sRFt7GjhB5YUfIW09vPLxgTk7e vI4GD1I513x6t8mSoOhjPnjSR/tirsp+je1XFB64abty5pXJh0WyvHoGJNJ/Sq1JeM54 lLbA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=rDroy2DuV0Z4iy9XiqW72UlqD6lNpGcZjykkgT7KSSU=; b=YQeznXwA7kBJXDd/+zRkQibhae8B8dp8qzXbYxstHUV/gm5U+1IFzCmtv6gAOWs21Y x8vphYfdczjrlFXooD0C3U4EHasVkBkl2nM5ANgHB/av3oTVJAWftrNNJZ1VuLv1Rtoh NQuR+T1EgZXBLQ+nE2Qaw5qJfZp45s+OTW04xQ1Km7ZL/PeXyDg/UiLO0R9CoO8/NVN0 tr4vk49Uva2y1d4JZo2s1AlHp7LmjdMzKyxPZK4Q8SVfl+eRfJ4Zns5oMwjlYfXjSrAM BjgjGC7vjrDcU4qBthRWFVcEIKisyO0PgnQcEqBiF9FpOGc4DqKsohXPcFqEA2tTQVfD P01A== X-Gm-Message-State: AOAM533T2Io0JAPce7j0Nr4ARz9fDYWSBSNbeYRFYvXiowLu0uriY2hx 08wieqQlqmefEN4SOHqUExupsPsyq3BtGTeJ4Bg= X-Google-Smtp-Source: ABdhPJx4jkCygbogXCL+mlHGsr9yEGjqEZ/fL6DQBHVH+xWNRIa5rEvscMYqa5+Im6lB+C6ir+PGfinvmzM/Z5FYtK0= X-Received: by 2002:a05:600c:290a:: with SMTP id i10mr10965706wmd.187.1605888519702; Fri, 20 Nov 2020 08:08:39 -0800 (PST) MIME-Version: 1.0 Received: by 2002:adf:dec7:0:0:0:0:0 with HTTP; Fri, 20 Nov 2020 08:08:38 -0800 (PST) In-Reply-To: References: <1f8e49ff-e3da-8d24-57f1-11f17389aa84@sentex.net> <2691e1fd-5a27-4dd0-2ef7-b1c06fd4e751@sentex.net> <5A5094BC-D417-4BA6-97E2-7CB522B51368@FreeBSD.org> <4ec6ed6f-b3b4-22ae-e1ec-93a46f3d88ea@sentex.net> <0ddec867-32b5-f667-d617-0ddc71726d09@sentex.net> From: Mateusz Guzik Date: Fri, 20 Nov 2020 17:08:38 +0100 Message-ID: Subject: Re: zoo reboot Friday Nov 20 14:00 UTC To: mike tancsa Cc: "Bjoern A. Zeeb" , netperf-admin@freebsd.org, netperf-users@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Cd1gZ18pyz3pqZ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=isM9P7/M; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2a00:1450:4864:20::333 as permitted sender) smtp.mailfrom=mjguzik@gmail.com X-Spamd-Result: default: False [-2.49 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::333:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.51)[0.508]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::333:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::333:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[netperf-users]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: netperf-users@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Announcements and discussions related to the netperf cluster. " List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Nov 2020 16:08:43 -0000 Is there something I can do to help? On 11/20/20, Mateusz Guzik wrote: > Oh, that's a bummer. I wonder if there is a regression in the boot > loader though. > > Does the pool mount if you boot the system from a cd/over the > network/whatever? > > On 11/20/20, mike tancsa wrote: >> Some progress. But now >> >> >> Consoles: internal >> video/keyboard >> BIOS drive C: is >> disk0 >> BIOS drive D: is >> disk1 >> BIOS drive E: is >> disk2 >> BIOS drive F: is >> disk3 >> BIOS drive G: is >> disk4 >> BIOS drive H: is >> disk5 >> BIOS drive I: is >> disk6 >> BIOS drive J: is >> disk7 >> BIOS drive K: is >> disk8 >> zio_read error: >> 5 >> zio_read error: >> 5 >> zio_read error: >> 5 >> ZFS: i/o error - all block copies >> unavailable >> ZFS: can't read MOS of pool >> zroot >> BIOS 615kB/1983396kB available >> memory >> >> >> FreeBSD/x86 bootstrap loader, Revision >> 1.1 >> (Thu Nov 19 08:18:03 EST 2020 >> mdtancsa@zoo.freebsd.org) >> ERROR: cannot open /boot/lua/loader.lua: invalid >> argument. >> >> >> >> >> Type '?' for a list of commands, 'help' for more detailed >> help. >> OK >> >> >> On 11/20/2020 9:28 AM, mike tancsa wrote: >>> I am wondering this is a problem with having the 2 SSD drives off the >>> LSI controller as part of the pool as vdev / meta data caches :(=C2=A0 = At >>> boot time I guess those are not seen yet ? Gonna have to make a trip to >>> the office to try and move those drives off the LSI controller and onto >>> the motherboard if possible to test out this theory and hopefully it >>> will boot. Anything else to try ? >>> >>> =C2=A0=C2=A0=C2=A0 ---Mike >>> >>> On 11/20/2020 9:09 AM, mike tancsa wrote: >>>> Hmm, not off to a good start.=C2=A0 This will take a little longer. >>>> >>>> >>>> >>>> ZFS: i/o error - all block copies >>>> unavailable >>>> ZFS: can't read MOS of pool >>>> zroot >>>> gptzfsboot: failed to mount default pool >>>> zroot >>>> >>>> >>>> FreeBSD/x86 >>>> boot >>>> >>>> >>>> int=3D00000000=C2=A0 err=3D00000000=C2=A0 efl=3D00010246 >>>> eip=3D00008974 >>>> eax=3D00000001=C2=A0 ebx=3D00000000=C2=A0 ecx=3D00000000 >>>> edx=3D00000000 >>>> esi=3D00000000=C2=A0 edi=3D00000000=C2=A0 ebp=3D0008de38 >>>> esp=3D0008ddd0 >>>> cs=3D002b=C2=A0 ds=3D0033=C2=A0 es=3D0033=C2=A0=C2=A0=C2=A0 fs=3D0033= =C2=A0 gs=3D0033 >>>> ss=3D0033 >>>> cs:eip=3Df7 35 90 9d 00 00 85 f6-74 05 89 3e 89 5e 04 >>>> 89 >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 c2 e9 cc 00 00 00 66 c7-45 ea 00 = 00 89 d8 c1 >>>> e8 >>>> ss:esp=3D00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 >>>> 00 >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 00 00 00 00 00 00 00 00-00 00 00 = 00 00 00 00 >>>> 00 >>>> BTX >>>> halted >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> On 11/19/2020 1:36 PM, mike tancsa wrote: >>>>> Thanks, I forgot about those :) I will add them of course.=C2=A0=C2= =A0 WRT to >>>>> zfs >>>>> backups, I want to redo how that works to something more useful using >>>>> better incremental sends.=C2=A0 Something like zrepl works well. I wi= ll >>>>> take >>>>> a look at that next week or so >>>>> >>>>> =C2=A0=C2=A0=C2=A0 ---Mike >>>>> >>>>> On 11/19/2020 1:23 PM, Bjoern A. Zeeb wrote: >>>>>> On 19 Nov 2020, at 17:38, George Neville-Neil wrote: >>>>>> >>>>>>> On 19 Nov 2020, at 10:57, mike tancsa wrote: >>>>>>> >>>>>>>> On 11/19/2020 8:31 AM, mike tancsa wrote: >>>>>>>>> To upgrade to r367842. I will also be upgrading the installed pkg= s >>>>>>>>> >>>>>>>> Also, with the pkg upgrade as so many are so very stale, its >>>>>>>> probably >>>>>>>> best to uninstall them all and then install what everyone needs / >>>>>>>> uses ? >>>>>>>> >>>>>>>> Below is the list of what is currently installed. I will kill thos= e >>>>>>>> and >>>>>>>> install to start >>>>>>>> >>>>>>>> bash,curl,conserver-com,git,gmake,ipmitools,megacli,perl,pdksh,pyt= hon3x,rsync,screen,storcli,subversion,sudo,tmux,vim,zsh >>>>>>>> >>>>>>>> >>>>>>>> Is there anything else people want / need ? >>>>>>> I think our best bet is to "just do it" and then fault in whatever >>>>>>> we >>>>>>> missed. >>>>>> Mike: >>>>>> >>>>>> - isc-dhcp=C2=A0=C2=A0 (or similar kind of flavour if you prefer som= ething else >>>>>> these days) would be beneficial I think. >>>>>> >>>>>> - micro_proxy=C2=A0=C2=A0 is run from inted in order to allow test m= achines to >>>>>> reach package repositories, etc. (as per motd on zoo). >>>>>> >>>>>> - bind=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 is running se= rving a local forward/reverse zone in >>>>>> addition to /etc/hosts; not sure if it is needed or helps or is >>>>>> stale? >>>>>> >>>>>> - pigz=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 for your zfs backups agai= n? >>>>>> >>>>>> I didn=E2=80=99t notice anything else so far. >>>>>> >>>>>> - smartmontools=C2=A0=C2=A0=C2=A0 in case you are monitoring disks? >>>>>> >>>>>> >>>>>> >>>>>> /bz >>>>>> >> > > > -- > Mateusz Guzik > --=20 Mateusz Guzik