From owner-freebsd-fs@freebsd.org Mon Dec 17 00:36:57 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 621EA1343EC5 for ; Mon, 17 Dec 2018 00:36:57 +0000 (UTC) (envelope-from kayasaman@gmail.com) Received: from mail-wr1-x435.google.com (mail-wr1-x435.google.com [IPv6:2a00:1450:4864:20::435]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5CC5C70B06 for ; Mon, 17 Dec 2018 00:36:56 +0000 (UTC) (envelope-from kayasaman@gmail.com) Received: by mail-wr1-x435.google.com with SMTP id c14so10582492wrr.0 for ; Sun, 16 Dec 2018 16:36:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language; bh=IcHuru1KHM2W1bAxb0PnGSZxnffnVswf30cQrvvtrys=; b=Aa6gQqzbSLQNobdpolJqfVTqMY7HzH5xHYRR0NK3X720tUUHYOyp5023rzFqEKag1a ztAvM88gcJsDinz25Fy2Sl3ZHpw+NG4+N1hhMvd80h/LZitQ32Fk865ed5KR5hQL+Wu7 uN8PPuojRS2OEnK+4rHMNzGJQRq+dbVpI2tx4JE9PCV4jfBdkMPaRJCDSWlRWoFx8BWM KEmvuDvDpYnHVG5O7EbS/2CXMiPvy/w65L1mP0KdkDUTgeOPurREY7trC8Bc38/srjBj r7r18EyNAPjBu5c3GDuDJ9xqMi26cV/a8YRDIudYCoRLtrqtIgtQBGJOoPDnanmpX2kz CKJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=IcHuru1KHM2W1bAxb0PnGSZxnffnVswf30cQrvvtrys=; b=TU4mwCqod2LODMuGy5HCjT8YiM+5ygvvg7YW1WO9/V8IgEbZQNzLzNgFDTAiZvYCQb vugXTzY9ctxCPJXIy6sXcTcwul7QCclZ0nTS3tRxf26PaGsbShzbkU5OI+9stgRRfm+S iUROa70ugZa+gIhPkvdnyvzcyxd6/HjQQiDgh5zFLKVuYts7N/yJkJfLEpeogrzg9hZI NHmkN7t1cuCFNvkEGUPOxrbeMH9H+zgib8eWb2cNfcu2AciVMuOxW6qj+NocGhjo3ClP u8FtAP6esrG9SBboBcVREt7BEMk+E2m2zyu33B3Sos55RBQcvmhGGpeU4CIwL9wfLL/e 6TNQ== X-Gm-Message-State: AA+aEWYnhAed8awwvnN5lQKfvL9Me95G2EpBUsjex8xy7826nhl4YjMT JmLsYccEreCG7SMLK4j8X3DD47LH X-Google-Smtp-Source: AFSGD/XdOj5hkXFcCLQ0T1zSIKLvwdOA8kAhv0NHM5pe+xB+xHsds3vilD3JNngFIohCx98ou9G2zg== X-Received: by 2002:adf:de91:: with SMTP id w17mr9520854wrl.320.1545007014751; Sun, 16 Dec 2018 16:36:54 -0800 (PST) Received: from Sting-Ray.optiplex-networks.com (optiplexnetworks.plus.com. [212.159.80.17]) by smtp.gmail.com with ESMTPSA id q9sm11585555wrp.0.2018.12.16.16.36.53 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 16 Dec 2018 16:36:54 -0800 (PST) Subject: Re: Upgrade to 12-Release system not booting kernel panic To: "freebsd-fs@freebsd.org >> freebsd-fs" References: <4a9526c1-2c46-eebe-b92d-d10e522d8941@gmail.com> From: Kaya Saman Message-ID: Date: Mon, 17 Dec 2018 00:36:53 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US-large X-Rspamd-Queue-Id: 5CC5C70B06 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Aa6gQqzb; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kayasaman@gmail.com designates 2a00:1450:4864:20::435 as permitted sender) smtp.mailfrom=kayasaman@gmail.com X-Spamd-Result: default: False [-4.31 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.71)[-0.708,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.59)[ipnet: 2a00:1450::/32(-1.54), asn: 15169(-1.33), country: US(-0.08)]; RCVD_IN_DNSWL_NONE(0.00)[5.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Dec 2018 00:36:57 -0000 On 12/17/18 12:01 AM, Warner Losh wrote: > Did you get a FreeBSD copyright notice before the crash? I don't recall as the screen went so fast. One thing I can say is that I managed to get the system up! :-) <- though I don't think it is stable :-( Basically it seems the kernel panic was from a setting(s) in /boot/loader.conf Using the installer img usb image in Live mode I commented out most of the modifications in there. I then proceeded to remove all my mechanical drives and left only the ssd's, then import the zroot and create a new cache file. After that the system managed to boot and I was able to continue with the upgrade. To get the pools back I installed the drives while operational (hot swap) and then did a zpool import on them. ....So far the system is up and functioning though after rebuilding @ports I need to reboot again to finish up the upgrade. This is something I am not too confident about doing as I do not wish to remove all my drives again then re-import the pools. Regards, Kaya > > Warner > > On Sun, Dec 16, 2018, 8:45 AM Kaya Saman wrote: > > Hi, > > > I've been digging around a little on this one and it seems that > there is > some ZFS wierdness going on. > > > My original install was an 11.2-RELEASE fresh install and upon an > upgrade to 12-RELEASE the system is having issues booting. > > > I have a ZFS root pool called zroot; by default this mounts at > zroot/ROOT/default and a few other non-root / bootable ZFS pools. > > > The system is a SuperMicro SC216 chassis with LSI non-RAID HBA. > > > I have the boot disks ada0 and ada1 plugged into the rear of the > chassis > and directly into the systemboard which is also a SuperMicro. These > drives are both Samsung SSD's. > > The 22 drive slots at the front of the chassis are occupied by the > other > various data pools. > > > So here is some strangeness... if I remove all 22 drives from the > front, > the system boots fine but straight after boot goes into kernel panic > mode and reboots before I can even look at the error or get to the > login > prompt. > > > With the non-root pools installed at the BTX loader after scanning > through all the bios drives I get a bunch of: > > read 264 from ... to 0x...., error 0x10 errors > > then: > > ZFS: i/o error - all block copies unavailable > > ZFS: can't read MOS of pool > > > after this the system simply hangs? > > > I have tried looking around but everything mentioning the MOS > error is > talking about the root pool, a particularly good reference is here: > http://freebsd.1045724.x6.nabble.com/ZFS-i-o-error-in-recent-12-0-td6245865.html > > > In fact I did try to boot with a USB stick and go into Live mode then > import all the pools on the system. This works without any issue! The > pools are fine the data is there everything looks normal. > > - I also rebuilt the zpool.cache according to the link just incase > there > was some kind of corruption there, however upon reboot I still get > the > same issue?? > > > Looking at a bug report with a kernel panic: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=220923#c17 > > > I have attempted to add: > > > kern.cam.scsi_delay="50000" > > kern.cam.boot_delay="50000" > > > into the /boot/loader.conf file but unfortunately the issue still > continues :-( > > > I wonder if there is a way to tell to tell the system to only look at > certain drives for booting?? > > > There is this line in my loader.conf: > > vfs.root.mountfrom="zfs:zroot" > > > It maybe the wrong hunch I have but it seems like the system is > looking > for "zroot" on all pools instead of the actual root pool hence the > above > errors?? > > > Would anyone be able to suggest anything or have any ideas about > how to > get the system back online and booting?? > > > Thanks. > > > Kaya > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to > "freebsd-fs-unsubscribe@freebsd.org > " >