From owner-freebsd-stable@freebsd.org Fri Jul 10 18:29:13 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1174E370433 for ; Fri, 10 Jul 2020 18:29:13 +0000 (UTC) (envelope-from guido@gvr.org) Received: from gvr.gvr.org (gvr.gvr.org [62.251.117.91]) (using TLSv1.2 with cipher DHE-RSA-CAMELLIA256-SHA256 (256/256 bits)) (Client CN "gvr.gvr.org", Issuer "Gandi Standard SSL CA 2" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B3M53392cz3Trb; Fri, 10 Jul 2020 18:29:11 +0000 (UTC) (envelope-from guido@gvr.org) Received: from gvr.gvr.org (localhost [127.0.0.1]) by gvr.gvr.org (Postfix) with ESMTP id 434DD68503; Fri, 10 Jul 2020 20:29:04 +0200 (CEST) X-Virus-Scanned: amavisd-new at gvr.org Received: from gvr.gvr.org ([127.0.0.1]) by gvr.gvr.org (gvr.gvr.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id pC1ywBp_oAph; Fri, 10 Jul 2020 20:29:04 +0200 (CEST) Received: by gvr.gvr.org (Postfix, from userid 657) id E745668500; Fri, 10 Jul 2020 20:29:03 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gvr.org; s=20190204; t=1594405743; bh=W3qooh4NPYXBtpr3Y1zElYNlUuBH3M+N8Q+No4x/Dcs=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=qeydHRtRrsbxNeo6m8CAan7f1LvqPGYe6Ozzv+5PSQJtkjnK8OhtoZPOAUlnCmECP M6P747SWbTrW8uNypeXq2zEvH9/1tfLaMS+svKIxS/LQ27fHI87wDhpSO9y1ivad5d zYYBjx8yAxPlBYw3Af9qaG9TClaRijvAfT15UTfkBqv9yKy9rMP0wb6m98mKM/Vkg2 6v3q6lvpz458wcBl2vUYahPBxEHIGT12tVT6xj3i6Sec4tCjgPBVaQliHZKABwuCmo OayBZOPQsZD7yLmxnEyPhG1p2I4TJBKKlyAAGE+TbPFWUmnSSlTW6GB8xYEwljYW0t g+xWoJuq5CTew== Date: Fri, 10 Jul 2020 20:29:03 +0200 From: Guido van Rooij To: Kyle Evans Cc: FreeBSD-STABLE Mailing List Subject: Re: 12.1p7 no longer boots after doing zpool upgrade -a Message-ID: <20200710182903.GA7412@gvr.gvr.org> References: <20200709131201.GA3464@co.gvr.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4B3M53392cz3Trb X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gvr.org header.s=20190204 header.b=qeydHRtR; dmarc=none; spf=pass (mx1.freebsd.org: domain of guido@gvr.org designates 62.251.117.91 as permitted sender) smtp.mailfrom=guido@gvr.org X-Spamd-Result: default: False [-3.02 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.009]; R_DKIM_ALLOW(-0.20)[gvr.org:s=20190204]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[gvr.org]; NEURAL_HAM_LONG(-1.02)[-1.018]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gvr.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.49)[-0.491]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3265, ipnet:62.251.0.0/17, country:NL] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jul 2020 18:29:13 -0000 On Thu, Jul 09, 2020 at 08:24:54AM -0500, Kyle Evans wrote: > On Thu, Jul 9, 2020 at 8:12 AM Guido van Rooij wrote: > > > > I did a zpool upgrade -a to enable large_dnode and spacemap_v2. > > After that, I did: > > gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 2 ada0 > > gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 2 ada1 > > and: > > gpart bootcode -p /boot/boot1.efifat -i 1 ada0 > > gpart bootcode -p /boot/boot1.efifat -i 1 ada1 > > > > Now the system no longer boots from either disk and drops to the efi shell. > > This method of updating the ESP is no longer recommended for new 12.x > installations -- we now more carefully construct the ESP with an > /EFI/FreeBSD/loader.efi where loader.efi is /boot/loader.efi. You will > want to rebuild this as such, and that may fix part of your problem. Hi Kyle, Thnaks for your asnwer. I have not got it to work with that configuration. What did work was to replace the /efi/boot/BOOTx64.efi with loader.efi and and change the content of startup.nsh with loader.efi. Withoyt the above answer I wouldn't have figure it out that quickly so thanks! I will investigate further once I have more time (early next week probably). > > > From memory, the partitions on ada0 and ada1 are as folows: > > > > 1 efi > > 2 freebsd-boot > > 3 freebsd-swap > > 4 freebsd > > p4 is a geli partition with zfs in it. > > ada0p4.eli and ada1p4.eli form a mirrored zpool (called zroot).. > > > > The boot process no longer asks for a GELi password. It just isues > > a no zfs pools found. > > > > When I boot from a stick, it does ask for the GELi password. When > > I set currdev correctly in the loader, I am able to load the kernel, > > opensolaris.ko and zfs.ko. However booting failed because I get an > > Error: Solaris: NOTICE: Cannot find the pool label for 'zroot' > > > > Was vfs.root.mountfrom set correctly? My completely uneducated guess > is that it likely wasn't and we couldn't locate the zpool.cache -- the > value of vfs.root.mountfrom should basically match the currdev format > here, except without a trailing colon. I did not set this sysctl so most likely that was the cause. As the system is up and running again I didn't test it. Let me know if you want me to. -Guido