From owner-freebsd-stable@freebsd.org Sun Oct 22 13:03:16 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF629E523C8 for ; Sun, 22 Oct 2017 13:03:16 +0000 (UTC) (envelope-from fbsd-lists@dudes.ch) Received: from mail.dudes.ch (mail.dudes.ch [193.73.211.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.dudes.ch", Issuer "StartCom Class 3 OV Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78B946550B for ; Sun, 22 Oct 2017 13:03:15 +0000 (UTC) (envelope-from fbsd-lists@dudes.ch) Received: from amd64.dudes.ch (amd64.dudes.ch [193.73.211.16]) (authenticated bits=0) by mail.dudes.ch (8.15.2/8.15.2) with ESMTPSA id v9MD34qG001382 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sun, 22 Oct 2017 15:03:04 +0200 (CEST) (envelope-from fbsd-lists@dudes.ch) Date: Sun, 22 Oct 2017 15:03:04 +0200 From: Markus Wild To: freebsd-stable@freebsd.org Subject: Re: System fails to boot with zfs root on nvme mirror when not using full disks Message-ID: <20171022150304.14d3a0c9@amd64.dudes.ch> In-Reply-To: <20171020165144.GC96120@in-addr.com> References: <20171020171345.073bd9b1@mwoffice.virtualtec.office> <20171020165144.GC96120@in-addr.com> X-Mailer: Claws Mail 3.15.1 (GTK+ 2.24.31; amd64-portbld-freebsd11.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.78 on 193.73.211.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Oct 2017 13:03:17 -0000 Hello Gary thanks for your input! > My suspicion is that you didn't make a backup of the new > /boot/zfs/zpool.cache > > From the USB live booted system, when you recreated the zpool you > likely changed parameters that live in the cache. You need to copy > that to the new boot pool or ZFS can get angry It's a possibility... new attempt from usb live system: gpart delete -i 3 nvd0 gpart delete -i 3 nvd1 gpart add -a 4k -s 50G -t freebsd-zfs -l zfs0 nvd0 gpart add -a 4k -s 50G -t freebsd-zfs -l zfs1 nvd1 sysctl vfs.zfs.min_auto_ashift=12 zpool create -m none -o cachefile=/var/tmp/zpool.cache zroot mirror /dev/gpt/zfs0 /dev/gpt/zfs1 zfs receive -Fud zroot < zroot.zfs zpool set bootfs=zroot/ROOT/default zroot mount -t zfs zroot/ROOT/default /mnt cp /var/tmp/zpool.cache /mnt/boot/zfs/zpool.cache umount /mnt reboot Unfortunately, this didn't change anything. I'm still getting the Trying to mount root from zfs:zroot/ROOT/default []... Mounting from zfs:zroot/ROOT/default failed with error 6. error :( Any other ideas....? Cheers, Markus