Date: Wed, 21 Oct 2020 16:18:43 -0400 (EDT) From: Walter Cramer <wfc@mintsol.com> To: Cassiano Peixoto <peixotocassiano@gmail.com> Cc: mike tancsa <mike@sentex.net>, freebsd-stable@freebsd.org Subject: Re: Zpool doesn't boot anymore after FreeBSD 12.1 Message-ID: <20201021160923.T14777@mulder.mintsol.com> In-Reply-To: <CAJajdNU9-pc9De0tDge=4HPaT1jc%2B7evfZSjCrcNMXqtSpDs2Q@mail.gmail.com> References: <CAJajdNWgiKyd1jmX4uPogWU4Ty=OiEgDnQGaoLZUWgj_pr9WKw@mail.gmail.com> <CAJajdNXPhGj-mKj6R_N94Bfnhvm=nHr3RwfBm4qoTB3g_=6kGw@mail.gmail.com> <CAJajdNV0nGdhAm6cgs2SKMBsY=Hi1Azb8fA_0PFrLUuejCT8ag@mail.gmail.com> <fea719f4-8918-38e6-7566-d77e9a244ef0@sentex.net> <CAJajdNU9-pc9De0tDge=4HPaT1jc%2B7evfZSjCrcNMXqtSpDs2Q@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
My guess - there is a work-around or two, but you'll face a lot more=20 grief, long-term, if you don't do things the right way (aka do a bunch of= =20 re-install work) now. I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to= =20 see how the original disk is partitioned. Then duplicate that=20 partitioning on da1 and da2. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa <mike@sentex.net> wrote: > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > ? Or is it perhaps trying to boot from da1 or da2 which does not have > boot info ? Generally its not recommended to use the entire disk as > part of a pool. Create a partition scheme first > > gpart create -s gpt da1 > > gpart add -t freebsd-zfs da1 > > then add da1p1 to the pool > > ---Mike > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassiano@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time wi= th > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zroot ONLINE 0 0 0 > >> gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zroot ONLINE 0 0 0 > >> gpt/disk0 ONLINE 0 0 0 > >> da1 ONLINE 0 0 0 > >> da2 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn=E2=80=99t boot anymore, i got the following error= : > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.or= g > " > > > _______________________________________________ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Oct 21 20:24:19 2020 Return-Path: <owner-freebsd-stable@freebsd.org> Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3FFDC42CAB8 for <freebsd-stable@mailman.nyi.freebsd.org>; Wed, 21 Oct 2020 20:24:19 +0000 (UTC) (envelope-from peixotocassiano@gmail.com) Received: from mail-ej1-x62b.google.com (mail-ej1-x62b.google.com [IPv6:2a00:1450:4864:20::62b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CGhmL1zt4z3VZh for <freebsd-stable@freebsd.org>; Wed, 21 Oct 2020 20:24:18 +0000 (UTC) (envelope-from peixotocassiano@gmail.com) Received: by mail-ej1-x62b.google.com with SMTP id t25so5055798ejd.13 for <freebsd-stable@freebsd.org>; Wed, 21 Oct 2020 13:24:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=bYM8uyZRxakBUD7crU0t4qRaO27VzD3XSrbRx5qtPmw=; b=fbRhC8/FRj9Kp43NdAFlTVFo2wXgOlrrXyT4/ozKLXN6tftacPBOP83zaI9r3YIZYV cHmP0YpWNj15yrygzMbZ7uaKMFGKARqE1tcXfzkG5RcQfcCEXuMEW4yinzALO7HD9j3J F2YZLkADiVu4lg0mwBUgaVfdi7RcvYxKIB/McxBFCcVyVNJ5/gWDJx78BRu667pag5Mm 8oO8XTS/SFIbiu5UrwUCjvHAzJzLYH2VMHazWJ0rZvSMbw7DY2sirRF6Ue1Ruzxe+4gY /s7HUKk0cWSemWSgjMdjJnptT72E0L/voFTFcuGSZ1hG7ZGz7A6Dshcvd0kczk6rQ0me /Rxg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bYM8uyZRxakBUD7crU0t4qRaO27VzD3XSrbRx5qtPmw=; b=TucRmzPV8+PpLahT4uiicIpIFhECsrSoxJky3ne6gJ4KTmVkb8bBCmet4/paW9nYd3 qe/JyK+Vg7Wt6mh640XtKHqRKJDH7yxw14Y1TYiqIGMN6rrE6ntfus8JpflXDcgM/aU2 0C6r2Qz9C5VfDmk50OitHmA8P/k1D00vQtGT7Oe3XfXAoDlpUwMmPE41/hwEfPUseYDB IL0rJpAheJcCKGKTL7Vj9OpoAjp2tsgSj06mRQDhRG7rugngbwvuvwtx03X9EWObv0GR 7AQ2PB88dwok1UKNnTYdYxBprBL5JC3EZR+/7qTpCR0k2r748f0pyQCQlIwRTfbWGKj8 rEUw== X-Gm-Message-State: AOAM532o8G/J8EHYFpvT79fkpWjv5toC9W4KmH5FFQB4oAsJOsqhXC4V Lkd5vtBEr1BGpfWc/LfHxflmFRrfxQMJdjnOxHU= X-Google-Smtp-Source: ABdhPJyIx7qGABQI/0vwTeEtDgVednbPYGdm318WgDOy/a+c86wxeCfLSwQhrdhYNaStZiiKb3hWa7rroP2I0uDIOBA= X-Received: by 2002:a17:906:9483:: with SMTP id t3mr5546135ejx.390.1603311856717; Wed, 21 Oct 2020 13:24:16 -0700 (PDT) MIME-Version: 1.0 References: <CAJajdNWgiKyd1jmX4uPogWU4Ty=OiEgDnQGaoLZUWgj_pr9WKw@mail.gmail.com> <CAJajdNXPhGj-mKj6R_N94Bfnhvm=nHr3RwfBm4qoTB3g_=6kGw@mail.gmail.com> <CAJajdNV0nGdhAm6cgs2SKMBsY=Hi1Azb8fA_0PFrLUuejCT8ag@mail.gmail.com> <fea719f4-8918-38e6-7566-d77e9a244ef0@sentex.net> <CAJajdNU9-pc9De0tDge=4HPaT1jc+7evfZSjCrcNMXqtSpDs2Q@mail.gmail.com> <20201021160923.T14777@mulder.mintsol.com> In-Reply-To: <20201021160923.T14777@mulder.mintsol.com> From: Cassiano Peixoto <peixotocassiano@gmail.com> Date: Wed, 21 Oct 2020 17:24:05 -0300 Message-ID: <CAJajdNU0fP7RVJuvZT7+uUTquRKSeRLVx9L7cBJ10XVJEZ5LOw@mail.gmail.com> Subject: Re: Zpool doesn't boot anymore after FreeBSD 12.1 To: Walter Cramer <wfc@mintsol.com> Cc: mike tancsa <mike@sentex.net>, freebsd-stable@freebsd.org X-Rspamd-Queue-Id: 4CGhmL1zt4z3VZh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=fbRhC8/F; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of peixotocassiano@gmail.com designates 2a00:1450:4864:20::62b as permitted sender) smtp.mailfrom=peixotocassiano@gmail.com X-Spamd-Result: default: False [-3.79 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.006]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.010]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62b:from]; NEURAL_HAM_SHORT(-0.77)[-0.774]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-stable>, <mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable/>; List-Post: <mailto:freebsd-stable@freebsd.org> List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-stable>, <mailto:freebsd-stable-request@freebsd.org?subject=subscribe> X-List-Received-Date: Wed, 21 Oct 2020 20:24:19 -0000 Walter, Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. But is there a way to make the partition of da1 and da2 since both are already inserted on pool? I think it's not allowed... Thanks. On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer <wfc@mintsol.com> wrote: > My guess - there is a work-around or two, but you'll face a lot more > grief, long-term, if you don't do things the right way (aka do a bunch of > re-install work) now. > > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to > see how the original disk is partitioned. Then duplicate that > partitioning on da1 and da2. > > -Walter > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > Hi guys, > > Thank your for your answer. > > @Ricchard First of all I didn't have a chance to run zpool upgrade, becau= se > after the system update reboot i ran into the issue. > > @Walter and @mike Regarding making a partition, I never see any > recommendation about this, I've been always using the entire disk on a po= ol > to expand it. Until FreeBSD 11.2 it worked fine. > > Is there a workaround for this or should I reinstall the entire pool? > > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa <mike@sentex.net> wrote: > > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 i= s > > ? Or is it perhaps trying to boot from da1 or da2 which does not have > > boot info ? Generally its not recommended to use the entire disk as > > part of a pool. Create a partition scheme first > > > > gpart create -s gpt da1 > > > > gpart add -t freebsd-zfs da1 > > > > then add da1p1 to the pool > > > > ---Mike > > > > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > > Hi there, > > > > > > Anyone can help please? I've many servers with this same issue. Thank= s > > > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > > peixotocassiano@gmail.com> > > > wrote: > > > > > >> Hi there, > > >> > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > > added two more disks to expand my pool. BTW I already did it many time > with > > no issues. > > >> > > >> I ran: > > >> > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> status: Some supported features are not enabled on the pool. The poo= l > > can > > >> still be used, but some features are unavailable. > > >> action: Enable all features using 'zpool upgrade'. Once this is done= , > > >> the pool may no longer be accessible by software that does not > > support > > >> the features. See zpool-features(7) for details. > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zroot ONLINE 0 0 0 > > >> gpt/disk0 ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> > > >> # zpool add -f zroot da1 > > >> # zpool add -f zroot da2 > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zroot ONLINE 0 0 0 > > >> gpt/disk0 ONLINE 0 0 0 > > >> da1 ONLINE 0 0 0 > > >> da2 ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> # reboot > > >> > > >> Then my system doesn=E2=80=99t boot anymore, i got the following err= or: > > >> > > >> gptzfsboot: error 4 lba 2038346899 > > >> gptzfsboot: error 4 lba 1361327267 > > >> /boot/config: -Dh > > >> > > >> BTX loader 1.00 BTX version is 1.02 > > >> Consoles: internal video/keyboard serial port > > >> BIOS drive A: is fd0 > > >> BIOS drive C: is disk0 > > >> BIOS drive D: is disk1 > > >> BIOS drive E: is disk2 > > >> BIOS drive F: is disk3 > > >> BIOS drive G: is disk4 > > >> BIOS drive H: is disk5 > > >> ZFS: i/o error - all block copies unavailable > > >> ZFS: failed to read pool zroot directory object > > >> BIOS 638kB/3143616kB available memory > > >> > > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > > >> > > >> Type '?' for list of commands, 'help' for more datailed help. > > >> OK > > >> > > >> I can import my pool with no problems using the lived, but I could n= ot > > fix it. > > >> > > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok tha= t? > > >> > > >> Thanks. > > >> > > >> > > >> > > >> > > > _______________________________________________ > > > freebsd-stable@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > > To unsubscribe, send any mail to " > freebsd-stable-unsubscribe@freebsd.org > > " > > > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20201021160923.T14777>