From owner-freebsd-fs@freebsd.org Mon Nov 11 12:51:41 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED7CA1B4DDF for ; Mon, 11 Nov 2019 12:51:41 +0000 (UTC) (envelope-from jonathan.anderson@mun.ca) Received: from esa02.ucs.mun.ca (esa02.ucs.mun.ca [134.153.136.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx.mun.ca", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47BW3J630Cz48Gw for ; Mon, 11 Nov 2019 12:51:40 +0000 (UTC) (envelope-from jonathan.anderson@mun.ca) IronPort-SDR: qm9oHfbgUhjEpLT08UU2T8iP/iFaPAxgrIq5s5BbznlCrwROivQkLV2fYGgd0U6xLBAW9prT9f 6Cwj9tBkZWZygavy7ZnJUhXhVSDt1PR68eLoeI9YHalzV+ORXaa3ft3pxRDU0C/lQNQZkp0VF3 Rs05Kc3HshPvCBhA7/rvuPYXo/adeljJCtECX3zTwc8o1nu8rVQLZuI96twNMh83pISVWGYl94 CTmdb7JVsERUnMPSt2C17an9VwZoik/v9JQyo7WVZE2XTcLOjY4Hu2QiGEtRcIeWPRrqnsoXmZ 7hc= X-IronPort-AV: E=Sophos;i="5.68,293,1569292200"; d="scan'208";a="21054937" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from mail-qt1-f199.google.com ([209.85.160.199]) by smtp02.ucs.mun.ca with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Nov 2019 09:21:40 -0430 Received: by mail-qt1-f199.google.com with SMTP id v92so17445317qtd.18 for ; Mon, 11 Nov 2019 04:51:39 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=JIfgPkKWoThaP8m1oVu8LIP0/N4HHJTyiR/bKuSi5I4=; b=YaCmh8V7y1/E9Wsdw8LUifog0BDuhr9TFIXu+fC4wv/dsakKWvNFk86TeTZ/oP89Ly cRwDvxsB+KVKdyvqtuDlZ2vRGJTkUm3lAYlOOH/v9iF5ywgZODXu9hFazaVlrDloc20M 6oVl3NebqU7SUMxHrjMLuc59ydF8YEFCUnR408DIybNuOL3O/mwxsRFsilOqVOBiTGVS 9j12On5uMw24ZsXosd6hmCLQyVeMvZL6NyozkSTzrs3mR/pSvmdzg4ymIAyMRT4/ZHOi 4AoL+sp33LJjmBYVHsq23nNLA4Kaa3/HzxWTL8twShd8VFvlUWOPUT4ZjQaTcrrjnvwM wGkg== X-Gm-Message-State: APjAAAUEhT5kvOjYsDttUZ6ODMxQjx/HUGq1C0iSeqnuOnQ58+thQONX fobSljczGVg/23J5kYA/6GMM44Sl8nX0jyptALC42P2bVqr98JLpM+WMTRvMTTMnxBRRhlSWY+N KHE+8PTFGVEXHaJJG X-Received: by 2002:a0c:ee41:: with SMTP id m1mr9230986qvs.201.1573476698459; Mon, 11 Nov 2019 04:51:38 -0800 (PST) X-Google-Smtp-Source: APXvYqzem9TawvkFtV6Uzm2qpj4uCbD6yv7Shse6vqnDyY3SqkjrMgZlcMhAb4Qa3V5hmWF4Q3sbyA== X-Received: by 2002:a0c:ee41:: with SMTP id m1mr9230957qvs.201.1573476697944; Mon, 11 Nov 2019 04:51:37 -0800 (PST) Received: from bagstock.jonandchrissy.ca (CPE00fc8db75533-CM00fc8db75530.cpe.net.cable.rogers.com. [174.117.179.42]) by smtp.gmail.com with ESMTPSA id u18sm11327822qth.20.2019.11.11.04.51.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 11 Nov 2019 04:51:37 -0800 (PST) Date: Mon, 11 Nov 2019 09:21:35 -0330 From: Jonathan Anderson To: "Kevin P. Neal" Cc: "freebsd-fs@FreeBSD.org" Subject: Re: Broken ZFS boot on upgrade Message-ID: <20191111125135.GA70914@bagstock.jonandchrissy.ca> References: <20191111021326.GA61162@neutralgood.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20191111021326.GA61162@neutralgood.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-Rspamd-Queue-Id: 47BW3J630Cz48Gw X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jonathan.anderson@mun.ca has no SPF policy when checking 134.153.136.22) smtp.mailfrom=jonathan.anderson@mun.ca X-Spamd-Result: default: False [-1.26 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.992,0]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[mun.ca]; AUTH_NA(1.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[22.136.153.134.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6579, ipnet:134.153.0.0/16, country:CA]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.17)[ipnet: 134.153.0.0/16(-0.43), asn: 6579(-0.34), country: CA(-0.09)] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Nov 2019 12:51:42 -0000 On 11/10, Kevin P. Neal wrote: > Do you have snapshots? If you have a snapshot from before you upgraded > then you can roll back the upgrade. That's another way to get you back > to a bootable system. I do have snapshots, though mightn't the effectiveness of a rollback depend on the reason for the failure? For example, if the issue is the 2+ TB thing, mightn't new blocks created by the rollback also end up on the large, not-visible-to-BIOS disks? > If this is the case then can you remove disks one at a time and replace > them with GPT-partitioned disks? If you are using mirrors then this may > work if the smallest partition/disk currently in use per-vdev is no larger > than a disk that has been partitioned. Hmmmm... I think that, unfortunately, the mirrors are mostly exactly the same size (four 1 TiB and two 3 TiB), so there isn't any slack for resizing. > Sensible? Mmmmmm... I would say that multiple ZFS partitions on a single > disk is something to be avoided if possible. There may be cases where it > can't be avoided, but it's not the best. Multiple partitions on a disk in > the _same_ _pool_ sounds just plain bad and I wouldn't do it. Ok, thanks! Jon -- Jonathan Anderson jonathan@FreeBSD.org