From owner-freebsd-fs@freebsd.org Mon Nov 11 13:10:27 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F0D021B52D8 for ; Mon, 11 Nov 2019 13:10:27 +0000 (UTC) (envelope-from jonathan.anderson@mun.ca) Received: from esa05.ucs.mun.ca (esa05.ucs.mun.ca [134.153.136.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx.mun.ca", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47BWSy5xNkz48yj for ; Mon, 11 Nov 2019 13:10:26 +0000 (UTC) (envelope-from jonathan.anderson@mun.ca) IronPort-SDR: 6f1wh/pUol9DWKL749j/O9j6UydF8emT8a971OCKp+ca4YGcff/c4R3BC3GJBNizQDbwkWUEw9 sNqwKTpDc1z0gtriWXoRlFDC0fRqHEPsdCcs6ZSPdEbo8LvFtyrxlbSrsKlTRPWxt1rHxFRvOB 0V1vpxLjHu2xhNYjxL2QkjTkeUIfS2ZawYJafLZXOkz3n6cDZGLp7G0HXXrRqkp/p6MLFMBsw3 f6gzIUUMqXJEb7HuDNfd9egZzsg+Q+eyKDm4hsVrbPlxB5D2lZuXVtbTokTIGp52T6EphNrfOi pP8= X-IronPort-AV: E=Sophos;i="5.68,293,1569292200"; d="scan'208";a="20838968" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from mail-qt1-f200.google.com ([209.85.160.200]) by smtp05.ucs.mun.ca with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 11 Nov 2019 09:40:25 -0430 Received: by mail-qt1-f200.google.com with SMTP id h15so17530381qtn.6 for ; Mon, 11 Nov 2019 05:10:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=0Wp2NKhPhrtNRj3l0d4tzQ/VSgqNvETAjIa8c/B9JNA=; b=KBc1oniNAusupiT2SX4oPHhoTojXn5AED8NcTot5Jh90br7MfLyxkuYXA8Q2T9SHos 3rv4KRthcVbC8lJoG8oXE/N7uEo+cnpMUAn52kXK++oaeSP5lq9BQJO3l4ATCY5/CSoM 7p31K43DzQleFugPaNZcKthjnj/oAKwDQHxiNO6FSe6URVDrg5ssUJcVUSvEcjEmaqX/ AezBx9cTChw5x4dOU/C4koDRtsFLzWcKZWCKz2DJPF/WDSmHFZY7GDXlTEsNlnT+DCVi hc3kb07z+Sa/zO+9o46vw1VUZoDbFzKUdERDnCbwFXNZD5+Ms7OvTSaOY7hmALYjlBUf QGhQ== X-Gm-Message-State: APjAAAVKJ3B6ygdanwkgYlxN3erDCzIN1NT0L3P1wm36NlCdZ7wT2ZRj +TjmliYUuSqbkSwT6Ep/VSoJsLiYHmG6uloIGINC7S17U1Wi5pYKg1rFyLFNPyENWYvNjwqGNrk LT2eMsDiYyCjfRGbx X-Received: by 2002:a05:6214:484:: with SMTP id ay4mr23326859qvb.35.1573477824336; Mon, 11 Nov 2019 05:10:24 -0800 (PST) X-Google-Smtp-Source: APXvYqzya1XtFK35M92eIopEzOlOEVQpCD36v/qRPGaZnDpmYiEIcuduzRUFzptsxldzJgEHucBUAw== X-Received: by 2002:a05:6214:484:: with SMTP id ay4mr23326831qvb.35.1573477823917; Mon, 11 Nov 2019 05:10:23 -0800 (PST) Received: from bagstock.jonandchrissy.ca (CPE00fc8db75533-CM00fc8db75530.cpe.net.cable.rogers.com. [174.117.179.42]) by smtp.gmail.com with ESMTPSA id v20sm6685887qkg.92.2019.11.11.05.10.23 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 11 Nov 2019 05:10:23 -0800 (PST) Date: Mon, 11 Nov 2019 09:40:21 -0330 From: Jonathan Anderson To: Andriy Gapon Cc: "freebsd-fs@FreeBSD.org" Subject: Re: Broken ZFS boot on upgrade Message-ID: <20191111131021.GC70914@bagstock.jonandchrissy.ca> References: <1cb4895b-c84d-6204-18fa-53eac7195ad6@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1cb4895b-c84d-6204-18fa-53eac7195ad6@FreeBSD.org> User-Agent: Mutt/1.12.2 (2019-09-21) X-Rspamd-Queue-Id: 47BWSy5xNkz48yj X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jonathan.anderson@mun.ca has no SPF policy when checking 134.153.136.25) smtp.mailfrom=jonathan.anderson@mun.ca X-Spamd-Result: default: False [-1.26 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.993,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[mun.ca]; AUTH_NA(1.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[25.136.153.134.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6579, ipnet:134.153.0.0/16, country:CA]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.17)[ipnet: 134.153.0.0/16(-0.41), asn: 6579(-0.33), country: CA(-0.09)] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Nov 2019 13:10:28 -0000 On 11/11, Andriy Gapon wrote: > Could it be that you have 2TB+ disk(s) and a relatively old BIOS ? The first two vdevs use 1 TiB disks, but the third vdev has 3 TiB disks, so that sounds like a possible explanation... perhaps the contents of /boot previously resided on one of the 1 TiB vdevs but the new /boot lives on the new vdev post-upgrade. Is there a zfs admin command to ask which vdev(s) a file or directory's blocks reside on? My BIOS is from 2016, so not "old", but possibly old enough? Thank you, Jon -- Jonathan Anderson jonathan@FreeBSD.org