From owner-freebsd-stable@freebsd.org Fri Jul 19 18:21:04 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 77AD6A8C69 for ; Fri, 19 Jul 2019 18:21:04 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (khavrinen.csail.mit.edu [IPv6:2603:400a:0:7ec::801e:1c14]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "khavrinen.csail.mit.edu", Issuer "Client CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7129D80B06 for ; Fri, 19 Jul 2019 18:21:03 +0000 (UTC) (envelope-from wollman@khavrinen.csail.mit.edu) Received: from khavrinen.csail.mit.edu (localhost [127.0.0.1]) by khavrinen.csail.mit.edu (8.15.2/8.15.2) with ESMTPS id x6JIL2JI028126 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL CN=khavrinen.csail.mit.edu issuer=Client+20CA) for ; Fri, 19 Jul 2019 14:21:02 -0400 (EDT) (envelope-from wollman@khavrinen.csail.mit.edu) Received: (from wollman@localhost) by khavrinen.csail.mit.edu (8.15.2/8.15.2/Submit) id x6JIL1ql028125; Fri, 19 Jul 2019 14:21:01 -0400 (EDT) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <23858.2573.932364.128957@khavrinen.csail.mit.edu> Date: Fri, 19 Jul 2019 14:21:01 -0400 From: Garrett Wollman To: freebsd-stable@freebsd.org Subject: ZFS root mount regression X-Mailer: VM 8.2.0b under 26.2 (amd64-portbld-freebsd11.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (khavrinen.csail.mit.edu [127.0.0.1]); Fri, 19 Jul 2019 14:21:02 -0400 (EDT) X-Rspamd-Queue-Id: 7129D80B06 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=csail.mit.edu; spf=pass (mx1.freebsd.org: domain of wollman@khavrinen.csail.mit.edu designates 2603:400a:0:7ec::801e:1c14 as permitted sender) smtp.mailfrom=wollman@khavrinen.csail.mit.edu X-Spamd-Result: default: False [-3.03 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[khavrinen.csail.mit.edu,incoming.csail.mit.edu]; DMARC_POLICY_ALLOW(-0.50)[csail.mit.edu,none]; NEURAL_HAM_SHORT(-0.26)[-0.258,0]; IP_SCORE(-0.26)[ipnet: 2000::/3(-0.84), asn: 12874(-0.49), country: IT(0.03)]; FORGED_SENDER(0.30)[wollman@csail.mit.edu,wollman@khavrinen.csail.mit.edu]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12874, ipnet:2000::/3, country:IT]; FROM_NEQ_ENVFROM(0.00)[wollman@csail.mit.edu, wollman@khavrinen.csail.mit.edu] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jul 2019 18:21:04 -0000 I recently upgraded several file servers from 11.2 to 11.3. All of them boot from a ZFS pool called "tank" (the data is in a different pool). In a couple of instances (which caused me to have to take a late-evening 140-mile drive to the remote data center where they are located), the servers crashed at the root mount phase. In one case, it bailed out with error 5 (I believe that's [EIO]) to the usual mountroot prompt. In the second case, the kernel panicked instead. The root cause (no pun intended) on both servers was a disk which was supplied by the vendor with a label on it that claimed to be part of the "tank" pool, and for some reason the 11.3 kernel was trying to mount that (faulted) pool rather than the real one. The disks and pool configuration were unchanged from 11.2 (and probably 11.1 as well) so I am puzzled. Other than laboriously running "zpool labelclear -f /dev/somedisk" for every piece of media that comes into my hands, is there anything else I could have done to avoid this? -GAWollman