From owner-freebsd-stable@freebsd.org Mon Mar 13 12:06:51 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8D90CCCC83C for ; Mon, 13 Mar 2017 12:06:51 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7AF7F131C for ; Mon, 13 Mar 2017 12:06:51 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: by mailman.ysv.freebsd.org (Postfix) id 77485CCC83A; Mon, 13 Mar 2017 12:06:51 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76EC6CCC838 for ; Mon, 13 Mar 2017 12:06:51 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47C20131B for ; Mon, 13 Mar 2017 12:06:50 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from dilbert.london-internal.ingresso.co.uk ([10.64.50.6] helo=dilbert.ingresso.co.uk) by constantine.ingresso.co.uk with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.88 (FreeBSD)) (envelope-from ) id 1cnOkS-000EBX-L3 for stable@freebsd.org; Mon, 13 Mar 2017 12:06:48 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.88 (FreeBSD)) (envelope-from ) id 1cnOkS-0000oL-Ia for stable@freebsd.org; Mon, 13 Mar 2017 12:06:48 +0000 To: stable@freebsd.org Subject: moutnroot failing on zpools in Azure after upgrade from 10 to 11 due to lack of waiting for da0 Message-Id: From: Pete French Date: Mon, 13 Mar 2017 12:06:48 +0000 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Mar 2017 12:06:51 -0000 I have a number of machines in Azure, all booting from ZFS and, until the weekend, running 10.3 perfectly happily. I started upgrading these to 11. The first went fine, the second would not boot. Looking at the boot diagnistics it is having problems finding the root pool to mount. I see this is the diagnostic output: storvsc0: on vmbus0 Solaris: NOTICE: Cannot find the pool label for 'rpool' Mounting from zfs:rpool/ROOT/default failed with error 5. Root mount waiting for: storvsc (probe0:blkvsc0:0:storvsc1: 0:0): on vmbus0 storvsc scsi_status = 2 (da0:blkvsc0:0:0:0): UNMAPPED (probe1:blkvsc1:0:1:0): storvsc scsi_status = 2 hvheartbeat0: on vmbus0 da0 at blkvsc0 bus 0 scbus2 target 0 lun 0 As you can see, the drive da0 only appears after it has tried, and failed, to mount the root pool. Normally I would just stick in a big 'vfs.mountroot.timeout' but that variable doesnt not appear to exist under 11 - or at least it doesnt show up in sysctl. I have one machine which boots fine. I can take the drive of this machine, clone it, and attach to a new VM, and that VM fails to boot! Am now a bit scared to reboot that virtual machine in case it doesnt come back. Can anyone offer any suggestions ? Just being able to delay the mount might be enough if there is a variable which can do that. I do rather need to get these machines back online.... thanks, -pete.