From owner-freebsd-stable@FreeBSD.ORG Thu Dec 4 00:46:01 2014 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 741D5231 for ; Thu, 4 Dec 2014 00:46:01 +0000 (UTC) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1A5E78D1 for ; Thu, 4 Dec 2014 00:46:00 +0000 (UTC) Received: by mail-wi0-f182.google.com with SMTP id h11so26271127wiw.15 for ; Wed, 03 Dec 2014 16:45:59 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=OmWAN4AfmVHafPDlLzYCMhBghzGUnSO49zmpoqzB3MY=; b=OtsiDXD9msWujBY4ty3in1T+nkCkf9OK12Y5u0vjiyXDLnhR2on/uY9iL3iQAbiajq nKvOmgrRMCdmg7neEW1bQeyzfeSK4m2kBRt6qz5uYZIqzQnKCZlXTOmlUNMxKld30X0P 70bqGysz1eYuD6OMO2g2gGzIXsSKdme6NXrVl/GNobfw8T4wPR3dCaVEkDCSz/aNiafo wCmu7VJznXw12BihNPKt4qAiXsN1QPBVni4rvwQLCVy0E1kyv2CkPK21Ed78h2L4OqLq VlZzl3TCyGOAm8aNkeeW3eKDS4CJv3WLfAUZK2uB2D87KmeAcuj5Rs+Iiug1QfEqvEeV J+hg== X-Gm-Message-State: ALoCoQnOxpg/Ca2ZA5sGqjXdeQ91An8kiI23ot7ihmSBhodPMZRvxLIoB0AET5Mt40ss1yXE+NR5 X-Received: by 10.194.175.69 with SMTP id by5mr11408880wjc.32.1417653958963; Wed, 03 Dec 2014 16:45:58 -0800 (PST) Received: from [10.10.1.68] (82-69-141-170.dsl.in-addr.zen.co.uk. [82.69.141.170]) by mx.google.com with ESMTPSA id t10sm34953040wix.15.2014.12.03.16.45.57 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 03 Dec 2014 16:45:58 -0800 (PST) Message-ID: <547FAF3C.5080002@multiplay.co.uk> Date: Thu, 04 Dec 2014 00:47:56 +0000 From: Steven Hartland User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Michael Schmiedgen , freebsd-stable@freebsd.org Subject: Re: ZFS 'mount error 5' hits production server References: <547F6E54.5020706@takwa.de> <547F98AF.9070701@multiplay.co.uk> <547FA5A9.1010600@gmx.net> In-Reply-To: <547FA5A9.1010600@gmx.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Dec 2014 00:46:01 -0000 Unfortunately error 5 isn't very helpful as that's just EIO :( When booted from the old kernel try moving out the cache file e.g. mv /boot/zfs/zpool.cache /boot/zfs/zpool.cache.old If for some reason your cache file and your disks are out of sync that might help. Also ensure your loading zfs in /etc/rc.conf zfs_enable="YES" Check you don't have anything zfs custom in /boot/loader.conf You should just have the two zfs related lines such as: zfs_load="YES" vfs.root.mountfrom="zfs:tank/root" Your pool layout does look a little odd from your zpool get all as bootfs seems to be set to just "tank" is that correct as its quite none standard? If not and your root is tank/root then that might also be your issue. Next up there should be no need for mountpoint legacy / should do just fine. If you do have a single partition install you might want to consider switching to something more standard which looks something like: NAME USED AVAIL REFER MOUNTPOINT tank 853G 292G 46.5K none tank/root 21.6G 292G 21.3G / tank/root/tmp 11.2M 292G 11.2M /tmp tank/root/var 270M 292G 270M /var Oh and ensure your boot loader has been updated: gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada1 Hope this helps. Regards Steve On 04/12/2014 00:07, Michael Schmiedgen wrote: > On 12/04/2014 00:11, Steven Hartland wrote: >> Have you been able to boot from rescue / mfsroot cd? > > I got remote console via KVM and booted kernel.old > from loader prompt. Everythins is fine with old 10.0 > kernel. Finished upgrading by installing 10.1 userland > did not help either. > > Thanks, > Michael > >> On 03/12/2014 20:11, Michael Schmiedgen wrote: >>> Hi list, >>> >>> today I upgraded one of our servers from 10.0 to 10.1 with >>> freebsd-update. GENERIC kernel, ZFS 2-way mirror, GPT, nothing >>> special. After booting kernel, when trying to mount the >>> root file system I get: 'cannot mount, error 5' or something. >>> >>> Strangely I got this error a few weeks ago at home, running >>> CURRENT with custom kernel: >>> https://lists.freebsd.org/pipermail/freebsd-current/2014-October/052900.html >>> >>> >>> >>> I created the pools and datasets manually via console. Has >>> anything changed? With legacy mountpoint, or that one needs a >>> boot dataset, or something? >>> >>> Thanks, >>> Michael >>> >>> >>> Configuration is: >>> >>> gpart show: >>> >>> => 34 5860533101 ada0 GPT (2.7T) >>> 34 256 1 freebsd-boot (128K) >>> 290 6 - free - (3.0K) >>> 296 8388608 2 freebsd-swap (4.0G) >>> 8388904 5662310400 3 freebsd-zfs (2.6T) >>> 5670699304 189833831 - free - (91G) >>> >>> => 34 5860533101 ada1 GPT (2.7T) >>> 34 256 1 freebsd-boot (128K) >>> 290 6 - free - (3.0K) >>> 296 8388608 2 freebsd-swap (4.0G) >>> 8388904 5662310400 3 freebsd-zfs (2.6T) >>> 5670699304 189833831 - free - (91G) >>> >>> >>> zpool status: >>> >>> NAME PROPERTY VALUE SOURCE >>> tank size 2.62T - >>> tank capacity 3% - >>> tank altroot - default >>> tank health ONLINE - >>> tank guid XXX default >>> tank version - default >>> tank bootfs tank local >>> tank delegation on default >>> tank autoreplace off default >>> tank cachefile - default >>> tank failmode wait default >>> tank listsnapshots off default >>> tank autoexpand off default >>> tank dedupditto 0 default >>> tank dedupratio 1.00x - >>> tank free 2.53T - >>> tank allocated 99.0G - >>> tank readonly off - >>> tank comment - default >>> tank expandsize 0 - >>> tank freeing 0 default >>> tank fragmentation 0% default >>> tank leaked 0 default >>> tank feature@async_destroy enabled local >>> tank feature@empty_bpobj active local >>> tank feature@lz4_compress enabled local >>> tank feature@multi_vdev_crash_dump enabled local >>> tank feature@spacemap_histogram disabled local >>> tank feature@enabled_txg disabled local >>> tank feature@hole_birth disabled local >>> tank feature@extensible_dataset disabled local >>> tank feature@embedded_data disabled local >>> tank feature@bookmarks disabled local >>> tank feature@filesystem_limits disabled local >>> >>> >>> zfs get all tank: >>> >>> NAME PROPERTY VALUE SOURCE >>> tank type filesystem - >>> tank creation Aug 2012 - >>> tank used 98.9G - >>> tank available 2.49T - >>> tank referenced 8.34G - >>> tank compressratio 1.00x - >>> tank mounted yes - >>> tank quota none default >>> tank reservation none default >>> tank recordsize 128K default >>> tank mountpoint legacy local >>> tank sharenfs off default >>> tank checksum on default >>> tank compression off default >>> tank atime off local >>> tank devices on default >>> tank exec on default >>> tank setuid on default >>> tank readonly off default >>> tank jailed off default >>> tank snapdir hidden default >>> tank aclmode discard default >>> tank aclinherit restricted default >>> tank canmount on default >>> tank xattr off temporary >>> tank copies 1 default >>> tank version 5 - >>> tank utf8only off - >>> tank normalization none - >>> tank casesensitivity sensitive - >>> tank vscan off default >>> tank nbmand off default >>> tank sharesmb off default >>> tank refquota none default >>> tank refreservation none default >>> tank primarycache all default >>> tank secondarycache all default >>> tank usedbysnapshots 4.53G - >>> tank usedbydataset 8.34G - >>> tank usedbychildren 86.1G - >>> tank usedbyrefreservation 0 - >>> tank logbias latency default >>> tank dedup off default >>> tank mlslabel - >>> tank sync standard default >>> tank refcompressratio 1.00x - >>> tank written 3.10G - >>> tank logicalused 91.7G - >>> tank logicalreferenced 6.71G - >>> tank volmode default default >>> tank filesystem_limit none default >>> tank snapshot_limit none default >>> tank filesystem_count none default >>> tank snapshot_count none default >>> tank redundant_metadata all default >