From owner-freebsd-stable@FreeBSD.ORG Thu Dec 12 13:32:07 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AC80D9F4 for ; Thu, 12 Dec 2013 13:32:07 +0000 (UTC) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [128.127.144.4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 232E111EA for ; Thu, 12 Dec 2013 13:32:05 +0000 (UTC) Received: from bsdrookie.norma.com. (bsdrookie.norma.com [192.168.7.71]) by elf.hq.norma.perm.ru (8.14.5/8.14.5) with ESMTP id rBCDVhFn030846 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Thu, 12 Dec 2013 19:31:43 +0600 (YEKT) (envelope-from emz@norma.perm.ru) Message-ID: <52A9BABF.6060403@norma.perm.ru> Date: Thu, 12 Dec 2013 19:31:43 +0600 From: "Eugene M. Zheganin" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130709 Thunderbird/17.0.6 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Subject: Re: zfs i/o error - all block copies unavailable References: <52A8C5AF.1000800@norma.perm.ru> <52A99894.4080704@FreeBSD.org> In-Reply-To: <52A99894.4080704@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (elf.hq.norma.perm.ru [192.168.3.10]); Thu, 12 Dec 2013 19:31:43 +0600 (YEKT) X-Spam-Status: No hits=-101.0 bayes=0.5 testhits ALL_TRUSTED=-1, USER_IN_WHITELIST=-100 autolearn=unavailable version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on elf.hq.norma.perm.ru X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Dec 2013 13:32:07 -0000 Hi. On 12.12.2013 17:05, Andriy Gapon wrote: > > A few words about your pool configuration and the disks that it is comprised of... > It was created under 8.2-STABLE, still not upgraded. Now it's running on one disk (I keep another as a cold backup, just in case). It has a separated log device (addition or removal doesn't affect the error message - I tried that). Disks: diskid/DISK-MK0311YHG8W4EA is ada2, got this strange id while importing pool on different machines and different FreeBSd versions. ada1 is a blank disk, waiting to attach and resilver. ada0 is a separate log device. BIOS is set to boot from ada2 first. Other data: ===Cut=== # zpool status pool: zfsroot state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://illumos.org/msg/ZFS-8000-2Q scan: resilvered 352G in 9h34m with 0 errors on Thu Dec 12 09:20:25 2013 config: NAME STATE READ WRITE CKSUM zfsroot DEGRADED 0 0 0 mirror-0 DEGRADED 0 0 0 17492019096575782489 UNAVAIL 0 0 0 was /dev/diskid/DISK-MK0311YHG0P7KAp2 diskid/DISK-MK0311YHG8W4EAp2 ONLINE 0 0 0 logs ada0 ONLINE 0 0 0 errors: No known data errors # gpart show => 34 7814037101 ada1 GPT (3.6T) 34 4062 - free - (2.0M) 4096 128 1 freebsd-boot (64K) 4224 3968 - free - (1.9M) 8192 16777216 2 freebsd-swap (8.0G) 16785408 7797248000 3 freebsd-zfs (3.6T) 7814033408 3727 - free - (1.8M) => 34 5860533101 diskid/DISK-MK0311YHG8W4EA GPT (2.7T) 34 128 1 freebsd-boot (64K) 162 5860532973 2 freebsd-zfs (2.7T) # zpool get version zfsroot NAME PROPERTY VALUE SOURCE zfsroot version 28 local # camcontrol devlist at scbus0 target 0 lun 0 (ada0,pass0) at scbus4 target 0 lun 0 (ada1,pass1) at scbus5 target 0 lun 0 (ada2,pass2) # uname -a FreeBSD witchdoctor.hq.norma.perm.ru 10.0-BETA1 FreeBSD 10.0-BETA1 #0 r257042: Fri Oct 25 10:36:18 YEKT 2013 emz@ravenholm:/usr/obj/usr/src/sys/GENERIC amd64 # zdb -uuu zfsroot Uberblock: magic = 0000000000bab10c version = 28 txg = 14319226 guid_sum = 834775614900075866 timestamp = 1386855032 UTC = Thu Dec 12 19:30:32 2013 rootbp = DVA[0]=<0:1cdb997dc00:800> DVA[1]=<0:1823b8000:800> DVA[2]=<0:8903e6de00:800> [L0 DMU objset] fletcher4 uncompressed LE contiguous unique triple size=800L/800P birth=14319226L/14319226P fill=1536 cksum=9d27e4420:11a5620d1142:fe973030dd097:99a2a40f6f1dcdc # zdb zfsroot: version: 28 name: 'zfsroot' state: 0 txg: 14309424 pool_guid: 956623217810981947 hostid: 1697066120 hostname: 'witchdoctor.hq.norma.perm.ru' vdev_children: 2 vdev_tree: type: 'root' id: 0 guid: 956623217810981947 children[0]: type: 'mirror' id: 0 guid: 13487386534404888877 whole_disk: 0 metaslab_array: 23 metaslab_shift: 31 ashift: 9 asize: 3000588042240 is_log: 0 children[0]: type: 'disk' id: 0 guid: 17492019096575782489 path: '/dev/diskid/DISK-MK0311YHG0P7KAp2' phys_path: '/dev/diskid/DISK-MK0311YHG0P7KAp2' whole_disk: 0 not_present: 1 DTL: 29 children[1]: type: 'disk' id: 1 guid: 14768018157997934015 path: '/dev/diskid/DISK-MK0311YHG8W4EAp2' phys_path: '/dev/diskid/DISK-MK0311YHG8W4EAp2' whole_disk: 0 DTL: 27 children[1]: type: 'disk' id: 1 guid: 9470960829239143386 path: '/dev/ada0' phys_path: '/dev/ada0' whole_disk: 1 metaslab_array: 4113 metaslab_shift: 29 ashift: 9 asize: 80021553152 is_log: 1 create_txg: 14308146 features_for_read: ===Cut=== Thanks. Eugene.