From owner-freebsd-current@FreeBSD.ORG Mon Nov 5 11:34:51 2012 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 38102B86 for ; Mon, 5 Nov 2012 11:34:51 +0000 (UTC) (envelope-from paul-freebsd@fletchermoorland.co.uk) Received: from hercules.mthelicon.com (hercules.mthelicon.com [66.90.118.40]) by mx1.freebsd.org (Postfix) with ESMTP id 0162F8FC0C for ; Mon, 5 Nov 2012 11:34:50 +0000 (UTC) Received: from demophon.fletchermoorland.co.uk (hydra.fletchermoorland.co.uk [78.33.209.59] (may be forged)) (authenticated bits=0) by hercules.mthelicon.com (8.14.5/8.14.5) with ESMTP id qA5BYmlW054986; Mon, 5 Nov 2012 11:34:49 GMT (envelope-from paul-freebsd@fletchermoorland.co.uk) Message-ID: <5097A458.2030909@fletchermoorland.co.uk> Date: Mon, 05 Nov 2012 11:34:48 +0000 From: Paul Wootton User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:12.0) Gecko/20120530 Thunderbird/12.0.1 MIME-Version: 1.0 To: Steven Hartland Subject: Re: ZFS RaidZ-2 problems References: <508F98F9.3040604@fletchermoorland.co.uk> <50979436.4020907@fletchermoorland.co.uk> <749120126EF1493696FA77101C824F09@multiplay.co.uk> In-Reply-To: <749120126EF1493696FA77101C824F09@multiplay.co.uk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freeBSD-CURRENT Mailing List X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2012 11:34:51 -0000 On 11/05/12 10:49, Steven Hartland wrote: > Yes RAIDZ2 should enable a 2 drive failure without the array faulting so > something strange is going on there somewhere. That was my thought, but I dont know what or why. > > Silly question, what size drives and what driver are you using? > See below > Regards > Steve > > ----- Original Message ----- From: "Paul Wootton" > > To: "freeBSD-CURRENT Mailing List" > Sent: Monday, November 05, 2012 10:25 AM > Subject: ZFS RaidZ-2 problems > > >>> state: FAULTED >>> status: One or more devices could not be opened. There are >>> insufficient >>> replicas for the pool to continue functioning. >>> action: Attach the missing device and online it using 'zpool online'. >>> see: http://illumos.org/msg/ZFS-8000-3C >>> scan: resilvered 30K in 0h0m with 0 errors on Sun Oct 14 12:52:45 >>> 2012 >>> config: >>> >>> NAME STATE READ WRITE CKSUM >>> storage FAULTED 0 0 1 >>> raidz2-0 FAULTED 0 0 6 >>> ada0 ONLINE 0 0 0 >>> ada1 ONLINE 0 0 0 >>> ada2 ONLINE 0 0 0 >>> 17777811927559723424 UNAVAIL 0 0 0 was >>> /dev/ada3 >>> ada4 ONLINE 0 0 0 >>> ada5 ONLINE 0 0 0 >>> ada6 ONLINE 0 0 0 >>> ada7 ONLINE 0 0 0 >>> ada8 ONLINE 0 0 0 >>> ada10p4 ONLINE 0 0 0 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-8 SATA 2.x device ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 ada2 at ahcich2 bus 0 scbus3 target 0 lun 0 ada2: ATA-8 SATA 2.x device ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada2: Previously was known as ad10 ada3 at ahcich3 bus 0 scbus4 target 0 lun 0 ada3: ATA-8 SATA 2.x device ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada3: Previously was known as ad12 ada4 at ahcich5 bus 0 scbus7 target 0 lun 0 ada4: ATA-8 SATA 2.x device ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada4: Previously was known as ad18 ada5 at ahcich6 bus 0 scbus9 target 0 lun 0 ada5: ATA-8 SATA 2.x device ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada5: Command Queueing enabled ada5: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada5: Previously was known as ad22 ada6 at ahcich7 bus 0 scbus10 target 0 lun 0 ada6: ATA-8 SATA 2.x device ada6: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada6: Command Queueing enabled ada6: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada6: Previously was known as ad24 ada7 at ahcich8 bus 0 scbus11 target 0 lun 0 ada7: ATA-8 SATA 2.x device ada7: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada7: Command Queueing enabled ada7: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada7: Previously was known as ad26 ada8 at ahcich9 bus 0 scbus12 target 0 lun 0 ada8: ATA-8 SATA 2.x device ada8: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada8: Command Queueing enabled ada8: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada8: Previously was known as ad28 ada9 at ahcich10 bus 0 scbus13 target 0 lun 0 ada9: ATA-7 SATA 2.x device ada9: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada9: Command Queueing enabled ada9: 152627MB (312581808 512 byte sectors: 16H 63S/T 16383C) ada9: Previously was known as ad30 ada10 at ahcich11 bus 0 scbus14 target 0 lun 0 ada10: ATA-8 SATA 2.x device ada10: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada10: Command Queueing enabled ada10: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C) ada10: Previously was known as ad32 root@filekeeper:/dev # gpart show ada10 => 34 1953525101 ada10 GPT (931G) 34 256 1 freebsd-boot (128k) 290 16777216 2 freebsd-swap (8.0G) 16777506 335544320 3 freebsd-zfs (160G) 352321826 976773168 4 freebsd-zfs (465G) 1329094994 283115520 5 freebsd-zfs (135G) 1612210514 341314621 - free - (162G) pool: boot state: ONLINE status: Some supported features are not enabled on the pool. The pool can still be used, but some features are unavailable. action: Enable all features using 'zpool upgrade'. Once this is done, the pool may no longer be accessible by software that does not support the features. See zpool-features(5) for details. scan: scrub repaired 0 in 0h33m with 0 errors on Thu Oct 4 13:54:15 2012 config: NAME STATE READ WRITE CKSUM boot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 gptid/3f1627a2-0670-11e2-8347-6cf0490ff9e9 ONLINE 0 0 0 ada10p5 ONLINE 0 0 0 root@filekeeper:/dev # gpart list ada9 [...] 3. Name: ada9p3 Mediasize: 144955146240 (135G) Sectorsize: 512 Stripesize: 0 Stripeoffset: 148480 Mode: r1w1e2 rawuuid: 3f1627a2-0670-11e2-8347-6cf0490ff9e9 rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: (null) length: 144955146240 offset: 8590083072 type: freebsd-zfs index: 3 end: 299893025 start: 16777506 [...] Paul