From owner-freebsd-fs@freebsd.org Thu Sep 8 16:35:47 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F320BD2AE1 for ; Thu, 8 Sep 2016 16:35:47 +0000 (UTC) (envelope-from rm@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 83F85D6F; Thu, 8 Sep 2016 16:35:47 +0000 (UTC) (envelope-from rm@FreeBSD.org) Received: from [127.0.0.1] (localhost [IPv6:::1]) by freefall.freebsd.org (Postfix) with ESMTP id 9D67F1C14; Thu, 8 Sep 2016 16:35:46 +0000 (UTC) (envelope-from rm@FreeBSD.org) Subject: Re: ZFS-8000-8A: assistance needed To: Maurizio Vairani , Ruslan Makhmatkhanov References: <11f2a660-304d-4a50-bab8-ec2a2737b3a4@FreeBSD.org> <98bfee78-5440-a105-829b-47a7790889cf@cloverinformatica.it> Cc: freebsd-fs@freebsd.org From: Ruslan Makhmatkhanov Message-ID: <352e1cbf-1daa-f78c-cb0b-0752e36f8928@FreeBSD.org> Date: Thu, 8 Sep 2016 19:34:23 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Sep 2016 16:35:47 -0000 Maurizio Vairani wrote on 09/08/2016 17:01: > Il 08/09/2016 15:16, Ruslan Makhmatkhanov ha scritto: >> Maurizio Vairani wrote on 09/08/2016 15:55: >>> Il 08/09/2016 13:46, Ruslan Makhmatkhanov ha scritto: >>>> Maurizio, much thanks for your answers. It made some things clearer, >>>> but some are still isn't. Please see my comments inline: >>>> >>>> I checked the disks with that labels and all of them seems ok: >>>> >>>> gpart show excerpt: >>>> """ >>>> Geom name: mfid2 >>>> 1. Name: mfid2p1 >>>> label: drive-07 >>>> Geom name: mfid3 >>>> 1. Name: mfid3p1 >>>> label: drive-08 >>>> Geom name: mfid4 >>>> 1. Name: mfid4p1 >>>> label: drive-09 >>>> """ >>>> >>>> I checked them all with smartctl -a -d sat /dev/pass2[3,4] and got >>>> >>>> """ >>>> SMART Status not supported: ATA return descriptor not supported by >>>> controller firmware >>>> SMART overall-health self-assessment test result: PASSED >>>> """ >>>> >>>> And they also seems ok in mfiutil: >>>> root:~ # mfiutil show volumes >>>> mfi0 Volumes: >>>> Id Size Level Stripe State Cache Name >>>> mfid0 ( 838G) RAID-0 256K OPTIMAL Disabled >>>> mfid1 ( 838G) RAID-0 256K OPTIMAL Disabled >>>> mfid2 ( 476G) RAID-0 256K OPTIMAL Disabled >>>> mfid3 ( 476G) RAID-0 256K OPTIMAL Disabled >>>> mfid4 ( 476G) RAID-0 256K OPTIMAL Disabled >>>> mfid5 ( 167G) RAID-0 64K OPTIMAL Writes >>>> mfid6 ( 167G) RAID-0 64K OPTIMAL Writes >>>> mfid7 ( 476G) RAID-0 64K OPTIMAL Writes >>>> >>>> I only wasn't able to read the smart status of mfid0/mfid1 (they are >>>> SCSI-6 drives according to mfiutil): >>>> >>>> smartctl -d scsi -a /dev/pass0[1] >>>> Standard Inquiry (36 bytes) failed [Input/output error] >>>> Retrying with a 64 byte Standard Inquiry >>>> Standard Inquiry (64 bytes) failed [Input/output error] >>>> >>>> But I'm not sure if I'm using correct type in -d switch (tried all of >>>> them). This drives doesn't seems participate in that zpool, but I'm >>>> interested in checking them too. >>>> >>> I don't know the LSI MegaRAID SAS controller but according to >>> https://www.smartmontools.org/wiki/Supported_RAID-Controllers >>> seems it is supported in FreeBSD. But what is the output of the command >>> "smartctl --scan" ? >>> >>> Regards, >>> Maurizio >> >> Sure, it is supported. >> [...] >> >> So it looks like mfid0 != pass0. And actually pass1 is an interface >> for mfid0? Right? >> > Yes, seems to me too. > > But, unfortunately, "mrsas (4) does not allow smartctl to access > S.M.A.R.T data from physical drive hidden under /dev/daX" > > bug: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=212211 > > Maurizio This makes sense now. Thank you! We'll try check the controller port and cables as suggested by gpalmer@ because error rates on both drives are equal and this is strange. And if this doesn't make a difference, then replace the drives. -- Regards, Ruslan T.O.S. Of Reality