From owner-freebsd-stable@FreeBSD.ORG Sat Sep 20 21:03:39 2014 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6EC44966 for ; Sat, 20 Sep 2014 21:03:39 +0000 (UTC) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 03E47AB7 for ; Sat, 20 Sep 2014 21:03:38 +0000 (UTC) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 513D5153A8D; Sat, 20 Sep 2014 23:03:35 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8dpnkl9cXuEx; Sat, 20 Sep 2014 23:02:56 +0200 (CEST) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 46882153A8B; Sat, 20 Sep 2014 23:02:56 +0200 (CEST) Message-ID: <541DEB82.3020709@digiware.nl> Date: Sat, 20 Sep 2014 23:02:58 +0200 From: Willem Jan Withagen User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Karl Denninger , freebsd-stable@freebsd.org Subject: Re: getting to 4K disk blocks in ZFS References: <540FF3C4.6010305@ish.com.au> <54114029.3060507@FreeBSD.org> <2128347.Ah5i0RTCvp@overcee.wemm.org> <541230F1.3060402@digiware.nl> <7D0869A9-C114-4C4F-877A-3FB26AD7737D@scsiguy.com> <607F83CE25104CE09C74935BA9E26485@multiplay.co.uk> <541CBD5B.8050603@denninger.net> In-Reply-To: <541CBD5B.8050603@denninger.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Sep 2014 21:03:39 -0000 On 20-9-2014 1:33, Karl Denninger wrote: > > On 9/19/2014 6:23 PM, Steven Hartland wrote: >> >> ----- Original Message ----- >>> From: "Justin T. Gibbs" >>> To: "Willem Jan Withagen" >>> Cc: "Steven Hartland" ; >>> ; "Andriy Gapon" ; >>> "Peter Wemm" ; "Aristedes Maniatis" >>> Sent: Saturday, September 20, 2014 12:07 AM >>> Subject: Re: getting to 4K disk blocks in ZFS >>> >>> >>> On Sep 11, 2014, at 5:32 PM, Willem Jan Withagen >>> wrote: >>> >>>> On 11-9-2014 19:49, Peter Wemm wrote: >>>>>> Another downside is 1/4th of uberblocks, 32 vs 128. >>>>>> Also, automatic sector size detection works great for me and I've >>> never had >>>>>> a need to manually tweak ashift. >>>>> >>>>> Unfortunately, I have. Same drive connected two different ways: >>>>> >>>>> da12 at mps1 bus 0 scbus1 target 11 lun 0 >>>>> da12: Fixed Direct Access SCSI-6 device >>>>> da12: 600.000MB/s transfers >>>>> da12: Command Queueing enabled >>>>> da12: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C) >>>>> >>>>> ada1 at ahcich1 bus 0 scbus3 target 0 lun 0 >>>>> ada1: ATA-8 SATA 3.x device >>>>> ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) >>>>> ada1: Command Queueing enabled >>>>> ada1: 3815447MB (7814037168 512 byte sectors: 16H 63S/T 16383C) >>>>> ada1: quirks=0x1<4K> >>>>> >>>>> The 4k flag is missing when it's on the sas controller. The Ident >>> strings are >>>>> changed. >>>>> >>>>> This came up elsewhere recently. >>>> >>>> I reported the same fact for the new set of WD REDs I installed. >>>> Seems that ada and da have different quirks tables... >>>> So disks on SATA connectors on the motherboard are diagnosed as >>> being 4Kb. >>>> The disks on my twa don't get the quirk and are considered 512b >>>> >>>> —WjW >>> >>> I’m surprised that we have to constantly add quirks. Are these >>> drives really >>> failing to report their ata params correctly? Is there a reason we >>> don’t >>> currently utilize the ata params data (which is already fetched for >>> trim/unmap >>> detection) to also set lbppbe (logical block per physical block >>> exponent) and >>> lalba (lowest aligned lba)? We may find that many of the existing >>> quirks are >>> unnecessary if we fix the probe code. >> >> On the contary I've not found a single drive which reports 4k sectors >> on its >> own, every single one that I've seen report 4k is because we've added a >> quirk for it :( >> >> > Where is Smartctl getting it from? > > smartctl -i /dev/da2 > smartctl 6.3 2014-07-26 r3976 [FreeBSD 10.1-BETA1 amd64] (local build) > Copyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org > > === START OF INFORMATION SECTION === > Device Model: HGST HDN724040ALE640 > Serial Number: PK2334PCG6NA0B > LU WWN Device Id: 5 000cca 24cc30684 > Firmware Version: MJAOA5E0 > User Capacity: 4,000,787,030,016 bytes [4.00 TB] > Sector Sizes: 512 bytes logical, 4096 bytes physical > Rotation Rate: 7200 rpm > Form Factor: 3.5 inches > Device is: Not in smartctl database [for details use: -P showall] > ATA Version is: ATA8-ACS T13/1699-D revision 4 > SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) > Local Time is: Fri Sep 19 18:33:16 2014 CDT > SMART support is: Available - device has SMART capability. > SMART support is: Enabled > > It's not coming from a database, as Smartctl doesn't know about these > (yet); they're too new. I really need to add the fact that it is on a Areca controller, other it does not show. (The 3ware was the server before that) ====================== [~wjw] root@zfs.digiware.nl# smartctl -a /dev/da2 smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.3-STABLE amd64] (local build) Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Vendor: WDC Product: WD30EFRX-68AX9N0 Revision: R001 User Capacity: 3,000,592,982,016 bytes [3.00 TB] Logical block size: 512 bytes Rotation Rate: 10000 rpm Logical Unit id: 0x0004d927fffff820 Serial number: WD-WMC1T4088786 Device type: disk Transport protocol: Fibre channel (FCP-2) Local Time is: Sat Sep 20 22:49:27 2014 CEST SMART support is: Available - device has SMART capability. SMART support is: Enabled Temperature Warning: Disabled or Not Supported ====================== So that does not give any other blocksize. And with additional controller knowledge: ====================== [~wjw] root@zfs.digiware.nl# smartctl -a -d areca,1 -T permissive /dev/arcmsr0 smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.3-STABLE amd64] (local build) Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Western Digital Red (AF) Device Model: WDC WD30EFRX-68AX9N0 Serial Number: WD-WMC1T4081674 LU WWN Device Id: 5 0014ee 60377e6b2 Firmware Version: 80.00A80 User Capacity: 3,000,592,982,016 bytes [3.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-2 (minor revision not indicated) SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s) Local Time is: Sat Sep 20 22:58:04 2014 CEST SMART support is: Available - device has SMART capability. SMART support is: Enabled ====================== --WjW