From owner-freebsd-stable@FreeBSD.ORG Thu Aug 5 04:47:53 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 019B91065674 for ; Thu, 5 Aug 2010 04:47:53 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-ew0-f54.google.com (mail-ew0-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id 7D9048FC0A for ; Thu, 5 Aug 2010 04:47:52 +0000 (UTC) Received: by ewy26 with SMTP id 26so2603826ewy.13 for ; Wed, 04 Aug 2010 21:47:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date :user-agent:references:in-reply-to:cc:mime-version:content-type :content-transfer-encoding:message-id; bh=5Nhwkw8mOdwYFSYCplSLNfH1VjXoqNMPybMDN2/TtxA=; b=vuTTX1G+Zp4vXB7LV4ZkwLQ7sd8bw97Td+AdmaawmrjHe3SeLrbFxk8M9b/0IMPEEO vMzrwrZh8DFWmeJUcMaRyZ0xdskBEBfH6D8Kj+2FiYuz9rzqnOelyPQ0yK+jPH/8trnJ pYzs4+5TUA4iVMK2idNELUQ5saiVwHbI/v5ac= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:user-agent:references:in-reply-to:cc :mime-version:content-type:content-transfer-encoding:message-id; b=OyXxikHt3yKZSfSeCwD9cfWQmqhVt0sJdtvyQHCf+FzKzSzOqXz3a0xYkeIQ5rvi1p PYorkNMA4VEgFYThId5xwCt7ZAycPncD8EA8hNNcLqaGkx5YcBb2OryPyaOYC1zf1OMD nx3oq3BYCM2uD+PK+UjtWs7POB+o8sBkPUkhg= Received: by 10.213.48.131 with SMTP id r3mr7249630ebf.69.1280983671561; Wed, 04 Aug 2010 21:47:51 -0700 (PDT) Received: from alex.super ([91.195.101.86]) by mx.google.com with ESMTPS id u9sm8061844eeh.5.2010.08.04.21.47.48 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 04 Aug 2010 21:47:50 -0700 (PDT) From: "Alex V. Petrov" To: Jeremy Chadwick Date: Thu, 5 Aug 2010 12:47:42 +0800 User-Agent: KMail/1.13.5 (FreeBSD/8.1-STABLE; KDE/4.4.5; amd64; ; ) References: <201008042008.25679.alexvpetrov@gmail.com> <20100805041752.GA89285@icarus.home.lan> In-Reply-To: <20100805041752.GA89285@icarus.home.lan> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201008051247.43260.alexvpetrov@gmail.com> Cc: freebsd-stable@freebsd.org Subject: Re: zpool - low speed write X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Aug 2010 04:47:53 -0000 > Your ada3 disk is different from the other two. Can you please provide > the output from the following 3 commands? > > camcontrol identify ada2 > camcontrol identify ada3 > camcontrol identify ada4 > > > vfs.zfs.cache_flush_disable=1 > > vfs.zfs.zil_disable=1 > > I question both of these settings, especially the latter. Please remove > them both and re-test your write performance. I removed all settings of zfs. Now it default. camcontrol identify ada2 pass2: ATA-8 SATA 2.x device pass2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model WDC WD10EADS-00M2B0 firmware revision 01.00A01 serial number WD-WCAV51709425 WWN 50014ee2adf88aae cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 1953525168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 Feature Support Enable Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no 0/0x0 unload no no free-fall no no data set management (TRIM) no ************* camcontrol identify ada3 pass3: ATA-8 SATA 2.x device pass3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model WDC WD10EADS-00L5B1 firmware revision 01.01A01 serial number WD-WCAU4D726772 WWN 50014ee238ab988 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 1953525168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 Feature Support Enable Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no 0/0x0 unload no no free-fall no no data set management (TRIM) no ************* camcontrol identify ada4 pass4: ATA-8 SATA 2.x device pass4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) protocol ATA/ATAPI-8 SATA 2.x device model WDC WD10EADS-00M2B0 firmware revision 01.00A01 serial number WD-WMAV50095864 WWN 50014ee014f3265 cylinders 16383 heads 16 sectors/track 63 sector size logical 512, physical 512, offset 0 LBA supported 268435455 sectors LBA48 supported 1953525168 sectors PIO supported PIO4 DMA supported WDMA2 UDMA6 Feature Support Enable Value Vendor read ahead yes yes write cache yes yes flush cache yes yes overlap no Tagged Command Queuing (TCQ) no no Native Command Queuing (NCQ) yes 32 tags SMART yes yes microcode download yes yes security yes no power management yes yes advanced power management no no 0/0x00 automatic acoustic management yes no 254/0xFE 128/0x80 media status notification no no power-up in Standby yes no write-read-verify no no 0/0x0 unload no no free-fall no no data set management (TRIM) no ************* dd if=/dev/zero of=/tank/test.zero bs=3M count=1000 1000+0 records in 1000+0 records out 3145728000 bytes transferred in 527.727573 secs (5960894 bytes/sec) During execution dd: zpool iostat -v 10 10 capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 48 25,4K 4,35M ada4 598G 333G 0 16 9,94K 1,56M ada2 633G 295G 0 16 7,26K 1,54M ada3 727G 201G 0 14 8,21K 1,25M ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 29 0 2,28M ada4 598G 333G 0 10 0 870K ada2 633G 295G 0 8 0 774K ada3 727G 201G 0 9 0 689K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 14 0 91,8K ada4 598G 333G 0 4 0 25,2K ada2 633G 295G 0 5 0 28,6K ada3 727G 201G 0 4 0 38,0K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 19 0 227K ada4 598G 333G 0 6 0 75,3K ada2 633G 295G 0 6 0 76,6K ada3 727G 201G 0 6 0 75,3K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 25 0 2,27M ada4 598G 333G 0 9 0 877K ada2 633G 295G 0 8 0 787K ada3 727G 201G 0 7 0 659K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 29 12,8K 2,51M ada4 598G 333G 0 11 0 1,07M ada2 633G 295G 0 9 0 750K ada3 727G 201G 0 8 12,8K 724K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 37 0 2,53M ada4 598G 333G 0 12 0 847K ada2 633G 295G 0 13 0 986K ada3 727G 201G 0 11 0 759K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 25 0 2,39M ada4 598G 333G 0 9 0 915K ada2 633G 295G 0 8 0 900K ada3 727G 201G 0 7 0 632K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 28 0 1,76M ada4 598G 333G 0 11 0 919K ada2 633G 295G 0 7 0 207K ada3 727G 201G 0 9 0 676K ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- tank 1,91T 829G 0 26 0 2,16M ada4 598G 333G 0 10 0 856K ada2 633G 295G 0 7 0 646K ada3 727G 201G 0 8 0 711K ---------- ----- ----- ----- ----- ----- ----- ----- Alex V. Petrov