From owner-freebsd-stable@FreeBSD.ORG Wed Aug 4 15:09:58 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2C1E9106567C for ; Wed, 4 Aug 2010 15:09:58 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-ew0-f54.google.com (mail-ew0-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id ABD738FC1D for ; Wed, 4 Aug 2010 15:09:57 +0000 (UTC) Received: by ewy26 with SMTP id 26so2333557ewy.13 for ; Wed, 04 Aug 2010 08:09:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date :user-agent:references:in-reply-to:cc:mime-version:content-type :content-transfer-encoding:message-id; bh=bOx3aShTlWnYW2TDDO7pAfk7metPJJuMTBclbKSHHbs=; b=ogLVeJDBuwVI+BZZ0QZd3dRHYPt9CFYjWjjcYyZ1DoTXTC5EHYvYeWKoFXaXpV/+cp /Y4KsBraJoJDChwRkzpbpE7819I8rmedbPC90hHd7m7SDy9uy5tb6YUaDybFzWG4zi5q mlccVmGTLz4KXyoEETKqiu0kfTTsIRJix4s0E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:user-agent:references:in-reply-to:cc :mime-version:content-type:content-transfer-encoding:message-id; b=aYCk+QmTuEMrxURZE/bqfA5e3inQST3fixEp/yOTaO6k6ziH9CI/KUmE5s2KKcHNd/ 9+fYwWq1gJXzysd+r76pcK5eXXJMhUx0P8Gjioa+CQaUdUcWPzc+kLSo1n9JgVEofrs0 A5DQTQe9s7Hz28vRS9YeJiJi9GMYt9Xaitoks= Received: by 10.14.119.13 with SMTP id m13mr852291eeh.71.1280934596385; Wed, 04 Aug 2010 08:09:56 -0700 (PDT) Received: from alex.super ([91.195.101.86]) by mx.google.com with ESMTPS id a48sm12931260eei.13.2010.08.04.08.09.49 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 04 Aug 2010 08:09:53 -0700 (PDT) From: "Alex V. Petrov" To: Martin Matuska Date: Wed, 4 Aug 2010 23:09:44 +0800 User-Agent: KMail/1.13.5 (FreeBSD/8.1-STABLE; KDE/4.4.5; amd64; ; ) References: <201008042008.25679.alexvpetrov@gmail.com> <201008042213.31631.alexvpetrov@gmail.com> <4C597BD6.7080708@FreeBSD.org> In-Reply-To: <4C597BD6.7080708@FreeBSD.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <201008042309.44985.alexvpetrov@gmail.com> Cc: freebsd-stable@freebsd.org Subject: Re: zpool - low speed write X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Aug 2010 15:09:58 -0000 =D0=92 =D1=81=D0=BE=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D0=B8 =D0=BE=D1=82 = 4 =D0=B0=D0=B2=D0=B3=D1=83=D1=81=D1=82=D0=B0 2010 22:40:22 =D0=B2=D1=8B =D0= =BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB=D0=B8: > Try booting with the following on /boot/loader.conf: > vfs.zfs.vdev.max_pending=3D"10" > vfs.zfs.txg.write_limit_override=3D268435456 >=20 > And remove setting: > vfs.zfs.cache_flush_disable=3D1 >=20 > Then try a dd from /dev/zero. OK. dd if=3D/dev/zero of=3D/tank/test.zero bs=3D3M count=3D1000 1000+0 records in 1000+0 records out 3145728000 bytes transferred in 394.974934 secs (7964374 bytes/sec) During execution dd: zpool iostat -v 10 10 capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 819G 0 52 53,5K 4,09M ada4 601G 330G 0 18 20,2K 1,47M ada2 637G 291G 0 18 17,3K 1,45M ada3 730G 198G 0 16 15,9K 1,18M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 13 125 1,08M 9,22M ada4 600G 331G 4 43 390K 3,25M ada2 636G 292G 5 43 371K 3,32M ada3 729G 199G 3 38 345K 2,64M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 0 183 0 15,2M ada4 600G 331G 0 63 0 5,28M ada2 636G 292G 0 64 0 5,58M ada3 729G 199G 0 55 0 4,37M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 0 177 0 14,6M ada4 600G 331G 0 62 0 5,29M ada2 636G 292G 0 60 0 5,14M ada3 729G 199G 0 53 0 4,17M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 0 193 0 15,6M ada4 601G 330G 0 65 0 5,41M ada2 636G 292G 0 68 0 5,60M ada3 729G 199G 0 59 0 4,60M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 0 178 0 12,8M ada4 601G 330G 0 61 0 4,45M ada2 636G 292G 0 63 0 4,73M ada3 729G 199G 0 53 0 3,65M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 0 190 0 14,1M ada4 601G 330G 0 68 0 5,24M ada2 636G 292G 0 64 0 4,88M ada3 729G 199G 0 57 0 3,95M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 821G 4 178 269K 14,4M ada4 601G 330G 1 64 122K 5,47M ada2 636G 292G 1 60 77,2K 4,86M ada3 729G 199G 0 53 70,3K 4,03M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 820G 5 128 327K 7,26M ada4 601G 330G 1 39 128K 2,02M ada2 636G 292G 1 46 109K 2,95M ada3 730G 198G 1 41 90,5K 2,29M =2D--------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write =2D--------- ----- ----- ----- ----- ----- ----- tank 1,92T 820G 9 181 541K 10,3M ada4 601G 330G 3 65 181K 4,07M ada2 636G 292G 2 59 192K 3,44M ada3 730G 198G 2 56 168K 2,78M =2D--------- ----- ----- ----- ----- ----- ----- =2D---- Alex V. Petrov