From owner-freebsd-fs@FreeBSD.ORG Mon Mar 18 19:13:50 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 4BFF04BB for ; Mon, 18 Mar 2013 19:13:50 +0000 (UTC) (envelope-from davide.damico@contactlab.com) Received: from mail2.shared.smtp.contactlab.it (mail2.shared.smtp.contactlab.it [93.94.37.7]) by mx1.freebsd.org (Postfix) with ESMTP id B57032C8 for ; Mon, 18 Mar 2013 19:13:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; d=contactlab.it; s=clab1; c=relaxed/relaxed; q=dns/txt; i=@contactlab.it; t=1363634027; h=From:Subject:Date:To:MIME-Version:Content-Type; bh=slIuux2+uiX4OxPB6aqnTNoxhyw/gXgfV/tyM51hZAw=; b=K9liGf6b4w2pLeTU1pVdgOmzvi9wFWvI/1nNGdfVqzon1KR4GZpheueEneMhKKM5 MI5D8af+uO2sPHZLU6oRo6BjEtIam0aoExSysOw3I0q3KuVQjAoqCgvJkFZY6Z7V Z+eHv5tU0EJ+1J32ee4qvALFJ7dCJ11BFFpX6xKfN0w=; Received: from [213.92.90.12] ([213.92.90.12:47782] helo=mail3.tomato.it) by t.contactlab.it (envelope-from ) (ecelerity 3.5.1.37854 r(Momo-dev:3.5.1.0)) with ESMTP id 2E/C3-24145-B6767415; Mon, 18 Mar 2013 20:13:47 +0100 Received: from mx3-master.housing.tomato.lan ([172.16.7.55]) by mail3.tomato.it with smtp (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1UHfVD-0009e7-AV for freebsd-fs@freebsd.org; Mon, 18 Mar 2013 20:13:47 +0100 Received: (qmail 37078 invoked by uid 80); 18 Mar 2013 19:13:47 -0000 To: Steven Hartland Subject: Re: FreBSD 9.1 and ZFS v28 performances X-PHP-Script: uebmeil.sys.tomatointeractive.it/index.php for 172.16.16.50 X-PHP-Originating-Script: 0:main.inc MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 18 Mar 2013 20:13:47 +0100 From: Davide D'Amico Organization: ContactLab Mail-Reply-To: In-Reply-To: <42B9D942BA134E16AFDDB564858CA007@multiplay.co.uk> References: <514729BD.2000608@contactlab.com> <810E5C08C2D149DBAC94E30678234995@multiplay.co.uk> <51473D1D.3050306@contactlab.com> <1DD6360145924BE0ABF2D0979287F5F4@multiplay.co.uk> <51474F2F.5040003@contactlab.com> <51475267.1050204@contactlab.com> <514757DD.9030705@contactlab.com> <42B9D942BA134E16AFDDB564858CA007@multiplay.co.uk> Message-ID: <1bfdea0efb95a7e06554dadf703d58e7@sys.tomatointeractive.it> X-Sender: davide.damico@contactlab.com User-Agent: Roundcube Webmail/0.8.5 Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: davide.damico@contactlab.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2013 19:13:50 -0000 > How does ZFS compare if you do it on 1 SSD as per your second > UFS test? As I'm wondering the mfi cache is kicking in? Well, it was a test :) The MFI cache is enabled because I am using mfid* as jbod (mfiutil create jbod mfid3 mfid4 mfid5 mfid6): > > While running the tests what sort of thing are you > seeing from gstat, any disks maxing? If so primarily > read or write? Here the r/w pattern using zpool iostat 2: DATA 52.2G 1.03T 102 0 1.60M 0 DATA 52.2G 1.03T 7 105 128K 674K DATA 52.2G 1.03T 40 0 655K 0 DATA 52.2G 1.03T 16 0 264K 0 DATA 52.2G 1.03T 7 154 120K 991K DATA 52.2G 1.03T 125 0 1.95M 0 DATA 52.2G 1.03T 44 117 711K 718K DATA 52.2G 1.03T 63 0 1015K 0 DATA 52.2G 1.03T 39 0 631K 0 DATA 52.2G 1.03T 1 152 24.0K 1006K DATA 52.2G 1.03T 9 0 152K 0 DATA 52.2G 1.03T 2 100 40.0K 571K DATA 52.2G 1.03T 41 0 663K 0 DATA 52.2G 1.03T 41 0 658K 89.9K DATA 52.2G 1.03T 1 114 24.0K 741K DATA 52.2G 1.03T 0 0 0 0 DATA 52.2G 1.03T 2 155 40.0K 977K DATA 52.2G 1.03T 3 0 63.9K 0 DATA 52.2G 1.03T 28 0 456K 0 DATA 52.2G 1.03T 98 125 1.49M 863K DATA 52.2G 1.03T 122 0 1.89M 0 DATA 52.2G 1.03T 70 123 1.10M 841K DATA 52.2G 1.03T 21 0 352K 0 DATA 52.2G 1.03T 1 0 24.0K 0 DATA 52.2G 1.03T 10 160 168K 1.06M DATA 52.2G 1.03T 6 0 112K 0 DATA 52.2G 1.03T 0 126 7.99K 908K DATA 52.2G 1.03T 50 0 807K 0 DATA 52.2G 1.03T 19 0 320K 97.9K DATA 52.2G 1.03T 4 122 66.9K 862K DATA 52.2G 1.03T 6 0 104K 0 DATA 52.2G 1.03T 0 164 0 1.06M DATA 52.2G 1.03T 128 0 2.01M 0 DATA 52.2G 1.03T 0 0 0 0 DATA 52.2G 1.03T 0 106 0 649K DATA 52.2G 1.03T 5 0 95.9K 0 DATA 52.2G 1.03T 8 114 144K 711K DATA 52.2G 1.03T 40 0 655K 0 DATA 52.2G 1.03T 47 0 759K 0 DATA 52.2G 1.03T 13 96 216K 551K DATA 52.2G 1.03T 2 0 40.0K 0 DATA 52.2G 1.03T 0 97 0 402K And the result from sysbench: General statistics: total time: 82.9567s total number of events: 1 total time taken by event execution: 82.9545s Using a SSD: # iostat mfid2 -x 2 tty mfid2 cpu tin tout KB/t tps MB/s us ni sy in id 0 32 125.21 31 3.84 0 0 0 0 99 0 170 0.00 0 0.00 1 0 0 0 99 0 22 0.00 0 0.00 3 0 2 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 32.00 2 0.08 3 0 1 0 96 0 22 32.00 0 0.02 3 0 1 0 96 0 22 4.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 2 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 1 0 96 0 22 0.00 0 0.00 3 0 2 0 96 0 22 44.80 67 2.95 3 0 1 0 96 0 22 87.58 9 0.81 3 0 2 0 96 0 22 32.00 3 0.09 2 0 2 0 96 0 585 0.00 0 0.00 3 0 1 0 96 0 22 4.00 0 0.00 0 0 0 0 100 And the result from sysbench: General statistics: total time: 36.1146s total number of events: 1 total time taken by event execution: 36.1123s That are the same results using SAS disks. d.