From owner-freebsd-fs@FreeBSD.ORG Fri Mar 30 07:08:17 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9F61E1065678 for ; Fri, 30 Mar 2012 07:08:16 +0000 (UTC) (envelope-from mailer@mail.firmos.at) Received: from mail.firmos.at (mail.firmos.at [80.123.225.49]) by mx1.freebsd.org (Postfix) with ESMTP id 8C0F68FC12 for ; Fri, 30 Mar 2012 07:08:15 +0000 (UTC) Received: from [91.114.28.42] (helo=BigMac.local) by mail.firmos.at with esmtpsa (TLSv1:CAMELLIA256-SHA:256) (Exim 4.76 (FreeBSD)) (envelope-from ) id 1SDVw9-000H7U-1v for freebsd-fs@freebsd.org; Fri, 30 Mar 2012 09:07:53 +0200 Message-ID: <4F755BD7.7040308@firmos.at> Date: Fri, 30 Mar 2012 09:08:07 +0200 From: Franz Schober Organization: FirmOS Business Solutions Gmbh User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Sender: mailer@mail.firmos.at X-SA-Exim-Connect-IP: 91.114.28.42 X-SA-Exim-Mail-From: mailer@mail.firmos.at X-SA-Exim-Scanned: No (on mail.firmos.at); SAEximRunCond expanded to false Subject: Re: Re; ZFS Performance FreeBSD 9.0 vs. Openindiana X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2012 07:08:17 -0000 Thx for your input ! Am 29.03.12 12:51, schrieb grarpamp: > Knowing of no better... I find Iozone quite nice. > > However... I would first resolve these differences in > the test methodology before trying to compare > anything 74 revisions apart... and perhaps the > address width as well. > > Version $Revision: 3.323 $ > Compiled for 32 bit mode. > Build: Solaris10cc-64 > File size set to 4194304 KB > > Version $Revision: 3.397 $ > Compiled for 64 bit mode. > Build: freebsd > File size set to 4194304 KB I recompiled both iozone binaries to 3.398 64 bit, results are similar. Messurement files are below. > Then try to see where the average 45% speedup is occuring. > >> to run not only in cache >> Processor cache size set to 1024 Kbytes. > 128k could very well fit in a cache somewhere. > Such as say, the one above. > > As shown on the iozone site, I'd try graphing the full range > of record sizes as a first baseline comparison. In progress. > And poke around the sysctls to see how the zfs parameters > match up. Any hints about the very interresting sysctls about zfs tuning for FreeBSD here ? >> -c Include close() in the timing calculations. This is useful only >> if you suspect that close() is broken in the operating system >> currently under test. > Really, you do? Used the parameters here from an NFS testing paper, for the new tests I omitted this one. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > Iozone: Performance Test of File I/O Version $Revision: 3.398 $ Compiled for 64 bit mode. Build: freebsd Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer. Ben England. Run began: Thu Mar 29 14:19:38 2012 SYNC Mode. Record Size 128 KB File size set to 4194304 KB Command line used: iozone -o -t 8 -r 128k -s 4G Output is in Kbytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 Kbytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. Throughput test with 8 processes Each process writes a 4194304 Kbyte file in 128 Kbyte records Children see throughput for 8 initial writers = 150868.63 KB/sec Parent sees throughput for 8 initial writers = 150863.48 KB/sec Min throughput per process = 18857.70 KB/sec Max throughput per process = 18859.75 KB/sec Avg throughput per process = 18858.58 KB/sec Min xfer = 4193920.00 KB Children see throughput for 8 rewriters = 149426.29 KB/sec Parent sees throughput for 8 rewriters = 149424.16 KB/sec Min throughput per process = 18593.01 KB/sec Max throughput per process = 18746.05 KB/sec Avg throughput per process = 18678.29 KB/sec Min xfer = 4160128.00 KB Children see throughput for 8 readers = 1042745.14 KB/sec Parent sees throughput for 8 readers = 1041299.44 KB/sec Min throughput per process = 122961.57 KB/sec Max throughput per process = 133874.20 KB/sec Avg throughput per process = 130343.14 KB/sec Min xfer = 3852288.00 KB Children see throughput for 8 re-readers = 866942.31 KB/sec Parent sees throughput for 8 re-readers = 862920.82 KB/sec Min throughput per process = 104678.79 KB/sec Max throughput per process = 111929.87 KB/sec Avg throughput per process = 108367.79 KB/sec Min xfer = 3944832.00 KB Children see throughput for 8 reverse readers = 997806.75 KB/sec Parent sees throughput for 8 reverse readers = 988615.08 KB/sec Min throughput per process = 108911.76 KB/sec Max throughput per process = 144133.22 KB/sec Avg throughput per process = 124725.84 KB/sec Min xfer = 3181952.00 KB Children see throughput for 8 stride readers = 288693.36 KB/sec Parent sees throughput for 8 stride readers = 287774.92 KB/sec Min throughput per process = 33722.81 KB/sec Max throughput per process = 40996.01 KB/sec Avg throughput per process = 36086.67 KB/sec Min xfer = 3455104.00 KB Children see throughput for 8 random readers = 115986.33 KB/sec Parent sees throughput for 8 random readers = 115983.24 KB/sec Min throughput per process = 14144.19 KB/sec Max throughput per process = 14719.62 KB/sec Avg throughput per process = 14498.29 KB/sec Min xfer = 4030464.00 KB Children see throughput for 8 mixed workload = 189486.43 KB/sec Parent sees throughput for 8 mixed workload = 189470.53 KB/sec Min throughput per process = 12340.80 KB/sec Max throughput per process = 35010.00 KB/sec Avg throughput per process = 23685.80 KB/sec Min xfer = 1478528.00 KB Children see throughput for 8 random writers = 147573.26 KB/sec Parent sees throughput for 8 random writers = 147564.68 KB/sec Min throughput per process = 18446.08 KB/sec Max throughput per process = 18447.95 KB/sec Avg throughput per process = 18446.66 KB/sec Min xfer = 4193920.00 KB Children see throughput for 8 pwrite writers = 150153.40 KB/sec Parent sees throughput for 8 pwrite writers = 150151.15 KB/sec Min throughput per process = 18768.81 KB/sec Max throughput per process = 18769.74 KB/sec Avg throughput per process = 18769.18 KB/sec Min xfer = 4194176.00 KB Children see throughput for 8 pread readers = 1132129.56 KB/sec Parent sees throughput for 8 pread readers = 1132038.43 KB/sec Min throughput per process = 132049.78 KB/sec Max throughput per process = 149369.56 KB/sec Avg throughput per process = 141516.20 KB/sec Min xfer = 3708288.00 KB Children see throughput for 8 fwriters = 479942.93 KB/sec Parent sees throughput for 8 fwriters = 405355.22 KB/sec Min throughput per process = 51488.59 KB/sec Max throughput per process = 79697.76 KB/sec Avg throughput per process = 59992.87 KB/sec Min xfer = 4194304.00 KB Children see throughput for 8 freaders = 1305623.56 KB/sec Parent sees throughput for 8 freaders = 1274297.58 KB/sec Min throughput per process = 159303.33 KB/sec Max throughput per process = 170930.03 KB/sec Avg throughput per process = 163202.95 KB/sec Min xfer = 4194304.00 KB iozone test complete. Iozone: Performance Test of File I/O Version $Revision: 3.398 $ Compiled for 64 bit mode. Build: Solaris10gcc-64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer. Ben England. Run began: Thu Mar 29 14:26:32 2012 SYNC Mode. Record Size 128 KB File size set to 4194304 KB Command line used: /usr/benchmarks/iozone/iozone -o -t 8 -r 128k -s 4G Output is in Kbytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 Kbytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. Throughput test with 8 processes Each process writes a 4194304 Kbyte file in 128 Kbyte records Children see throughput for 8 initial writers = 163928.73 KB/sec Parent sees throughput for 8 initial writers = 163742.79 KB/sec Min throughput per process = 20472.19 KB/sec Max throughput per process = 20514.05 KB/sec Avg throughput per process = 20491.09 KB/sec Min xfer = 4185728.00 KB Children see throughput for 8 rewriters = 166042.96 KB/sec Parent sees throughput for 8 rewriters = 166022.58 KB/sec Min throughput per process = 20738.16 KB/sec Max throughput per process = 20785.44 KB/sec Avg throughput per process = 20755.37 KB/sec Min xfer = 4184960.00 KB Children see throughput for 8 readers = 1204767.22 KB/sec Parent sees throughput for 8 readers = 1204261.66 KB/sec Min throughput per process = 129381.34 KB/sec Max throughput per process = 193455.00 KB/sec Avg throughput per process = 150595.90 KB/sec Min xfer = 2804864.00 KB Children see throughput for 8 re-readers = 996214.55 KB/sec Parent sees throughput for 8 re-readers = 991045.12 KB/sec Min throughput per process = 123043.02 KB/sec Max throughput per process = 126982.37 KB/sec Avg throughput per process = 124526.82 KB/sec Min xfer = 4094208.00 KB Children see throughput for 8 reverse readers = 2712166.84 KB/sec Parent sees throughput for 8 reverse readers = 2634185.61 KB/sec Min throughput per process = 271423.66 KB/sec Max throughput per process = 581808.50 KB/sec Avg throughput per process = 339020.86 KB/sec Min xfer = 1995136.00 KB Children see throughput for 8 stride readers = 318718.81 KB/sec Parent sees throughput for 8 stride readers = 318551.66 KB/sec Min throughput per process = 32463.41 KB/sec Max throughput per process = 50197.65 KB/sec Avg throughput per process = 39839.85 KB/sec Min xfer = 2714112.00 KB Children see throughput for 8 random readers = 121252.01 KB/sec Parent sees throughput for 8 random readers = 121242.78 KB/sec Min throughput per process = 14592.07 KB/sec Max throughput per process = 16029.80 KB/sec Avg throughput per process = 15156.50 KB/sec Min xfer = 3818112.00 KB Children see throughput for 8 mixed workload = 192510.71 KB/sec Parent sees throughput for 8 mixed workload = 192398.09 KB/sec Min throughput per process = 12424.72 KB/sec Max throughput per process = 35641.26 KB/sec Avg throughput per process = 24063.84 KB/sec Min xfer = 1462912.00 KB Children see throughput for 8 random writers = 163482.42 KB/sec Parent sees throughput for 8 random writers = 163297.29 KB/sec Min throughput per process = 20411.26 KB/sec Max throughput per process = 20456.37 KB/sec Avg throughput per process = 20435.30 KB/sec Min xfer = 4185216.00 KB Children see throughput for 8 fwriters = 132004.80 KB/sec Parent sees throughput for 8 fwriters = 130492.16 KB/sec Min throughput per process = 16337.71 KB/sec Max throughput per process = 16703.73 KB/sec Avg throughput per process = 16500.60 KB/sec Min xfer = 4194304.00 KB Children see throughput for 8 freaders = 1069833.95 KB/sec Parent sees throughput for 8 freaders = 1064831.11 KB/sec Min throughput per process = 133137.16 KB/sec Max throughput per process = 135073.42 KB/sec Avg throughput per process = 133729.24 KB/sec Min xfer = 4194304.00 KB iozone test complete. Thx, Franz Schober