From owner-freebsd-performance@FreeBSD.ORG Mon Jan 31 16:59:16 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EA6ED16A4CE; Mon, 31 Jan 2005 16:59:16 +0000 (GMT) Received: from avscan2.sentex.ca (avscan2.sentex.ca [199.212.134.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1426643D39; Mon, 31 Jan 2005 16:59:16 +0000 (GMT) (envelope-from mike@sentex.net) Received: from localhost (localhost.sentex.ca [127.0.0.1]) by avscan2.sentex.ca (8.12.11/8.12.11) with ESMTP id j0VGxFb9042942; Mon, 31 Jan 2005 11:59:15 -0500 (EST) (envelope-from mike@sentex.net) Received: from avscan2.sentex.ca ([127.0.0.1]) by localhost (avscan2.sentex.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 42340-08; Mon, 31 Jan 2005 11:59:15 -0500 (EST) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by avscan2.sentex.ca (8.12.11/8.12.11) with ESMTP id j0VGxFDZ042928; Mon, 31 Jan 2005 11:59:15 -0500 (EST) (envelope-from mike@sentex.net) Received: from simian.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.12.11/8.12.11) with ESMTP id j0VGx8iW086983; Mon, 31 Jan 2005 11:59:08 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <6.2.1.2.0.20050131101913.045736f8@64.7.153.2> X-Mailer: QUALCOMM Windows Eudora Version 6.2.1.2 Date: Mon, 31 Jan 2005 12:00:39 -0500 To: Robert Watson , jeff@freebsd.org From: Mike Tancsa In-Reply-To: <6.2.0.14.0.20050128145435.098e3d48@64.7.153.2> References: <6.2.0.14.0.20050127213817.02f19220@64.7.153.2> <6.2.0.14.0.20050128145435.098e3d48@64.7.153.2> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by amavisd-new X-Virus-Scanned: by amavisd-new at avscan2b cc: freebsd-performance@freebsd.org Subject: Re: FreeBSD 5.3 I/O Performance / Linux 2.6.10 | Continued Discussion X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Jan 2005 16:59:17 -0000 OK, I re-ran the tests on the same box using CURRENT as of this morning. There does not seem to be any large difference speed wise between RELENG_5 and HEAD, at least as it relates to the 3ware driver. Both RELENG_5 and HEAD are behind RELENG_4 and Linux 2.6.10 which are pretty equal in the tests that I did. I could not run the full NFS tests, and async nfs mounts are broken in RELENG_5 and HEAD. F=RELENG_5 L=Linux 2.6.10 H=FreeBSD Current Jan 31/2005 -------Sequential Output-------- ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU F 2000 33789 25.8 34065 8.3 14038 3.8 47484 44.6 67316 9.5 2873.7 5.7 L 2000 28073 62.0 22391 4.3 12189 2.0 17577 35.5 102132 5.5 1853.7 2.5 H 2000 33301 27.9 34832 8.3 12872 3.4 49762 46.8 67274 9.2 8078.1 15.1 HEAD PostMark v1.5 : 3/27/01 pm>set location /mnt pm>set size 300 100000 pm>set transactions 400000 pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 2435 seconds total 2432 seconds of transactions (164 per second) Files: 200107 created (82 per second) Creation alone: 500 files (250 per second) Mixed with transactions: 199607 files (82 per second) 199905 read (82 per second) 199384 appended (81 per second) 200107 deleted (82 per second) Deletion alone: 889 files (889 per second) Mixed with transactions: 199218 files (81 per second) Data: 12715.55 megabytes read (5.22 megabytes per second) 12728.92 megabytes written (5.23 megabytes per second) pm> LINUX 2.6.10 (EXT3 filesystem) pm>set size 300 100000 pm>set location /mnt pm>set transactions 400000 pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 1504 seconds total 1503 seconds of transactions (266 per second) Files: 200107 created (133 per second) Creation alone: 500 files (500 per second) Mixed with transactions: 199607 files (132 per second) 199905 read (133 per second) 199384 appended (132 per second) 200107 deleted (133 per second) Deletion alone: 889 files (889 per second) Mixed with transactions: 199218 files (132 per second) Data: 12715.55 megabytes read (8.45 megabytes per second) 12728.92 megabytes written (8.46 megabytes per second) pm> RELENG_5. PostMark v1.5 : 3/27/01 pm>set location /mnt pm>size 300 100000 Eh? pm>set size 300 100000 pm>set location /mnt pm>set transactions 400000 pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 2490 seconds total 2487 seconds of transactions (160 per second) Files: 200107 created (80 per second) Creation alone: 500 files (500 per second) Mixed with transactions: 199607 files (80 per second) 199905 read (80 per second) 199384 appended (80 per second) 200107 deleted (80 per second) Deletion alone: 889 files (444 per second) Mixed with transactions: 199218 files (80 per second) Data: 12715.55 megabytes read (5.11 megabytes per second) 12728.92 megabytes written (5.11 megabytes per second) pm> HEAD [nfs]# time dd if=/dev/zero of=/mnt/test bs=16k count=2000 2000+0 records in 2000+0 records out 32768000 bytes transferred in 0.761311 secs (43041540 bytes/sec) 0.008u 0.048s 0:00.84 4.7% 35+291k 0+258io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=32k count=2000 2000+0 records in 2000+0 records out 65536000 bytes transferred in 2.080178 secs (31504996 bytes/sec) 0.000u 0.116s 0:02.08 5.2% 29+285k 1+500io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=64k count=2000 2000+0 records in 2000+0 records out 131072000 bytes transferred in 3.381287 secs (38763940 bytes/sec) 0.000u 0.232s 0:03.39 6.7% 20+262k 2+1000io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=128k count=2000 time dd if=/dev/zero of=/mnt/test bs=256k count=2000 2000+0 records in 2000+0 records out 262144000 bytes transferred in 6.768166 secs (38731910 bytes/sec) 0.007u 0.477s 0:06.80 6.9% 26+495k 7+2000io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=256k count=2000 time dd if=/dev/zero of=/mnt/test bs=512k count=2000 2000+0 records in 2000+0 records out 524288000 bytes transferred in 14.230285 secs (36843113 bytes/sec) 0.000u 0.988s 0:14.29 6.8% 26+833k 6+4000io 0pf+0w [nfs]# [nfs]# time dd if=/dev/zero of=/mnt/test bs=512k count=2000 2000+0 records in 2000+0 records out 1048576000 bytes transferred in 28.617657 secs (36640875 bytes/sec) 0.000u 2.113s 0:28.72 7.3% 25+1430k 29+8000io 0pf+0w [nfs]# RELENG_5 [nfs]# time dd if=/dev/zero of=/mnt/test bs=16k count=2000 32768000 bytes transferred in 0.724865 secs (45205661 bytes/sec) 0.000u 0.066s 0:00.73 8.2% 33+281k 0+250io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=32k count=2000 65536000 bytes transferred in 1.731888 secs (37840788 bytes/sec) 0.000u 0.122s 0:01.74 6.8% 28+283k 0+500io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=64k count=2000 131072000 bytes transferred in 3.131403 secs (41857273 bytes/sec) 0.000u 0.245s 0:03.14 7.6% 25+335k 0+1000io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=128k count=2000 262144000 bytes transferred in 6.973014 secs (37594073 bytes/sec) 0.000u 0.509s 0:07.00 7.1% 26+510k 0+2000io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=256k count=2000 524288000 bytes transferred in 14.253915 secs (36782035 bytes/sec) 0.000u 1.003s 0:14.30 6.9% 25+784k 0+4000io 0pf+0w [nfs]# time dd if=/dev/zero of=/mnt/test bs=512k count=2000 1048576000 bytes transferred in 28.135716 secs (37268502 bytes/sec) 0.008u 2.165s 0:28.21 7.6% 24+1386k 0+8000io 0pf+0w [nfs]# NFS tests done from a RELENG_5 client with testfile.new in the servers cache [ns4-new]# time dd if=/dev/zero of=/mnt/testfile bs=16k count=16384 16384+0 records in 16384+0 records out 268435456 bytes transferred in 80.830089 secs (3320984 bytes/sec) 0.020u 0.442s 1:20.90 0.5% 29+254k 0+32768io 0pf+0w [ns4-new]# time dd if=/mnt/testfile.new of=/dev/null bs=16k 16384+0 records in 16384+0 records out 268435456 bytes transferred in 0.290720 secs (923347100 bytes/sec) 0.007u 0.283s 0:00.29 96.5% 26+227k 0+0io 0pf+0w postmark on nfs PostMark v1.5 : 3/27/01 pm>set size 300 100000 pm>set location /mnt pm>set transactions 400 pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 68 seconds total 64 seconds of transactions (6 per second) Files: 697 created (10 per second) Creation alone: 500 files (125 per second) Mixed with transactions: 197 files (3 per second) 194 read (3 per second) 206 appended (3 per second) 697 deleted (10 per second) Deletion alone: 494 files (494 per second) Mixed with transactions: 203 files (3 per second) Data: 10.26 megabytes read (154.52 kilobytes per second) 36.87 megabytes written (555.26 kilobytes per second) NFS on HEAD [ns4-new]# time dd if=/dev/zero of=/mnt/testfile bs=16k count=16384 16384+0 records in 16384+0 records out 268435456 bytes transferred in 52.172368 secs (5145165 bytes/sec) 0.016u 0.465s 0:52.23 0.8% 24+208k 0+32768io 0pf+0w [ns4-new]# time dd if=/mnt/testfile.new of=/dev/null bs=16k 16384+1 records in 16384+1 records out 268435774 bytes transferred in 6.328295 secs (42418341 bytes/sec) 0.023u 0.363s 0:06.36 5.9% 35+298k 0+0io 0pf+0w [ns4-new]# PostMark v1.5 : 3/27/01 pm>set location /mnt pm>set size 300 100000 pm>set transactions 400 pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 68 seconds total 63 seconds of transactions (6 per second) Files: 697 created (10 per second) Creation alone: 500 files (125 per second) Mixed with transactions: 197 files (3 per second) 194 read (3 per second) 206 appended (3 per second) 697 deleted (10 per second) Deletion alone: 494 files (494 per second) Mixed with transactions: 203 files (3 per second) Data: 10.26 megabytes read (154.52 kilobytes per second) 36.87 megabytes written (555.26 kilobytes per second) pm> NFS on head with vfs.nfsrv.async=1 [ns4-new]# time dd if=/dev/zero of=/mnt/testfile.async bs=16k count=16384 16384+0 records in 16384+0 records out 268435456 bytes transferred in 500.301252 secs (536548 bytes/sec) 0.018u 0.453s 8:20.53 0.0% 22+194k 0+32768io 0pf+0w [ns4-new]#