From owner-freebsd-current@FreeBSD.ORG Tue Jan 30 20:05:04 2007 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0AECC16A403 for ; Tue, 30 Jan 2007 20:05:03 +0000 (UTC) (envelope-from roberthuff@rcn.com) Received: from smtp02.lnh.mail.rcn.net (smtp02.lnh.mail.rcn.net [207.172.157.102]) by mx1.freebsd.org (Postfix) with ESMTP id AEFA913C491 for ; Tue, 30 Jan 2007 20:05:03 +0000 (UTC) (envelope-from roberthuff@rcn.com) Received: from mr02.lnh.mail.rcn.net ([207.172.157.22]) by smtp02.lnh.mail.rcn.net with ESMTP; 30 Jan 2007 15:05:02 -0500 Received: from smtp01.lnh.mail.rcn.net (smtp01.lnh.mail.rcn.net [207.172.4.11]) by mr02.lnh.mail.rcn.net (MOS 3.7.5a-GA) with ESMTP id MVQ72874; Tue, 30 Jan 2007 15:04:42 -0500 (EST) Received: from 209-6-203-219.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com (HELO jerusalem.litteratus.org.litteratus.org) ([209.6.203.219]) by smtp01.lnh.mail.rcn.net with ESMTP; 30 Jan 2007 15:04:40 -0500 From: Robert Huff MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <17855.41967.928998.142397@jerusalem.litteratus.org> Date: Tue, 30 Jan 2007 15:00:47 -0500 To: freebsd-current@freebsd.org In-Reply-To: <20070130075708.GB892@turion.vk2pj.dyndns.org> References: <20070126224352.GD927@turion.vk2pj.dyndns.org> <17854.27369.656331.328734@jerusalem.litteratus.org> <20070130075708.GB892@turion.vk2pj.dyndns.org> X-Mailer: VM 7.17 under 21.5 (beta27) "fiddleheads" XEmacs Lucid X-Junkmail-Status: score=10/50, host=mr02.lnh.mail.rcn.net X-Junkmail-SD-Raw: score=unknown, refid=str=0001.0A090204.45BFA4EE.0063,ss=1,fgs=0, ip=207.172.4.11, so=2006-05-09 23:27:51, dmn=5.2.125/2006-10-10 Subject: Re: Interesting speed benchmarks X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jan 2007 20:05:04 -0000 Peter Jeremy writes: > >huff@>>dump 0 -D /tmp/DF -Lau -f /dev/null /usr >& /tmp/null_dump > > I'd drop the '-u' and '-D' and add a '-C'. When sizing the cache, > take into account that each dump subprocess (typically around 5) > will allocate that much RAM. huff@>>dump 0 -La -C 32 -f /dev/null /usr >& /tmp/null_dump huff@>>cat /tmp/null_dump DUMP: Date of this level 0 dump: Tue Jan 30 08:54:55 2007 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping snapshot of /dev/da1s1d (/usr) to /dev/null DUMP: mapping (Pass I) [regular files] DUMP: Cache 32 MB, blocksize = 65536 DUMP: mapping (Pass II) [directories] DUMP: estimated 26869650 tape blocks. DUMP: dumping (Pass III) [directories] DUMP: 0.55% done, finished in 15:06 at Wed Jan 31 00:06:45 2007 DUMP: dumping (Pass IV) [regular files] DUMP: 3.12% done, finished in 5:10 at Tue Jan 30 14:15:50 2007 DUMP: 6.47% done, finished in 3:36 at Tue Jan 30 12:47:08 2007 DUMP: 96.97% done, finished in 0:06 at Tue Jan 30 12:26:50 2007 DUMP: 98.77% done, finished in 0:02 at Tue Jan 30 12:28:03 2007 DUMP: 99.99% done, finished soon DUMP: DUMP: 27162681 tape blocks on 1 volume DUMP: finished in 12961 seconds, throughput 2095 KBytes/sec DUMP: Closing /dev/null DUMP: DUMP IS DONE For comparison: huff@>> dd if=/backup/Tue/usr/2007.Jan.30.usr.dump.tgz of=/dev/null 901411+1 records in 901411+1 records out 461522455 bytes transferred in 40.817512 secs (11306972 bytes/sec) > >huff@>>cat /tmp/null_dump > ... > > DUMP: DUMP: 27485576 tape blocks on 1 volume > > DUMP: finished in 13818 seconds, throughput 1989 KBytes/sec > > That is not good. Presumably the dmesg output looks sane (ie it's > not running narrow SCSI-1) and dd (or similar) report decent > thruput. kernel: ahc0: port 0xa400-0xa4ff mem 0xf1000000-0xf1000fff irq 11 at device 8.0 on pci0 kernel: ahc0: [GIANT-LOCKED] jerusalem kernel: da1 at ahc0 bus 0 target 4 lun 0 jerusalem kernel: da1: Fixed Direct Access SCSI-2 device jerusalem kernel: da1: 80.000MB/s transfers (40.000MHz, offset 15, 16bit) jerusalem kernel: da1: Command Queueing Enabled jerusalem kernel: da1: 47702MB (97693755 512 byte sectors: 255H 63S/T 6081C) > Can you provide some more details on the FS? What are the block > and frag sizes It's UFS2, with default Block and frag sizes. > and how many inodes are used? huff@>>df -i | grep usr Filesystem 1024-blocks Used Avail Capacity iused ifree %iused Mounted on /dev/da1s1d 46287340 26883474 15700880 63% 423220 5582538 7% /usr Robert Huff