From owner-freebsd-hackers@FreeBSD.ORG Mon Jan 8 04:19:26 2007 Return-Path: X-Original-To: freebsd-hackers@freebsd.org Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A501116A416 for ; Mon, 8 Jan 2007 04:19:26 +0000 (UTC) (envelope-from dgilbert@daveg.ca) Received: from ox.eicat.ca (ox.eicat.ca [66.96.30.35]) by mx1.freebsd.org (Postfix) with ESMTP id 7C43C13C455 for ; Mon, 8 Jan 2007 04:19:26 +0000 (UTC) (envelope-from dgilbert@daveg.ca) Received: by ox.eicat.ca (Postfix, from userid 66) id 88CB7C18A; Sun, 7 Jan 2007 23:19:23 -0500 (EST) Received: by canoe.dclg.ca (Postfix, from userid 101) id CFBA750840; Sun, 7 Jan 2007 23:19:23 -0500 (EST) From: David Gilbert MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <17825.50763.781656.393704@canoe.dclg.ca> Date: Sun, 7 Jan 2007 23:19:23 -0500 To: Dan Nelson In-Reply-To: <20070108033046.GA41724@dan.emsphone.com> References: <17825.44456.556954.545497@canoe.dclg.ca> <20070108033046.GA41724@dan.emsphone.com> X-Mailer: VM 7.17 under 21.4 (patch 19) "Constant Variable" XEmacs Lucid Cc: freebsd-hackers@freebsd.org, David Gilbert Subject: Re: dump reads more than restore writes? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jan 2007 04:19:26 -0000 >>>>> "Dan" == Dan Nelson writes: Dan> If you have a lot of small files, dump may be rereading directory Dan> information. Dump has a cache option that can help, but make Dan> sure you also dump a snapshot (i.e. always use -L when using -C). Several people have suggested this, but actually it has the same behaviour when using -C (I often use -C 32). This filesystem is not mounted, so -L is not required, but I do use -L when required. But the filesystem is 95% full (aren't they all) and the vast majority of the files on it are "media" files --- ie: movies, mp3's, ISOs, etc. Very few files under a meg. Probably not too many files over 100 meg as most of the files on the disk are in rar format. ... now Azurus (used to obtain most of the files) writes holey files. One chunk at a time (512k-ish to 4meg-ish). Those could end up being not-very-contiguous, but I'd expect them to consist (by majority) of full filesystem blocks. The amazing part (to me) is how consistent it is. If this is not a reporting error of gstat, it makes dump look _very_ wasteful. If the numbers are being reported correctly, it means that dump is reading 600 gig to copy a 200 gig disk. !?! Dave. -- ============================================================================ |David Gilbert, Independent Contractor. | Two things can be | |Mail: dave@daveg.ca | equal if and only if they | |http://daveg.ca | are precisely opposite. | =========================================================GLO================