From owner-freebsd-questions Wed Oct 31 16:31:42 2001 Delivered-To: freebsd-questions@freebsd.org Received: from koza.acecape.com (koza2.acecape.com [66.9.36.222]) by hub.freebsd.org (Postfix) with ESMTP id 79BA437B401 for ; Wed, 31 Oct 2001 16:31:39 -0800 (PST) Received: from p65-147.acedsl.com (p65-147.acedsl.com [66.114.65.147]) by koza.acecape.com (8.10.1/8.9.3) with ESMTP id fA10VKo15151; Wed, 31 Oct 2001 19:31:20 -0500 (EST) Date: Wed, 31 Oct 2001 19:30:13 -0500 (EST) From: Francisco Reyes X-X-Sender: fran@zoraida.natserv.net To: Stijn Hoop Cc: smorton@acm.org, Lucas Bergman , Alson van der Meulen , FreeBSD Questions List Subject: Memory vs large number of files (was Archiving large number of files) In-Reply-To: <20011029232120.C75666@pcwin002.win.tue.nl> Message-ID: <20011031192039.Y5664-100000@zoraida.natserv.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On Mon, 29 Oct 2001, Stijn Hoop wrote: > On Mon, Oct 29, 2001 at 05:06:58PM -0500, Simon Morton wrote: > > > $ rm tarball.tar ; find . -print0 | xargs -0 tar rf tarball.tar > > > would probably do the trick then. > > > > > > --Stijn > > > > tar cf tarball.tar dir1 dir2 dir3 > > > > be the simplest way to do it? > > I agree that this is a simpler way to tar up a single directory, or a few > directories; I believe the original poster had to specify a lot of things > to backup. That's when the find | xargs answer came up. I have both cases. I have a few directories where I want the whole directory and another where I only want to tar files within a certain date range. I will look into the suggestions given for the cases where I don't want the whole directory. In terms of performance would memory help on case of large directories? I have directories which will have from 5,000 to 40,000 files. I don't think we will ever need the data after 30 days, but my boss wants me to archive all data. I figure I will tar and bzip2 the files daily. The directories in question get about 5,000 per day. Before I was cleaning them monthly. I am thinking about doing a daily tar. The problem is when we have to do any kind of research (usually involving the last 7 days). I would then have to expand several of these tar archives. Right now I have 128MB of RAM. Would going to 256 make things speedier? The machine in question is a Dell 500Mhz running FreeBSD 4.X stable. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message