From owner-freebsd-questions@FreeBSD.ORG Tue Jul 29 22:16:51 2003 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9950237B401 for ; Tue, 29 Jul 2003 22:16:51 -0700 (PDT) Received: from mta6.snfc21.pbi.net (mta6.snfc21.pbi.net [206.13.28.240]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1620543FA3 for ; Tue, 29 Jul 2003 22:16:51 -0700 (PDT) (envelope-from Hostmaster@Video2Video.Com) Received: from adsl-66-122-241-14.dsl.sndg02.pacbell.net ([66.122.241.14]) by mta6.snfc21.pbi.net (iPlanet Messaging Server 5.1 HotFix 1.6 (built Oct 18 2002)) with ESMTP id <0HIT00DCUO02EJ@mta6.snfc21.pbi.net> for FreeBSD-Questions@FreeBSD.Org; Tue, 29 Jul 2003 22:16:50 -0700 (PDT) Date: Tue, 29 Jul 2003 22:16:47 -0700 (PDT) From: Peter Leftwich X-X-Sender: root@Video2Video.Com To: SDBUG Message-id: <20030729221408.G16402-100000@Video2Video.Com> Organization: Video2Video Services - http://Www.Video2Video.Com MIME-version: 1.0 Content-type: TEXT/PLAIN; charset=US-ASCII Content-transfer-encoding: 7BIT cc: FreeBSD Questions LIST Subject: FW: Mirroring tool? web snake? getbot? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2003 05:16:51 -0000 Er, sort of cancel that. By luck, "Aria" falls at the early part of the alphabet and I seem to have found just the right graphical tool that can recurse X levels deep. The only problem is ... I think it respects a site's ".robots" or "robots.txt" file (this is bad). We'll see what I can come up with. It sure would be nice -- and worth registering just for the feature -- if Opera could download all files ending in "X" on current page and maintain (mirror) directory structure locally (to hard disk)!! The research goes on. ---------- Forwarded message ---------- From: Peter Leftwich To: SDBUG Cc: FreeBSD Questions LIST Subject: Mirroring tool? web snake? getbot? Date: Tue, 29 Jul 2003 21:54:39 -0700 (PDT) Hi all. I'm searching and searching the (X11 / GUI) ports at www.freebsd.org and www.freshmeat.net but I was wondering if some of you could help me with a better, targeted keyword that describes this kind of tool or application? All I'd like is a graphical tool that prompts the user for a URL then proceeds to mirror that URL to the working directory or to a "base" directory specified in its preferences. It would also be nice to filter by URL's ending in ___ for example, .jpg, .jpeg, .mp3, and so forth. I used a command line tool called "httrack" for many months until I found that upon each successive run of the program, it deletes the results of the last run! Stupid! Thanks for any ideas you all may have. -- Peter Leftwich President & Founder, Video2Video Services Box 13692, La Jolla, CA, 92039 USA http://Www.Video2Video.Com