From owner-freebsd-questions Mon Jan 29 01:24:59 1996 Return-Path: owner-questions Received: (from root@localhost) by freefall.freebsd.org (8.7.3/8.7.3) id BAA16452 for questions-outgoing; Mon, 29 Jan 1996 01:24:59 -0800 (PST) Received: from resolver.viaduk.net (root@resolver.viaduk.net [194.44.78.1]) by freefall.freebsd.org (8.7.3/8.7.3) with SMTP id BAA16435 for ; Mon, 29 Jan 1996 01:24:38 -0800 (PST) Received: (from sns@localhost) by resolver.viaduk.net (8.6.12/8.6.12) id LAA14434; Mon, 29 Jan 1996 11:23:17 +0200 Date: Mon, 29 Jan 1996 11:23:16 +0200 (EET) From: Sergey Stepanenko To: Daniel Baker cc: freebsd-questions@freebsd.org Subject: Re: WWW Mirror? In-Reply-To: Message-ID: X-Contacts: +38 044 4625090 X-Organization: Viaduk-Telecom MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-questions@freebsd.org Precedence: bulk On Sun, 28 Jan 1996, Daniel Baker wrote: > Date: Sun, 28 Jan 1996 13:43:03 -0600 (CST) > From: Daniel Baker > To: freebsd-questions@freebsd.org > Subject: WWW Mirror? > > Does anyone know of a program for FreeBSD or something that can mirror a > WWW site? For example, mirroring all of www.freebsd.org onto my > webserver, is there a program to do that?? This is a modified version of Oscar Nierstrasz's # htget script. I have modified the code here, and added some new # procedures in the url, html and http lib. # # The original version (and newer ones) can be found on # # # Retrieves HTML pages, creating local copies in the _current_ # directory. The script will check for the last-modified stamp on the # document, and will not fetch it if the document isn't changed. # Options : # -abs - Relative URLs are converted to absolute URLs. # -r - All reachable UR"s with the same directory # prefixare fetched (will convert to rel. urls) # -fa - Will not check after timestamp (will work like # the old version of this script) # -s - Will send output to stdout instead of file > > Thanks > Daniel > > -- > Daniel Baker - Daniel@Cuckoo.COM > "Huhuhu, thank you, drive through please" > > With best . . Sergey Stepanenko - System/Network Administrator Technical Director - Viaduk-Telecom, Inc 10 Sagaidachnogo St., 254070 Kiev, Ukraine tel. +38 (044) 4168267 tel./fax +38 (044) 4625090 hostmaster@viaduk.net - sns@viaduk.net . .