From owner-freebsd-questions@FreeBSD.ORG Wed Apr 1 16:32:57 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5ADA21065675 for ; Wed, 1 Apr 2009 16:32:57 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id C1BAA8FC0A for ; Wed, 1 Apr 2009 16:32:56 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from vhoffman.lon.namesco.net (150.117-84-212.staticip.namesco.net [212.84.117.150]) (authenticated bits=0) by unsane.co.uk (8.14.3/8.14.0) with ESMTP id n31GYuvX021184 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Wed, 1 Apr 2009 17:34:57 +0100 (BST) (envelope-from vince@unsane.co.uk) Message-ID: <49D39735.6050204@unsane.co.uk> Date: Wed, 01 Apr 2009 17:32:53 +0100 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-GB; rv:1.9.1b3pre) Gecko/20081204 Thunderbird/3.0b1 MIME-Version: 1.0 To: "O. Hartmann" References: <49D39153.4020707@zedat.fu-berlin.de> In-Reply-To: <49D39153.4020707@zedat.fu-berlin.de> X-Enigmail-Version: 0.96a Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org Subject: Re: Fetching directories inclusive subdirectories on HTTP server via fetch or othe FreeBSD-own tools? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Apr 2009 16:32:57 -0000 On 1/4/09 17:07, O. Hartmann wrote: > Hello. > > I run into a problem I can not solve. I need to fetch a whole > directory tree from a public remote site. The top level directory and > its subdirectories are accessible via ftp:// and http:// so I tried > fetch, but fetch does only retrieve data on file basis and does not > copy a whole directory tree recursively. The remote site does not > offer sftp/sshd for that purpose. > > Is there a simple way to perform such a task with FreeBSD's own tools > (I try to avoid installing 'wget' and sibblings)? I need to keep it > simple, task should be performed via cronjob. > > Please eMail me. > Without writing a script to parse the output of fetch I dont think its possible (fetch the index via http, parse for dirs, decend into dir, rinse and repeat.) Looking at http://www.freebsd.org/doc/en/articles/hubs/mirror-howto.html which I would expect to suggest FreeBSDs own tools, suggests various ports to use. Vince > Thanks in advance, > > Oliver > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org"