From owner-freebsd-questions@FreeBSD.ORG Thu Apr 2 10:34:42 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 702E91065672 for ; Thu, 2 Apr 2009 10:34:42 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 9F7208FC16 for ; Thu, 2 Apr 2009 10:34:41 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from vhoffman.lon.namesco.net (150.117-84-212.staticip.namesco.net [212.84.117.150]) (authenticated bits=0) by unsane.co.uk (8.14.3/8.14.0) with ESMTP id n32Aaebs038353 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 2 Apr 2009 11:36:41 +0100 (BST) (envelope-from vince@unsane.co.uk) Message-ID: <49D494BE.2060603@unsane.co.uk> Date: Thu, 02 Apr 2009 11:34:38 +0100 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-GB; rv:1.9.1b3pre) Gecko/20081204 Thunderbird/3.0b1 MIME-Version: 1.0 To: "O. Hartmann" References: <200904011702.n31H2xZI071651@lurza.secnetix.de> <49D48851.8000901@zedat.fu-berlin.de> In-Reply-To: <49D48851.8000901@zedat.fu-berlin.de> X-Enigmail-Version: 0.96a Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org Subject: Re: Fetching directories inclusive subdirectories on HTTP server via fetch or othe FreeBSD-own tools? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Apr 2009 10:34:42 -0000 On 2/4/09 10:41, O. Hartmann wrote: > Oliver Fromme wrote: >> O. Hartmann wrote: >> > I run into a problem I can not solve. I need to fetch a whole >> directory > tree from a public remote site. The top level directory >> and its > subdirectories are accessible via ftp:// and http:// so I >> tried fetch, > but fetch does only retrieve data on file basis and >> does not copy a > whole directory tree recursively. The remote site >> does not offer > sftp/sshd for that purpose. >> > > Is there a simple way to perform such a task with FreeBSD's own >> tools (I > try to avoid installing 'wget' and sibblings)? I need to >> keep it simple, > task should be performed via cronjob. >> >> I'm afraid you can't do that with FreeBSD base tools. >> >> An alternative to wget would be "omi" (ports/ftp/omi) >> which is a simple FTP mirroring tool, written in C >> without any dependencies. Usage is simple: >> >> $ omi -s server.name.com -r /remote/dir -l ./local/dir >> >> Note that, by default, it tries to synchronize the local >> dir perfectly, i.e. if the remote dir is empty, it will >> wipe out the local dir. (The option "-P 0" will prevent >> omi from removing anything.) >> >> Best regards >> Oliver >> > > Thanks for so much answers. > > I tried 'omi' but I find that the tool does not travers deeper into a > dir than level one, so subdirs seem to be left out. I will try wget, > although this tool would not be the first choice. > I seem to remember that nctp3 had a decent -R recurse option to its get (or its ncftpget non interactive mode) if you want to avoid wget. Vince > > Thanks, > Oliver > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org"