Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 1 Apr 2009 19:02:59 +0200 (CEST)
From:      Oliver Fromme <olli@lurza.secnetix.de>
To:        freebsd-questions@FreeBSD.ORG, ohartman@zedat.fu-berlin.de
Subject:   Re: Fetching directories inclusive subdirectories on HTTP server via fetch or othe FreeBSD-own tools?
Message-ID:  <200904011702.n31H2xZI071651@lurza.secnetix.de>
In-Reply-To: <49D39153.4020707@zedat.fu-berlin.de>

next in thread | previous in thread | raw e-mail | index | archive | help
O. Hartmann <ohartman@zedat.fu-berlin.de> wrote:
 > I run into a problem I can not solve. I need to fetch a whole directory 
 > tree from a public remote site. The top level directory and its 
 > subdirectories are accessible via ftp:// and http:// so I tried fetch, 
 > but fetch does only retrieve data on file basis and does not copy a 
 > whole directory tree recursively. The remote site does not offer 
 > sftp/sshd for that purpose.
 > 
 > Is there a simple way to perform such a task with FreeBSD's own tools (I 
 > try to avoid installing 'wget' and sibblings)? I need to keep it simple, 
 > task should be performed via cronjob.

I'm afraid you can't do that with FreeBSD base tools.

An alternative to wget would be "omi" (ports/ftp/omi)
which is a simple FTP mirroring tool, written in C
without any dependencies.  Usage is simple:

$ omi -s server.name.com -r /remote/dir -l ./local/dir

Note that, by default, it tries to synchronize the local
dir perfectly, i.e. if the remote dir is empty, it will
wipe out the local dir.  (The option "-P 0" will prevent
omi from removing anything.)

Best regards
   Oliver

-- 
Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M.
Handelsregister: Registergericht Muenchen, HRA 74606,  Geschäftsfuehrung:
secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün-
chen, HRB 125758,  Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart

FreeBSD-Dienstleistungen, -Produkte und mehr:  http://www.secnetix.de/bsd

"That's what I love about GUIs: They make simple tasks easier,
and complex tasks impossible."
        -- John William Chambless



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200904011702.n31H2xZI071651>