From owner-freebsd-questions@FreeBSD.ORG Thu Apr 2 09:43:07 2009 Return-Path: Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2DA14106566B for ; Thu, 2 Apr 2009 09:43:07 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id DB3D58FC17 for ; Thu, 2 Apr 2009 09:43:06 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1LpJRy-0004dV-5r>; Thu, 02 Apr 2009 11:43:06 +0200 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1LpJRy-0000cT-4d>; Thu, 02 Apr 2009 11:43:06 +0200 Message-ID: <49D48851.8000901@zedat.fu-berlin.de> Date: Thu, 02 Apr 2009 09:41:37 +0000 From: "O. Hartmann" Organization: Freie =?ISO-8859-15?Q?Universit=E4t_Berlin?= User-Agent: Thunderbird 2.0.0.21 (X11/20090323) MIME-Version: 1.0 To: freebsd-questions@FreeBSD.ORG, ohartman@zedat.fu-berlin.de References: <200904011702.n31H2xZI071651@lurza.secnetix.de> In-Reply-To: <200904011702.n31H2xZI071651@lurza.secnetix.de> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: 130.133.86.198 Cc: Subject: Re: Fetching directories inclusive subdirectories on HTTP server via fetch or othe FreeBSD-own tools? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Apr 2009 09:43:07 -0000 Oliver Fromme wrote: > O. Hartmann wrote: > > I run into a problem I can not solve. I need to fetch a whole directory > > tree from a public remote site. The top level directory and its > > subdirectories are accessible via ftp:// and http:// so I tried fetch, > > but fetch does only retrieve data on file basis and does not copy a > > whole directory tree recursively. The remote site does not offer > > sftp/sshd for that purpose. > > > > Is there a simple way to perform such a task with FreeBSD's own tools (I > > try to avoid installing 'wget' and sibblings)? I need to keep it simple, > > task should be performed via cronjob. > > I'm afraid you can't do that with FreeBSD base tools. > > An alternative to wget would be "omi" (ports/ftp/omi) > which is a simple FTP mirroring tool, written in C > without any dependencies. Usage is simple: > > $ omi -s server.name.com -r /remote/dir -l ./local/dir > > Note that, by default, it tries to synchronize the local > dir perfectly, i.e. if the remote dir is empty, it will > wipe out the local dir. (The option "-P 0" will prevent > omi from removing anything.) > > Best regards > Oliver > Thanks for so much answers. I tried 'omi' but I find that the tool does not travers deeper into a dir than level one, so subdirs seem to be left out. I will try wget, although this tool would not be the first choice. Thanks, Oliver