From owner-freebsd-questions Thu Jun 27 11:20:10 2002 Delivered-To: freebsd-questions@freebsd.org Received: from infinity.aesredfish.net (ns1.aesredfish.net [65.168.0.12]) by hub.freebsd.org (Postfix) with ESMTP id 5F23737B418 for ; Thu, 27 Jun 2002 11:19:25 -0700 (PDT) Received: from potentialtech.com (mhope-dhcp-65-168-1-181.dashfast.com [65.168.1.181]) by infinity.aesredfish.net (8.11.6/8.11.0) with ESMTP id g5RIJ6002961; Thu, 27 Jun 2002 14:19:07 -0400 Message-ID: <3D1B5895.5020704@potentialtech.com> Date: Thu, 27 Jun 2002 14:25:25 -0400 From: Bill Moran User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.0rc1) Gecko/20020502 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Philip Hallstrom Cc: freebsd-questions@FreeBSD.ORG Subject: Re: FTP/HTTP caching proxy for use with fetch and ports? References: <20020627103338.C21360-100000@cypress.adhesivemedia.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Philip Hallstrom wrote: > Hi all - > I've got a small LAN (4 machines) and I tend to install a lot of > the same ports on all the machines (usually using portupgrade). What I've > been doing up till now is installing on one machine and then ftp'ing the > distfiles over to the other machines and installing on them. I know I > could build packages and do it that way, but for whatever reason I don't. > > I started looking into caching proxies that would help automate this > process somewhat, but I haven't had much luck. I tried jftpgw (FTP only) > but could never get it to work right. Tried Apache's proxy which says it > will do both, but it seemed to only cache HTTP and it's not really > designed for "long term caching" so to speak. > > Anyone have any suggestions? Seems like this would be a common thing to > reduce bandwidth... In addition to the other suggestion (use NFS, which I have been doing with great success) you can use squid, which will cache both FTP and HTTP. Squid won't do what you want out of the box, however, and neither will fetch. Two things to do (in order) 1. Make sure fetch knows to use the proxy. The man page tells you how to do this. I believe you set an environ, but I'm not sure, read the man. 2. Make sure your proxy server will cache very large files. Squid refuses to cache very large files by default, and I'd guess other proxy servers do the same. Squid can be configured, however, to cache files no matter how large they are. On the proxies I've installed, this tweak has been a good idea. Just make sure you have enough disk space to cache all that stuff. -- Bill Moran Potential Technologies http://www.potentialtech.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message