From owner-freebsd-questions  Tue Mar  4 11:54:48 1997
Return-Path: <owner-questions>
Received: (from root@localhost)
          by freefall.freebsd.org (8.8.5/8.8.5) id LAA11850
          for questions-outgoing; Tue, 4 Mar 1997 11:54:48 -0800 (PST)
Received: from cedb.dpcsys.com (cedb.DPCSYS.com [209.25.4.3])
          by freefall.freebsd.org (8.8.5/8.8.5) with ESMTP id LAA11844
          for <questions@freebsd.org>; Tue, 4 Mar 1997 11:54:43 -0800 (PST)
Received: from localhost (dan@localhost) by cedb.dpcsys.com (8.8.5/8.8.2) with SMTP id TAA09399; Tue, 4 Mar 1997 19:35:28 GMT
Date: Tue, 4 Mar 1997 11:35:27 -0800 (PST)
From: Dan Busarow <dan@dpcsys.com>
To: Khetan Gajjar <khetan@iafrica.com>
cc: questions@freebsd.org
Subject: Re: Web search engines
In-Reply-To: <Pine.BSF.3.95q.970304171212.9050G-100000@chain-work.iafrica.com>
Message-ID: <Pine.UW2.3.95.970304113420.6898G-100000@cedb>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-questions@freebsd.org
X-Loop: FreeBSD.org
Precedence: bulk

On Tue, 4 Mar 1997, Khetan Gajjar wrote:
> Does anybody in -question land know of a good web search engine ? I've had
> a look at htDig, but it keeps core-dumping as soon as the databases get
> larger than 40MB. I tried Excite, but it requires all the documents to be
> on the same machine as the engine - not viable in our case, where the web
> server needs to index about 5/6 machines.

http://harvest.transarc.com

Takes a little bit of work to setup correctly but well worth
the effort.

Dan
-- 
 Dan Busarow                                                  714 443 4172
 DPC Systems / Beach.Net                                    dan@dpcsys.com
 Dana Point, California  83 09 EF 59 E0 11 89 B4   8D 09 DB FD E1 DD 0C 82