From owner-freebsd-questions Tue Mar 4 07:12:07 1997 Return-Path: Received: (from root@localhost) by freefall.freebsd.org (8.8.5/8.8.5) id HAA25762 for questions-outgoing; Tue, 4 Mar 1997 07:12:07 -0800 (PST) Received: from chain-work.iafrica.com (chain-work.iafrica.com [196.31.1.66]) by freefall.freebsd.org (8.8.5/8.8.5) with ESMTP id HAA25755 for ; Tue, 4 Mar 1997 07:12:03 -0800 (PST) Received: from localhost (khetan@localhost) by chain-work.iafrica.com (8.8.5/8.8.5) with SMTP id RAA09245 for ; Tue, 4 Mar 1997 17:13:07 +0200 (SAT) Date: Tue, 4 Mar 1997 17:13:07 +0200 (SAT) From: Khetan Gajjar To: questions@freebsd.org Subject: Web search engines Message-ID: X-Alternate-Address: gjjkhe01@sonnenberg.uct.ac.za X-PGP-Fingerprint: FF F9 1C B8 39 06 1E CD 60 4C E8 57 2D A3 46 E7 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-questions@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Hi. Does anybody in -question land know of a good web search engine ? I've had a look at htDig, but it keeps core-dumping as soon as the databases get larger than 40MB. I tried Excite, but it requires all the documents to be on the same machine as the engine - not viable in our case, where the web server needs to index about 5/6 machines. Any advice appreciated. --- Khetan Gajjar [ http://www.iafrica.com/~khetan] I'm a FreeBSD User! [ http://www.freebsd.org ] PGP Key [finger khetan@chain.iafrica.com] UUNet Internet Africa [0800-030-002 & help@iafrica.com]