From owner-freebsd-questions@FreeBSD.ORG Wed Jan 24 01:05:02 2007 Return-Path: X-Original-To: freebsd-questions@FreeBSD.ORG Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1067616A400 for ; Wed, 24 Jan 2007 01:05:02 +0000 (UTC) (envelope-from kline@tao.thought.org) Received: from tao.thought.org (dsl231-043-140.sea1.dsl.speakeasy.net [216.231.43.140]) by mx1.freebsd.org (Postfix) with ESMTP id AC5B613C441 for ; Wed, 24 Jan 2007 01:05:01 +0000 (UTC) (envelope-from kline@tao.thought.org) Received: from tao.thought.org (localhost [127.0.0.1]) by tao.thought.org (8.13.8/8.13.1) with ESMTP id l0O150jM078278 for ; Tue, 23 Jan 2007 17:05:00 -0800 (PST) (envelope-from kline@tao.thought.org) Received: (from kline@localhost) by tao.thought.org (8.13.8/8.13.1/Submit) id l0O1503s078271 for freebsd-questions@FreeBSD.ORG; Tue, 23 Jan 2007 17:05:00 -0800 (PST) (envelope-from kline) Date: Tue, 23 Jan 2007 17:05:00 -0800 From: Gary Kline To: FreeBSD Mailing List Message-ID: <20070124010459.GA77770@thought.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Organization: Thought Unlimited. Public service Unix since 1986. X-Of_Interest: Observing twenty years of service to the Unix community User-Agent: Mutt/1.5.13 (2006-08-11) Cc: Subject: How ignorant a question is this?? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jan 2007 01:05:02 -0000 Guys, Dunno how dumb this question is to ask, but given the breadth of knowledge on this list, this is the place; esp'ly since my question involves web-crawlers. Or spiders[?] So I'm thinking of setting loose my own crawler to search. Are there any network tools that will search for pages with a TOPIC and look for any kind of subtopics? Say the TOP="dogfood" and the subtopics are "for poodles", "standard poodles", "black poodles." i Am pretty good with the search engines, but I thought: just for the hell of it.... Any feedback will be greatly appreciated. tia, people, gary -- Gary Kline kline@thought.org www.thought.org Public Service Unix