Date: Fri, 16 Sep 2005 21:26:15 -0700 From: Gary Kline <kline@tao.thought.org> To: FreeBSD Mailing List <freebsd-questions@FreeBSD.ORG> Subject: is there a way to auto-gather web data? Message-ID: <20050917042615.GA70296@thought.org>
next in thread | raw e-mail | index | archive | help
Hi people, No, I'm not trying to "steal" this info--it has been in the public domain for cnturies. But on "the.public.foobar.com" there is an "/cgi/author.html?id=hallaj", let's say. In order to gleen the sayings from "hallaj" I have to click several times before the paragraphs are displayed. wget fails on this one. I'd like to scarf up all their sayings automagically.... Anybody know how to automate my clicking? There are at least 150 authors, each with N blurbs. :-X ...Talk about carpal-tunnel syndrome. I've seen what spambots can do to my guestbooks, so this may be a __black art__. tia, y'all, gary -- Gary Kline kline@thought.org www.thought.org Public service Unix
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20050917042615.GA70296>