htdig


Jim Geer (eti@searchexpress.com)
Tue, 25 Aug 1998 14:42:33 -0500


Hello,

Could I use htdig with the ASCII output option as a spider to download the first x bytes of
all WEB pages that meet a certain criteria, such as all containing the word nanotechnology?

If not, can it download, say, a million pages, so that I can develop the sub-set myself.?

Thanks,
Jim Geer
eti@cris.com



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:27:18 PST