Jim Geer (
Tue, 25 Aug 1998 14:42:33 -0500


Could I use htdig with the ASCII output option as a spider to download the first x bytes of
all WEB pages that meet a certain criteria, such as all containing the word nanotechnology?

If not, can it download, say, a million pages, so that I can develop the sub-set myself.?

Jim Geer

This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:27:18 PST