Re: [htdig] Using htdig to just collect/gather the pages


Subject: Re: [htdig] Using htdig to just collect/gather the pages
From: Peterman, Timothy P (timothy.p.peterman@lmco.com)
Date: Thu Jan 18 2001 - 12:02:05 PST


For that you might consider using "wget", which has the capability to
recursively retrieve web sites (among other things). See the following
for more info: http://www.gnu.org/software/wget/wget.html

Mark Friedman wrote:
>
> Is there a way to configure htdig to be used to just spider and collect
> pages and documents without doing any of the index/search related stuff?
>
> Thanks in advance.
>
> -Mark

-- 
Tim Peterman - Web Master,
IT&P Unix Support Group Technical Lead
Lockheed Martin EIS/NE&SS, Moorestown, NJ

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Thu Jan 18 2001 - 12:21:39 PST