Re: [htdig] delayed remove of bad urls


Subject: Re: [htdig] delayed remove of bad urls
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Tue May 23 2000 - 15:06:40 PDT


At 8:48 PM +0200 5/23/00, st002556@hrz1.hrz.tu-darmstadt.de wrote:
>Is there a way to avoid this? I can set remove_bad_urls to false, but
>in this case, bad url will never be removed! What I need is way
>to tell htmerge somethink like:
>
>Only remove bad urls, if they were last two weeks too!

Interesting idea. While ht://Dig stores the access time of documents
in the database, there is currently no use of this data.

One suggestion would be to ping the servers before you index them.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Tue May 23 2000 - 13:01:47 PDT