Re: [htdig] delayed remove of bad urls

Subject: Re: [htdig] delayed remove of bad urls
From: Geoff Hutchison (
Date: Tue May 23 2000 - 15:06:40 PDT

At 8:48 PM +0200 5/23/00, wrote:
>Is there a way to avoid this? I can set remove_bad_urls to false, but
>in this case, bad url will never be removed! What I need is way
>to tell htmerge somethink like:
>Only remove bad urls, if they were last two weeks too!

Interesting idea. While ht://Dig stores the access time of documents
in the database, there is currently no use of this data.

One suggestion would be to ping the servers before you index them.

-Geoff Hutchison
Williams Students Online

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Tue May 23 2000 - 13:01:47 PDT