Re: [htdig] Indexing problems


Subject: Re: [htdig] Indexing problems
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Tue Jan 02 2001 - 21:07:33 PST


At 6:03 AM +0100 1/3/01, peter karlsson wrote:
>I seem to have some problem with htdig indexing my site; it does index
>and update the pages it initially indexed, but it never finds any new
>pages, even if they are linked from the previously indexed pages.

Does your server send a Last-Modified-Since: header? (Or put another
way, are many of these documents server-parsed or other dynamic
content?)

If so, try setting the modification_time_is_now attribute:
<http://www.htdig.org/attrs.html#modification_time_is_now>

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Tue Jan 02 2001 - 21:29:48 PST