Re: [htdig] Problem with content-type text/html; charset=SOMETHING


Subject: Re: [htdig] Problem with content-type text/html; charset=SOMETHING
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Wed May 24 2000 - 19:27:49 PDT


At 3:44 PM -0700 5/24/00, Gordon Harty wrote:
>The content-type was the only thing I could think would be different.
>Both of these pages were being indexed. The meta data was added to
>both pages and then around the same time (I can't confirm that at
>exactly the same time but within the same week or so) these two sites
>were not indexed.
>
>Would Apache be picking up this meta information and feeding it to
>htdig?

I doubt it. You should probably turn on more debugging information
(e.g. -vvv or -vvvv) when calling htdig. With this level of
debugging, you can see the HTTP headers sent by Apache as well as
fairly detailed reasoning from htdig as far as rejecting or indexing
things.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Wed May 24 2000 - 17:25:27 PDT