Re: htdig: meta robots tag problem

Geoff Hutchison (
Mon, 21 Sep 1998 23:15:14 -0400

><meta name="robots" content="index,nofollow">
>However, htsearch doesn't report the pages with this meta tag (I
>assume they were not indexed, right?). Is this htdig bug, or
>mistake on my part? What is a correct way of achieving the
>desire effect?

That *should* work. To see what's going on, try:

<meta name="robots" content="nofollow"> and see if you see the same behavior.


-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in
the body of the message.

This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:27:49 PST