Geoff Hutchison (ghutchis@wso.williams.edu)
Thu, 6 May 1999 10:41:25 -0400
>I know there is a general robot nofollow meta tag directive that htdig
>understands, but is there an htdig-specific nofollow command, like:
Nope.
>(analagous to the htdig-noindex command)?
This is only retained for backwards-compatibility. Since there's already a
robots meta tag, we'd prefer to stick to the standard.
>If not, any ideas for preventing just htdig from following local links from
>a document?
Beyond using the robot nofollow command? Use the robots.txt file. You can
give specific directives to individual robots.
You can also use the noindex_start and noindex_end attributes:
http://www.htdig.org/attrs.html#noindex_start
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.
This archive was generated by hypermail 2.0b3 on Thu May 06 1999 - 08:08:11 PDT