Re: htdig: url rejected...


Geoff Hutchison (ghutchis@wso.williams.edu)
Mon, 30 Nov 1998 20:35:00 -0500


At 12:06 PM -0500 11/30/98, david bernick wrote:
>while running the htdig program, i get this message:
>
>url rejected: (level
>1)http://real.one21.net/sites/waterworks/contact_ww/welcome.htm
>A tag: pos = 2, position = ="showroom/welcome.htm">
>href: http://real.one21.net/sites/waterworks/showroom/welcome.htm ()

This means that the URL has matched one of the patterns for htdig to
exclude. For example, it could fall outside limit_urls_to, or have a
pattern that matches something in exclude_urls, or the server's robots.txt
file excludes it.

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-request@sdsu.edu containing the single word "unsubscribe" in
the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:28:55 PST