Re: htdig: Digging: url rejected

Geoff Hutchison (
Sat, 14 Nov 1998 21:16:15 -0500

At 4:13 PM -0500 11/10/98, V. Ray Krebs III wrote:
>What does this error mean:
> url rejected: (level 1) ...

This means the URL was rejected for one of a few preliminary reasons:
1) It matched part of the "exclude_urls" directives
2) It was included as part of a server's robot.txt file
3) It had an extension that matched bad_extensions

Offhand, I'd guess it was #1.

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in
the body of the message.

This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:28:48 PST