Re: [htdig] htdig and cross-references

Geoff Hutchison (
Mon, 20 Sep 1999 09:49:01 -0500

At 4:10 AM +0200 9/20/99, Xhemil Meco wrote:
>What's the behaviour of htdig if it encounters two pages pointing to

If the URLs are different, htdig will index the two pages and move
on. Obviously most sites will have many "loops." The only problem
comes if such a loop occurs where at each step, the URL is unique. In
that case, it will appear that it is a new URL and htdig will index
the page repeatedly.

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to containing the single word unsubscribe in
the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Mon Sep 20 1999 - 08:11:16 PDT