Re: [htdig3-dev] Help request

Subject: Re: [htdig3-dev] Help request
From: Geoff Hutchison (
Date: Fri Feb 11 2000 - 06:01:26 PST

At 11:54 AM +0100 2/11/00, amrito wrote:
>When I specify a certain url, it looks as if htdig only indexes
>certain documents from that location.
>From where does htdig get the information, which files it includes
>in the indexing process?
>(From 'HREF' entries in 'welcome.html'?)

It's a "spider" so it follows every link it can find from the initial
start_url (which can be more than one). It will follow client-side
image-maps, frames, <LINK> tags, normal <a href> tags...

>Is there any possibility to tell htdig to include every (.html) file
>from a directory into its digging?

If you don't have a directory index for that directory (i.e. Apache's
FancyIndexing), the only way to do it is to make a list of the URLs.

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig3-dev mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Fri Feb 11 2000 - 06:23:23 PST