Re: [htdig] local_urls

Subject: Re: [htdig] local_urls
From: Geoff Hutchison (
Date: Mon Feb 21 2000 - 18:11:46 PST

At 10:16 PM +0100 2/21/00, Gert Brantner wrote:
>i'm trying to index directories that are not linked anywhere from my
>site, the dirs are reachable via http. i thought i could achive this
>with the local_urls attribute, but there is no effect. i spent extra
>attention to trailing slashes and "="..

As you have figured out, this will not work. If the URLs are not
linked from anywhere, they will not be indexed unless you tell the
indexer about them! So you looked in the wrong place, you want to
supply information through the start_url attribute. If the
directories do not have automatic indexes themselves, you will need
to generate a list of the URLs using something like find.


-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Mon Feb 21 2000 - 18:37:42 PST