Re: [htdig] indexing non linked documents

Torsten Neuer (
Sat, 22 May 1999 14:44:17 +0200

According to Patrick Robin:
>Is there a way to tell htdig to index all html documents
>in a directory structure, including those who are not linked
>to by any other page?

At least there are 2 ways I could think of:

1) Include all documents (or at least the start documents) in the
   start_urls tag of the htdig fonriguration file.

2) ht://Dig can also index directory indices created by the web
   server, if your server creates them for the directories where
   no index document exists. That way you should get most files
   (but also those you don't want to be indexed such as modules
   which are included in server-side scripts).

IMO the first method would be the best.


InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Sat May 22 1999 - 05:05:56 PDT