Re: [htdig] indexing non linked documents

Torsten Neuer (
Sat, 22 May 1999 19:49:53 +0200

According to Gabriel Fenteany:
>For number 2, do you mean that, in Apache parlance, if "fancy indexing" is
>on and the directory is included in start_urls, htdig will index files even
>if they are not linked?

Yup, 'coz it will provide the linkage automagically.
But it
- works only in directories where no index document exists
- with the drawback of also attempting to index everything else
  that is in those directories and not explicitly excluded from
  digging by a bad_urls directive.
And since you don't want to have those server directories appear
in the search results, you'll have to tricks and twists to exclude
them in the search form. Depending on the depth of the directory
structure this can be extremely ugly and may even exceed certain
limits for passing on parameters (either HTTP or OS dependant) to
the htsearch application.


InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Sat May 22 1999 - 10:12:12 PDT