Re: [htdig] indexing subdirectories

Subject: Re: [htdig] indexing subdirectories
From: Gilles Detillieux (
Date: Tue Feb 22 2000 - 07:35:36 PST

According to karin kosina:
> maybe this is a stupid question, but i have got a big problem with
> ht.//Dig.
> obviously, it does not index any subdirectories. it indexes all the
> files in the doc_root dir, but that's it. i have _not_ set max_hop_count
> to a lower number, and the limit for the search is just defined by the
> start_url.
> any ideas?
> i am using htdig 3.1.4 on a redhat 6.1 (kernel 2.2.12-20) box with
> apache 1.3.9.

Well, you should realise that htdig does not index subdirectories. It's
a spider that follows HTML links from one document to another. It won't
find documents that aren't directly or indirectly referenced by <a href=...>
tags in your start_url document(s). If you want to index all documents
on your site, whether linked or not, you'll need to produce a list of them
and use that as your start_url, or generate an HTML document that links to
all your files, and have htdig start with that document.

Gilles R. Detillieux              E-mail: <>
Spinal Cord Research Centre       WWW:
Dept. Physiology, U. of Manitoba  Phone:  (204)789-3766
Winnipeg, MB  R3E 3J7  (Canada)   Fax:    (204)789-3930

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Tue Feb 22 2000 - 07:39:17 PST