Subject: [htdig] Indexing MANY directories
From: Roger Weiss (RogerW@trellix.com)
Date: Mon Jul 31 2000 - 07:28:11 PDT
> I want htdig to index my site, but am not sure of how to set up the config
> file to accomplish it.
> The structure is as follows:
> Under the main url, there are 20+ (category) directories, and under each
> of these directories are the user directories (many thousands).
> Within the user directories are the html files I want to index.
> I've tried putting the url with the category directories in the conf file
> for the start_url, but the indexing does not work. I believe because the
> html files are not directly under the category directories.
> I want the indexing to go thru each user directory within its category
> directory for all categories.
> Can htdig do that? I certainly can't put all 30,000+ sites into my config
> Thanks for your help.
> Roger Weiss
To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.
This archive was generated by hypermail 2b28 : Sun Jul 30 2000 - 21:26:41 PDT