RE: [htdig] Indexing MANY directories


Subject: RE: [htdig] Indexing MANY directories
From: Roger Weiss (RogerW@trellix.com)
Date: Mon Jul 31 2000 - 10:26:52 PDT


Are you saying that each category directory should contain a file with a
link to all the user directories within that category?
We're using Java Web Server, and I'm not aware of any files with built-in
dir listings.
However, wouldn't I need more than a dir listing? Wouldn't they have to be
in url (hyperlink) format so htdig could follow it?

This seems like a pretty basic feature...Am I missing something?

Thanks again,

Roger Weiss

-----Original Message-----
From: Geoff Hutchison [mailto:ghutchis@wso.williams.edu]
Sent: Monday, July 31, 2000 11:21 AM
To: Roger Weiss
Cc: 'htdig@htdig.org'
Subject: Re: [htdig] Indexing MANY directories

On Mon, 31 Jul 2000, Roger Weiss wrote:

> Under the main url, there are 20+ (category) directories, and under each
> of these directories are the user directories (many thousands).
> Within the user directories are the html files I want to index.

The first thing to remember is that htdig follows hyperlinks. As you've
described it, there are a bunch of disconnected websites. Do you have
directory listings from the main url to the categories and then from the
categories to the user directories?

If you have a webserver (e.g. Apache) that automatically generates a
directory listing for the directories, this would work.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Mon Jul 31 2000 - 00:25:15 PDT