RE: [htdig] website indexer and local file indexer

Subject: RE: [htdig] website indexer and local file indexer
From: David McMahon (
Date: Sun Feb 27 2000 - 09:53:04 PST

I remember installing an altavista tool about 4 years
ago that did exactly this. It went through and indexed
my entired disk and allowed me to search on it using
the altavista interface and results template. Pretty
Of course it was a windows-only tool if i remember
correctly, but are there other tools that do this out
there today? I haven't been able to find one!

I will take a look at the code as well to see how
close htdig is to doing this.


> At 1:15 AM -0500 2/27/00, David McMahon wrote:
> >I would like the be able to just specify a
> >directory and have it recurse through looking
> >at every valid file type and index it. I don't see
> >that this is possible with htdig. Is this the case?
> This is correct. Ht://Dig follows links through documents, so unless
> you have some sort of directory index, it won't be able to do this.
> Of course, you can write a simple script and either use that as an
> index, or simply as a setting for your start_url setting.
> The 3.2 branch of the code currently supports file:// URLs and it has
> been suggested that this code could generate a list of files for
> directory URLs, but no one has stepped forward to implement this
> feature. Help is, of course, always welcome.
> -Geoff Hutchison
> Williams Students Online

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Sun Feb 27 2000 - 09:55:45 PST