htdig: Question from new user...

Jim Serio (
Sun, 21 Sep 1997 18:57:33 -0700

Hi All,
   Just discovered this great program. Was using GlimpsHTTP
for a while and wasn't impressed. Anyway, I installed
3.0.8b2 without problems, except the rundig gives the
following errors:

[root@rollercoaster bin]# rundig
././rundig: @BIN_DIR@/htdig: No such file or directory
././rundig: @BIN_DIR@/htmerge: No such file or directory
././rundig: @BIN_DIR@/htnotify: No such file or directory
././rundig: @BIN_DIR@/htfuzzy: No such file or directory
././rundig: @BIN_DIR@/htfuzzy: No such file or directory

That's not that important though as I can still run htdig
manually. I am pretty sure I have setup the config file
properly. Relevant portions are:

limit_urls_to: ${start_url}
exclude_urls: /cgi-bin/ .cgi
exclude_urls: /images/ .gif
max_head_length: 75000

Now, when I run "htdig -i -v -s" I get the following:

[root@rollercoaster bin]# htdig -i -v -s

New server:, 80
0:0:0: ---+-* size = 2714
1:1:1: -----+------------
size = 1912
2:3:2: redirect
htdig: Run complete
htdig: 1 server seen:
htdig: 3 documents

It seems that it is not traversing my entire directory
structure, as I have multiple sub-directories with other
html files.

A test search for a word only in a file in one of the sub-dirs
confirms that it did not index them.

The only thing I can think of that I am doing wrong on my
end is that I do not use the full URL to any file in my
.html files. I also make extensive use of SSI. So, in my
index.html file, all files are referenced relatively, like
<a href="/census"> instead of <a href="">

Could that be the problem? It seems from what I understand
of this program is that it acts like a spider traversing
each link.

Any help on this would be appreciated.

BTW, I also run a few majordomo lists and *really* love the
web archive (Webarc) for this list. Besides hypermail, is
Webarc currently available or does anyone have pointers to
other majordomo -> www converters?


Jim Serio (PGP Key ID: 0xE5E9F23E)
World of Coasters -
The Web's Premier Coaster Site!
To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in
the body of the message.

This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:25:05 PST