[htdig] The 4:02 crash

Subject: [htdig] The 4:02 crash
From: Vincent QUERU (vqueru@free.fr)
Date: Tue Sep 12 2000 - 08:39:00 PDT

Hi !

I recently had trouble running htdig with cron but thanks to the "rundig.sh"
script you provided everything is
now fine but I noticed that every morning when I arrive at the office the search
engine had crashed.

But looking through Apache's access log I noticed the following 2 lines :

my_server - - [12/Sep/2000:04:02:00 +0200] "GET /robots.txt HTTP/1.0" 404 278
my_server - - [12/Sep/2000:04:02:00 +0200] "GET
/r2_admin/robot_init_page/?ht_dig_robot=1 HTTP/1.0" 401

I did not do a "robots.txt" file as my server is the only one to index the site.

It looks as if there is some kind of automatic indexing (of course 4:02 is
nowhere to be found in my crontab)
but I did not find anything in the documentation about it and the problem is
that after it my db.wordlist file is

What can I do to stop this ?

Thanks a lot !

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
FAQ: <http://www.htdig.org/FAQ.html>

This archive was generated by hypermail 2b28 : Tue Sep 12 2000 - 08:41:04 PDT